Date of Award

5-1-2015

Document Type

Thesis (Undergraduate)

Department or Program

Department of Computer Science

First Advisor

Peter Winkler

Second Advisor

Peter Doyle

Abstract

This paper constructs bounds on the minimax risk under loss functions when statistical estimation is performed in a distributed environment and with communication constraints. We treat this problem using techniques from information theory and communication complexity. In many cases our bounds rely crucially on metric entropy conditions and the classical reduction from estimation to testing. A number of examples exhibit how bounds on the minimax risk play out in practice. We also study distributed statistical estimation problems in the context of PAC-learnability and derive explicit algorithms for solving classical problems. We study the communication complexity of these algorithms.

Comments

Originally posted in the Dartmouth College Computer Science Technical Report Series, number TR2015-777.

COinS