Woodbury is located in Litchfield County west of Waterbury between Southbury and Watertown along Highway 6 on the banks of the Nonewaug River near Quassapaug Lake.