Liberty Bank's Naugatuck branch is situated on the former site of philanthropist John Howard Whittemore's mansion, designed by Stanford White of the architectural firm McKim, Mead & White in 1888. This commission marked the beginning of Whittemore's collaboration with the firm, leading to several significant projects in Naugatuck. Although the mansion was destroyed by fire, the original stone walls and iron-pillared gateways from Whittemore's estate still border the property, preserving a connection to the past.

Whittemore, co-owner of the Naugatuck Malleable Iron Company, selected this location for its view of the iron mills below.

The current Neo-Victorian Liberty Bank building, constructed in 1974 and expanded in 1998, occupies the site, blending modern design with elements from the original estate.

Designated as a part of the Naugatuck Center Historic District on July 30, 1999.