During the 1770's British Loyalists (who were known as Tories) met in this area, and it became known as Tory Corner.
A monument at intersection of Main Street and Washington street explains:
"Here in the 1770's in this area called Williamstown lived brothers Nathaniel and Benjamin Williams, prosperous farmers and operators of a saw and grist mill. As the Revolution approached, their loyalist views attracted people of similar sentiments who congregated at this intersection and it became known as Tory Corner.
"Mary WIlliams, wife of Nathaniel, did not accompany her husband to join the King's forces in 1777, but chose to tend the family farm and assist the cause of liberty. She kept and maintained the Williams' Property and her community and personal ties were able to withstand the strains of the Revolution." [1]