Police encountered a man during a foot patrol on Main Street last week who then ran away, leading to his arrest.
He's identified as 50-year-old Damon Lovett of Stamford.
Officers say when they caught him, he had a loaded gun and 34 bags of a substance believed to be crack cocaine.
Police also say the gun was stolen.
Bond is set at $250,000.