Bridgeport fire officials said the fire happened at Pine Point Drive just before noon on Monday.
Officials said the residents were out by the time the fire department arrived.
They say the Red Cross is assisting with the residents who were displaced.
The fire is under investigation by the fire marshal's office.