Several residents of Barrie were displaced after an early morning fire at an apartment building near the downtown.