An apartment building in New Westminster was heavily damaged by fire Friday afternoon, sending three people to hospital.