More than 65 firefighters are battling an apartment fire on Spencer Street after reports of smoke and flames from building.

"Crews were alerted to the blaze at 5.43am and the incident was quickly upgraded after the building was noted to have combustible cladding," the Melbourne Fire Brigade said in a statement.