State and territory governments will share in $2 billion of new funding for public housing, as federal Labor faces mounting pressure over its stalled plan to build 30,000 additional homes.

Prime Minister Anthony Albanese will use a speech to the Victorian Labor conference on Saturday to announce a new social housing accelerator plan, with the cash to flow to the states within two weeks.