The CFMEU has stood down about 20 workplace delegates with bikie links at building sites in Victoria, union sources have said, as it desperately tries to fend off going into administration over claims of corruption and underworld infiltration.

The militant construction union held a crisis meeting in Melbourne on Friday as the Fair Work Commission general manager continued reviewing his powers to apply to put it into external administration, several days after the Albanese government said it would back such a move.