The Albanese government will junk its controversial Ministerial Direction 99 in two weeks and replace it with a new order it says will make it harder for foreigners who have committed crimes to appeal against the cancellation of their visas.

As the New Zealand government expressed fresh concerns, the opposition said the new order was too ambiguous and it would hone it further if elected to ensure there was little ground for foreign-born criminals to be allowed to stay.