Former Indigenous Australians minister Ken Wyatt has warned governments must not walk away from the challenge of fixing disadvantage faced by Aboriginals and Torres Strait Islanders, expressing doubt that the leader of his former party would take serious action to close the gap.

Predicting “quiet Australians” will vote Yes in Saturday’s referendum on the Indigenous Voice to parliament, the one-time Liberal MP questioned Opposition Leader Peter Dutton’s commitment to advancing reconciliation.