Resistance is emerging among conservative Coalition MPs to recognising Indigenous Australians in the constitution and establishing a "voice to Parliament", with some fearing it could be seized upon by activist judges and usurp government decision-making.

Indigenous Australians Minister Ken Wyatt on Wednesday declared his intention to seek to build a consensus and hold a referendum in this term of Parliament, provided it would be assured of passing.