Australia needs a proper debate on how to get its infrastructure needs right by potentially putting politicians at "arms length" to avoid wasteful decisions and white elephants, says Glenn Stevens.

Noting that Australia's AAA credit rating shouldn't be the only metric by which the budget is judged, Mr Stevens warned that questions around infrastructure should be separated from more urgent questions of how to manage the "recurrent" expenditure.