New Zealand Prime Minister Jacinda Ardern has conceded questions about safety on the country's most active volcano "must be answered", as the search for bodies missing on White Island continues.

Speaking after six bodies were returned from the site of Monday's deadly eruption in the Bay of Plenty, Ms Ardern cautioned debate about safety of tourists on the island and said coronial and workplace health and safety investigations must be completed without prejudice.