First school rules for AI chatbots in classrooms

‘We have to be really careful.’ Why Australia’s biggest schooling system has slammed the brakes on AI in classrooms.

Education ministers have released the first guidelines for the use of AI in schools.

School students will be allowed to use artificial intelligence chatbots to write assignments so long as they tell their teachers, under the first rules for AI in classrooms.

But Australia’s biggest public schooling system has slammed the brakes on the rollout of generative AI, which will not be ready for use in NSW by the start of the new school year.

Federal, state and territory education ministers yesterday released the first “framework’’ for the use of AI in schools, nearly two months after endorsing it in a private meeting.

The single-page framework advises schools to consider privacy, security and ethical concerns over AI – and warns of the risk students will use it to cheat.

“Generative AI technology has great potential to assist teaching and learning and reduce administrative workload in Australian schools,’’ it states.

“The growing accessibility and sophistication of generative AI tools provides opportunities to develop human-like generated text and rich multimedia content in a way that has not been previously possible.

“Schools will need to be supported in understanding and appropriately managing a range of privacy, security and ethical considerations.’’

The document says schools will need to risk-manage the “potential consequences’’ – including errors and algorithmic bias in AI-produced content.

The framework also warns of the “misuse of personal or confidential information’’.

And it states that generative AI – such as ChatGPT or Bard – could be used to “discriminate against individuals or groups, or to undermine the integrity of student assessments’’.

The framework fails to give teachers any specific guidance on which AI tools are best to use in schools, and how to use or manage it.

“Schools (should) engage students in learning about generative AI tools and how they work, including their potential limitations and biases, and deepen this learning as student usage increases,’’ it states.

Student assignments and homework should “clearly outline how generative AI tools should or should not be used, and allows for a clear and unbiased evaluation of student ability’’.

Under the heading of “academic integrity’’, the only guidance is that “students are supported to use generative AI tools ethically in their schoolwork, including by ensuring appropriate attribution’’.

The framework says AI tools must not “harm the wellbeing and safety’’ of teachers or students.

Citing privacy concerns, NSW Education Minister Prue Car said generative AI would not be used in public schools by the start of next year.

“We have to be really careful with the privacy, which is why we’re taking our time,’’ she said.

“We must ensure any future policy makes the technology accessible to everyone, no matter what their background.’’

NSW Education Minister Prue Car has raised privacy and equity concerns over AI. Picture: NCA NewsWire/ Adam Yip

Federal Education Minister Jason Clare said schools should not use generative AI products that sell student data, citing risks to children’s privacy and safety.

A Queensland Education Department spokeswoman said that 500 students from Years 5 to 12 were trailing the generative teaching and learning tool Cerego, which would be rolled out to all public schools next year.

“Cerego is an adaptive learning platform that uses generative AI and machine learning to provide quiz-based learning that quickly adjusts to the needs of individual students,’’ she said.

“A wide range of subjects including English, Physics, Science, Health, and Accounting are included in the trial that is providing a tailored learning experience for students.

“Teachers are able to quality assure content prior to delivering it to students.’’

South Australian Education Minister Blair Boyer said his department was working with Microsoft to develop a “safe version’’ of a chatbot which had been trialed in eight schools this year, and would be tested in eight more schools next year.

“AI will be a part of our work and lives in the future, which means we have a responsibility to educate young people about its appropriate use,’’ he said.

“If we don’t, we are doing them an incredible disservice.

“In South Australia, we have worked with Microsoft to develop a safe version for use in schools, with extra security features built in to safeguard student privacy and data.’’

Victorian Education Minister Ben Carroll said privacy and security were “paramount’’ for teachers and students.

Northern Territory Education Minister Eva Lawler said that generative AI would not replace teachers, but “enhance teaching’’.

West Australian Education Minister Dr Tony Buti said AI could “revolutionise education, change marking and assessments, lesson planning, even the way students provide feedback’’.

“However, we must ensure it is done safely and effectively,’’ he said.

###