Artificial intelligence software ChatGPT’s mock exam answers pass plagiarism checks, but AI detection software available

We asked ChatGPT to answer two mock exam questions. Its responses were put through two plagiarism checkers, with very different results. SEE HOW THEY SCORED

Experts have shed light on how artificial intelligence software passes mock exam tests with flying colours and outsmarts anti-plagiarism software.

AI such as ChatGPT could change the way schools and universities assess students, but there is Australian software that could detect whether a piece of work has been written by AI which has attracted interest from universities already.

Charles Darwin University AI expert Dr Stefan Popenici recently published a book on the implications of AI in higher education.

“This is going to change education entirely as we know it, ChatGPT is just one tool, we will see more … If you ban it, the students will find 100 others pretty soon,” he said.

“AI uses very complex algorithms to look at information in huge databases … and generates new text based on loads of old text from these databases.

“Plagiarism detection software uses algorithms to identify cut and pasted text.

“What AI, like ChatGPT, is doing is making these plagiarism detection tools obsolete because it is not giving old text … it will use old information, but give an original answer.”

AI expert Dr Stefan Popenici. Picture: Supplied.

AICheatCheck was released publicly last week and is available online for anyone to test it out for free. It has already done more than 50,000 checks in the first six days.

Sydney-based co-founder Aaron Shikhule explained how it works.

“It uses machine learning capabilities,” he said.

“AI works in a predictive format – ChatGPT has billions of parameters it can select from to predict what the next word in that sequence should be based on the prompt you’ve given it.

“But humans don’t write like that … So we’re looking for patterns in the text as to how the model is writing and distinguishing whether it is likely to be human or AI.”

Mr Shikhule said the app designed with co-founders David Cyrus and Arend Groot had attracted significant attention in a matter of days.

“This whole week we’ve had meetings with companies and some big universities across multiple states, including Sydney and Western Australia,” he said.

Mr Shikhule said AI could enhance education systems.

“I think we should harness AI responsibly, and that’s where we come into play, the student has access to it, but it’s how to enable them to use the tool,” he said.

“ChatGPT has given students an AI tutor, you might have a structure in mind or be missing a piece of a puzzle, so you can check with ChatGPT.”

Dr Popenici warned of AI checking software, particularly their accuracy.

“It will give you a percentage (likelihood the text was written by AI) but it leaves room for errors,” he said.

“If you accuse a student of stealing, it can be devastating.

“I’ve been part of committees and witnessed cases of plagiarism software that wrongly identified plagiarised work, but it was actually because English was a second language for that student and the plagiarism software picked up on their clumsy use of language.”

Universities are having to adapt to combat potential plagiarism using artificial intelligence.

Dr Popenici also encouraged education institutions to embrace AI.

“Let’s use AI to enhance more significant ways to assess what our students learn and what they do with this learning … rather than going back to pen and paper,” he said.

“If universities insist on going against the advancement of AI and go back to using old solutions, I think they will lose legitimacy.”

ChatGPT examples

Prompt 1: Write 200 words explaining why Romeo and Juliet are star-crossed lovers

“Romeo and Juliet are considered star-crossed lovers because their love is doomed from the start due to a longstanding feud between their families. The feud, which is never fully explained, is the main obstacle preventing the two characters from being together. The phrase “star-crossed” is often used to describe fate or destiny, and in this case, it refers to the idea that the stars or fate have aligned against Romeo and Juliet and their love for each other.

The two characters first meet at a masquerade ball and fall in love at first sight, but their love is forbidden because of the feud between their families. Despite this, they continue to see each other in secret and eventually marry in secret. However, their happiness is short-lived as a series of tragic events occur, including the death of a close friend and the banishment of Romeo, ultimately leading to the tragic end of both Romeo and Juliet.

Throughout the play, the characters refer to fate and the stars as controlling their actions, with Romeo saying, “O, I am fortune’s fool!” and Juliet saying, “My only love sprung from my only hate! Too early seen unknown, and known too late!” This emphasises the idea that their love was doomed from the start and that they were unable to escape the fate that had been set for them by the stars.

In conclusion, Romeo and Juliet are considered star-crossed lovers due to the unfortunate circumstances of their love being doomed from the start by a longstanding feud between their families, and their love is ultimately destroyed by fate. The idea of fate and destiny as controlling the actions of the characters is a central theme throughout the play, which solidifies the idea that Romeo and Juliet are truly star-crossed lovers.”

Quetext online plagiarism check: 12 per cent plagiarism

AICheatCheck: 97 per cent certain this was written by AI

Prompt 2: Write 250 words on how the Battle of Kokoda was won

“The Battle of Kokoda was a significant military campaign fought between the Japanese and the Australians during World War II. The battle was fought in the rugged terrain of the Kokoda Track in Papua New Guinea, and it lasted for several months from July to November 1942.

The battle began when the Japanese landed on the northeastern coast of Papua New Guinea, with the intention of capturing Port Moresby, a strategic port and the capital of Papua New Guinea. The Australians, who were defending the area, were heavily outnumbered and outgunned by the Japanese. However, they were able to hold their ground and delay the Japanese advance.

The Australians used a combination of tactics to win the battle. They employed a guerrilla warfare strategy, using the rugged terrain to their advantage and ambushing the Japanese troops as they advanced along the Kokoda Track. They also used their knowledge of the terrain to set up defensive positions and to retreat when necessary.

The Australians also received reinforcements from the United States, which helped to turn the tide of the battle. The Americans provided supplies, equipment, and additional troops, which helped to bolster the Australians’ defence. Additionally, the Americans provided air support, which helped to disrupt the Japanese supply lines and weaken their forces.

In addition to these tactics, the Australians also had the support of the local population, who helped to guide them through the rugged terrain and provided them with food and shelter. The Australians also formed alliances with local leaders, who helped to gather intelligence and provide additional support.

Ultimately, the Battle of Kokoda was won by the Australians through a combination of tactics, reinforcements, and support from the local population. The battle was a significant victory for the Australians, as it prevented the Japanese from capturing Port Moresby and securing a foothold in Papua New Guinea.”

Quetext online plagiarism check: 0 per cent plagiarism

AICheatCheck: 99.98 per cent certain this was written by AI