An AI to detect an AI

Created by Dalle-E

It is a common idiom to say “Set a thief to catch a thief”. A modified version of this phrase in the ChatGPT era is “Set AI to Catch AI”.

GPTzero.meĀ  is the new tool that has emerged to detect if any text has been generated by ChatGPT or similar AI and not by a human. This tool is developed to help educators to detect if AI has been used to generate text responses in essays and assignments. Just like the “Plagiarism” detection tool, this tool checks the text and identifies the possibility of a text having been generated by an AI.

At first glance it appears to be working reasonably fine and it generates an “Average Perplexity Score” ) measurement of randomness of the text) for the subject text and highlights possible portions generated by AI. Another score called the “Burstiness Score” measures the variation in perplexity.

The product could be useful to preserve the integrity of the education evaluation system as we use today though we need to re-work on our assessment systems soon.

Naavi

About Vijayashankar Na

Naavi is a veteran Cyber Law specialist in India and is presently working from Bangalore as an Information Assurance Consultant. Pioneered concepts such as ITA 2008 compliance, Naavi is also the founder of Cyber Law College, a virtual Cyber Law Education institution. He now has been focusing on the projects such as Secure Digital India and Cyber Insurance
This entry was posted in Cyber Law. Bookmark the permalink.

Leave a Reply

Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.