Students Are Likely Writing Millions of Papers With AI

Discover how students are increasingly using AI to write their papers, with millions containing AI-generated content. Turnitin's data shows that 11% of papers may contain AI-written language. Learn about the challenges in detecting AI usage and the impact on traditional essays. Read more.

Students are increasingly turning to AI to assist them in writing their papers, with millions of papers potentially containing AI-generated content, according to data released by Turnitin, a plagiarism detection service. The company’s AI writing detection tool, which has been trained on a vast range of student papers and other AI-generated texts, has reviewed over 200 million papers, revealing that 11 percent of them may contain AI-written language. While some critics express concerns about the potential biases and factual inaccuracies associated with AI-generated content, teachers are grappling with the challenge of detecting its use and holding students accountable. The use of word spinners and other AI software further complicates the issue, blurring the line between genuine student work and AI-generated content. As the relationship between students and AI continues to evolve, educators are encouraged to start conversations that explore the nuances of using generative AI in academic writing.

Introduction

In recent years, there has been a significant rise in the use of Artificial Intelligence (AI) in various fields, including writing. With the development of generative AI technology, students now have the ability to create papers with the assistance of AI software. This article explores the data on AI-generated papers, the impact of generative AI on writing, the challenges in detecting AI in writing, the types of AI software used by students, detection tools and bias, the adoption of AI detection software, and alternative approaches in addressing AI usage.

Data on AI-generated Papers

Turnitin’s AI writing detection tool

Turnitin, a plagiarism detection service, introduced an AI writing detection tool that has been trained on a vast number of papers written by students and AI-generated texts. This detector has reviewed over 200 million papers, and the results show that there is a significant amount of AI-written language present in student papers.

Number of papers reviewed

According to Turnitin, students have submitted more than 22 million papers that may have utilized generative AI in the past year. This data highlights the prevalence of AI usage in academic writing and its potential impact on the traditional essay format.

Percentage of papers with AI-written language

Out of the papers reviewed, Turnitin found that approximately 11 percent may contain AI-written language in about 20 percent of their content. This indicates that a substantial portion of student papers may have significant contributions from AI software.

False positive rate

Turnitin claims that its AI writing detection tool has a false positive rate of less than 1 percent when analyzing full documents. This suggests that the tool is relatively accurate in identifying AI-generated language in papers.

Impact of Generative AI on Writing

Concerns about the death of traditional essays

The introduction of generative AI, such as chatbots and other language models, has raised concerns about the potential decline of traditional essay writing. While these AI tools can synthesize information quickly, they are not always error-free and can produce biased or inaccurate content. However, students have found value in using chatbots for research, organizing ideas, and even as ghostwriters.

Flaws and limitations of generative AI

Generative AI has been known to create its own facts, cite non-existent academic references, and produce biased text, particularly regarding gender and race. These flaws highlight the limitations of relying solely on AI software for academic writing.

Use of chatbots and ghostwriting

Students have been utilizing chatbots and other generative AI tools for various purposes, including having chatbots write their papers, assisting them as brainstorming partners, or using AI as an aid in their writing process. In some cases, traces of generative AI have even been found in peer-reviewed and published academic writing.

Presence of generative AI in academic writing

Generative AI has become increasingly prevalent in academic writing, making it necessary to address the impact it has on traditional writing conventions. The ubiquity of AI software and its integration into writing processes raises questions about the authenticity and integrity of students’ work.

Challenges in Detecting AI in Writing

Desire to hold students accountable

Teachers and institutions have the desire to hold students accountable for using generative AI tools without proper permission or disclosure. However, detecting the use of AI in writing assignments presents several challenges.

Difficulty in proving AI usage

Proving the usage of AI in a given assignment is not a straightforward task. Generated text is still considered original, making it harder to differentiate between AI-generated content and content created solely by the student. This poses a challenge for instructors who want to detect and address AI usage appropriately.

Use of messy and untested detection methods

Instructors have attempted to find their own solutions for detecting AI in writing, often relying on messy and untested methods. These methods can lead to inaccurate results and distress for students. It is crucial to develop reliable and standardized detection methods that can effectively identify AI usage.

Inclusion of generative AI in grading processes

Adding to the complexity, some teachers have incorporated generative AI into their grading processes. This further blurs the line between authentic student work and AI-assisted writing.

Types of AI Software Used by Students

ChatGPT and similar large language models

ChatGPT and other large language models have gained popularity among students for their ability to synthesize information and assist with writing tasks. These AI tools allow students to generate content quickly and efficiently.

Word spinners

Word spinners are another type of AI software that rewrites text, making it less obvious that the work was either plagiarized or generated by AI. These tools can make it challenging for teachers to detect AI usage in student papers.

Use of tools like Grammarly

In addition to chatbots and word spinners, students also rely on tools like Grammarly, which now incorporates generative AI components. The increased integration of generative AI in familiar software blurs the boundaries of what students can and cannot use.

Detection Tools and Bias

Risk of bias in AI detectors

Detection tools themselves carry the risk of bias. English language learners, for example, may be more likely to trigger false positives in AI detectors, leading to potential unfair consequences.

False positives and English language learners

A study examining seven different AI detectors found a 61.3 percent false positive rate when evaluating English language proficiency exams. However, it did not specifically analyze the performance of Turnitin’s AI detector. Turnitin claims to have trained its detector on a diverse range of writing from both English language learners and native English speakers.

Accuracy of Turnitin compared to other tools

A test comparing 16 AI language detectors found that Turnitin was among the most accurate in identifying AI-generated papers. The evaluation involved undergraduate papers as well as papers created by AI. These findings suggest that Turnitin’s AI detection tool is effective in identifying the presence of generative AI.

Adoption of AI Detection Software

Pilot period and purchasing decisions

Many educational institutions had access to Turnitin’s AI detection software during a free pilot period, which concluded at the beginning of this year. Despite the risks associated with false positives and bias against English learners, a majority of Turnitin’s clients have chosen to purchase and implement the AI detection software.

Risks leading to universities pausing usage

However, some universities, such as Montclair State University, Vanderbilt University, and Northwestern University, have decided to pause the usage of Turnitin’s AI detector due to concerns about biased results and the inability of the tool to provide confirmation like it does for plagiarism. These universities recognize the potential value of AI in academia but acknowledge the need for further development and trust in the detection tools.

Alternative Approaches in Addressing AI Usage

Focus on conversations and nuance in using AI

Rather than relying solely on detection tools, teachers can focus on engaging students in conversations about the nuances and intricacies of using generative AI. This approach encourages open dialogue and promotes critical thinking about the appropriate and ethical boundaries of AI usage in academic writing.

Issues with bias and confirmation in plagiarism detection

Addressing the challenges of bias and confirmation in plagiarism detection is essential. The development of improved detection methods that consider the unique characteristics of generative AI can help ensure fair and accurate identification of AI usage without disregarding its potential benefits.

Conclusion

The integration of generative AI into academic writing has become increasingly prevalent, with students utilizing various AI tools to enhance their writing process. While there are concerns about the impact on traditional essays and the challenges in detecting AI usage, it is crucial to foster conversations, develop reliable detection methods, and address issues of bias and confirmation. As AI continues to evolve, finding a balance between leveraging its benefits and upholding academic integrity remains a key priority for educators and institutions.

Additional Resources

Related articles and stories

For more information on the topic, consider exploring the following articles and stories:

  1. “Here’s Proof the AI Boom Is Real: More People Are Tapping ChatGPT at Work” by Steven Levy
  2. “Perplexity’s Founder Was Inspired by Sundar Pichai. Now They’re Competing to Reinvent Search” by Aravind Srinivas
  3. “Your Kid May Already Be Watching AI-Generated Videos on YouTube” by Kate Knibbs
  4. “Inside the Creation of the World’s Most Powerful Open Source AI Model” by Will Knight

WIRED newsletter subscription

Stay up-to-date with the latest technology news and trends by subscribing to the WIRED newsletter.

Contact information and social media links

For further inquiries or to connect with WIRED, you can visit their website and access their contact information. Additionally, you can follow WIRED on various social media platforms for regular updates and engaging content.

Source: https://www.wired.com/story/student-papers-generative-ai-turnitin/