Generative AI Detection Tools

Generative AI instruction and detection policies are on the rise

• 55% of law schools offer classes dedicated to teaching students about AI and how to use it effectively.
• 85% of law schools are considering additions to their curricula related to AI. 
• 69% of law schools have adapted their academic integrity policies in response to generative AI

- AI and Legal Education Survey (American Bar Association, ABA Task Force on Law and Artificial Intelligence)

Given the increase in generative AI instruction and use in the classroom, we have seen a corresponding uptick in faculty interest in AI detection tools. At USD, the rule on Artificial Intelligence Tool Usage in Written Work states that generative AI may not be included in written work for credit unless the instructor explicitly permits such use in the syllabus or elsewhere in writing. If a faculty member suspects use of generative AI in a way that has not been approved, they may choose to use an AI detector.  

But, do AI detection tools even work? 

In short, no. A June 2023 study of a dozen AI detectors found that they were "neither accurate nor reliable.” Similar studies from the University of Maryland and University of Adelaide documented the pitfalls inherent in accurately detecting AI generated text and ease of fooling AI detectors into believing text was human generated. 

This guide is not an endorsement of any particular tool. AI detectors are problematic and not recommended as a sole indicator of academic misconduct.  Given the widespread concerns about the accuracy of AI detection tools, instructors and institutions must balance preventing plagiarism with minimizing false accusations.  AI detectors should be used with caution and discernment, or not at all. 

If you suspect academic misconduct, reach out to Assistant Dean for Law Student Affairs at (619) 260-6851 or lawstudentaffairs@sandiego.edu.