Prof. Daniel Schwarcz Quoted in Associated Press about Legal Studies and AI

Last year, Professor Daniel Schwarcz, former Minnesota Law Professor Jonathan Choi, Professor Kristin Hickman, and Professor Amy Monahan experimented with ChatGPT and had it take exams in torts, employee benefits, taxation, and aspects of constitutional law. The tests included a total of 95 multiple-choice questions and 12 essay questions. The chatbot generally did better on the essays than the multiple-choice questions, scoring in the 17th percentile of all students and the 7th percentile, respectively. But its essay performance was inconsistent. “It is becoming increasingly likely that in the near future, many lawyers will need to collaborate with AIs, like ChatGPT, both to save time and money and to improve the quality of their work product,” Schwarcz said.

The paper the four professors wrote, “ChatGPT Goes to Law School” was recently published in the Journal of Legal Education. Read the paper.