Bar Battle of the Bots – Part One

Ralph Losey’s article evaluates the legal reasoning abilities of six advanced AI models from OpenAI and Google using a real 2024 Bar Exam essay question. Despite the high expectations, results varied significantly, with ChatGPT 4.0 emerging as the strongest contender, earning an A- for its relevant case citations and understanding of the Uniform Commercial Code (UCC). In contrast, some models, like Gemini Advanced, hallucinated information, revealing weaknesses. The findings suggest that while AI can match the average lawyer’s analytical skills, it still falls short of human expertise in nuanced legal analysis, emphasizing the need for continued human oversight and verification in legal practice.

Designing Generative AI for Legal Professionals: Key Principles and Best Practices

Generative AI is revolutionizing legal technology, providing tools to automate and enhance the workflows of legal professionals. However, developing effective AI applications requires an understanding of lawyers’ daily challenges. A study by IBM researchers outlines six design principles for creating AI tools tailored to legal practices: design responsibly, for mental models, for appropriate trust, for generative variability, for co-creation, and for imperfection. These principles guide developers in building user-friendly applications that enhance productivity while addressing ethical considerations. By fostering collaboration between developers and legal professionals, legal tech can evolve to meet the industry’s unique demands and improve efficiency.

Responding Party’s Complaints of Financial Burden of Document Review Were Unsupported by the Evidence, Any Evidence

One of the largest cases in the U.S. today is a consolidated group of price-fixing cases in District Court in Chicago. In Re Broiler Chicken Antitrust Litigation, 290 F. Supp. 3d 772 (N.D. Ill. 2017) (order denying motions to dismiss Read More …

Another Judge is Asked to Settle a Keyword Squabble and He Hesitates To Go Where Angels Fear To Tread: Only Tells the Parties What Keywords NOT To Use

In this blog we discuss yet another case where the parties are bickering over keywords and the judge was asked to intervene. Webastro Thermo & Comfort v. BesTop, Inc., 2018 WL 3198544, No.16-13456 (E.D. Mich. June 29, 2018). The opinion was Read More …

Project Cost Estimation Is Key To Opposing ESI Discovery as Disproportionately Burdensome Under Rule 26(b)(1)

If you are opposing ESI discovery as over-burdensome under Rule 26(b)(1), then you MUST provide evidence of the economic burden of the requested review. You cannot just say it is over-burdensome. Even if it seems obvious, you must provide some Read More …