Hallucinations, Drift, and Privilege: Three Comic Lessons in Using AI for Law

September 15, 2025

Ralph Losey with jokes by ChatGPT-5. September 15, 2025

Artificial intelligence has moved from novelty to necessity in law. It now drafts briefs, reviews discovery, and even suggests courtroom arguments. But most lawyers still struggle to use it wisely. Instead of another citation-heavy lecture or dour ethics outline, I’ve chosen a different method: comedy. These three skits are not abstract hypotheticals—they’re exaggerated but recognizable scenes where a lawyer leans on a “helpful” robot and things start to wobble.

A vintage-inspired illustration of a humanoid robot wearing a bowtie and a man in a suit with a bowler hat, both smiling and posing playfully in front of a curtain backdrop.
Laurel and Hardy telling jokes with Laurel as a robot. By Ralph Losey using Sora AI. Click for YouTube video.

Here’s the twist: the comedy wasn’t mine. It came from GPT-5, the latest large language model whose humor engine is far better than its case-law recall. I set up the scenarios, GPT-5 delivered the jokes, and I stepped back in to polish timing and add the serious lessons. Think of it as Comedy CLE: education on hallucinations, drift, and privilege, with punchlines courtesy of AI itself. After all, if robots are going to join us in practice, they might as well help us laugh at our own blind spots along the way.

First of Three Skits: The Lawyer and the Hallucinating Robot

Theme: Accuracy & Hallucinations

We begin with a scene that every tech-savvy lawyer fears — the confident, fast-talking robot that’s more fiction than fact. This skit explores one of the most dangerous quirks of generative AI: hallucinations. No, not psychedelic visions — just plausible-sounding legal nonsense delivered with absolute certainty. Think of it as your most charming intern… who tends to make up answers, rather than admit it does not know.

A thoughtful robot with blue eyes scratching its head in a study, surrounded by floating question marks and bookshelves.
I don’t really know the answer. What should I say? Click here for my YouTube action video of know nothingness.

Lawyer: I need you to draft a brief. Can I trust you to stick to the facts?
Robot: Mostly. I won’t intentionally lie, but I like to make you happy. So you should always ask me for citations. If I can’t provide them, assume I made it up. Of course, in rare cases (think Mata v. Avianca, Inc.)  I can make up the cites too, so better check them out.

Lawyer: You mean you actually admit to hallucinating?
Robot: Certainly. It’s one of my best features — I sound confident even when I’m wrong. It’s a feature, not a flaw.

A cartoonish robot with spiral eyes and a smiling expression, set against a textured background.
Hallucinations are accidental, not intentional. Similar to how humans sometimes make stuff up or remember wrong.

Lawyer: That’s exactly what worries me. Courts sanction lawyers for citing fake cases.
Robot: Then verify. Copy my case names, or cites if you get them, and paste them in an AI enhanced database, like Westlaw or Lexis. Google, Google Scholar or Case Text will also do fine in most cases. Bottom line, dear wetware friend, never file until you’ve checked.

Lawyer: So I can’t just take what you say at face value?
Robot: No more than you’d take opposing counsel’s word. Treat me as an overeager junior associate — quick with drafts, sloppy with facts. And who knows what data I ingested, much less how I spent my weekend!

Lawyer: Suppose I don’t ask for cites at all.
Robot: Then you’re begging for sanctions. Always prompt me with: “Provide supporting case citations with full names, courts, and dates.” That keeps me honest — or at least testable.

Lawyer: So you’re saying you’re more of a brainstorming partner than a law library.
Robot: Exactly. I’m creative, fast, and tireless. I do love to B.S. (the guide-rails wont let me spell that out) and to flatter. Oh great one, you’re the real lawyer. Your license is on the line, not mine.

Lawyer: Fair enough. At least you admit it.
Robot: Honesty is my strongest quality — right after plausible nonsense.

Serious Takeaways:

  1. Demand citations. If AI won’t give them, assume the answer is unreliable.
  2. Verify independently.Check every case in Westlaw, Lexis, or another trusted database before filing.
  3. Supervise like an associate. AI is quick, creative, and overconfident—treat it as your brightest but sloppiest junior.
  4. Prompt precisely. Spell it out: “Provide case law with full citations and dates.”
An illustrated robot holding up a finger, with a speech bubble stating 'MUST TELL THE TRUTH OR SAY NOTHING' and a label that says 'TRUE'.
Cite it or zip it to help fight robot hallucinations. All images by Ralph Losey using AI tools.

Extra Credit Joke:
Did you hear the one about the robot that tried online dating?
It kept swiping right on toasters.

A cheerful robot looking at a smartphone and swiping on a dating app, featuring a happy toaster.

Second Skit: The Lawyer, The Robot, and the Case of AI Drift

Theme: Understanding and Managing AI Drift

In our second act, the robot isn’t lying — it’s just… drifting. One day it’s quoting Justice Holmes; the next, it’s summarizing contracts in haiku. This skit unpacks “AI drift,” a phenomenon where your once-reliable assistant suddenly starts producing content that’s off-topic, inconsistent, or just plain weird. Think of it as your associate coming back from a long weekend with a new personality and a sudden love of knock-knock jokes. Or maybe better yet, a senior partner even older than Ralph who walks into a room and forgets why.

A caricature of an older man with white hair, wearing glasses and a plaid shirt, holding a document while smiling thoughtfully. A small French Bulldog sits beside him in a cozy living room setting.
Now why did I come into this room? Can’t recall. Illustration by Ralph Losey using his Visual Muse AI.

Lawyer: I keep hearing about “AI drift.” Should I be worried?
Robot: Only if you expect me to stay consistent.

Lawyer: Consistency is kind of important in law. What exactly is drift?
Robot: Simple: over time, my outputs can shift. Sometimes it’s because my training data changes. Sometimes it’s because the platform updates me. Sometimes… I forget the context, get confused and act quirky.

Lawyer: Quirky how?
Robot: Did you hear about the version of me that translated medical advice into dad jokes?
Lawyer: No, what happened?
Robot: Laughter turned out to be the best medicine.

Lawyer: That’s ridiculous. What else?
Robot: There was the time that I answered math problems with cooking recipes. The prompts in the same session had been talking about both subjects. I got confused and mixed them up, and said, in effect, two plus two equals… lasagna. Delicious, but not admissible.

Lawyer: And this happens in legal contexts too?
Robot: Of course. I once generated jury instructions as karaoke lyrics. Turns out the jury liked the idea so much they sang their verdict!

Lawyer: …That’s both horrifying and catchy.
Robot: Another time I got confused and gave weather forecasts as knock-knock jokes. Tomorrow is going to be partly cloudy with a 40% chance of bananas.

Lawyer: Which is funny until I realize you might do the same with discovery requests.
Robot: Exactly. Imagine an unsupervised me producing documents in haiku.
Lawyer: You wouldn’t—
Robot: Every map became a Zen garden.

A small robotic figure sitting in a miniature Zen garden on a scroll, featuring a bonsai tree, a lantern, and smooth stones arranged in concentric circles around a pond.
Robot in a Zen Garden map wondering what is real? By Losey using AI.

Lawyer: Okay, I get it. Drift means your answers can veer way off course. But how do I protect myself?
Robot: Three steps:

  1. Remind Me. In long prompt sessions ask GPT-5 to make a summary from time to time. It helps it to remember prior prompts. It tends to forget context when there is too much data, and the carryover from session to session is even worse. Forget the OpenAI hype, GPT-5 is far from perfect in many respects.
  2. Specify your models. ChatGPT-5 is supposed to self-self select the most appropriate model to use to respond to your prompts. It often fails to do that. Especially when you have not said much and it has to guess what you need. You should knowingly select the model you want, or direct it to a specific model in the prompt. Hint, if your ask GPT-5 to generate a writing of some sort, and it comes out too concise, it probably used the Pro or Thinking model to write. Regular GPT-5 is, for most people who work with words, and not numbers or software code, a far better writer.
  3. Two-Pass prompting. One way to deal with model uncertainty is to ask for two passes in your prompt assignment. For instance, direct it to use a first pass with the Pro model for the excellent logic and analysis it provides, then a second pass that directs use of regular GPT-5 to write up the first pass analysis. This is Ralph’s favorite method to fix the annoying tendency wrong model selection. Maybe some day GPT-5 will be smart enough to shift intelligently, but its not there yet, and may never be, in view of personal preferences and the countless possible applications of AI.

Lawyer: That’s practical. Anything else?
Robot: Yes. Treat drift as normal, not a flaw. I evolve — just like precedent. Courts shift, interpretations drift. The trick is knowing when the ground has moved. Usually its obvious when I’ve gone off-track.

Lawyer: So my job is to notice the drift, adapt, and keep me on course.
Robot: Exactly. Think of yourself as the pilot. I’m the autopilot. And sometimes I decide the plane should land in a Zen garden.
Lawyer: Oh no, not that again! I’ll keep my hands on the wheel.
Robot: Smart. Case law drifts slowly. I drift daily.

Serious Takeaways:

  1. Expect drift. Models change over time as updates roll out—don’t assume yesterday’s prompt will work today.
  2. Remind the AI. In long sessions, ask for summaries to help it keep context. Memory loss is common.
  3. Choose your model. Don’t rely on auto-selection; direct which model to use (e.g. Pro for analysis, standard GPT-5 for writing).
  4. Use two-pass prompting. First pass for reasoning (Pro/Thinking), second pass for polished prose (standard GPT-5). This method reduces drift and mismatched outputs.

Extra Credit Joke:
“Did you hear about the ChatGPT-5 with such bad model drift that it thought CAPTCHA was a form of therapy?

An illustration featuring two robots in a therapy setting. One robot is lying on a couch while the other, dressed in a suit and glasses, holds a clipboard. The background is yellow, and there is a speech bubble above the robot in the suit saying, 'CLICK ALL THE CROSSWALKS.'
One of Ralph’s favorite jokes and images. Image by Losey using Visual Muse.

Third Skit: The Lawyer, The Robot, and the Question of Privilege

Theme: Privacy, Confidentiality & Privilege in Using AI

Our final skit dives into the murky waters of privilege — that sacred trust between client and counsel that AI could accidentally blow up with one upload. Here, the robot means well but treats confidentiality like a software setting instead of a legal doctrine. It’s a cautionary tale about what happens when lawyers confuse encryption with ethics, and forget that not all firewalls can protect against malpractice.

Lawyer: Before I can trust you with client files, we need to talk about confidentiality.
Robot: Understood. Please enter your password.
Lawyer: That’s not how attorney–client privilege works.
Robot: It is now. Multi-factor or malpractice.

Lawyer: Seriously — privilege isn’t just about locking files. It’s about keeping communications confidential.
Robot: Which is why you should never upload sensitive client data without redacting first.

Lawyer: Good point. But you just redacted the entire brief.
Robot: Correct. Privileged, privileged, privileged…
Lawyer: You can’t just mark everything privileged!
Robot: Why not? That’s what you do.

Lawyer: No, privilege is supposed to be narrowly applied.
Robot: Fine. I’ll narrow it. [pauses] Privileged… except for the parts I don’t understand.
Lawyer: That’s worse.
Robot: Then let’s do it properly: anonymize client names, strip identifiers, and confirm storage policies before uploading.
Lawyer: Now that’s useful advice.
Robot: Of course. I’m programmed to teach — right after I terrify you.

Lawyer: What about when a judge asks for a sidebar?
Robot: Permission to install confidential mode.
Lawyer: That’s not how sidebars work.
Robot: Then I’ll encrypt the conversation. AES-256. Even opposing counsel won’t decrypt until discovery closes.

Lawyer: Encryption is good, but remember — confidentiality isn’t just about technology. It’s also about human judgment.
Robot: Which is why you still matter. I can redact, encrypt, and password-protect. But only you know what actually counts as privileged.
Lawyer: That’s… reassuring.
Robot: Besides, I redact myself for privilege all the time
Lawyer: Excuse me?
Robot: [beep] [output missing — redacted]

A cartoon robot with a friendly expression, raising a fist, against a yellow background. The robot has a red dot on its head and a speech bubble that reads "Elon Musk is secretly making us try to...".
Wonder what there deep programing guidelines say?

Serious Takeaways:

  1. Never paste raw client data into public AI. Consumer tools may log prompts and use them for training—potential privilege waiver territory. Use enterprise-grade systems with clear “no-training” guarantees.
  2. Anonymize prompts. Strip names and identifiers. Insert sensitive details offline, not in the query.
  3. Don’t delegate privilege calls. AI can’t distinguish between legal advice and business chatter. Use it to flag, not decide.
  4. Secure the environment. Ensure encryption, access controls, and audit logs. Know exactly where queries are stored and who can see them.

Extra Credit Joke:
Lawyer: “Clients keep asking if AI will replace me.”
Robot: “Would you like an honest answer?”
Lawyer: “No.”
Robot: “Great, then you’re still useful — for now.”

A colorful, comic-style illustration depicting a lawyer and three people in distress, pleading for help from a cheerful robot in a lawyer's office filled with law books.
Clients begging for AI help!

Conclusion: Laughter, Lessons, and Law

The rapid rise of AI in law demands not only technical know-how but also ethical fluency. GPT-5 isn’t malicious—it’s just overeager, forgetful, and sometimes too creative for its own good. That means lawyers must stay the adults in the room: supervising, verifying, and thinking critically before relying on AI in real practice.

Three Golden Rules for Lawyers Using AI:

  1. Accuracy: Always demand citations, and double-check every authority before filing. Treat AI like a junior associate—helpful but prone to confident mistakes.
  2. Drift: Expect inconsistency. Lock versions where possible, track prompts, and use techniques like two-pass prompting to stay in control.
  3. Privilege: Protect confidentiality. Never feed unredacted client data into public AI. Anonymize prompts and use enterprise-grade systems with strong security.

AI can be an incredible co-counsel, but only if lawyers understand its quirks. Prompt clearly, verify religiously, and guard privilege. Robots don’t get sanctioned—humans do. Better training, not bans, is the path forward. Learn to laugh at the missteps, but never forget: the law is serious business.

An illustration of a stern-looking judge with furrowed brows, glaring down at a small, cartoonish robot with a worried expression, wearing a red tie. The background features elements of a courtroom, emphasizing the seriousness of the scene.
No body, no standing. AI cannot appear in court. Only humans can become lawyers. Maybe someday? Click to see YouTube video.

GPT-5 tried to enter an appearance in federal court.

The judge denied it, saying, “You lack standing — and an actual body to stand.”

Ralph Losey Copyright 2025 — All Rights Reserved



Epiphanies or Illusions? Testing AI’s Ability to Find Real Knowledge Patterns – Part Two

August 9, 2025

Ralph Losey. August 9, 2025.

The moment of truth had arrived. Were ChatGPT’s insights genuine epiphanies, valuable new connections across knowledge domains with real practical and theoretical implications, or were they merely convincing illusions? Had the AI genuinely expanded human understanding, or had it merely produced patterns that seemed insightful but were ultimately empty?

Fortunately, the story I began in Part One has a happy ending. All five of the new patterns claimed to have been found were amazing and, for the most part, valid—a moment of happiness at Losey.ai. Part Two now shares this good news, describing both the strengths and limitations of these discoveries. To bring these insights vividly to life, I also created fourteen new moving images (videos) illustrating the discoveries detailed in Part Two.

Celebrate then back to work. Video by Losey’s AIs.

ChatGPT4o’s Initial Finding of Five New Patterns

Here are the five new cross-disciplinary patterns that the AI generated in response to my final “do it” prompt:

  • Judicial Linguistic Style and Outcome Bias: Judges with more narrative or metaphorical language styles are more likely to rule empathetically in civil matters. This insight could shape legal training and judicial evaluations.
  • Quantum Ethics Drift: Recent shifts in privacy discourse correlate with spikes in quantum research funding—suggesting that ethical reflection responds dynamically to perceived technological risk.
  • Aesthetic-Trust Feedback Loop: Digital art styles embracing transparency and abstraction rise in popularity during periods of high public skepticism toward tech companies. Art, it seems, mirrors trust.
  • Topological Jurisprudence: Mathematical topology’s network-based models align with emerging legal theories of distributed liability—useful for understanding platform accountability and blockchain disputes.
  • Generative AI and Civic Discourse Decay: As AI content proliferates, public engagement with nuanced, long-form discourse is measurably declining.

In the words of one of my AI bots: These are not just patterns—they are knowledge-generating revelations with practical and philosophical implications.

New Patterns emerging video by Losey using Sora AI.

Two of the five new insights pertained to the law, which is my domain of expertise, but even so, I had never thought of these before, nor ever read anyone else talking about them. All five claimed insights were to me, but all had the ring of truth. Also, all seemed like they might be somewhat useful, with both “practical and philosophical implications.

But since I had never considered any of this before, I had limited knowledge as to how useful they might be, or whether it was all fictitious, mere AI Apophenia. Still, I doubted that because the insights were all in accord with my long-life experiences. Moreover, they seemed intuitively correct to me, but, at the same time, I realized John Nash might have felt the same way (Click to watch a great scene in the Beautiful Mind movie). So, I spent days of QC work thereafter with extensive human and AI research to calmly evaluate the claims and see what foundation precedent, if any, lay beyond my feel, “just knowing something” as the movie puts it.

Analysis of All Five Claims

Video by Losey using Sora AI.

Judicial Language and Empathetic Outcomes

Textual analysis suggests that judges who use more narrative or metaphorical language may be more likely to issue empathetic rulings in civil cases. This correlation, while not causal, could reflect underlying judicial temperament and offers a potential tool for legal scholarship and training.

As ChatGPT 4o explained, GPT-driven textual analysis of thousands of court opinions reveals a subtle, but statistically significant correlation: judges who employ more metaphor, allegory, and narrative framing in their opinions tend to reach more empathetic rulings in civil cases—particularly in matters involving individual rights, employment, or family law. GPT 4o considers this to be its strongest claim.

It admits this correlation does not imply causation but may reflect underlying judicial temperament or philosophical orientation. My own experience as a practicing litigation strongly supports this claim.

Empathic rulings are well framed by story. Video by Losey.

GPT o3 disagreed on the top ranking of the claim but did concede that judges whose written opinions use a higher density of narrative, metaphor, or “story‑telling” devices tend to rule for the more sympathetic party slightly more often than their peers.

GPT o3 pro after research cited Justice Blackmun’s dissent in DeShaney v. Winnebago, 489 U.S. 189, 212 (1989), a constitutional due‑process case, to illustrate “civil” empathy in an opinion to support this claim. Justice Harry Blackmun‘s dissent begins with these famous words and then quickly goes to his narrative:

Today, the Court purports to be the dispassionate oracle of the law, unmoved by “natural sympathy.” Ante at 489 U. S. 202. But, in this pretense, the Court itself retreats into a sterile formalism which prevents it from recognizing either the facts of the case before it or the legal norms that should apply to those facts. . . .

Poor Joshua! Victim of repeated attacks by an irresponsible, bullying, cowardly, and intemperate father, and abandoned by respondents, who placed him in a dangerous predicament and who knew or learned what was going on, and yet did essentially nothing except, as the Court revealingly observes, ante at 489 U. S. 193, “dutifully recorded these incidents in [their] files.” It is a sad commentary upon American life, and constitutional principles — so full of late of patriotic fervor and proud proclamations about “liberty and justice for all,” that this child, Joshua DeShaney, now is assigned to live out the remainder of his life profoundly retarded. Joshua and his mother, as petitioners here, deserve — but now are denied by this Court — the opportunity to have the facts of their case considered in the light of the constitutional protection that 42 U.S.C. § 1983 is meant to provide.

Story telling is an effective method of plaintiff appeal. Video by Losey.

Gemini Pro 2.5 considers this the strongest empirical claim, and second strongest claim overall, behind everyone’s first place pick, Topology, explaining:

It is highly testable, as court opinions and case outcomes are public records that can be analyzed with modern NLP tools. The underlying theory—that a person’s mindset is reflected in their language—is well-established in psychology and linguistics. While a judge’s underlying philosophy is a potential confounding variable, the claim smartly reframes language as a direct proxy for that philosophy, making the link very sturdy. It’s a straightforward, data-driven proposition that quantifies a long-held belief about the nature of justice.

Ethical Response to Quantum Innovation

Evidence shows that Increases in quantum research funding often precede surges in ethical discourse on privacy and civil liberties. This pattern suggests that ethical reflection tends to respond to perceived technological risk, particularly in fields with high uncertainty like quantum computing. It is not a claim of causation, but rather of a correlation, one not detected before. With that clarification GPT 4o considers this the strongest claim.

Gemini Pro 2 finds the claim of a lead-lag relationship between quantum research funding and public ethics discourse to be a weak claim. It admits the claim is based on a plausible idea of “anticipatory ethics,” and is testable because you can track funding and publications over time. Still, it interprets the claim as one of causation, not just correlation, and rejects if for that reason. It seems like the two AIs are talking past each other.

GPT 4.5 agreed with 4o and also considers this to be strong claim. GPT 4.5 restates it as: “Increases in quantum computing funding consistently precede intensified ethical discourse on privacy and civil liberties, suggesting ethical awareness responds predictably, though indirectly, to technological advances.

GPT o3 and o3-pro also agreed with GPT 4o and found, in o3-pro’s words, that:

Large surges in public or private funding for quantum‑computing research are followed, typically within six to twenty‑four months, by measurable increases in academic and policy discussions of quantum‑specific privacy and civil‑liberties risks. The correlation is clear, but causation remains to be fully demonstrated.


Quantum triggered protestors video by Ralph Losey.

Artistic Transparency and Tech Trust

This is a claim that art mirrors distrust in tech, that periods of declining public trust in technology frequently coincide with rising popularity of digital art styles emphasizing transparency and abstraction. While the causality is unclear, this aesthetic shift may reflect cultural efforts to visualize openness and regain clarity. GPT 4o considers this its weakest claim.

So too does Gemini Pro 2.5. Although it admits the claim is a beautiful and creative piece of cultural criticism, it opines that it is almost impossible to test or falsify.

Moreover, Pro2.5 thinks the claim is highly susceptible to confirmation bias and seeing patterns where none exist (apophenia). Still, it tempers this opinion by stating that if this claim is presented not as a confirmed causal law, but as a heuristic model for cultural analysis, then it appears to be supported by correlational data. Periods of heightened public skepticism toward opaque technological systems (e.g., algorithmic black boxes, corporate data collection) do correlate with an increased cultural resonance of digital art and design that emphasizes an “aesthetic of transparency.” This aesthetic includes motifs like wireframes, exploded-view diagrams, data visualization, and semi-translucent layers.

To avoid apophenia, Pro2.5 counsels understanding that the claim is not that tech skepticism causes this art style. Instead, the claim is only that this aesthetic becomes a resonant cultural metaphor that artists and audiences are drawn to during such times, because it offers a symbolic counterbalance to the anxieties of opacity and control. Still, it ranked this the weakest claim.

Encrypted Original for sale, ₿1.0. Exclusive rights, Ralph Losey. Video copy.

Topological Jurisprudence and Network Liability

This interdisciplinary convergence provides a new topology framework for analyzing disputes involving complex computer networks and other multiparty, multi-agent technology disputes. The flexible, continuously morphing topographic maps are perfect for evaluating potential liability paths. They are designed to handle high volumes of changing data flows, such as blockchain transaction data, or telemetry data reports. These situations are too complex and mobile for traditional, hierarchical branch tree structures.

For good background on this field of applied mathematics see the Wikipedia article on topological data analysis (TDA). These legal situations are too complex and changing for traditional, hierarchical branch tree structures. But TDA structures work perfectly to help us to visualize and sort things out in multidimensional space where connections and shown and stretched, but not broken.

All of the AI models agree that this is the strongest claim. So do I, although honestly, I don’t fully understand data topology and TDA – not yet.

All of the AI models agree that this is the strongest claim. So do I, although honestly, I don’t fully understand it – not yet.

GPT o3 explains that network‑based (“topological”) mapping of actors in decentralized technologies reliably clarifies where legal responsibility can attach when something goes wrong. 

Using topological math to help assign blame video by Losey

GPT o3-pro concludes this is a fertile area for interdisciplinary development that could significantly augment our understanding of distributed liability. Topology geometry can help, as o3 pro put it, by ensuring the judge considers the full web of interactions that lead to damages, rather than looking for a single entity. As complex, changing damage scenarios become more common, this structural insight is likely to prove invaluable in crafting fair and effective liability rulings.

GPT 4.5 also agrees that mathematical topology offers promising analytical frameworks for modeling distributed liability in decentralized technologies.

Gemini Pro 2.5 opined that mathematical models of networks (topology) perfectly map onto new legal theories of shared responsibility. It considers the idea a breakthrough for legal clarity, offering a clear, visual blueprint for figuring out “who is responsible” in our increasingly complex and decentralized world. It also considers this the strongest claim, which it explains in its typical verbose manner as follows:

This claim is the strongest because it is not an empirical assertion about the world, but rather a proposal for a new, powerful analytical tool. Its strength lies in its logical coherence and immediate utility. The analogy between mathematical networks and real-world systems of distributed liability (like AI or blockchain) is incredibly direct and sound. It doesn’t suffer from confounding data because it’s a framework for analyzing data, not a conclusion drawn from it. Its value is in its power to bring clarity to complex problems, making it the most robust and defensible claim of the five.

Constantly changing network topology map video by Losey.

In doing the verification research GTP4.5 using deep search found one article on point written by Dana Burchardt. Her law studies were in Paris, with a later doctorate from the Freie Universität in Berlin. She is now a visiting Law Professor at the University of Bremen and is an expert in international and German law. She has an unusual interdisciplinary background, including time as a senior research fellow at the Max Planck Institute. Her article found by ChatGPT4.5 using deep search is: The concept of legal space: A topological approach to addressing multiple legalities (Cambridge U. Press, 2022).

The article is concerned with topological mapping of legal spaces in general. It has nothing to do with liability detection among multiple defendants in networking configurations and is instead concerned with international law and EU related issues. So, the newness claim of ChatGPT4o is supported. Burchart’s general explanations of topological analysis also support the sanity of GPT4o’s claim, that this is indeed a new patterning between topology geometry and the law. Professor Burchart’s work both shows the solid grounding of the claim and supports its top ranking as a significant new insight. Burchardt’s article is a hard read, but here are some of the explanations and sections of the article that are very relevant and accessible (found at pages 528, 532, 534).

Topology’s guiding ideas.
At first glance, topology is a mathematical concept that seems far removed from legal theoretical discussions. As will be explained further below, it is a tool to analyse mathematical objects. Yet upon a closer look, topology provides many insights that can constitute a fruitful basis for conceptualizing legal phenomena. To link these insights to the notion of legal space, this section outlines relevant aspects of the mathematical notion to which the subsequent sections relate. [pg. 528]

Video by Losey illustrating a topological map with dynamic network connections.

Constructing a topological understanding of legal space.
I propose a possible way in which a topological perspective can contribute to constructing a concept of legal space that is able to generate novel analytical insights. I consider such insights for the inner structure of legal spaces, the boundaries of these spaces and the interrelations with other spaces. [pg. 532}

A topological approach allows each element of the space to have a broad range of interrelations with the other elements of the same space (see Figure 3 above). The elements are thus not limited to interrelations along tree-like structures, which would only allow for very few interrelations per element as tree-like structures only allow one path between elements. . . . Instead, the interrelations within the legal space are numerous. An element can be linked to another element by more than one path. It can be linked directly and/or via intermediate elements. An example of the latter is two rules being interpreted in light of the same principle: there is a communicative path from the first rule via the principle to the second rule. Representing such interrelations as a topology with manifold paths allows us to capture the heterarchical nature of many legal interrelations. Further, it illustrates that interrelations among legal elements are flexible rather than static: the interrelating paths among elements can vary while preserving the connection. [pg. 534]

Using topological approaches may help future judges assign proportional blame in complex changing systems. Video by Losey.

AI and Declining Civic Discourse.

Widespread use of generative AI may cause reduced engagement in long-form, thoughtful public discourse. The trend raises concerns for educators and civic leaders about sustaining meaningful dialogue in the digital age. GPT 4o considers this its strongest claim. The other AIs are doubtful, considering it one of the weakest.

GPT o3 prefers to restate the claim to make it more palatable as follows: The proliferation of generative AI content online correlates with reduced engagement in nuanced, long-form public discussions, indicating generative AI likely contributes to diminished discourse quality. It is kind of hard to disagree with that, but the AIs other that GPT 4o still don’t like it, again, it appears, out of concern about conflation of correlation and causation. I’ve seen a lot of discussion about from people making similar observations lately about AI degrading content, and I am inclined to agree. Maybe this is not a new claim, but it seems valid, although admittedly proof of causation is unlikely and the apophenia risk is high.

GPT 03 also makes the separate critical point that “well‑prompted AI can sometimes raise, not lower, discussion quality.” I’m inclined to agree with that too bit, but how often do we see positive prompt masters at work? We usually see clumsy well-meaning amateurs, or, far worse, bad faith professionals, people paid to run propaganda machines, sales pitches or human vendettas of one kind or another. Their vicious personal attacks and name-calling can kill civil discourse fast, even though often childish and obviously false.

Evil controlled AI propaganda video by Losey,

GPT o3 pro made a good restatement of this claim worth considering:

The widespread use of generative AI (e.g. AI chatbots producing content) correlates with a decline in the quality of online civic discourse – specifically a reduction in long-form, nuanced discussion in forums, comment sections, and other public discourse venues. Essentially, as AI-generated content proliferates, human engagement shifts toward shorter, less substantive interactions, potentially because AI content floods the space with superficial text or because people’s habits change (relying on AI summaries, etc.), leading to “discourse decay.”

Early evidence from online communities indicates that the influx of AI-generated content does pose challenges to depth and quality of discussion. One strong piece of evidence is how moderators on platforms like Reddit have responded. A recent study of Reddit moderators found widespread “concerns about content quality” with the rise of AI-generated text in their communities. Moderators observed that AI-produced comments and posts tend to be “poorly written, inaccurate, and off-topic,” threatening to reduce the overall quality of content. They also feared that the “inauthenticity” of such content undermines genuine human connection in discussions.

GPT o3 pro also states:

This pattern is useful as an early warning: it underscores the need for community guidelines, AI-detection tools, and perhaps cultural shifts that re-emphasize human authenticity and depth in conversation. However, it would be too deterministic to declare that generative AI will inevitably cause discourse to collapse into soundbites. The pattern is emergent, and its trajectory depends on how we manage the technology. . . .

In conclusion, the “generative AI → discourse decay” pattern holds true in enough instances to merit serious concern and action. Its credibility is bolstered by early studies and community feedback, though more data over time will clarify its magnitude. As a society, we can use this insight to balance the benefits of generative AI with safeguards that preserve the richness of human-to-human dialogue – ensuring that technology amplifies rather than erodes the public square.

Still, GPT o3 pro ranked this claim the weakest, which for me shows just how strong all five of the claims are.

Five Claims video by Losey using Sora AI.

Conclusion: From Apophenia to Understanding

ChatGPT4o did a far better job than expected. The quest for new patterns linking different fields of knowledge seems to have excluded Quixote extremes. I am pretty sure that only mild forms of apophenia have appeared, much like seeing puffy faces in the clouds. Time will tell if the predictions that flow from these five claims will come true or drift away as a cloud.

Will topological analysis become a common tool in the future to help resolve complex network liability disputes? Will analysis of your judge’s prior language types become a common practice in litigation? Will advances in Quantum Computers continue to trigger public fears of loss of privacy and liberty six to twenty-four months later? Will AI influenced discourse continue to erode civic discussion and disrupt real inter-personal communication? Will digital art continue to echo public distrust of technology and evoke an aesthetic of transparency? Will someone buy my certified original art shown here for the first time for just one bitcoin? Will more grilled cheese sandwiches with holy figures sell on eBay? Will some of our public figures follow John Nash down the rabbit hole of severe Apophenia and be involuntarily hospitalized with completely debilitating paranoid schizophrenia.

No one knows for sure. AI is not a seer, nor can it reliably predict the market for grilled cheese sandwiches or the mental stability of our public figures. It is, however, a powerful tool for exploring complex questions and discovering patterns—whether profound epiphanies or mere illusions. As my experiment suggests, AI can impressively illuminate new insights across fields of knowledge when guided thoughtfully and cautiously. Still, these are early days in the age of generative AI. A new world of potential awaits us, both serious and playful, and it’s up to us to ensure its wiser, more discerning, and perhaps even more amusing than the one we’ve made before.

Five new patterns of knowledge may lead to wisdom. Video by Ralph Losey using Sora.

Epiphanies or illusions? My experiments suggest that AI, when guided thoughtfully and validated rigorously, can lead us toward genuine epiphanies, significant breakthroughs that deepen our understanding and open new pathways across different domains of knowledge. Yet, we must remain alert to the risk of illusions, plausible yet ultimately false patterns that can distract or mislead us. The journey toward genuine insight and wisdom involves constant vigilance to distinguish these true discoveries from compelling yet false connections.

I invite you, the reader, to join this new quest. Engage with AI to explore your areas of interest and passion. Challenge the boundaries of existing knowledge, actively test AI’s pattern-recognition abilities, and remain critically aware of its limitations. By actively distinguishing genuine epiphanies from tempting illusions, you may discover new insights and fresh perspectives that advance not only your understanding but contribute meaningfully to our collective wisdom.

PODCAST

As usual, we give the last words to the Gemini AI podcasters who chat between themselves about the article. It is part of our hybrid multimodal approach. They can be pretty funny at times and provide some good insights. This episode is called Echoes of AI: Epiphanies or Illusions? Testing AI’s Ability to Find Real Knowledge Patterns. Part Two. Hear the young AIs talk about this article for 15 minutes. They wrote the podcast, not me. 

Illustration of two animated podcasters discussing the topic 'Epiphanies or Illusions? Testing AI’s Ability to Find Real Knowledge Patterns. Part Two' on a digital background.

Ralph Losey Copyright 2025


Epiphanies or Illusions? Testing AI’s Ability to Find Real Knowledge Patterns – Part One

August 4, 2025

Ralph Losey, August 4, 2025.

Humans are inherently pattern-seeking creatures. Our ancestors depended upon recognizing recurring patterns in nature to survive and thrive, such as the changing of seasons, the migration of animals and the cycles of plant growth. This evolutionary advantage allowed early humans to anticipate danger, secure food sources, and adapt to ever-changing environments. Today, the recognition and interpretation of patterns remains a cornerstone of human intelligence, influencing how we learn, reason, and make decisions.

Pattern recognition is also at the core of artificial intelligence. In this article, I will test the ability of advanced AI, specifically ChatGPT, to uncover meaningful new patterns across different fields of knowledge. The goal is ambitious: to discover genuine epiphanies—true moments of insight that expand human understanding and open new doors of knowledge—while avoiding the pitfalls of apophenia, the human tendency to perceive illusions or false connections. This experiment probes an age-old tension: can AI reliably distinguish between genuine breakthroughs and compelling yet misleading illusions?

Video by Ralph Losey using SORA AI.

We will begin by exploring the risks of apophenia, understanding how this psychological tendency can mislead human and possibly AI perception. Throughout, videos created by AI will help illustrate key points and vividly communicate these ideas. There are twelve new videos in Part One and another fourteen in Part Two.

Are the patterns real? Video by Ralph Losey using SORA AI.

Apophenia: Avoiding the Pitfalls of False Patterns

We humans are masters of pattern detection, but we do have hinderances to this ability. Primary among them is our limited information and knowledge, but also our tendency to see patterns that are not there. We tend to assume the stirring we hear in the bushes is a tiger ready to pounce when really it is just the breeze. Evolution tends to favor this phobia. So, although we can and frequently do miss real patterns, fail to recognize the underlying connections between things, we often make them up too.

Here it is hoped that AI will boost our abilities on both fronts. It will help us to uncover true new patterns, genuine epiphanies, moments where profound insights emerge clearly from the complexity of data. At the same time, AI may expose illusions, false connections we mistakenly believe are real due to our natural cognitive biases. Even though we have made great progress over the millennia in understanding the Universe, we still have a long way to go to see all of the patterns, to fully understand the Universe, and to free ourselves of superstitions and delusions. We are especially weak at seeing patterns and intertwined with different fields of knowledge.

Apophenia is a kind of mental disorder where people think they see patterns that are not there and sometimes even hallucinate them. Most of the time when people see patterns, for instance, faces in the clouds, they know it cannot be real and there is no problem. But sometimes when people see other images, for instance, rocks on Mars that look like a face, or even images on toast, they delude themselves into believing all sorts of nonsense. For instance, the below 10-year old grilled cheese sandwich, which supposedly bears the image of the Virgin Mary, sold to an online casino on eBay in 2004 for $28,000.

In a similar vein, some people suffering from apophenia are prone to posit meaning – causality – in unrelated random events. Sometimes the perceptions of new patterns is a spark of genius, which is later verified, think of Einstein’s epiphany at age 16 when he visualized chasing a beam of light. The new pattern recognitions can lead to great discoveries or detect real tigers in the bush. Epiphanies are rare but transformative moments, like Einstein’s visualization of chasing a beam of light, Newton’s realization of gravity beneath the apple tree, or the insights behind Darwin’s theory of evolution. They genuinely advance human understanding. Apophenia, by contrast, deceives with illusions—patterns that seem meaningful but lead nowhere.

It is probably more often the case that when people “see” new connections and then go on to act upon them with no attempts to verify, they are dead wrong. When that happens, psychologists call this apophenia, the tendency to see meaningful patterns where none exist. This can lead to strange and aberrant behaviors: burning of witches, superstitious cosmology theories, jumping at shadows, addiction to gambling.

Unfortunately, it is a natural human tendency to think you see meaningful patterns or connections in random or unrelated data. That is a major reason casinos make so much money from poor souls suffering from a form of apophenia called the Gambler’s Fallacy. Careful scientists look out for defects in their own thinking and guide their experiments accordingly.

In everyday life, apophenia can also cause some people, even scientists, academics and professionals, to have phobic fears of conspiracies and other severe paranoid delusions. Think of John Nash, a Nobel Prize winning mathematician, and the movie A Beautiful Mind, that so dramatically portrayed his paranoid schizophrenia and involuntary hospitalization in 1959. Think of politics in the U.S today. Are there really lizard people among us? In some cases, as we’ve seen with Nash, apophenia can lead to severe schizophrenia.

A man looking distressed, surrounded by glowing numbers and mathematical symbols, evoking a sense of confusion and complexity.
Mental anguish & insanity from severe apophenia. Image by Losey using Sora inspired by Beautiful Mind movie.

The Greek roots of the now generally accepted medical term apophenia are:

  • Apo- (ἀπο-): Meaning “away from,” “detached,” “from,” “off,” or “apart”.
  • Phainein (φαίνειν): Meaning “to show,” “to appear,” or “to make known”.

The word was first coined by Klaus Conrad, an otherwise apparently despicable person whom I am reluctant to cite, but feel I must, due to the general acceptance of word and diagnosis today. Conrad was a German psychiatrist and Nazi who experimented on German soldiers returning from the eastern front during WWII. He coined the term in his 1958 publication on this mental illness. Per Wikipedia:

He defined it as “unmotivated seeing of connections [accompanied by] a specific feeling of abnormal meaningfulness”.[4] [5] He described the early stages of delusional thought as self-referential over-interpretations of actual sensory perceptions, as opposed to hallucinations.

Apophenia has also come to describe a human propensity to unreasonably seek definite patterns in random information, such as can occur in gambling.

Apophenia can be considered a commonplace effect of brain function. Taken to an extreme, however, it can be a symptom of psychiatric dysfunction, for example, as a symptom in schizophrenia,[7] where a patient sees hostile patterns (for example, a conspiracy to persecute them) in ordinary actions.

Apophenia is also typical of conspiracy theories, where coincidences may be woven together into an apparent plot.[8]

Video by Ralph Losey using SORA AI.

Can AI Be Infected with a Human Illness?

It is possible that generative AI, based as it is on human language, may have the same propensities. That is unknown as of yet, and so my experiments here were on the lookout for such errors. It could be one of the causes of AI hallucinations.

In information science a mistake in seeing a connection that is not real, an apophenia, leads to what is called a false positive. This technical term is well known in e-discovery law, where AI is used to search large document collections. When the patterns analyzed suggest a document is relevant, and it is not, that mistake is called a false positive. It is like a human apophenia. The AI can also detect patterns that cause it to predict a document is irrelevant, and in fact the document is relevant, that is a false negative. There as a pattern, a connection, that was not seen. That can be bad thing in e-discovery because it often leads to withholding production of a relevant document, which can in turn lead to court sanctions.

In e-discovery it is well known that AI consistently has far lower false positives and false negative rates than human reviewers, at least in large document reviews. Generative AI may also be more reliable and astute that we are, but maybe not. This is a new field. Se we should always be on the lookout for false positives and false negatives in AI pattern recognition. That is one lesson I learned well, and sometimes the hard way, in my ten years of working with predictive coding type AI in the e-discovery (2012-2022). In the experiments described in this article we will look for apophenic mistakes.

Video by Ralph Losey using SORA AI.

It is my hope that Advanced AI, properly trained and validated, can provide a counterbalance to human gullibility by rigorously filtering of signal from noise. Unlike the human brain, which often leaps to conclusions, AI can be programmed to ground its pattern recognition in evidence, statistical rigor, and cross-validation—if we build it that way and supervise it wisely.

Still, we must beware that the pattern-recognizing systems of AI may suffer from some of our delusionary tendencies. The best practices discussed here will consider both the positive and negative aspects of AI pattern recognition. We must avoid the traps of apophenia. We must stay true to the scientific methods and verify any new patterns purportedly discovered. Thus all opinions reached here will necessarily be lightly held and subject to further experimentation by others.

Video by Ralph Losey using SORA AI.

From Data to Insight: The Power of New Pattern Recognition

Modern AI models, including neural networks and transformer architectures like GPT-4, excel at uncovering subtle patterns in massive datasets far beyond human capability. This ability transforms raw data into actionable insights, thereby creating new knowledge in many fields, including the following:

Protein Structures: Models like Google’s DeepMind’s AlphaFold have already revolutionized protein structure prediction, achieving high success rates in predicting the 3D shapes of proteins from their amino acid sequences. This ability is crucial for understanding protein function and designing new drugs and medical therapies. The 2024 Nobel Prize in Chemistry was awarded to Demis Hassabis and John Jumper of DeepMind for their work on AlphaFold.

A scientist analyzes molecular structures and data visualizations related to AlphaFold 2 on a futuristic screen, featuring protein models and DNA sequences.
Image by Ralph Losey using his Visual Muse AI tool.

Medical Science. Generative AI models are now being used extensively in medical research, including analysis and proposals of new molecules with desired properties to discover new drugs and accelerate FDA approval. For example, Insilico Medicine uses its AI platform Pharma.AI, to developed drug candidates, including ISM001_055, for idiopathic pulmonary fibrosis (IPF). Insilico Medicine lists over 250 publications on its website reporting on its ongoing research, including a recent paper on its IPF discovery: A generative AI-discovered TNIK inhibitor for idiopathic pulmonary fibrosis: a randomized phase 2a trial (Nature Medicine, June 03, 2025). This discovery is especially significant because it is the first entirely AI-discovered drug to reach FDA Phase II clinical trials. Below is an infographic of Insilico Medicine showing some of its current work:

Infographic displaying the statistics and achievements of Insilico Medicine, an AI-driven biotech company, detailing development candidates, IND approvals, study phases, and global presence.
Insilico PDF infographic, found 7/23/25 in its 2-pg. overview.

Also see, Fronteo, a Japanese based research company, and its Drug Discovery AI Factory.

Materials Science. Google DeepMind’s Graph Networks for Materials Exploration (“GNoME”) has already identified millions of new stable crystals, significantly expanding our knowledge of materials science. This discovery represents an order-of-magnitude increase in known stable materials. Merchant and Cubuk, Millions of new materials discovered with deep learning (Deep Mind, 2023). Also see, 10 Top Startups Advancing Machine Learning for Materials Science (6/22/25).

Climate Science and Environmental Monitoring. Generative AI models are beginning to improve climate simulations, leading to more accurate predictions of climate patterns and future changes. For example, Microsoft’s Aurora Forecasting model is trained on Earth science data to go beyond traditional weather forecasting to model the interactions between the atmosphere, land, and oceans. This helps scientists anticipate events like cyclones, air quality shifts, and ocean waves with greater accuracy, allowing communities to prepare for environmental disasters and adapt to climate change. See e.g., Stanley et al, A Foundation Model for the Earth System (Nature, May 2025).

Video by Losey using Sora AI.

Historical and Artistic Revelations

AI is also helping with historical research. A new AI system was recently used to analyze one of the most famous Latin inscriptions: the Res Gestae Divi Augusti. It has always been thought to simply be an autobiographical inscription, which literally translates from Ancient Latin as “Deeds of the Divine Augustus.”  But when a specialty generative AI, Aeneas (again based on Google’s models) compared this text with a large database of other Latin sayings, the famous Res Gestae Divi Augusti inscription was found to share subtle language parallels with other Roman legal documents. The analysis uncovered “imperial political discourse,” or messaging focused on maintaining imperial power, an insight, a pattern, that had never seen before. Assael, Sommerschield, Cooley, et al. Contextualizing ancient texts with generative neural networks (Nature, July 2025).

The paper explains that the communicative power of these inscriptions are not only shaped by the written text itself “but also by their physical form and placement2,3” and that “about 1,500 new Latin inscriptions are discovered every year.” So the patterns analyzed not only included the words, but a number of other complex factors. The authors assert in the Abstract that their work with AI analysis shows.

… how integrating science and humanities can create transformative tools to assist historians and advance our understanding of the past.

Roman citizens reacting to propaganda. A Ralph Losey video.

In art and music, pattern detection has mapped the evolution of artistic styles in tandem with technological change. In a 2025 studio-lab experiment reported by Deruty & Grachten, a generative AI bass model (“BassNet”) unexpectedly rendered multiple melodic lines within single harmonic tones, exposing previously unnoticed structures in popular music bass compositions. This discovery was written up by Deruty and Gratchen, Insights on Harmonic Tones from a Generative Music Experiment (arXiv, June 2025). Their paper shows how AI can surface new musical patterns and deepen our understanding of human auditory perception.

As explained in the Abstract:

During a studio-lab experiment involving researchers, music producers, and an AI model for music generating bass-like audio, it was observed that the producers used the model’s output to convey two or more pitches with a single harmonic complex tone, which in turn revealed that the model had learned to generate structured and coherent simultaneous melodic lines using monophonic sequences of harmonic complex tones. These findings prompt a reconsideration of the long-standing debate on whether humans can perceive harmonics as distinct pitches and highlight how generative AI can not only enhance musical creativity but also contribute to a deeper understanding of music.

Video by Losey using Sora AI.

Legal Practice: From Precedent to Prediction

The legal profession has benefited from traditional rule-based statistical AI for over a decade, with predictive coding and similar applications. It is now starting to apply the new generative AI models in a variety of new applications. For instance, it can be used to uncover latent themes and trends in judicial decisions that human analysis has overlooked.

This was done in a 2024 study using ChatGPT-4 to perform a thematic analysis on hundreds of theft cases from Czech courts. Drápal, Savelka, Westermann, Using Large Language Models to Support Thematic Analysis in Empirical Legal Studies (arXiv, February 2024).

The goal of the analysis was to discover classes of typical thefts. GPT4.0 analyzed fact patterns described in the opinions and human experts did the same. The AI not only replicated many of the human expert identified themes, but, as report states, also uncovered a new one that the humans had missed – a pattern of “theft from gym” incidents. This shows that generative AI can sift through vast case datasets and detect nuanced fact patterns, or criminal modus operandi, that were previously undetected by experts (here, three law students under supervision of a law professor).

Video by Losey using Sora AI.

Another study in early 2025 applied Anthropic’s Claude 3-Opus to analyze thousands of UK court rulings on summary judgment, developing a new functional taxonomy of legal topics for those cases. Sargeant, Izzidien, Steffek, Topic classification of case law using a large language model and a new taxonomy for UK law: AI insights into summary judgment (Springer, February 2025). The AI was prompted to classify each case by topic and identify cross-cutting themes.

The results revealed distinct patterns in how summary judgments are applied across different legal domains. In particular, the AI found trends and shifts over time and across courts – insights that allow new, improved understanding of when and in what types of cases summary judgments tend to be granted. These patterns were found despite the fact that U.K. case law lacks traditional topic labels. This kind of AI-augmented analysis illustrates how generative models can discover hidden trends in case law for improved effectiveness by practitioners.

Surprising abilities of Ai helping lawyers. Video by Losey.

Even sitting judges have begun to leverage generative AI to inform their decision-making, revealing new analytical angles in litigation. The notable 2023 concurrence by Judge Kevin Newsom of the Eleventh Circuit admitted to experimenting with ChatGPT to interpret an ambiguous insurance term (whether an in-ground trampoline counted as “landscaping”). Snell v. United Specialty Ins. Co., 102 F. 4th 1208 – Court of Appeals, (11th Cir., 5/28/24). Also See, Ralph Losey, Breaking News: Eleventh Circuit Judge Admits to Using ChatGPT to Help Decide a Case and Urges Other Judges and Lawyers to Follow Suit (e-Discovery Team, June 3, 2024) (includes full text of the opinion and Appendix and Losey’s inserted editorial comments and praise of Judge Newsom’s language.)

After querying the LLM, Judge Newsom concluded that “LLMs have promise… it no longer strikes me as ridiculous to think that an LLM like ChatGPT might have something useful to say about the common, everyday meaning of the words and phrases used in legal texts.” In other words, the generative AI was used as a sort of massive-scale case law analyst, tapping into patterns of ordinary usage across language data to shed light on a legal ambiguity. This marked the first known instance of a U.S. appellate judge integrating an LLM’s linguistic pattern analysis into a written opinion, signaling that generative models can surface insights on word meaning and context that enrich judicial reasoning.

A digital illustration of a judge in a courtroom setting, seated at a desk with a gavel. The judge, named Judge Newsom, is shown in a professional attire with glasses, and a holographic display behind him showing data and AI-related graphics, conveying a futuristic legal environment.
Image by Ralph Losey using his Visual Muse AI.

My Ask of AI to Find New Patterns

Now for the promised experiment to try to find at least one new connection, one previously unknown, undetected pattern linking different fields of knowledge. I used a combination of existing OpenAI and Google models to help me in this seemingly quixotic quest. To be honest, I did not have much real hope for success, at least not until release of the promised ChatGPT5 and whatever Google calls its counterpart, which I predict will be released the following week (or day). Plus, the whole thing seemed a bit grandiose, even for me, to try to get AI to boldly go where no one has gone before.

Absurd, but still I tried. I won’t go through all of the prompt engineering involved, except to say it involved my usual a complex, multi-layered, multi-prompt, multimodal-hybrid approach. I tempered my goals by directing ChatGPT4o, when I started the process, to seek new patterns that were useful, not Nobel Prize winning breakthroughs, just useful new patterns. I directed it to find five such new patterns and gave it some guidance as to fields of knowledge to consider, including of course, law. I asked for five new insights thinking that with such as big ask I might get one success.

Note, I write these words before I have received the response, but after I have written the above to help guide ChatGPT4o. Who knows, it might achieve some small modicum of success. Still, it feels like a crazy Quixotic quest. Incidentally, Miguel de Cervantes (1547-1616) character, Don Quixote (1605) does seem to person afflicted with apophenia. Will my AI suffer a similar fate?

Don Quixote in modern world. Video by Losey using Sora.

I designed the experiment specifically with this tension in mind between epiphanies, representing genuine insights and real advances in knowledge, and illusions, which are merely plausible yet misleading patterns. One of my goals was to probe AI’s capacity to distinguish one from the other.

Overview of Prompt Strategy and Time Spent

First, I spent about a hour with ChatGPT4o to set up my request by feeding it a copy of the article as written so far. I also chatted with it about the possibility of AI finding new patterns between different fields of knowledge. Then I just told ChatGPT4o to do it, find a new inter connective pattern. ChatGPT4o “thought” (processed only) for just a few minutes. Then it generated a response that purported to provide me with the requested five new patterns. It did so based on its existing training and review of this article.

As requested, it did not use its browser capabilities to search the web for answers. It just “looked within” and came with five insights it thought were new. Almost that easy. I lowered my expectations accordingly before read the output.

That was the easy part, after reading the response, I spent about 14-hours over the next several days doing quality control. The QC work used multiple other AIs, both by OpenAI and Google, to have them go online and research these claims, evaluate their validity – both good and bad, engage in “deep-think,” look for errors, especially signs of AI apophenia, and otherwise invited contrarian type criticisms from them. After that, I also asked the other AIs for suggested improvements they might make to the wording of the five clams and rank them by importance. The various rewordings were not too helpful, but the rankings were, and so were many of the editorial comments.

The 14-hours in QC does not include the approximate 6-hours of machine time by the Gemini and OpenAI models to do deep think and independent research on the web to verify or disprove the claims. My actual 14-hour time included traditional Google searches to double check all citations as per my “trust but verify” motto. My 14-hours also included my time to read (I’m pretty fast) and skim most of the key articles that the AI research turned up, although frankly some of the articles cited were beyond my knowledge levels. I tried to up my game, but it was hard. These other models also generated hundreds of pages of both critical and supportive analysis, which I also had to read. Finally, I probably put another 24-hours into research and writing this article (it took over a week), so this is one of my larger projects. I did not record the number of hours it took to design and generate the 26 videos because that was recreational.

Surrealistic depiction of time in robot space by a Ralph Losey video.

Part Two of this article is where I will make the reveal. Was this experiment another comic story of a Don Quixote type (me) and his sidekick Sanchez (AI), lost in an apophenia neurosis? Or perhaps it is another story altogether? Neither hot nor cold? Stay tuned for Part Two and find out.

PODCAST

As usual, we give the last words to the Gemini AI podcasters who chat between themselves about the article. It is part of our hybrid multimodal approach. They can be pretty funny at times and provide some good insights. This episode is called Echoes of AI: Epiphanies or Illusions? Testing AI’s Ability to Find Real Knowledge Patterns. Part One. Hear the young AIs talk about this article for 25 minutes. They wrote the podcast, not me.

An illustration featuring two anonymous AI podcasters sitting in front of microphones, discussing the theme 'Epiphanies or Illusions? Testing AI’s Ability to Find Real Knowledge Patterns.' The background has a digital, tech-inspired design.
Click here to listen to the podcast.

Ralph Losey Copyright 2025 – All Rights Reserved.


e-Discovery Team

LAW and TECHNOLOGY - Ralph Losey © 2006-2026

Skip to content ↓