AI chats may not be as private as they seem. Here’s what users should know.
Are AI conversations private? Based on U.S. court decisions from 2025 and 2026, the answer is no. Courts have ruled that chats with AI chatbots carry no legal confidentiality, can be subpoenaed, and may be preserved indefinitely — even after users click “Delete.”
Roughly half of the messages people send to ChatGPT are requests for advice, and more than 10 percent are personal reflections, according to OpenAI’s own data. Many users treat the chatbot like a diary, a therapist, or a trusted adviser — but unlike a therapist or a lawyer, a chatbot runs on third-party infrastructure, with no professional privilege protecting what you type. (For a practical starting point, see our guide to the most private browsers of 2026.)
Below: the 2025–2026 court decisions that shaped the legal status of AI conversations, how the storage architecture works, and what protective measures exist today.
To understand why conversations with AI are vulnerable, you first need to see how the platforms process and store them. The mechanics are the same across all major cloud AI services — OpenAI, Google, Anthropic, Microsoft — and rest on a few core principles. (For a deeper look at how cloud and local architectures compare, see Cloud AI vs. Local AI: Exploring Data Privacy.)
When you send a message to ChatGPT, Gemini, or any other cloud chatbot, the service stores far more than your prompt and its response. Every request also produces:
The service links each of these elements to your account. Together, they build a detailed digital profile — not only of what you asked, but when, from where, on which device, and in what context.

Access to chats extends well beyond automated systems. According to the privacy policies of OpenAI, Google, and Anthropic, the following parties may view your conversations:
All major AI companies state in their terms of use that they will disclose data in response to a lawful request. In August 2025, OpenAI added that if its systems detect threats of violence in chats, the company may proactively hand information to police without waiting for a request.

Deletion in the interface does not destroy the data immediately. Retention periods vary by provider:
But 30 days is only the default regime. Once a company falls under a litigation hold, retention becomes indefinite. That is exactly what happened in NYT v. OpenAI: the court ordered the company to preserve all chat logs — including ones that users had already deleted.

The only thing standing between your data and third-party disclosure is the company’s privacy policy. That policy is an internal document the company drafts, revises at will, and cannot enforce against a court order. The terms of use explicitly allow disclosure to comply with legal obligations, protect the company’s interests, and ensure safety.
In a cloud AI service, the company controls the data — not you. That follows directly from an architecture that runs processing on someone else’s server.
None of them applies to conversations with an AI chatbot. A chatbot is not a licensed professional, follows no professional code, and bears no responsibility for disclosing information. Yet in practice, users bring AI the same questions they used to bring to lawyers, doctors, and therapists.
In July 2025, OpenAI CEO Sam Altman appeared on This Past Weekend, a podcast hosted by comedian Theo Von — a conversational show with an audience of millions, most of whom don’t work in technology. TechCrunch, Business Insider, TechRadar, and dozens of other outlets picked up his remarks.
According to Altman, people bring ChatGPT their most personal matters — treating it as a therapist and a life coach, asking what they should do. Young users especially. But no legal privilege attaches to those conversations. If a matter reaches litigation and someone makes a lawful request, a court can compel the company to hand over the contents. Altman’s own summary of the situation:
“Very screwed up.”
Legally, the statement broke no new ground — specialists already knew that AI carries no privilege. But public confirmation from the CEO of the largest AI company, in front of a mass audience, moved the issue from trade press into public debate.
Altman also argued for creating a new legal institution modeled on attorney-client privilege. In June 2025, he wrote on X:
“We think conversations with AI should be like conversations with a lawyer or doctor. Hopefully, society figures this out soon.”
At the time of publication, no jurisdiction had created such an institution, and no bill on the subject had advanced beyond discussion.
While the discussion continued in podcasts and on Twitter, the courts were forming their own position.
In April 2026, the federal court for the Southern District of New York decided United States v. Heppner — the first federal ruling to directly address whether AI conversations carry legal privilege. The defendant had entered information he described as “confidential legal strategy” into a public AI platform — effectively using the chatbot to prepare for litigation. Investigators pulled the data during a search and introduced it as evidence.
The defense argued that attorney-client privilege protected the information. The court rejected that argument on three grounds:
The reasoning is straightforward. What matters is the venue: a federal court issued the ruling, creating precedent. The court effectively held that using AI for legal tasks does not, by itself, create any privilege.
For completeness, one Michigan state court reached the opposite conclusion during the same period. In Warner v. Gilbarco, Inc., a self-represented (pro se) party used AI to prepare materials. The court held that the work-product doctrine protected the resulting work, reasoning that generative AI functioned as a tool rather than as a third party to whom the party had disclosed confidential information.
Two caveats limit that ruling:
United States v. Heppner (2026)Warner v. Gilbarco (2026)Court levelFederal (S.D.N.Y.)State (Michigan)Doctrine at issueAttorney-client privilegeWork-product doctrineAI treated asThird party (no privilege)Tool (privilege preserved)OutcomeData disclosedData protectedPrecedent weightHigher (federal)Lower (state)
The legal landscape is fragmented, and no uniform standard yet exists. At the federal level, though, one trend is clear: entering data into a commercial AI platform creates no legal privilege. Until legislation says otherwise, courts will treat information you provide to a cloud chatbot the same way they treat email, text messages, or search history — subject to request and admission in litigation.
The New York Times Company v. Microsoft Corporation et al. became the landmark case for what happens to deleted user chats when a court preservation order is in force.
In December 2023, The New York Times filed suit against OpenAI and Microsoft in the federal court for the Southern District of New York. The core allegation: both companies had used millions of NYT articles to train their language models without permission or payment. The case became one of the largest copyright disputes involving generative AI, and other publishers — including the Chicago Tribune — joined it.
Once discovery began, the case started reaching into the data of ordinary ChatGPT users.
The plaintiffs wanted to prove that ChatGPT systematically reproduces copyrighted content in its responses. For that, they needed real examples — specific answers to specific prompts from real users, not just information about the training data.
The logic was straightforward: if a user asks ChatGPT about a topic covered by an NYT article, and the model reproduces portions of that article in its response, that may constitute copyright infringement. Therefore user chat logs were relevant evidence.
OpenAI objected. The company argued that the request was overbroad, swept in millions of non-party users, and conflicted with its privacy policy and deletion practices.
Several ChatGPT users tried to intervene in the case to protect their data. The court denied those motions repeatedly, on the ground that the users were non-parties to the litigation.
The preservation order stayed in effect for five months. Data preserved during that window remained available to plaintiffs even after the order lifted.
The case set out several principles that extend well beyond this specific copyright dispute:
Alongside civil litigation, U.S. law-enforcement agencies began using AI chatbot conversations as legal evidence in criminal cases through 2025. By early 2026, a consistent practice had emerged.
On January 1, 2025, a fire started in the Pacific Palisades neighborhood of Los Angeles and smoldered for six days. On January 7, strong winds drove it into one of the most destructive wildfires in the city’s history: 12 dead, nearly 7,000 structures destroyed, and estimated damage of $150 billion.
In October 2025, the FBI arrested Jonathan Rinderknecht, a 29-year-old former Uber driver with dual French and U.S. citizenship. Prosecutors charged him with intentional arson, carrying up to 45 years in prison.
The prosecution combined several sources of evidence — iPhone geolocation data, surveillance-camera footage, witness testimony, and analysis of how the fire developed. But it also introduced Rinderknecht’s ChatGPT history as a separate strand.
According to prosecutors, Rinderknecht used ChatGPT as a kind of diary. He generated images of a burning city. He asked the chatbot, “Why am I always angry?” He discussed wealth inequality and expressed the view that rich people were destroying the world. And while calling the police to report the fire, he simultaneously typed a question into ChatGPT:
“Are you guilty if a fire is caused by your cigarette?”
— with a spelling mistake in “lit.” ChatGPT answered yes.
The prosecution used the prompts to argue motive: revenge, anger, loneliness. The defense argued that the prosecution had pulled the conversations out of context. One juror noted during trial that he himself had had similar conversations with chatbots — casting doubt on the claim that such prompts alone demonstrated criminal intent.
At the end of June 2026, the jury deadlocked 10–2 in favor of acquittal, and the judge declared a mistrial. The court scheduled a retrial for October 2026.
The significance is not the outcome — which remains open — but the fact of admission. Federal prosecutors introduced a chatbot conversation history as evidence, and the court accepted it.
In October 2025, Forbes published an investigation into the first documented case of federal investigators obtaining a warrant specifically for ChatGPT user data — not for a known account, but for a reverse search based on prompts.
The background: Homeland Security Investigations had spent a year pursuing the administrator of a dark-web site containing child sexual abuse material. Agents operated undercover and communicated with the suspect through the site. During those exchanges, the suspect mentioned using ChatGPT and shared fragments of his prompts. The prompts themselves involved nothing criminal — one, for example, asked what would happen if Sherlock Holmes met Q from Star Trek.
But knowing the exact wording of the prompts was enough. Investigators obtained a court warrant requiring OpenAI to run a reverse search: identify the account that sent those exact prompts and turn over everything associated with it — full transcripts of all conversations, the user’s name, email address, IP addresses, and payment history.
The novel element was the direction of the search. The warrant required OpenAI not to disclose data from a known account, but to search prompt contents to identify an unknown user — analogous to the “reverse warrants” law-enforcement agencies previously used against Google for geolocation and search queries. For AI platforms, this was the first public precedent.
Jennifer Lynch, an attorney at the Electronic Frontier Foundation, framed the significance:
Although the warrant covered only two prompts from one user, it showed that law-enforcement agencies now view ChatGPT as another data source they can tap for evidence.
The Rinderknecht case and the DHS warrant are not isolated. By the end of 2025, AI conversations had surfaced in several criminal cases:
In the Robertson case, one piece of evidence was a conversation with My AI, Snapchat’s chatbot, in which he asked:
“What if I shoot them if they step onto my property with hostile intent?”
In the Schaeffer case, prosecutors linked the 19-year-old to a series of acts of vandalism through messages he sent to ChatGPT discussing his actions.
In each case, investigators used AI conversations to establish motive, intent, or the suspect’s awareness — the elements criminal law calls mens rea.
Beyond responding to warrants and subpoenas, OpenAI confirmed in August 2025 that the company proactively monitors user conversations for threats of violence. When automated filters flag content that suggests plans to physically harm other people, the conversation goes to a specialized moderation team. If moderators confirm a real threat, the company may hand information to law-enforcement agencies — without notifying the user and without waiting for a court request.
The company follows a different approach in self-harm cases: it does not notify police and instead offers support and crisis resources to the user. But the mere existence of a proactive monitoring system means a court order is not the only path to a ChatGPT conversation — the company may also disclose it on its own initiative.
For law enforcement, AI conversations function as electronic evidence on the same footing as search history, email, and messenger chats. A conversation with a chatbot can be more informative than a search query, though: instead of a few keywords, it is an extended dialogue in which the user articulates thoughts, asks follow-up questions, and discusses possible courses of action.
All major AI platforms offer privacy settings: disabling chat history, Temporary Chat, and opting out of training data use. Each measure has a specific effect — and specific limits.
When you disable history in ChatGPT or use Temporary Chat, the conversation no longer shows up in the sidebar, and the platform does not use it to train the model. The data itself does not vanish from the server. OpenAI keeps it for 30 days for safety monitoring and abuse detection. Google Gemini keeps it for 72 hours; Anthropic keeps it for 30 days. During that window, the data sits on the server, remains accessible to company employees, and a court warrant can pull it.
And if a court issues a preservation order within that window — as happened in NYT v. OpenAI — the 30-day rule stops applying. The data freezes indefinitely.
Users on Free, Plus, and Pro plans can disable the “Improve the model for everyone” option in settings. That does exclude your conversations from the training data for future model versions. It does not change the core fact: the platform still sends the data to the server, processes it there, and stores it for the standard retention period.
Opting out shapes what the company does with the data internally. It has no effect on what the company must do with the data in response to a court order.
ChatGPT Enterprise and business plans offer a substantially stricter regime: no training on user data by default, administrator control over retention, and contractual confidentiality obligations from OpenAI. The preservation order in NYT v. OpenAI expressly excluded customers with Zero Data Retention (ZDR) agreements.
These protections are available to organizations with the budgets and legal resources to negotiate them. For an ordinary user working through a medical diagnosis, a termination, or an insurance dispute, the option is effectively out of reach.
All of the measures above limit how the company uses your data internally. None of them changes the company’s obligation to comply with a court warrant. As long as the data sits on the company’s server, a court order can reach it — regardless of what you toggled in settings.
The alternative to cloud processing is a local language model — an architecture that never sends your data to an external server.
A local language model runs directly on your device. Your device’s processor handles the prompt. Your device generates the response. The data never leaves the machine at any stage — not when you send the prompt, not during processing, and not when the platform stores your conversation history.
When the data never reaches a company server, the mechanisms of court requests, preservation orders, and proactive monitoring have no target. The company physically has no data to disclose.

A local model is not absolute protection. The limits matter:
With cloud AI, someone else stores your data and a court can compel that someone. With a local model, your data stays on your device, and law-enforcement agencies need a warrant to search that specific device — a procedure that is harder and more legally constrained than a request directed at a technology company.
The court decisions and architectural realities above lead to a few practical rules.
Not every AI conversation carries the same risk. Asking a chatbot to phrase an email, explain a textbook concept, or brainstorm project ideas rarely produces material that would cause harm if exposed. Cloud AI remains a convenient and productive tool for those tasks. (For an overview of how a browser-native AI assistant fits into this workflow, see What Is Sigma AI Chat?)
When sensitive information enters the picture, the rule is simple: before you type it, ask whether you would be comfortable with a stranger reading that message. If the answer is no, the message should not leave your device.
Sensitive information includes:
For non-sensitive tasks, cloud models remain useful. Even so, it makes sense to minimize the data you leave on the server.
Court decisions from 2025 and 2026 built a working enforcement practice around conversations with AI chatbots:
Cloud AI remains a productive tool for work that does not require confidentiality. For anything involving sensitive information, local models — where your device processes the data and nothing reaches a third party — are the right architecture.
