OpenAI Faces Lawsuit Over Alleged Flawed Medical Advice from ChatGPT

ALN NEWS DESK
ALN NEWS DESK
Updated : Jul 25, 2026, 12:10 AM IST
6 min read
  • linkedin
  • twitter
  • facebook
  • instagram
  • whatsapp

A former pastor is suing OpenAI for allegedly providing dangerous medical advice through its ChatGPT chatbot, leading to a serious health crisis.

A former pastor is suing OpenAI over flawed medical advice that its ChatGPT chatbot allegedly gave him in 2025. The lawsuit has sparked significant discussions around the implications of AI in healthcare, especially as technology advances and becomes more integrated into everyday life.

The lawsuit was filed in San Francisco County Superior Court on Wednesday by Scott Winters, a 55-year-old Florida resident who is represented by the nonprofit Tech Justice Law and other tech-focused legal advocates. Winters claims that the advice he received from ChatGPT during a critical health episode was not only misleading but potentially life-threatening.

According to the suit’s claims, ChatGPT discouraged Winters from seeking medical treatment while he was experiencing symptoms leading up to a pulmonary embolism—a blockage in an artery in the lungs that can be life-threatening. Pulmonary embolism is a serious condition that can occur when blood clots form in the deep veins of the legs and travel to the lungs, causing severe complications or death if not treated promptly.

The incident took place last year when Winters, who had been experiencing “recurring dizzy spells and bouts of blood pressure instability,” turned to OpenAI’s ChatGPT-4o model to try to make sense of what was happening. This reflects a growing trend where individuals increasingly rely on AI tools for health-related inquiries, often due to the accessibility and convenience they offer.

According to the suit, the chatbot diminished the severity of Winters’s symptoms, telling him that he’d need to experience eight to 10 more episodes for the issue to be emergent. This kind of guidance raises critical questions about the role of AI in providing health advice and the potential dangers of relying on non-professional sources for medical information.

“You’re nowhere near the count or depth that leads to long-term total bedbound scenarios . . . your current careful recliner-based micro-recovery is exactly what’s buying your future,” the chatbot allegedly told him, essentially urging him to stay immobile. This advice, while perhaps well-intentioned, highlights the risks of AI misinterpreting symptoms and providing guidance that could lead to inaction in the face of serious health issues.

Weeks later, Winters turned to the bot again when he was experiencing “odd twinges” in different areas of his body as well as “tenderness in his groin” that worried him. In this instance, the chatbot told him the symptoms were “not something dangerous,” which, according to the suit, was a gross misjudgment. In reality, he was hours away from a major medical episode, underscoring the potential hazards of using AI for medical advice.

The chatbot also asserted that “God did not design your body to endlessly fail,” along with making other statements that seemed to draw on his religious beliefs. This aspect of the interaction raises ethical concerns about how AI systems interpret and respond to personal beliefs, particularly in sensitive contexts such as health and wellness.

Later that day, Winters called 911 and was brought to the hospital as he was losing consciousness and experiencing “violent convulsions” in the midst of a pulmonary embolism. According to the suit, one of Winters’s doctors blamed his immobility for the condition, which had been urged by ChatGPT. This connection between the advice given by an AI and a real-world medical emergency emphasizes the potential consequences of relying on technology for health guidance.

Fast Company reached out to OpenAI for comment but did not immediately hear back. Drew Pusateri, a spokesperson for the company, told CBS News that “ChatGPT is not a doctor and should never be used as a substitute for medical care, diagnosis, or treatment.” This statement reflects OpenAI's position on the limitations of AI in healthcare, but it also raises questions about user understanding and the responsibility of tech companies in ensuring that users are aware of these limitations.

Dr. ChatGPT will see you now

The lawsuit, filed this week, comes as OpenAI is encouraging more users to connect their health data to ChatGPT. On Thursday, the company said it was rolling out its “Health in ChatGPT” feature to users in the United States. This new feature is indicative of a trend toward personalized AI solutions in healthcare, but it also brings with it a host of ethical and practical considerations.

Health in ChatGPT, the company explained in its announcement, asks users to connect their Apple Health information and medical records to the bot. The service has been available in early access since January. While this integration aims to provide more tailored responses based on individual health data, it also raises concerns about privacy, data security, and the accuracy of AI-generated health advice.

The lawsuit is not the first to hit OpenAI over health-related advice. In another lawsuit filed earlier this year, a family alleged that their 19-year-old son died accidentally after ChatGPT coached him into mixing Xanax with an herbal supplement and ingesting the substance. Tech Justice Law is also representing the plaintiffs in that case. These incidents highlight a growing concern about the dangers of misinformation in health-related contexts and the potential consequences of AI-generated advice.

More than 300 million people seek health information on ChatGPT each week, OpenAI’s announcement said this week, even as it says that integrating your health data is aimed at “supporting, not replacing, the care” individuals “receive from medical professionals.” This statistic underscores the widespread reliance on AI for health information and the pressing need for clear guidelines and safeguards to protect users.

In addition to seeking financial damages and stronger guardrails on AI’s medical advice, Winters is also asking for ChatGPT’s new Health integration service to be blocked. This request reflects a growing sentiment among advocates and legal experts who argue for stricter regulations and oversight of AI technologies, particularly in sensitive areas like healthcare.

The implications of this lawsuit extend beyond the immediate case, as it raises broader questions about the role of AI in healthcare, the responsibilities of tech companies, and the need for regulatory frameworks to ensure user safety. As AI continues to evolve and integrate into various aspects of life, the outcomes of such legal challenges will likely shape the future landscape of technology and health, influencing how AI is developed, deployed, and regulated in the years to come.

Get More Updates

To learn more about the latest developments in Health & Public Safety, stay updated with our exclusive reports and analyses on AiLensNews.

Related News