AI health chatbots: helpful tools but unreliable and privacy risks persist

While AI chatbots like ChatGPT and Google Gemini can provide quick health information, experts warn they are neither reliable enough nor secure to replace medical professionals, highlighting accuracy issues and data privacy concerns.

AI chatbots are becoming a common first stop for health questions, but the advice they give is not dependable enough to replace a clinician. Consumer Reports says tools such as ChatGPT, Microsoft Copilot and Google Gemini can produce clear, fast answers that sound authoritative, yet they can also invent details or mix up important facts. Kevin Loria, a health reporter at Consumer Reports, said the systems can be useful for gathering general information, but he warned that errors are often difficult to spot.

That concern is supported by recent research. Penn State researchers found that AI systems answered health-related questions with nearly 76% accuracy, which means a substantial share of responses were wrong or incomplete. Separate studies presented at the American Academy of Orthopaedic Surgeons found that popular chatbots gave inconsistent guidance on musculoskeletal conditions, reinforcing the risk of relying on them for medical decisions.

Privacy is another issue. A JAMA article highlighted the risks of data breaches, unauthorised access and the lack of the same confidentiality rules that cover doctor-patient conversations. Consumer Reports also warns that information entered into a chatbot may be stored, used or exposed in a breach, which makes sensitive symptoms, test results and other personal details particularly risky to share.

The practical advice is to use AI only as a starting point, not as a source of diagnosis or treatment. Consumer Reports recommends checking any medical information against trusted sources such as MedlinePlus, the Centres for Disease Control and Prevention or a recognised medical organisation. Loria said that if a question could affect how someone acts on their own health, they should speak with a doctor. AI chatbots should never be used in a medical emergency; in the United States, the correct response is to call 911 immediately.

Disclaimer: This content is intended for informational purposes only. Readers are advised to exercise their own judgement, conduct due diligence, or consult a qualified expert before acting on any information provided.