Prépublication · 2026
How Safe Is ChatGPT Health Advice? Evidence from Real User Conversations in Four Global South Countries
Shreyasi Roy Chowdhury, Kiran Garimella — Monde
Source : arXiv
Résumé
People increasingly bring their health questions to ChatGPT, yet safety evaluations of LLM health advice rest almost entirely on clinician-authored vignettes, synthetic prompts, or simulated user profiles. The gap is widest for the Global South, where concerns about demographic bias and unsafe recommendations are well documented but have never been tested on real usage. We present, to our knowledge, the first demographically grounded safety evaluation of real-world health conversations with ChatGPT. From a consent-based data-donation corpus of 202,590 conversations from 1,252 users in India, N…