The Rundown AI: Old AI model tops doctors in ER trial

Posted on May 4, 2026 by michelleclarke2015

🏥 Old AI model tops doctors in ER trial
Image source: Images 2.0 / The Rundown
The Rundown: A Harvard study published in Science just put OpenAI’s o1-preview (released in 2024) through 76 real ER cases, with the AI diagnosing patients more accurately than two physicians, despite using only raw electronic health-record text.
The details:
The study compared OpenAI’s o1-preview model with two attending physicians across 76 real ER cases and three decision stages of patient care.At initial ER triage, the model gave the correct diagnosis 67.1% of the time, compared to 55.3% and 50.0% for the two physicians.The two separate physician reviewers tasked with scoring couldn’t tell which diagnoses came from the model and which came from the humans.In one case, the AI flagged a rare flesh-eating infection in a transplant patient roughly 12 to 24 hours before the treating doctor caught it.
Why it matters: Millions of people are already using AI daily for health questions, but studies like these are showing the usefulness can also flow the other way to the doctors themselves. If a model generations behind is already beating ER doctors, imagine what the frontier could look like inside the patient care process.
Unknown's avatar

About michelleclarke2015

Life event that changes all: Horse riding accident in Zimbabwe in 1993, a fractured skull et al including bipolar anxiety, chronic fatigue …. co-morbidities (Nietzche 'He who has the reason why can deal with any how' details my health history from 1993 to date). 17th 2017 August operation for breast cancer (no indications just an appointment came from BreastCheck through the Post). Trinity College Dublin Business Economics and Social Studies (but no degree) 1997-2003; UCD 1997/1998 night classes) essays, projects, writings. Trinity Horizon Programme 1997/98 (Centre for Women Studies Trinity College Dublin/St. Patrick's Foundation (Professor McKeon) EU Horizon funded: research study of 15 women (I was one of this group and it became the cornerstone of my journey to now 2017) over 9 mth period diagnosed with depression and their reintegration into society, with special emphasis on work, arts, further education; Notes from time at Trinity Horizon Project 1997/98; Articles written for Irishhealth.com 2003/2004; St Patricks Foundation monthly lecture notes for a specific period in time; Selection of Poetry including poems written by people I know; Quotations 1998-2017; other writings mainly with theme of social justice under the heading Citizen Journalism Ireland. Letters written to friends about life in Zimbabwe; Family history including Michael Comyn KC, my grandfather, my grandmother's family, the O'Donnellan ffrench Blake-Forsters; Moral wrong: An acrimonious divorce but the real injustice was the Catholic Church granting an annulment – you can read it and make your own judgment, I have mine. Topics I have written about include annual Brain Awareness week, Mashonaland Irish Associataion in Zimbabwe, Suicide (a life sentence to those left behind); Nostalgia: Tara Hill, Co. Meath.
This entry was posted in Uncategorized. Bookmark the permalink.

Leave a comment