The Microsoft AI team shares research that demonstrates how AI can sequentially investigate and solve medicine’s most complex diagnostic challenges—cases that expert physicians struggle to answer.
Benchmarked against real-world case records published each week in the New England Journal of Medicine, we show that the Microsoft AI Diagnostic Orchestrator (MAI-DxO) correctly diagnoses up to 85% of NEJM case proceedings, a rate more than four times higher than a group of experienced physicians. MAI-DxO also gets to the correct diagnosis more cost-effectively than physicians.
The AI only needs to alert the doctor that something is off and should be tested for. It does not replace doctors, but augments them. It’s actually a great use for AI, it’s just not what we think of as AI in a post-LLM world. The medically useful AI is pattern recognition. LLMs may also help doctors if they need a starting point into researching something weird and obscure, but ChatGPT isn’t being used for diagnosing patients, nor is anything any AI says the “final verdict”. It’s just a tool to improve early detection of disorders, or it might point someone towards an useful article or book.