Chatbots Crushed USMLE Step 3; Docs Use AI to Fight Insurers; AI for Nurses

Welcome to MedAI Roundup, highlighting the latest news and research in healthcare-related artificial intelligence each month.

Former FDA Director Scott Gottlieb, MD, and colleagues pitted several chatbots against each other in taking the U.S. Medical Licensing Examination (USMLE) Step 3. Here’s how they fared. (CNBC)

Physicians are increasingly turning to generative AI tools to fight back against insurers. (New York Times)

AI tools may be able to help researchers better “talk” to their data. (Nature)

Generative AI responses to patient messages were more empathetic than physician responses, but they were also wonkier, which may pose a challenge for patients with lower health or English literacy, according to a study published in JAMA Network Open.

GPT-4 Vision — the multimodal version of OpenAI’s latest model — outperformed physicians on a multi-choice image-based quiz designed to assess diagnostic ability (81.6% vs 77.8%), but it also provided flawed explanations for 35.5% of its answers, according to research in NPJ Digital Medicine.

Large language models (LLMs) built specifically with evidence-based medicine in mind bested general LLMs on answering clinical questions, according to a study conducted by Atropos Health and published in arXiv.

An article in Nature warned about the potential risk of LLMs corrupting training data with their own previously generated data in a downward feed-loop, which could lead to “model collapse.”

On the business side, the Mayo Clinic has partnered with Abridge and Epic to develop a generative AI ambient documentation workflow specifically for nurses.

Microsoft is partnering with Mass General Brigham and the University of Wisconsin-Madison to develop AI-powered tools for medical imaging.

Suki announced a collaboration with several Federally Qualified Health Centers and Community Health Centers aimed at addressing high patient volumes in underserved areas.

Commure will buy Augmedix, a developer of ambient AI clinical documentation tools. (Fierce Healthcare)

Please enable JavaScript to view the comments powered by Disqus.