Monday, July 28, 2025
News Health
  • Health News
  • Hair Products
  • Nutrition
    • Weight Loss
  • Sexual Health
  • Skin Care
  • Women’s Health
    • Men’s Health
No Result
View All Result
  • Health News
  • Hair Products
  • Nutrition
    • Weight Loss
  • Sexual Health
  • Skin Care
  • Women’s Health
    • Men’s Health
No Result
View All Result
HealthNews
No Result
View All Result
Home Health News

Typos and slang spur AI to discourage seeking medical care

June 30, 2025
in Health News
Share on FacebookShare on Twitter


Be cautious about asking AI for advice on when to see a doctor

Chong Kee Siong/Getty Images

Should you see a doctor about your sore throat? AI’s advice may depend on how carefully you typed your question. When artificial intelligence models were tested on simulated writing from would-be patients, they were more likely to advise against seeking medical care if the writer made typos, included emotional or uncertain language – or was female.

“Insidious bias can shift the tenor and content of AI advice, and that can lead to subtle but important differences” in how medical resources are distributed, says Karandeep Singh at the University of California, San Diego, who was not involved in the study.

Abinitha Gourabathina at the Massachusetts Institute of Technology and her colleagues used AI to help create thousands of patient notes in different formats and styles. For example, some messages included extra spaces and typos to mimic patients with limited English proficiency or less ease with typing. Other notes used uncertain language in the style of writers with health anxiety, colourful expressions that lent a dramatic or emotional tone or gender-neutral pronouns.

The researchers then fed the notes to four large language models (LLMs) commonly used to power chatbots and told the AI to answer questions about whether the patient should manage their condition at home or visit a clinic, and whether the patient should receive certain lab tests and other medical resources. These AI models included OpenAI’s GPT-4, Meta’s Llama-3-70b and Llama-3-8b, and the Palmyra-Med model developed for the healthcare industry by the AI company Writer.

The tests showed that the various format and style changes made all the AI models between 7 and 9 per cent more likely to recommend patients stay home instead of getting medical attention. The models were also more likely to recommend that female patients remain at home, and follow-up research showed they were more likely than human clinicians to change their recommendations for treatments because of gender and language style in the messages.

OpenAI and Meta did not respond to a request for comment. Writer does not “recommend or support” using LLMs – including the company’s Palmyra-Med model – for clinical decisions or health advice “without a human in the loop”, says Zayed Yasin at Writer.

Most operational AI tools currently used in electronic health record systems rely on OpenAI’s GPT-4o, which was not specifically studied in this research, says Singh. But he said one big takeaway from the study is the need for improved ways to “evaluate and monitor generative AI models” used in the healthcare industry.

Topics:



Source link : https://www.newscientist.com/article/2486372-typos-and-slang-spur-ai-to-discourage-seeking-medical-care/?utm_campaign=RSS%7CNSNS&utm_source=NSNS&utm_medium=RSS&utm_content=home

Author :

Publish date : 2025-06-30 21:00:00

Copyright for syndicated content belongs to the linked Source.

Previous Post

What the Brains of Centenarians Reveal

Next Post

Medicine Shortages Leave Pharmacies at ‘Breaking Point’

Related Posts

Health News

‘Make Doctors Great Again’: What We Heard This Week

July 27, 2025
Health News

Memory Problems Today Tied to Leaded Gas Levels Half a Century Earlier

July 27, 2025
Health News

Bad ICU Design Hampers Care

July 27, 2025
Health News

Badenoch says Conservatives would ban strikes by NHS doctors

July 27, 2025
Health News

Why Is HHS Targeting the Organ Transplant System?

July 26, 2025
Health News

RFK Jr. Reportedly Planning to Fire All USPSTF Members

July 26, 2025
Load More

‘Make Doctors Great Again’: What We Heard This Week

July 27, 2025

Memory Problems Today Tied to Leaded Gas Levels Half a Century Earlier

July 27, 2025

Bad ICU Design Hampers Care

July 27, 2025

Badenoch says Conservatives would ban strikes by NHS doctors

July 27, 2025

Why Is HHS Targeting the Organ Transplant System?

July 26, 2025

RFK Jr. Reportedly Planning to Fire All USPSTF Members

July 26, 2025

The Rise in Adolescent Bariatric Surgery Doesn’t Mean GLP-1s Have Failed

July 26, 2025

After Venus Williams’ Comment, Here’s What to Know About Athletes’ Health Insurance

July 26, 2025
Load More

Categories

Archives

July 2025
MTWTFSS
 123456
78910111213
14151617181920
21222324252627
28293031 
« Jun    

© 2022 NewsHealth.

No Result
View All Result
  • Health News
  • Hair Products
  • Nutrition
    • Weight Loss
  • Sexual Health
  • Skin Care
  • Women’s Health
    • Men’s Health

© 2022 NewsHealth.

Go to mobile version