LLMs

Health Tech

LLMs Can Perpetuate Harmful Ideas About Race-Based Medicine, Study Shows

A new study led by Stanford researchers tested four commercially available LLMs and found that they all could potentially cause harm by breeding inaccurate, racist information. For example, all models tried to justify race-based medicine when asked questions about calculating patients’ kidney function and lung capacity — two areas where race-based medicine practices used to be common but have since been scientifically refuted.

Health Tech

Healthcare AI Trends to Watch: M&A Exits & Generative AI Use Cases

The healthcare AI space will be an exciting one to watch over the next couple years, as investment dollars flow to startups and providers launch more AI pilots. Two of the most interesting trends to watch will be the use cases that healthcare organizations prioritize when deploying generative AI models, as well as M&A activity within the healthcare AI field, a CB Insights analyst declared during a recent webinar.

Health Tech

Senator Probes Google About ‘Premature Deployment of Unproven Technology’ In Healthcare Settings

Senator Mark Warner (D-Virginia) penned a letter to Google leadership expressing concerns about Med-PaLM 2 — the company’s generative AI tool for healthcare providers that is currently being used by Mayo Clinic and other health systems. The letter requested that Google provide more clarity about its chatbot’s training, accuracy, ethical considerations and deployment in healthcare settings.

Health Tech

Is Amazon’s Approach With HealthScribe Favoring Collaboration Over Competition Smart?

Amazon recently unveiled HealthScribe, an API that software companies can use to create clinical note generation apps that providers can later adopt. With this approach, Amazon is seeking to collaborate with companies that are building clinical documentation AI apps rather than compete with them. Some think this approach is clever, but others think it does little to facilitate bi-directional EHR integration and create standardization.

Health Tech

Advice Given by ChatGPT Vs. Human Providers Is Nearly Indistinguishable, NYU Study Says

NYU researchers conducted a study this year in which nearly 400 people were asked to identify whether responses to patient questions were produced by human providers or ChatGPT. Participants had a limited ability to tell the source of the responses apart, so the study authors concluded that the use of LLMs like ChatGPT could be an effective way to streamline healthcare providers’ communication with patients.

Health Tech

The 3 Hottest Areas for Healthcare Generative AI

There are three key areas of the healthcare sector where generative AI is booming the most — in terms of both venture capital funding and the development of innovative technology — according to Anjalika Komatireddy, an analyst at CB Insights. During a recent webinar, she discussed the generative AI activity occurring in these three areas: care delivery and navigation, digital therapeutics and drug discovery.