New research reveals uptake of AI-powered messaging in healthcare settings
Clinicians with access to generated drafts used them around 20 percent of the time, and improved response times by seven percent.
A new study from NYU Tandon, NYU Langone Health, and the NYU Stern School of Business offers one of the first data-driven looks at how generative AI might help healthcare providers manage their message overload — and why many are hesitant to adopt the technology.
Over a ten-month period from October 2023 through August 2024, a team led by Morton L. Topfer Professor of Technology Management Oded Nov observed more than 55,000 patient messages sent to healthcare providers through a secure online patient portal. The system used an embedded generative AI tool that automatically generated draft replies for incoming patient messages; healthcare providers could choose to start with the draft, begin a reply from scratch, or use their usual reply interface.
The research was published in npj Digital Medicine.
“This paper provides evidence that AI has the potential to make patient-provider communication more efficient and more responsive,” says Soumik Mandal, research scientist and lead author of the research. “To unlock its full potential in the next phase, however, will require tailored implementation to ensure that AI tools meaningfully reduce clinician burden while enhancing care quality. The paper outlines some practical strategies to improve draft utilization and guide future implementation efforts as key next steps.”
Other authors include NYU Stern’s Batia M. Wiesenfeld, as well as NYU Langone Health’s Adam C. Szerencsy, William R. Small, Vincent Major, Safiya Richardson, Antoinette Schoenthaler, and Devin Mann.
According to the published results, providers chose to “Start with Draft” in 19.4 percent of cases where a draft was shown. Adoption rose modestly over the course of the study as the system’s prompting improved. Using a draft shaved roughly 7 percent off response times, a median of 331 seconds versus 355 seconds when drafting from scratch, but in many cases, this time saved was offset by time spent reviewing, editing, or ignoring drafts.
“LLMs are a new technology that can help providers be more responsive, more effective and more efficient in their communication with their patients,” says Nov. “The more we understand who uses it and why, the better we can leverage it.”
By analyzing tens of thousands of messages, the researchers found that certain qualities made drafts more likely to be used. Shorter, more readable, and more informative drafts tended to be preferred. Tone also mattered: messages that sounded slightly more human and empathetic were more likely to be adopted, though the ideal balance differed by role. Physicians leaned toward concise, neutral text, while support staff were more receptive to messages with a warmer tone. These preferences hint at a future where AI systems could adapt their writing style based on the user’s role or communication history.
Still, the study shows how hesitant healthcare providers remain to rely on AI-generated language at all. The authors suggest several possible reasons including suboptimal alignment with clinical workflows, and the cognitive cost of reviewing a constant stream of AI output, much of which may be irrelevant. Simply generating text for every message, they argue, can create clutter that undermines the very efficiency such tools are meant to provide.
The researchers see ample opportunity ahead. Future systems may need to learn each user’s style, selectively generate drafts only for messages likely to benefit, and continuously adapt prompt strategies.
Mandal, Soumik, et al. Utilization of Generative AI-Drafted Responses for Managing Patient-Provider Communication, 2 Sept. 2025, https://doi.org/10.1101/2025.08.31.25334725.
