Artificial intelligence has proven itself useful in reading medical imaging and even shown it can pass doctors’ licensing exams.
Now, a new AI tool has demonstrated the ability to read physicians’ notes and accurately anticipate patients’ risk of death, readmission to hospital, and other outcomes important to their care.
Designed by a team at NYU Grossman School of Medicine, the software is currently in use at the university’s affiliated hospitals throughout New York, with the hope that it will become a standard part of health care.
A study on its predictive value was published on Wednesday in the journal Nature. Lead author Eric Oermann, an NYU neurosurgeon and computer scientist, said that while non-AI predictive models have been around in medicine for a long time, they were hardly used in practice because the data they needed requires cumbersome reorganisation and formatting.
But “one thing that’s common in medicine everywhere, is physicians write notes about what they’ve seen in clinic, what they’ve discussed with patients,” he said.
“So our basic insight was, can we start with medical notes as our source of data, and then build predictive models on top of it?” The large language model, called NYUTron, was trained on millions of clinical notes from the health records of 387,000 people who received care within NYU Langone hospitals between January 2011 and May 2020.
These included any records written by doctors, such as patient progress notes, radiology reports and discharge instructions, resulting in a 4.1-billion-word corpus.
One of the key challenges for the software was interpreting the natural language that physicians write in, which varies greatly among individuals, including in the abbreviations they choose.
By looking back at records of what happened, researchers were able to calculate how often the soft-ware’s predictions turned out to be accurate.
They also tested the tool in live environments, training it on the records from, for example, a hospi-tal in Manhattan then seeing how it fared in a Brooklyn hospital, with different patient demo-graphics.
Overall, NYUTron identified an unnerving 95 per cent of people who died in hospital before they were discharged, and 80pc of patients who would be readmitted within 30 days.—AFP
