Detecting new lesions with an LLM(opens in a new tab)
Annals of NeurologyWhether an MRI showed new lesions was written into narrative reports, not stored as anything you could count. One prompt turned every report in our health record into data we could analyze, and that analysis became my first-author paper in Annals of Neurology.
- Reports14,888 MRI reports from 2000 to 2022, with new T2 and contrast-enhancing lesions described only in prose.
- PromptOne prompt reads each report and returns discrete fields.
- FieldsNew T2 lesions, how many, and whether any enhance: things you can finally count.
- Check97% accurate against manual annotation. Every report classified in about four hours, for $28.
- AnalysisWith those labels we identified neighborhood poverty as a predictor of new inflammatory activity on B-cell depleting therapy.