Large Language Models for Interrogating Drug Labels March 12, 2026

Webcast | Virtual

---

• Date: March 12, 2026
• Time: 3:00 p.m. - 4:00 p.m. ET

UCSF CERSI

Thursday, March 12, 2026
3:00 – 4:00 PM (Eastern Standard Time)

Presented By

Russ B Altman, MD, PhD
Kenneth Fong Professor of Bioengineering, Genetics, Medicine, Biomedical Data Science and (by courtesy) of Computer Science, and Senior Fellow at the Stanford Institute for HAI

About the Presentation

Working with the Office of Generic Drugs at CDER, we built a benchmark to measure the accuracy of LLMs in accurately extracting information from drug labels.  The benchmark includes simple retrieval of information, retrieval requiring synthesis and questions that the benchmark should refuse to answer (as impossible or nonsensical).  We evaluated current commodity LLMs on this benchmark. We then fine-tuned a publicly available LLM model with a fraction of this benchmark and held out the remainder for testing. We report the results of a fine-tuned model and discuss challenges in accurate extraction of drug label information.

About the Presenter

Russ Biagio Altman, M.D., Ph.D., is the Kenneth Fong Professor of Bioengineering, Genetics, Medicine, Biomedical Data Science and (by courtesy) Computer Science, Senior Fellow at the Stanford Institute for HAI, and past chairman of the Bioengineering Department at Stanford University. His research applies informatics, data science and AI to problems relevant to medicine. He is interested in methods for understanding drug action, efficacy and adverse effects while integrating molecular, cellular, organism and population data. His lab has a special focus on how human genetic variation impacts drug response—pharmacogenomics—and is the founding Principal Investigator of the Pharmacogenomics Knowledgebase. He helps lead an FDA-supported Center of Excellence in Regulatory Science & Innovation and is an Associate Director of the Stanford Institute for Human-Centered Artificial Intelligence.  He has chaired the FDA Science Board and served on the NIH Director’s Advisory Committee.

Dr. Altman holds an AB from Harvard College, an MD from Stanford Medical School, and a PhD in Medical Information Sciences from Stanford. He is a fellow of the American College of Physicians, the American College of Medical Informatics, the American Institute of Medical and Biological Engineering, and the American Association for the Advancement of Science. He is a member of the National Academy of Medicine (previously Institute of Medicine) and co-chaired the IOM’s Drug Forum. Dr. Altman is also a past president, founding board member, and a fellow of the International Society for Computational Biology), and a past president of the American Society for Clinical Pharmacology & Therapeutics.  

The founding editor of Annual Reviews of Biomedical Data Science, he hosts a podcast entitled “The Future of Everything.”.

Remote Access Information

https://ucsf.zoom.us/j/92399248442?pwd=ZpUfTpqnm0w3D3dDpvUCwEM75MYfsO.1

Advance Registration NOT Required.

For Questions and Reasonable Accommodations

Please contact Ruize Li at Ruize.Li@fda.hhs.gov or go to Interpreting.Services@oc.fda.gov.