This webinar compares the performance OpenAI’s GPT-4.5, Anthropic’s Claude 3.7 Sonnet, and John Snow Labs’ Medical LLM on the five most common tasks related to analyzing clinical notes:
- Summarization: “Summarize the patient’s medical history and initial presentation.”
- Information extraction: “What procedures did the patient undergo in the past year?”
- Question answering: “What biomarkers are commonly negative in APL cases?”
- De-identification: “Generate a HIPAA safe harbor anonymized version of this note.”
- Clinical coding: “What are the billable ICD-10-CM code for this visit?”
This is done via a blind evaluation by practicing medical doctors. The doctors are asked to decide which answer they prefer on the dimensions of factuality, clinical relevance, and conciseness. The evaluation methodology, including the measurement of inter-annotator agreement and drift over time, will be presented as well.
David Talby is the Chief Executive Officer at John Snow Labs, helping companies apply artificial intelligence to solve real-world problems in healthcare and life science.
David is the creator of Spark NLP – the world’s most widely used natural language processing library in the enterprise. He has extensive experience building and running web-scale software platforms and teams – in startups, for Microsoft’s Bing in the US and Europe, and to scale Amazon’s financial systems in Seattle and the UK.
David holds a Ph.D. in Computer Science and Master’s degrees in both Computer Science and Business Administration. He was named USA CTO of the Year by the Global 100 Awards in 2022 and Game Changers Awards in 2023.
Veysel is the Chief Technology Officer at John Snow Labs, improving the Spark NLP for the Healthcare library and delivering hands-on projects in Healthcare and Life Science. Holding a PhD degree in ML, Dr. Kocaman has authored more than 25 papers in peer reviewed journals and conferences in the last few years, focusing on solving real world problems in healthcare with NLP.
He is a seasoned data scientist with a strong background in every aspect of data science including machine learning, artificial intelligence, and big data with over ten years of experience. Veysel has broad consulting experience in Statistics, Data Science, Software Architecture, DevOps, Machine Learning, and AI to several start-ups, boot camps, and companies around the globe.
He also speaks at Data Science & AI events, conferences and workshops, and has delivered more than a hundred talks at international as well as national conferences and meetups.
Reserve Your Spot