The field of natural language processing (NLP) is rapidly advancing, and accurate clinical and biomedical NLP models are becoming increasingly important. In this keynote speech, Veysel will present a detailed comparison of the state-of-the-art large language models (LLMs) (namely ChatGPT, GPT-3, GPT-3.5 and BioGPT) and the pre-trained deep learning (DL) models from Spark NLP for Healthcare on various NLP tasks, including NER, relation extraction, assertion status, de-identification, and entity resolution. Through his talk, Veysel will demonstrate the strengths and weaknesses of both types of models and aim to show that pre-trained DL models could still be more accurate choice for these types of tasks in real world clinical settings. He will also discuss important factors such as privacy, cost, tunability, freshness, and pre-processing gaps associated with the use of large language models. His presentation will include the benchmarking results, providing attendees with an opportunity to review the methods and evaluate the findings for themselves. The overall goal of this talk is to provide a fair and unbiased analysis of the performance of these models in clinical and biomedical NLP tasks, to help attendees make informed decisions about the best choice for their use case.