Episode description
Chatbots use natural language processing (NLP) to converse and answer questions posed by a human user. Large language models (think billions of language parameters/nodes connected via networks to produce non-linear correlations between nodes) have accelerated the usability of chatbots. Original composition, answering complex questions etc. are some of the featuresIn this episode we examine the feasibility of a hugely popular chatbot to answer a national medical licensing exam and discuss the implications of this disruptive innovation.
Episode Host: Jonathan Sherbino
Episode article
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR Medical Education, 9(1), e45312. https://doi.org/10.2196/45312
For show notes and more info, please look at the Episode page
Hosts: Lara Varpio, Jason Frank, Jonathan Sherbino, Linda Snell
Technical Producer: Samuel Lundberg
Executive Producer: Teresa Sörö
Production of Unit for teaching and learning at Karolinska Institutet