Offline dengan aplikasi Player FM !
#02 A clinical introduction to Large language models (LLM), AI chatbots, Med-PaLM
Manage episode 428686727 series 3585389
In this episode, we introduce large language models in healthcare, their potentials and pitfalls. We put AI chatbots like ChatGPT to the test, discuss our thoughts on Google's Med-PaLM, and dabble in a bit of philosophy of artificial general intelligence.
Like what you're hearing? Support us by subscribing and reaching out to us. We want to encourage open discussion between clinicians and developers.
Dev&Doc is a podcast where doctors and developers deep dive into the potential of AI in healthcare.
👨🏻⚕️Doc - Dr. Joshua Au Yeung
🤖Dev - Zeljko Kraljevic
LinkedIn Newsletter
YouTube
Spotify
Apple
Substack
For enquiries - 📧 Devanddoc@gmail.com
Timestamps:
00:00 Start
00:16 Intro
02:04 ChatGPT, A giant leap for mankind?
04:02 Spending two weeks with ChatGPT as a doctor
07:36 History of Large Language Models (LLMs)
10:15 A top down approach to what is an LLM
17:31 Medical language is a language in itself
18:42 A lot of data, that is just wrong
21:05 Self-supervised training LLM
22:05 Instruction based fine tuning a LLM
23:52 Doc summarizing LLM training
25:48 The clinical shortcomings of instruction based tuning
27:33 Reinforcement learning from Human (clinician) feedback
32:22 Doc summarizing LLM, RLHF - A strict vs a progressive parent
34:10 There are still many problems with LLMs, aligning with clinical training data
36:26 Training a LLM on discharge summaries is a bad idea
39:18 Garbage in garbage out - data
40:13 Context windows
40:43 Data cleaning clinical notes
44:31 Bias in scientific domain LLMs PubmedGPT, Galatica
46:31 Data drift in medicine and continual learning
50:01 MedPaLM - instruction tuning to the medical domain
50:23 Model benchmarks do not reflect the real world
59:11 LLM emulating human language, but not the brain. Only one piece of the mind
1:01:10 LLMs on headaches and general knowledge
1:03:25 Where does a LLM fit in into the clinical work flow
1:05:50 Are regulations working against safety?
1:08:26 Cooling down LLMs to pass regulations
1:09:50 Why call it a hallucination? It's a false positive
1:13:57 Examples of bias of ChatGPT - A bad Santa Claus
1:17:00 Do LLMs encode true "understanding"? Can language lead to AGI?
1:20:05 Pregnancy - an acid test for Large Language Models
1:21:55 Training a LLM for the NHS (NHS-LLM)
1:25:25 Tell the model to "think deeply"
1:27:55 Asking ChatGPT to draw a picture of a human O.O
1:31:00 Language is not enough to achieve AGI
1:32:10 What can clinicians do about LLMs? Assisting vs Autonomous
1:39:07 What's next- Forecasting diagnoses with AI
🎞️ Editor - Dragan Kraljević
🎨 Brand design and art direction - Ana Grigorovici
25 episode
Manage episode 428686727 series 3585389
In this episode, we introduce large language models in healthcare, their potentials and pitfalls. We put AI chatbots like ChatGPT to the test, discuss our thoughts on Google's Med-PaLM, and dabble in a bit of philosophy of artificial general intelligence.
Like what you're hearing? Support us by subscribing and reaching out to us. We want to encourage open discussion between clinicians and developers.
Dev&Doc is a podcast where doctors and developers deep dive into the potential of AI in healthcare.
👨🏻⚕️Doc - Dr. Joshua Au Yeung
🤖Dev - Zeljko Kraljevic
LinkedIn Newsletter
YouTube
Spotify
Apple
Substack
For enquiries - 📧 Devanddoc@gmail.com
Timestamps:
00:00 Start
00:16 Intro
02:04 ChatGPT, A giant leap for mankind?
04:02 Spending two weeks with ChatGPT as a doctor
07:36 History of Large Language Models (LLMs)
10:15 A top down approach to what is an LLM
17:31 Medical language is a language in itself
18:42 A lot of data, that is just wrong
21:05 Self-supervised training LLM
22:05 Instruction based fine tuning a LLM
23:52 Doc summarizing LLM training
25:48 The clinical shortcomings of instruction based tuning
27:33 Reinforcement learning from Human (clinician) feedback
32:22 Doc summarizing LLM, RLHF - A strict vs a progressive parent
34:10 There are still many problems with LLMs, aligning with clinical training data
36:26 Training a LLM on discharge summaries is a bad idea
39:18 Garbage in garbage out - data
40:13 Context windows
40:43 Data cleaning clinical notes
44:31 Bias in scientific domain LLMs PubmedGPT, Galatica
46:31 Data drift in medicine and continual learning
50:01 MedPaLM - instruction tuning to the medical domain
50:23 Model benchmarks do not reflect the real world
59:11 LLM emulating human language, but not the brain. Only one piece of the mind
1:01:10 LLMs on headaches and general knowledge
1:03:25 Where does a LLM fit in into the clinical work flow
1:05:50 Are regulations working against safety?
1:08:26 Cooling down LLMs to pass regulations
1:09:50 Why call it a hallucination? It's a false positive
1:13:57 Examples of bias of ChatGPT - A bad Santa Claus
1:17:00 Do LLMs encode true "understanding"? Can language lead to AGI?
1:20:05 Pregnancy - an acid test for Large Language Models
1:21:55 Training a LLM for the NHS (NHS-LLM)
1:25:25 Tell the model to "think deeply"
1:27:55 Asking ChatGPT to draw a picture of a human O.O
1:31:00 Language is not enough to achieve AGI
1:32:10 What can clinicians do about LLMs? Assisting vs Autonomous
1:39:07 What's next- Forecasting diagnoses with AI
🎞️ Editor - Dragan Kraljević
🎨 Brand design and art direction - Ana Grigorovici
25 episode
Semua episode
×1 #24 Significantly advancing LLMs with RAG (Google's Gemini 2.0, Deep Research, notebookLM) 57:46
1 #23 Can OpenAI's GPT o1 solve complex medical problems? 39:44
1 #22 Explaining Explainable AI (for healthcare) with Dr Annabelle Painter (RSM digital health section Podcast) 58:40
1 #21 Foundational Models in Digital Pathology: Enhancing Cancer detection and outcomes 1:01:43
1 #20 How to build a successful healthTech/ BioTech start-up (2024 roadmap) - Derrick Khor 1:08:33
1 #19 Tracking health with technology and AI - demystifying digital biomarkers 1:03:36
1 #18 Keith Grimes - Startups and doctors, HealthTech consulting, Babylon's demise, Leadership theory 1:09:33
1 #17 How to build a clinically safe Large Language Model - Hippocratic AI, Llama3, Biollama 43:24
1 #16 Dev&Doc x Rewired - LLMs, Clinical foundation models and automating administrative tasks (live) 46:59
1 #14 Aligning AI models for healthcare | Understanding Reinforcement Learning from Human Feedback (RLHF) 42:01
1 #13 Research begins when hype ends - Doc's adventure, LlaMa3 , Code LlaMa, Gemini Ultra 18:04
1 #12 2024 AI Predictions : Ambient clinical intelligence, language models as commodities, GPT-5 and AGI 46:15
1 #11 The AI race to automate clinical coding 28:01
1 #10 The building blocks of AGI - Google's Gemini, OpenAI's Q* 28:37
Selamat datang di Player FM!
Player FM memindai web untuk mencari podcast berkualitas tinggi untuk Anda nikmati saat ini. Ini adalah aplikasi podcast terbaik dan bekerja untuk Android, iPhone, dan web. Daftar untuk menyinkronkan langganan di seluruh perangkat.