Offline dengan aplikasi Player FM !
[QA] The Remarkable Robustness of LLMs: Stages of Inference?
Manage episode 426022284 series 3524393
The study explores Large Language Models' robustness by deleting and swapping layers, finding interventions retain 72-95% accuracy without fine-tuning, with more layers showing increased robustness.
https://arxiv.org/abs//2406.19384
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1252 episode
Manage episode 426022284 series 3524393
The study explores Large Language Models' robustness by deleting and swapping layers, finding interventions retain 72-95% accuracy without fine-tuning, with more layers showing increased robustness.
https://arxiv.org/abs//2406.19384
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1252 episode
Tutti gli episodi
×Selamat datang di Player FM!
Player FM memindai web untuk mencari podcast berkualitas tinggi untuk Anda nikmati saat ini. Ini adalah aplikasi podcast terbaik dan bekerja untuk Android, iPhone, dan web. Daftar untuk menyinkronkan langganan di seluruh perangkat.