Offline dengan aplikasi Player FM !
[QA] Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers
Manage episode 425855573 series 3524393
Large Language Models can easily manipulate fact retrieval by changing contexts, behaving like associative memory models. Transformers use self-attention and value matrix for memory tasks.
https://arxiv.org/abs//2406.18400
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1553 episode
Manage episode 425855573 series 3524393
Large Language Models can easily manipulate fact retrieval by changing contexts, behaving like associative memory models. Transformers use self-attention and value matrix for memory tasks.
https://arxiv.org/abs//2406.18400
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1553 episode
ทุกตอน
×Selamat datang di Player FM!
Player FM memindai web untuk mencari podcast berkualitas tinggi untuk Anda nikmati saat ini. Ini adalah aplikasi podcast terbaik dan bekerja untuk Android, iPhone, dan web. Daftar untuk menyinkronkan langganan di seluruh perangkat.