Offline dengan aplikasi Player FM !
PingPong: A Benchmark for Role-Playing Language Models with User Emulation and Multi-Model Evaluation
Manage episode 439972240 series 3524393
We present a benchmark for assessing language models' role-playing abilities through dynamic conversations, utilizing player, interrogator, and judge models, validated by experiments comparing automated and human evaluations.
https://arxiv.org/abs//2409.06820
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1657 episode
Manage episode 439972240 series 3524393
We present a benchmark for assessing language models' role-playing abilities through dynamic conversations, utilizing player, interrogator, and judge models, validated by experiments comparing automated and human evaluations.
https://arxiv.org/abs//2409.06820
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1657 episode
सभी एपिसोड
×Selamat datang di Player FM!
Player FM memindai web untuk mencari podcast berkualitas tinggi untuk Anda nikmati saat ini. Ini adalah aplikasi podcast terbaik dan bekerja untuk Android, iPhone, dan web. Daftar untuk menyinkronkan langganan di seluruh perangkat.