Artwork

Konten disediakan oleh Kubernetes Bytes, Ryan Wallner, and Bhavin Shah. Semua konten podcast termasuk episode, grafik, dan deskripsi podcast diunggah dan disediakan langsung oleh Kubernetes Bytes, Ryan Wallner, and Bhavin Shah atau mitra platform podcast mereka. Jika Anda yakin seseorang menggunakan karya berhak cipta Anda tanpa izin, Anda dapat mengikuti proses yang diuraikan di sini https://id.player.fm/legal.
Player FM - Aplikasi Podcast
Offline dengan aplikasi Player FM !

Deploy and fine-tune LLM models on Kubernetes using KAITO

44:17
 
Bagikan
 

Manage episode 433011321 series 3332465
Konten disediakan oleh Kubernetes Bytes, Ryan Wallner, and Bhavin Shah. Semua konten podcast termasuk episode, grafik, dan deskripsi podcast diunggah dan disediakan langsung oleh Kubernetes Bytes, Ryan Wallner, and Bhavin Shah atau mitra platform podcast mereka. Jika Anda yakin seseorang menggunakan karya berhak cipta Anda tanpa izin, Anda dapat mengikuti proses yang diuraikan di sini https://id.player.fm/legal.

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Sachi Desai, Product Manager and Paul Yu, Sr. Cloud Advocate at Microsoft to talk about the open source KAITO project. KAITO is the Kubernetes AI Toolchain Operator that enables AKS users to deploy open source LLM models on their Kubernetes clusters. They discuss how KAITO helps with running AI-enabled applications alongside the LLM models, how it helps users bring their own LLM models and run them as containers, and how KAITO helps them fine-tune open source LLMs on their Kubernetes clusters.

Check out our website at https://kubernetesbytes.com/

Cloud Native News:

  • https://azure.github.io/AKS/2024/07/30/azure-container-storage-ga
  • https://github.blog/news-insights/product-news/introducing-github-models/

Show links:

  1. Fei Guo - https://www.linkedin.com/in/fei-guo-a48319a/
  2. Ishaan Sehgal - https://www.linkedin.com/in/ishaan-sehgal/

Timestamps:

  • 00:02:15 Cloud Native News
  • 00:05:34 Interview with Sachi and Paul
  • 00:42:08 Key takeaways
  continue reading

85 episode

Artwork
iconBagikan
 
Manage episode 433011321 series 3332465
Konten disediakan oleh Kubernetes Bytes, Ryan Wallner, and Bhavin Shah. Semua konten podcast termasuk episode, grafik, dan deskripsi podcast diunggah dan disediakan langsung oleh Kubernetes Bytes, Ryan Wallner, and Bhavin Shah atau mitra platform podcast mereka. Jika Anda yakin seseorang menggunakan karya berhak cipta Anda tanpa izin, Anda dapat mengikuti proses yang diuraikan di sini https://id.player.fm/legal.

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Sachi Desai, Product Manager and Paul Yu, Sr. Cloud Advocate at Microsoft to talk about the open source KAITO project. KAITO is the Kubernetes AI Toolchain Operator that enables AKS users to deploy open source LLM models on their Kubernetes clusters. They discuss how KAITO helps with running AI-enabled applications alongside the LLM models, how it helps users bring their own LLM models and run them as containers, and how KAITO helps them fine-tune open source LLMs on their Kubernetes clusters.

Check out our website at https://kubernetesbytes.com/

Cloud Native News:

  • https://azure.github.io/AKS/2024/07/30/azure-container-storage-ga
  • https://github.blog/news-insights/product-news/introducing-github-models/

Show links:

  1. Fei Guo - https://www.linkedin.com/in/fei-guo-a48319a/
  2. Ishaan Sehgal - https://www.linkedin.com/in/ishaan-sehgal/

Timestamps:

  • 00:02:15 Cloud Native News
  • 00:05:34 Interview with Sachi and Paul
  • 00:42:08 Key takeaways
  continue reading

85 episode

Tüm bölümler

×
 
Loading …

Selamat datang di Player FM!

Player FM memindai web untuk mencari podcast berkualitas tinggi untuk Anda nikmati saat ini. Ini adalah aplikasi podcast terbaik dan bekerja untuk Android, iPhone, dan web. Daftar untuk menyinkronkan langganan di seluruh perangkat.

 

Panduan Referensi Cepat