Running ML/LLM models on Kubernetes Across Major Cloud Providers with Abhishek Choudhary
Abhishek, co-founder and CTO of @truefoundry, explores the complexities of building a machine learning platform on Kubernetes. Discover solutions to challenges like handling diverse hardware, managing large Docker images, and optimizing costs. Learn how True Foundry uses tools like Argo CD, Keda, and Istio to create efficient abstractions for data scientists and streamline ML operations.