Managing AI Costs with Sonia Cuff
Mar 19, 2025•37 min•Ep. 976
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more
Episode description
How are you managing your AI costs? Richard chats with Sonia Cuff about how she's been helping sysadmins understand how AI technology is billed out and how to measure them within a given application and across the organization. Sonia starts with some definitions since the term AI is so broad. It's not just about large language models! The conversation also dives into carbon footprints, and using the FinOps models to help with costing for your cloud infrastructure, whether you're using AI or not!
Links
- OpenAI Tokenizer
- Manage Cost for Azure OpenAI Service
- Sustainable Software Engineering with AKS
- Azure Carbon Optimization
- FinOps Foundation
- FinOps FOCUS
- Phoenix Project
Recorded February 19, 2025
For the best experience, listen in Metacast app for iOS or Android