Installing Open-WebUI and exploring local LLMs on CF: Cloud Foundry Weekly: Episode 46 - podcast episode cover

Installing Open-WebUI and exploring local LLMs on CF: Cloud Foundry Weekly: Episode 46

Feb 21, 20251 hr 10 minEp. 46
--:--
--:--
Download Metacast podcast app
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

We are kicking off our "How-To" mini-series with this episode! We will show a deep dive on deploying the popular open-webui application on Cloud Foundry! Open-WebUI is a great tool to explore and experiment with GenAI on your locally deployed LLMs running on the GenAI for Tanzu Platform tile. We will also deep dive into different model variants and inference engines such as Ollama and vLLM.

Open-WebUI:
https://openwebui.com/

GenAI for tPCF Samples:
https://github.com/nkuhn-vmw/GenAI-for-TPCF-Samples

Cloud Foundry Podcast: https://cloudfoundryweekly.com/episodes
Cloud Foundry Weekly LinkedIn:  https://www.linkedin.com/in/cloud-foundry-weekly 
Cloud Foundry Weekly X: https://x.com/cf_weekly

Nick Kuhn LinkedIn: https://www.linkedin.com/in/nick-kuhn-aa72a39/
Nick Kuhn X: https://x.com/tehkuhnz
Nick Kuhn Blog: https://tehkuhnz.io/

Nicky Pike LinkedIn: https://www.linkedin.com/in/nicky-pike/
Nicky Pike X: https://x.com/bearded_bytes
Nicky Pike Blog: https://nickypike.dev

For the best experience, listen in Metacast app for iOS or Android