Episode description

In this one, I discuss the dilemma between using retrieval-based generation and the newer "long context models".

Long context models, like the Gemini suite of models, allow us to send up to millions of tokens (thousands of text pages), whereas retrieval (RAG)-based systems allow us to search through as much (if not more) content and retrieve only the necessary bits to send the LLM for improved answers.

Both have advantages and disadvantages. This short episode will help you better understand when to use each.

Build Your First Scalable Product with LLMs: https://academy.towardsai.net/courses/beginner-to-advanced-llm-dev?ref=1f9b29

Master LLMs and Get Industry-ready Now: https://academy.towardsai.net/?ref=1f9b29

Our ebook: https://academy.towardsai.net/courses/buildingllmsforproduction?ref=1f9b29