Episode 183 - Gemini 1.5: One Million Tokens, Endless Possibilities? 🤯

Google's Gemini 1.5 is here, boasting a mind-blowing 1 million token context window! 🤯 Join Allen and Linda as they dive deep into this experimental AI, exploring its capabilities, limitations, and potential use cases. 🤔

They share their experiences testing Gemini 1.5 with original content, including Two Voice Devs transcripts and synthetic videos, and discuss the challenges of finding data that hasn't already been used to train the AI. 🧐

Get ready for a lively discussion on hallucinations, the future of content creation, and the ethical questions surrounding these powerful language models. 🤖

More info:

* https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/

* https://developers.googleblog.com/2024/02/gemini-15-available-for-private-preview-in-google-ai-studio.html

* https://openai.com/sora

Timestamps:

00:00:00 Introduction

00:01:05 Notable features of Gemini 1.5

00:02:57 What is a token?

00:06:39 Linda's test with Danish citizenship PDF

00:09:33 Allen's test with Les Miserables and needle in a haystack

00:12:27 Testing with Data Portability API data

00:14:28 Linda's test with YouTube search history and Netflix recommendations

00:17:44 Allen's test with Two Voice Devs transcripts

00:21:32 Issues with counting and hallucinations

00:24:21 Testing with OpenAI's Sora AI synthetic videos

00:30:05 Ethical questions and the future of content creation

00:31:50 Potential use cases for large context windows

00:36:34 API limitations and challenges

00:37:39 Performance and cost considerations

00:41:34 Comparison with retrieval augmented generation and vector databases

00:44:21 Generating summaries and markers from this transcript

Leave your thoughts and questions in the comments below!