Episode description

Vector Podcast Live

Topics:

00:00 Kick-off introducing co:rise study platform

03:03 Grant’s background

04:58 Principle of 3 C’s in the life of a CTO: Code, Conferences and Customers

07:16 Principle of 3 C’s in the Search Engine development: Content, Collaboration and Context

11:51 Balance between manual tuning in pursuit to learn and Machine Learning

15:42 How to nurture intuition in building search engine algorithms

18:51 How to change the approach of organizations to true experimentation

23:17 Where should one start in approaching the data (like click logs) for developing a search engine

29:36 How to measure the success of your search engine

33:50 The role of manual query rating to improve search result relevancy

36:56 What are the available datasets, tools and algorithms, that allow us to build a search engine?

41:56 Vector search and its role in broad search engine development and how the profession is shaping up

49:01 The magical question of WHY: what motivates Grant to stay in the space

52:09 Announcement from Grant: course discount code DGSEARCH10

54:55 Questions from the audience

Show notes:

- Grant’s interview at Berlin Buzzwords 2016: https://www.youtube.com/watch?v=Y13gZM5EGdc

- “BM25 is so Yesterday: Modern Techniques for Better Search”: https://www.youtube.com/watch?v=CRZfc9lj7Po

- “Taming text” - book co-authored by Grant: https://www.manning.com/books/taming-text

- Search Fundamentals course - https://corise.com/course/search-fundamentals

- Search with ML course - https://corise.com/course/search-with-machine-learning

- Click Models for Web Search: https://github.com/markovi/PyClick

- Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing, book by Ron Kohavi et al: https://www.amazon.com/Trustworthy-Online-Controlled-Experiments-Practical-ebook/dp/B0845Y3DJV

- Quepid, open source tool and free service for query rating and relevancy tuning: https://quepid.com/

- Grant’s talk in 2013 where he discussed the need of a vector field in Lucene and Solr: https://www.youtube.com/watch?v=dCCqauwMWFE

- CLIP model for multimodal search: https://openai.com/blog/clip/

- Demo of multimodal search with CLIP: https://blog.muves.io/multilingual-and-multimodal-vector-search-with-hardware-acceleration-2091a825de78

- Learning to Boost: https://www.youtube.com/watch?v=af1dyamySCs

- Dmitry’s Medium List on Vector Search: https://medium.com/@dmitry-kan/list/vector-search-e9b564d14274