HACKATHON: Evals November 2023 (2)
Feb 05, 2024•49 min•Ep. 11
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more
Episode description
Join our hackathon group for the second episode in the Evals November 2023 Hackathon subseries. In this episode, we solidify our goals for the hackathon after some preliminary experimentation and ideation.
Check out Stellaric's website, or follow them on Twitter.
01:53 - Meeting starts
05:05 - Pitch: extension of locked models
23:23 - Pitch: retroactive holdout datasets
34:04 - Preliminary results
37:44 - Next steps
42:55 - Recap
Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.
For the best experience, listen in Metacast app for iOS or Android