ep50 (ICLR): ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Mar 14, 2020•28 min
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more
Episode description
ICLR 2020より，Replaced Token Detectionタスクによる事前学習によってGLUEとSQuADでSOTAを獲得したStanford x Googleのモデルを解説しました．
今回紹介した記事はこちらのissueで解説しています．
https://github.com/jojonki/arXivNotes/issues/391
サポーターも募集中です．
https://www.patreon.com/jojonki
For the best experience, listen in Metacast app for iOS or Android