ep47 (ICLR): ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Jan 12, 2020•26 min
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more
Episode description
ICLR 2020より，factorized embeddingとパラメタ共有によるパラメタ削減及び文順序予測タスクを採用したALBERTを解説しました．
今回紹介した記事はこちらのissueで解説しています． https://github.com/jojonki/arXivNotes/issues/348
サポーターも募集中です． https://www.patreon.com/jojonki
For the best experience, listen in Metacast app for iOS or Android