ep19: SentencePiece: A simple and language independent subword tokenizer and detokenizer for NLP - podcast episode cover

ep19: SentencePiece: A simple and language independent subword tokenizer and detokenizer for NLP

Jan 20, 201937 min
--:--
--:--
Download Metacast podcast app
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

第19回では,Googleが開発したサブワードによるTokenizer/DetokenizerであるSentencePieceを解説しました.
今回紹介した論文はこちらのissueで解説しています.

github.com/jojonki/arXivNotes/issues/186

番組への支援は,こちらからお待ちしております.www.patreon.com/jojonki

For the best experience, listen in Metacast app for iOS or Android