The Conference for Machine Learning Innovation

Natural Language Processing (NLP): The Transformer Zoo

Session
Join the ML Revolution!
Register until the conference starts:
✓ 50% off on all prices
✓ 10% team discount
Register Now
Join the ML Revolution!
Register until the conference starts:
✓ 50% off on all prices
✓ 10% team discount
Register Now
Join the ML Revolution!
Register until November 4:
✓ 2 in 1 conference special
✓ Save up to €220
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until November 4:
✓ 2 in 1 conference special
✓ Save up to €220
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until the conference starts:
✓ 2-in-1 conference special
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until the conference starts:
✓ 2-in-1 conference special
✓ 10 % Team Discount
Register Now
Infos
Tuesday, December 7 2021
15:45 - 16:30

Transformer-based language models have been at the core of the recent progress in Natural Language Processing (NLP). This original idea, based on transfer learning, has sparked a whole ecosystem. In this talk, we give a short retrospective about the different models starting with the original BERT, taking a look at derivatives like RoBERTa and AlBERT, stressing the differences to XLnet and GPT-{2,3}. As most of the research is still very academic, we show how the myriad of (fine-tuned) models available at Huggingface can be used very easily in Jupyter notebooks to solve real-world problems in different industries. Often, successful classification is only the first step to facilitate other machine learning tasks like trend prediction etc.

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von Singapore Singapore .

Take me to the full program of Zum vollständigen Programm von Berlin Berlin .

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von Munich Munich .

This Session Diese Session belongs to the gehört zum Programm von BerlinBerlin program. Take me to the current program of . Hier geht es zum aktuellen Programm von Singapore Singapore , Berlin Berlin or oder Munich Munich .

Behind the Tracks