The Conference for Machine Learning Innovation

Natural Language Processing (NLP): The Transformer Zoo

Session
Join the ML Revolution!
Register until September 16:
✓Save up to $290
✓10% team discount
Register Now
Join the ML Revolution!
Register until September 16:
✓Save up to $290
✓10% team discount
Register Now
Join the ML Revolution!
Register until November 7th:
✓Save up to € 210
✓10% Team Discount
Register Now
Join the ML Revolution!
Register until November 7th:
✓Save up to € 210
✓10% Team Discount
Register Now
Join the ML Revolution!
Register until March 5:
✓ML Intro Day for free
✓Save up to 500 €
✓10 % Team Discount
Register Now
Join the ML Revolution!
Register until March 5:
✓ML Intro Day for free
✓Save up to 500 €
✓10 % Team Discount
Register Now
Infos

Transformer-based language models have been at the core of the recent progress in Natural Language Processing (NLP). This original idea, based on transfer learning, has sparked a whole ecosystem. In this talk, we give a short retrospective about the different models starting with the original BERT, taking a look at derivatives like RoBERTa and AlBERT, stressing the differences to XLnet and GPT-{2,3}. As most of the research is still very academic, we show how the myriad of (fine-tuned) models available at Huggingface can be used very easily in Jupyter notebooks to solve real-world problems in different industries. Often, successful classification is only the first step to facilitate other machine learning tasks like trend prediction etc.

This Session originates from the archive of Diese Session stammt aus dem Archiv von BerlinBerlin . Take me to the program of . Hier geht es zum aktuellen Programm von Singapore Singapore .

This Session originates from the archive of Diese Session stammt aus dem Archiv von BerlinBerlin . Take me to the program of . Hier geht es zum aktuellen Programm von Berlin Berlin .

This Session originates from the archive of Diese Session stammt aus dem Archiv von BerlinBerlin . Take me to the program of . Hier geht es zum aktuellen Programm von Munich Munich .

This Session Diese Session originates from the archive of stammt aus dem Archiv von BerlinBerlin . Take me to the current program of . Hier geht es zum aktuellen Programm von Singapore Singapore , Berlin Berlin or oder Munich Munich .

Behind the Tracks