The Conference for Machine Learning Innovation

An Introduction to Transformers

Session
Join the ML Revolution!
Until March 17:
✓ ML Intro Day for free
✓ Save more than 500€
✓ 2-in-1 conference special
Register Now
Join the ML Revolution!
Until March 17:
✓ ML Intro Day for free
✓ Save more than 500€
✓ 2-in-1 conference special
Register Now
Thank you for attending!
Register Now
Thank you for attending!
Register Now
Join the ML Revolution!
Register until conference starts:
✓ 2 in 1 conference special
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until conference starts:
✓ 2 in 1 conference special
✓ 10 % Team Discount
Register Now
Infos
Wednesday, November 24 2021
16:30 - 17:15

Transformers and architectures based on them like BERT, GPT and T5 are the new stars of Natural Language Processing (NLP). With the advent of Vision Transformers (ViTs), it seems that they will take Image and Video Processing by storm as well.

More than a enough reason to take a good look under the hood at what makes Transformers tick. In this session we will study Attention, the mechanism that powers all these Transformer variants. We will learn the difference between Encoder, Decoder and Encoder-Decoder architectures.

Finally, we will take a first glimpse at ViTs and see how what changes are necessary to use a transformer for image processing instead of NLP.

This Session belongs to the Diese Session gehört zum Programm vom SingaporeSingapore program. Take me to the program of . Hier geht es zum Programm von Munich Munich .

Take me to the full program of Zum vollständigen Programm von Singapore Singapore .

This Session belongs to the Diese Session gehört zum Programm vom SingaporeSingapore program. Take me to the program of . Hier geht es zum Programm von Berlin Berlin .

This Session Diese Session belongs to the gehört zum Programm von SingaporeSingapore program. Take me to the current program of . Hier geht es zum aktuellen Programm von Munich Munich , Singapore Singapore or oder Berlin Berlin .

Behind the Tracks