The Conference for Machine Learning Innovation

An Introduction to Transformers

Session
Join the ML Revolution!
Register until October 21:
✓ 50% off on all prices
✓ 10% team discount
Register Now
Join the ML Revolution!
Register until October 21:
✓ 50% off on all prices
✓ 10% team discount
Register Now
Join the ML Revolution!
Register until September 23:
✓ PS Classic or C64 Mini for free
✓ Save up to €310
10 % Team Discount
Register Now
Join the ML Revolution!
Register until September 23:
✓ PS Classic or C64 Mini for free
✓ Save up to €310
10 % Team Discount
Register Now
Join the ML Revolution!
Register until the conference starts:
✓ 2-in-1 conference special
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until the conference starts:
✓ 2-in-1 conference special
✓ 10 % Team Discount
Register Now
Infos
Wednesday, November 24 2021
15:30 - 16:15

Transformers and architectures based on them like BERT, GPT and T5 are the new stars of Natural Language Processing (NLP). With the advent of Vision Transformers (ViTs), it seems that they will take Image and Video Processing by storm as well.

More than a enough reason to take a good look under the hood at what makes Transformers tick. In this session we will study Attention, the mechanism that powers all these Transformer variants. We will learn the difference between Encoder, Decoder and Encoder-Decoder architectures.

Finally, we will take a first glimpse at ViTs and see how what changes are necessary to use a transformer for image processing instead of NLP.

Take me to the full program of Zum vollständigen Programm von Singapore Singapore .

This Session belongs to the Diese Session gehört zum Programm vom SingaporeSingapore program. Take me to the program of . Hier geht es zum Programm von Berlin Berlin .

This Session belongs to the Diese Session gehört zum Programm vom SingaporeSingapore program. Take me to the program of . Hier geht es zum Programm von Munich Munich .

This Session Diese Session belongs to the gehört zum Programm von SingaporeSingapore program. Take me to the current program of . Hier geht es zum aktuellen Programm von Singapore Singapore , Berlin Berlin or oder Munich Munich .

Behind the Tracks