The Conference for Machine Learning Innovation

An Introduction to Transformers

Session
Join the ML Revolution!
Register until September 15:
✓ Save up to $323
✓ 3 Day Special
✓ Team discount
Register Now
Join the ML Revolution!
Register until September 15:
✓ Save up to $323
✓ 3 Day Special
✓ Team discount
Register Now
Join the ML Revolution!
Register until August 18:
✓ Pre-conference workshops for free
✓ Save up to €503
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until August 18:
✓ Pre-conference workshops for free
✓ Save up to €503
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Until the Conference starts:
✓ Group discount
✓ Special discount for freelancers
Register Now
Join the ML Revolution!
Until the Conference starts:
✓ Group discount
✓ Special discount for freelancers
Register Now

Transformers and architectures based on them like BERT, GPT and T5 are the new stars of Natural Language Processing (NLP). With the advent of Vision Transformers (ViTs), it seems that they will take Image and Video Processing by storm as well.

More than a enough reason to take a good look under the hood at what makes Transformers tick. In this session we will study Attention, the mechanism that powers all these Transformer variants. We will learn the difference between Encoder, Decoder and Encoder-Decoder architectures.

Finally, we will take a first glimpse at ViTs and see how what changes are necessary to use a transformer for image processing instead of NLP.

This Session originates from the archive of Diese Session stammt aus dem Archiv von SingaporeSingapore . Take me to the program of . Hier geht es zum aktuellen Programm von Singapore Singapore .

This Session originates from the archive of Diese Session stammt aus dem Archiv von SingaporeSingapore . Take me to the program of . Hier geht es zum aktuellen Programm von Berlin Berlin .

This Session originates from the archive of Diese Session stammt aus dem Archiv von SingaporeSingapore . Take me to the program of . Hier geht es zum aktuellen Programm von Munich Munich .

This Session Diese Session originates from the archive of stammt aus dem Archiv von SingaporeSingapore . Take me to the current program of . Hier geht es zum aktuellen Programm von Singapore Singapore , Berlin Berlin or oder Munich Munich .

Behind the Tracks