The Conference for Machine Learning Innovation

Brains vs. Brawn – Is endless scaling really the way forward?

Keynote
Join the ML Revolution!
Until June 2
✓ Save up to 226€
✓ Group discount
✓ Special discount for freelancers
Register Now
Join the ML Revolution!
Until June 2
✓ Save up to 226€
✓ Group discount
✓ Special discount for freelancers
Register Now
Thank you for attending!
Register Now
Thank you for attending!
Register Now
Join the ML Revolution!
Register until conference starts:
✓ 2 in 1 conference special
✓ 10 % Team Discount
Register Now
Join the ML Revolution!
Register until conference starts:
✓ 2 in 1 conference special
✓ 10 % Team Discount
Register Now
Infos
Tuesday, June 28 2022
09:00 - 09:45

The current race towards ever larger models by the Googles and OpenAIs of this world can be quite discouraging to everyday ML practitioners. Are we doomed to simply rent the giant models we will never have the compute and data to build ourselves? Is careful research and model architecture design useless in an age where the common wisdom is to crush every problem under billions of parameters?Regrettably model size and SOTA scores seem to be the main evaluation criteria for papers, research and models. In the meantime many other smart, useful or simply intriguing ideas fall by the wayside while everybody talks about how GPT-3 will replace programmers next year (it wont’t). So let’s try and look at other approaches to improve the quality of a model other than drowning it in data & compute.

Take me to the full program of Zum vollständigen Programm von Munich Munich .

This Session belongs to the Diese Session gehört zum Programm vom MunichMunich program. Take me to the program of . Hier geht es zum Programm von Singapore Singapore .

This Session belongs to the Diese Session gehört zum Programm vom MunichMunich program. Take me to the program of . Hier geht es zum Programm von Berlin Berlin .

This Session Diese Session belongs to the gehört zum Programm von MunichMunich program. Take me to the current program of . Hier geht es zum aktuellen Programm von Munich Munich , Singapore Singapore or oder Berlin Berlin .

Behind the Tracks