The Conference for Machine Learning Innovation

An Introduction to Natural Language Generation

Session
Join the ML Revolution!
Register until March 5:
✓ML Intro Day for free
✓Save up to 500 €
✓10 % Team Discount
Register Now
Join the ML Revolution!
Register until March 5:
✓ML Intro Day for free
✓Save up to 500 €
✓10 % Team Discount
Register Now
Join the ML Revolution!
Register until November 7th:
✓Save up to € 210
✓10% Team Discount
Register Now
Join the ML Revolution!
Register until November 7th:
✓Save up to € 210
✓10% Team Discount
Register Now

The amazing results of OpenAI’s GPT-2 have rekindled interest in Natural Language Generation (NLG), a subfield of Natural Language Processing (NLP). But how does GPT-2 work, how is it trained and how does one interpret its output to generate text? And why, if those new neural network / transformer – based models have such an impressive performance, are rule-based NLG systems still the norm in commercial text generation applications?

This talk will cover the basics of rule based and ML-based NLG systems and their respective advantages and disadvantages. You will learn how Machine Learning systems like GPT-2 learn to generate text and what their strengths and weaknesses are. We will have a look at the latest attempts to better control the output of systems like GPT-2 and what is still necessary for Deep Learning based systems to completely take over one of the last bastions of symbolic/rule-based AI, natural language generation.

Take me to the full program of Zum vollständigen Programm von Munich Munich .

This Session belongs to the Diese Session gehört zum Programm vom MunichMunich program. Take me to the program of . Hier geht es zum Programm von Berlin Berlin .

This Session belongs to the Diese Session gehört zum Programm vom MunichMunich program. Take me to the program of . Hier geht es zum Programm von Singapore Singapore .

This Session Diese Session belongs to the gehört zum Programm von MunichMunich program. Take me to the current program of . Hier geht es zum aktuellen Programm von Munich Munich , Berlin Berlin or oder Singapore Singapore .

Behind the Tracks