The Conference for Machine Learning Innovation

From Paper to Product – How we implemented BERT

Session
Join the ML Revolution!
Register until January 23:
✓Raspberry Pi or C64 Mini for free
✓Save up to $310
✓ Group Discount
Register Now
Join the ML Revolution!
Register until January 23:
✓Raspberry Pi or C64 Mini for free
✓Save up to $310
✓ Group Discount
Register Now
Join the ML Revolution!
Register until March 5:
✓ML Intro Day for free
✓Save up to 500 €
✓10 % Team Discount
Register Now
Join the ML Revolution!
Register until March 5:
✓ML Intro Day for free
✓Save up to 500 €
✓10 % Team Discount
Register Now
Join the ML Revolution!
Until Conference starts:
✓Special discount for Freelancers
✓10% Team Discount
Register Now
Join the ML Revolution!
Until Conference starts:
✓Special discount for Freelancers
✓10% Team Discount
Register Now
Infos
Wednesday, December 11 2019
14:15 - 15:00
Room:
Salon 8+9

BERT is a state-of-the-art natural language processing (NLP) model that allows pretraining on unlabelled text data and later transfer training to a variety of NLP tasks. Due to its promising novel ideas and impressive performance we chose it as a core component for a new natural language generation product. Reading a paper, maybe following a tutorial with example code and putting a working piece of software into production are, however, two totally different things.

In this session, we will tell you how we trained a custom version of the BERT network and included it into a natural language generation (NLG) application. You will hear how we arrived at the decision to use BERT and what other approaches we tried. We will tell you about the failures and the mistakes we made so you do not have to repeat them, but also about the surprises, successes and lessons learned.

This Session belongs to  Diese Session gehört zum Programm vom MunichMunich and  und BerlinBerlin . Take me to the program of . Hier geht es zum aktuellen Programm von Singapore Singapore .

Take me to the program of Zum aktuellen Programm von Munich Munich .

Take me to the program of Zum aktuellen Programm von Berlin Berlin .

This Session Diese Session belongs to gehört zum Programm von MunichMunich and  und BerlinBerlin . Take me to the program of . Hier geht es zum aktuellen Programm von Singapore Singapore , Munich Munich  and  und  Berlin Berlin .

Behind the Tracks