The Conference for Machine Learning Innovation

From Paper to Product – How we implemented BERT

Session
Join the ML Revolution!
Register until September 10:
✓ Raspberry Pi or C64 Mini for free
✓Save up to 313 €
✓10 % Team Discount
Register Now
Join the ML Revolution!
Register until September 10:
✓ Raspberry Pi or C64 Mini for free
✓Save up to 313 €
✓10 % Team Discount
Register Now
Join the ML Revolution!
Register until July 2:
✓ Raspberry Pi or C64 Mini for free
✓ Save up to $310
✓ 10% team discount
Register Now
Join the ML Revolution!
Register until July 2:
✓ Raspberry Pi or C64 Mini for free
✓ Save up to $310
✓ 10% team discount
Register Now
Join the ML Revolution!
Register until November 7th:
✓Save up to € 210
✓10% Team Discount
Register Now
Join the ML Revolution!
Register until November 7th:
✓Save up to € 210
✓10% Team Discount
Register Now
Infos
Wednesday, December 11 2019
14:15 - 15:00
Room:
Salon 8+9

BERT is a state-of-the-art natural language processing (NLP) model that allows pretraining on unlabelled text data and later transfer training to a variety of NLP tasks. Due to its promising novel ideas and impressive performance we chose it as a core component for a new natural language generation product. Reading a paper, maybe following a tutorial with example code and putting a working piece of software into production are, however, two totally different things.

In this session, we will tell you how we trained a custom version of the BERT network and included it into a natural language generation (NLG) application. You will hear how we arrived at the decision to use BERT and what other approaches we tried. We will tell you about the failures and the mistakes we made so you do not have to repeat them, but also about the surprises, successes and lessons learned.

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von Online Edition Online Edition .

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von Munich Munich .

This Session belongs to the Diese Session gehört zum Programm vom BerlinBerlin program. Take me to the program of . Hier geht es zum Programm von Singapore Singapore .

Take me to the full program of Zum vollständigen Programm von Berlin Berlin .

This Session Diese Session belongs to the gehört zum Programm von BerlinBerlin program. Take me to the current program of . Hier geht es zum aktuellen Programm von Online Edition Online Edition , Munich Munich , Singapore Singapore or oder Berlin Berlin .

Behind the Tracks