Moving NLP Forward With Transformer Models and Attention

The Real Python Podcast

Episode | Podcast

Date: Fri, 12 Aug 2022 12:00:00 +0000

What's the big breakthrough for Natural Language Processing (NLP) that has dramatically advanced machine learning into deep learning? What makes these transformer models unique, and what defines "attention?" This week on the show, Jodie Burchell, developer advocate for data science at JetBrains, continues our talk about how machine learning (ML) models understand and generate text.