Date: Sat, 25 Sep 2021 20:00:00 -0400
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>The overwhelming growth of smartphones, smart speakers, and spoken word content has corresponded with increasingly sophisticated machine learning models for recognizing speech content in audio data. Dylan Fox founded Assembly to provide access to the most advanced automated speech recognition models for developers to incorporate into their own products. In this episode he gives an overview of the current state of the art for automated speech recognition, the varying requirements for accuracy and speed of models depending on the context in which they are used, and what is required to build a special purpose model for your own ASR applications.</p> <h2>Announcements</h2> <ul> <li>Hello and welcome to Podcast.__init__, the podcast about Python’s role in data and science.</li> <li>When you’re ready to launch your next app or want to try a project you hear about on the show, you’ll need somewhere to deploy it, so take a look at our friends over at Linode. With the launch of their managed Kubernetes platform it’s easy to get started with the next generation of deployment and scaling, powered by the battle tested Linode platform, including simple pricing, node balancers, 40Gbit networking, dedicated CPU and GPU instances, and worldwide data centers. Go to <a href="https://www.pythonpodcast.com/linode?utm_source=rss&utm_medium=rss">pythonpodcast.com/linode</a> and get a $100 credit to try out a Kubernetes cluster of your own. And don’t forget to thank them for their continued support of this show!</li> <li>Your host as usual is Tobias Macey and today I’m interviewing Dylan Fox about the challenges of training and deploying large models for automated speech recognition</li> </ul> <h2>Interview</h2> <ul> <li>Introductions</li> <li>How did you get introduced to Python?</li> <li>What is involved in building an ASR model? <ul> <li>How does the complexity/difficulty compare to models for other data formats? (e.g. computer vision, NLP, NER, etc.)</li> </ul> </li> <li>How have ASR models changed over the last 5, 10, 15 years?</li> <li>What are some other categories of ML applications that work with audio data? <ul> <li>How does the level of complexity compare to ASR applications?</li> </ul> </li> <li>What is the typical size of an ASR model that you are deploying at Assembly? <ul> <li>What are the factors that contribute to the overall size of a given model?</li> </ul> </li> <li>How does accuracy compare with model size?</li> <li>How does the size of a model contribute to the overall challenge of deploying/monitoring/scaling it in a production environment?</li> <li>How can startups effectively manage the time/cost that comes with training large models?</li> <li>What are some techniques that you use/attributes that you focus on for feature definitions in the source audio data?</li> <li>Can you describe the lifecycle stages of an ASR model at Assembly?</li> <li>What are the aspects of ASR which are still intractable or impractical to productionize?</li> <li>What are the most interesting, innovative, or unexpected ways that you have seen ASR technology used?</li> <li>What are the most interesting, unexpected, or challenging lessons that you have learned while working on ASR?</li> <li>What are the trends in research or industry that you are keeping an eye on?</li> </ul> <h2>Keep In Touch</h2> <ul> <li><a href="https://www.linkedin.com/in/dylanbfox/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">LinkedIn</a></li> <li><a href="https://twitter.com/youvegotfox?lang=en&utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">@YouveGotFox</a> on Twitter</li> </ul> <h2>Picks</h2> <ul> <li>Tobias <ul> <li><a href="https://www.imdb.com/title/tt8385148/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">The Hitman’s Wife’s Bodyguard</a></li> </ul> </li> <li>Dylan <ul> <li><a href="https://www.netflix.com/title/81441273?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Inspiration 4 Documentary</a></li> </ul> </li> </ul> <h2>Closing Announcements</h2> <ul> <li>Thank you for listening! Don’t forget to check out our other show, the <a href="https://www.dataengineeringpodcast.com?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Data Engineering Podcast</a> for the latest on modern data management.</li> <li>Visit the <a href="https://www.pythonpodcast.com?utm_source=rss&utm_medium=rss">site</a> to subscribe to the show, sign up for the mailing list, and read the show notes.</li> <li>If you’ve learned something or tried out a project from the show then tell us about it! Email <a href="mailto:hosts@podcastinit.com">hosts@podcastinit.com</a>) with your story.</li> <li>To help other people find the show please leave a review on <a href="https://itunes.apple.com/us/podcast/podcast.-init/id981834425?mt=2&uo=6&at=&ct=&utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">iTunes</a> and tell your friends and co-workers</li> <li>Join the community in the new Zulip chat workspace at <a href="https://www.pythonpodcast.com/chat?utm_source=rss&utm_medium=rss">pythonpodcast.com/chat</a></li> </ul> <h2>Links</h2> <ul> <li><a href="https://learnpythonthehardway.org/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Learn Python The Hard Way</a></li> <li><a href="https://github.com/mozilla/DeepSpeech?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">DeepSpeech</a></li> <li><a href="https://github.com/flashlight/wav2letter?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Wav2Letter</a></li> <li><a href="https://en.wikipedia.org/wiki/BERT_(language_model)?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">BERT</a></li> <li><a href="https://en.wikipedia.org/wiki/GPT-3?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">GPT-3</a></li> <li><a href="https://en.wikipedia.org/wiki/Convolutional_neural_network?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Convolutional Neural Network (CNN)</a></li> <li><a href="https://en.wikipedia.org/wiki/Recurrent_neural_network?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Recurrent Neural Network (RNN)</a></li> <li><a href="https://mycroft.ai/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Mycroft</a> <ul> <li><a href="https://www.pythonpodcast.com/episode-82-mycroft-with-steve-penrod/?utm_source=rss&utm_medium=rss">Podcast Episode</a></li> </ul> </li> <li><a href="https://cmusphinx.github.io/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">CMU Sphinx</a></li> <li><a href="https://github.com/cmusphinx/pocketsphinx?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Pocket Sphinx</a></li> <li><a href="https://towardsdatascience.com/gaussian-mixture-models-explained-6986aaf5a95?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Gaussian Mixture Model (GMM)</a></li> <li><a href="https://en.wikipedia.org/wiki/Hidden_Markov_model?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Hidden Markov Model (HMM)</a></li> <li><a href="https://arxiv.org/abs/1412.5567?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">DeepSpeech Paper</a></li> <li><a href="https://en.wikipedia.org/wiki/Transformer_(machine_learning_model)?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Transformer Architecture</a></li> <li><a href="https://www.dataengineeringpodcast.com/audio-analytic-sound-recognition-episode-139/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Audio Analytic Sound Recognition Podcast Episode</a></li> <li><a href="https://horovod.ai/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Horovod</a> distributed training library</li> <li><a href="https://en.wikipedia.org/wiki/Knowledge_distillation?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Knowledge Distillation</a></li> <li><a href="https://www.openslr.org/12?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Libre Speech Data Set</a></li> <li><a href="https://lambdalabs.com/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Lambda Labs</a></li> <li><a href="https://arxiv.org/abs/1904.05862?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">Wav2Vec</a></li> </ul> <p>The intro and outro music is from Requiem for a Fish <a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">The Freak Fandango Orchestra</a> / <a href="http://creativecommons.org/licenses/by-sa/3.0/?utm_source=rss&utm_medium=rss" rel="noopener" target="_blank">CC BY-SA</a></p> </div> <img alt="" height="0" src="https://analytics.boundlessnotions.com/piwik.php?idsite=1&rec=1&url=https%3A%2F%2Fwww.pythonpodcast.com%2Fautomated-speech-recognition-episode-333%2F&action_name=An+Exploration+Of+Automated+Speech+Recognition+-+Episode+333&urlref=https%3A%2F%2Fwww.pythonpodcast.com%2Ffeed%2F&utm_source=rss&utm_medium=rss" style="border: 0; width: 0; height: 0;" width="0" />