#50: Web scraping at scale with Scrapy and ScrapingHub

Talk Python To Me

Episode | Podcast

Date: Tue, 15 Mar 2016 00:00:00 -0800

What do you do when you are working with an amazing web application that, for whatever reason, doesn't have an API? One option is to say I wish that site had an API and give up. Or, you could use scrapy, an open source web scraping framework from Pablo Hoffman and [scrapinghub.com](scrapinghub.com) and create your own API!