GoogleBot Crawler Now Uses HTTP/2 to Index the Web, Let us discuss how this affects our Back-end?

The Backend Engineering Show with Hussein Nasser

Episode | Podcast

Date: Fri, 18 Sep 2020 20:47:17 GMT

<p>Google Bot is now attempting to use HTTP/2 to crawl the web</p> <p>Ever since mainstream browsers started supporting the next major revision of HTTP,&nbsp;HTTP/2 or h2&nbsp;for short, web professionals&nbsp;asked us&nbsp;whether Googlebot can crawl over the upgraded, more modern version of the protocol.</p> <p>Today we're announcing that starting mid November 2020, Googlebot will support crawling over HTTP/2 for select sites.</p> <p>Article</p> <p>https://webmasters.googleblog.com/2020/09/googlebot-will-soon-speak-http2.html</p> <p>* Intro 0:00</p> <p>* What is a Crawler 1:06</p> <p>* Current Crawler uses h1 2:00</p> <p>* Crawler now uses h2 4:40</p> <p>* Less connections, slightly high CPU usage 6:30</p> <p>* Opting out of h2 crawling 9:00</p> <p>* FAQ 11:40</p> <p>Http/2 playlist 0;50 https://www.youtube.com/playlist?list=PLQnljOFTspQWbBegaU790WhH7gNKcMAl-</p> <p>http/2 not cheap 7;00 https://www.youtube.com/watch?v=GriONb4EfPY</p> <p>lucid chart 9;50 https://www.youtube.com/watch?v=gejfT1h6LBo</p> <p>h2c smuggling 18:30 https://www.youtube.com/watch?v=B2VEQ3jFq6Q</p>