Cloud Dataflow with Frances Perry

Google Cloud Platform Podcast

Episode | Podcast

Date: Wed, 14 Jun 2017 01:07:49 +0000

<p>Cloud Dataflow and its OSS counterpart Apache Beam are amazing tools for Big Data. So today your co-hosts <a href="https://twitter.com/francesc">Francesc</a> and <a href="https://twitter.com/Neurotic">Mark</a> interview <a href="https://twitter.com/francesjperry">Frances Perry</a>, the Tech Lead and PMC for those projects, to join us and tell us more about it.</p> <h5 id="about-frances-perry">About Frances Perry</h5> <p><a href="https://twitter.com/francesjperry">Frances Perry</a> is a software engineer who likes to make big data processing easy, intuitive, and efficient. After many years working on Google’s internal data processing stack, she joined the Cloud Dataflow team to make this technology available to external cloud customers. She led the early work on Dataflow’s unified batch/streaming programming model and is now on the PMC for Apache Beam.</p> <h5 id="cool-things-of-the-week">Cool things of the week</h5> <ul> <li>Rewriting <a href="https://moviegolf.com">moviegolf.com</a> <a href="https://medium.com/google-cloud/rewriting-moviegolf-com-e5c01fd396dc"> Medium</a></li> <li>App Engine users, now you can configure custom domains from the API or CLI <a href="https://cloudplatform.googleblog.com/2017/06/App-Engine-users-now-you-can-configure-custom-domains-from-the-API-or-CLI.html"> announcement</a></li> <li>Join the gRPC/Istio community day June 26th at Google Sunnyvale <a href="https://twitter.com/IstioMesh/status/871780296651354112">twitter</a></li> </ul> <h5 id="interview">Interview</h5> <ul> <li>Cloud Dataflow <a href="https://cloud.google.com/dataflow/">homepage</a></li> <li>Apache Beam <a href="https://beam.apache.org/">homepage</a> <ul> <li>Java SDK Quickstart <a href="https://beam.apache.org/get-started/quickstart-java/">docs</a></li> <li>Python SDK Quickstart <a href="https://beam.apache.org/get-started/quickstart-py/">docs</a></li> </ul> </li> <li>Cloud Dataflow, Apache Beam and you <a href="https://cloud.google.com/blog/big-data/2016/08/cloud-dataflow-apache-beam-and-you"> announcement</a></li> </ul> <div style="text-align: center;"><a href="https://cloud.google.com/dataflow/"><img src="https://googlecloudpodcast.libsyn.com/images/icons/bigdata/Cloud-Dataflow.png" style="margin: auto;" /></a></div> <h5 id="question-of-the-week">Question of the week</h5> <p>How can I connect all the instances in a Managed Instance Group to CloudSQL securely?</p> <ul> <li><a href="https://cloud.google.com/sql/docs/mysql/connect-compute-engine">Connecting MySQL Client from Compute Engine</a></li> <li><a href="https://cloud.google.com/sql/docs/mysql/sql-proxy">About the Cloud SQL Proxy</a></li> <li>CloudSQL Proxy <a href="https://github.com/GoogleCloudPlatform/cloudsql-proxy">GitHub repo</a></li> </ul> <h5 id="where-can-you-find-us-next">Where can you find us next?</h5> <p>Francesc just released a new <a href="https://youtu.be/yuW6BwOS8Eg?list=PL64wiCrrxh4Jisi7OcCJIUpguV_f5jGnZ"> #justforfunc episode</a> where he explains how to use cgo.</p> <p>He will be running a workshop at <a href="https://qconnewyork.com/">QCon New York</a> on Go tooling based on <a href="https://www.youtube.com/watch?v=uBjoTxosSys">this video</a>, after that he’ll be at GopherCon in Denver!</p> <p>Mark is still on vacation - but don’t worry, he’ll be back soon!</p>