Managing ML Lifecycles with Vertex AI with Erwin Huizenga

Google Cloud Platform Podcast

Episode | Podcast

Date: Wed, 17 Nov 2021 00:00:00 +0000

<p>We’re learning all about Vertex AI this week as <a href="https://twitter.com/carterthecomic">Carter Morgan</a> and <a href="https://twitter.com/jaydjenkins">Jay Jenkins</a> host guest <a href="https://twitter.com/erwinhuizenga">Erwin Huizenga</a>. He helps us understand what is meant by Asia Pacific and how Machine Learning is growing there. APAC’s Machine Learning scene is exciting for its enterprise companies leveraging ML for innovative projects at scale. The ML journey of many of these customers revealed challenges with things like efficiency that Vertex AI was built to solve.</p> <p>The Vertex AI platform boasts tools that help with everything from the beginning stages of data collection to analysis, validation, transformation, model training, evaluation, serving the model, and metadata tracking. Erwin offers detailed examples of this pipeline process and describes how Feature Store helps clients manage their projects.</p> <p>Using Vertex AI not only simplifies the initial development process but streamlines the iteration process as the model is adjusted over time. Pipelines offers automation options that help with this, Erwin explains. ML Operations are also built into Vertex AI to ensure everything is done in compliance with industry standards, even at scale. Using customer recommendations as an example, Erwin walks us through how Vertex AI can employ embedding to enhance customer experiences through ML.</p> <p>By using Vertex AI in combination with other Google offerings like AutoML, companies can effectively build working ML projects without data science experience. We talk about the Vertex AI user interface and the other tools and APIS that are available there. Erwin tells us how Digits Financial uses Vertex AI and Pipeline to bring models to production in days rather than months, and how others can get started with Vertex AI, too.</p> <h5 id="erwin-huizenga">Erwin Huizenga</h5> <p><a href="https://twitter.com/erwinhuizenga">Erwin Huizenga</a> is a Data Scientist at Google specializing in TensorFLow, Python, and ML.</p> <h5 id="cool-things-of-the-week">Cool things of the week</h5> <ul> <li>Announcing Spot Pods for GKE Autopilot—save on fault tolerant workloads <a href="https://cloud.google.com/blog/products/containers-kubernetes/announcing-spot-pods-for-gke-autopilot"> blog</a></li> <li>Indosat Ooredoo and Google Launch Strategic Partnership to Accelerate Digitalization Across SMBs and Enterprises in Indonesia <a href="https://www.googlecloudpresscorner.com/2021-11-08-Indosat-Ooredoo-and-Google-Launch-Strategic-Partnership-to-Accelerate-Digitalization-Across-SMBs-and-Enterprises-in-Indonesia"> site</a></li> <li>Indosat Ooredoo dan Google Luncurkan Kemitraan Strategis untuk Percepatan Digitalisasi UMKM dan Perusahaan di Indonesia <a href="https://indonesia.googleblog.com/2021/11/indosat-ooredoo-dan-google-luncurkan.html"> site</a></li> </ul> <h5 id="interview">Interview</h5> <ul> <li>Vertex AI <a href="https://cloud.google.com/vertex-ai">site</a></li> <li>Google Cloud in Asia Pacific <a href="https://cloud.google.com/blog/topics/google-cloud-asia-pacific">blog</a></li> <li>Introduction to Vertex AI <a href="https://cloud.google.com/vertex-ai/docs/start/introduction-unified-platform"> docs</a></li> <li>What Is a Machine Learning Pipeline? <a href="https://valohai.com/machine-learning-pipeline/">site</a></li> <li>TensorFlow <a href="https://www.tensorflow.org">site</a></li> <li>PyTorch <a href="https://pytorch.org">site</a></li> <li>Vertex AI Feature Store <a href="https://cloud.google.com/vertex-ai/docs/featurestore">docs</a></li> <li>AutoML <a href="https://cloud.google.com/automl">site</a></li> <li>BigQuery ML <a href="https://cloud.google.com/bigquery-ml/docs">site</a></li> <li>Vertex AI Matching Engine <a href="https://cloud.google.com/vertex-ai/docs/matching-engine/overview">docs</a></li> <li>ScaNN <a href="https://github.com/google-research/google-research/tree/master/scann"> site</a></li> <li>Announcing ScaNN: Efficient Vector Similarity Search <a href="https://ai.googleblog.com/2020/07/announcing-scann-efficient-vector.html"> blog</a></li> <li>Vertex AI Workbench <a href="https://cloud.google.com/vertex-ai-workbench">site</a></li> <li>Vertex Pipeline Case Study: Digits Financial <a href="https://www.techvalidate.com/product-research/cloud-ai-ml/case-studies/B8A-A64-3A7"> site</a></li> <li>Intro to Vertex Pipelines Codelab <a href="https://codelabs.developers.google.com/vertex-pipelines-intro#0">site</a></li> <li>Vertex AI: Training and serving a custom model Codelab <a href="https://codelabs.developers.google.com/vertex_custom_training_prediction#0"> site</a></li> <li>Vertex AI Workbench: Build an image classification model with transfer learning and the notebook executor Codelab <a href="https://codelabs.developers.google.com/vertex_notebook_executor#0"> site</a></li> <li>APAC Best of Next 2021 <a href="https://cloudonair.withgoogle.com/events/apac-best-of-next21">site</a></li> <li>TFX: A TensorFlow-Based Production-Scale Machine Learning Platform <a href="https://research.google/pubs/pub46484/">site</a></li> <li>Rules of Machine Learning <a href="https://developers.google.com/machine-learning/guides/rules-of-ml"> site</a></li> <li>Google Cloud Skills Boost: Build and Deploy Machine Learning Solutions on Vertex AI <a href="https://www.cloudskillsboost.google/quests/183">site</a></li> <li>Monitoring feature attributions: How Google saved one of the largest ML services in trouble <a href="https://cloud.google.com/blog/topics/developers-practitioners/monitoring-feature-attributions-how-google-saved-one-largest-ml-services-trouble"> blog</a></li> </ul> <h5 id="what-s-something-cool-you-re-working-on">What’s something cool you’re working on?</h5> <p>Jay is working on <a href="https://cloudonair.withgoogle.com/events/apac-best-of-next21">APAC Best of Next</a> and will be doing a session on sustainability!</p> <p>Carter is working on transitioning the GCP Podcast to a video format!</p>