Google Cloud Platform Podcast

Due to popular demand, this week Francesc and Mark

Wendy Kan joins your co-hosts Francesc and Mark today to talk about Kaggle, their competitions, and the cool data sets available on their platform.

Kaggle joined the Google family a few months ago, so it's a great opportunity to know more about the platform and the amazing community behind it.

Wendy is a data scientist at Kaggle, the largest global data science community. Wendy works with companies and organizations to transform their data into machine learning competitions and had launched over 50 competitions on various topics such as image classification, revenue prediction, GIS and satellite data, click through rate, customer categorization, and real estate prediction. She was a software engineer and researcher before joining Kaggle. She holds BS and MS degrees in Electrical Engineering from National Tsing Hua University and PhD in Biomedical Engineering from The University of Texas at Austin.

• Google App Engine standard now supports Java 8 announcement
• How SREs find the landmines in a service - CRE life lessons blog post
• How HBO's Silicon Valley built "Not Hotdog" with mobile TensorFlow, Keras & React Native Hackernoon

• Kaggle home page
• Kaggle Competitions list
• Kaggle Datasets list
• Tensorflow: An open-source software library for Machine Intelligence tensorflow.org
• Keras: The Python Deep Learning library keras.io

How do you do client side load balancing with gRPC and Kubernetes?

• Ray Tsang answers with a GitHub repo

Francesc will be at GopherCon in Denver!

Mark will be speaking at Google Cloud Summit, New York with Phoenix One Games in July.

Wendy Kan joins your co-hosts

Kaggle joined the Google family a few months ago, so it’s a great opportunity to know more about

If you have ever wanted to play with huge datasets - this is the episode for you! Partner Operations Manager Mike Hamberg and Program Manager Will Curran join your co-hosts Francesc and Mark to talk through all the public datasets that Google Cloud Platform hosts for you on BigQuery and Google Compute Storage.

Mike works on helping Google teams and partners take raw data from the web and make it look beautiful and usable in BigQuery (and other platforms like Merchant Center).

Will is a program manager in Google Cloud, focused on Data and Analytics partners and passionate about improving access to the world's datasets. One of the programs he manages is the Cloud Public Datasets program.

• Google Cloud Platform expands to Australia with new Sydney region - open now announcement locations
• Why We're Moving to Google Cloud Platform blog
• Story of a successful migration to Google Cloud Platform blog

• Public Datasets site bigquery
• BigQuery site
• Google Cloud Storage site
• Reddit BigQuery subreddit
• TIL BigQuery site
• Have a public dataset you want to make public, email [email protected]

I need better visualisation into my billing and product usage - what can I do?

• Visualize GCP Billing using BigQuery and Data Studio blog dashboard demo

Francesc be running a workshop at QCon New York on Go tooling based on this video, after that he'll be at GopherCon in Denver!

Mark will be hosting the Playcrafting Playtest Night in San Francisco and speaking at Google Cloud Summit, New York with in July.

If you have ever wanted to play with huge datasets - this is the episode for you! Partner Operations Manager Mike Hamberg

It's all about open source monitoring this week, as Prometheus Co-Founder Julius Volz, joins your co-hosts Francesc and Mark to talk all about Prometheus. Where it came from, why it was built and why you should use it.

Julius co-founded the Prometheus monitoring system and lead the project to success at SoundCloud and beyond. He now focuses on growing the Prometheus community and is the main organizer of PromCon, the first conference around Prometheus. In a previous life, Julius was a Site Reliability Engineer at Google.

• New Singapore GCP region – open now blog locations
• Training an object detector using Cloud Machine Learning Engine blog
• Preparing a Container Engine Environment for Production solution

• Prometheus homepage github
• Prometheus Overview youtube media
• Prometheus Query Language docs
• Grafana homepage docs
• Prometheus Client Libraries docs
• Installing Prometheus on Kubernetes helm operator
• Cortex, a Open source, horizontally scalable Prometheus as a service github
• Prometheus Federation docs
• Prometheus Conference, PromCon 2017 site

I didn't put enough log statements in my application, and now things are broken. Help!?

• Using Debug Logpoints docs youtube

Francesc just released a new #justforfunc episode where he builds a Twitter bot that runs for free on GCP.

He will be running a workshop at QCon New York on Go tooling based on this video, after that he'll be at GopherCon in Denver!

Mark will be speaking at Google Cloud Summit, New York in July.

It’s all about open source monitoring this week, as Prometheus Co-Founder Julius Volz,

Cloud Dataflow and its OSS counterpart Apache Beam are amazing tools for Big Data. So today your co-hosts Francesc and Mark interview Frances Perry, the Tech Lead and PMC for those projects, to join us and tell us more about it.

Frances Perry is a software engineer who likes to make big data processing easy, intuitive, and efficient. After many years working on Google's internal data processing stack, she joined the Cloud Dataflow team to make this technology available to external cloud customers. She led the early work on Dataflow's unified batch/streaming programming model and is now on the PMC for Apache Beam.

• Rewriting moviegolf.com Medium
• App Engine users, now you can configure custom domains from the API or CLI announcement
• Join the gRPC/Istio community day June 26th at Google Sunnyvale twitter

• Cloud Dataflow homepage
• Apache Beam homepage
  • Java SDK Quickstart docs
  • Python SDK Quickstart docs
• Cloud Dataflow, Apache Beam and you announcement

How can I connect all the instances in a Managed Instance Group to CloudSQL securely?

• Connecting MySQL Client from Compute Engine
• About the Cloud SQL Proxy
• CloudSQL Proxy GitHub repo

Francesc just released a new #justforfunc episode where he explains how to use cgo.

He will be running a workshop at QCon New York on Go tooling based on this video, after that he'll be at GopherCon in Denver!

Mark is still on vacation - but don't worry, he'll be back soon!

Cloud Dataflow and its OSS counterpart Apache Beam are amazing tools for Big Data.

Yesterday Spinnaker reached its version 1.0, today Francesc and Mark talk to Steven Kim and Christopher Sanson about it!

Spinnaker is an open-source multi-cloud continuous delivery platform used in production at companies like Netflix, Waze, Target, and Cloudera, plus a new open-source command line interface (CLI) tool called halyard that makes it easy to deploy Spinnaker itself

Steven Kim is an engineering manager at Google based in New York City, focused on build and delivery systems. Prior to Google, Steven ran engineering teams at DreamWorks Animation, and was a part of the technical leadership in new initiatives at the studio.

Christopher Sanson is the Product Manager for Cloud Container Builder, Spinnaker, and Cloud CICD at Google. Prior to joining Google he ran his own software development company, building web and mobile apps for companies from startups to the Fortune 100.

• Coolest features of Google Container Builder blog post by Ahmet Alp Balkan
• Know thy enemy: how to prioritize and communicate risks - CRE life lessons blog post
  • #72 Customer Reliability Engineering with Luke Stone gcppodcast
• Sherol Chen's page on Machine Learning Eliza Effect

• Spinnaker spinnaker.io
• Spinnaker 1.0: a continuous delivery platform for cloud announcement
• Release Engineering chapter of the SRE book
• Deploying the Netflix API Netflix Tech Blog
• Spinnaker on Google Cloud Deployment Manager

• Spinnaker Meetup in San Francisco meetup.com
• Join the Spinnaker Channel on Slack join.spinnaker.io

Could you clarify the pricing model for Google Cloud Source Repositories?

• Cloud Source Repositories Pricing and Quota

Francesc will be running a workshop at QCon New York on Go tooling based on this video, after that he'll be at GopherCon in Denver!

Mark is going on vacation for a few weeks - but