The Cloudcast

Data Observability


Listen Later

Kevin Hu (@kevinzenghu, Co-Founder | CEO at @Metaplane) talks about the concepts behind Data Observability and the unique challenges for Data Engineers.

SHOW: 594

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

  • BMC Wants to Know if your business is on it's A-Game
  • BMC Autonomous Digital Enterprise
  • Usage.ai (homepage)
  • Start saving up to 57% of your AWS EC2 spend in under 5 minutes with Usage AI. No code change, no downtime, no engineering work required.
  • New Relic (homepage)
  • Services down? New Relic offers full stack visibility with 16 different monitoring products in a single platform.

SHOW NOTES:

  • Metaplane (homepage)


Topic 1 - Welcome to the show. Let’s talk about your background and what led you to start Metaplane.

Topic 2 - Let’s start by talking about the concept of what is a modern data engineer. What is this person doing, what are they responsible for, and who are their typical “customers” within a business. 

Topic 3 - Beyond just huge volumes of data and trying to make the data usable (formatting, ETL, storage access, etc.), what sort of problems do data engineers encounter? How much is typically “first-party data” and how much comes from external systems? 

Topic 4 - Let’s talk about Data Observability. First off, what is it?. And second, how is it different from the Observability that we’ve seen from Datadog or Honeycomb or Observe or many others? 

Topic 5 - What are the types of Data Observability problems that Metaplane is focused on solving for Data engineers? Are these usually done independently, or in collaboration with the application or business analyst teams?

Topic 6 - What are some of the immediate results (improvements) that companies see when adding Data Observability to their environments?


FEEDBACK?

  • Email: show at the cloudcast dot net
  • Twitter: @thecloudcastnet
...more
View all episodesView all episodes
Download on the App Store

The CloudcastBy Massive Studios

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

147 ratings


More shows like The Cloudcast

View all
Hanselminutes with Scott Hanselman by Scott Hanselman

Hanselminutes with Scott Hanselman

377 Listeners

Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

Software Engineering Radio - the podcast for professional software developers

272 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

283 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,027 Listeners

Thoughtworks Technology Podcast by Thoughtworks

Thoughtworks Technology Podcast

41 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

592 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

624 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

202 Listeners

Gartner ThinkCast by Gartner

Gartner ThinkCast

110 Listeners

DataFramed by DataCamp

DataFramed

266 Listeners

Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

Kubernetes Podcast from Google

181 Listeners

Practical AI by Practical AI LLC

Practical AI

189 Listeners

The Stack Overflow Podcast by The Stack Overflow Podcast

The Stack Overflow Podcast

64 Listeners

The Real Python Podcast by Real Python

The Real Python Podcast

140 Listeners

The Pragmatic Engineer by Gergely Orosz

The Pragmatic Engineer

52 Listeners