Data With Direction

Send us a text

Do you love data but don't quite get Medallion Architecture? 
Do you think that Medallion Architecture is just a buzz word?
Do you think Medallion is really just a name to a method that has been around for decades (Staging, Production, Presentation?) 

Join us for what will be sure to be a enlightening and passionate discussion about data architecture with the great Shane Gibson (@shagility), myself and here to mediate and help keep us in line will be Ramona Truta!

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

Level up from “pipeline builder” to “senior engineer.” In this video I share the 7 books that actually changed how I design systems, ship stable data products, and interview with confidence. Each pick comes with one takeaway, one field exercise, and one interview line you can use tomorrow.

Want the Reading Tracker and Governance Card template? Check the pinned comment.

What you’ll learn

Systems trade-offs you can explain in one sentence

Data product SLOs and quality checks that leadership cares about

Dimensional modeling decisions that prevent double counts

SQL plan fluency that cuts p95 from seconds to milliseconds

Maintainability habits that kill “one-off” nightmares

Governance that makes AI safe, auditable, and fundable

Storytelling that gets your work adopted

Resources (Books)

Designing Data-Intensive Applications — Martin Kleppmann
https://amzn.to/45QIzci

Fundamentals of Data Engineering — Joe Reis, Matt Housley
https://amzn.to/4lMN3Xh

The Data Warehouse Toolkit — Ralph Kimball, Margy Ross
https://amzn.to/45Sd0yH

SQL Performance Explained — Markus Winand
https://amzn.to/4lOy1QK

The Pragmatic Programmer — Andrew Hunt, David Thomas
https://amzn.to/47eXsaz

Data Governance — John Ladley
https://amzn.to/4myGcBZ

Storytelling With Data — Cole Nussbaumer Knaflic
https://amzn.to/4lH98pZ


Resources (Udemy courses to pair with your reading)

• The Complete SQL Bootcamp: Go from Zero to Hero — Jose Portilla
https://click.linksynergy.com/deeplink?id=WuIlwt/6f6I&mid=39197&murl=https%3A%2F%2Fwww.udemy.com%2Fcourse%2Fthe-complete-sql-bootcamp%2F%3FcouponCode%3DPMNVD1525


• Taming Big Data with Apache Spark 4 and Python - Hands On!
https://click.linksynergy.com/deeplink?id=WuIlwt/6f6I&mid=39197&murl=https%3A%2F%2Fwww.udemy.com%2Fcourse%2Ftaming-big-data-with-apache-spark-hands-on%2F%3FcouponCode%3DKEEPLEARNING


• The Complete Hands-On Introduction to Apache Airflow 3 — Marc Lamberti
https://click.linksynergy.com/deeplink?id=WuIlwt/6f6I&mid=39197&murl=https%3A%2F%2Fwww.udemy.com%2Fcourse%2Fthe-complete-hands-on-course-to-master-apache-airflow%2F%3FcouponCode%3DPMNVD1525


How to use this video

For each chapter you read, complete two hands-on labs from the paired course. Reading plus reps beats passive reading every time.


Chapters:
00:00 – Introduction & Why These Books Matter
00:41 – About the Presenter
00:54 – Book 1: Designing Data-Intensive Applications
01:48 – Book 2: Fundamentals of Data Engineering
02:46 – Book 3: The Data Warehouse Toolkit
03:34 – Book 4: SQL Performance Explained
04:25 – Book 5: The Pragmatic Programmer
05:10 – Book 6: Data Governance
06:39 – Book 7: Storytelling with Data
07:26 – Bonus: Top Udemy Courses for Data Engineers
09:11 – 8-Week Data Engineering Roadmap
09:58 – Final Thoughts & Next Steps

—
What you’ll learn:
• The 7 best books for data engineers (with summa

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

Unlock the power of Databricks with this in-depth guide to Liquid Clustering! If your Databricks jobs are slow, expensive, or hard to explain, this video is for you. Learn how Liquid Clustering can transform your data pipelines, cut costs, and make you stand out in job interviews. We’ll break down the differences between partitioning, Z-ordering, and Liquid Clustering, show you how to implement it, and share expert tips for interview success. Plus, discover common pitfalls and how to avoid them!

What you’ll learn:

Why traditional partitioning and Z-ordering fall short
How Liquid Clustering works and why it’s a game-changer
Real-world performance and cost benefits
How to explain Liquid Clustering in interviews
Common mistakes and best practices

Interview Template: https://www.gambilldataengineering.com/gambill-data-business-templates#liquid-clustering

If you are looking for a book recommendation to learn more about Data Engineering on Databricks Check this out: https://amzn.to/4mCVdCD

Chapters:
0:00 – Introduction: The Databricks Performance Problem
0:24 – Why Liquid Clustering Matters
1:21 – What is Liquid Clustering?
2:09 – Key Benefits: Performance, Cost, Governance
3:14 – Comparing Partitioning, Z-ordering, and Liquid Clustering
4:27 – How to Implement Liquid Clustering
4:51 – The “Cluster by Auto” Secret
5:15 – Interview Tips: How to Stand Out
6:01 – Common Pitfalls to Avoid
6:41 – Key Takeaways
7:08 – Call to Action & Next Steps

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

If you ship AI-generated code you do not understand, you will not be replaced by AI. You will be replaced by an engineer who knows how to use it well.

We were live with two sharp data pros for a straight talk session on collaborating with AI in real pipelines.

🗓 Friday, August 15, 2025
🕙 10:00 PM ET
🔴 YouTube Live

What we covered
AI as a Pair programmer - How to write code with AI that doesn't suck!

AI as data interrogator - Shane's cool tool that helps to contextualize your data ecosystem. 

AI is taking data engineer jobs... Round robin on our thoughts on this question.

Plus live questions from the community and some great conversation on how to break into data engineering... 2 hours packed full of fun and information. 

Panel
• Chris Gambill, Data Engineering Consultant
• Ramona Truta, Data and AI Practitioner
• Shane Gibson, Co-founder at AgileData

Bring a question from your stack. Your question might be chosen to workshop and give you a concrete next step.

#DataEngineering #AI #Databricks #SQL #DataOps #AgenticAI #MLOps #SoftwareEngineering #LiveStream

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

Unlock your data engineering career in 2025 with this step-by-step blueprint! Whether you’re just starting out or looking to level up, this guide covers the essential skills, tools, and strategies you need to land high-paying, future-proof data jobs. Learn why Databricks, SQL, Delta Lake, and Spark are must-haves, and discover the real-world playbook for mastering the modern data stack. Includes interview questions, salary insights, and top resources to accelerate your journey.

Download the checklist:
https://www.gambilldataengineering.com/gambill-data-business-templates#de-data-engineer

Book suggestions:
• Designing Data-Intensive Applications https://amzn.to/4mserKS
• Information Product Canvas https://amzn.to/45GHCEj
• Data Warehouse Toolkit https://amzn.to/4lmQd3V

Udemy suggestions:
Databricks & Spark: http://bit.ly/4mlELpU
Data Engineering on Databricks:  http://bit.ly/40MLIYT
SQL for Engineering:

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

From Neuroscience to Startups: A Data Pro’s Journey | Kyle Stratis Interview

Join host Chris as he interviews Kyle Stratus, founder of Stratus Data Labs and O’Reilly author, about his unique journey from neuroscience PhD to startup founder and data innovator. Discover how Kyle transitioned into tech, built a viral meme stock market, and what he learned from startup successes and failures—including a legendary cease and desist from NASDAQ! Perfect for aspiring data scientists, engineers, and entrepreneurs.

⏰ Timestamps
00:00 – Introduction: Meet Kyle Stratus, Data Innovator & Author
00:33 – From Neuroscience PhD to Software Engineer
01:04 – Entering the Startup World & Consulting for Early-Stage Companies
01:49 – Academic Backgrounds in Data Science
02:55 – The Startup Cautionary Tale: NASDANQ Meme Stock Market
03:54 – Building the Meme Stock Market: Tech & Team
04:52 – Community Growth & Media Attention
05:35 – Launch Day Drama: Deploying on the Road
06:11 – Funding Challenges & Pitching at Accelerators
07:08 – The Pitch Event: Meme Stocks vs. Defense Contractors
07:36 – Legal Trouble: Cease & Desist from NASDAQ
08:25 – The Power of Startup Friendships & Lessons Learned

Meet the guest:
Kyle Stratis
Stratis Data Labs: https://stratisdatalabs.com/ 
AI Agents with MCP (O’Reilly): https://learning.oreilly.com/library/view/ai-agents-with/9798341639546/

👍 If you enjoyed this video, don’t forget to like, subscribe, and hit the bell for more interviews with data leaders and startup founders!

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

Negotiate Like a Pro or Stay Underpaid in 2025

Unlock the secrets to salary negotiation as a data engineer in 2025! In this video, you'll learn exactly what to say, when to say it, and how to anchor your value so you never leave money on the table again. Whether you're entry-level or a seasoned pro, these strategies will help you maximize your compensation, avoid common mistakes, and confidently navigate every stage of the offer process.

Timestamps / Chapters:
00:00 - Why Most Data Engineers Stay Underpaid
00:24 - Understanding 2025 Compensation Bands
00:47 - Senior & Advanced Compensation Factors
01:13 - How Location, Industry, and Equity Impact Pay
01:44 - Using Tools & Your Network to Benchmark Offers
02:17 - The Most Important Line to Use with HR
02:58 - When to Negotiate: The Right Timeline
02:51 - Why Phone Beats Email for Negotiation
03:11 - The Anti-Trap Script for Early Comp Questions
03:40 - The STAR Framework for Negotiation
04:07 - Total Compensation: What to Ask For
04:34 - Anchoring with Data & Market Research
04:51 - Making Your Case: Show Your Value
05:34 - What to Do When They Say "Top of Range"
05:53 - Common Negotiation Mistakes to Avoid
06:13 - Negotiation is Not a Standoff
06:40 - How to Respond to "No"
06:54 - Levers to Pull: Reviews, Bonuses, PTO, and More
07:32 - Advanced Perks: Office, Training, Title, Travel
07:59 - Real-World Example: Certification for a Raise
08:27 - The Power of Grace and Leverage
08:52 - Final Thoughts: Be Professional, Be Prepared
09:10 - Like, Subscribe & Get Personalized Help
09:44 - Next Steps: Level Up Your Career

👇 Need help with your next negotiation? Check the link below for mock negotiations, comp strategy, and personalized coaching!

#SalaryNegotiation #DataEngineer #CareerAdvice #2025

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

What’s it really like building data solutions from the ground up in a startup?
Join Chris Gambill (Founder, Gambill Data) for a candid live conversation with Kyle Stratis, founder of Stratis Data Labs, O’Reilly author, and hands-on data leader in the trenches of startup growth.

Kyle’s not only shaping the future of AI automation with his upcoming book, AI Agents with MCP (O’Reilly), he’s got the scars, wins, and hard-earned wisdom from building data and AI stacks in the chaos of startup life.

In this livestream, we’ll cover:
How to thrive as a data pro in a fast-paced startup

The biggest surprises (and pitfalls) for data engineers outside big enterprise

What Kyle learned writing “AI Agents with MCP”, and what’s next for the field

Audience Q&A!

Meet the guest:
Kyle Stratis
• LinkedIn: See below
• Stratis Data Labs: See below
• AI Agents with MCP (O’Reilly): See below

Set a reminder and bring your questions! See you LIVE at 12pm ET!


Meet the guest:
Kyle Stratis
Stratis Data Labs: https://stratisdatalabs.com/
Kyle’s LinkedIn: https://www.linkedin.com/in/kylestratis/
AI Agents with MCP (O’Reilly): https://learning.oreilly.com/library/view/ai-agents-with/9798341639546/

#DataEngineering #StartupLife #AI #Livestream #DataWithDirection

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

Think AI is only for machine learning experts and prompt engineering pros? Think again. In this episode of Data With Direction, Chris Gambill joined by AI Architect Ramona Truta breaks down 10 essential AI skills that you probably already have—and shows you how to level them up to stay relevant in the rapidly shifting world of data and AI.

From writing clear Google searches to debugging messy SQL queries, these everyday skills translate directly into the AI age. If you’re a data engineer, analyst, or tech-curious professional looking to build a future-proof skillset, this one’s for you.

🧠 What you’ll learn:

• Why prompt engineering is just fancy Googling
• How GenAI mirrors your best brainstorming sessions
• The invisible data skills you’re already using daily
• How to sharpen your critical and analytical thinking for the AI era
• Why resilience—not tech—is the real superpower

🎯 Whether you're building pipelines or cleaning up the aftermath of vibe-coded chaos, you’ll walk away knowing how to turn your current skills into an AI-ready advantage.

🔗 Learn more at gambilldataengineering.com

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.

Send us a text

Are you a data engineer stuck in a mid-level role, wondering why your career isn’t advancing as fast as your skills? In this video, Chris Gambill breaks down the three invisible mistakes that hold back 80% of data engineers from landing senior positions and big salary jumps. Learn how to avoid the technology trap, visibility gap, and impact illusion—and discover actionable strategies to boost your career, increase your salary, and stand out to decision makers.

What you’ll learn:

The 3 biggest career mistakes data engineers make (and how to avoid them)
Why technical skills alone aren’t enough for promotions
How to make your work visible and valued by managers
The “career ceiling” framework for breaking into senior and leadership roles
A step-by-step action plan to start moving up today

Timestamps:
0:00 – Why most data engineers get stuck
0:30 – The career ceiling framework
1:00 – Mistake #1: The Technology Trap
2:00 – Mistake #2: The Visibility Gap
3:00 – Mistake #3: The Impact Illusion
4:00 – Your action plan for career growth
4:30 – What’s next: Salary negotiation strategies

Subscribe for more data engineering career tips and strategies!

Support the show

Chris Gambill is a data engineering consultant and educator with 25+ years of experience helping organizations modernize their data stacks. As founder of Gambill Data, he specializes in data strategy, cloud migration, and building resilient analytics platforms for mid-market and enterprise clients. He’s passionate about making real-world data engineering accessible.

Connect with Chris on LinkedIn or learn more at gambilldata.com.