The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

How Redica Transformed Their Data With Airflow and Snowflake with Shankar Mahindar


Listen Later

The life sciences industry relies on data accuracy, regulatory insight and quality intelligence. Building a unified system that keeps these elements aligned is no small feat.


In this episode, we welcome Shankar Mahindar, Senior Data Engineer II at Redica Systems. We discuss how the team restructures its data platform with Airflow to strengthen governance, reduce compliance risk and improve customer experience.


Key Takeaways:


00:00 Introduction.

01:53 A focused analytics platform reduces compliance risk in life sciences.

07:31 A centralized warehouse orchestrated by Airflow strengthens governance.

09:12 Managed orchestration keeps attention on analytics and outcomes.

10:32 A modern transformation stack enables scalable modeling and operations.

11:51 Event-driven pipelines improve data freshness and responsiveness.

14:13 Asset-oriented scheduling and versioning enhance reliability and change control.

16:53 Observability and SLAs build confidence in data quality and freshness.

21:04 Priorities include partitioned assets and streamlined developer tooling.


Resources Mentioned:


Shankar Mahindar

https://www.linkedin.com/in/shankar-mahindar-83a61b137/


Redica Systems | LinkedIn

https://www.linkedin.com/company/redicasystems/


Redica Systems | Website

https://redica.com


Apache Airflow

https://airflow.apache.org/


Astronomer

https://www.astronomer.io/


Snowflake

https://www.snowflake.com/


AWS

https://aws.amazon.com/




Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.



#AI #Automation #Airflow #MachineLearning

...more
View all episodesView all episodes
Download on the App Store

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIBy Astronomer

  • 5
  • 5
  • 5
  • 5
  • 5

5

20 ratings


More shows like The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,007 Listeners

The Joe Rogan Experience by Joe Rogan

The Joe Rogan Experience

229,029 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

537 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

625 Listeners

Data Engineering Podcast by Tobias Macey

Data Engineering Podcast

146 Listeners

Masters of Scale by WaitWhat

Masters of Scale

3,990 Listeners

DevOps Paradox by Darin Pope & Viktor Farcic

DevOps Paradox

25 Listeners

The Real Python Podcast by Real Python

The Real Python Podcast

142 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,922 Listeners

SmartLess by Jason Bateman, Sean Hayes, Will Arnett

SmartLess

57,845 Listeners

Hard Fork by The New York Times

Hard Fork

5,507 Listeners

The Data Stack Show by Rudderstack

The Data Stack Show

14 Listeners

The Data Engineering Show by The Firebolt Data Bros

The Data Engineering Show

8 Listeners

The AWS Developers Podcast by Amazon Web Services

The AWS Developers Podcast

25 Listeners

The Economics Show by Financial Times

The Economics Show

147 Listeners