Understanding the complexities of Apache Airflow can be daunting for newcomers and seasoned data engineers. But with the right guidance, mastering the tool becomes an achievable milestone.

In this episode, Marc Lamberti, Head of Customer Education at Astronomer, joins us to share his journey from Udemy instructor to driving education at Astronomer, and how he's helping over 100,000 learners demystify Airflow.

Key Takeaways:

(02:36) Early exposure to Airflow while addressing inefficiencies in data workflows.

(04:10) Common barriers to implementing open source tools in enterprise settings.

(06:18) The shift from part-time teaching to a full-time focus on Airflow education.

(07:53) A modular, guided approach to structuring educational content.

(09:57) The value of highlighting underused Airflow features for broader adoption.

(12:35) Certifications as a method to assess readiness and uncover knowledge gaps.

(13:25) Coverage of essential Airflow concepts in the Fundamentals exam.

(16:07) The DAG Authoring exam’s emphasis on practical, advanced features.

(20:08) A call for more visible integration of Airflow with AI workflows.

Resources Mentioned:

Marc Lamberti

https://www.linkedin.com/in/marclamberti/

Astronomer | LinkedIn

https://www.linkedin.com/company/astronomer/

Astronomer Academy

https://academy.astronomer.io/

Airflow Fundamentals Certification

https://www.astronomer.io/certification/

DAG Authoring Certification

https://academy.astronomer.io/plan/astronomer-certification-dag-authoring-for-apache-airflow-exam

The Complete Hands-On Introduction to Airflow

https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/?utm_source=adwords&utm_medium=udemyads&utm_campaign=Search_DSA_Beta_Prof_la.EN_cc.ROW-English&campaigntype=Search&portfolio=ROW-English&language=EN&product=Course&test=&audience=DSA&topic=&priority=Beta&utm_content=deal4584&utm_term=_._ag_162511579404_._ad_696197165418_._kw__._de_c_._dm__._pl__._ti_dsa-1677053911088_._li_9061346_._pd__._&matchtype=&gad_source=1&gad_campaignid=21168154305&gbraid=0AAAAADROdO3MpljfP-gssiYSmDEPdhZV9&gclid=Cj0KCQjw097CBhDIARIsAJ3-nxdjZA6G5-Y0-akk6Huksy2PLb04t92J4iNfUSIbMdrSAla_tb-o2N8aArOeEALw_wcB&couponCode=PMNVD3025

https://www.astronomer.io/events/roadshow/london/  

https://www.astronomer.io/events/roadshow/new-york/  

https://www.astronomer.io/events/roadshow/sydney/  

https://www.astronomer.io/events/roadshow/san-francisco/  

https://www.astronomer.io/events/roadshow/chicago/

Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.

#AI #Automation #Airflow #MachineLearning