In this episode, we will introduce the concept of causal inference, and discuss how the data scientist team from Walmart determines Causal Effects when A/B Tests are Infeasible through Adopter Analysis.

Based on their published tech blog, with the link provided here for your reference:  https://medium.com/walmartglobaltech/how-to-determine-causal-effects-when-a-b-tests-are-infeasible-through-adopter-analysis-b06f2d51a633 

In this episode, we will discuss the importance of metrics for the business. We will share the journey of how Indeed started with a single metric to measure client-side performance, and eventually converged into a composite metric serving as a comprehensive measure

Based on their published tech blog, with the link provided here for your reference: 
https://engineering.indeedblog.com/blog/2024/01/composite-web-performance-metric

In this episode, we will explore how Pinterest uses generative AI technology to develop a text-to-SQL feature for their data analytics team. We will examine the general architecture of their two iterations, regarding how the team has enhanced the AI product to support better a wider range of analytics use cases with improved productivity.

Based on their published tech blog, with the link provided here for your reference: https://medium.com/pinterest-engineering/how-we-built-text-to-sql-at-pinterest-30bad30dabff

In this episode, we'll discuss what network effects are, how they introduce challenges in the standard A/B testing framework, and how the cluster experimentation method can be leveraged to address these challenges. We will also delve into the technical details of how clusters can be generated, and evaluated, and the associated trade-offs that need to be considered.

Based on their published tech blog, with the link provided here for your reference: https://medium.com/@AnalyticsAtMeta/how-meta-tests-products-with-strong-network-effects-96003a056c2c

In this episode, we'll explore how the data science team from Grammarly developed their geo-experimentation to measure marketing effectiveness. We will cover about three components in designing an A/B testing experiment, as well as considerations regarding the opportunistic costs of the experimentation.

Based on their published tech blog, with the link provided here for your reference: https://www.grammarly.com/blog/engineering/measuring-marketing-effectiveness-in-a-cookie-less-world/ 

In this episode, we'll explore how the data science team from Shopify leverages Monte Carlo Simulation to develop their sampled success metrics. We'll discuss what is sampled success metrics, the associated trade-offs needed to build them, and how Monte Carlo simulation can be used to inform decisions.

Based on their published tech blog, with the link provided here for your reference: https://shopify.engineering/monte-carlo-simulations-sampled-success-metrics

In this episode, we'll explore how the data science team from Klaviyo developed a Generative AI Product that enhances experiences and enables efficient customer segmentation. We'll also discuss two key concepts in Generative AI: prompt chaining and few-shot learning.

Based on their published tech blog, with the link provided here for your reference: https://klaviyo.tech/building-segments-ai-fe33d9cab822

Description: In this episode, we will talk about the importance of remediating failed workflow jobs to reduce business infrastructure costs. We delve into Netflix's approach, which involves enhancing their existing rule-based error classifier with advanced machine learning models. This allowed for auto-remediation, improving the handling of memory configuration and unclassified errors, ultimately leading to substantial cost savings.

Based on their published tech blog, with the link provided here for your reference: https://netflixtechblog.com/evolving-from-rule-based-classifier-machine-learning-powered-auto-remediation-in-netflix-data-039d5efd115b

In this episode, we will talk about what is technical debt in software engineering and its associated risks. We will also share a set of metrics to measure the status of technical debt and ways to help companies quantify their progress toward better software engineering efforts.

Based on their published tech blog, with the link provided here for your reference: https://medium.com/booking-com-development/measuring-technical-debt-to-avoid-the-boiling-frog-syndrome-c44eb48b3ce1

In this episode, we will discuss how the Science team at Amazon designs pricing experiments to improve experimentation power. We will cover concepts like the carryover effect and spillover effect, as well as the solutions the team developed to overcome those challenges.

Based on their published tech blog, with the link provided here for your reference: https://www.amazon.science/blog/the-science-of-price-experiments-in-the-amazon-store