Datacast

Datacast

Download on the App Store

Datacast episodes

  • Episode 69: DataPrepOps, Active Learning, and Team Management with Jennifer Prendki
    Show Notes
    • (01:46) Jennifer shared her formative experiences growing up in France and wanting to be a physicist.
    • (03:04) Jennifer unpacked the evolution of her academic journey in France — getting Physics degrees at Louis Pasteur University, Paris-Sud University, and Sorbonne University.
    • (06:44) Jennifer mentioned her time as a Postdoctoral Researcher in Neutrino Physics at Duke University, where her research group lacked the funding to carry on scientific projects.
    • (09:35) Jennifer discussed her transition from academia to industry, working as a Quantitative Research Scientist at Quantlab Financial in Houston.
    • (13:31) Jennifer went over her move to the Bay Area, working for YuMe and Ayasdi — growing and managing early-stage data science teams at both places.
    • (19:19) Jennifer recalled her foray into becoming a Senior Data Science Manager of the Search team at Walmart Labs. She managed the Metrics-Measurements-Insights team and the Store-Search team.
    • (23:59) Jennifer shared the business anecdote that made her obsessed with measuring the ROI of data science.
    • (28:46) Jennifer reflected on the opportunity to give conference talks and become a thought leader in the data science community (watch her first industry talk, “Review Analysis: An Approach to Leveraging User-Generated Content in the Context of Retail” at MLconf 2016).
    • (31:10) Jennifer unpacked her interest in active learning and outlined existing challenges of making active learning performant in real-world ML systems.
    • (36:58) After 1.5 years with Walmart Labs, Jennifer became the Chief Data Scientist at Atlassian. She shared the tactics to grow the Search & Smarts team of scientists and engineers from 3 to 17 people in less than 6 months across 3 locations.
    • (40:31) Jennifer discussed the organizational and operational challenges with making ML useful in enterprises and the importance of data preparation in the modern ML stack.
    • (47:24) Jennifer elaborated on the topic of “Agile for Data Science Teams,” which discusses that organizations that invest in ML but do not get the organizational side of things right will fail.
    • (53:09) Jennifer went over her decision to accept a VP of Machine Learning role at Figure Eight, then a frontier startup that offers enterprise-grade labeling solutions to ML teams.
    • (57:56) Jennifer went over the inception of her startup Alectio, whose mission is to help companies do ML more efficiently with fewer data and help the world do ML more sustainably by reducing the industry’s carbon footprint.
    • (01:04:32) Jennifer unpacked her 4-part blog series about responsible AI that calls out the need to fight bias, increase accessibility, and create more opportunities in AI.
    • (01:09:06) Jennifer discussed the hurdles she had to jump through to find early adopters of Alectio.
    • (01:11:03) Jennifer emphasized the valuable lessons learned to attract the right people who are excited about Alectio’s mission.
    • (01:14:38) Jennifer cautioned the danger of taking advice without thinking through how it can be applied to one’s career.
    • (01:17:09) Jennifer condensed her decade of experience navigating the tech industry as a woman into concrete advice.
    • (01:19:19) Closing segment.
    Jennifer’s Contact Info
    • LinkedIn
    • Twitter
    • Medium
    Alectio’s Resources
    • Website
    • Twitter
    • LinkedIn
    • What Is Alectio? (Video)
    • Is Big Data Dragging Us Towards Another AI Winter? (Article)
    Mentioned ContentTalks
    • The Day Big Data Died (Oct 2020 @ Interop Digital)
    • The Importance of Ethics in Data Science (Keynote @ Women in Analytics Conference 2019)
    • Introduction to Active Learning (ODSC London 2018)
    • Agile for Data Science Teams (Strata Data Conf — New York 2018)
    • Big Data and the Advent of Data Mixology (Interop ITX — The Future of Data Summit 2017)
    • The Limitations of Big Data In Predictive Analytics (DataEngConf SF 2017)
    • Review Analysis: An Approach to Leveraging User-Generated Content in the Context of Retail (MLconf 2016)
    Articles

    1 — Women vs. The Workplace Series

    • Gender Discrimination (Oct 2015)
    • Why Leading By Example Matters (Jan 2017)
    • Data Scientist: the SexISTiest Job of the 21st Century? (Feb 2017)
    • The Role of Motherhood in Gender Discrimination (March 2017)
    • The Biggest Challenges of the Female Manager (May 2017)
    • Parity in the Workplace: Why We Are Not There Yet (Dec 2017)
    • The Pyramid of Needs of Professional Women (Dec 2017)

    2 — Management Series

    • The Secrets to Successfully Managing an Underperformer (June 2017)
    • The Top Secrets to Managing a Rockstar (July 2017)
    • The Real Cost of Hiring Over-Qualified Candidates in Technology (March 2018)
    • Team Culture (May 2018)

    3 — Responsible AI Series

    • How We Got Responsible AI All Wrong (Part 1)
    • Impact, Bias, and Sustainability in AI (Part 2)
    • Increasing Accessibility to AI (Part 3)
    • Creating More Opportunities in AI (Part 4)
    Book
    • “Managing Up” (by Rosanne Badowski and Roger Gittines)
    Notes

    Jennifer told me that Alectio is about to launch a community version that people will be able to compete to get the best model with the minimum amount of data this fall. Be sure to check out their blog and follow them on LinkedIn!

    About the show

    Datacast features long-form, in-depth conversations with practitioners and researchers in the data community to walk through their professional journeys and unpack the lessons learned along the way. I invite guests coming from a wide range of career paths — from scientists and analysts to founders and investors — to analyze the case for using data in the real world and extract their mental models (“the WHY and the HOW”) behind their pursuits. Hopefully, these conversations can serve as valuable tools for early-stage data professionals as they navigate their own careers in the exciting data universe.

    Datacast is produced and edited by James Le. Get in touch with feedback or guest suggestions by emailing [email protected].

    Subscribe by searching for Datacast wherever you get podcasts or click one of the links below:

    • Listen on Spotify
    • Listen on Apple Podcasts
    • Listen on Google Podcasts

    If you’re new, see the podcast homepage for the most recent episodes to listen to, or browse the full guest list.



    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    1 hr 29 min
  • Episode 68: Threat Intelligence, Venture Stamina, and Data Investing with Sarah Catanzaro
    Show Notes
    • (01:48) Sarah talked about the formative experiences of her upbringing: growing up interested in the natural sciences and switching focus on terrorism analysis after experiencing the 9/11 tragedy with her own eyes.
    • (04:07) Sarah discussed her experience studying International Security Studies at Stanford and working at the Center for International Security and Cooperation.
    • (07:15) Sarah recalled her first job out of college as a Program Director at the Center for Advanced Defense Studies — collaborating with academic researchers to develop computational approaches that counter terrorism and piracy.
    • (09:48) Sarah went over her time as a cyber-intelligence analyst at Cyveillance, which provided threat intelligence services to enterprises worldwide.
    • (12:22) Sarah walked over her time at Palantir as an embedded analyst, where she observed the struggles that many agencies had with data integration and modeling challenges.
    • (15:26) Sarah unpacked the challenges of building out the data team and applying the data work at Mattermark.
    • (20:15) Sarah shared her opinion on the career trajectory for data analysts and data scientists, given her experience as a manager for these roles.
    • (23:43) Sarah shared the power of having a peer group and building a team culture that she was proud of at Mattermark.
    • (26:41) Sarah joined Canvas Ventures as a Data Partner in 2016 and shared her motivation for getting into venture capital.
    • (29:47) Sarah revealed the secret sauce to succeed in venture — stamina.
    • (32:00) Sarah has been an investor at Amplify Partners since 2017 and shared what attracted her about the firm’s investment thesis and the team.
    • (35:28) Sarah walked through the framework she used to prove her value upfront as the new investor at Amplify.
    • (38:35) Sarah shared the details behind her investment on the Series A round for OctoML, a Seattle-based startup that leverages Apache TVM to enable their clients to simply, securely, and efficiently deploy any model on any hardware backend.
    • (44:39) Sarah dissected her investment on the seed round for Einblick, a Boston-based startup that builds a visual computing platform for BI and analytics use cases.
    • (48:45) Sarah mentioned the key factors inspiring her investment in the seed round for Metaphor Data, a meta-data platform that grew out of the DataHub open-source project developed at LinkedIn.
    • (53:57) Sarah discussed what triggered her investment in the Series A round for Runway, a New York-based team building the next-generation creative toolkit powered by machine learning.
    • (58:36) Sarah unpacked the advice she has been giving her portfolio companies in hiring decisions and expanding their founding team (and advice they should ignore).
    • (01:01:29) Sarah went over the process of curating her weekly newsletter called Projects To Know (active since 2019).
    • (01:05:00) Sarah predicted the 3 trends in the data ecosystem that will have a disproportionately huge impact in the future.
    • (01:11:15) Closing segment.

    Sarah’s Contact Info

    • Amplify Page
    • Twitter
    • LinkedIn
    • Medium

    Amplify Partners’ Resources

    • Website
    • Team
    • Portfolio
    • Blog
    Mentioned Content

    Blog Posts

    • Our Investment in OctoML
    • Announcing Our Investment in Einblick
    • Our Investment in Metaphor Data
    • Our Series A Investment in Runway

    People

    • Sunil Dhaliwal (General Partner at Amplify Partners)
    • Mike Dauber (General Partner at Amplify Partners)
    • Lenny Pruss (General Partner at Amplify Partners)
    • Mike Volpi (Co-Founder and Partner at Index Ventures)
    • Gary Little (Co-Founder and General Partner at Canvas Ventures)

    Book

    • “Zen and the Art of Motorcycle Maintenance” (by Robert Pirsig)
    New Updates

    Since the podcast was recorded, Sarah has been keeping her stamina high!

    • Her investments in Hex (data workspace for teams) and Meroxa (real-time data platform) have been made public.
    • She has also spoken at various panels, including SIGMOD, REWORK, University of Chicago, and Utah Nerd Nights.

    Be sure to follow @sarahcat21 on Twitter to subscribe to her brain on the intersection of data, VC, and startups!



    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    1 hr 17 min
  • Episode 67: Model Observability, AI Bias, and ML Infrastructure Ecosystem with Aparna Dhinakaran
    Show Notes
    • (01:39) Aparna talked about her Bachelor’s degree in Electrical Engineering and Computer Science at UC Berkeley.
    • (02:50) Aparna shared her undergraduate research experience at the Energy and Sustainable Technologies lab.
    • (04:34) Aparna discussed valuable lessons learned from her industry internships at TubeMogul and compared the objective with that of a research environment.
    • (08:26) Aparna then joined Uber as a software engineer on the Marketplace Forecasting team, where she led the development of Uber’s first model lifecycle management system for running ML model computations at scale to power Uber’s dynamic pricing algorithms.
    • (12:40) Aparna talked about how she became interested in model monitoring while Uber’s model store.
    • (17:29) Aparna discussed her decision to join the Ph.D. program in Computer Vision at Cornell University, specifically about bias in model, after spending 3 years at Uber.
    • (23:40) Aparna shared the backstory behind co-founding MonitorML with her brother Eswar and going through the 2019 summer batch of Y-Combinator.
    • (26:47) Aparna discussed the acquisition of MonitorML by Arize AI, where she’s currently the Chief Product Officer.
    • (28:41) Aparna unpacked the key insights in her ongoing ML Observability blog series, which argues that model observability is the foundational platform that empowers teams to continually deliver and improve results from the lab to production.
    • (33:17) Aparna shared her verdict for the ML tooling ecosystem in the upcoming years from her in-depth exploration of ML infrastructure tools covering data preparation, model building, model validation, and model serving.
    • (37:01) Aparna briefly shared the challenges encountered to get the first cohort of customers for Arize.
    • (39:23) Aparna went over valuable lessons to attract the right people who are excited about Arize’s mission.
    • (41:04) Aparna shared her advice for founders who are in the process of finding the right investors for their companies.
    • (42:24) Aparna reasoned how participating in The Amazing Race was similar to running a startup.
    • (44:59) Closing segment.

    Aparna’s Contact Info

    • Twitter
    • LinkedIn
    • Medium
    • Forbes Column
    • Website
    • Github
    • Google Scholar

    Arize’s Resources

    • Website
    • Medium
    • LinkedIn
    • Twitter
    Mentioned Content

    Blog Posts

    • ML Infrastructure Tools for Data Preparation (May 2020)
    • ML Infrastructure Tools for Model Building (May 2020)
    • ML Infrastructure Tools for Production (Part 1) (May 2020)
    • ML Infrastructure Tools for Production (Part 2) (Sep 2020)
    • ML Infrastructure Tools — ML Observability (Feb 2021)
    • The Model’s Shipped — What Could Possibly Go Wrong? (Feb 2021)

    People

    • Rediet Abebe (Assistant Professor of Computer Science at UC Berkeley and Junior Fellow at the Harvard Society of Fellows)
    • Timnit Gebru (Founder of Black in AI, Ex-Research Scientist at Google)
    • Serge Belongie (Professor of Computer Science at Cornell and Aparna’s past Ph.D. advisor)
    • Solon Barocas (Principal Researcher at Microsoft Research and Adjunct Assistant Professor of Information Science at Cornell)
    • Manish Raghavan (Ph.D. candidate in the Computer Science department at Cornell)
    • Kate Crawford (Principal Researcher at Microsoft Research and Co-founder/Director of research at NYU’s AI Now Institute)

    Book

    • “The Hard Thing About The Hard Things” (by Ben Horowitz)
    New Updates

    Since the podcast was recorded, a lot has happened at Arize AI!

    • Aparna has continued writing the ML observability series: The Playbook to Monitor Your Model’s Performance in Production (March 2021) and Beyond Monitoring: The Rise of Observability (May 2021).
    • Arize has been recognized in Forbes’s AI 50 2021: Most Promising AI Companies.
    • Aparna has also contributed to Forbes various articles: from the Chronicles of AI Ethics and Q&A with Ethics researchers, to a list of Women in AI to watch and emerging ML tooling categories.
    About The Show

    Datacast features long-form, in-depth conversations with practitioners and researchers in the data community to walk through their professional journeys and unpack the lessons learned along the way. I invite guests coming from a wide range of career paths — from scientists and analysts to founders and investors — to analyze the case for using data in the real world and extract their mental models (“the WHY”) behind their pursuits. Hopefully, these conversations can serve as valuable tools for early-stage data professionals as they navigate their own careers in the exciting data universe.

    Datacast is produced and edited by James Le. Get in touch with feedback or guest suggestions by emailing [email protected].

    Subscribe by searching for Datacast wherever you get podcasts or click one of the links below:

    • Listen on Spotify
    • Listen on Apple Podcasts
    • Listen on Google Podcasts

    If you’re new, see the podcast homepage for the most recent episodes to listen to, or browse the full guest list.



    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    49 min
  • Episode 66: Monitoring Models in Production with Emeli Dral
    Show Notes
    • (02:07) Emeli shared her educational background getting degrees in Applied Mathematics and Informatics from the Peoples’ Friendship University of Russia in the early 2010s.
    • (04:24) Emeli went over her experience getting a Master’s Degree at Yandex School of Data Analysis.
    • (07:06) Emeli reflected on lessons learned from her first job out of university working as a Software Developer at Rambler, one of the biggest Russian web portals.
    • (09:33) Emeli walked over her first year as a Data Scientist developing e-commerce recommendation systems at Yandex.
    • (13:38) Emeli discussed core projects accomplished as the Chief Data Scientist at Yandex Data Factory, Yandex’s end-to-end data platform.
    • (17:52) Emeli shared her learnings transitioning from an IC to a manager role.
    • (19:21) Emeli mentioned key components of success for industrial AI, given her time as the co-founder and Chief Data Scientist at Mechanica AI.
    • (22:40) Emeli dissected the makings of her Coursera specializations — “Machine Learning and Data Analysis” and “Big Data Essentials.”
    • (26:14) Emeli discussed her teaching activities at Moscow Institute of Physics and Technology, Yandex School of Data Analysis, Harbour.Space, and Graduate School of Management — St. Petersburg State University.
    • (30:12) Emeli shared the story behind the founding of Evidently AI, which is building a human interface to machine learning, so that companies can trust, monitor, and improve the performance of their AI solutions.
    • (32:32) Emeli explained the concept of model monitoring and exposed the monitoring gap in the enterprise (read Part 1 and Part 2 of the Monitoring series).
    • (34:13) Emeli looked at possible data quality and integrity issues while proposing how to track them (read Part 3, Part 4, and Part 5 of the Monitoring series).
    • (36:47) Emeli revealed the pros and cons of building an open-source product.
    • (39:13) Emeli talked about prioritizing product roadmap for Evidently AI.
    • (41:24) Emeli described the data community in Moscow.
    • (42:03) Closing segment.

    Emeli’s Contact Info

    • LinkedIn
    • Twitter
    • Coursera
    • GitHub
    • Medium

    Evidently AI’s Resources

    • Website
    • Twitter
    • LinkedIn
    • GitHub
    • Documentation
    Mentioned Content

    Blog Posts

    • ML Monitoring, Part 1: What Is It and How It Differs? (Aug 2020)
    • ML Monitoring, Part 2: Who Should Care and What We Are Missing? (Aug 2020)
    • ML Monitoring, Part 3: What Can Go Wrong With Your Data? (Sep 2020)
    • ML Monitoring, Part 4: How To Track Data Quality and Data Integrity? (Oct 2020)
    • ML Monitoring, Part 5: Why Should You Care About Data And Concept Drift? (Nov 2020)
    • ML Monitoring, Part 6: Can You Build a Machine Learning Model to Monitor Another Model? (April 2021)

    Courses

    • “Machine Learning and Data Analysis”
    • “Big Data Essentials”

    People

    • Yann LeCun (Professor at NYU, Chief AI Scientist at Facebook)
    • Tomas Mikolov (the creator of Word2Vec, ex-scientist at Google and Facebook)
    • Andrew Ng (Professor at Stanford, Co-Founder of Google Brain, Coursera, and Landing AI, Ex-Chief Scientist at Baidu)

    Book

    • “The Elements of Statistical Learning” (by Trevor Hastie, Robert Tibshirani, and Jerome Friedman)
    New Updates

    Since the podcast was recorded, a lot has happened at Evidently! You can use this open-source tool (https://github.com/evidentlyai/evidently) to generate a variety of interactive reports on the ML model performance and integrate it into your pipelines using JSON profiles.

    This monitoring tutorial is a great showcase of what can go wrong with your models in production and how to keep an eye on them: https://evidentlyai.com/blog/tutorial-1-model-analytics-in-production.

    About The Show

    Datacast features long-form conversations with practitioners and researchers in the data community to walk through their professional journey and unpack the lessons learned along the way. I invite guests coming from a wide range of career paths - from scientists and analysts to founders and investors — to analyze the case for using data in the real world and extract their mental models (“the WHY”) behind their pursuits. Hopefully, these conversations can serve as valuable tools for early-stage data professionals as they navigate their own careers in the exciting data universe.

    Datacast is produced and edited by James Le. Get in touch with feedback or guest suggestions by emailing [email protected].

    Subscribe by searching for Datacast wherever you get podcasts or click one of the links below:

    • Listen on Spotify
    • Listen on Apple Podcasts
    • Listen on Google Podcasts

    If you're new, see the podcast homepage for the most recent episodes to listen to, or browse the full guest list.



    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    47 min
  • Episode 65: Chaos Theory, High-Frequency Trading, and Experimentations at Scale with David Sweet
    Show Notes
    • (01:59) David recalled his undergraduate experience studying Physics and Mathematics at Duke University back in the early 90s.
    • (05:55) David reflected on his decision to pursue a Ph.D. in Physics at the University of Maryland, College Park, specializing in Nonlinear Dynamics and Chaos Theory.
    • (10:18) David unpacked his Nature paper called “Topology in Chaotic Scattering.”
    • (14:43) David went over his two papers on fractal dimensions in higher-dimensional chaotic scattering following his Nature publication.
    • (21:42) David talked about his project K Desktop Environment, which provides a free, user-friendly desktop for Linux/UNIX systems (later turned into a print book with MacMillan Publishing in 2000).
    • (24:20) David explained the premise behind his work on Andamooka, a site that supports open content.
    • (27:24) David walked over his time as a quantitative analyst at Thales Fund Management after finishing his Ph.D.
    • (30:50) David discussed his 4-year stint at Lehman Brothers — moving up the ladder into a Vice President role, up until Barclay’s Capital acquired it.
    • (33:24) David talked about his proudest accomplishment during the 5-year stint as a headdesk in equities trader at KCG/GETCO.
    • (35:37) David shared war stories while working at an investment firm called Teza Technologies and co-founding Galaxy Digital Trading (specializing in cryptocurrency trading).
    • (41:34) David unpacked key concepts covered in his guest lectures on optimization of high-frequency trading systems at NYU Stern School of Business.
    • (44:26) David explained his career change to work as a Machine Learning Engineer at Instagram in the summer of 2019.
    • (47:17) David briefly mentioned his transition back to a quant trader role at 3Red Partners.
    • (48:05) David is writing a technical book with Manning called “Tuning Up,” which provides a toolbox of experimental methods that will boost the effectiveness of machine learning systems, trading strategies, infrastructure, and more.
    • (50:48) David reflected on the benefits of his physics academic background for his quant analyst career.
    • (52:27) Closing segment.
    David’s Contact Info
    • Website
    • LinkedIn
    • Twitter
    Mentioned Content

    Publications

    • "Topology In Chaotic Scattering" (Nature, May 1999)
    • "Fractal Dimension of Higher-Dimensional Chaotic Repellors" (June 1999)
    • "Fractal Basin Boundaries in Higher-Dimensional Chaotic Scattering"

    Book

    • “The Elements of Statistical Learning” (by Trevor Hastie, Robert Tibshirani, and Jerome Friedman)

    People

    • Jim Simons (Founder of Renaissance Technologies)
    • Michael Kearns (Professor at the University of Pennsylvania, previously leading Morgan Stanley’s AI Center of Excellence)
    • Vasant Dhar (Professor at NYU Stern School of Business, Founder of SCT Capital)
    Tuning Up — From A/B testing to Bayesian optimization

    Manning’s permanent 40% discount code (good for all Manning products in all formats) for Datacast listeners: poddcast19.

    You can refer to this link: http://mng.bz/4MAR.

    Here are two free eBook codes to get copies of Tuning Up for two lucky Datacast listeners: tngdtcr-AB2C and tngdtcr-6D43

    You can refer to this link: http://mng.bz/G6Bq.



    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    57 min
  • Episode 64: Improving Access to High-Quality Data with Fabiana Clemente
    Show Notes
    • (02:06) Fabiana talked about her Bachelor’s degree in Applied Mathematics from the University of Lisbon in the early 2010s.
    • (04:18) Fabiana shared lessons learned from her first job out of college as a Siebel and BI Developer at Novabase.
    • (05:13) Fabiana discussed unique challenges while working as an IoT Solutions Architect at Vodafone.
    • (09:56) Fabiana mentioned projects she contributed to as a Data Scientist at startups such as ODYSAI and Habit Analytics.
    • (12:44) Fabiana talked about the two Master’s degrees she got while working in the industry (Applied Econometrics from Lisbon School of Economics and Management and Business Intelligence from NOVA IMS Information Management School).
    • (14:41) Fabiana distinguished the difference between data science and business intelligence.
    • (18:01) Fabiana shared the founding story of YData, the first data-centric platform with synthetic data, whose she is currently the Chief Data Officer.
    • (21:32) Fabiana discussed different techniques to generate synthetic data, including oversampling, Bayesian Networks, and generative models.
    • (24:01) Fabiana unpacked the key insights in her blog series on generating synthetic tabular data.
    • (29:40) Fabiana summarized novel design and optimization techniques to cope with the challenges of training GAN models.
    • (33:44) Fabiana brought up the benefits of using Differential Privacy as a complement to synthetic data generation.
    • (38:07) Fabiana unpacked her post “The Cost of Poor Data Quality,” — where she defined data quality as data measures based on factors such as accuracy, completeness, consistency, reliability, and above all, whether it is up to date.
    • (42:11) Fabiana explained the important role that data quality plays in ensuring model explainability.
    • (44:57) Fabiana reasoned about YData’s decision to pursue the open-source strategy.
    • (47:47) Fabiana discussed her podcast called “When Machine Learning Meets Privacy” in collaboration with the MLOps Slack community.
    • (49:14) Fabiana briefly shared the challenges encountered to get the first cohort of customers for YData.
    • (50:12) Fabiana went over valuable lessons to attract the right people who are excited about YData’s mission.
    • (51:52) Fabiana shared her take on the data community in Lisbon and her effort to inspire more women to join the tech industry.
    • (53:47) Closing segment.
    Fabiana’s Contact Info
    • LinkedIn
    • Medium
    • Twitter
    YData’s Resources
    • Website
    • Github
    • LinkedIn
    • Twitter
    • AngelList
    • Synthetic Data Community
    Mentioned Content

    Blog Posts

    • Synthetic Data: The Future Standard for Data Science Development (April 2020)
    • Generating Synthetic Tabular Data with GANs — Part 1 (May 2020)
    • Generating Synthetic Tabular Data with GANs — Part 2 (May 2020)
    • What Is Differential Privacy? (May 2020)
    • What Is Going On With My GAN? (July 2020)
    • How To Generate Synthetic Tabular Data? Wasserstein Loss for GANs (Sep 2020)
    • The Cost of Poor Data Quality (Sep 2020)
    • How Can I Explain My ML Models To The Business? (Oct 2020)
    • Synthetic Time-Series Data: A GAN Approach (Jan 2021)

    Podcast

    • “When Machine Learning Meets Privacy”

    People

    • Jean-Francois Rajotte (Resident Data Scientist at the University of British Columbia)
    • Sumit Mukherjee (Associate Professor of Statistics at Columbia University)
    • Andrew Trask (Leader at OpenMined, Research Scientist at DeepMind, Ph.D. Student at the University of Oxford)
    • Théo Ryffel (Co-Founder of Arkhn, Ph.D. Student at ENS and INRIA, Leader at OpenMined)

    Recent Announcements/Articles

    • Partnerships with UbiOps and Algorithmia
    • The rise of DataPrepOps (March 2021)
    • From model-centric to data-centric (March 2021)


    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    57 min
  • Episode 63: Real-World Transfer Learning with Azin Asgarian
    Show Notes
    • (02:06) Azin described her childhood growing up in Iran and going to a girls-only high school in Tehran designed specifically for extraordinary talents.
    • (05:08) Azin went over her undergraduate experience studying Computer Science at the University of Tehran.
    • (10:41) Azin shared her academic experience getting a Computer Science MS degree at the University of Toronto, supervised by Babak Taati and David Fleet.
    • (14:07) Azin talked about her teaching assistant experience for a variety of CS courses at Toronto.
    • (15:54) Azin briefly discussed her 2017 report titled “Barriers to Adoption of Information Technology in Healthcare,” which takes a system thinking perspective to identify barriers to the application of IT in healthcare and outline the solutions.
    • (19:35) Azin unpacked her MS thesis called “Subspace Selection to Suppress Confounding Source Domain Information in AAM Transfer Learning,” which explores transfer learning in the context of facial analysis.
    • (28:48) Azin discussed her work as a research assistant at the Toronto Rehabilitation Institute, working on a research project that addressed algorithmic biases in facial detection technology for older adults with dementia.
    • (33:02) Azin has been an Applied Research Scientist at Georgian since 2018, a venture capital firm in Canada that focuses on investing in companies operating in the IT sectors.
    • (38:20) Azin shared the details of her initial Georgian project to develop a robust and accurate injury prediction model using a hybrid instance-based transfer learning method.
    • (42:12) Azin unpacked her Medium blog post discussing transfer learning in-depth (problems, approaches, and applications).
    • (48:18) Azin explained how transfer learning could address the widespread “cold-start” problem in the industry.
    • (49:50) Azin shared the challenges of working on a fintech platform with a team of engineers at Georgian on various areas such as supervised learning, explainability, and representation learning.
    • (51:46) Azin went over her project with Tractable AI, a UK-based company that develops AI applications for accident and disaster recovery.
    • (55:26) Azin shared her excitement for ML applications using data-efficient methods to enhance life quality.
    • (57:46) Closing segment.
    Azin’s Contact Info
    • Website
    • Twitter
    • LinkedIn
    • Google Scholar
    • GitHub
    Mentioned Content

    Publications

    • “Barriers to Adoption of Information Technology in Healthcare” (2017)
    • “Subspace Selection to Suppress Confounding Source Domain Information in AAM TransferLearning” (2017)
    • “A Hybrid Instance-based Transfer Learning Method” (2018)
    • “Prediction of Workplace Injuries” (2019)
    • “Algorithmic Bias in Clinical Populations — Evaluating and Improving Facial Analysis Technology in Older Adults with Dementia” (2019)
    • “Limitations and Biases in Facial Landmark Detection” (2019)

    Blog Posts

    • “An Introduction to Transfer Learning” (Dec 2018)
    • “Overcoming The Cold-Start Problem: How We Make Intractable Tasks Tractable” (April 2021)

    People

    • Yoshua Bengio (Professor of Computer Science and Operations Research at University of Montreal)
    • Geoffrey Hinton (Professor of Computer Science at University of Toronto)
    • Louis-Philippe Morency (Associate Professor of Computer Science at Carnegie Mellon University)

    Book

    • “Machine Learning: A Probabilistic Approach” (by Kevin Murphy)

    Note: Azin and her collaborator are going to give a talk at ODSC Europe 2021 in June about a Georgian’s project with a portfolio company, Tractable. They have written a short blog post about it too which you can find HERE.



    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    1 hr 6 min
  • Episode 62: Leading Organizations Through Analytics Transformations with Gordon Wong
    Show Notes
    • (02:09) Gordon briefly talked about his undergraduate studying Psychology and Philosophy at Rutgers University in the early 90s.
    • (03:24) Gordon reflected on the first decade of his career getting into database technologies.
    • (05:34) Gordon discussed his predilection towards consulting, specifically his role in the professional services team at AB Initio Software in the early 2000s.
    • (08:02) Gordon recalled the challenges of leading data warehousing initiatives at Smarter Travel Media and ClickSquared in the 2000s.
    • (13:14) Gordon emphasized the advantage of a multi-tenant database over a traditional relational database.
    • (18:30) Gordon recalled his one-year stint at Cervello, leading business intelligence implementations for their clients.
    • (21:59) Gordon elaborated on his projects during his 3 years as the director of business intelligence infrastructure at Fitbit.
    • (26:09) Gordon dived into his framework of choosing data tooling vendors while at Fitbit (and how he settled with a tiny startup called Snowflake back then).
    • (30:02) Gordon provided recommendations for startups to be data-driven.
    • (33:24) Gordon recalled practices to foster effective collaboration while managing the 3 teams of data engineering, data warehousing, and data analytics at Fitbit.
    • (36:44) Gordon went over his proudest accomplishment as the director of data engineering at ezCater, making substantial improvements to their data warehouse platform.
    • (38:59) Gordon shared his framework for interviewing data engineers.
    • (41:39) Gordon walked through his consulting engagement in analytics engineering for Zipcar and data warehousing for edX.
    • (46:17) Gordon reflected on his time as the Vice President of business intelligence at HubSpot.
    • (50:50) Gordon unpacked his notion of “Data Hierarchy of Needs,” which entails the five pillars — data security, data quality, system reliability, user experience, and data coverage.
    • (56:55) Gordon discussed current opportunities for driving better social outcomes and empowering democracy through data.
    • (59:48) Gordon shared the key criteria that enable healthy team dynamics from his hands-on experience building data teams.
    • (01:02:13) Gordon unpacked the central features and benefits of Snowflake for the un-initiated.
    • (01:06:25) Gordon gave his verdict for the ETL tooling landscape in the next few years.
    • (01:08:33) Gordon described the data community in Boston.
    • (01:09:52) Closing segment.
    Gordon’s Contact Info
    • LinkedIn
    Mentioned Content

    People

    • Tristan Handy (co-founder of Fishtown Analytics and co-creator of dbt)
    • Michael Kaminsky (who coined the term “Analytics Engineering”)
    • Barr Moses (co-founder and CEO of Monte Carlo, who coined the term “Data Observability”)

    Book

    • “Start With Why” (By Simon Sinek)


    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    1 hr 16 min
  • Episode 61: Meta Reinforcement Learning with Louis Kirsch
    Show Notes
    • (2:05) Louis went over his childhood as a self-taught programmer and his early days in school as a freelance developer.
    • (4:22) Louis described his overall undergraduate experience getting a Bachelor’s degree in IT Systems Engineering from Hasso Plattner Institute, a highly-ranked computer science university in Germany.
    • (6:10) Louis dissected his Bachelor thesis at HPI called “Differentiable Convolutional Neural Network Architectures for Time Series Classification,” — which addresses the problem of automatically designing architectures for time series classification efficiently, using a regularization technique for ConvNet that enables joint training of network weights and architecture through back-propagation.
    • (7:40) Louis provided a brief overview of his publication “Transfer Learning for Speech Recognition on a Budget,” — which explores Automatic Speech Recognition training by model adaptation under constrained GPU memory, throughput, and training data.
    • (10:31) Louis described his one-year Master of Research degree in Computational Statistics and Machine Learning at the University College London supervised by David Barber.
    • (12:13) Louis unpacked his paper “Modular Networks: Learning to Decompose Neural Computation,” published at NeurIPS 2018 — which proposes a training algorithm that flexibly chooses neural modules based on the processed data.
    • (15:13) Louis briefly reviewed his technical report, “Scaling Neural Networks Through Sparsity,” which discusses near-term and long-term solutions to handle sparsity between neural layers.
    • (18:30) Louis mentioned his report, “Characteristics of Machine Learning Research with Impact,” which explores questions such as how to measure research impact and what questions the machine learning community should focus on to maximize impact.
    • (21:16) Louis explained his report, “Contemporary Challenges in Artificial Intelligence,” which covers lifelong learning, scalability, generalization, self-referential algorithms, and benchmarks.
    • (23:16) Louis talked about his motivation to start a blog and discussed his two-part blog series on intelligence theories (part 1 on universal AI and part 2 on active inference).
    • (27:46) Louis described his decision to pursue a Ph.D. at the Swiss AI Lab IDSIA in Lugano, Switzerland, where he has been working on Meta Reinforcement Learning agents with Jürgen Schmidhuber.
    • (30:06) Louis created a very extensive map of reinforcement learning in 2019 that outlines the goal, methods, and challenges associated with the RL domain.
    • (33:50) Louis unpacked his blog post reflecting on his experience at NeurIPS 2018 and providing updates on the AGI roadmap regarding topics such as scalability, continual learning, meta-learning, and benchmarks.
    • (37:04) Louis dissected his ICLR 2020 paper “Improving Generalization in Meta Reinforcement Learning using Learned Objectives,” which introduces a novel algorithm called MetaGenRL, inspired by biological evolution.
    • (44:03) Louis elaborated on his publication “Meta-Learning Backpropagation And Improving It,” which introduces the Variable Shared Meta-Learning framework that unifies existing meta-learning approaches and demonstrates that simple weight-sharing and sparsity in a network are sufficient to express powerful learning algorithms.
    • (51:14) Louis expands on his idea to bootstrap AI that entails how the task, the general meta learner, and the unsupervised objective should interact (proposed at the end of his invited talk at NeurIPS 2020).
    • (54:14) Louis shared his advice for individuals who want to make a dent in AI research.
    • (56:05) Louis shared his three most useful productivity tips.
    • (58:36) Closing segment.
    Louis’s Contact Info
    • Website
    • Twitter
    • LinkedIn
    • Google Scholar
    • GitHub
    Mentioned Content

    Papers and Reports

    • Differentiable Convolutional Neural Network Architectures for Time Series Classification (2017)
    • Transfer Learning for Speech Recognition on a Budget (2017)
    • Modular Networks: Learning to Decompose Neural Computation (2018)
    • Contemporary Challenges in Artificial Intelligence (2018)
    • Characteristics of Machine Learning Research with Impact (2018)
    • Scaling Neural Networks Through Sparsity (2018)
    • Improving Generalization in Meta Reinforcement Learning using Learned Objectives (2019)
    • Meta-Learning Backpropagation And Improving It (2020)

    Blog Posts

    • Theories of Intelligence — Part 1 and Part 2 (July 2018)
    • Modular Networks: Learning to Decompose Neural Computation (May 2018)
    • How to Make Your ML Research More Impactful (Dec 2018)
    • A Map of Reinforcement Learning (Jan 2019)
    • NeurIPS 2018, Updates on the AI Roadmap (Jan 2019)
    • MetaGenRL: Improving Generalization in Meta Reinforcement Learning (Oct 2019)
    • General Meta-Learning and Variable Sharing (Nov 2020)

    People

    • Jeff Clune (for his push on meta-learning research)
    • Kenneth Stanley (for his deep thoughts on open-ended learning)
    • Jürgen Schmidhuber (for being a visionary scientist)

    Book

    • “Grit” (by Angela Duckworth)


    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    1 hr 2 min
  • Episode 60: Algorithms and Data Structures for Massive Datasets with Dzejla Medjedovic
    Show Notes
    • (01:58) Dzejla described her undergraduate experience studying Computer Science at the Sarajevo School of Science and Technology back in the mid-2000s.
    • (07:59) Dzejla recapped her overall experience getting a Ph.D. in Computer Science at Stony Brook University.
    • (14:38) Dzejla unpacked the key research problem in her Ph.D. thesis titled “Upper and Lower Bounds on Sorting and Searching in External Memory.”
    • (19:13) Dzejla went over the details of her paper “Don’t Thrash: How to Cache Your Hash on Flash,” — which describes the Cascade Filter, an approximate-membership-query data structure that scales beyond main memory, that is an alternative to the well-known Bloom-filter data structure.
    • (24:41) Dzejla elaborated on her work “The batched predecessor problem in external memory,” — which studies the lower bounds in three external memory models: the I/O comparison model, the I/O pointer-machine model, and the index-ability model.
    • (29:56) Dzejla shared her learnings from being a Teaching Assistant for the Introduction to Algorithms course at Stony Brook (both at the undergraduate and graduate level).
    • (35:08) Dzejla went over her summer internships at Microsoft’s Server and Tools Division during her Ph.D.
    • (41:06) Dzejla reasoned about her decision to return to Sarajevo School of Science and Technology as an Assistant Professor of Computer Science.
    • (47:22) Dzejla dissected the essential concepts and methods covered in her Data Structures, Introductory Algorithms, Advanced Algorithms, and Algorithms for Big Data courses taught at SSIT.
    • (48:42) Dzejla provided a brief overview of the Computer Science/Software Engineering department at the International University of Sarajevo (where she has been a professor since 2017.
    • (50:57) Dzejla briefly talked about the courses that she taught at IUS, including Intro to Programming, Human-Computer Interaction, and Algorithms/Data Structures.
    • (52:49) Dzejla shared the challenges of writing Algorithms and Data Structures for Massive Datasets, which introduces data processing and analytics techniques specifically designed for large distributed datasets.
    • (56:14) Dzejla explained concepts in Part 1 of the book — including Hash Tables, Approximate Membership, Bloom Filters, Frequency/Cardinality Estimation, Count-Min Sketch, and Hyperloglog.
    • (58:38) Dzejla provided a brief overview of techniques to handle streaming data in Part 2 of the book.
    • (01:00:14) Dzejla mentioned the data structures for large databases and external-memory algorithms in Part 3 of the book.
    • (01:02:15) Dzejla shared her thoughts about the tech community in Sarajevo.
    • (01:04:16) Closing segment.
    Dzejla’s Contact Info
    • LinkedIn
    • Twitter
    • Google Scholar
    Mentioned Content

    Papers

    • “Upper and Lower Bounds on Sorting and Searching in External Memory” (Dzejla’s Ph.D. Thesis, 2014)
    • “Don’t Thrash: How to Cache Your Hash on Flash” (2012)
    • “The batched predecessor problem in external memory” (2014)

    People

    • Erik Demaine (Computer Science Professor at MIT)
    • Michael Bender (Computer Science Professor at Stony Brook, Dzejla’s Ph.D. Advisor)
    • Joseph Mitchell (Computational Geometry Professor at Stony Brook)
    • Steven Skiena (Computer Science Professor at Stony Brook)
    • Jeff Erickson (Computer Science Professor at UIUC)

    Books

    • “Algorithms and Data Structures for Massive Datasets” (by Dzejla Medjedovic, Emin Tahirovic, and Ines Dedovic)
    • “The Algorithm Design Manual” (by Steven Skiena)

    Here is a permanent 40% discount code (good for all Manning products in all formats) for Datacast listeners: poddcast19. Link at http://mng.bz/4MAR.

    Here is one free eBook code good for a copy of Algorithms and Data Structures for Massive Datasets for a lucky listener: algdcsr-7135. Link at http://mng.bz/Q2y6



    This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit datacast.substack.com/subscribe
    1 hr 12 min

About Datacast

From the publisher's feed

Datacast follows the narrative journey of data practitioners and researchers to unpack the career lessons they learned along the way. James Le hosts the show.