Vanishing Gradients

Episode 3: Language Tech For All


Listen Later

Rachael Tatman is a senior developer advocate for Rasa, where she’s helping developers build and deploy ML chatbots using their open source framework.
Rachael has a PhD in Linguistics from the University of Washington where her research was on computational sociolinguistics, or how our social identity affects the way we use language in computational contexts. Previously she was a data scientist at Kaggle and she’s still a Kaggle Grandmaster.
In this conversation, Rachael and I talk about the history of NLP and conversational AI//chatbots and we dive into the fascinating tension between rule-based techniques and ML and deep learning – we also talk about how to incorporate machine and human intelligence together by thinking through questions such as “should a response to a human ever be automated?” Spoiler alert: the answer is a resounding NO WAY!
In this journey, something that becomes apparent is that many of the trends, concepts, questions, and answers, although framed for NLP and chatbots, are applicable to much of data science, more generally.
We also discuss the data scientist’s responsibility to end-users and stakeholders using, among other things, the lens of considering those whose data you’re working with to be data donors.
We then consider what globalized language technology looks like and can look like, what we can learn from the history of science here, particularly given that so much training data and models are in English when it accounts for so little of language spoken globally.
Links
Rachael's website (https://www.rctatman.com/)
Rasa (https://rasa.com/)
Speech and Language Processing (https://web.stanford.edu/~jurafsky/slp3/)
by Dan Jurafsky and James H. Martin
Masakhane (https://twitter.com/MasakhaneNLP), putting African languages on the #NLP map since 2019
The Distributed AI Research Institute (https://www.dair-institute.org/), a space for independent, community-rooted AI research, free from Big Tech’s pervasive influence
The Algorithmic Justice League (https://www.ajl.org/), unmasking AI harms and biases
Black in AI (https://blackinai.github.io/#/), increasing the presence and inclusion of Black people in the field of AI by creating space for sharing ideas, fostering collaborations, mentorship and advocacy
Hugo's blog post on his new job and why it's exciting for him to double down on helping scientists do better science (https://outerbounds.com/blog/hba-excited-to-join-metaflow-and-outerbounds/)

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit hugobowne.substack.com
...more
View all episodesView all episodes
Download on the App Store

Vanishing GradientsBy Hugo Bowne-Anderson

  • 5
  • 5
  • 5
  • 5
  • 5

5

11 ratings


More shows like Vanishing Gradients

View all
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

537 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,330 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,089 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

Founders by David Senra

Founders

2,170 Listeners

The Prof G Pod with Scott Galloway by Vox Media Podcast Network

The Prof G Pod with Scott Galloway

5,554 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

511 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

131 Listeners

AI + a16z by a16z

AI + a16z

35 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,427 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

21 Listeners

Training Data by Sequoia Capital

Training Data

40 Listeners

High Signal: Data Science | Career | AI by Delphina

High Signal: Data Science | Career | AI

19 Listeners

Cheeky Pint by Stripe

Cheeky Pint

47 Listeners