Weaviate Podcast

Neurosymbolic AI in Search with Professor Laura Dietz - Weaviate Podcast #49!


Listen Later

Hey everyone, thank you so much for watching the 49th episode of the Weaviate Podcast!! This podcast features Professor Laura Dietz from the University of New Hampshire! I came across Dr. Dietz's tutorial at ECIR on Neuro-Symbolic Approaches for Information Retrieval and am so grateful that she was interested in joining the Weaviate Podcast! I learned so much about Neurosymbolic Search, especially around the role of Entity Linking and Entity Re-Ranking -- as well as the topic of Knowledge Graphs and Vector Search. We also discussed Prof. Dietz and collaborators latest perspectives paper on Large Language Models for Relevance Judgment. TLDR this describes the idea of using LLMs to either generate synthetic queries for documents or say annotate the relevance for query, document pairs. We discussed this kind of idea with Leo Boytsov and his work on InPars, and have presented Promptagator on past episodes of the Weaviate Air show. Although this idea comes with a lot of potential, Dr. Dietz explains the potentials for bias and poor judgements, as well as generally diving more into the details of this kind of idea! I really hope you enjoy the podcast, we are more than happy to answer any questions you might have about these ideas, or discuss any of your ideas! Thanks so much for watching!

Check out Laura Dietz's Publications here: https://scholar.google.com/citations?user=IIXpJ8oAAAAJ&hl=en&oi=ao
ECIR 23 Tutorial: Neuro-Symbolic Approaches
for Information Retrieval: https://www.cs.unh.edu/~dietz/appendix/dietz2023neurosymbolic.pdf
Please check this paper out below, I think this is a severely underrated work in the Search / Information Retrieval community:
Perspectives on Large Language Models for Relevance Judgment: https://arxiv.org/pdf/2304.09161.pdf
Chapters
0:00 Introduction
0:15 Neurosymbolic Search
4:50 Entity Parsing and Vector Semantics
10:56 Query Intent Understanding
15:35 Knowledge Graphs and Vector Search
17:37 Symbolic Re-Ranking
22:10 ColBERT and Entity Ranking
26:25 Example - South America and Zika Virus IR
29:15 Knowledge Graph Query Languages with LLMs
35:10 We need more Knowledge Graphs!!
37:30 PrimeKG from Harvard BMI
39:40 Filtered Vector Search
42:20 LLM Entity Linking - “The” example
47:30 Cross Encoder Entity Focus?
48:25 Perspectives on LLMs for Relevance Judgments
55:28 Spectrum of Human-Machine Collaboration for Labeling
57:30 Use LLM to Create Relevance Labeling Interfaces
1:02:30 Importance for Weaviate
1:03:45 12 Authors’ 3 Conclusions
1:04:40 IR Research Community Challenge
1:06:55 Query Generation for Weaviate Users
1:13:05 Clustering Queries
1:17:30 Final Thoughts

...more
View all episodesView all episodes
Download on the App Store

Weaviate PodcastBy Weaviate

  • 4
  • 4
  • 4
  • 4
  • 4

4

4 ratings


More shows like Weaviate Podcast

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,270 Listeners

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

31,896 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

507 Listeners

Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,363 Listeners

Lage der Nation - der Politik-Podcast aus Berlin by Philip Banse & Ulf Buermeyer

Lage der Nation - der Politik-Podcast aus Berlin

244 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

440 Listeners

The Daily by The New York Times

The Daily

111,077 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

207 Listeners

Practical AI by Practical AI LLC

Practical AI

188 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

8,756 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

129 Listeners

Unsupervised Learning by by Redpoint Ventures

Unsupervised Learning

39 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

72 Listeners

Interconnects by Nathan Lambert

Interconnects

10 Listeners

AI + a16z by a16z

AI + a16z

33 Listeners