LessWrong (30+ Karma)

“When Are Results from Computational Complexity Not Too Coarse?” by Dalcy


Listen Later

Tl;dr, While an algorithm's computational complexity may be exponential in general (worst-case), it is often possible to stratify its input via some dimension _k_ that makes it polynomial for a fixed _k_, and only exponential in _k_. Conceptually, this quantity captures the core aspect of a problem's structure that makes specific instances of it 'harder' than others, often with intuitive interpretations.

Example: Bayesian Inference and Treewidth

One can easily prove exact inference (decision problem of: "is _P(X)>0_?") is NP-hard by encoding SAT-3 as a Bayes Net. Showing that it's NP is easy too.

Given a 3-SAT instance _phi_ over _Q_1, dots Q_n_, one can cleverly encode it as a Bayes Net _B_{phi}_ such that _P_{B_{phi}}(X=x^1) > 0_ if and only if _phi_ is satisfiable (From Koller & Friedman 2009).

Therefore, inference is NP-complete, implying that algorithms are worst-case exponential. But this can't be the typical case! Let's examine the example of a Bayes Net whose structure is a chain [...]

---

Outline:

(00:32) Example: Bayesian Inference and Treewidth

(04:13) General Lesson

The original text contained 4 footnotes which were omitted from this narration.

---

First published:

July 3rd, 2024

Source:

https://www.lesswrong.com/posts/Ja9NP3NJpEd7BXMnW/when-are-results-from-computational-complexity-not-too

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

112,842 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

130 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,215 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

531 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,221 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates by Liron Shapira

Doom Debates

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners