
Sign up to save your podcasts
Or


Tl;dr, While an algorithm's computational complexity may be exponential in general (worst-case), it is often possible to stratify its input via some dimension _k_ that makes it polynomial for a fixed _k_, and only exponential in _k_. Conceptually, this quantity captures the core aspect of a problem's structure that makes specific instances of it 'harder' than others, often with intuitive interpretations.
Example: Bayesian Inference and Treewidth
One can easily prove exact inference (decision problem of: "is _P(X)>0_?") is NP-hard by encoding SAT-3 as a Bayes Net. Showing that it's NP is easy too.
Given a 3-SAT instance _phi_ over _Q_1, dots Q_n_, one can cleverly encode it as a Bayes Net _B_{phi}_ such that _P_{B_{phi}}(X=x^1) > 0_ if and only if _phi_ is satisfiable (From Koller & Friedman 2009).Therefore, inference is NP-complete, implying that algorithms are worst-case exponential. But this can't be the typical case! Let's examine the example of a Bayes Net whose structure is a chain [...]
---
Outline:
(00:32) Example: Bayesian Inference and Treewidth
(04:13) General Lesson
The original text contained 4 footnotes which were omitted from this narration.
---
First published:
Source:
Narrated by TYPE III AUDIO.
By LessWrongTl;dr, While an algorithm's computational complexity may be exponential in general (worst-case), it is often possible to stratify its input via some dimension _k_ that makes it polynomial for a fixed _k_, and only exponential in _k_. Conceptually, this quantity captures the core aspect of a problem's structure that makes specific instances of it 'harder' than others, often with intuitive interpretations.
Example: Bayesian Inference and Treewidth
One can easily prove exact inference (decision problem of: "is _P(X)>0_?") is NP-hard by encoding SAT-3 as a Bayes Net. Showing that it's NP is easy too.
Given a 3-SAT instance _phi_ over _Q_1, dots Q_n_, one can cleverly encode it as a Bayes Net _B_{phi}_ such that _P_{B_{phi}}(X=x^1) > 0_ if and only if _phi_ is satisfiable (From Koller & Friedman 2009).Therefore, inference is NP-complete, implying that algorithms are worst-case exponential. But this can't be the typical case! Let's examine the example of a Bayes Net whose structure is a chain [...]
---
Outline:
(00:32) Example: Bayesian Inference and Treewidth
(04:13) General Lesson
The original text contained 4 footnotes which were omitted from this narration.
---
First published:
Source:
Narrated by TYPE III AUDIO.

112,842 Listeners

130 Listeners

7,215 Listeners

531 Listeners

16,221 Listeners

4 Listeners

14 Listeners

2 Listeners