
Sign up to save your podcasts
Or
Tl;dr, While an algorithm's computational complexity may be exponential in general (worst-case), it is often possible to stratify its input via some dimension _k_ that makes it polynomial for a fixed _k_, and only exponential in _k_. Conceptually, this quantity captures the core aspect of a problem's structure that makes specific instances of it 'harder' than others, often with intuitive interpretations.
Example: Bayesian Inference and Treewidth
One can easily prove exact inference (decision problem of: "is _P(X)>0_?") is NP-hard by encoding SAT-3 as a Bayes Net. Showing that it's NP is easy too.
Given a 3-SAT instance _phi_ over _Q_1, dots Q_n_, one can cleverly encode it as a Bayes Net _B_{phi}_ such that _P_{B_{phi}}(X=x^1) > 0_ if and only if _phi_ is satisfiable (From Koller & Friedman 2009).Therefore, inference is NP-complete, implying that algorithms are worst-case exponential. But this can't be the typical case! Let's examine the example of a Bayes Net whose structure is a chain [...]
---
Outline:
(00:32) Example: Bayesian Inference and Treewidth
(04:13) General Lesson
The original text contained 4 footnotes which were omitted from this narration.
---
First published:
Source:
Narrated by TYPE III AUDIO.
Tl;dr, While an algorithm's computational complexity may be exponential in general (worst-case), it is often possible to stratify its input via some dimension _k_ that makes it polynomial for a fixed _k_, and only exponential in _k_. Conceptually, this quantity captures the core aspect of a problem's structure that makes specific instances of it 'harder' than others, often with intuitive interpretations.
Example: Bayesian Inference and Treewidth
One can easily prove exact inference (decision problem of: "is _P(X)>0_?") is NP-hard by encoding SAT-3 as a Bayes Net. Showing that it's NP is easy too.
Given a 3-SAT instance _phi_ over _Q_1, dots Q_n_, one can cleverly encode it as a Bayes Net _B_{phi}_ such that _P_{B_{phi}}(X=x^1) > 0_ if and only if _phi_ is satisfiable (From Koller & Friedman 2009).Therefore, inference is NP-complete, implying that algorithms are worst-case exponential. But this can't be the typical case! Let's examine the example of a Bayes Net whose structure is a chain [...]
---
Outline:
(00:32) Example: Bayesian Inference and Treewidth
(04:13) General Lesson
The original text contained 4 footnotes which were omitted from this narration.
---
First published:
Source:
Narrated by TYPE III AUDIO.
26,434 Listeners
2,388 Listeners
7,906 Listeners
4,133 Listeners
87 Listeners
1,462 Listeners
9,095 Listeners
87 Listeners
389 Listeners
5,429 Listeners
15,174 Listeners
474 Listeners
121 Listeners
75 Listeners
459 Listeners