Exact Inference Algorithms for Probabilistic Reasoning;
250 likes | 272 Vues
This document explores exact inference algorithms for probabilistic reasoning, focusing on belief updating, finding most probable explanations (MPE), maximum a-posteriori hypothesis, and maximum-expected-utility (MEU) decision-making. It discusses the use of bucket elimination and the impact of ordering on complexity. The document also provides examples and explanations of induced width, moral graphs, and the impact of observations.
Exact Inference Algorithms for Probabilistic Reasoning;
E N D
Presentation Transcript
Exact Inference Algorithms for Probabilistic Reasoning; COMPSCI 276 Fall 2007
Probabilistic Inference Tasks • Belief updating: • Finding most probable explanation (MPE) • Finding maximum a-posteriory hypothesis • Finding maximum-expected-utility (MEU) decision
Example with a chain P(A|D=d)=? P(D)=? P(D|A=a)=? D A B C O(4k^2) instead of O(k^4), k is the domain size
Elimination operator bucket B: P(b|a) P(d|b,a) P(e|b,c) B bucket C: P(c|a) C bucket D: D bucket E: e=0 E bucket A: P(a) A P(a|e=0) W*=4 ”induced width” (max clique size) Bucket elimination Algorithm elim-bel (Dechter 1996)
B E C D D C E B A A
A B C D E “Moral” graph B E C D D C E B A A Complexity of elimination The effect of the ordering:
Finding small induced-width • NP-complete • A tree has induced-width of ? • Greedy algorithms: • Min width • Min induced-width • Max-cardinality • Fill-in (thought as the best) • See anytime min-width (Gogate and Dechter)
A B C D E “Moral” graph Theorem: elim-bel is exponential in the adjusted induced-width w*(e,d)