Abstract
Bayesian Knowledge Bases (BKB) are a rule-based probabilistic model that extends the well-known Bayes Networks (BN), by naturally allowing for context-specific independence and for cycles in the directed graph. We present a semantics for BKBs that facilitate handling of marginal probabilities, as well as finding most probable explanations.
Complexity of reasoning with BKBs is NP hard, as for Bayes networks, but in addition, deciding consistency is also NP-hard. In special cases that problem does not occur. Computation of marginal probabilities in BKBs is another hard problem, hence approximation algorithms are necessary – stochastic sampling being a commonly used scheme. Good performance requires importance sampling, a method that works for BKBs with cycles is developed.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
F. Bacchus, Representing and Reasoning with Probabilistic Knowledge: A Logical Approach to Probabilities (MIT Press, 1990).
C. Boutilier, N. Friedman, M. Goldszmidt and D. Koller, Context-specific independence in Bayesian networks, in: Uncertainty in Artificial Intelligence, Proceedings of the 12th Conference (Morgan Kaufmann, August 1996) pp. 115–123.
G.F. Cooper, The computational complexity of probabilistic inference using Bayesian belief networks, Artificial Intelligence 44 (1990) 393–405.
P. Dagum and M. Luby, Approximating probabilistic inference in Bayesian belief networks is NP-hard, Artificial Intelligence 60(1) (March 1993) 141–153.
A.P. Dempster, A generalization of Bayesian inference, Journal of the Royal Statistical Society 30 (1968) 205–247.
C. Domshlak, D. Gershkovich, E. Gudes, N. Liusternik, A. Meisels, T. Rosen and S.E. Shimony, FlexiMine-a flexible platform for KDD research and application construction, in: KDD-98, Proceedings of the Fourth International Conference on Knowledge Discovery in Databases (1998) pp. 184–188.
W.F. Dowling and J.H. Gallier, Linear-time algorithms for testing the satisfiability of propositional Horn formulae, Journal of Logic Programming 3 (1984) 267–284.
D. Heckerman, Probabilistic Similarity Networks (MIT Press, 1991).
M. Henrion, Propagating uncertainty in Bayesian networks by probabilistic logic sampling, in: Proceedings Uncertainty in Artificial Intelligence 4 (1988) pp. 149–163.
G. Johnson, Jr. and E. Santos, Jr., Generalizing knowledge representation rules for acquiring and validating uncertain knowledge, in: Proceedings of the 13th International Florida Artificial Intelligence Research Society Conference (May 2000) pp. 186–190.
N.J. Nilsson, Probabilistic logic, Artificial Intelligence 28 (1986) 71–87.
J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference (Morgan Kaufmann, San Mateo, CA, 1988).
D. Poole, Probabilistic Horn abduction and Bayesian networks, Artificial Intelligence 64(1) (1993) 81–129.
T. Rosen and S.E. Shimony, BKBs-semantics, characteristics, and inference, Technical Report FC-99-07, Ben-Gurion University (1999).
E. Santos, Jr. and E.S. Santos, A framework for building knowledge-bases under uncertainty, Journal of Experimental and Theoretical Artificial Intelligence 11 (1999) 265–286.
E.S. Santos and E.Santos, Jr., Reasoning with uncertainty in a knowledge-based system, in: Proceedings of the International Symposium on Multiple-Valued Logic (1987) pp. 75–81.
E. Santos Jr., A linear constraint satisfaction approach to cost-based abduction, Artificial Intelligence 65(1) (1994) 1–27.
G.A. Shafer, Mathematical Theory of Evidence (Princeton University Press, 1979).
S.E. Shimony, The role of relevance in explanation I: Irrelevance as statistical independence, International Journal of Approximate Reasoning 8(4) (June 1993) 281–324.
S.E. Shimony, Finding MAPs for belief networks is NP-hard, Artificial Intelligence 68(2) (August 1994) 399–410.
S.E. Shimony, The role of relevance in explanation II: Disjunctive assignments and approximate independence, International Journal of Approximate Reasoning 13(1) (July 1995) 27–60.
S.E. Shimony, E. Santos, Jr. and T. Rosen, Independence semantics for BKBs, in: Proceedings of the 13th International Florida Artificial Intelligence Research Society Conference (May 2000) pp. 308–312.
E.H. Shortliffe and B.G. Buchanan, A model of inexact reasoning in medicine, Mathematical Biosciences 23 (1975) 351–379.
P. Spirtes, C. Glymour and R. Scheines, Causation, Prediction, and Search (Springer, 1993).
P. Thagard, Explanatory coherence, Behavioral and Brain Sciences 12 (1989) 435–502.
L.A. Zadeh, The role of fuzzy logic in the management of uncertainty in expert systems, Fuzzy Sets and Systems 11 (1983) 199–227.
N.L. Zhang and D. Poole, Intercausal independence and heterogeneous factorization, in: Uncertainty in AI, Proceedings of the Tenth Conference (July 1994) pp. 606–614.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Rosen, T., Shimony, S.E. & Santos, E. Reasoning with BKBs – Algorithms and Complexity. Annals of Mathematics and Artificial Intelligence 40, 403–425 (2004). https://doi.org/10.1023/B:AMAI.0000012874.65239.b0
Issue Date:
DOI: https://doi.org/10.1023/B:AMAI.0000012874.65239.b0