Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-xbtfd Total loading time: 0 Render date: 2024-11-17T19:12:51.021Z Has data issue: false hasContentIssue false

11 - A Bayesian Approach to Learning Causal Networks

Published online by Cambridge University Press:  05 June 2012

David Heckerman
Affiliation:
Machine Learning and Applied Statistics Group, Microsoft Research
Ralph F. Miles Jr.
Affiliation:
California Institute of Technology
Detlof von Winterfeldt
Affiliation:
University of Southern California
Get access

Summary

ABSTRACT. Bayesian methods have been developed for learning Bayesian networks from data. Most of this work has concentrated on Bayesian networks interpreted as a representation of probabilistic conditional independence without considering causation. Other researchers have shown that having a causal interpretation can be important because it allows us to predict the effects of interventions in a domain. In this chapter, we extend Bayesian methods for learning acausal Bayesian networks to causal Bayesian networks.

There has been a great deal of recent interest in Bayesian methods for learning Bayesian networks from data (Spiegelhalter and Lauritzen 1990; Cooper and Herskovits 1991, 1992; Buntine 1991, 1994; Spiegelhalter, Dawid, Lauritzen and Cowell 1993; Madigan and Raftery 1994; Heckerman et al. 1994, 1995). These methods take prior knowledge of a domain and statistical data and construct one or more Bayesian-network models of the domain. Most of this work has concentrated on Bayesian networks interpreted as a representation of probabilistic conditional independence. Nonetheless, several researchers have proposed a causal interpretation for Bayesian networks (Pearl and Verma 1991; Spirtes, Glymour, and Scheines 1993; Heckerman and Shachter 1995). These researchers show that having a causal interpretation can be important because it allows us to predict the effects of interventions in a domain – something that cannot be done without a causal interpretation.

In this paper, we extend Bayesian methods for learning acausal Bayesian networks to causal Bayesian-networks learning.

Type
Chapter
Information
Advances in Decision Analysis
From Foundations to Applications
, pp. 202 - 220
Publisher: Cambridge University Press
Print publication year: 2007

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aliferis, C., and Cooper, G. (1994). An evaluation of an algorithm for inductive learning of Bayesian belief networks using simulated data sets. In Proceedings of Tenth Conference on Uncertainty in Artificial Intelligence. Seattle, WA: Morgan Kaufmann, 8–14.Google Scholar
Buntine, W. (1991). Theory refinement on Bayesian networks. In Proceedings of Seventh Conference on Uncertainty in Artificial Intelligence. Los Angeles, CA: Morgan Kaufmann, 52–60.Google Scholar
Buntine, W. (1994). Operations for learning with graphical models. Journal of Artificial Intelligence Research, 2, 159–225.Google Scholar
Cooper, G., and Herskovits, E. (1991). A Bayesian method for the induction of probabilistic networks from data. Technical Report SMI-91–1. Section on Medical Informatics, Stanford University.Google Scholar
Cooper, G., and Herskovits, E. (1992). A Bayesian method for the induction of probabilistic networks from data. Machine Learning, 9, 309–347.CrossRefGoogle Scholar
Cowell, R., Dawid, A., and Sebastiani, P. (1995). A comparison of sequential learning methods for incomplete data. Technical Report 135, Department of Statistical Science, University College London.Google Scholar
Dempster, A., Laird, N., and Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, B39, 1–38.Google Scholar
Heckerman, D., Geiger, D., and Chickering, D. (1994). Learning Bayesian networks: The combination of knowledge and statistical data. In Proceedings of Tenth Conference on Uncertainty in Artificial Intelligence. Seattle, WA: Morgan Kaufmann, 293–301.Google Scholar
Heckerman, D., Geiger, D., and Chickering, D. (1995). Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning, 20, 197–243.CrossRefGoogle Scholar
Heckerman, D., and Shachter, R. (1995). Decision-Theoretic Foundations for Causal Reasoning. Journal of Artificial Intelligence Research, 3, 405–430.Google Scholar
Holland, P. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81, 945–968.CrossRefGoogle Scholar
Howard, R., and Matheson, J. (1981). Influence diagrams. In Howard, R., and Matheson, J. (Eds.), Readings on the Principles and Applications of Decision Analysis, Vol. II. Menlo Park, CA: Strategic Decisions Group, 721–762.Google Scholar
Howard, R. (1990). From influence to relevance to knowledge. In Oliver, R. M. and Smith, J. Q. (Eds.), Influence Diagrams, Belief Nets, and Decision Analysis. New York: Wiley and Sons, 3–23.Google Scholar
Madigan, D., and Raftery, A. (1994). Model selection and accounting for model uncertainty in graphical models using Occam's window. Journal of the American Statistical Association, 89, 1535–1546.CrossRefGoogle Scholar
Matheson. J. (1990). Using influence diagrams to value information and control. In Oliver, R. M. and Smith, J. Q. (Eds.), Influence Diagrams, Belief Nets, and Decision Analysis. New York: Wiley and Sons, 25–48.Google Scholar
Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann.Google Scholar
Pearl, J. (1995). Causal diagrams for empirical research. Biometrika, 82, 669–710.CrossRefGoogle Scholar
Pearl, J., and Verma, T. (1991). A theory of inferred causation. In Allen, J., Fikes, R., and Sandewall, E., (Eds.), Knowledge Representation and Reasoning: Proceedings of the Second International Conference. New York: Morgan Kaufmann, 441–452.Google Scholar
Rubin, D. (1978). Bayesian inference for causal effects: The role of randomization. Annals of Statistics, 6, 34–58.CrossRefGoogle Scholar
Shachter, R. (1986). Evaluating influence diagrams. Operations Research, 34, 871–882.CrossRefGoogle Scholar
Spiegelhalter, D., Dawid, A., Lauritzen, S., and Cowell, R. (1993). Bayesian analysis in expert systems. Statistical Science, 8, 219–282.CrossRefGoogle Scholar
Spiegelhalter, D., and Lauritzen, S. (1990). Sequential updating of conditional probabilities on directed graphical structures. Networks, 20, 579–605.CrossRefGoogle Scholar
Spirtes, P., Glymour, C., and Scheines, R. (1993). Causation, Prediction, and Search. New York: Springer-Verlag.CrossRefGoogle Scholar
Titterington, D. (1976). Updating a diagnostic system using unconfirmed cases. Applied Statistics, 25, 238–247.CrossRefGoogle Scholar
Verma, T., and Pearl, J. (1990). Equivalence and synthesis of causal models. In Proceedings of Sixth Conference on Uncertainty in Artificial Intelligence. Boston, MA: Morgan Kaufmann, 220–227.Google Scholar
York, J. (1992). Bayesian methods for the analysis of misclassified or incomplete multivariate discrete data. Ph.D. thesis, Department of Statistics, University of Washington, Seattle.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×