Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2024-12-23T08:20:26.815Z Has data issue: false hasContentIssue false

Compressibility and the Reality of Patterns

Published online by Cambridge University Press:  01 January 2022

Abstract

Daniel Dennett distinguishes real patterns from bogus patterns by appeal to compressibility. As information theorists have shown, data are compressible if and only if those data exhibit a pattern. Noting that high-level models are much simpler than their low-level counterparts, Dennett interprets high-level models as compressed representations of the fine-grained behavior of their target system. As such, he argues that high-level models depend on patterns in this behavior. Unfortunately, data scientific practice complicates Dennett’s interpretation, undermining the traditional justification for real patterns and suggesting a revised research program for its defenders.

Type
Research Article
Copyright
Copyright © The Philosophy of Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

I am indebted to Shaun Nichols, Daniel Dennett, Terry Horgan, Brandon Ashby, Caroline King, Rhys Borchert, and Amanda Romaine for their comments, conversation, and encouragement on this article. Any remaining errors or omissions are entirely my own.

References

Alpaydin, E. 2017. Introduction to Machine Learning. Cambridge, MA: MIT Press.Google Scholar
Arpit, D., et al. 2017. “A Closer Look at Memorization in Deep Networks.” Proceedings of the 34th ICML 70:233–42.Google Scholar
Belhumeur, P. N., Hespanha, J. P., and Kriegman, D. J.. 1997. “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection.” IEEE Transactions on Pattern Analysis and Machine Intelligence 7:711–20.Google Scholar
Burnston, D. 2017. “Real Patterns in Biological Explanation.” Philosophy of Science 84 (5): 879–91..CrossRefGoogle Scholar
Dennett, D. C. 1991. “Real Patterns.” Journal of Philosophy 88 (1): 2751..CrossRefGoogle Scholar
Fodor, J. A. 1974. “Special Sciences; or, The Disunity of Science as a Working Hypothesis.” Synthese 28 (2): 97115..CrossRefGoogle Scholar
Fodor, J. A.. 1997. “Special Sciences: Still Autonomous after All These Years.” Philosophical Perspectives 11:149–63.Google Scholar
Goldberg, L. R. 1992. “The Development of Markers for the Big-Five Factor Structure.” Psychological Assessment 4:2642.CrossRefGoogle Scholar
Goodfellow, I., Bengio, Y., and Courville, A.. 2016. Deep Learning. Cambridge, MA: MIT Press.Google Scholar
Kolmogorov, A. N. 1963. “On Tables of Random Numbers.” Sankhyä A 25 (4): 369–76..Google Scholar
Krause, J., Stark, M., Deng, J., and Fie-Fie, L.. 2013. “3D Object Representations for Fine-Grained Categorization.” 4th IEEE Workshop on 3D Representation and Recognition at ICCV 2013.CrossRefGoogle Scholar
Ladyman, J., and Ross, D.. 2007. Every Thing Must Go: Metaphysics Naturalized. Oxford: Oxford University Press.CrossRefGoogle Scholar
Ladyman, J., and Ross, D.. 2013. “The World in Data.” In Scientific Metaphysics, ed. Ross, D., Ladyman, J., and Kincaid, H.. Oxford: Oxford University Press.Google Scholar
Liu, Z., Luo, P., Wang, X., and Tang, X.. 2015. “Deep Learning Face Attributes in the Wild.” In Proceedings of the IEEE International Conference on Computer Vision, 3730–38. Piscataway, NJ: IEEE.Google Scholar
Loewer, B. 2009. “Why Is There Anything Except Physics?Synthese 170 (2): 217–33..CrossRefGoogle Scholar
Rathmanner, S., and Hutter, M.. 2011. “A Philosophical Treatise of Universal Induction.” Entropy 13 (6): 1076–136..CrossRefGoogle Scholar
Rammstedt, B., and John, O. P.. 2007. “Measuring Personality in One Minute or Less: A 10-Item Short Version of the Big Five Inventory in English and German.” Journal of Research in Personality 41 (1): 203–12..CrossRefGoogle Scholar
Ross, D. 1995. “Real Patterns and the Ontological Foundations of Microeconomics.” Economics and Philosophy 11 (1): 113–36..CrossRefGoogle Scholar
Ross, D., and Spurrett, D.. 2004. “What to Say to a Skeptical Metaphysician: A Defense Manual for Cognitive and Behavioral Scientists.” Behavioral and Brain Sciences 27:603–64.CrossRefGoogle ScholarPubMed
Sayood, K. 2018. Introduction to Data Compression. Cambridge, MA: Kaufmann.Google Scholar
Shannon, C. 1948. “A Mathematical Theory of Communication.” Bell System Technical Journal 27:379423.CrossRefGoogle Scholar
Turk, M., and Pentland, A.. 1991. “Eigenfaces for Recognition.” Journal of Cognitive Neuroscience 3 (1): 7186..CrossRefGoogle ScholarPubMed
Wallace, C. 2005. Statistical and Inductive Inference by Minimum Message Length. New York: Springer.Google Scholar
Wallace, D. 2012. The Emergent Multiverse. Oxford: Oxford University Press.CrossRefGoogle Scholar
Zhang, W., Sun, J., and Tang, X.. 2008. “Cat Head Detection: How to Effectively Exploit Shape and Texture Features.” Proceedings of the European Conference on Computer Vision 4:802–16.Google Scholar