Hostname: page-component-7bb8b95d7b-wpx69 Total loading time: 0 Render date: 2024-10-07T01:04:55.831Z Has data issue: false hasContentIssue false

Ideography insight from facial recognition and neuroimaging

Published online by Cambridge University Press:  02 October 2023

Benjamin C. Nephew
Affiliation:
Department of Biology and Biotechnology, Worcester Polytechnic Institute, Worcester, MA, USA [email protected] [email protected]
Justin J. Polcari
Affiliation:
Department of Biology and Biotechnology, Worcester Polytechnic Institute, Worcester, MA, USA [email protected] [email protected]
Dmitry Korkin
Affiliation:
Department of Computer Science, Worcester Polytechnic Institute, Worcester, MA, USA [email protected]

Abstract

One novel example and/or perspective in support of “Why the learning account fails” is the impressive ability of humans to recognize and memorize facial features and accurately and reliably connect those to related identities. Furthermore, neuroimaging analysis presents an example in support of the crucial role of standardization in the lack of adoption of ideography.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press

One novel example and/or perspective in support of, “Why the learning account fails,” that the lack of viable ideographies is a learnability issue, is the impressive ability of humans to recognize and memorize facial features and accurately and reliably connect those to related identities. Faces are an aggregation of graphical features. Individuals are capable of learning and remembering hundreds of faces and facial expressions over decades and can identify extremely minor differences in facial features starting from a very young age (Nelson, Morse, & Leavitt, Reference Nelson, Morse and Leavitt1979). Human facial recognition is robust additional evidence that we are fully capable of processing and storing graphical features as well as phonemes. The challenge or failure of sophisticated artificial intelligence algorithms in correctly identifying faces compared to humans is a prime example of human ability in the graphical realm (Cavazos, Phillips, Castillo, & O'Toole, Reference Cavazos, Phillips, Castillo and O'Toole2021; Phillips et al., Reference Phillips, Yates, Hu, Hahn, Noyes, Jackson and O'Toole2018). This is not only an ability that humans are skilled at learning, it is also a highly evolved inherent skill crucial to maternal–infant bonding and successful early development. Brain regions critical for the identification of faces exhibit increased activity in new mothers compared to nulliparous women and these changes are closely linked to empathetic concern (Rigo et al., Reference Rigo, Kim, Esposito, Putnick, Venuti and Bornstein2019; Zhang et al., Reference Zhang, Rigo, Su, Wang, Chen, Esposito and Du2020). It is possible that the failure of some ideographies is because of a lack of emotional relevance, where an increased focus on emotional impact in the development of graphic codes will result in enhanced adoption.

Although most cognitive traits possess modest heritability, twin studies of facial recognition reveal a high-genetic contribution (Wilmer et al., Reference Wilmer, Germine, Chabris, Chatterjee, Williams, Loken and Duchaine2010). However, this ability does not strongly correlate with measures of visual and verbal recognition, leading to the conclusion that facial recognition is both specific and highly heritable, underscoring its importance to our survival as a mammalian species highly dependent on parental care and social interaction. Although this specificity of facial recognition could be seen as support for learnability-based theories of challenges to ideographies, it can also be interpreted as a lack of relevant and valid tools to reliably assess general visual recognition (Diaz-Orueta, Rogers, Blanco-Campal, & Burke, Reference Diaz-Orueta, Rogers, Blanco-Campal and Burke2022). Along these lines, perhaps what is needed for the development of effective ideographies is a focus on less abstract, more organic shapes and features commonly found in human faces. Given the findings from studies of mothers and the heritability of facial recognition, it could indeed be that emojis are the future of effective ideography.

Neuroimaging analysis presents an example in support of the crucial role of standardization in the lack of adoption of ideography. Functional neuroimaging involves the processing and interpretation of brain activity that is often depicted solely by graphical representation. Similar to facial recognition algorithms, neuroimaging analysis often involves numerous assumptions and compromises and the never-ending methods development in this field has led to overall inconsistency (Poldrack et al., Reference Poldrack, Baker, Durnez, Gorgolewski, Matthews, Munafò and Yarkoni2017). The lack of standardization in the analysis of neuroimaging data is widely acknowledged as a key reason for poor replication and repeatability in neuroimaging studies in the past (Kennedy et al., Reference Kennedy, Abraham, Bates, Crowley, Ghosh, Gillespie and Travers2019), similar to the weak agreement on the meaning of various emojis. Accordingly, recent efforts to broadly increase standardization in neuroimaging (Niso et al., Reference Niso, Botvinik-Nezer, Appelhoff, De La Vega, Esteban, Etzel and Rieger2022), functionally increasing agreement on the meaning of graphical images of brain activity, may substantially enhance replication across the field. At the individual level, the standardization in functional neuroimaging that is focused on changes in brain activity has accelerated the learning process within and across trainees, resulting in the increased adoption of what could be referred to as a very complex form of ideography.

An integral aspect of neuroimaging analysis is the discrimination of patterns of functional brain activity versus patterns indicative of statistical noise/variability because of various confounds such as electrical interference or subjects moving during scans. This can occur through two methods, one based on organic human learning and training, the other based on a form of artificial intelligence, deep learning. The identification and extraction of these confound-based patterns can be accomplished through the training of individuals and/or the use of an image recognition program. Similar to facial recognition, the best performance is often obtained through the use of both image recognition programs and subsequent human confirmatory inspection. However, variability in training and human performance has adverse effects on reproducibility and current efforts are focused on the application of deep learning to neuroimaging analysis (Abrol et al., Reference Abrol, Fu, Salman, Silva, Du, Plis and Calhoun2021). Perhaps we should consult ChatGPT on how best to design a self-sufficient graphic code?

Financial support

This research received no specific grant from any funding agency, commercial, or not-for-profit sectors.

Competing interest

None.

References

Abrol, A., Fu, Z., Salman, M., Silva, R., Du, Y., Plis, S., & Calhoun, V. (2021). Deep learning encodes robust discriminative neuroimaging representations to outperform standard machine learning. Nature Communications, 12(1), 353. doi:10.1038/s41467-020-20655-6CrossRefGoogle ScholarPubMed
Cavazos, J. G., Phillips, P. J., Castillo, C. D., & O'Toole, A. J. (2021). Accuracy comparison across face recognition algorithms: Where are we on measuring race bias? IEEE Transactions on Biometrics, Behavior, and Identity Science, 3(1), 101111. doi:10.1109/TBIOM.2020.3027269CrossRefGoogle ScholarPubMed
Diaz-Orueta, U., Rogers, B. M., Blanco-Campal, A., & Burke, T. (2022). The challenge of neuropsychological assessment of visual/visuo-spatial memory: A critical, historical review, and lessons for the present and future. Frontiers in Psychology, 13, 962025. doi:10.3389/fpsyg.2022.962025CrossRefGoogle ScholarPubMed
Kennedy, D. N., Abraham, S. A., Bates, J. F., Crowley, A., Ghosh, S., Gillespie, T., … Travers, M. (2019). Everything matters: The ReproNim perspective on reproducible neuroimaging. Frontiers in Neuroimaging, 13. doi:10.3389/fninf.2019.00001Google ScholarPubMed
Nelson, C. A., Morse, P. A., & Leavitt, L. A. (1979). Recognition of facial expressions by seven-month-old infants. Child Development, 50(4), 12391242.CrossRefGoogle ScholarPubMed
Niso, G., Botvinik-Nezer, R., Appelhoff, S., De La Vega, A., Esteban, O., Etzel, J. A., … Rieger, J. W. (2022). Open and reproducible neuroimaging: From study inception to publication. NeuroImage, 263, 119623. https://doi.org/10.1016/j.neuroimage.2022.119623CrossRefGoogle ScholarPubMed
Phillips, P. J., Yates, A. N., Hu, Y., Hahn, C. A., Noyes, E., Jackson, K., … O'Toole, A. J. (2018). Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms. PNAS, 115(24), 61716176. doi:10.1073/pnas.1721355115CrossRefGoogle ScholarPubMed
Poldrack, R. A., Baker, C. I., Durnez, J., Gorgolewski, K. J., Matthews, P. M., Munafò, M. R., … Yarkoni, T. (2017). Scanning the horizon: Towards transparent and reproducible neuroimaging research. Nature Reviews Neuroscience, 18(2), 115126. doi:10.1038/nrn.2016.167CrossRefGoogle ScholarPubMed
Rigo, P., Kim, P., Esposito, G., Putnick, D. L., Venuti, P., & Bornstein, M. H. (2019). Specific maternal brain responses to their own child's face: An fMRI meta-analysis. Developmental Review, 51, 5869. https://doi.org/10.1016/j.dr.2018.12.001CrossRefGoogle ScholarPubMed
Wilmer, J. B., Germine, L., Chabris, C. F., Chatterjee, G., Williams, M., Loken, E., … Duchaine, B. (2010). Human face recognition ability is specific and highly heritable. PNAS, 107(11), 52385241. doi:10.1073/pnas.0913053107CrossRefGoogle ScholarPubMed
Zhang, K., Rigo, P., Su, X., Wang, M., Chen, Z., Esposito, G., … Du, X. (2020). Brain responses to emotional infant faces in new mothers and nulliparous women. Scientific Reports, 10(1), 9560. doi:10.1038/s41598-020-66511-xCrossRefGoogle ScholarPubMed