Face Recognition Depends on Specialized Mechanisms Tuned to View‐Invariant Facial Features: Insights from Deep Neural Networks Optimized for Face or Object Recognition

Cognitive Science 45 (9):e13031 (2021)
  Copy   BIBTEX

Abstract

Face recognition is a computationally challenging classification task. Deep convolutional neural networks (DCNNs) are brain‐inspired algorithms that have recently reached human‐level performance in face and object recognition. However, it is not clear to what extent DCNNs generate a human‐like representation of face identity. We have recently revealed a subset of facial features that are used by humans for face recognition. This enables us now to ask whether DCNNs rely on the same facial information and whether this human‐like representation depends on a system that is optimized for face identification. In the current study, we examined the representation of DCNNs of faces that differ in features that are critical or non‐critical for human face recognition. Our findings show that DCNNs optimized for face identification are tuned to the same facial features used by humans for face recognition. Sensitivity to these features was highly correlated with performance of the DCNN on a benchmark face recognition task. Moreover, sensitivity to these features and a view‐invariant face representation emerged at higher layers of a DCNN optimized for face recognition but not for object recognition. This finding parallels the division to a face and an object system in high‐level visual cortex. Taken together, these findings validate human perceptual models of face recognition, enable us to use DCNNs to test predictions about human face and object recognition as well as contribute to the interpretability of DCNNs.

Other Versions

No versions found

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 100,607

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Distributed neural systems for face perception.James V. Haxby & M. Ida Gobbini - 2011 - In Andy Calder, Gillian Rhodes, Mark Johnson & Jim Haxby (eds.), Oxford Handbook of Face Perception. Oxford University Press. pp. 93--110.
Taking apart the neural machinery of face processing.Winrich Freiwald & Doris Tsao - 2011 - In Andy Calder, Gillian Rhodes, Mark Johnson & Jim Haxby (eds.), Oxford Handbook of Face Perception. Oxford University Press.
Cognitive and computational approaches to face recognition.Alice O'Toole - 2011 - In Andy Calder, Gillian Rhodes, Mark Johnson & Jim Haxby (eds.), Oxford Handbook of Face Perception. Oxford University Press. pp. 15--30.

Analytics

Added to PP
2021-09-08

Downloads
15 (#1,220,624)

6 months
5 (#1,015,253)

Historical graph of downloads
How can I increase my downloads?