New MIT study explores machine learning and pareidolia

Researchers from the Massachusetts Institute of Technology’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have advanced the study of pareidolia— the phenomenon where humans perceive faces in inanimate objects—through the development of a new machine learning model and dataset. Unveiled at the European Conference on Computer Vision (ECCV) in October, this research provides insights into why humans experience this phenomenon and suggests a pathway for enhancing computer vision capabilities.

Mark Hamilton, a PhD student in electrical engineering and computer science and the lead researcher of the study, stated, “What this paper really tries to do is explore the intersection between pareidolia and computer vision.” The researchers sought to understand how machine learning could replicate the way humans experience pareidolia by constructing the world’s first large-scale dataset specifically for this purpose.

To create this dataset, the team sifted through a massive collection of 5.85 billion images to curate a set of 5,000 pareidolic faces. Hamilton explained that the intention is for the dataset to be used to explore psychological concepts through computer models, allowing researchers to conduct experiments without the ethical and logistical issues commonly associated with human subjects. He compared this to the practice of developing rat models for testing new pharmaceuticals.

In testing the computational abilities of their model, the team conducted an experiment in which a state-of-the-art face detector struggled to identify pareidolic faces until additional training data featuring animal faces was incorporated. Hamilton theorised that this could indicate an evolutionary advantage of pareidolia; the ability to identify face-like patterns might have provided early humans with the crucial skill of recognising camouflaged threats in their environment, thereby enhancing survival.

The study also evaluated simpler machine learning models, like Gaussian models, revealing interesting characteristics about how pareidolic faces are represented. These basic models focused primarily on low-frequency features, representing the overall structure of faces while bypassing intricate details, a contrasting method to more complex neural networks that function as ‘black boxes.’ “You can write down a closed form equation, graph it out, and ask questions about how it behaves,” Hamilton explained regarding the advantages of simpler models.

Despite the promising findings, experts caution against directly equating the perceptual abilities of machines with those of humans. Greg Borenstein, a graduate from the MIT Media Lab’s Playful Systems Group, remarked, “The thing that a human being sees as a face is very different… a convolutional neural network detects very specific patterns of pixels rather than the concept of two eyes and a mouth.” While algorithms form patterns based on training data rather than evolutionary impulses, there are similarities in how humans and computers engage with images. For instance, in parallel tests with random noise images, both humans and the machine learning models displayed a “pareidolic peak,” identifying the most faces at intermediate levels of detail.

The implications of this research extend beyond cognitive science and into practical applications. One significant prospect involves enhancing facial recognition technology by reducing false positives or broadening the models to recognise a variety of faces, including non-human ones, like cartoons. Additionally, Hamilton noted that insights gained could feed into generative design, helping machines to create user-friendly devices that are less intimidating—critical in products like dental scanners for children.

The collaboration between researchers from disciplines of computer science, cognition, and product design signifies a multidimensional approach towards understanding both human perception and artificial intelligence. As innovations in AI and other emerging technologies continue to develop, the integration of such findings could lead to machines that perceive the world more similarly to humans, even recognising the shocked face of an electrical outlet.

Source: Noah Wire Services