How similar is the human mind to the machines that can behave like it? After decades spent lagging behind the recognitional capabilities of even a young child, machine-vision systems can now classify natural images with accuracy rates that match adult humans. The success of such models, especially biologically inspired Convolutional Neural Networks (CNN's), has been exciting not only for the practical purpose of developing new technologies (for example screening baggage at airports, reading street signs in autonomous vehicles, or diagnosing radiological scans), but also for better understanding the human mind itself. Recent work, for example, has found that CNN's can be used to predict the behavior of humans and non-human primates, large-scale activation of brain regions, and even the firing patterns of individual neurons — leading to speculation that the mechanisms and computational principles underlying CNN's may resemble those of our own brains.
To address this question, we introduce a “machine-theory-of-mind” task that asks whether humans can infer the classification that a machine-vision system would assign to a given image. We acquired images produced by several prominent adversarial attacks, and displayed them to human subjects who were told that a machine had classified them as familiar objects. The human’s task was to “think like a machine” and determine which label was generated for each image. We conducted eight experiments using this task, probing human understanding of five different adversarial image sets. Importantly, none of these images was created with human vision in mind —they were simply generated to fool a machine-vision system into misclassifying an image.
Zhou Z et al. (2019) Humans can decipher adversarial images. Nat Commun. 10: 1334. doi: 10.1038/s41467-019-08931-6
This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
Sections of the Introduction and Discussion are presented in the Podcast. Access the full-text article here: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6430776