COMPUTATIONAL RESEARCH in BOSTON and BEYOND (CRIBB)
| Date | October 2, 2020 |
|---|---|
| Speaker | Jenelle Feather Massachusetts Institute of Technology |
| Topic | Metamers of neural networks reveal divergence from human perceptual systems |
| Abstract | Artificial neural networks now achieve human-level performance on tasks such as image and speech recognition, raising the question of whether they should be taken seriously as models of biological sensory systems. Such neural network models exhibit human-like patterns of behavior, and their feature spaces reliably predict brain activity. On the other hand, neural network models can often be fooled by small adversarial perturbations that have no effect on humans. In this talk, I will detail our work using "model metamers" to investigate similarities between neural networks and human sensory systems. Model metamers are physically distinct stimuli that produce nearly the same response within a model, and thus the same model prediction. Our results show that despite replicating aspects of human behavior and neural responses, present-day deep neural networks learn invariances that deviate markedly from those of biological sensory systems. Model metamers may help guide future model refinements to reduce or eliminate these discrepancies. |
| Biography |
Archives
Acknowledgements
We thank the generous support of MIT IS&T, CSAIL, and the Department of Mathematics for their support of this series.