AAAI Publications, Thirtieth AAAI Conference on Artificial Intelligence

Font Size: 
Toward a Taxonomy and Computational Models of Abnormalities in Images
Babak Saleh, Ahmed Elgammal, Jacob Feldman, Ali Farhadi

Last modified: 2016-03-05


The human visual system can spot an abnormal image, and reason about what makes it strange. This task has not received enough attention in computer vision. In this paper we study various types of atypicalities in images in a more comprehensive way than has been done before. We propose a new dataset of abnormal images showing a wide range of atypicalities. We design human subject experiments to discover a coarse taxonomy of the reasons for abnormality. Our experiments reveal three major categories of abnormality: object-centric, scene-centric, and contextual. Based on this taxonomy, we propose a comprehensive computational model that can predict all different types of abnormality in images and outperform prior arts in abnormality recognition.


Visual Attributes; Classification; Detection; Reasoning; Probabilistic Graphical Models; Crowdsourcing; Human Perception

Full Text: PDF