Heatmap-based Out-of-Distribution Detection

Hornauer J, Belagiannis V (2023)

Publication Type: Conference contribution

Publication year: 2023

Publisher: Institute of Electrical and Electronics Engineers Inc.

Pages Range: 2602-2611

Conference Proceedings Title: Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023

Event location: Waikoloa, HI, USA

ISBN: 9781665493468

DOI: 10.1109/WACV56688.2023.00263

Abstract

Our work investigates out-of-distribution (OOD) detection as a neural network output explanation problem. We learn a heatmap representation for detecting OOD images while visualizing in- and out-of-distribution image regions at the same time. Given a trained and fixed classifier, we train a decoder neural network to produce heatmaps with zero response for in-distribution samples and high response heatmaps for OOD samples, based on the classifier features and the class prediction. Our main innovation lies in the heatmap definition for an OOD sample, as the normalized difference from the closest in-distribution sample. The heatmap serves as a margin to distinguish between in- and out-of-distribution samples. Our approach generates the heatmaps not only for OOD detection, but also to indicates in- and out-of-distribution regions of the input image. In our evaluations, our approach mostly outperforms the prior work on fixed classifiers, trained on CIFAR-10, CIFAR-100 and Tiny ImageNet. The code is publicly available at: https://github.com/jhornauer/heatmap_ood.

Authors with CRIS profile

Vasileios Belagiannis

Involved external institutions

Universität Ulm DE Germany (DE)

How to cite

APA:

Hornauer, J., & Belagiannis, V. (2023). Heatmap-based Out-of-Distribution Detection. In Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023 (pp. 2602-2611). Waikoloa, HI, USA: Institute of Electrical and Electronics Engineers Inc..

MLA:

Hornauer, Julia, and Vasileios Belagiannis. "Heatmap-based Out-of-Distribution Detection." Proceedings of the 23rd IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023, Waikoloa, HI, USA Institute of Electrical and Electronics Engineers Inc., 2023. 2602-2611.

BibTeX: Download