A Deep Learning Framework for Joint Image Restoration and Recognition

Ruilong Chen, Lyudmila Mihaylova, Hao Zhu, Nidhal Carla Bouaynaya

    Research output: Contribution to journalArticle

    Abstract

    Image restoration and recognition are important computer vision tasks representing an inherent part of autonomous systems. These two tasks are often implemented in a sequential manner, in which the restoration process is followed by a recognition. In contrast, this paper proposes a joint framework that simultaneously performs both tasks within a shared deep neural network architecture. This joint framework integrates the restoration and recognition tasks by incorporating: (i) common layers, (ii) restoration layers and (iii) classification layers. The total loss function combines the restoration and classification losses. The proposed joint framework, based on capsules, provides an efficient solution that can cope with challenges due to noise, image rotations and occlusions. The developed framework has been validated and evaluated on a public vehicle logo dataset under various degradation conditions, including Gaussian noise, rotation and occlusion. The results show that the joint framework improves the accuracy compared with the single task networks.

    Original languageEnglish (US)
    Pages (from-to)1561-1580
    Number of pages20
    JournalCircuits, Systems, and Signal Processing
    Volume39
    Issue number3
    DOIs
    StatePublished - Mar 1 2020

      Fingerprint

    All Science Journal Classification (ASJC) codes

    • Signal Processing
    • Applied Mathematics

    Cite this