Similarity-based Contextual Zero-Shot Recognition via Distance-Weighted Calibration
- Similarity-based Contextual Zero-Shot Recognition via Distance-Weighted Calibration
- Other Titles
- 거리-가중 보정을 통한 유사도 기반 문맥적 제로샷 인식
- Alternative Author(s)
- Issue Date
- 2021. 2
- Zero-shot recognition (ZSR) aims to learn a visual classifier for categories with the absence of training samples. The focus in most traditional ZSR models is to transfer semantic knowledge of familiar categories to represent unfamiliar ones only with the visual appearance of an unseen object. To transfer knowledge, it is assumed that visually similar objects tend to also be semantically similar. However, the correlation between visual and semantic characteristics is not always assured, which induces a limitation in accurate and wide-covered predictions.
To alleviate this limitation, we consider not only the visual information but contexts to enhance cognitive ability in a multi-object scene. In this paper, we propose a novel method, contextual inference, that exploits the surrounding information obtained with similarity measures between an unseen object and its surrounding objects by using external resources such as knowledge graphs and semantic embedding spaces. Moreover, with the intuition that close contexts involve more related associations, distance-weighting is applied to each of the surrounding information by a newly defined distance calculation formula. We integrate the contextual inference into the traditional ZSR models to calibrate their visual predictions.
We perform extensive experiments for comparative evaluations on two different datasets: ImageNet categories and Visual Genome categories containing small and large amounts of target categories, respectively. Various quantitative experiments with accuracy metrics and qualitative experiments with exemplary prediction results are conducted for validation. The experimental results demonstrate the effectiveness of our method with significant enhancements in performances. Consequently, we expect this dissertation plays a key role in investigating context-aware ZSR that is yet rarely studied.
- Appears in Collections:
- GRADUATE SCHOOL[S](대학원) > COMPUTER SCIENCE(컴퓨터·소프트웨어학과) > Theses (Ph.D.)
- Files in This Item:
There are no files associated with this item.
- RIS (EndNote)
- XLS (Excel)