452 0

Similarity-based Contextual Zero-Shot Recognition via Distance-Weighted Calibration

Title
Similarity-based Contextual Zero-Shot Recognition via Distance-Weighted Calibration
Other Titles
거리-가중 보정을 통한 유사도 기반 문맥적 제로샷 인식
Author
장두수
Alternative Author(s)
장두수
Advisor(s)
최용석
Issue Date
2021. 2
Publisher
한양대학교
Degree
Doctor
Abstract
Zero-shot recognition (ZSR) aims to learn a visual classifier for categories with the absence of training samples. The focus in most traditional ZSR models is to transfer semantic knowledge of familiar categories to represent unfamiliar ones only with the visual appearance of an unseen object. To transfer knowledge, it is assumed that visually similar objects tend to also be semantically similar. However, the correlation between visual and semantic characteristics is not always assured, which induces a limitation in accurate and wide-covered predictions. To alleviate this limitation, we consider not only the visual information but contexts to enhance cognitive ability in a multi-object scene. In this paper, we propose a novel method, contextual inference, that exploits the surrounding information obtained with similarity measures between an unseen object and its surrounding objects by using external resources such as knowledge graphs and semantic embedding spaces. Moreover, with the intuition that close contexts involve more related associations, distance-weighting is applied to each of the surrounding information by a newly defined distance calculation formula. We integrate the contextual inference into the traditional ZSR models to calibrate their visual predictions. We perform extensive experiments for comparative evaluations on two different datasets: ImageNet categories and Visual Genome categories containing small and large amounts of target categories, respectively. Various quantitative experiments with accuracy metrics and qualitative experiments with exemplary prediction results are conducted for validation. The experimental results demonstrate the effectiveness of our method with significant enhancements in performances. Consequently, we expect this dissertation plays a key role in investigating context-aware ZSR that is yet rarely studied.
URI
https://repository.hanyang.ac.kr/handle/20.500.11754/158927http://hanyang.dcollection.net/common/orgView/200000485721
Appears in Collections:
GRADUATE SCHOOL[S](대학원) > COMPUTER SCIENCE(컴퓨터·소프트웨어학과) > Theses (Ph.D.)
Files in This Item:
There are no files associated with this item.
Export
RIS (EndNote)
XLS (Excel)
XML


qrcode

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE