81 0

Efficient neural network compression via transfer learning for machine vision inspection

Title
Efficient neural network compression via transfer learning for machine vision inspection
Author
노영균
Keywords
Deep learning; Industrial image inspection; Neural network compression; Transfer learning
Issue Date
2020-04
Publisher
ELSEVIER
Citation
NEUROCOMPUTING, v. 413, page. 294-304
Abstract
Several practical difficulties arise when trying to apply deep learning to image-based industrial inspection tasks: training datasets are difficult to obtain, each image must be inspected in milliseconds, and defects must be detected with 99% or greater accuracy. In this paper we show how, for image-based industrial inspection tasks, transfer learning can be leveraged to address these challenges. Whereas transfer learning is known to work well only when the source and target domain images are similar, we show that using ImageNet-whose images differ significantly from our target industrial domain-as the source domain, and performing transfer learning, works remarkably well. For one benchmark problem involving 5,520 training images, the resulting transfer-learned network achieves 99.90% accuracy, compared to only a 70.87% accuracy achieved by the same network trained from scratch. Further analysis reveals that the transfer-learned network produces a considerably more sparse and disentangled representation compared to the trained-from-scratch network. The sparsity can be exploited to compress the transfer-learned network up to 1/128 the original number of convolution filters with only a 0.48% drop in accuracy, compared to a drop of nearly 5% when compressing a trained-from-scratch network. Our findings are validated by extensive systematic experiments and empirical analysis. (C) 2020 Elsevier B.V. All rights reserved.
URI
https://www.sciencedirect.com/science/article/pii/S0925231220310961?via%3Dihubhttps://repository.hanyang.ac.kr/handle/20.500.11754/165951
ISSN
0925-2312; 1872-8286
DOI
10.1016/j.neucom.2020.06.107
Appears in Collections:
COLLEGE OF ENGINEERING[S](공과대학) > COMPUTER SCIENCE(컴퓨터소프트웨어학부) > Articles
Files in This Item:
There are no files associated with this item.
Export
RIS (EndNote)
XLS (Excel)
XML


qrcode

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE