OmniMVS: End-to-End Learning for Omnidirectional Stereo Matching
- Title
- OmniMVS: End-to-End Learning for Omnidirectional Stereo Matching
- Author
- 임종우
- Keywords
- Cameras; Feature extraction; Three-dimensional displays; Estimation; Neural networks; Machine learning; Computational modeling
- Issue Date
- 2019-10
- Publisher
- IEEE/CVF
- Citation
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Page. 8986-8996
- Abstract
- In this paper, we propose a novel end-to-end deep neural network model for omnidirectional depth estimation from a wide-baseline multi-view stereo setup. The images captured with ultra wide field-of-view (FOV) cameras on an omnidirectional rig are processed by the feature extraction module, and then the deep feature maps are warped onto the concentric spheres swept through all candidate depths using the calibrated camera parameters. The 3D encoder-decoder block takes the aligned feature volume to produce the omnidirectional depth estimate with regularization on uncertain regions utilizing the global context information. In addition, we present large-scale synthetic datasets for training and testing omnidirectional multi-view stereo algorithms. Our datasets consist of 11K ground-truth depth maps and 45K fisheye images in four orthogonal directions with various objects and environments. Experimental results show that the proposed method generates excellent results in both synthetic and real-world environments, and it outperforms the prior art and the omnidirectional versions of the state-of-the-art conventional stereo algorithms.
- URI
- https://ieeexplore.ieee.org/document/9010863https://repository.hanyang.ac.kr/handle/20.500.11754/154350
- ISBN
- 978-1-7281-4803-8
- ISSN
- 2380-7504
- DOI
- 10.1109/ICCV.2019.00908
- Appears in Collections:
- COLLEGE OF ENGINEERING[S](공과대학) > COMPUTER SCIENCE(컴퓨터소프트웨어학부) > Articles
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML