Implementation experiments on convolutional neural network training using synthetic images for 3D pose estimation of an excavator on real images
- Title
- Implementation experiments on convolutional neural network training using synthetic images for 3D pose estimation of an excavator on real images
- Author
- 한상욱
- Keywords
- Excavator; 3D pose estimation; Synthetic dataset; Kinematic constraints; Perspective camera projection
- Issue Date
- 2022-01
- Publisher
- ELSEVIER
- Citation
- AUTOMATION IN CONSTRUCTION, v. 133, article no. 103996, Page. 1-17
- Abstract
- Remote and descriptive visualization of spatio-temporal information of excavator activities may increase awareness about jobsite hazards and operational performance in earthwork operations. One of the emerging approaches to collect this information is to extract the 3D pose of an excavator from the video frames using a convolutional neural network (CNN). However, this method requires labeling the training datasets, which are difficult to prepare because of conditions unsuitable for installing the motion capture sensors. This study investigates the performance of a CNN for estimating the 3D pose when trained on a synthetic dataset. In particular, a kinematic constraint is proposed to update the model parameters efficiently during training. The results show that the proposed method estimated the 3D poses of a real excavator with an average pose error of 9.63°. Hence, the proposed data augmentation method could help address the training data issues and improves the learning of real data complexity.
- URI
- https://www.sciencedirect.com/science/article/pii/S0926580521004477?via%3Dihubhttps://repository.hanyang.ac.kr/handle/20.500.11754/176857
- ISSN
- 0926-5805;1872-7891
- DOI
- 10.1016/j.autcon.2021.103996
- Appears in Collections:
- COLLEGE OF ENGINEERING[S](공과대학) > CIVIL AND ENVIRONMENTAL ENGINEERING(건설환경공학과) > Articles
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML