Wearable fabric sensor for controlling myoelectric hand prosthesis via classification of foot postures

Abstract

The degrees-of-freedom of robotic prosthetic hands have recently increased, but high-level amputees such as those with shoulder disarticulation and trans-humeral amputation do not have enough muscular areas on their upper limbs upon which to base surface electromyogram (sEMG) signals. In this paper, a wearable fabric sensor is proposed to measure the sEMG on the lower limb and to classify the foot postures by using the proposed convolutional neural network (CNN), ultimately, for the application to high-level upper limb amputees. First, we determined that sEMG signals of the lower limb can be classified into levels in a manner similar to those of the upper limb for eight postures. Second, a multilayer perceptron (MLP) and the proposed CNN was used to compare the pattern recognition accuracy for classifying eight postures. Finally, the wearable fabric sensor and the proposed CNN network were demonstrated by the trans-radial amputees. These results showed that the wearable fabric sensor verified different eight patterns based on similar motions of both limbs (p ˂ 0.001). In addition, the classification accuracy (91.3%) of the proposed CNN was much higher than that (79%) of MLP (p ˂ 0.05). The wearable fabric sensor allowed the measurement location to change from the upper limb to the lower limb and allowed the number of the classifiable patterns to increase thanks to the sixteen-channel sEMG signals acquired from 32 fabric electrodes. The high classification accuracy of the proposed CNN will be useful for various users who have to wear myoelectric prosthesis every day.