A Case Series in Position-Aware Myoelectric Prosthesis Control Using Recurrent Convolutional Neural Network Classification with Transfer Learning

Abstract

Position-aware myoelectric prosthesis controllers require long, data-intensive training routines. Transfer Learning (TL) might reduce training burden. A TL model can be pre-trained using forearm muscle signal data from many individuals to become the starting point for a new user. A recurrent convolutional neural network (RCNN)-based classifier has already been shown to benefit from TL in offline analysis (95% accuracy). The present real-time study tested whether an RCNN-based classification controller with TL (RCNN-TL) could reduce training burden, offer improved device control (per functional task performance metrics), and mitigate what is known as the “limb position effect”. 27 participants without amputation were recruited. 19 participants performed wrist/hand movements across multiple limb positions, with resulting forearm muscle signal data used to pre-train RCNN-TL. 8 other participants donned a simulated prosthesis, retrained (calibrated) and tested RCNN-TL, plus trained and tested a conventional linear discriminant analysis classification controller (LDA-Baseline). Results confirmed that TL reduces user training burden. RCNN-TL yielded improved task performance durations over LDA-Baseline (in specific Grasp and Release phases), yet other metrics worsened. Overall, this work contributes training condition factors necessary for TL success, identifies metrics needed for comprehensive control analysis, and contributes insights towards improved position-aware control.