Auto-evaluation of motion imitation in a child-robot imitation game for upper arm rehabilitation

The purpose of this study is fusing play-like child robot interaction with physiotherapy in order to achieve upper arm rehabilitation by motivating the child. The proposed system is not intended to substitute for the physiotherapist, but to assist them in their therapeutic tasks by encouraging the child's participation in the activity. Recognizing the imitation performance of the child and supporting him/her with feedback for drawing the child's attention and motivating the child to imitate the robot is crucial. This study concentrates on automatically evaluating the upper body actions of the child during an imitation based physical therapy. For quantifying the performance of the child, two measures were considered: Range of Motion (RoM) and Dynamic Time Warping (DTW) distance. In our initial experiments, eight healthy children were asked to stand in front of a Kinect sensor and to mimic the actions of the humanoid robot Nao, which consist of shoulder abduction, shoulder vertical flexion&extension and elbow flexion. The proposed evaluation measure is verified as a reliable measurement according to Intraclass Correlation Coefficient (ICC) through comparison with evaluations of five physiotherapists as ground truth. The degree of consistency among our ratings and the physiotherapist ratings is between %76 and %96 for different motions.