This paper introduced a hand function rehabilitation system based on motor imagery (MI) brain-computer interface for hand function rehabilitation of stroke patients. The rehabilitation system contains three subsystems. Offline training subsystem displays the blank screen, a left or right hand movement video and arrow in turn, which respectively reminders patients to rest and make preparations for MI and instruct them how to do MI, and be doing MI. Finally, the patients' electroephalography (EEG) signals are acquired and processed to generate a recognition model. Model update online training subsystem presents the black screen and a left or right arrow, the meanings of which are the same as those in offline training subsystem. Then the acquired EEG signals are analyzed according to the established recognition model. Next, the analysis result is derived to control the hand movement video to be played. The video can also act as a visual feedback, which makes patients' EEG signals easier to be recognized. The updated and more effective recognition model is built at last. Virtual reality (VR) online training subsystem constructs 3D grid models of VR scene, a 3D man model and its hand animations in the 3Dmax. Then, all of them are imported into Unity3D. The control methods of the animations are also designed in Unity3D. In the end, the patients' EEG signals are analyzed according to the updated recognition model, thus controlling the hand movements of the 3D man in real time. The developed system has many characteristics, such as multilevel training and more immersion, which hopefully promotes the plasticity of central nervous system. The designed system provides new treatments for post-stroke hand function rehabilitation and further lays the foundation for family-mode rehabilitation.
ZHANG Tao
,
YANG Bang-hua
,
DUAN Kai-wen
,
TANG Jian-zhen
,
HAN Xu
. Development of Hand Function Rehabilitation System Based on Motor Imagery Brain-computer Interface[J]. Chinese Journal of Rehabilitation Theory and Practice, 2017
, 23(1)
: 4
-9
.
DOI: 10.3969/j.issn.1006-9771.2017.01.002
[1] 贾杰. 脑卒中后手功能康复现状[J]. 老年医学与保健, 2015, 21(3): 129-131.
[2] Plantin J, Laurencikas E, Lindberg P, et al. Biomarkers for prediction of hand function after stroke: The ProHand study protocol [J]. J Neurologic Sci, 2013, 333(Suppl 1): 555-556.
[3] 逄锦熙,倪克锋. 脑卒中后手功能障碍的康复治疗进展[J]. 中国现代医生, 2015, 53(13): 143-146.
[4] 周冰,刘佳,郭玉玲. 针刺疗法与运动想象联合治疗脑卒中致上肢功能障碍临床观察[J]. 中西医结合心脑血管病杂志, 2012, 10(5): 555-556.
[5] 吴群英,张萍. 冷疗技术在脑卒中偏瘫患者上肢及手功能训练中的效果观察[J]. 当代护士旬刊, 2011 (5): 20-21.
[6] 王国宝,鲍勇,丁旭,等. 功能性电刺激对脑卒中肢体运动功能康复的作用及进展[J]. 中国康复, 2012, 27(5): 372-375.
[7] 张文,陆廷仁,王美芬,等. 作业治疗在脑卒中偏瘫患者康复中的疗效[J]. 上海第二医科大学学报, 2004, 24(6): 472-473.
[8] 夏隽晖,夏文广,郑婵娟,等. 作业治疗对脑卒中后肩手综合征的疗效观察[J]. 中国康复, 2013, 28(6): 454-455.
[9] 彭宪星,亓云玲,刘芹. 运动疗法对脑卒中患者肌张力的影响作用[J]. 中国实用医刊, 2016, 43(5): 20-21.
[10] 苏志源. 中医治疗脑卒中[J]. 中国中医药咨询, 2012, 4(1): 243.
[11] Mattia D, Pichiorri F, Molinari M, et al. Brain computer interface for hand motor function restoration and rehabilitation [M]// Allison B. Towards Practical Brain-Computer Interfaces. Berlin: Springer Berlin Heidelberg, 2012: 131-153.
[12] Zhang H, Liang J, Liu Y, et al. An Iterative Method for Classifying Stroke Subjects' Motor Imagery EEG Data in the BCI-FES Rehabilitation Training System [C]. Foundations and Practical Applications of Cognitive Systems and Information Processing, 2014: 363-373.
[13] 刘小燮,毕胜,高小榕,等.基于运动想象的脑机交互康复训练新技术对大脑可塑性的影响[J]. 中国康复医学杂志, 2015, 28(2): 97-102.
[14] 崔尧,丛芳,刘霖. 镜像神经元系统的基本理论及其在运动功能康复中的意义[J]. 中国康复理论与实践, 2012, 18(3): 239-243.
[15] Stefan K. Formation of a motor memory by action observation [J]. J Neurosci, 2005, 25(41): 9339-9346.
[16] 翟艺,徐秀林. 基于虚拟现实技术的上肢康复系统的发展现状[J]. 中国康复理论与实践, 2014, 20(10): 908-910.
[17] 朱惠娟. 基于Unity3D的虚拟漫游系统[J]. 计算机系统应用, 2012, 21(10): 36-39.
[18] Yang B, Zhang T, Duan K. Development of a BCI Simulated Application System Based on Unity3D [C]. 2015 International Conference on Virtual Reality and Visualization (ICVRV). IEEE Computer Society, 2015: 277-280.
[19] Ron-Angevin R, Díaz-Estrella A. Brain-computer interface: Changes in performance using virtual reality techniques [J]. Neurosci Lett, 2009, 449(2): 123-127.
[20] Tchernichovski O, Wallman J. Neurons of imitation [J]. Nature, 2008, 451(17): 249-250.
[21] 张凯. 沉浸式三维虚拟漫游技术研究[J]. 长春理工大学学报(自然科学版), 2016, 39(1): 104-106.
[22] 刘雁,王建军. 浅谈3Dmax在人头建模中的方法与技巧[J]. 电子世界, 2014(15): 106.
[23] 向玉玲. 3DMax中角色动画技术[J]. 计算机光盘软件与应用, 2011(17): 139.
[24] 唐朝正,丁政,李春燕,等. 运动想象结合任务导向训练对慢性期脑卒中患者上肢功能影响的随机对照研究[J]. 中华物理医学与康复杂志, 2014, 36(11): 495-499.
[25] Yang B, He L. Removal of ocular artifacts from EEG signals using ICA-RLS in BCI [C]. IEEE Workshop on Electronics, Computer and Applications, 2014: 544-547.
