搜索

x

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

头部旋转运动下自适应非接触鲁棒性心率检测方法

巴图巴雅尔·欧赟 赵跃进 孔令琴 董立泉 刘明 惠梅

引用本文:
Citation:

头部旋转运动下自适应非接触鲁棒性心率检测方法

巴图巴雅尔·欧赟, 赵跃进, 孔令琴, 董立泉, 刘明, 惠梅

Adaptive non-contact robust heart rate detection method under head rotation motion

Batubayaer Ou-Yun, Zhao Yue-Jin, Kong Ling-Qin, Dong Li-Quan, Liu Ming, Hui Mei
PDF
HTML
导出引用
  • 基于人脸视频的生理信号检测面临的主要挑战是运动伪影噪声. 针对受试者头部刚性旋转运动引起的伪影噪声, 本文提出利用头部运动信息构建自适应滤波器的非接触式心率检测方法. 该方法利用人脸二维和三维的特征点计算受试者运动中头部的偏航和俯仰欧拉角度, 并将其作为调控过程噪声协方差的信号质量指数, 进而构建了自适应Kalman滤波器, 实现了稳健的心率估计. 实验结果表明: 本文提出的方法可有效抑制头部刚性旋转运动引起的噪声, 平均绝对误差为2.22 beat/min, 均方根误差为2.76 beat/min, 与现有方法相比准确度分别提升9%与24.6%, 具有统计显著性. 本文提出的头部旋转角度自适应非接触鲁棒性心率检测方法在自发运动的真实场景下能有效提升检测的准确性, 扩大了成像式光电容积描记技术在视频健康监测领域的使用场景.
    The dominant challenge of vital signal monitoring based on facial video is to eliminate the interference of motion artifacts. In this paper, we propose a non-contact heart rate detection method based on an adaptive filter constructed by head movement information to tackle the noise of motion artifacts caused by the rigid rotation of the subject's head. The two-dimensional and three-dimensional feature points of the subject’s face are used to calculate the yaw and pitch Euler angles of the head movement, then the yaw and pitch Euler angles are used as a novel signal quality index (SQI) for modulating process noise covariance to construct an adaptive Kalman filter, and finally robust heart rate is estimated by this method. The experimental results show that the proposed method can effectively suppress the noise caused by the head rigid rotation with an average absolute error of 2.22 beat/min and a root mean square error of 2.76 beat/min, which are statistically significant with an accuracy improvement of 9% and 24.6%, respectively, compared with the existing methods. The adaptive non-contact robust heart rate detection technique based on head rigid rotation may effectively enhance the accuracy in real-world motion situations, as well as broaden the range of applications for IPPG in the field of the video-based monitoring of health conditions.
      通信作者: 赵跃进, yjzhao@bit.edu.cn ; 孔令琴, konglingqin3025@bit.edu.cn
    • 基金项目: 国家自然科学基金(批准号: 61705010, 11774031, 61935001)资助的课题
      Corresponding author: Zhao Yue-Jin, yjzhao@bit.edu.cn ; Kong Ling-Qin, konglingqin3025@bit.edu.cn
    • Funds: Project supported by the National Natural Science Foundation of China (Grant Nos. 61705010, 11774031, 61935001).
    [1]

    Franco M, Cooper R S, Bilal U, Fuster V 2011 Am. J. Med. 124 95Google Scholar

    [2]

    Allen J 2007 Physiol. Meas. 28 R1Google Scholar

    [3]

    Shelley K H 2007 Anesth. Analg. 105 S31Google Scholar

    [4]

    Sun Y, Thakor N 2016 IEEE Trans. Biomed. Eng. 63 463Google Scholar

    [5]

    Hulsbusch M, Blazek V 2002 Medical Imaging San Diego, California, USA, April 24, 2002 110

    [6]

    Verkruysse W, Svaasand L O, Nelson J S 2008 Opt. Express 16 21434

    [7]

    Wieringa F P, Mastik F, Steen A 2005 Ann. Biomed. Eng. 33 1034Google Scholar

    [8]

    Shao D, Yang Y, Liu C, Tsow F, Yu H, Tao N 2014 IEEE Trans. Biomed. Eng. 61 2760Google Scholar

    [9]

    Hülsbusch M 2008 Ph. D. Dissertation (Aachen: RWTH Aachen University) (in German)

    [10]

    Poh M Z, McDuff D J, Picard R W 2010 Opt. Express 18 10762Google Scholar

    [11]

    Poh M Z, McDuff D J, Picard R W 2010 IEEE Trans. Biomed. Eng. 58 7Google Scholar

    [12]

    Lewandowska M, Ruminski J, Kocejko T, Nowak J 2011 Federated Conference on Computer Science and Information Systems-FedCSIS 2011 Szczecin, Poland, September 18–21, 2011 p405

    [13]

    Haan G D, Jeanne V 2013 IEEE Trans. Biomed. Eng. 60 2878Google Scholar

    [14]

    Wang W, Brinker A C D, Stuijk S, Haan G D 2017 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) Washington, USA, May 30–June 3, 2017 p71

    [15]

    Wang W, Brinker A C D, Stuijk S, Haan G D 2016 IEEE Trans. Biomed. Eng. 64 1479Google Scholar

    [16]

    Wang W, Brinker A C D, Stuijk S, Haan G D 2017 Physiol. Meas. 38 1023Google Scholar

    [17]

    Sun Y, Hu S, Azorin-Peris V, Greenwald S, Chambers J, Zhu Y 2011 J. Biomed. Opt. 16 077010Google Scholar

    [18]

    Wang W, Stuijk S, Haan G D 2014 IEEE Trans. Biomed. Eng. 62 415Google Scholar

    [19]

    Wu B F, Huang P W, Lin C H, Chung M L, Tsou T Y, Wu Y L 2018 IEEE Access 6 21621Google Scholar

    [20]

    Kong L, Wu Y, Zhao Y, Dong L, Hui M, Liu M, Liu X 2020 IEEE Photonics J. 12 1Google Scholar

    [21]

    Viola P A, Jones M J 2001 Computer Vision and Pattern Recognition Kauai, Hawaii, USA, December 8–14, 2001 p511

    [22]

    Kwon S, Kim J, Lee D, Park K 2015 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) Milan, Italy, August 25–29, 2015 p4938

    [23]

    杨萍, 侯威, 封国林 2008 物理学报 57 5333Google Scholar

    Yang P, Hou W, Feng G L 2008 Acta Phys. Sin. 57 5333Google Scholar

    [24]

    Bousefsaf F, Maaoui C, Pruski A 2013 Biomed. Signal Process. Control 8 568Google Scholar

    [25]

    Haan G D, Leest A V 2014 Physiol. Meas. 35 1913Google Scholar

    [26]

    孔令琴 2014 博士学位论文 (北京: 北京理工大学)

    Kong L 2014 Ph. D. Dissertation (Beijing: Beijing Institute of Technology) (in Chinese)

    [27]

    Wang W 2017 Ph. D. Dissertation (Eindhoven, The Netherlands: Eindhoven University of Technology)

    [28]

    Smith W J 2008 Modern Optical Engineering: The Design of Optical Systems (4th Ed.) (New York: The McGraw-Hill Companies, Inc) p253

    [29]

    Asthana A, Zafeiriou S, Cheng S, Pantic M 2013 Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on Portland, Oregon, USA, June 23–28, 2013 p3444

    [30]

    Baltrusaitis T, Robinson P, Morency L 2012 IEEE Conference on Computer Vision & Pattern Recognition Providence, Rhode island, USA, June 16–21, 2012 p2610

    [31]

    Baltrusaitis T, Robinson P, Morency L 2016 IEEE Winter Conference on Applications of Computer Vision Lake Placid, New York, USA, March 7–10, 2016 p1

    [32]

    Baltrusaitis T, Zadeh A, Lim Y C, Morency L 2018 IEEE International Conference on Automatic Face & Gesture Recognition Xi’an, China, May 15–19, 2018 p59

    [33]

    Andreotti F, Trumpp A, Malberg H, Zaunseder S 2015 2015 IEEE 35th International Conference on Electronics and Nanotechnology (ELNANO) Kyiv, Ukraine, April 21–24, 2015 p428

    [34]

    张玉燕, 殷东哲, 温银堂, 罗小元 2021 物理学报 70 118102Google Scholar

    Zhang Y Y, Yin D Z, Wen Y T, Luo S Y 2021 Acta Phys. Sin. 70 118102Google Scholar

    [35]

    Nemati S, Malhotra A, Clifford G 2010 EURASIP J. Adv. Signal Process. 2010 926305Google Scholar

    [36]

    Tarvainen M P, Ranta-Aho P O, Karjalainen P A 2002 IEEE Trans. Biomed. Eng. 49 172Google Scholar

    [37]

    Fallet S, Moser V, Braun F, Vesin J M 2017 Computing in Cardiology Conference Vancouver, BC, Canada, September 11–14, 2016 p341

  • 图 1  人脸的3个旋转运动自由度

    Fig. 1.  Three rotational freedom degrees of human head.

    图 2  头部旋转角度信息作为自适应滤波器质量控制的流程图

    Fig. 2.  Flow chart of head rotation angles as a quality control of our proposed adaptive filter.

    图 3  实验方案图 (a) 实验装置示意图; (b) 采集到的视频片段((i)头部姿势的欧拉角为0°; (ii) 头部俯仰运动; (iii) 头部偏航)

    Fig. 3.  Experimental plan diagram: (a) Experiment set-up; (b) video clips ((i) the Euler angle of the head pose is 0°; (ii) the head pitch segment; (iii) the head yaw segment).

    图 4  矩形ROI区域选取示意图 (a)面部68个关键点检测; (b)脸颊矩形ROI区域; (c)偏航运动时ROI区域

    Fig. 4.  Flow chart of rectangular ROI area selection: (a) 68 feature points detection; (b) rectangular ROI area; (c) ROI area during yaw motion.

    图 5  本文提出方法的流程图

    Fig. 5.  Flow chart of method proposed in this paper.

    图 6  本文提出的滤波器与CHROM结合的对比结果

    Fig. 6.  Comparison results of the filter proposed in this paper combined with CHROM.

    图 7  21组实验结果相关性图(图中红线表示y=x的线性关系) (a) CHROM方法的相关性图; (b)本文提出的滤波器与CHROM结合的相关性图

    Fig. 7.  Correlation plots of 21 groups of experimental results (the red lines in the plots indicate linear relationship of y = x): (a) Correlation plot of CHROM method; (b) correlation plot of combining CHROM with our proposed adaptive filter.

    表 1  本文提出的自适应滤波器与不同的传统方法结合前后实验结果对比

    Table 1.  Comparison of experimental results before and after combining the filter proposed in this paper with different traditional methods.

    方法类型 传统的方法传统方法结合本文的滤波器
    MAE/(beat·min–1)RMSE/(beat·min–1)$ {\mathit{R}}^{2} $MAE/(beat·min–1)RMSE/(beat·min–1)$ {\mathit{R}}^{2} $
    GREEN5.988.650.5471 3.884.950.7217
    CDF5.469.220.59933.184.160.8402
    POS3.224.850.76442.863.610.8181
    POS+CDF6.6911.590.47743.254.420.8517
    CHROM2.443.660.81422.222.740.8401
    CHROM+CDF4.718.900.75142.623.460.8901
    下载: 导出CSV
  • [1]

    Franco M, Cooper R S, Bilal U, Fuster V 2011 Am. J. Med. 124 95Google Scholar

    [2]

    Allen J 2007 Physiol. Meas. 28 R1Google Scholar

    [3]

    Shelley K H 2007 Anesth. Analg. 105 S31Google Scholar

    [4]

    Sun Y, Thakor N 2016 IEEE Trans. Biomed. Eng. 63 463Google Scholar

    [5]

    Hulsbusch M, Blazek V 2002 Medical Imaging San Diego, California, USA, April 24, 2002 110

    [6]

    Verkruysse W, Svaasand L O, Nelson J S 2008 Opt. Express 16 21434

    [7]

    Wieringa F P, Mastik F, Steen A 2005 Ann. Biomed. Eng. 33 1034Google Scholar

    [8]

    Shao D, Yang Y, Liu C, Tsow F, Yu H, Tao N 2014 IEEE Trans. Biomed. Eng. 61 2760Google Scholar

    [9]

    Hülsbusch M 2008 Ph. D. Dissertation (Aachen: RWTH Aachen University) (in German)

    [10]

    Poh M Z, McDuff D J, Picard R W 2010 Opt. Express 18 10762Google Scholar

    [11]

    Poh M Z, McDuff D J, Picard R W 2010 IEEE Trans. Biomed. Eng. 58 7Google Scholar

    [12]

    Lewandowska M, Ruminski J, Kocejko T, Nowak J 2011 Federated Conference on Computer Science and Information Systems-FedCSIS 2011 Szczecin, Poland, September 18–21, 2011 p405

    [13]

    Haan G D, Jeanne V 2013 IEEE Trans. Biomed. Eng. 60 2878Google Scholar

    [14]

    Wang W, Brinker A C D, Stuijk S, Haan G D 2017 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) Washington, USA, May 30–June 3, 2017 p71

    [15]

    Wang W, Brinker A C D, Stuijk S, Haan G D 2016 IEEE Trans. Biomed. Eng. 64 1479Google Scholar

    [16]

    Wang W, Brinker A C D, Stuijk S, Haan G D 2017 Physiol. Meas. 38 1023Google Scholar

    [17]

    Sun Y, Hu S, Azorin-Peris V, Greenwald S, Chambers J, Zhu Y 2011 J. Biomed. Opt. 16 077010Google Scholar

    [18]

    Wang W, Stuijk S, Haan G D 2014 IEEE Trans. Biomed. Eng. 62 415Google Scholar

    [19]

    Wu B F, Huang P W, Lin C H, Chung M L, Tsou T Y, Wu Y L 2018 IEEE Access 6 21621Google Scholar

    [20]

    Kong L, Wu Y, Zhao Y, Dong L, Hui M, Liu M, Liu X 2020 IEEE Photonics J. 12 1Google Scholar

    [21]

    Viola P A, Jones M J 2001 Computer Vision and Pattern Recognition Kauai, Hawaii, USA, December 8–14, 2001 p511

    [22]

    Kwon S, Kim J, Lee D, Park K 2015 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) Milan, Italy, August 25–29, 2015 p4938

    [23]

    杨萍, 侯威, 封国林 2008 物理学报 57 5333Google Scholar

    Yang P, Hou W, Feng G L 2008 Acta Phys. Sin. 57 5333Google Scholar

    [24]

    Bousefsaf F, Maaoui C, Pruski A 2013 Biomed. Signal Process. Control 8 568Google Scholar

    [25]

    Haan G D, Leest A V 2014 Physiol. Meas. 35 1913Google Scholar

    [26]

    孔令琴 2014 博士学位论文 (北京: 北京理工大学)

    Kong L 2014 Ph. D. Dissertation (Beijing: Beijing Institute of Technology) (in Chinese)

    [27]

    Wang W 2017 Ph. D. Dissertation (Eindhoven, The Netherlands: Eindhoven University of Technology)

    [28]

    Smith W J 2008 Modern Optical Engineering: The Design of Optical Systems (4th Ed.) (New York: The McGraw-Hill Companies, Inc) p253

    [29]

    Asthana A, Zafeiriou S, Cheng S, Pantic M 2013 Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on Portland, Oregon, USA, June 23–28, 2013 p3444

    [30]

    Baltrusaitis T, Robinson P, Morency L 2012 IEEE Conference on Computer Vision & Pattern Recognition Providence, Rhode island, USA, June 16–21, 2012 p2610

    [31]

    Baltrusaitis T, Robinson P, Morency L 2016 IEEE Winter Conference on Applications of Computer Vision Lake Placid, New York, USA, March 7–10, 2016 p1

    [32]

    Baltrusaitis T, Zadeh A, Lim Y C, Morency L 2018 IEEE International Conference on Automatic Face & Gesture Recognition Xi’an, China, May 15–19, 2018 p59

    [33]

    Andreotti F, Trumpp A, Malberg H, Zaunseder S 2015 2015 IEEE 35th International Conference on Electronics and Nanotechnology (ELNANO) Kyiv, Ukraine, April 21–24, 2015 p428

    [34]

    张玉燕, 殷东哲, 温银堂, 罗小元 2021 物理学报 70 118102Google Scholar

    Zhang Y Y, Yin D Z, Wen Y T, Luo S Y 2021 Acta Phys. Sin. 70 118102Google Scholar

    [35]

    Nemati S, Malhotra A, Clifford G 2010 EURASIP J. Adv. Signal Process. 2010 926305Google Scholar

    [36]

    Tarvainen M P, Ranta-Aho P O, Karjalainen P A 2002 IEEE Trans. Biomed. Eng. 49 172Google Scholar

    [37]

    Fallet S, Moser V, Braun F, Vesin J M 2017 Computing in Cardiology Conference Vancouver, BC, Canada, September 11–14, 2016 p341

  • [1] 火元莲, 王丹凤, 龙小强, 连培君, 齐永锋. 非高斯冲激干扰下基于Softplus函数的核自适应滤波算法. 物理学报, 2021, 70(2): 028401. doi: 10.7498/aps.70.20200954
    [2] 张玉燕, 殷东哲, 温银堂, 罗小元. 基于自适应Kalman滤波的平面阵列电容成像. 物理学报, 2021, 70(11): 118102. doi: 10.7498/aps.70.20210442
    [3] 巴图巴雅尔·欧赟, 赵跃进, 孔令琴. 头部旋转运动下自适应非接触鲁棒性心率检测方法. 物理学报, 2021, (): . doi: 10.7498/aps.70.20211634
    [4] 刘海旭, 侯满宏, 李新胜. X频段连续波100 kW吸收式谐波滤波器研制. 物理学报, 2018, 67(19): 198401. doi: 10.7498/aps.67.20180577
    [5] 方志明, 崔荣一, 金璟璇. 基于生物视觉特征和视觉心理学的视频显著性检测算法. 物理学报, 2017, 66(10): 109501. doi: 10.7498/aps.66.109501
    [6] 秦修培, 耿德路, 洪振宇, 魏炳波. 超声悬浮过程中圆柱体的旋转运动机理研究. 物理学报, 2017, 66(12): 124301. doi: 10.7498/aps.66.124301
    [7] 胡进峰, 张亚璇, 李会勇, 杨淼, 夏威, 李军. 基于最优滤波器的强混沌背景中谐波信号检测方法研究. 物理学报, 2015, 64(22): 220504. doi: 10.7498/aps.64.220504
    [8] 宁小磊, 王宏力, 张琪, 陈连华. 区间衍生粒子滤波器. 物理学报, 2010, 59(7): 4426-4433. doi: 10.7498/aps.59.4426
    [9] 杨 光, 陈桂英, 祁胜文, 郝召锋, 田建国, 张春平. 非均匀输入图像对基于细菌视紫红质膜的新事物滤波器输出特性的数值模拟. 物理学报, 2007, 56(12): 6954-6960. doi: 10.7498/aps.56.6954
    [10] 杜正聪, 唐 斌, 李 可. 混合退火粒子滤波器. 物理学报, 2006, 55(3): 999-1004. doi: 10.7498/aps.55.999
    [11] 刘新元, 谢柏青, 戴远东, 王福仁, 李壮志, 马 平, 谢飞翔, 杨 涛, 聂瑞娟. 射频SQUID心磁图数据自适应滤波研究. 物理学报, 2005, 54(4): 1937-1942. doi: 10.7498/aps.54.1937
    [12] 熊 涛, 常胜江, 申金媛, 张延炘. 用于可变比特率视频通信量预测的自适应训练及删剪算法. 物理学报, 2005, 54(4): 1931-1936. doi: 10.7498/aps.54.1931
    [13] 赵 莉, 陈赓华, 张利华, 黄旭光, 翟光杰, 李俊文, 汤玉林, 冯 稷. 互补型自适应滤波器在心磁信号处理中的应用. 物理学报, 2004, 53(12): 4420-4427. doi: 10.7498/aps.53.4420
    [14] 甘建超, 肖先赐. 基于相空间邻域的混沌时间序列自适应预测滤波器(Ⅱ)非线性自适应滤波. 物理学报, 2003, 52(5): 1102-1107. doi: 10.7498/aps.52.1102
    [15] 甘建超, 肖先赐. 基于相空间邻域的混沌时间序列自适应预测滤波器(Ⅰ)线性自适应滤波. 物理学报, 2003, 52(5): 1096-1101. doi: 10.7498/aps.52.1096
    [16] 韦保林, 罗晓曙, 汪秉宏, 全宏俊, 郭维, 傅金阶. 一种基于三阶Volterra滤波器的混沌时间序列自适应预测方法. 物理学报, 2002, 51(10): 2205-2210. doi: 10.7498/aps.51.2205
    [17] 张家树, 肖先赐. 用于混沌时间序列自适应预测的一种少参数二阶Volterra滤波器. 物理学报, 2001, 50(7): 1248-1254. doi: 10.7498/aps.50.1248
    [18] 张家树, 肖先赐. 用一种少参数非线性自适应滤波器自适应预测低维混沌时间序列. 物理学报, 2000, 49(12): 2333-2339. doi: 10.7498/aps.49.2333
    [19] 朱物华, 张仲桂. 频带滤波器之瞬流. 物理学报, 1937, 3(1): 39-50. doi: 10.7498/aps.3.39
    [20] 朱物华, 张仲桂. 低频滤波器之瞬流. 物理学报, 1936, 2(1): 76-105. doi: 10.7498/aps.2.76
计量
  • 文章访问数:  3229
  • PDF下载量:  60
  • 被引次数: 0
出版历程
  • 收稿日期:  2021-09-02
  • 修回日期:  2021-10-12
  • 上网日期:  2022-02-25
  • 刊出日期:  2022-03-05

/

返回文章
返回