搜索

x

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

单摄像机下基于眼动分析的行为识别

孟春宁 白晋军 张太宁 刘润蓓 常胜江

引用本文:
Citation:

单摄像机下基于眼动分析的行为识别

孟春宁, 白晋军, 张太宁, 刘润蓓, 常胜江

Eye movement analysis for activity recognition based on one web camera

Meng Chun-Ning, Bai Jin-Jun, Zhang Tai-Ning, Liu Run-Bei, Chang Sheng-Jiang
PDF
导出引用
  • 眼动信息是识别观看视频、浏览网页等以视觉任务为主的行为的关键信息. 针对传统的可穿戴传感器普遍具有侵入性, 而现有基于视觉的眼动仪存在价格昂贵、校准过程复杂等问题, 本文尝试使用单一的标准网络摄像头获取眼动信息用于行为识别, 并评估了该方法的可行性. 提出一种针对低质量视频图像的虹膜跟踪算法以获取眼动信号, 然后分别从水平和垂直方向的眼动信号中提取出五种新的眼动特征, 并从中选择出最优特征子集, 最后采用支持向量机分类器评价了本文方法的可行性. 针对不同应用背景设计了三组验证实验: 留一交叉验证、k折交叉验证及单独校准测试, 三组实验中, 对不同参与者三种行为的平均识别正确率分别为68.4%, 79.3%及84.1%, 证明了基于视频图像的眼动分析用于行为识别是一种很有希望的传感形式, 并有望用于更为复杂的传感任务.
    Eye movement information is the key clue for recognizing the vision-dominated tasks, such as browsing the web, or watching a video. However, traditional wearable sensors are invasive and the vision-based eye trackers are very expensive and need time consuming calibration. Therefore, an activity recognition method based on eye movement analysis under one web camera is first proposed and the feasibility is assessed. First, an iris tracking method for the low quality image is proposed to acquire eye movement information. Then, five ten novel features are extracted from the horizontal and the vertical eye movement signals for activity recognition, and the optimal feature subset is selected. Finally, the support vector machine is used to assess the feasibility of the proposed method. Three experiments are designed for different applications: leave-one-out cross-validation, k-fold cross-validation, and validation after respective calibration. Experimental results show that their accuracies are 68.4%, 79.3% and 84.1%, respectively, which demonstrate the promise of eye based activity recognition using one web camera.
    • 基金项目: 教育部博士点基金(批准号: 20090031110033)和国家自然科学基金(批准号: 61171027)资助的课题.
    • Funds: Project supported by the National Natural Science Foundation of China (Grant No. 61171027), and the Doctoral program of Higher Education of China (Grant No. 20090031110033).
    [1]

    Shen H T, Li J W, Zhang B L, Chang S J, Wang K, Zhang Y X, Zhai H S 2006 Acta Phys. Sin. 55 6399 (in Chinese) [申会庭, 李江卫, 张便利, 常胜江, 王凯, 张延炘, 翟宏琛 2006 物理学报 55 6399]

    [2]

    Turaga P, Chellappa R, Subrahmanian V S, Udrea O 2008 IEEE Trans. Circ. Syst. Vid. 18 1473

    [3]
    [4]

    Najafi B, Aminian K, Paraschiv-Ionescu A, Loew F, Bula C J, Robert P 2003 IEEE Trans. Biomedical Eng. 50 711

    [5]
    [6]
    [7]

    Ward J A, Lukowicz P, Troster G, Starner T E 2006 IEEE Trans. Pattern. Anal. 28 1553

    [8]
    [9]

    Gordon D, Schmidtke H R, Beigl M, Zengen G V 2010 Proceedings of the 14th International Symposium on Wearable Computers Seoul, Oct.10-13, 2010 p1

    [10]

    Bulling A, Ward J A, Gellersen H, Troster G 2011 IEEE Trans. Pattern. Anal. 33 741

    [11]
    [12]
    [13]

    Zhang Z T, Zhang J S 2010 Chin. Phys. B 19 104601

    [14]

    Zhang W, Cheng B, Zhang B 2012 Acta Phys. Sin. 61 060701 (in Chinese) [张伟, 成波, 张波 2012 物理学报 61 060701]

    [15]
    [16]
    [17]

    Kim S M, Sked M, Ji Q 2004 Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society San Francisco, Sept.1-5, 2004 p2271

    [18]

    Hansen D W, Pece A E C 2005 Comput. Vis. Image. Und. 98 182

    [19]
    [20]

    Yoo D H, Chung M J 2005 Comput. Vision. Image. Und. 98 25

    [21]
    [22]
    [23]

    Shih S W, Liu J 2004 IEEE Trans. Syst. Man. Cy. B 34 234

    [24]

    Tsukada A, Kanade T 2012 Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara March 28-30, 2012 p213

    [25]
    [26]

    Meng C N, Zhang T N, Zhang P, Chang S J 2012 Opt. Eng. 51 077008

    [27]
    [28]

    Elhelw M, Nicolaou M, Chung A, Yang G Z, Atkins M S 2008 ACM Trans. Appl. Percept. 5 1

    [29]
    [30]
    [31]

    Dempere-Marco L, Hu X P, MacDonald S L S, Ellis S M, Hansell D M, Yang G Z 2002 IEEE Trans. Med. Imaging. 21 741

    [32]

    Manor B R, Gordon E 2003 J. Neurosci. Meth. 128 85

    [33]
    [34]
    [35]

    Hansen D W, Ji Q 2010 IEEE Trans. Pattern. Anal. 32 478

  • [1]

    Shen H T, Li J W, Zhang B L, Chang S J, Wang K, Zhang Y X, Zhai H S 2006 Acta Phys. Sin. 55 6399 (in Chinese) [申会庭, 李江卫, 张便利, 常胜江, 王凯, 张延炘, 翟宏琛 2006 物理学报 55 6399]

    [2]

    Turaga P, Chellappa R, Subrahmanian V S, Udrea O 2008 IEEE Trans. Circ. Syst. Vid. 18 1473

    [3]
    [4]

    Najafi B, Aminian K, Paraschiv-Ionescu A, Loew F, Bula C J, Robert P 2003 IEEE Trans. Biomedical Eng. 50 711

    [5]
    [6]
    [7]

    Ward J A, Lukowicz P, Troster G, Starner T E 2006 IEEE Trans. Pattern. Anal. 28 1553

    [8]
    [9]

    Gordon D, Schmidtke H R, Beigl M, Zengen G V 2010 Proceedings of the 14th International Symposium on Wearable Computers Seoul, Oct.10-13, 2010 p1

    [10]

    Bulling A, Ward J A, Gellersen H, Troster G 2011 IEEE Trans. Pattern. Anal. 33 741

    [11]
    [12]
    [13]

    Zhang Z T, Zhang J S 2010 Chin. Phys. B 19 104601

    [14]

    Zhang W, Cheng B, Zhang B 2012 Acta Phys. Sin. 61 060701 (in Chinese) [张伟, 成波, 张波 2012 物理学报 61 060701]

    [15]
    [16]
    [17]

    Kim S M, Sked M, Ji Q 2004 Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society San Francisco, Sept.1-5, 2004 p2271

    [18]

    Hansen D W, Pece A E C 2005 Comput. Vis. Image. Und. 98 182

    [19]
    [20]

    Yoo D H, Chung M J 2005 Comput. Vision. Image. Und. 98 25

    [21]
    [22]
    [23]

    Shih S W, Liu J 2004 IEEE Trans. Syst. Man. Cy. B 34 234

    [24]

    Tsukada A, Kanade T 2012 Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara March 28-30, 2012 p213

    [25]
    [26]

    Meng C N, Zhang T N, Zhang P, Chang S J 2012 Opt. Eng. 51 077008

    [27]
    [28]

    Elhelw M, Nicolaou M, Chung A, Yang G Z, Atkins M S 2008 ACM Trans. Appl. Percept. 5 1

    [29]
    [30]
    [31]

    Dempere-Marco L, Hu X P, MacDonald S L S, Ellis S M, Hansell D M, Yang G Z 2002 IEEE Trans. Med. Imaging. 21 741

    [32]

    Manor B R, Gordon E 2003 J. Neurosci. Meth. 128 85

    [33]
    [34]
    [35]

    Hansen D W, Ji Q 2010 IEEE Trans. Pattern. Anal. 32 478

  • [1] 冯婕, 崔益豪, 李豫东, 文林, 郭旗. CMOS有源像素传感器辐射损伤对星敏感器星图识别影响机理与识别算法. 物理学报, 2022, 71(18): 184208. doi: 10.7498/aps.71.20220894
    [2] 张如轩, 宗肖航, 于婷婷, 葛一璇, 胡适, 梁文杰. 基于纳米传感器矩阵的混合气体组分探测与识别. 物理学报, 2022, 71(18): 180702. doi: 10.7498/aps.71.20220955
    [3] 张嘉伟, 姚鸿博, 张远征, 蒋伟博, 吴永辉, 张亚菊, 敖天勇, 郑海务. 通过机器学习实现基于摩擦纳米发电机的自驱动智能传感及其应用. 物理学报, 2022, 71(7): 078702. doi: 10.7498/aps.71.20211632
    [4] 王鑫, 王俊林. 太赫兹波段电磁超材料吸波器折射率传感特性. 物理学报, 2021, 70(3): 038102. doi: 10.7498/aps.70.20201054
    [5] 王玥, 崔子健, 张晓菊, 张达篪, 张向, 周韬, 王暄. 超材料赋能先进太赫兹生物化学传感检测技术的研究进展. 物理学报, 2021, 70(24): 247802. doi: 10.7498/aps.70.20211752
    [6] 张国英, 焦兴强, 刘业舒, 张安国, 孟春雪. 缺陷与掺杂共存的黑磷烯甲醛传感行为的电子理论. 物理学报, 2020, 69(23): 237101. doi: 10.7498/aps.69.20200990
    [7] 李雪健, 曹敏, 汤敏, 芈月安, 陶洪, 古皓, 任文华, 简伟, 任国斌. M型少模光纤中模间受激布里渊散射特性及其温度和应变传感特性. 物理学报, 2020, 69(11): 114203. doi: 10.7498/aps.69.20200103
    [8] 李媛, 彭平. 非晶Ag晶化过程中不同类型晶核结构的识别与跟踪. 物理学报, 2019, 68(7): 076401. doi: 10.7498/aps.68.20182188
    [9] 涂兴华, 赵宜超. 对称熔融拉锥型光纤光栅温度和应力传感特性. 物理学报, 2019, 68(24): 244204. doi: 10.7498/aps.68.20191034
    [10] 王帆, 李豫东, 郭旗, 汪波, 张兴尧, 文林, 何承发. 基于4晶体管像素结构的互补金属氧化物半导体图像传感器总剂量辐射效应研究. 物理学报, 2016, 65(2): 024212. doi: 10.7498/aps.65.024212
    [11] 汪波, 李豫东, 郭旗, 刘昌举, 文林, 任迪远, 曾骏哲, 玛丽娅. 质子辐射下互补金属氧化物半导体有源像素传感器暗信号退化机理研究. 物理学报, 2015, 64(8): 084209. doi: 10.7498/aps.64.084209
    [12] 张玉萍, 李彤彤, 吕欢欢, 黄晓燕, 张会云. 工字形太赫兹超材料吸波体的传感特性研究. 物理学报, 2015, 64(11): 117801. doi: 10.7498/aps.64.117801
    [13] 邓芳明, 何怡刚, 佐磊, 李兵, 吴可汗. 基于无源超高频射频识别标签的湿度传感器设计. 物理学报, 2014, 63(18): 188402. doi: 10.7498/aps.63.188402
    [14] 张伟, 成波, 张波. 驾驶人眼睛区域的鲁棒性定位算法研究. 物理学报, 2012, 61(6): 060701. doi: 10.7498/aps.61.060701
    [15] 马晓燠, 郭友明, 饶长辉, 魏凯, 田雨, 饶学军. 多阳极PMT的串扰对四象限倾斜跟踪传感器跟踪精度的影响. 物理学报, 2012, 61(24): 242902. doi: 10.7498/aps.61.242902
    [16] 马晓燠, 母杰, 饶长辉. 死区对四象限跟踪传感器跟踪精度的影响. 物理学报, 2012, 61(7): 072903. doi: 10.7498/aps.61.072903
    [17] 张文铸, 袁 坚, 俞 哲, 徐赞新, 山秀明. 基于元胞自动机的无线传感网络整体行为研究. 物理学报, 2008, 57(11): 6896-6900. doi: 10.7498/aps.57.6896
    [18] 马卫东, 王 磊, 李幼平, 水鸿寿, 周明天. 用户需求行为对互联网动力学整体特性的影响. 物理学报, 2008, 57(3): 1381-1388. doi: 10.7498/aps.57.1381
    [19] 王 磊, 周淑华, 袁 坚, 任 勇, 山秀明. 虚拟网络行为对互联网整体特性的影响. 物理学报, 2007, 56(1): 36-42. doi: 10.7498/aps.56.36
    [20] 乔学光, 贾振安, 傅海威, 李 明, 周 红. 光纤光栅温度传感理论与实验. 物理学报, 2004, 53(2): 494-497. doi: 10.7498/aps.53.494
计量
  • 文章访问数:  5074
  • PDF下载量:  565
  • 被引次数: 0
出版历程
  • 收稿日期:  2012-11-20
  • 修回日期:  2013-04-30
  • 刊出日期:  2013-09-05

/

返回文章
返回