-
Pixel-wise coded exposure (PCE) imaging based on digital micromirror device (DMD) is an advanced high-speed imaging technology, which can realize the high-speed imaging by using a low-frame-rate camera. During exposure time, the multi-frame image information of a dynamic object can be integrated into one encoded image, and then the multi-frame sub-exposure images can be extracted by the post-processing algorithm. Therefore, the accurate pixel-to-pixel alignment between the DMD and the camera is the key step to realize PCE imaging, which has drawn much attention from researchers. So their studies mainly focused on how to achieve accurate pixel matching. However, the resolution of the relay imaging lens, as another important influence factor of PCE imaging, also has a significant influence on the imaging results, but few people have studied and analyzed it. To solve this problem, in this work, we theoretically analyze the influence of the resolution of the relay imaging system on the reconstructed decoded images, and verifies the theoretical analysis through simulation and imaging experiments. On this basis, a PCE imaging system is built, and a point spread function (PSF) estimation method of relay lens based on the fringe phase is proposed. Furthermore, a Richard-Lucy deconvolution algorithm is introduced into the reconstruction process of coded image to effectively improve the quality of PCE imaging, which is of great significance in developing the PCE imaging technology.
-
Keywords:
- high-speed imaging /
- pixel-wise coded exposure imaging /
- relay lens /
- digital micromirror device
[1] Akiyama M, Yang Z B, Gnapowski S, Hamid S, Hosseini R, Akiyama H 2014 IEEE Trans. Plasma Sci. 42 3215
Google Scholar
[2] 李明飞, 莫小范, 赵连洁, 霍娟, 杨然, 李凯, 张安宁 2016 物理学报 65 064201
Google Scholar
Li M F, Mo X F, Zhao L J, Huo J, Yang R, Li K, Zhang A N 2016 Acta Phys. Sin. 65 064201
Google Scholar
[3] Zhang J, Xiong T, Tran T, Chin S, Cummings R E 2016 Opt. Express 24 9013
Google Scholar
[4] Khan S R, Feldman M, Gunturk B K 2018 Signal Process. Image Commun. 60 107
Google Scholar
[5] 冯维, 张福民, 王惟婧, 曲兴华 2017 物理学报 66 234201
Google Scholar
Feng W, Zhang F M, Wang W J, Qu X H 2017 Acta Phys. Sin. 66 234201
Google Scholar
[6] Qiao Y, Xu X P, Liu T, Pan Y 2015 Appl Opt. 54 60
Google Scholar
[7] Tang C Y, Chen Y T, Li Q, Feng H J, Xu Z H 2015 Optica 35 0410002
[8] Bub G, Tecza M, Helmes M, Lee P, Kohl P 2009 Nat. Methods 7 209
[9] Ri S, Fujigaki M, Morimoto Y 2009 Opt. Eng. 48 103605
Google Scholar
[10] Liu D Y, Gu J W, Hitomi Y, Gupta M, Mitsunaga T, Nayar S K 2013 IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36 248
[11] Feng W, Zhang F M, Qu X H, Zheng S W 2016 Sensors 16 331
[12] Peng X, Tian J D, Zhang P, Wei L B, Qiu W J, Li E B, Zhang D W 2005 Opt. Lett. 30 1965
Google Scholar
[13] Niu B, Qu X H, Guan X H, Zhang F M 2021 Opt. Express 29 27562
Google Scholar
[14] Gunturk B K, Feldman M 2013 Proc. SPIE 8660 86600P
Google Scholar
[15] Feng W, Zhang F M, Wang W J, Xing W, Qu X H 2017 Appl. Opt. 56 3831
Google Scholar
[16] Wang C M, Tu C 2014 Int. J. Signal Process. Image Process. Pattern Recognit. 7 217
[17] Gao L, Liang J Y, Li C Y, Wang L H 2014 Nature 516 74
Google Scholar
[18] Adekunle A, Barakat N 2009 Opt. Express 17 1831
Google Scholar
[19] Liu Y, Wang Z F 2015 J. Visual Commun. Image Represent. 31 208
Google Scholar
[20] Gu B, Li W J, Wong J T, Zhu M Y, Wang M H 2012 J. Visual Commun. Image Represent. 23 604
Google Scholar
[21] Ri S, Fujigaki M, Matui T, Morimoto Y 2006 Appl. Opt. 45 6940
Google Scholar
[22] Ri S, Fujigaki M, Matui T, Morimoto Y 2006 Exp. Mech. 46 67
Google Scholar
-
图 1 (a) 像素编码曝光成像光路设计; (b) 实验装置; (c) DMD微反射镜与CCD像素对应关系
Figure 1. (a) Optical configuration design of pixel-wise coded exposure; (b) experimental device; (c) mapping relationship between DMD micro-mirrors and the CCD pixels.
图 2 (a) 单帧编码图像; (b) DMD与CCD之间的同步控制原理; (c) 不同时刻的重构图像信息
Figure 2. (a) Single frame encoded image; (b) principle of synchronous control between DMD and CCD; (c) reconstructed image information at different times.
图 3 (a)
$ \sigma $ = 0.3 pixelsize时的成像效果; (b)$ \sigma $ = 0.6 pixelsize时的成像效果; (c)$ \sigma $ = 0.9 pixelsize时的成像效果Figure 3. (a) Imaging effect of image I when
$ \sigma $ = 0.3 pixelsize; (b) imaging effect of imageI when $ \sigma $ = 0.6 pixelsize; (c) imaging effect of image I when$ \sigma $ = 0.9 pixelsize.
图 4 (a) 单帧条纹编码图像; (b) 数值模拟产生的PSF; (c) 重构的条纹图像信息; (d) 计算获得的相位图; (e) 图(d)中黄线虚线处的切面相位值
Figure 4. (a) Single frame fringe encoded image; (b) numerical simulation of PSF; (c) reconstructed fringe image information; (d) calculated phase diagram; (e) section phase value at dotted line of yellow line in Figure (d).
图 5 单帧编码图像
Figure 5. Single frame encoded image.
图 6 (a)—(c) 不同
$ \sigma $ 值的编码图像; (e)—(g) 对编码图像直接提取得到的重构图像; (h)—(k)对编码图像反卷积处理后的重构图像Figure 6. (a)–(c) Coded images of different
$ \sigma $ ; (e)–(g) the reconstructed image obtained by directly extracting the coded image; (h)–(k) the reconstructed image after deconvolution of the coded image.
图 7 (a) 编码图像; (b) 重构的条纹图像信息; (c) 相位图; (d) 图(c)中黄线位置的切面相位值的线性拟合结果
Figure 7. (a) Coded images; (b) reconstructed fringe image information; (c) phase diagram; (d) linear fitting results of phase values of the yellow line position in Figure (c).
图 8 (a) 低分辨率条件下的编码图像及重构结果; (b) 编码图象(a)经反卷积处理及重构的结果; (c) 高分辨率条件下的编码图像及重构结果; (d) 编码图象(c)经反卷积处理及重构的结果
Figure 8. (a) Coded images and reconstruction results at low resolution; (b) results of deconvolution and reconstruction of coded image (a); (c) coded images and reconstruction results at high resolution; (d) results of deconvolution and reconstruction of coded image (c).
-
[1] Akiyama M, Yang Z B, Gnapowski S, Hamid S, Hosseini R, Akiyama H 2014 IEEE Trans. Plasma Sci. 42 3215
Google Scholar
[2] 李明飞, 莫小范, 赵连洁, 霍娟, 杨然, 李凯, 张安宁 2016 物理学报 65 064201
Google Scholar
Li M F, Mo X F, Zhao L J, Huo J, Yang R, Li K, Zhang A N 2016 Acta Phys. Sin. 65 064201
Google Scholar
[3] Zhang J, Xiong T, Tran T, Chin S, Cummings R E 2016 Opt. Express 24 9013
Google Scholar
[4] Khan S R, Feldman M, Gunturk B K 2018 Signal Process. Image Commun. 60 107
Google Scholar
[5] 冯维, 张福民, 王惟婧, 曲兴华 2017 物理学报 66 234201
Google Scholar
Feng W, Zhang F M, Wang W J, Qu X H 2017 Acta Phys. Sin. 66 234201
Google Scholar
[6] Qiao Y, Xu X P, Liu T, Pan Y 2015 Appl Opt. 54 60
Google Scholar
[7] Tang C Y, Chen Y T, Li Q, Feng H J, Xu Z H 2015 Optica 35 0410002
[8] Bub G, Tecza M, Helmes M, Lee P, Kohl P 2009 Nat. Methods 7 209
[9] Ri S, Fujigaki M, Morimoto Y 2009 Opt. Eng. 48 103605
Google Scholar
[10] Liu D Y, Gu J W, Hitomi Y, Gupta M, Mitsunaga T, Nayar S K 2013 IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36 248
[11] Feng W, Zhang F M, Qu X H, Zheng S W 2016 Sensors 16 331
[12] Peng X, Tian J D, Zhang P, Wei L B, Qiu W J, Li E B, Zhang D W 2005 Opt. Lett. 30 1965
Google Scholar
[13] Niu B, Qu X H, Guan X H, Zhang F M 2021 Opt. Express 29 27562
Google Scholar
[14] Gunturk B K, Feldman M 2013 Proc. SPIE 8660 86600P
Google Scholar
[15] Feng W, Zhang F M, Wang W J, Xing W, Qu X H 2017 Appl. Opt. 56 3831
Google Scholar
[16] Wang C M, Tu C 2014 Int. J. Signal Process. Image Process. Pattern Recognit. 7 217
[17] Gao L, Liang J Y, Li C Y, Wang L H 2014 Nature 516 74
Google Scholar
[18] Adekunle A, Barakat N 2009 Opt. Express 17 1831
Google Scholar
[19] Liu Y, Wang Z F 2015 J. Visual Commun. Image Represent. 31 208
Google Scholar
[20] Gu B, Li W J, Wong J T, Zhu M Y, Wang M H 2012 J. Visual Commun. Image Represent. 23 604
Google Scholar
[21] Ri S, Fujigaki M, Matui T, Morimoto Y 2006 Appl. Opt. 45 6940
Google Scholar
[22] Ri S, Fujigaki M, Matui T, Morimoto Y 2006 Exp. Mech. 46 67
Google Scholar
DownLoad:
Catalog
Metrics
- Abstract views: 2358
- PDF Downloads: 51
- Cited By: 0
