Search

Article

x

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

Color image perception based on stochastic spiking neural network

Xu Zi-Heng He Yu-Zhu Kang Yan-Mei

Citation:

Color image perception based on stochastic spiking neural network

Xu Zi-Heng, He Yu-Zhu, Kang Yan-Mei
PDF
HTML
Get Citation
  • Our aim is to present an interpretable algorithm for enhancing low-illuminance color image based on the principle of stochastic resonance and the fundamental biophysical process of human brain perceiving object color. To this end, the phenomenon of stochastic resonance in a conductance-based integrate-and-fire neuronal network is first explored, with the effect of firing threshold, synaptic weight and the population size on the signal-to-noise ratio revealed, and the firing threshold is recognized as the key parameter for the resonance effects. And then, a color image enhancement algorithm, where the peak signal-to-noise ratio and the natural image quality evaluator are adopted as quantifying indexes, is developed by combining the stochastic spiking neuronal network and the involved biophysical process relating to visual perception. Note that the enhanced image is aperiodic, thus in order to optimize the performance of the algorithm, an illuminance distribution based threshold strategy is given by us for the first time. The numerical tests show that the algorithm has good enhancement performance and stability. We wish this algorithm could be applied to relevant signal processing fields such as military detection and medical image preprocessing.
      Corresponding author: Kang Yan-Mei, ymkang@xjtu.edu.cn
    • Funds: Project supported by the National Natural Science Foundation of China (Grant Nos. 11772241, 12172268).
    [1]

    Gonzalez C R, Woods R E 2002 Digital Image Processing (2nd Ed.) (New Jersey: Prentice Hall) pp88–108

    [2]

    Kwong R H, Johnston E W 1992 IEEE Trans. Signal Process. 40 1633Google Scholar

    [3]

    Dai Q, Pu Y F, Rahman Z, Aamir Z 2019 Symmetry Basel 11 574Google Scholar

    [4]

    Benzi R, Sutera A, Vulpiani, A 1981 J. Phys. A-Math. Gen. 14 453Google Scholar

    [5]

    Gammaitoni L, Hanggi P, Jung P, Marchesoni F 1998 Rev. Mod. Phys. 70 223Google Scholar

    [6]

    Simonotto E, Riani M, Seife C, Roberts M, Twitty J, Moss F 1997 Phys. Rev. Lett. 78 1186Google Scholar

    [7]

    Sasaki H, Sakane S, Ishida T, Todorokihara M, Kitamura T, Aoki R 2008 Behav. Brain. Res. 193 152Google Scholar

    [8]

    Yang T 1998 Phys. Lett. A 245 79Google Scholar

    [9]

    Delahaies A, Rousseau D, Fasqueal J B, Chapeau-Blondeau F 2012 J. Opt. Soc. Am. A: 29 1211

    [10]

    Jha R K, Chouhan R 2014 Signal Image Video Process. 8 339Google Scholar

    [11]

    Dylov D V, Fleischer J W 2010 Nat. Photonics 4 323Google Scholar

    [12]

    Patel A, Kosko B 2011 IEEE Trans. Signal Process. 59 488Google Scholar

    [13]

    Itzcovich E, Riani M, Sannita W G 2017 Sci. Rep. 7 12840Google Scholar

    [14]

    Van-der-Groen O, Tang M F, Wenderoth N, Mattingley J B, Jeff B 2018 PLoS Comput. Biol. 14 1

    [15]

    Nnoli U 2019 Optik 195 163111Google Scholar

    [16]

    Kang Y M, Xu J X, Xie Y 2005 Phys. Rev. E 72 021902Google Scholar

    [17]

    Yu Y G, Richard R D, Lee T S 2005 Phys. Rev. Lett. 94 108103Google Scholar

    [18]

    Ashok P, Bart K 2008 IEEE Trans. Neural Networks 19 1993

    [19]

    Purves D 2011 Brains: How They Seem to Work (New Jersey : Financial Times Press Science) pp30–47

    [20]

    Li Z P 2019 Curr. Opin. Neurobiol. 58 1

    [21]

    Fu Y X, Kang Y M, Chen G R 2020 Front. Comput. Neurosci. 14 24Google Scholar

    [22]

    Rolls E L, Loh M, Deco G, Winterer G 2008 Nat. Rev. Neurosci. 9 696Google Scholar

    [23]

    Smith R A 1978 Siggraph Comput. Graph 12 12Google Scholar

    [24]

    Lagnado L 2000 Exp. Physiol. 85 1Google Scholar

    [25]

    Kang Y M, Liu R N, Mao X R 2021 Cognitive Neurodynamics 15 517Google Scholar

    [26]

    Tiwari I, Phogat R, Parmananda P, Ocampo-Espindola J L, Rivera L 2016 Phys. Rev. E 94 022210Google Scholar

    [27]

    Mittal A, Soundararajan R, Bovik A C 2013 IEEE Signal Process. Let. 20 209Google Scholar

    [28]

    Durrant S, Kang Y M, Stocks N, Feng J F 2011 Phys. Rev. E 84 011923Google Scholar

    [29]

    Faisal A A, Selen L P J, Wolpert D P 2008 Nat. Rev. Neurosci. 9 292Google Scholar

    [30]

    Wilke S D, Eurich C 2001 W 10th Computational Neuroscience Meeting Monterey, USA, June, 2001 p1023

    [31]

    Wiesenfeld K, Moss F 1995 Nature 373 33Google Scholar

    [32]

    Levin J E, Miller J P 1996 Nature 380 165Google Scholar

    [33]

    Stacey W C, Durand D M 2000 J. Neurosci. 83 1394

  • 图 1  模型(1)的时间历程图 (a)仅含漏电项的单个神经元膜电位示意图, ${V_{{\text{re}}}}=-0.3$; (b)无噪声时单个神经元的膜电位演化; (c)有噪声时单个神经元的膜电位演化; (d)有噪声的单个神经元的放电序列串; (e)有噪声神经元集群的放电格栅图, 其中实心点代表当前时刻所对应的神经元有动作电位产生. 图(b)至图(e)参数: ${V_{\rm th}} = 0.3$, ${V_{\rm re}} = $$ 0$, ${g_{\rm{l}}} = {g_{\rm{s}}} = 1$, ${C_m} = 1$, ${E_{\rm syn}} = 0$, $\varepsilon = 0.1$, $ \varOmega = 1 $, ${\tau _{{s}}} = 1$, ${\tau _{\rm{d}}} = 0.5$, $N = 50$, $t = 100$; (b) $D = 0$; (c), (e) $D = $$ 0.025$

    Figure 1.  The evolution diagram of model (1): (a)Single neuron’s potential only with leaky term, ${V_{{\text{re}}}}=-0.3$; (b) single neuron’s membrane potential evolution without noise; (c) single Neuron’s membrane potential evolution with noise; (d) single neuron’s spike train with noise; (e) raster plot of the network where every node denotes a spike at a corresponding time and neuron. Parameters from picture (b) to (e) are set as ${V_{\rm th}} = 0.3$, ${V_{\rm re}} = 0$, ${g_{\rm{l}}} = {g_{\rm{s}}} = 1$, ${C_m} = 1$, ${E_{\rm syn}} = 0$, $\varepsilon = 0.1$, $ \varOmega = 1 $, ${\tau _{{s}}} = 1$, ${\tau _{\rm{d}}} = 0.5$, $N = 50$, $t = 100$; (b)$D = 0$; (c), (e)$D = 0.025$.

    图 2  (a)信噪比随阈值${V_{\rm th}}$, 突触权重$w$变化图; (b)不同阈值信噪比变化情况; (c)不同突触权重信噪比变化情况. 参数${V_{\rm re}} = 0$, ${g_{\rm{l}}} = {g_{\rm{s}}} = 1$, ${C_{\rm{m}}} = 1$, ${E_{\rm syn}} = 0$, $\varepsilon = 0.1$, $ \varOmega = 1 $, ${\tau _{{s}}} = 1$, ${\tau _{\rm{d}}} = 0.5$, $N = 5$, $t = 100$

    Figure 2.  (a) Signal-to-noise ratio for different threshold Vth and synaptic weight w; (b) signal-to-noise ratio for different threshold Vth; (c) signal-to-noise ratio for different synaptic weight w. Parameters are set as ${V_{\rm re}} = 0$, ${g_{\rm{l}}} = {g_{\rm{s}}} = 1$, ${C_{\rm{m}}} = 1$, ${E_{\rm syn}} = 0$, $\varepsilon = 0.1$, $ \Omega = 1 $, ${\tau _{{s}}} = 1$, ${\tau _{\text{d}}} = 0.5$, $N = 5$, $t = 100$.

    图 3  信噪比随神经元集群尺寸变化图, 参数${V_{\rm th}} = 0.3$, $w = - 0.2$, ${V_{\rm re}} = 0$, ${g_{\rm{l}}} = {g_{\rm{s}}} = 1$, ${C_{\rm{m}}} = 1$, ${E_{\rm syn}} = 0$, $\varepsilon = 0.1$, $ \varOmega = 1 $, ${\tau _{{s}}} = 1$, ${\tau _{\rm{d}}} = 0.5$, $t = 100$

    Figure 3.  Signal-to-noise ratio for different quantity of neurons with ${V_{\rm th}} = 0.3$, $w = - 0.2$, ${V_{\rm re}} = 0$, ${g_{\rm{l}}} = {g_{\rm{s}}} = 1$, ${C_{\rm{m}}} = 1$, ${E_{\rm syn}} = 0$, $\varepsilon = 0.1$, $ \varOmega = 1 $, ${\tau _{{s}}} = 1$, ${\tau _{\rm{d}}} = 0.5$, $t = 100$.

    图 4  图像增强流程图

    Figure 4.  The flow chart of dark image enhancement algorithm.

    图 5  编码过程流程图

    Figure 5.  The flow chart of encoding part.

    图 6  不同神经元个数对最优增强图像质量的影响 (a)神经元个数N=50; (b)神经元个数N=300; (c)峰值信噪比(PSNR)变化曲线, 虚线代表在此噪声强度取得最优图像. 参数${V_{{\text{th}}}} = 0.0667$, $w = - 0.2$, ${V_{{\text{re}}}} = 0$, ${g_{\text{l}}} = {g_{\text{s}}} = 1$, ${C_{\text{m}}} = 1$, ${E_{{\text{syn}}}} = 0$, ${\tau _s} = 1$, ${\tau _{\text{d}}} = 0.5$, $t = 100$

    Figure 6.  Difference caused by the size of neuron population: (a) N=50; (b) N=300; (c) peak signal-to-noise ratio(PSNR) curve, the dotted line reflects the noise density corresponds to the best enhanced picture. Parameters are set as ${V_{{\text{th}}}} = 0.0667$, $w = - 0.2$, ${V_{{\text{re}}}} = 0$, ${g_{\text{l}}} = {g_{\text{s}}} = 1$, ${C_{\text{m}}} = 1$, ${E_{{\text{syn}}}} = 0$, ${\tau _s} = 1$, ${\tau _{\text{d}}} = 0.5$, $t = 100$.

    图 7  亮度的频数分布直方图 (a) 原始黑暗图像; (b) 0.6分位点最优图像; (c) 0.95分位点最优图像

    Figure 7.  Frequency histogram of brightness: (a) The origin dark image; (b) best image corresponding to 60 percent quantile; (c) best image corresponding to 95 percent quantile.

    图 8  不同阈值下对应的最优增强图像 (a) 0.6分位点; (b) 0.95分位点; (c) 峰值信噪比变化曲线, 虚线处表示最优噪声强度. 参数$w = - 0.2$, ${V_{{\text{re}}}} = 0$, ${g_{\text{l}}} = {g_{\text{s}}} = 1$, ${C_{\text{m}}} = 1$, ${E_{{\text{syn}}}} = 0$, ${\tau _s} = 1$, ${\tau _{\text{d}}} = 0.5$, $N = 300$, $t = 100$

    Figure 8.  Best enhanced images with different membrane potential thresholds: (a) 60 percent quantile; (b) 95 percent quantile; (c) peak signal-to-noise ratio(PSNR) curves, the dotted line reflects the noise density corresponds to the best enhanced picture. Parameters are set as $w = - 0.2$, ${V_{{\text{re}}}} = 0$, ${g_{\text{l}}} = {g_{\text{s}}} = 1$, ${C_{\text{m}}} = 1$, ${E_{{\text{syn}}}} = 0$, ${\tau _ s} = 1$, ${\tau _{\text{d}}} = 0.5$, $N = 300$, $t = 100$.

    图 9  图像增强结果 (a) 原始黑暗图像; (b) 原始清晰图像; (c) 本文提出的随机共振方法, $D = 0.0035$, ${V_{{\text{th}}}} = 0.0667$; (d) SSR算法; (e) HE算法; (f) SVD-DSR算法

    Figure 9.  (a) The origin dark image; (b) the origin bright image; (c) our stochastic-resonance algorithm with $D = 0.0035$and ${V_{{\text{th}}}} = 0.0667$; (d) SSR algorithm; (e) HE algorithm; (f) SVD-DSR algorithm.

    图 10  图像增强结果 (a) 原始黑暗图像; (b) 本文提出的随机共振方法$D = 0.0035$, ${V_{{\text{th}}}} = 0.11$; (c) SSR算法; (d) HE算法; (e) SVD-DSR算法; (f) NIQE变化图

    Figure 10.  (a) The origin dark image; (b) our stochastic-resonance algorithm with $D = 0.0035$ and ${V_{{\text{th}}}} = 0.11$; (c) SSR algorithm; (d) HE algorithm; (e) SVD-DSR algorithm; (f) NIQE under different noise densities.

    表 1  四种算法的PSNR和NIQE

    Table 1.  PSNR and NIQE of these four algorithms.

    图像质量评价指标本文提出的随机共振算法SSRHESVD-DSR
    PSNR21.58378.008914.653715.9144
    NIQE3.45704.01105.05435.0330
    DownLoad: CSV

    表 2  四种算法的PSNR和NIQE

    Table 2.  PSNR and NIQE of these four algorithms.

    图像质量评价指标本文提出的随机共振算法SSRHESVD-DSR
    NIQE3.68904.37124.65454.9605
    DownLoad: CSV
  • [1]

    Gonzalez C R, Woods R E 2002 Digital Image Processing (2nd Ed.) (New Jersey: Prentice Hall) pp88–108

    [2]

    Kwong R H, Johnston E W 1992 IEEE Trans. Signal Process. 40 1633Google Scholar

    [3]

    Dai Q, Pu Y F, Rahman Z, Aamir Z 2019 Symmetry Basel 11 574Google Scholar

    [4]

    Benzi R, Sutera A, Vulpiani, A 1981 J. Phys. A-Math. Gen. 14 453Google Scholar

    [5]

    Gammaitoni L, Hanggi P, Jung P, Marchesoni F 1998 Rev. Mod. Phys. 70 223Google Scholar

    [6]

    Simonotto E, Riani M, Seife C, Roberts M, Twitty J, Moss F 1997 Phys. Rev. Lett. 78 1186Google Scholar

    [7]

    Sasaki H, Sakane S, Ishida T, Todorokihara M, Kitamura T, Aoki R 2008 Behav. Brain. Res. 193 152Google Scholar

    [8]

    Yang T 1998 Phys. Lett. A 245 79Google Scholar

    [9]

    Delahaies A, Rousseau D, Fasqueal J B, Chapeau-Blondeau F 2012 J. Opt. Soc. Am. A: 29 1211

    [10]

    Jha R K, Chouhan R 2014 Signal Image Video Process. 8 339Google Scholar

    [11]

    Dylov D V, Fleischer J W 2010 Nat. Photonics 4 323Google Scholar

    [12]

    Patel A, Kosko B 2011 IEEE Trans. Signal Process. 59 488Google Scholar

    [13]

    Itzcovich E, Riani M, Sannita W G 2017 Sci. Rep. 7 12840Google Scholar

    [14]

    Van-der-Groen O, Tang M F, Wenderoth N, Mattingley J B, Jeff B 2018 PLoS Comput. Biol. 14 1

    [15]

    Nnoli U 2019 Optik 195 163111Google Scholar

    [16]

    Kang Y M, Xu J X, Xie Y 2005 Phys. Rev. E 72 021902Google Scholar

    [17]

    Yu Y G, Richard R D, Lee T S 2005 Phys. Rev. Lett. 94 108103Google Scholar

    [18]

    Ashok P, Bart K 2008 IEEE Trans. Neural Networks 19 1993

    [19]

    Purves D 2011 Brains: How They Seem to Work (New Jersey : Financial Times Press Science) pp30–47

    [20]

    Li Z P 2019 Curr. Opin. Neurobiol. 58 1

    [21]

    Fu Y X, Kang Y M, Chen G R 2020 Front. Comput. Neurosci. 14 24Google Scholar

    [22]

    Rolls E L, Loh M, Deco G, Winterer G 2008 Nat. Rev. Neurosci. 9 696Google Scholar

    [23]

    Smith R A 1978 Siggraph Comput. Graph 12 12Google Scholar

    [24]

    Lagnado L 2000 Exp. Physiol. 85 1Google Scholar

    [25]

    Kang Y M, Liu R N, Mao X R 2021 Cognitive Neurodynamics 15 517Google Scholar

    [26]

    Tiwari I, Phogat R, Parmananda P, Ocampo-Espindola J L, Rivera L 2016 Phys. Rev. E 94 022210Google Scholar

    [27]

    Mittal A, Soundararajan R, Bovik A C 2013 IEEE Signal Process. Let. 20 209Google Scholar

    [28]

    Durrant S, Kang Y M, Stocks N, Feng J F 2011 Phys. Rev. E 84 011923Google Scholar

    [29]

    Faisal A A, Selen L P J, Wolpert D P 2008 Nat. Rev. Neurosci. 9 292Google Scholar

    [30]

    Wilke S D, Eurich C 2001 W 10th Computational Neuroscience Meeting Monterey, USA, June, 2001 p1023

    [31]

    Wiesenfeld K, Moss F 1995 Nature 373 33Google Scholar

    [32]

    Levin J E, Miller J P 1996 Nature 380 165Google Scholar

    [33]

    Stacey W C, Durand D M 2000 J. Neurosci. 83 1394

  • [1] Wang Ye-Hua, He Mei-Juan. Stochastic resonance in asymmetric bistable coupled network systems driven by Gaussian colored noise. Acta Physica Sinica, 2022, 71(19): 190501. doi: 10.7498/aps.71.20220909
    [2] Liu Guang-Kai, Quan Hou-De, Kang Yan-Mei, Sun Hui-Xian, Cui Pei-Zhang, Han Yue-Ming. A quadratic polynomial receiving scheme for sine signals enhanced by stochastic resonance. Acta Physica Sinica, 2019, 68(21): 210501. doi: 10.7498/aps.68.20190952
    [3] Xie Yong, Liu Ruo-Nan. Stochastic resonance in overdamped washboard potential system. Acta Physica Sinica, 2017, 66(12): 120501. doi: 10.7498/aps.66.120501
    [4] Li Guo-Fang, Sun Xiao-Juan. Effects of hybrid synapses and partial time delay on stochastic resonance in a small-world neuronal network. Acta Physica Sinica, 2017, 66(24): 240501. doi: 10.7498/aps.66.240501
    [5] Liu Jin-Jun, Leng Yong-Gang, Lai Zhi-Hui, Tan Dan. Stochastic resonance based on frequency information exchange. Acta Physica Sinica, 2016, 65(22): 220501. doi: 10.7498/aps.65.220501
    [6] Jin Yan-Fei, Li Bei. Stochastic resonance in a piecewise nonlinear system driven by colored correlated additive and multiplicative colored noises. Acta Physica Sinica, 2014, 63(21): 210501. doi: 10.7498/aps.63.210501
    [7] Dong Xiao-Juan, Yan Ai-Jun. The relationship between stochastic resonance and coherence resonance in a bi-stable system. Acta Physica Sinica, 2013, 62(7): 070501. doi: 10.7498/aps.62.070501
    [8] Zhang Jing-Jing, Jin Yan-Fei. Stochastic resonance in FHN neural system driven by non-Gaussian noise. Acta Physica Sinica, 2012, 61(13): 130502. doi: 10.7498/aps.61.130502
    [9] Zhang Lu, Zhong Su-Chuan, Peng Hao, Luo Mao-Kang. Stochastic resonance in an over-damped linear oscillator driven by multiplicative quadratic noise. Acta Physica Sinica, 2012, 61(13): 130503. doi: 10.7498/aps.61.130503
    [10] Yu Hai-Tao, Wang Jiang, Liu Chen, Che Yan-Qiu, Deng Bin, Wei Xi-Le. Stochastic resonance in coupled small-world neural networks. Acta Physica Sinica, 2012, 61(6): 068702. doi: 10.7498/aps.61.068702
    [11] Liang Xiao-Bing, Liu Xi-Shun, Liu An-Zhi, Wang Bo-Liang. The transmission of weak signal in one-way coupled Hodgkin-Huxley neural system. Acta Physica Sinica, 2009, 58(7): 5065-5069. doi: 10.7498/aps.58.5065
    [12] Wang Mao-Sheng. Frequency-dependent stochastic resonance in a two-dimensional neural map. Acta Physica Sinica, 2009, 58(10): 6833-6837. doi: 10.7498/aps.58.6833
    [13] Lin Min, Huang Yong-Mei, Fang Li-Min. The feedback control of stochastic resonance in bistable system. Acta Physica Sinica, 2008, 57(4): 2041-2047. doi: 10.7498/aps.57.2041
    [14] Lin Min, Mao Qian-Min, Zheng Yong-Jun, Li Dong-Sheng. Frequency matching method for stochastic resonance control. Acta Physica Sinica, 2007, 56(9): 5021-5025. doi: 10.7498/aps.56.5021
    [15] Ning Li-Juan, Xu Wei. Stochastic resonance in optical bistable system. Acta Physica Sinica, 2007, 56(4): 1944-1947. doi: 10.7498/aps.56.1944
    [16] Leng Yong-Gang, Wang Tai-Yong, Guo Yan, Wu Zhen-Yong. Study of the property of the parameters of bistable stochastic resonance. Acta Physica Sinica, 2007, 56(1): 30-35. doi: 10.7498/aps.56.30
    [17] Peng Jian-Hua, Yu Hong-Jie. Associative memory and segmentation in the neural system under stimulation of stochastic or chaotic perceptual singals. Acta Physica Sinica, 2007, 56(8): 4353-4360. doi: 10.7498/aps.56.4353
    [18] Zhou Xiao-Rong, Luo Xiao-Shu, Jiang Pin-Qun, Yuan Wu-Jie. The second super-harmonic stochastic resonance in the neural networks with small-world character. Acta Physica Sinica, 2007, 56(10): 5679-5683. doi: 10.7498/aps.56.5679
    [19] Leng Yong-Gang, Wang Tai-Yong, Guo Yan, Wang Wen-Jin, Hu Shi-Guang. Stochastic resonance behaviors of bistable systems connected in series. Acta Physica Sinica, 2005, 54(3): 1118-1125. doi: 10.7498/aps.54.1118
    [20] Shao Yuan-Zhi, Zhong Wei-Rong, Lin Guang-Ming, Li Jian-Can. Stochastic resonance of an Ising spin system driven by stochastic external field. Acta Physica Sinica, 2004, 53(9): 3157-3164. doi: 10.7498/aps.53.3157
Metrics
  • Abstract views:  4852
  • PDF Downloads:  131
  • Cited By: 0
Publishing process
  • Received Date:  25 October 2021
  • Accepted Date:  23 November 2021
  • Available Online:  26 January 2022
  • Published Online:  05 April 2022

/

返回文章
返回