Journal of Semiconductors, Volume. 44, Issue 10, 104101(2023)

Forward stagewise regression with multilevel memristor for sparse coding

Chenxu Wu1、†, Yibai Xue1、†, Han Bao1, Ling Yang1, Jiancong Li1, Jing Tian1, Shengguang Ren1, Yi Li1,2、*, and Xiangshui Miao1,2
Author Affiliations
  • 1School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan 430074, China
  • 2Hubei Yangtze Memory Laboratories, Wuhan 430205, China
  • show less
    Figures & Tables(8)
    (Color online) Schematic diagram of the digital-analog hybrid memristive sparse coding system. Input images can be divided into small patches and then represented by a few dictionary elements. The memristor array is used to store the approximate dictionary to calculate the cosine distance between the dictionary elements and the residual vector (image reconstruction error). The digital system then determines the most relevant dictionary element based on the result of the analog calculation, and that element at full precision becomes part of the reconstructed image.
    (Color online) (a) A schematic of the device structure. (b) SEM image of the Pt/Al2O3/AlOx/W memristor. (c) XPS image of Al 2p and O 1s in the AlOx and Al2O3 layers. (d) 100 consecutive dc I−V curves with forming voltage about 4.8 V. (e) HRS and LRS distributions for 10 devices. (f) An instance of tuning the device conductance to reach a target conductance state of 60 μS with an error rate < 4% is demonstrated. The inset shows the write-verify method where a step voltage of ± 20 mV is employed. (g) Eight target conductance states are fine-tuned through the write-verify method, with < 4% variations. (h) Stable read distribution of each eight target conductance states at a dc reading voltage of 0.1 V. (i) Retention test over 3000 s of the same eight conductance states mentioned in Fig. 2(h).
    (Color online) (a) Flow chart of the FSR. The sign of ε is dependent on the cosine similarity between the corresponding variable and residual vector. (b) Calculating the cosine distance between residual vector y−ŷ and variables x1, x2,···, xm by the memristor array. Each line of the array stores the values of a variable in the dataset and each element of the variable is represented by the conductance difference of two memristors. (c) Residual vectors mapped to the 4-bit scaling range. During the iteration, the numerical-voltage scaling ratio will be continuously decreased with the shrinking of the residual vector.
    (Color online) (a) The overdetermined DCT dictionary is mapped to the 128 × 256 memristor array. (b) Examples of the elements of the DCT dictionary. (c) Scheme of the original image (128 × 128). The image is divided into 8 × 8 patches for processing. (d) One patch in (c) to perform sparse coding with consideration of nonideal factors in a real circuit. (e) The dictionary element coefficient update path of (d). (f) Simulated reconstructed picture of (e), with consideration of nonideal factors in a real circuit. (g, h) In the case of adopting the DCT dictionary, the image reconstruction quality and sparsity of FSR under different thresholds (L0 is the average number of selected elements) with respect to (g) memristor-based FSR and (h) full-precision FSR.
    (Color online) (a) Schemes of the natural pictures used to train the dictionary. (b) The offline-learned dictionary is mapped to 128 × 256 memristor array. (c) Examples of the elements of the learned dictionary. (d, e) In the case of adopting the offline-learned dictionary, the image reconstruction quality and sparsity of FSR under different thresholds with respect to (d) memristor-based FSR and (e) full-precision FSR.
    (Color online) (a) The influence of conductance precision on peak-signal-to-noise ratio (PSNR) and sparsity (L0). (b) The influence of DAC precision on PSNR and sparsity. (c) The influence of ADC precision on PSNR and sparsity. (d) The robustness analysis of PSNR with device variations. (e) The robustness analysis of the sparsity with device variations.
    (Color online) (a) The image inpainting task is performed using memristor-based sparse coding, where the array input voltage is the residual vector of remaining pixels. (b) Image restoration effect based on the DCT dictionary and learned dictionary, the middle one is based on the DCT dictionary and the right one is based on the learned dictionary.
    • Table 1. Comparation of memristive sparse coding system.

      View table
      View in Article

      Table 1. Comparation of memristive sparse coding system.

      PSNR (dB)L0Patch sizeCompression ratio
      IEEE TNNLS (2015)[17]~24~40(10 × 10)~0.4
      Nature Nano (2017)[16]27.115.6(10 × 10)0.156
      Cognit. Neurodynam (2019)[19]33.57/(4 × 4)/
      This work33.89.81(8 × 8)0.153
      This work3819.4(8 × 8)0.303
    Tools

    Get Citation

    Copy Citation Text

    Chenxu Wu, Yibai Xue, Han Bao, Ling Yang, Jiancong Li, Jing Tian, Shengguang Ren, Yi Li, Xiangshui Miao. Forward stagewise regression with multilevel memristor for sparse coding[J]. Journal of Semiconductors, 2023, 44(10): 104101

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Articles

    Received: Mar. 13, 2023

    Accepted: --

    Published Online: Dec. 26, 2023

    The Author Email:

    DOI:10.1088/1674-4926/44/10/104101

    Topics