中国物理B ›› 2024, Vol. 33 ›› Issue (11): 116804-116804.doi: 10.1088/1674-1056/ad8a4a

• • 上一篇    下一篇

Real-time four-dimensional scanning transmission electron microscopy through sparse sampling

A W Robinson1,†, J Wells1, A Moshtaghpour3, D Nicholls1, C Huang3, A Velazco-Torrejon3, G Nicotra4, A I Kirkland3, and N D Browning1,6   

  1. 1 SenseAI Innovations Ltd., Liverpool, UK;
    2 Centre for Doctoral Training, University of Liverpool, Liverpool, UK;
    3 Correlative Imaging Group, Rosalind Franklin Institute, Oxford, UK;
    4 CNR-IMM, Z. I. VIII Strada 5, Catania, 95121, Italy;
    5 Department of Mechanical, Materials, and Aerospace Engineering, University of Liverpool, Liverpool, UK
  • 收稿日期:2024-08-23 修回日期:2024-10-16 接受日期:2024-10-23 出版日期:2024-11-15 发布日期:2024-11-15
  • 基金资助:
    The authors would like to thank the Rosalind Franklin Institute for providing access to the JEOL GrandARM 2 “Ruska” and National Research Council of Italy’s Institute for Microelectronics and Microsystems at Catania for providing access to the JEOL JEM-ARM 200F to gather results for this work. We thank the Royal Society for providing funding under grant number EGR10965.

Real-time four-dimensional scanning transmission electron microscopy through sparse sampling

A W Robinson1,†, J Wells1, A Moshtaghpour3, D Nicholls1, C Huang3, A Velazco-Torrejon3, G Nicotra4, A I Kirkland3, and N D Browning1,6   

  1. 1 SenseAI Innovations Ltd., Liverpool, UK;
    2 Centre for Doctoral Training, University of Liverpool, Liverpool, UK;
    3 Correlative Imaging Group, Rosalind Franklin Institute, Oxford, UK;
    4 CNR-IMM, Z. I. VIII Strada 5, Catania, 95121, Italy;
    5 Department of Mechanical, Materials, and Aerospace Engineering, University of Liverpool, Liverpool, UK
  • Received:2024-08-23 Revised:2024-10-16 Accepted:2024-10-23 Online:2024-11-15 Published:2024-11-15
  • Contact: A W Robinson E-mail:alex.robinson@senseai.vision
  • Supported by:
    The authors would like to thank the Rosalind Franklin Institute for providing access to the JEOL GrandARM 2 “Ruska” and National Research Council of Italy’s Institute for Microelectronics and Microsystems at Catania for providing access to the JEOL JEM-ARM 200F to gather results for this work. We thank the Royal Society for providing funding under grant number EGR10965.

PDF (PC)

104

赞

摘要： Four-dimensional scanning transmission electron microscopy (4-D STEM) is a state-of-the-art image acquisition mode used to reveal high and low mass elements at atomic resolution. The acquisition of the electron momenta at each real space probe location allows for various analyses to be performed from a single dataset, including virtual imaging, electric field analysis, as well as analytical or iterative extraction of the object induced phase shift. However, the limiting factor in 4-D STEM is the speed of acquisition which is bottlenecked by the read-out speed of the camera, which must capture a convergent beam electron diffraction (CBED) pattern at each probe position in the scan. Recent developments in sparse sampling and image inpainting (a branch of compressive sensing) for STEM have allowed for real-time recovery of sparsely acquired data from fixed monolithic detectors, Further developments in compressive sensing for 4-D STEM have also demonstrated that acquisition speeds can be increased, i.e., live video rate 4-D imaging is now possible. In this work, we demonstrate the first practical implementations of compressive 4-D STEM for real-time inference on two different scanning transmission electron microscopes.

关键词: compressive sensing, 4-D STEM, inpainting

Abstract: Four-dimensional scanning transmission electron microscopy (4-D STEM) is a state-of-the-art image acquisition mode used to reveal high and low mass elements at atomic resolution. The acquisition of the electron momenta at each real space probe location allows for various analyses to be performed from a single dataset, including virtual imaging, electric field analysis, as well as analytical or iterative extraction of the object induced phase shift. However, the limiting factor in 4-D STEM is the speed of acquisition which is bottlenecked by the read-out speed of the camera, which must capture a convergent beam electron diffraction (CBED) pattern at each probe position in the scan. Recent developments in sparse sampling and image inpainting (a branch of compressive sensing) for STEM have allowed for real-time recovery of sparsely acquired data from fixed monolithic detectors, Further developments in compressive sensing for 4-D STEM have also demonstrated that acquisition speeds can be increased, i.e., live video rate 4-D imaging is now possible. In this work, we demonstrate the first practical implementations of compressive 4-D STEM for real-time inference on two different scanning transmission electron microscopes.

Key words: compressive sensing, 4-D STEM, inpainting

中图分类号:  (Scanning transmission electron microscopy (STEM))

  • 68.37.Ma
61.72.uf (Ge and Si) 07.05.Pj (Image processing) 07.05.Hd (Data acquisition: hardware and software)