Open Access
11 June 2013 Fast optical sectioning obtained by structured illumination microscopy using a digital mirror device
Author Affiliations +
Abstract
High-throughput optical imaging is critical to obtain large-scale neural connectivity information of brain in neuroscience. Using a digital mirror device and a scientific complementary metal-oxide semiconductor camera, we report a significant speed improvement of structured illumination microscopy (SIM), which produces a maximum SIM net frame rate of 133 Hz. We perform three-dimensional (3-D) imaging of mouse brain slices at diffraction-limited resolution and demonstrate the fast 3-D imaging capability to a large sample with an imaging rate of 6.9×10 7   pixel/s of our system, an order of magnitude faster than previously reported.

Mapping neural connectivity of the whole brain is one of the key steps to understanding the brain in neuroscience. To map the neural networks of the entire brain, one is required to obtain sub-micron neural connection information on a centimeter scale.1 Recent progresses of micro-optical sectioning tomography (MOST) and fluorescence micro-optical sectioning tomography (fMOST)2,3 have achieved sub-micron voxel resolution imaging of the whole brain. But total data acquisition times still were 242 and 447 h, respectively, which was too slowly for neuroscience applications.

Structured illumination microscopy (SIM), which was first demonstrated by Neil et al., has optical sectioning ability comparable to confocal microscopy.4 In this technique, SIM projects a predefined high-frequency cosine illumination pattern on the specimen. Only in-focus information is modulated by this illumination fringe, owing to the rapid attenuation of high spatial frequency pattern with defocus. SIM acquires at least three images with different phase shifts to obtain an optical section.

The imaging speed of SIM depends on the process of shifting the cosine illumination pattern. Various methods of cosine fringe projection have been demonstrated in SIM systems, including mechanically moving grating,5,6 two beam interference illumination,7 micro-stripe array light-emitting diodes (LED),8 and liquid crystal spatial light modulators.9 Despite these efforts, an illumination pattern transition time of several tens of milliseconds still limits the net frame rate of SIM to a few hertz. A digital mirror device (DMD)-based SIM has been reported to achieve a cost-effective optical sectioning at an imaging speed of 1.6×107pixel/s.10 However, because SIM needs three raw images to get a section image, the real net SIM sectioning speed had been reduced to approximately 5.3×106pixel/s, similar to ones of MOST and fMOST. Relatively low imaging speed is a serious impediment to the high-throughput neuroanatomy application. In this study, by employing the fast modulation ability of DMD in binary mode and the fast imaging ability of scientific complementary metal-oxide semiconductor (CMOS) camera (sCMOS), we demonstrate a SIM image net rate of 6.9×107pixel/s, an order of magnitude faster than existing high-throughput neural networks imaging methods.2,3,11,12

We used a DMD in binary mode to make full use of the fast modulation ability of DMD. Patterns on the DMD plane can be defined as

Eq. (1)

S1(x,y)={1,whenmode(x,6*k)<3*k,k=1,2,0,others
where x and y represent pixel coordinates on the DMD. Selecting different values of k can obtain various fringe periods. By shifting the pixel values of the DMD to 2k and 4k, respectively, the phase shift steps of 2π/3 and 4π/3 on the specimen plane would then be executed, respectively. After acquiring three images, we can reconstruct the optical section image by4

Eq. (2)

Is1=[(I0I2π/3)2+(I2π/3I4π/3)2+(I0I4π/3)2]1/2.

Our experimental setup is shown in Fig. 1. A DMD (XD-ED01N, X-digit) was placed in a conjugate image plane of the excitation optical path. The DMD was a 1024×768micro-mirror array with a size of 13.68×13.68μm. Excitation light from a mercury lamp (X-cite Exacte, Lumen Dynamics) was collimated and oriented toward the DMD. The specimen was fixed on the XY stage (Aerotech), and axial scanning was achieved by a piezoelectric translational stage (P-721, Physik instrumente). Emission light from the sample was captured by a 2048×2048pixel sCMOS camera (ORCA-Flash4.0, Hamamatsu), which was synchronized with the DMD pattern transition.

Fig. 1

Schematic of the optical setup. LLG, liquid light guide; CL, collimating lens; M, mirror; DMD, digital micro-mirror; TL, tube lens; EX, excite filter; DM, dichroic mirror; PZT, piezoelectric translational stage; OBJ, objective lens; and EM, emission filter.

JBO_18_6_060503_f001.png

To test the performance of our system, we used fluorescence beads with a diameter of 170 nm (505/515, Molecular Probes) to measure imaging resolution. By setting the pattern period on the DMD plane to 164.16 μm (13.68μm×12), a three-dimensional (3-D) stack of the fluorescence beads was acquired with a z step of 250 nm using a 40× water-immersion objective (0.8 NA, LUMPLFLN 40XW, Olympus). Figure 2 shows that the measured lateral and axial FWHM values from a selected bead were 0.39 and 2.15 μm, respectively.

Fig. 2

Normalized lateral (a) and axial (b) responses of the system.

JBO_18_6_060503_f002.png

Figure 3(a) and 3(b) shows the conventional wide field image and corresponding SIM optical section image of fluorescence microspheres (10-μm diameter), demonstrating the optical sectioning ability of SIM. The image was captured by a 20× water-immersion objective (1.0 NA, XLUMPLFLN 20XW, Olympus), and excited light exposure power on the sample was measured to be 2.9 mW. SIM suppressed most of the out-of-focus blurring information. To demonstrate that it was capable of imaging the dynamic process, we developed an optical flow phantom model that consists of 1-mm diameter glass tubing and a micro-syringe pump. By using a micro-syringe pump, we could control the flow speed of fluorescent microspheres inside the glass tubing. The illumination grating is oriented perpendicular to the flow. Figure 3(c)3(g) shows SIM images that were taken under different frame rates for five different moving fluorescent microspheres. The imaging pixel format of the sCMOS was set to 2048×192, and 2×2 binning by camera was used to enhance the signal. These microspheres could be tracked and the mean flowing rate was calculated to be 46.2±2.9μm/s. When the net frame rate of SIM was 133 Hz, there were no movement artifacts in the SIM section image. Once the frame rate decreased to 50 Hz, movement artifacts began to appear in the section image. The artifacts became increasingly severe as the frame rate decreased further, until the imaged fluorescence microsphere completely separated into three consecutive structured light modulated raw images. The reconstructed SIM section image would look like a superposition of three microspheres [Fig. 3(g)].

Fig. 3

Images of fluorescent microspheres. (a) Conventional wide-field image of motionless fluorescent microspheres; (b) corresponding optically sectioned image captured by structured illumination microscopy (SIM); (c to g) structured illumination sectioned images of moving microspheres taken at different SIM imaging frame rates: faster recording rate (c) shows clear shape of the microsphere, while slower recording rate (d to g) shows deformed shape. Scale bars: 40 μm (a, b) and 15 μm (c to g), respectively.

JBO_18_6_060503_f003.png

Finally, we demonstrate that the video-rate SIM is a fast imaging method which can be applied to large tissue imaging. The XY stage moves the sample under the objective to extend the field of view of SIM. Using a mosaic technique, we imaged the coronal section of a 100-μm thick formaldehyde-fixed mouse (Thy1-eYFP-H mouse) brain slice using a 40× objective (0.8 NA, LUMPLFLN 40XW, Olympus). The exposure power at the sample was measured to be 1.7 mW. The whole mosaic included 1040 3-D image volumes. Each image volume contained 30 images at 2-μm intervals in the z direction, that is, 60-μm thick in total, which was the maximum imaging depth without significant degradation of images for fixed brain tissue. Figure 4 shows the maximum intensity projection of the stitched coronal section. We can readily identify the dendritic spine in the enlarged view of the apical dendrite region of the cortex [Fig. 4(c)].

Fig. 4

(a) Coronal section of a mouse brain. (b) Enlarged views of the region marked in (a), pyramid cells in the cortex. (c) Enlarged views of the region marked in (b), white arrows mark the individual spine on dendrite. Scale bars: 1 mm (a), 150 μm (b), and 15 μm (c), respectively.

JBO_18_6_060503_f004.png

The lateral field of view of each mosaic image was 310×290μm. The refresh rate of the DMD was set as 50 Hz and each 60-μm thick mosaic 3-D volume was acquired in approximately 3.5 s. It took approximately 1 h to acquire the whole coronal 3-D data volume by 40× objective. The depth discrimination ability of SIM makes block-face imaging available for the resin-embedded whole brain samples.2,3 A whole mouse was approximately 1×1×1cm3, and the imaging field of view was 620×580μm2 when using a 20× objective. 17×18 mosaics were needed to cover a coronal section, and each 60-μm thick 3-D mosaic took 3.5 s to image. We could estimate that the imaging time for a whole brain would be (3.5s×17×18+60s)×10,000/60=52.36h (60 s for sectioning). It indicates that whole brain data acquisition at sub-micron resolution would require no more than three days.

The imaging speed of this video-rate SIM here is limited by the exposure time and readout speed of the camera. The full frame rate of sCMOS is limited to 50 Hz in external trigger mode. Without any compromise in the field of view, 16.6 Hz is the fastest SIM net frame rate we can currently achieve. Further acceleration of the imaging process depends on the use of a brighter light source and a faster camera with a shorter readout time.

In conclusion, by taking full advantage of the high-speed binary modulation capability of the DMD and fast capture ability of sCMOS, we demonstrate a video-rate structured illumination microscope for fast optical sectioning. At present, the imaging throughput of video-rate SIM can reach 6.9×107pixels/s (2048×2048 at a 50 Hz imaging frame rate). Meanwhile, the system enables one to resolve the fine structures of neurons, such as spine in thick brain tissue. In combination with appropriate brain tissue preparation and mechanical sectioning methods, this video-rate SIM has the potential to map neuron connectivity information for entire brain in a relatively short time.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant Nos. 81127002 and 91232306) and Science Fund for Creative Research Group of China (Grant No. 61121004). We thank Ming Lei for introducing the concept of SIM.

References

1. 

J. W. LichtmanW. Denk, “The big and the small: challenges of imaging the brain’s circuits,” Science, 334 (6059), 618 –623 (2011). http://dx.doi.org/10.1126/science.1209168 SCIEAS 0036-8075 Google Scholar

2. 

A. Liet al., “Micro-optical sectioning tomography to obtain a high-resolution atlas of the mouse brain,” Science, 330 (6009), 1404 –1408 (2010). http://dx.doi.org/10.1126/science.1191776 SCIEAS 0036-8075 Google Scholar

3. 

H. Gonget al., “Continuously tracing brain-wide long-distance axonal projections in mice at one-micron voxel resolution,” Neuroimage, 74 (1), 87 –98 (2013). http://dx.doi.org/10.1016/j.neuroimage.2013.02.005 NEIMEF 1053-8119 Google Scholar

4. 

M. A. A. NeilR. JuskaitisT. Wilson, “Method of obtaining optical sectioning by using structured light in a conventional microscope,” Opt. Lett., 22 (24), 1905 –1907 (1997). http://dx.doi.org/10.1364/OL.22.001905 OPLEDP 0146-9592 Google Scholar

5. 

J. Siegelet al., “Whole-field five-dimensional fluorescence microscopy combining lifetime and spectral resolution with optical sectioning,” Opt. Lett., 26 (17), 1338 –1340 (2001). http://dx.doi.org/10.1364/OL.26.001338 OPLEDP 0146-9592 Google Scholar

6. 

F. ChaslesB. DubertretA. C. Boccara, “Optimization and characterization of a structured illumination microscope,” Opt. Express, 15 (24), 16130 –16140 (2007). http://dx.doi.org/10.1364/OE.15.016130 OPEXFF 1094-4087 Google Scholar

7. 

M. A. A. NeilR. JuškaitisT. Wilson, “Real time 3D fluorescence microscopy by two beam interference illumination,” Opt. Commun., 153 (1–3), 1 –4 (1998). http://dx.doi.org/10.1016/S0030-4018(98)00210-7 OPCOB8 0030-4018 Google Scholar

8. 

V. Poheret al., “Optical sectioning microscopes with no moving parts using a micro-stripe array light emitting diode,” Opt. Express, 15 (18), 11196 –11206 (2007). http://dx.doi.org/10.1364/OE.15.011196 OPEXFF 1094-4087 Google Scholar

9. 

N. Bozinovicet al., “Fluorescence endomicroscopy with structured illumination,” Opt. Express, 16 (11), 8016 –8025 (2008). http://dx.doi.org/10.1364/OE.16.008016 OPEXFF 1094-4087 Google Scholar

10. 

D. Danet al., “DMD-based LED-illumination Super-resolution and optical sectioning microscopy,” Sci. Rep., 3 1116 (2013). http://dx.doi.org/10.1038/srep01116 SRCEC3 2045-2322 Google Scholar

11. 

T. Raganet al., “Serial two-photon tomography for automated ex vivo mouse brain imaging,” Nat. Methods, 9 (3), 255 –258 (2012). http://dx.doi.org/10.1038/nmeth.1854 1548-7091 Google Scholar

12. 

L. Silvestriet al., “Confocal light sheet microscopy: micron-scale neuroanatomy of the entire mouse brain,” Opt. Express, 20 (18), 20582 –20598 (2012). http://dx.doi.org/10.1364/OE.20.020582 OPEXFF 1094-4087 Google Scholar
CC BY: © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Dongli Xu, Tao Jiang, Anan Li, Bihe Hu, Zhao Feng, Hui Gong, Shaoqun Zeng, and Qingming Luo "Fast optical sectioning obtained by structured illumination microscopy using a digital mirror device," Journal of Biomedical Optics 18(6), 060503 (11 June 2013). https://doi.org/10.1117/1.JBO.18.6.060503
Published: 11 June 2013
Lens.org Logo
CITATIONS
Cited by 41 scholarly publications and 2 patents.
Advertisement
Advertisement
KEYWORDS
Brain

Digital micromirror devices

Mirrors

Microscopy

Neuroimaging

Imaging systems

3D image processing

Back to Top