Open Access
3 June 2016 In vivo simultaneous multispectral fluorescence imaging with spectral multiplexed volume holographic imaging system
Author Affiliations +
Funded by: National Natural Science Foundation of China (NSFC), National Natural Science Foundation of China, National Natural Science Foundation, Natural Science Foundation of China, Equipment Development Project, National Major Scientific Instrument and Equipment Development, National Major Scientific Instrument and Equipment Development Project, National Major Scientific Instrument Equipment Development Project, National Key Instrumentation Development Project, National Major Scientific Instrument Equipment Development, National Major Scientific Instrument and Equipment Development Project under Grant
Abstract
A simultaneous multispectral fluorescence imaging system incorporating multiplexed volume holographic grating (VHG) is developed to acquire multispectral images of an object in one shot. With the multiplexed VHG, the imaging system can provide the distribution and spectral characteristics of multiple fluorophores in the scene. The implementation and performance of the simultaneous multispectral imaging system are presented. Further, the system’s capability in simultaneously obtaining multispectral fluorescence measurements is demonstrated with in vivo experiments on a mouse. The demonstrated imaging system has the potential to obtain multispectral images fluorescence simultaneously.

Multispectral imaging is a technique that can simultaneously acquire spectral and positional information of the objects at several key wavelengths,1 and it has been applied to the visualization of various superficially located diseases. Multispectral imaging can be achieved by acquiring individual band measurements with a filter wheel.2 In order to study important transient scenes such as fast biochemical reactions and cellular dynamic events in a single piece of tissue, it is desirable to acquire multispectral images of biological tissues at high temporal resolution. Liquid crystal tunable filter3 and acousto-optic tunable filter4 have been used to increase the speed of spectral scanning. However, these filters are polarization sensitive and suffer from poor light throughputs.5 In addition, the sequential acquisition mode is the intrinsic barrier that cannot be easily overcome. Therefore, some video-rate hyperspectral imaging technologies such as multiple apertures,6 reformatting,7 and inversion8 have been considered. However, these techniques require complex components, precise alignments and intensive computations. Beside, in many cases, the acquisition of the complete hyperspectral data cube provides little additional information compared with multispectral imaging, wherein images are acquired only in several discrete spectral bands.9 Multiplexed volume holographic grating (VHG) has been employed for multidepth biomedical imaging applications to reduce the need of spatial scanning.10,11 In the system, each hologram superimposed within the recording material is Bragg matched to a specific wave front that originates at a particular object plane located at different depths.

In this paper, a simultaneous multispectral imaging system using spectral multiplexed VHG is developed. Different from the aforementioned multidepth imaging systems, this system can simultaneously obtain both multiple spectral and positional information of fluorophores in the same object plane without wavelength scanning. A four-wavelength multiplexed VHG is used is this paper. Each hologram can selectively diffracts a target wavelength emitted from the same object plane using a designed reconstruction angle.11,12 The multiplexed VHG (thickness 1.1 mm, clear aperture 7×11  mm2) contains four volume holograms designated for 620, 530, 488, and 590 nm, respectively. The nominal incident angle θin in air is 15 deg. To make full use of the effective area of the charged-coupled-device (CCD) detector (Andor Clara, 1392×1040 effective pixels) and avoid overlap among the laterally separated multispectral images, the separation angle Δθ between the diffracted beams is designed as 1.5 deg. In order to achieve high-quality imaging performance, this VHG is custom-designed and fabricated by OptiGrate Corp (Oviedo, Florida). The parameters of the multiplexed VHG are given in Table 1.

Table 1

Parameters of the four multiplexed volume holograms.

Center wavelength (nm)620530488590
Grating period (μm)1.0910.9760.9431.198
Spectral-angular selectivity FWHM (deg)0.03190.03110.02960.0376
Diffraction efficiency (%)82.584.481.882.3

The reconstruction operation of the multiplexed VHG with multiple wavelength beams is shown in Fig. 1(a). For simplicity, the k-sphere diagram consisting of two grating vectors, Kg,1 for blue laser λB=488  nm and Kg,2 for yellow laser λY=590  nm, is shown in Fig. 1(b). ki,Y and kd,Y are the wave vectors of the yellow incidence and diffraction beams, respectively. ki,B and kd,B are the wave vectors of the blue incidence and diffraction beams, respectively. The angle of the diffracted yellow beam is θ1,dif=13.5  deg and the separation angle between the two diffracted beams is Δθ=1.5  deg.

Fig. 1

Geometry of the reconstruction operation of the multiplexed VHG. (a) When the collimated beam containing four target wavelengths arrives at the VHG with an incident angle of θin=15  deg, the multiplexed VHG diffracts the corresponding Bragg-matched components into four different directions. (b) k-sphere diagram of probing the multiplexed VHG recorded for λB=488  nm and λY=590  nm. Kg,1 and Kg,2 represent the grating vectors of the two multiplexed holograms for λB and λY, respectively. The two probe wavelengths share the same incident axis. The separation between the two Bragg-matched diffracted beams is Δθ=1.5  deg.

JBO_21_6_060502_f001.png

Figure 2(a) shows the experimental setup for measuring the spectral-angular selectivity of the four holograms with separate monochromatic lasers.13 The intensity of the incident light Pinc and diffracted light Pdif is measured by a power meter (Coherent LabMax-top). The diffraction intensity data are collected with the rotation step of 0.008 deg. Figure 2(b) shows the spectral-angular selectivity curve given by

Eq. (1)

η(%)=Pdif/Pinc×100%.

Fig. 2

(a) Experimental setup for measuring the spectral-angular selectivity at different target wavelengths. (b) The measured spectral-angular selectivity curves of the four multiplexed volume holograms. The diffraction intensity of each laser beam is measured sequentially by switching the shutter placed in front of the laser head. The results show that the Bragg-matched diffraction efficiency of each hologram is higher than 0.8.

JBO_21_6_060502_f002.png

Figure 3 shows the experimental setup of the proposed system using the multiplexed VHG with four holograms. The imaging object is illuminated by a white light source (ASAHI SPECTRA MAX-302). The scattered light from the object is collected by the C-mount lens. Then, an intermediate image is formed on the plane of the rectangular aperture, colocated at the front focal plane of the collimating lens (Thorlabs AC254-100-A, focal length 100 mm). The multiplexed VHG is located at the Fourier plane of the 4f system, formed by the collimating lens and the collector lens (Thorlabs AC254-075-A, focal length 75 mm). When the multispectral imaging system is illuminated by its target wavelengths emitted from the object, images with different spectral characteristics are projected to different lateral locations on the CCD detector.

Fig. 3

Experimental setup of the simultaneous multispectral imaging system. The multiplexed VHG is placed on the Fourier plane of the 4f system combined with the collimating lens and the collector lens. Each hologram diffracts the Bragg-matched component of the incident beam. The collector lens projects laterally separated images formed with different wavelengths on the CCD camera.

JBO_21_6_060502_f003.png

The images in Fig. 4(a) are taken in reflection mode with the Xenon lamp. The spatial resolution Δx of the whole system mainly depends on the focal length fcol of the collimating lens, the thickness L of the VHG14 and the scaling M of the intermediate image created by the front-end C-mount lens [Eq. (2)].

Eq. (2)

Δx=1M2λfcolθsL,
where λ is the center wavelength of the probe beam, and θs is the angle between the incident beam and the diffracted beam. With the C-mount lens, the system can simultaneously acquire four multispectral images of the whole mouse. However, this is done by sacrificing the resolution of the whole system. The spectral-angular selectivity of the volume holograms can also affect the contrast of the images. When the imaging system is illuminated by a broadband point source, due to the spectral-angular selectivity of the volume hologram, the intensity of the point spreads along the transverse direction. The image intensity of each point is superimposed by a weighted intensity of its lateral neighbor points. The transverse features of 1.58  mm can be resolved, while the contrast of the longitudinal features are severely affected.

Fig. 4

(a) Resolution measurement of the simultaneous multispectral imaging system. Due to the intensity spread in the transverse direction, the image shows different contrast in the transverse and longitudinal direction. The transverse features of Group-1 Element 3 have 0.63 line pairs/mm and can be resolved, while the longitudinal features of Element 1 cannot be resolved due to the contrast degradation caused by the transverse spread of intensity. (b) Four single-band images of the nude mouse are simultaneously obtained with reflection-mode illumination. (c) The FOVx and corresponding bandwidth of each single-band image are measured with the white blank cardboard.

JBO_21_6_060502_f004.png

An eight-week-old nude female mouse was anesthetized through intraperitoneal injection of 0.225 mL avertin solution and illuminated with the Xenon lamp. The multispectral images shown in Fig. 4(b) are simultaneously captured by the CCD detector without using bandpass filters. The image is rescaled into an array with all entries in [0, 1], and the contrast is enhanced by setting the minimum threshold as 0.13. Because the spectral-angular selectivity of the 590 and 620 nm holograms is inferior to the 488 and 530 nm holograms, the intensity superposition in the 590 and 620 nm images appears more significant than that in the 488 and 530 nm images. Another factor that affects the intensity and contrast of the four images is that biological tissues have higher absorption coefficients for blue and green wavelengths.15

To verify the bandwidth of each single-band image, a white blank cardboard illuminated with Xenon lamp was placed D=35  cm away from the objective lens. The relationship between the axial FOVx and the bandwidth of illumination is given by16

Eq. (3)

Δλi=2λifcolFOVxfobjθi,sD,
where Δλi is the bandwidth of each single-band image, λi is the designated wavelength of each hologram, θi,s is the angle between the incident beam and the diffracted beam of each wavelength, fcol and fobj are the focal lengths of the collimating lens and the C-mount lens, respectively. According to Eq. (3), the theoretical full-width-half-maximum (FWHM) bandwidths of the four single-band image are 25.24, 26.43, 26.77, and 28.79 nm, respectively. The measured FWHM bandwidths are 27.4, 23.4, 26.2, and 32.3 nm, respectively [Fig. 4(c)]. The deviations are mainly caused by the slight mechanical shifts of the spectrometer probe and the difference in the spectral-angularity selectivity of the four holograms. The central location xi of each Bragg-matched image on the detector plane can be calculated as

Eq. (4)

xi,c=fcol(θi,difθ1,dif),
where fcol is the focal length of the collector lens and θi,dif is the diffraction angle of the i’th wavelength.

The mouse then underwent in vivo fluorescence imaging. All in vivo procedures were carried out under the protocol approved by the Ethical Committee of Tsinghua University. Two fluorescent beads (diameter 3 mm and length 7 mm) filled with two kinds of 1.0  mg/mL Qdots solutions (Qdots 530 and Qdots 620) were buried subcutaneously (0.6  mm) into two sites separately, i.e., the right upper abdomen and the left lower abdomen, as shown in Fig. 5(a). To avoid the movement of fluorescent beads caused by respiration, a colorless transparent acrylic sheet with a thickness of 2 mm and a width of 30 mm was used to fix the mouse on the sample holder. Then, the two beads were excited with a narrow-band light source of 480 nm. An emission long-pass filter of 500 nm was used to block the excitation light during the fluorescence imaging procedure. Figures 5(b) and 5(c) are the images of Qdots 620 and Qdots 530 fluorescent beads, respectively. The image of the blue channel shown in Fig. 5(d) is obtained by removing the emission long-pass filter.

Fig. 5

Simultaneous in vivo fluorescence imaging experiments. (a) The nude mouse with two subcutaneously buried fluorescent beads photographed with a conventional camera. (b) and (c) are the simultaneously acquired fluorescence images of Qdots 620 and Qdots 530 fluorescent beads with the proposed imaging system, respectively. (d) The blue channel image obtained without the emission longpass filter. Complementary information of the mouse can be visualized in (e), which was obtained by overlaying fluorescence images on the blue channel image.

JBO_21_6_060502_f005.png

The in vivo experimental results indicate that the multispectral fluorescence imaging system using multiplexed VHG can simultaneously obtain both spectral and positional information of the fluorescence emitted from the mouse in one shot. The imaging depth can be improved by increasing the intensity of excitation light. However, because both the excitation and emission wavelengths used in this system are within visible band, it is a challenge for this system to image fluorescence objects at depths beyond a couple of millimeters.

In summary, a simultaneous multispectral imaging system constructed with few optical components (i.e., only four components) was proposed. The system can provide complementary information of both fluorescence distribution and nonfluorescence profile of biological tissues. The multiplexed VHG in the imaging system selectively diffracts the desired wavelengths emitted or scattered from the object, with each being imaged simultaneously on the detector plane and laterally separated from one another. Since each hologram for the specific target wavelength can be superimposed within the volume with the same recording wavelength, the use of spectrally multiplexed VHG as a spectroscopic device can provide more flexibility in deciding the number and the combination of target spectral bands of the multiplexed holograms to meet different multispectral imaging requirements. Although the diffraction efficiencies can be affected by the multiplexing procedure, the VHG can still keep high diffraction efficiency when the number of multiplexed holograms is within the capacity of the recording materials.17

Acknowledgments

The authors thank Dr. Jing Bai, Dr. Liangcai Cao, Dr. Huili Wang, and Dr. Shuaishuai Teng at Tsinghua University, and Dr. Yuan Luo and Dr. His-Hsun Chen at the National Taiwan University, for their helpful discussions and assistance. This work is supported by the National Natural Science Foundation of China under Grant Nos. 81227901, 81271617, 61322101, and 61361160418, and the National Major Scientific Instrument and Equipment Development Project under Grant No. 2011YQ030114.

References

1. 

M. S. Kim et al., “Steady-state multispectral fluorescence imaging system for plant leaves,” Appl. Opt., 40 (1), 157 –166 (2001). http://dx.doi.org/10.1364/AO.40.000157 APOPAI 0003-6935 Google Scholar

2. 

D. Roblyer et al., “Multispectral optical imaging device for in vivo detection of oral neoplasia,” J. Biomed. Opt., 13 (2), 024019 (2008). http://dx.doi.org/10.1117/1.2904658 JBOPFO 1083-3668 Google Scholar

3. 

M. E. Martin et al., “Development of an advanced hyperspectral imaging (hsi) system with applications for cancer detection,” Ann. Biomed. Eng., 34 (6), 1061 –1068 (2006). http://dx.doi.org/10.1007/s10439-006-9121-9 ABMECF 0090-6964 Google Scholar

4. 

Z. Nie et al., “Hyperspectral fluorescence lifetime imaging for optical biopsy,” J. Biomed. Opt., 18 (9), 096001 (2013). http://dx.doi.org/10.1117/1.JBO.18.9.096001 JBOPFO 1083-3668 Google Scholar

5. 

S. K. Shriyan et al., “Electro-optic polymer liquid crystal thin films for hyperspectral imaging,” J. Appl. Remote Sens., 6 (1), 063549 (2012). http://dx.doi.org/10.1117/1.JRS.6.063549 Google Scholar

6. 

J. Downing and A. R. Harvey, “Multi-aperture hyperspectral imaging,” Imaging and Applied Optics, JW2B. 2 Optical Society of America(2013). Google Scholar

7. 

L. Gao, R. T. Kester and T. S. Tkaczyk, “Compact image slicing spectrometer (iss) for hyperspectral fluorescence microscopy,” Opt. Express, 17 (15), 12293 –12308 (2009). http://dx.doi.org/10.1364/OE.17.012293 OPEXFF 1094-4087 Google Scholar

8. 

B. K. Ford et al., “Computed tomography-based spectral imaging for fluorescence microscopy,” Biophys. J., 80 (2), 986 –993 (2001). http://dx.doi.org/10.1016/S0006-3495(01)76077-8 BIOJAU 0006-3495 Google Scholar

9. 

E. M. Winter, “Methods for determining best multispectral bands using hyperspectral data,” in 2007 IEEE Aerospace Conf., 1 –6 (2007). http://dx.doi.org/10.1109/AERO.2007.353058 Google Scholar

10. 

Y. Luo, S. B. Oh and G. Barbastathis, “Wavelength-coded multifocal microscopy,” Opt. Lett., 35 (5), 781 –783 (2010). http://dx.doi.org/10.1364/OL.35.000781 OPLEDP 0146-9592 Google Scholar

11. 

Y. Luo et al., “Laser-induced fluorescence imaging of subsurface tissue structures with a volume holographic spatial-spectral imaging system,” Opt. Lett., 33 (18), 2098 –2100 (2008). http://dx.doi.org/10.1364/OL.33.002098 OPLEDP 0146-9592 Google Scholar

12. 

L. Cao et al., “Imaging spectral device based on multiple volume holographic gratings,” Opt. Eng., 43 (9), 2009 –2016 (2004). http://dx.doi.org/10.1117/1.1775231 Google Scholar

13. 

L. Yuan et al., “Simulations and experiments of aperiodic and multiplexed gratings in volume holographic imaging systems.,” Opt. Express, 18 (18), 18839 –19285 (2010). http://dx.doi.org/10.1364/OE.18.018839 OPEXFF 1094-4087 Google Scholar

14. 

A. Sinha and G. Barbastathis, “Broadband volume holographic imaging,” Appl. Opt., 43 (27), 5214 –5221 (2004). http://dx.doi.org/10.1364/AO.43.005214 APOPAI 0003-6935 Google Scholar

15. 

S. L. Jacques, “Optical properties of biological tissues: a review.,” Phys. Med. Biol., 58 (11), R37 –R61 (2013). http://dx.doi.org/10.1088/0031-9155/58/11/R37 Google Scholar

16. 

A. Sinha and G. Barbastathis, “Broadband volume holographic imaging,” Appl. Opt., 43 (27), 5214 –5221 (2004). http://dx.doi.org/10.1364/AO.43.005214 APOPAI 0003-6935 Google Scholar

17. 

X. Liu et al., “Optimization of a thick polyvinyl alcohol-acrylamide photopolymer for data storage using a combination of angular and peristrophic holographic multiplexing,” Appl. Opt., 45 (29), 7661 –7666 (2006). http://dx.doi.org/10.1364/AO.45.007661 APOPAI 0003-6935 Google Scholar
© 2016 Society of Photo-Optical Instrumentation Engineers (SPIE) 1083-3668/2016/$25.00 © 2016 SPIE
Yanlu Lv, Jiulou Zhang, Dong Zhang, Wenjuan Cai, Nanguang Chen, and Jianwen Luo "In vivo simultaneous multispectral fluorescence imaging with spectral multiplexed volume holographic imaging system," Journal of Biomedical Optics 21(6), 060502 (3 June 2016). https://doi.org/10.1117/1.JBO.21.6.060502
Published: 3 June 2016
Lens.org Logo
CITATIONS
Cited by 6 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Multispectral imaging

Imaging systems

Multiplexing

Luminescence

Holograms

In vivo imaging

Holography

Back to Top