Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
ARRAY OF LIGHT SOURCES, FOURIER PTYCHOGRAPHIC IMAGING SYSTEM AND METHOD OF PERFORMING FOURIER PTYCHOGRAPHY
Document Type and Number:
WIPO Patent Application WO/2023/217844
Kind Code:
A1
Abstract:
The present disclosure relates to an array of light sources (2) for a Fourier ptychographic imaging system (100), including at least two adjacent light sources (2) which preferably differ from each other in a property of light beams emitted from them and are configured to illuminate a sample (4) at different angles of incidence for reconstructing a single image of the sample using Fourier ptychography, wherein the property of light beams of each light source (2) is configured to match the sample (4) for increasing a contrast and/or a color or material information content in the reconstructed single image of the sample (4). In embodiments, one or more light sources is a UV light source. In embodiments, the sample is a biological sample. In embodiments, the FPM includes UV transparent components and/or materials such as quartz.

More Like This:
Inventors:
ENGEL THOMAS (DE)
DETHLEFSEN MARK (DE)
MARQUARDT GABY (DE)
Application Number:
PCT/EP2023/062391
Publication Date:
November 16, 2023
Filing Date:
May 10, 2023
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
SIEMENS HEALTHCARE GMBH (DE)
International Classes:
G02B21/36
Foreign References:
US10247933B22019-04-02
US10185137B22019-01-22
Other References:
COOKE COLIN L ET AL: "Physics-Enhanced Machine Learning for Virtual Fluorescence Microscopy", 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), IEEE, 10 October 2021 (2021-10-10), pages 3783 - 3793, XP034092716, DOI: 10.1109/ICCV48922.2021.00378
MICHAEL KELLMAN ET AL: "Data-Driven Design for Fourier Ptychographic Microscopy", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 8 April 2019 (2019-04-08), XP081166582
Attorney, Agent or Firm:
MAIER, Daniel // Siemens Healthcare GmbH (DE)
Download PDF:
Claims:
What is claimed is:

1. An array of light sources (2) for a Fourier ptychographic imaging system (100) , comprising at least two adjacent light sources (2) which preferably differ from each other in a property of light beams emitted from them and are configured to illuminate a sample (4) at different angles of incidence for reconstructing a single image of the sample using Fourier ptychography, wherein the property of light beams of each light source (2) is configured to match the sample (4) for increasing a contrast and/or a color or material information content in the reconstructed single image of the sample (4) .

2. The array of light sources according to claim 1, wherein the property of light beams comprises a wavelength, a bandwidth, a spectral profile and/or a polarization of the light beams.

3. The array of light sources according to claim 1 or 2, wherein the contrast in the reconstructed single image of the sample (4) depends on an interaction property of the light beams of the respective light source (2) with a given location of the sample (4) .

4. The array of light sources according to claim 3, wherein the interaction property comprises an absorption, a refraction, a scattering, a diffraction and/or fluorescence of the light beams of the respective light source (2) at the given location of the sample ( 4 ) .

5. The array of light sources according to claim 3 or 4, wherein the interaction property depends on the property of light beams of the respective light source (2) and a material and/or a geometry at the given location of the sample (4) .

6. The array of light sources according to any of the preceding claims, wherein the array of light sources (2) comprises at least three light sources (2) which are a first light source, a second light source and a third light source, wherein the first light source is adjacent to the second light source which is further adjacent to the third light source, wherein the first and second light sources differ from each other in a property of light beams emitted from them, wherein the second and third light sources differ from each other in a property of light beams emitted from them, and wherein the first and third light sources comprise the same property of light beams emitted from them.

7. The array of light sources according to claim 6, wherein in the reconstruction process using Fourier ptychography, an image taken by means of the second light source comprises a lower weighting factor than images taken by means of the first and third light sources.

8. The array of light sources according to claim 6, wherein in the reconstruction process using Fourier ptychography, an image taken by means of the second light source comprises the same weighting factor as images taken by means of the first and third light sources.

9. The array of light sources according to any of the preceding claims, wherein the array of light sources (2) comprises a plurality of light sources (2) , in particular more than three light sources (2) , preferably more than five light sources (2) , wherein the plurality of light sources form at least two clusters, wherein light sources within each cluster are adjacent to each other, and wherein the property of light beams of light sources in each cluster is configured to match a given location of the sample (4) for increasing a contrast in the reconstructed single image of the given location of the sample (4) .

10. The array of light sources according to any of the preceding claims, wherein the array of light sources is configured to be selected based on a type of the sample (4) .

11. A Fourier ptychographic imaging system (100) comprising the array of light sources (2) according to any of the claims 1-10.

12. The Fourier ptychographic imaging system (100) according to claim 11, comprising a bandpass filter, a notch filter, a filter defining a complex spectral profile, and/or an edge filter arranged between the array of light sources (2) and a camera sensor (12) of the Fourier ptychographic imaging system (100) .

13. The Fourier ptychographic imaging system (100) according to claim 11 or 12, wherein the Fourier ptychographic imaging system (100) comprises an objective (6) , wherein an objective aperture of the objective (6) is dividable into a number of segments, wherein each segment of the objective aperture is associated with a light source (2) or a cluster of light sources (2) in the array of light sources (2) .

14. A method of performing Fourier ptychography, comprising: illuminating (S10) a sample at different angles of incidence by at least two adjacent light sources in an array of light sources, wherein the at least two adjacent light sources preferably differ from each other in a property of light beams emitted from them, and the property of light beams of each of the at least two light source matches the sample for increasing a contrast in a single image of the sample to be reconstructed; capturing (S20) images of the sample by a camera, by means of the light beams from the at least two adjacent light sources; and reconstructing (S30) the single image of the sample by using the taken images.

15. The method according to claim 14, wherein the property of light beams comprises a wavelength, a bandwidth, and/or a polarization of the light beams.

Description:
Array of Light Sources , Fourier Ptychographic Imaging System and

Method of Performing Fourier Ptychography

FIELD OF THE INVENTION

[1 ] The present disclosure relates to an array of light sources (such as ultraviolet light or “UV”) for a Fourier ptychographic imaging system, a Fourier ptychographic imaging system preferably including one or more UV light sources, and a method of performing Fourier ptychography preferably using an ultraviolet (UV) based system for imaging biological samples without staining.

BACKGROUND

[2] Fourier Ptychography Microscopy (FPM) is a computational microscopy technique that generates high resolution images at large Field of Views (FoV). This is achieved by capturing an image sequence of a region of interest of a sample under various illumination angles greater than the Numerical Aperture (NA) of the used objective in bright-field mode and/or dark-field mode, and iteratively combining these images in Fourier space into a single high-resolution image.

[3] The images may be taken by a FPM microscope which can be assumed to be optically corrected to take images of the sample in considerably good quality, without significant distortion or chromatic aberrations.

[4] Typically, Fourier Ptychography images are captured with a monochrome camera and a colored illumination e.g. by white light or a light source with broader spectrum plus bandpass filters with selected wavelength or preferably Light-Emitting Diodes (LED) of a narrow bandwidth. As the illuminator or the light source, a flat array of LEDs or a hemispherical setup can be used. Some systems also have narrow bandwidth bandpass filters to even further decrease the bandwidth of the light in a particular image. The illumination wavelength may be selected by the LED used or in combination with bandpass filters with the Full-Width-at-Half-Maximum (FWHM) of e.g. 10, 50 or 80 nm in front of the monochrome camera. Color images are composed from separate image sets taken at different wavelengths, which are then reconstructed separately into (quasi-)monochromatic high-resolution images. If required, these high-resolution images can be combined to form color images afterwards.

[5] Microscopic samples, such as biological samples and medical samples, typically include different materials or tissues, however, problematically still have a relatively low or a considerably low material contrast at a given or specific wavelength for the different materials in a respective sample area. Consequently, in the final reconstructed image using Fourier Ptychography, changes in material or material composition of the sample cannot be detected or clearly differentiated.

[6] Accordingly, there is a continuing need for images with improved contrast and/or to provide a solution for Fourier ptychography which increases and optimizes the material differentiation in the single reconstructed image of the sample.

Summary

[7] This object is inventively achieved by the subject matter of the independent claims. Advantageous further developments may be taken from the dependent claims.

[8] In embodiments, the present disclosure provides, according to a first aspect, an array of light sources for a Fourier ptychographic imaging system, including at least two adjacent light sources which differ from each other in a property of light beams emitted from them and are configured to illuminate a sample at different angles of incidence for reconstructing a single image of the sample using Fourier ptychography, wherein the property of light beams of each light source is configured to match the sample for increasing a contrast and/or a color or material information content in the reconstructed single image of the sample. In embodiments, one or more light sources are predetermined to provide UV light.

[9] In embodiments, the present disclosure utilizes the differences in the property of light beams from different light sources in terms of spectral content when taking the images of an image set in order to improve and optimize the material contrast throughout the image set, i.e., between different sub-images, to better detect and differentiate changes in material or material composition of the sample.

[10] By means of the inventive array of light sources, the number of sub-images of a single image set does not need to be increased. Rather, the material differentiation is increased and optimized by increasing the absorption contrast, or by optimizing the diffraction efficiency or the sensitivity to refractive changes, to optimize the signal for a single image of given illumination direction or multiple directions overlapped.

[11] In embodiments of the array of light sources, the property of light beams includes a wavelength, a bandwidth, a spectral profile and/or a polarization of the light beams.

[12] In embodiments, the wavelengths of light beams emitted from the light sources may range from UV (including DUV < 200 nm) via VIS to IR (including SWIR and NIR up to 2500 nm). Said wavelengths of light beams are only limited by the camera technology and the optics to generate proper images.

[13] In embodiments, it may be advantageous to mix light sources which are different from each other in wavelength, bandwidth/spectrum, and/or polarization of the generated light beams for a single reconstruction. [14] The approach of using e.g., multi-wavelength light sources enables the of generation images with optimized or tailored contrast settings, even for samples which are difficult to image at a single given wavelength.

[15] In addition, in some embodiments, filters may be used which can shape the intensity distribution of the LED to a desired and quite arbitrary shape, such as multi-bands for a single LED.

[16] In a further embodiment of the array of light sources, the contrast in the reconstructed single image of the sample depends on an interaction property of the light beams of the respective light source with a given location of the sample.

[17] Embodiments of the present disclosure may exploit the fact that the single images taken with e.g. different wavelengths have the same physical location and feature structure on the image sensor, but they may differ in contrast depending on the respective interaction properties of the light of the respective wavelength with specific locations of the sample.

[18] In a further preferable embodiment of the array of light sources, the interaction property includes an absorption, a refraction, a scattering and/or a diffraction of the light beams of the respective light source at the given location of the sample.

[19] In a further preferable embodiment of the array of light sources, the interaction property depends on the property of light beams of the respective light source and a material and/or a geometry at the given location of the sample.

[20] In a further preferable embodiment of the array of light sources, the array of light sources includes a plurality such as at least three light sources which are a first light source, a second light source and a third light source, wherein the first light source is adjacent to the second light source which is further adjacent to the third light source, wherein the first and second light sources differ from each other in a property of light beams emitted from them, wherein the second and third light sources differ from each other in a property of light beams emitted from them, and wherein the first and third light sources comprise the same property of light beams emitted from them.

[21 ] In an FPM system, neighboring light sources in a light source array should have an overlap of at least 35% in aperture or in Fourier space. The overlap is needed to properly stitch the image content of different illumination angles.

[22] In embodiments, neighboring light sources may have different wavelengths. However, a more distant light source - the third light source, e.g. the next but one light source, has the same wavelength as the first light source. In embodiments, one or more light sources may include one or more wavelengths characterized as ultraviolet.

[23] The second light source which is the “middle” light source serves to secure the image reconstruction algorithm to properly stich the two neighboring light sources of the same type for proper alignment of the contributions in Fourier space. [24] This assignment of light sources with different wavelengths is attributed to the fact that there is a physical reconstruction directly from the Fourier transforms of the color corrected images while omitting the further transformation to an angular coordinate system as typically used in Fourier ptychography.

[25] In a further preferable embodiment of the array of light sources, in the reconstruction process using Fourier ptychography, an image taken by means of the second light source comprises a lower weighting factor than images taken by means of the first and third light sources.

[26] The information of the “middle” light source is fitted or used with a less weighting factor or only intermediately to properly stitch the information for the light sources of the same property such as wavelength, bandwidth, or polarization, when homogenizing the information in the iterative reconstruction cycles.

[27] This approach may resemble the same kind of reconstructed images for single colors as in the typical reconstructions. However, the number of sub-images used for different wavelengths substantially reduces.

[28] This approach of alternating light sources of different wavelengths can be used for a low number of wavelengths such as 2 or 3 different wavelengths which are preferably arranged in a rectangular, hexagonal or circular shape in flat or 3D form with equal or chirped distances between the light sources from center to high apertures.

[29] In a further preferable embodiment of the array of light sources, in the reconstruction process using Fourier ptychography, an image taken by means of the second light source comprises the same weighting factor as images taken by means of the first and third light sources.

[30] Thereby, the “middle” light source is weighted the same as the other light sources, irrespective of the individual color. In this case, the respective information content of all images, irrespective of the used wavelength, contributes with the same weight to the final synthesized image.

[31 ] By means of this approach, a generic resolution can be achieved where different wavelengths contribute to the final image. This approach is irrespective of whether it is an image taken by a monochrome sensor or a color image taken by a color sensor or generated from multiple monochrome images with different illumination settings.

[32] In a further preferable embodiment of the array of light sources, the array of light sources includes a plurality of light sources, in particular more than three light sources, preferably more than five light sources, wherein the plurality of light sources form at least two clusters, wherein light sources within each cluster are adjacent to each other, and wherein the property of light beams of light sources in each cluster is configured to match a given location of the sample for increasing a contrast in the reconstructed single image of the given location of the sample. [33] Thereby, the light sources of a different spectral content (such as the wavelength, bandwidth, and polarization) are arranged in quasi (local) clusters for each type of light sources. For example, central light sources for the bright-field imaging part are more adopted to absorption contrasting and thus preferably selected dependent on the sample properties, while dark-field light sources are more adopted to the angular scattering properties of the sample regarding refraction, dispersion and/or diffraction where absorption might be hindering since the optical pathway in the sample is prolonged, and thus the signal is attenuated more along its propagation path.

[34] In a further preferable embodiment of the array of light sources, the array of light sources is configured to be selected based on a type of the sample.

[35] For example, for unstained biological samples, such as body fluids, blood cells, blood smears, tissues, and tissue sections the absorption contrasting is considerably weak in the visible spectrum. Therefore, the bright-field imaging light sources can be selected from the non-visible spectral ranges such as UV or IR. In the UV range, there are different absorption mechanisms based on carbon bonds of the organic compounds which can lead to quite strong absorption contrast in the range of 200-380 nm, especially in the range of 250-320 nm, which can be easily implemented by using commercial LEDs. Preferably the light sources are configured to emit light in the range of 200 to 380 nm, most preferably in the range of 250 to 320 nm.

[36] In embodiments, the present disclosure provides, according to a second aspect, a Fourier ptychographic imaging system including the array of light sources according to the first aspect.

[37] In embodiments of the Fourier ptychographic imaging system, the Fourier ptychographic imaging system includes a bandpass filter, a notch filter, a filter defining a complex spectral profile, and/or an edge filter arranged between the array of light sources and a camera sensor of the Fourier ptychographic imaging system. This filter is preferably inserted into the imaging beam path between the objective lens and the camera.

[38] Thereby, the spectral characteristics and/or material differentiation in the (absorption) contrast is improved. The dark-field illumination may consist of different, e.g. longer wavelengths, e.g. in VIS or IR range, since light beams in these ranges might be scattered more efficiently based on the feature sizes of the sample under test.

[39] In a further preferable embodiment of the Fourier ptychographic imaging system, the Fourier ptychographic imaging system includes an objective, wherein an objective aperture of the objective is dividable into a number of segments, wherein each segment of the objective aperture is associated with a light source or a cluster of light sources in the array of light sources.

[40] In order to further utilize the local clustering of light sources, the illumination system may be structured in such a manner that the entire objective aperture range or the objective aperture in the bright-field and/or dark-field illumination portion is sectored into multiple segments/regions such as two, three, four, six or eight segments, and each segment is equipped with a different light source or a different combination of light sources (in wavelength, bandwidth and/or polarization) used in the illumination system.

[41 ] As described above in a preferable embodiment of the array of light sources, each light source may have nearest neighbors of different type. However, the same type of light source is preferably arranged in such a way that a larger segment/portion of illumination and/or imaging aperture space can be filled for this particular light source type or a given combination of light source types.

[42] Due to high degree of symmetry in the Fourier space, sectors of point symmetric locations may use quite different types of light sources in order to optimize the sampling efficiency for the sample in the imaging and reconstruction process. For instance, when the light source has four, six or eight segments, there might be two, two or three, or two or four different selections of light sources for a respective segment. These combinations might be chosen in a given sequence for neighboring segments. For example, in the case of six segments and two types of light source, there are three segments of each type and neighboring segments have light sources of different types. This results in a setup where none of the segments is opposite to another segment of the same type, demonstrating a broader coverage in aperture space for one type/set of wavelengths without losing any piece of information even for small details of the object. Further optimization can be achieved, if neighboring light sources in radial direction also comprise of different types in order to sample the Fourier space with an optimized sampling strategy with respect to homogeneity of sampling for a given light source type.

[43] The invention provides, according to a third aspect, a method of performing Fourier ptychography, comprising: illuminating a sample at different angles of incidence by at least two adjacent light sources in an array of light sources, wherein the at least two adjacent light sources differ from each other in a property of light beams emitted from them, and the property of light beams of each of the at least two light source matches the sample for increasing a contrast in a single image of the sample to be reconstructed; capturing images of the sample by a camera, by means of the light beams from the at least two adjacent light sources; and reconstructing the single image of the sample by using the taken images.

[44] In a preferable embodiment of the method, the property of light beams comprises a wavelength, a bandwidth, and/or a polarization of the light beams. BRIEF DESCRIPTION OF THE DRAWINGS

[45] The invention will be explained in greater detail with reference to exemplary embodiments depicted in the drawings as appended. The accompanying drawings are included to provide a further understanding of the present invention and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the present invention and together with the description serve to explain the principles of the invention.

[46] Other embodiments of the present invention and many of the intended advantages of the present invention will be readily appreciated as they become better understood by reference to the following detailed description. Like reference numerals designate corresponding similar parts. The Figures are not drawn to scale.

[47] Fig. 1 a shows a setup of a Fourier ptychographic imaging system including an array of light sources according to an embodiment of the invention, in a perspective view; Fig. 1 b shows the Fourier spectrum of the sample at the objective’s back-focal plane according to the setup of a Fourier ptychographic imaging system shown in Fig. 1 a; Fig. 1c shows shifting illumination angle by illuminating LEDs at different location according to the setup of a Fourier ptychographic imaging system shown in Fig. 1 a;

[48] Fig. 2 shows an illuminating device comprising an array of light sources according to another embodiment of the invention;

[49] Fig. 3 shows a view of an array of light sources according to another embodiment of the invention, in the sample plane;

[50] Fig. 4 shows a view of an array of light sources according to another embodiment of the invention, in the sample plane;

[51 ] Fig. 5 shows a block diagram of an embodiment of a method of performing Fourier ptychography;

[52] Fig. 6 depicts a graph with data relating to UV absorbance of proteins and nucleic acids;

[53] Figs. 7a and 7b depict images of an unstained bloodsmear on a quartz slide imaged imaged once at (a) 600nm and (b) 280nm; and

[54] Fig. 8 depicts FPM reconstructions of an image of bloodsmear imaged at 280nm. The left image shows a low resolution image acquired by the central LED prior to reconstruction. The image on the right corresponds to a high resolution image generated by combining the image on the left with all the other images acquired at different illumination angles in Fourier Space. DETAILED DESCRIPTION

[55] Fig. 1 a shows in a perspective view a setup of a Fourier ptychographic imaging system 100 including an array of light sources 2 according to an embodiment of the invention which are placed on a carrier board 3. The Fourier ptychographic imaging system 100 further includes from bottom to top as shown in the illustration a sample 4 placed in a sample plane 5, an objective 6, a tube lens 10 and a camera 12 for capturing images of the sample 4. As shown in Fig. 1 a, a region of interest 7 of the sample 4 is illuminated by the array of light sources 2 which are flashed consecutively in order to achieve illumination under a specific illumination angle. The hollow rectangle 8 represents the rear-focal plane of the objective 6 and/or corresponds to the aperture plane of the objective 6.

[56] In the embodiment shown in Fig. 1a, the array of light sources 2 includes a spatial distribution of separate low aperture LEDs which amount to 15*15 = 225 pieces. The exact number and arrangement of LED is determined by the desired resolution of the reconstructed image. In other embodiments not shown, laser-based or fiber-based light sources are possible.

[57] As shown in Fig. 1 a, the LEDs 2 are located on a plane in a grid shape of equidistant spacing in the x and y directions. In other embodiments not shown, the LEDs are located on a plane in a grid shape of equidistant spacing only in the x direction or only in the y direction. In another embodiment, the LEDs 2 are located on a plane in a grid shape with a chirped spacing of neighboring light sources so that the effective angular spacing as seen from the object is regular, i.e. equidistant in shape.

[58] In another embodiment, the light sources 2 are arranged on a three-dimensional structure such as on a hemisphere, where each light source has the same effective geometrical distance from the center of the field of view of the optics and in a preferred embodiment, the optical axis of each LED points to the center of the FoV of the optical system in the best focus focal plane setting. In general, any other spatial distribution of effective light sources is possible. The particular design can be calibrated in order to establish proper image reconstruction performance of the FPM system.

[59] In some embodiments, at a particular location of the grid, a single or multi-color light source is installed and preferably individually controlled in its intensity over time, e.g. being switched on or off and set with appropriate power levels which may be fixed, pre-calibrated and preferably linearized for adaptive settings.

[60] Conventionally, all grid positions are equipped with the same type of light sources. This design is essentially dictated by the requirement of the reconstruction algorithm for (quasi-)monochromatic image sets. However, not all wavelengths are equally useful in all possible positions of the illumination grid. For example, it can be imagined that wavelengths matched to strong absorption bands of a sample may be preferable for the bright-field regions of the illumination system, while the dark-field light-sources are matched to wavelength regions where the scattering cross-section of the sample is large.

[61 ] In embodiments, different light sources with e.g. different but known wavelengths and/or bandwidths are arranged at different positions of the grid, and it is not necessary to have nominally identical light sources at all of the grid positions.

[62] The single images taken with e.g. different wavelengths have the same physical location on the sample and thus feature structure on the image sensor of the camera 12, but they may differ in contrast depending on the respective interaction properties of the light of the respective wavelength with specific locations of the sample 4. The interaction property comprises absorption, refraction, scattering, diffraction and/or fluorescence property of the light beams of the respective light source 2 at the given location 7 of the sample 4. The interaction property depends on the property of light beams of the respective light source such as the wavelength, a bandwidth, and/or a polarization of the light beams, and also depends on the material and/or the geometry at the given location 7 of the sample 4.

[63] By means of the array of light sources 2, the number of sub-images of a single image set does not need to be increased. Rather, the material differentiation is increased and optimized by e.g. increasing the absorption contrast, or by optimizing the diffraction efficiency or the sensitivity to refractive changes, to optimize the signal for a single image of a given illumination direction or multiple directions overlapped.

[64] Fig. 1 b shows the Fourier spectrum of the sample 4 at the objective’s back-focal plane according to the setup of a Fourier ptychographic imaging system shown in Fig. 1 a. The circular sub-region 20 corresponds to the aperture size of the objective 6 and shifts with the shifting illumination angle.

[65] The light field emitted from one LED 2 can be approximated as a plane wave within a small region at the sample plane because the large distance between the LED 2 and the sample 4 increases the spatial coherence of the LED 2. The plane wave has vector components (kx, ky) associated with the oblique illumination of the LED 2 on the sample 4. Lighting up one LED 2 causes the sample’s Fourier spectrum to be shifted by (kx, ky) at the objective lens’s rear-focal plane, and the finite numerical aperture (NA) of the objective lens acts as a low-pass filter that transmits only a small sub-region at the center of the shifted Fourier spectrum. The low-passed Fourier component is further propagated to the image plane and is captured by the camera 12. The LEDs 2 are lit up sequentially so that the captured images contain partially overlapping Fourier sub-regions that together span the entire Fourier spectrum of the sample 4.

[66] In Fig. 1 c, a part of the LED array on the carrier board 3 is shown in an enlarged view. The parallel arrows and the parallel dashed lines shown in Fig. 1 c represent the sequentially switching of the LEDs 2 at different locations on the matrix in order to realize the illumination angle shifting. In the state shown in Fig. 1c, the LED 2i is switched on for providing the illumination.

[67] Fig. 2 shows an illuminating device 14 comprising a base unit 16 and a hemispherical carrier 18 fixed onto the base unit 16. On the hemispherical carrier 18, a hemispherical setup of LEDs (not shown) is provided, where each LED has the same effective geometrical distance from the center of the field of view of the optics. Due to the hemispherical setup, the optical axis of each LED is directed towards the axis of symmetry of the hemisphere and all optical axis should intersect at the nominal focus position of the optics to improve illumination homogeneity for the FoV.

[68] Fig. 3 shows a view of an array of light sources according to another embodiment of the invention, in the sample plane 5. In this embodiment, 9*9 = 81 LEDs 2 arranged in flat form are adopted for forming a rectangular illuminator.

[69] Fig. 4 shows a view of an array of light sources according to another embodiment of the invention, in the sample plane 5. In this embodiment, 76 LEDs 2 in total arranged in three-dimensional form are adopted for forming a hemispherical illuminator. The LEDs 2 are at a constant radial distance from the intersection of the optical axis (+) and the sample plane 5. In the view shown in Fig. 4, the angular increment for the rings formed by the LEDs is fixed, and for each ring, the LEDs have a “constant” angular spacing. An individual azimuthal offset per ring may be set in order to avoid overtone effects.

[70] The embodiment of the method of performing Fourier ptychography shown in Fig. 5 comprises three steps. In step S10, a sample is illuminated at different angles of incidence by at least two adjacent light sources in an array of light sources, wherein the at least two adjacent light sources differ from each other in a property of light beams emitted from them, and the property of light beams of each of the at least two light source matches the sample for increasing a contrast in a single image of the sample to be reconstructed. In step S20, images of the sample are captured by a camera, by means of the light beams from the at least two adjacent light sources. In step S30, the single image of the sample is reconstructed by using the images taken. In embodiments, additional steps are included such as providing one or more biological samples such as such as body fluids, blood cells, blood smears, tissues, and tissue sections. In embodiments, one or more UV light waves are preselected for contacting with the biological samples or specimens to improve contrast of derived images.

[71 ] The present invention is not limited to microscopy, but applies to Fourier ptychography in general.

[72] In some embodiments, the (local) clustering of light sources with wavelengths can also be used to further expand the NA according to reconstruction methods. When the wavelengths become shorter for the higher NA of illumination or there is some overlap with the normal wavelength of illumination for the respective image set, the effective maximal NA can further be increased for the reconstructed image, even though it is based on a different wavelength.

[73] In embodiments, in order to optimize the image quality of the images taken for a single image set, it may be preferential to select wavelength for illumination corresponding to the design wavelength of the imaging optics for chromatic correction such as achromatization and apochromatization. If this is not possible, it is preferential to optimize the setup to group the illumination of same focal settings into sub-groups and to use one of the sub-groups after the other. To further optimize the setup, it is preferable to order the subgroups such that the change from one subgroup to the next changes the focus position in the same direction, e.g. by positive or negative increments. This allows for minimizing the movement, and thus reducing any effects from mechanical hysteresis, or allows for minimizing the execution time of the image capture process, since the mechanical movement becomes minimized.

[74] In embodiments, using the overlap of image data in Fourier space by different wavelengths based on the color corrected images in the image plan enables to use one full image set I given number of raw images, to generate separate synthesized images for one or multiple of the wavelengths used in data capture. An aspect of image synthesis with a reduced weight or only for proper stitching and alignment in stitching for more distant image information for the same wavelength or with much reduced overlap is provided compared to standard reconstruction methods.

[75] The image capture is based on the different wavelengths employed to refocus the optics for the respective wavelength or bandwidth for optimal image contrast to compensate for chromatic (focus) aberrations of the optics. Refocus may also mean to rescale the image since the effective magnification can also change slightly when the focus position changes. This dependence of magnification on focus position and/or wavelength can be determined in standard calibration routines to determine system magnification e.g. by the use of scale bars or length artifacts or as relative scale factor related to an appropriate test structure, e.g. a binary pattern in a chrome on glass structure. With these calibration data, the images captured at a given wavelengths can be rescales in size prior to their application in the Fourier ptychographic reconstruction.

[76] In some embodiments, the present disclosure relates to an array of light sources (2) for a Fourier ptychographic imaging system (100), including at least two adjacent light sources (2) which differ from each other in a property of light beams emitted from them and are configured to illuminate a sample (4) at different angles of incidence for reconstructing a single image of the sample using Fourier ptychography, wherein the property of light beams of each light source (2) is configured to match the sample (4) for increasing a contrast and/or a color or material information content in the reconstructed single image of the sample (4). In some embodiments, the property of light beams includes a wavelength, a bandwidth, a spectral profile and/or a polarization of the light beams. In embodiments, the property of light beams is preselected to include light beams having a wavelength characterized as ultraviolet. In embodiments, the contrast in the reconstructed single image of the sample (4) depends on an interaction property of the light beams of the respective light source (2) with a given location of the sample (4). In embodiments, the interaction property includes an absorption, a refraction, a scattering and/or a diffraction of the light beams of the respective light source (2) at the given location of the sample (4). In embodiments, the interaction property depends on the property of light beams of the respective light source (2) and a material and/or a geometry at the given location of the sample (4). In embodiments, the array of light sources (2) includes at least three light sources (2) which are a first light source, a second light source and a third light source, wherein the first light source is adjacent to the second light source which is further adjacent to the third light source, wherein the first and second light sources differ from each other in a property of light beams emitted from them, wherein the second and third light sources differ from each other in a property of light beams emitted from them, and wherein the first and third light sources comprise the same property of light beams emitted from them. In embodiments, in the reconstruction process using Fourier ptychography, an image taken by means of the second light source includes a lower weighting factor than images taken by means of the first and third light sources. In embodiments, in the reconstruction process using Fourier ptychography, an image taken by means of the second light source comprises the same weighting factor as images taken by means of the first and third light sources. In embodiments, the array of light sources (2) includes a plurality of light sources (2), in particular more than three light sources (2), preferably more than five light sources (2), wherein the plurality of light sources form at least two clusters, wherein light sources within each cluster are adjacent to each other, and wherein the property of light beams of light sources in each cluster is configured to match a given location of the sample (4) for increasing a contrast in the reconstructed single image of the given location of the sample (4). In embodiments, the array of light sources is configured to be selected based on a type of the sample (4).

[77] In some embodiments, the present disclosure includes a Fourier ptychographic imaging system (100) including the array of light sources as shown or described herein. In embodiments, the Fourier ptychographic imaging system of the present disclosure includes a bandpass filter, a notch filter, a filter defining a complex spectral profile, and/or an edge filter arranged between the array of light sources (2) and a camera sensor (12) of the Fourier ptychographic imaging system (100). In embodiments, the Fourier ptychographic imaging system of the present disclosure includes an objective (6), wherein an objective aperture of the objective (6) is dividable into a number of segments, wherein each segment of the objective aperture is associated with a light source (2) or a cluster of light sources (2) in the array of light sources (2).

[78] In embodiments, the Fourier ptychographic imaging system (100), includes one or more UV transparent components, such as components including or consisting of quartz. Non-limiting examples of UV transparent components include one or more of light source (2), carrier board (3), sample plane (5), objective (6), region of interest (7), hollow rectangle (8), tube lens (10), camera (12) or UV transparent components thereof, illuminating device (14) or UV transparent components thereof.

[79] In some embodiments the disclosure relates to a biological sample that is embedded in a refracting index matching medium. The refractive index matching medium is preferably transparent in the UV, such as e.g. silicone oil.

[80] In embodiments, the present disclosure includes a method of performing Fourier ptychography, including: illuminating (S10) a sample at different angles of incidence by at least two adjacent light sources in an array of light sources, wherein the at least two adjacent light sources differ from each other in a property of light beams emitted from them, and the property of light beams of each of the at least two light source matches the sample for increasing a contrast in a single image of the sample to be reconstructed; capturing (S20) images of the sample by a camera, by means of the light beams from the at least two adjacent light sources; and reconstructing (S30) the single image of the sample by using the taken images. In embodiments, the property of light beams includes a wavelength, a bandwidth, and/or a polarization of the light beams. In embodiments, illuminating (S10) a sample at different angles of incidence further includes illuminating with ultraviolet light. In embodiments, illuminating (S10) a sample at different angles of incidence further includes providing one or more biological samples of the present disclosure.

[81 ] In some embodiments, the present disclosure relates to an array of light sources (2) for a Fourier ptychographic imaging system (100), including at least two adjacent light sources (2) which preferably differ from each other in a property of light beams emitted from them and are configured to illuminate a biological sample (4) at different angles of incidence for reconstructing a single image of the biological sample using Fourier ptychography, wherein the property of light beams of each light source (2) is configured to match the sample (4) for increasing a contrast and/or a color or material information content in the reconstructed single image of the sample (4), wherein one or more light sources includes ultraviolet light.

[82] In some embodiments, the present disclosure relates to a Fourier ptychographic imaging system (100) including the array of light sources (2) according to the present disclosure such as an array of UV light sources. [83] In some embodiments the present disclosure relates to a method of performing Fourier ptychography, including: illuminating (S10) a biological sample at different angles of incidence by at least two adjacent light sources in an array of light sources, wherein the at least two adjacent light sources preferably differ from each other in a property of light beams emitted from them, and the property of light beams of each of the at least two light source matches the sample for increasing a contrast in a single image of the sample to be reconstructed, wherein at least one adjacent light sources is an ultraviolet light source; capturing (S20) images of the biological sample by a camera, by means of the light beams from the at least two adjacent light sources, wherein the biological sample is characterized as unstained; and reconstructing (S30) the single image of the sample by using the taken images.

[84] It should be understood that all advantageous options, variance in modifications described herein and the foregoing with respect to the embodiments of the array of light sources according to the first aspect may be equally applied to the embodiments of the Fourier ptychographic imaging system according to the second aspect and to the embodiments of the method according to the third aspect, and vice versa.

Example 1

[85] Currently, biological samples that are analysed microscopically such as bloodsmears or tissue sections need to be stained to visualise important information such cell nuclei. This problematically represents a major hurdle on the path to further automation, increases costs and can lead to significant lab-to-lab variation in terms of diagnostic results.

[86] In embodiments, deficiencies in FMP are overcome by a microscopy approach, based on UV Fourier Ptychography Microscopy (FPM), that is able to directly image biolofical samples such as bloodsmears and digital pathology samples without the need for staining. Embodiments, include a method to digitally stain these images to provide clinicians with images that resemble those taken of stained samples.

[87] FPM is novel computational microscopy technology that combines the ability to record images at high resolution combined with a large field-of-view. This is achieved by illuminating a sample from multiple directions at angles both lower and higher than that resulting from the numerical aperture of the used objective. The resulting low-resolution images are than stitched together in Fourier Space using an iterative algorithm based on a Gerchberg-Saxton algorithm. Traditionally, FPM has been performed with great success in the visible range of the spectrum. However, biological samples have little to no absorption in this spectral range. By moving the wavelength from the visible into the UV the natural absorption bands of nucleotides and proteins at approximately 260nm and 280nm respectively, the absorption contrast of biological samples is greatly increased. EXAMPLE 2 UV-FPM for imaging of biological samples without natural absorption contrast

[88] Fourier Ptychography Microscopy (FPM) is a computational microscopy technique that generates high resolution images at large field of views (FoV). This is achieved by capturing images of a sample under various illumination angles greater than the Numerical Aperture (NA) of the used objective and iteratively combining these images in Fourier space into a high-resolution image. Illumination angles are chosen in such a way that images are overlapping by approximately 40% (such as 35% to 45%) in Fourier Space and is depending on several parameters like the used objective or the detector. The resolution limit of an FPM microscope is determined by the sum over the used microscope objective and the maximum illumination angle (a m ax) and the refractive index of the medium (n):

Equation 1

[89] Currently, illumination in Fourier Ptychography Microscopy is achieved by using visible light LED arrays. Numerous designs of such arrays have been proposed, e.g. flat arrays, hemispherical designs. But, in general, they all follow the same design concept: LEDs attached to some sort of carrier board which is then place at a certain distance from the sample. The LEDs are then flashed consecutively to achieve illumination under a specific illumination angle. In embodiments, such LED’s are placed with one or more light sources. Potential applications for this technology are wide ranging. With an eye on diagnostics, FPM may replace a standard optical microscope. For example, haematology (in particular blood smear analysis) or digital pathology. Such potential applications have gained significant interest both in academia as well as industry. For most diagnostic applications the workflow can be summarized as follows. A sample is taken, fixed onto a carrier, e.g. a microscopy slide, stained and then imaged on an FPM microscope. Ideally such a workflow is automized to increase throughput, reduce costs and to achieve consistent results. Staining is performed to create the absorption contrast needed to extract information from the microscope images. At the same time, staining represents a major hurdle as it leads to increased costs, it is also time intensive, and protocols can vary widely between laboratories. The present disclosure provides an FPM based approach using unstained images or imaging. Due to the nature of the image reconstruction, which is based on Gerchberg-Saxton iterative phase retrieval algorithm, FPM reconstructions not only lead to high resolution amplitude images but also to the calculation of a qualitative phase difference. There have been some suggestions to use this phase information to visualise objects that do not have a natural absorption contrast. However, the phase contrast demonstrated today in FPM images is not sufficient to differentiate white blood cells (WBC).

[90] In embodiments the present disclosure includes a UV based FPM system which can image biological samples without the need for staining. Samples are currently stained to generate the absorption contrast required to extract information from a biological sample, e.g. identify white blood cell nuclei. FPM based systems are based on visible light, a frequency in which most biological samples show minimal absorption. As mentioned in the previous section, this is problematic as a sample needs to be stained to create the absorption contras required for FPM-imaging. The present disclosure therefore proposed to shift the wavelength range used for FPM. It is well known that nucleic acids and proteins absorb at 260nm and 280nm respectively (See Figure 6). For example, 260nm radiation is often used to quantify DNA. C=C double bonds also absorb in the UV though the position of the absorption band depends on the amount of electron delocalisation and can shift significantly. Referring now to Fig. 6, Fig. 6 depicts UV Absorbance of Proteins and Nucleic Acids (from: world wide web: handling-solutions.eppendorf.com/sample-handling/photometry/ applications/detailview- applications/news/uv-vis-spectrophotometry-easy-and-quick-qu antification-of-nucleic-aci ds/).

[91 ] Besides the natural absorption contrast, lowering the wavelength has the additional benefit of increased resolution at a constant numerical aperture (see equation 1 ). This also means that a lower NAsys is required to result in the same resolution as a visible light FPM. In turn this means that either fewer LEDs (at lower illumination angles) are necessary or lower NA objectives could be used to achieve a target resolution.

[92] The examples below focus on blood smears and the identification and classification of nuclei within white blood cells but the concept can easily be expanded to other use cases where a sample has no absorption contrast within the visible wavelength range. Another example would be tissue sections which are stained to visualise cell-nuclei and other features within a sample.

[93] Shifting wavelength(s) used for FPM imaging to this wavelength range allows the imaging of biological samples without the need for staining. Figs. 7A and 7B show images of the same white blood cell one time measured with visible light (appr. 450nm) and one time with UV light at 280nm. These images clearly show how the nucleus is only visible when imaging with UV light. Note that these images are single images without FPM reconstruction and the resolution is therefore rather low. Referring now to FIGS. 7a and 7b, a zoomed in image of an unstained bloodsmear on a quartz slide imaged imaged once at 7(a) 600nm and 7(b) 280nm. Images were taken with a single UV LED under the sample and with a 10x/0.2NA objective. In the middle of the image is WBC. The increased absoprtion contrast of the nuclus) when imaging with 280nm is obvious.

[94] Referring now to Fig. 8, Fig. 8 shows an FPM reconstruction of white bloodcell when imaged at 280nm. A total of 121 images at various illumination images up to a maximum illumination angle of approximately 35° were acquired and stitched together in Fourier Space in order to generate the high-resolution image. Fig. 8 depicts FPM reconstruction of an image of bloodsmear imaged at 280 nm.

[95] It has been shown that biological samples used for FPM benefit from being embedded in a refractive index matching medium such as DPX mountant or microscope immersion oil and then sandwiched between two slides. In the case of UV FPM these slides as well as the mounting medium need to be UV transparent preferably in the range 250nm-320nm. An example for such a medium is silicon oil. One option to reduce the costs associated with the use of quartz as a carrier for the sample would be to employ an inverted FPM microscope. That way, only a thin coverslip would need to be made out of quartz to minimize absorption. In such a scenario, samples could also be mounted on the coverslip directly without the need for a second slide.

[96] Pathologists are used to analyse stained samples. As such it will be preferred to present them with colour images to drive acceptance. Digital staining of FPM images can be used to generate colour FPM images. Such staining can be achieved through direct overlay of FPM images measured at multiple wavelengths and adjusted the white balance of the images or by training an Al algorithm to stain the images. For both staining methods it is advisable to acquire UV-FPM images at multiple wavelengths, at least 2. It is also advisable that at least one of the used wavelengths is in the non-absorbing range of the sample to act as a counterstain.

[97] The ability to perform imaging of biological samples at large FoV, high resolution and without the need for staining also open the door to increased automation of the diagnostic workflow at reduced costs. Though it should be noted, that even with the large FoV offered by FPM scanning of a sample may still be necessary. Images could also be stitched together to create images of the whole sample with the ability to zoom in and out, mimicking an optical microscope. Furthermore, FPM allows for digital re-focussing of the sample. Paired with an ability to perform z-stacks this would allow for tomographic like imaging of a sample.

[98] As mentioned above, most commonly some form of LED array is used in FPM. It is possible to pattern the light-source such that different wavelengths are used at different positions and subsequently reconstructed into a single image. Polarization filters or polarization sensitive cameras could also be used in UV-FPM. This would minimize the effect of scattered background light and should lead to a reduction noise. The concept of polarisation FPM will be covered in more detail in a separate invention disclosure. [99] It should be noted, that changing the wavelength into the UV requires some changes to a standard FPM microscope. LEDs (or any other light-source used) are to be replaced with the corresponding UV counterparts. As UV LEDs are readily available nowadays this does not lead to any greater issues. Also, all optical components and the camera will need to be UV compatible. This means for example changing all glass-based parts to quartz. The sample as well does also need to be mounted on quartz microscope slides.

[100] In general, the concept described above can be expanded to all cases where a sample does not observe in the visible light range but in the UV, for example digital pathology. Tissue sections are also stained to create absorption contrast within the sample and FPM.

[101 ] The major difference to known solutions lies in the use of UV light-based FPM. Instead of using one or more stains to generate absorption contrast where there is none in a sample, the wavelength of the light is changed to make use of naturally existing absorption bands. This results in: easier automation, reduced hands-on time, removal of variability due to varying staining protocols, and easier comparison of results generated in different laboratories.

[102] In the foregoing detailed description, various features are grouped together in one or more examples for the purpose of streamlining the disclosure. It is to be understood that the above description is intended to be illustrative, and not restrictive. It is intended to cover alternatives, modifications and equivalents. Many other examples will be apparent to one skilled in the art upon reviewing the above specification.

[104] List of Reference Signs

[105] 2 light source

[106] 3 carrier board

[107] 4 sample

[108] 5 sample plane

[109] 6 objective

[110] 7 region of interest

[111] 8 hollow rectangle

[112] 10 tube lens

[113] 12 camera

[114] 14 illuminating device

[115] 16 base unit

[116] 18 hemispherical carrier

[117] 20 circular sub-region

[118] 100 Fourier ptychographic imaging system

[119] S10-S30 method steps