CLAIM FOR PRIORITY

[0001] This application claims priority to U.S. Provisional Patent Application Serial No. 63/275,051, filed on November 3, 2021, and entitled “TELEPHOTO LENS”, the content of which is incorporated by reference in its entirety herein.

FIELD OF THE INVENTION

[0002] The present invention relates generally to image capture systems, more particularly, to image capture device systems that utilize a flat sparsely-filled aperture to provide a telephoto lens in a thin form factor and also provide zoom capabilities for the flat sparsely-filled aperture imaging device.

BACKGROUND OF THE INVENTION

[0003] Many people utilize portable, handheld information handling devices (e.g., smart phones, tablets, smart watches, etc.) to capture images. For many people it is much easier to capture an image with a device that serves many purposes, instead of utilizing a dedicated imaging device. Additionally, dedicated imaging devices may be large and heavy and a person may not want to carry it everywhere in the event that the perfect photo opportunity arises. Thus, the portable, handheld information handling device solves some of these problems. Since these devices are utilized so frequently for image capturing, the imaging mechanisms, imaging optics, and on-board image

SUBSTITUTE SHEET RULE 26 processing have become more advanced to provide for better quality images as compared to older portable, handheld information handling devices. However, due to the form factor of the information handling device, these devices and imaging mechanisms suffer from some deficiencies as compared to larger, dedicated imaging devices. For example, some features that are found on dedicated imaging devices are not available on the described information handling devices due to the size of the information handling device.

[0004] For example, information handling devices do not have a true telephoto lens. The challenge is the diffraction limit. The diffraction limit of the human eye is set by the pupil diameter, which is typically 5 mm in daylight. For visible light, with a wavelength of 0.55 micrometers, that sets the Rayleigh limit at about 30 seconds of arc (0.5 minute of arc). A 7x set of binoculars can give no more detail unless it delivers a resolution of 30 sec/7 ~ 4 sec of arc. To do that its diffraction limit, typically set by the front lens, must be at least 7x the diameter of the human pupil, that is, about 35 mm. When binoculars are designated 7x35, that means they magnify 7x compared to normal eyesight, and have a 35mm aperture, thus allowing them to deliver adequate optical resolution at that magnification.

[0005] A telephoto lens is characterized by its long focal length. For standard 35 mm cameras, a 50mm focal length gives the standard photographic image. A 100mm focal length gives 2x magnification and a 350 mm lens delivers 7x magnification, the same as 7x35 binoculars. The necessary focal length for a telephoto lens causes a challenge

SUBSTITUTE SHEET ( RULE 26) in putting the telephoto lens on an information handling device, particularly one having a thin form factor. One technique for increasing the focal length within a thin form factor is by folding the optics, an example of which is shown in Figure 2. In this example, the light enters through a 6 mm aperture, is reflected, and focused on an imaging array that is 1.5 cm distant from the aperture. Thus, the folded lens design allows a focal length of 1.5 cm in a mobile phone that may have only 6 or 7 mm of thickness to carry the image. As is evident from the diagram, the width of the aperture is not significantly greater than that of the human eye, so the resolution is limited to about 30 arc sec. But if a larger-diameter aperture is used, then the light from that aperture will not fit in the thin mobile camera.

SUMMARY OF THE INVENTION

[0006] In order to create a telephoto lens that will fit in a thin information handling device form factor, the described system provides an imaging device including a sparsely-filled optical aperture and imaging optics. The sparsely-filled optical aperture is in a shape that forms an outer portion of the optical aperture. In other words, and as an example, the optical aperture may be a ring shape, where the inner portion of the ring is not part of the optical aperture. This is in contrast to traditional telephoto lenses in which the entire area of the aperture is filled. For example, FIG. 3 A - 3D illustrates examples of information handling devices having sparsely-filled optical apertures. In these examples, the white portion corresponds to the optical aperture(s) and the gray portion corresponds to other parts of the information handing device. As illustrated in

SUBSTITUTE SHEET ( RULE 26) these examples, the optical aperture is in a ring shape that has an inner portion that corresponds to the information handling device and not the optical aperture(s).

[0007] Due to the thin form factor of the information handling device, the imaging optics may be in the folded optics design, for example, as found in FIG. 2. Thus, the imaging device also includes imaging optics that include at least one reflection device that is optically located after the optical aperture and at least one imaging sensor optically located after the at least one reflection device. When light enters the optical aperture, the light reflects from the at least one reflection device onto the at least one imaging sensor.

[0008] Thus, the system, device, and method described herein provide a novel technique for providing a telephoto lens within a thin form factor information handling device. Specifically, the described system and method utilizes a sparsely- filled aperture that provides a long focal length and a large-diameter aperture that can be included within a thin design, even if the sparsely-filled aperture is included in an information handling device that can support a thicker imaging device. Additionally, the described system and method provides a technique that allows for a zoom feature with the described telephoto lens utilizing one or more movable lenses.

[0009] In summary, one aspect provides an imaging device, including: a sparsely- filled optical aperture having a shape forming an outer portion of the optical aperture, wherein at least a portion of an inner portion formed by the outer portion of the optical aperture is not a part of the optical aperture; and imaging optics, wherein the

SUBSTITUTE SHEET ( RULE 26) imaging optics include at least one reflection device optically located after the optical aperture and at least one imaging sensor optically located after the at least one reflection device, wherein light entering the optical aperture reflects from the at least one reflection device onto the at least one imaging sensor.

[0010] Another aspect provides information handling device, including: an imaging device, including: an sparsely-filled optical aperture having a shape forming an outer portion of the optical aperture, wherein at least a portion of an inner portion formed by the outer portion of the optical aperture is not a part of the optical aperture; and imaging optics, wherein the imaging optics include at least one reflection device optically located after the optical aperture and at least one imaging sensor optically located after the at least one reflection device, wherein light entering the optical aperture reflects from the at least one reflection device onto the at least one imaging sensor; at least one memory device; and at least one processor operatively coupled to the imaging device and the at least one memory device.

[0011] Another aspect provides a method, including: receiving light through an sparsely-filled optical aperture, wherein the optical aperture is formed in a shape forming an outer portion of the optical aperture, wherein at least a portion of an inner portion formed by the outer portion of the optical aperture is not a part of the optical aperture; and reflecting the light using at least one reflection device optically located after the optical aperture onto at least one imaging sensor optically located after the at least one reflection device.

SUBSTITUTE SHEET ( RULE 26) A BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Fig. 1 illustrates a block diagram showing an example apparatus device.

[0013] Fig. 2 illustrates an example folded optics design.

[0014] Fig. 3A - 3D illustrates example information handling devices with one or more sparsely-filled aperture.

[0015] FIG. 4 illustrates an example cross-section of the optics design illustrated in FIG. 3B.

[0016] FIG. 5 illustrates an example resolution of the human eye and of the 7x ring optics of FIG. 3B and FIG. 4.

[0017] FIG. 6 illustrates an example cross-section of the optics design of a multiple camera embodiment.

[0018] FIG. 7 illustrates an example cross-section of the optics design of a double flat camera with two focal lengths.

[0019] FIG. 8 A - 8B illustrates two other example cross-sections of sparsely-filled aperture layouts.

[0020] FIG. 9A - 9F illustrates example non-ring sparsely-filled apertures.

[0021] FIG. 10 illustrates an example cross-section of the optics design of a sparsely- filled aperture with a zoom feature.

[0022] FIG. 11 illustrates an example cross-section of the optics design of a sparsely- filled aperture with a zoom feature and having a flatter design.

SUBSTITUTE SHEET ( RULE 26) [0023] FIG. 12 illustrates an example plan view of the optics design illustrated in FIG. 10.

[0024] FIG. 13 illustrates an example design for a zoom feature of an imaging device having a stationary imaging sensor.

[0025] FIG. 14 illustrates the zoom ratio as a function of the position of the first movable lens illustrated in FIG. 13.

DETAILED DESCRIPTION OF THE INVENTION

[0026] In accordance with the present application, the described system and method provide a technique for addressing the challenges of a long focal length and large- diameter aperture within a thin form factor or a thin imaging device. Specifically, the described system and method utilize an aperture that is not-completely-filled, also referred to as a sparsely-filled aperture. Such a sparsely-filled aperture allows for an imaging device that can be thin, for example, less than 10 millimeters in thickness. [0027] Referring to Fig. 1, a device 1000, for example, that includes the described imaging device or that can be used within the imaging device, is described. The device 1000 includes one or more microprocessors 1002 (collectively referred to as CPU 1002) that retrieve data and/or instructions from memory 1004 and execute retrieved instructions in a conventional manner. Memory 1004 can include any tangible computer readable media, e.g., persistent memory such as magnetic and/or optical disks, ROM, and PROM and volatile memory such as RAM.

SUBSTITUTE SHEET ( RULE 26) [0028] CPU 1002 and memory 1004 are connected to one another through a conventional interconnect 1006, which is a bus in this illustrative embodiment and which connects CPU 1002 and memory 1004 to one or more input devices 1008 and/or output devices 1010, network access circuitry 1012, and orientation sensors 1014. Input devices 1008 can include, for example, a keyboard, a keypad, a touch- sensitive screen, a mouse, and a microphone. Output devices 1010 can include one or more displays - such as an OLED (organic light-emitting diode), a microLED, or liquid crystal display (LCD), or a printed image of sufficiently high resolution - and one or more loudspeakers for associated audio. Network access circuitry 1012 sends and receives data through computer networks. Orientation sensors 1014 measure orientation of the device 1000 in three dimensions and report measured orientation through interconnect 1006 to CPU 1002. These orientation sensors may include, for example, an accelerometer, gyroscope, and the like, and may be used in identifying the position of the user.

[0029] One type of sparsely-filled aperture is referred to as a “ring aperture.” The ring aperture is an optical aperture having a circular shape that forms an outer portion of the optical aperture. At least a part of the area enclosed by the outer portion of the optical aperture is not a part of the optical aperture. In other words, the optical aperture forms a circular shape that has an inner portion that is not a part of the optical aperture. An example of a ring aperture is shown in Figure 3 A, placed on the back of a commercially available mobile phone. This will be the example used here

SUBSTITUTE SHEET ( RULE 26) throughout. However, this is not intended to be a limiting example, as the described imaging device can be used on any information handling device.

[0030] In Figure 3, the aperture is represented by the white region on the back of the phone. The ring lens in Figure 3 A gives 3x the resolution of the human eye, and thereby qualifies as a true telephoto lens. If we take a 35mm equivalent, and say that for such a camera, 35mm serves as the standard eye resolution, then this camera gives the equivalent of 3x35mm = 105 mm equivalent focal length. Figure 3B shows a larger ring telephoto that gives 7x eye resolution, and thus is equivalent to 7x binoculars, or to a camera equivalent of 225 mm. Thus, the size of the sparsely-filled optical aperture influences a maximum magnification value of the imaging device. [0031] A cross-section of the Figure 3B optics is shown in Figure 4. The dark black lines indicate ray paths through the imaging optics. The imaging optics include at least one reflection device optically located after the optical aperture and at least one imaging sensor optically located after the at least one reflection device. Light entering the optical aperture reflects from the at least one reflection device onto the at least one imaging sensor. As can be seen in Figure 4, the light entering the ring optics (illustrated entering at the top of the cross-section) is focused toward the center of the ring onto the imaging array, also referred to as an imaging sensor. In the implementation shown, the focus is achieved by two reflectors, the ring reflector that folds the light towards a central spherical or semi-spherical reflector that folds the light towards the imaging array. In another embodiment, rather than reflectors, lenses

SUBSTITUTE SHEET ( RULE 26) may be utilized. However, the reflectors tend to minimize chromatic aberration. It should be noted that the diffraction limit of a sparsely-filled aperture is superior to that of a filled aperture due to the fact that the average spacing of points on the sparsely-filled aperture is greater than it is for a filled aperture.

[0032] The diffraction pattern of the 7x lens (Figure 3B) for a point source of light (e.g. a star) is shown in Figure 5, along with the diffraction pattern for a camera that has a 5 mm filled circular aperture which is comparable to the geometry of the human eye. In Figure 5, the image of a star-like object (point-spread-function) is shown for the human eye and for the 7x camera (Figure 3B). Also plotted is the human eye image with its intensity multiplied by a factor of 100, so its shape can be more easily compared to that of the ring aperture. As seen, the 7x camera of Figure 3B yields a brighter image. This is due to the fact that the larger lens captures more light, and that it squeezes the light into a smaller diffraction peak.

[0033] Images in digital cameras can be “sharpened” by applying image processing. One of the best kinds of such processing is the application of a Wiener filter to the image. In many cases, a Wiener filter is the optimum method for improving the quality of an arbitrary image. Applying such filters typically consists of doing a fast- Fourier transform (FFT) to the image, dividing the result by the Wiener filter function, which is typically a function based on the Fourier transform of the aperture combined with an estimate of the image signal-to-noise ratio. Such filtering is well-

SUBSTITUTE SHEET ( RULE 26) known to those practiced in the art of image manipulation, and it typically improves the resolution of the image by a factor of 2 to 3.

[0034] This same type of sharpening can be accomplished with the ring aperture optics without applying an image processing or applying a Wiener filter to the image. It is expected the ring aperture will give a factor of 2-3 improved resolution. Note that we do not include this factor of 2-3 in our statement that the ring optics can improve over a filled circular aperture by a factor of 7x or more. If we included it, we would say that the ring aperture could improve over an unfiltered filled circular aperture by a factor of 14x to 21x. However, since such filtering is available to a filled circular aperture camera, to make a comparison to the filled aperture we do not include it. [0035] The ring aperture has a series of secondary peaks, seen in Figure 5 near 8 arcsec, 15 arcsec, and 22 arcsec. These can create rings around point-like objects, such as stars. To reduce such artifacts, the described system can include image processing in the camera. This will happen if a Wiener filter based on the point- spread-function of the ring aperture is applied to the image. Other more advanced filter methods can also be used, such as those based on artificial intelligence.

Artificial intelligence can improve an image better than a Wiener filter by deducing the nature or context of the image (a face? a building? a tree?) and by applying different filters to different parts of the image. As an alternative, the filtering could be applied by software once the image has been moved to an external computer.

SUBSTITUTE SHEET ( RULE 26) [0036] The properties of non-filled apertures are not widely known to optical designers, since in most camera and telescope designs, it is considered important to bring as much light as possible from the region of the aperture to the focus. The described system and method demonstrate that if the goal is not maximum light, but high resolution in an extremely compact space, then a sparsely-filled aperture can provide that. The value of a non-filled aperture is further enhanced when strong computing power is available, as is true when the camera is implemented in a modern mobile phone.

[0037] In the example of Figure 3 reflected optics were used; this assists in minimizing chromatic aberration. However, this may result in a small amount of diffractive aberration, since blue light focuses slightly more sharply than does red light. Such an aberration could be corrected in software, or by the introduction of corrective optics in the camera. Utilizing only a slice of a full reflecting sphere, as shown in the illustrated figures, may result in minimal spherical aberrations. Accordingly, instead of a sphere, the surface could be parabolic shape, or it could be a different shape that minimizes total aberration, including spherical and astigmatism. The central reflector, which is depicted as spherical in Figure 4, could be other shapes, including parabolic, hyperbolic, or other shape than spherical. The shape could be configured to minimize aberrations. Moreover, a lens or combination of lenses could be placed between the sparsely-filled optics camera and the image sensor to minimize aberrations.

SUBSTITUTE SHEET ( RULE 26) [0038] The discussed example was chosen to match the dimensions of common mobile phones. However, the method described here (non-filled aperture, digital filters applied in image processing) has application in situations in which a thin imaging device is desired.

[0039] Since most of the space within the ring is empty (referred to as the inner portion formed by the outer portion of the optical aperture), additional cameras could be combined with the sparsely-filled optical aperture imaging device. Figure 3C and 3D show a mobile phone with additional apertures. These apertures could be conventional cameras, for example, as shown in Figure 3C as filled circular lenses within the inner portion or additional sparsely-filled optical aperture imaging device, as shown in Figure 3D).

[0040] Figure 6 shows a cross-section of a multiple camera embodiment that includes one large-diameter ring camera and three smaller-dimeter conventional cameras, for example, as illustrated by Figure 3C. Two of the smaller-diameter conventional cameras are based on focus by lens and one is based on focus by reflection. Of course, lens and reflective focus could be combined.

[0041] Thus, as shown in Figure 3C and Figure 6, it can be seen that the large ring optical aperture does not necessary prohibit the use of other cameras in the space within the ring. It is also possible to use two or more ring optical aperture imaging devices on the same part of the mobile phone or other flat device, for example, as

SUBSTITUTE SHEET ( RULE 26) illustrated in Figure 3D. A cross-section of the optics of such an example is illustrated in Figure 7.

[0042] The large but non-filled aperture can provide the angular resolution needed for a compact telephoto camera that can fit in a thin object such as a mobile phone. Additionally, image compensation can eliminate the image artifacts that otherwise could make the image less satisfactory. While the previously described example provides a particular geometry that achieves these objectives, other geometric layouts can achieve a similar high angular resolution. Two of these are shown in Figure 7. [0043] In Figure 7, two ring cameras (“outer ring” and “inner ring”) create two separate images. For the outer ring, the ray path is similar to that shown in Fig 4. The inner ring camera, in this implementation, takes advantage of the fact that most of the light that hits a glass surface near normal incidence will pass though the surface rather than be reflected. Thus, the light from the outer ring lens is reflected (by total internal reflection) off the inner spherical surface, but the light from the inner ring lens passes through. Other designs and geometric layouts are possible and contemplated. For example, the two cameras in Figure 7 could have additional cameras added in the manner shown in Figure 4.

[0044] Once the value of a ring geometry is recognized, with additional value obtainable by image processing, then other layouts can be used that would be evident to a person practiced in the field of camera optics. Figure 8A and Figure 8B shows

SUBSTITUTE SHEET ( RULE 26) two such embodiments. These use both refractive optics and reflective optics. There are many combinations that can be used.

[0045] Note also that, in the designs depicted in this document, many of the surfaces do not participate in required reflections. These surfaces can be blackened, that is, made to absorb stray light, by using methods well-known to those practiced in the art of camera design.

[0046] While the description has described an optical aperture having a ring shape, other shapes can be used. To achieve high (e.g. about 7x) resolution in all directions, the aperture needs to contain regions that are substantially separated in all directions (all azimuths). This can be done with rings, but it can be done in other ways. Example embodiments illustrating the use of different partially-filled apertures are shown in Figures 8A - 8F

[0047] In addition to the telephoto function of the previously described optical aperture and imaging device, a zoom capability can be included with the described optical aperture. To include a zoom capability, additional components are added to the imaging optics of the previously described imaging optics. Specifically, instead of the light or image that is captured hitting the imaging sensor from the central reflection device, it is reflected by a mirror to make it have a vertical orientation. This mirror may be a 45° mirror. The image location could also contain an optional field lens, which is common in optics design. Figure 10 illustrates an example cross-section of the optics for such an optical aperture having a zoom capability. Similar optics can be

SUBSTITUTE SHEET ( RULE 26) achieved using lenses instead of mirrors or a combination of mirrors and lens. Additionally, the interior of the optics may be plastic, glass, air, and/or the like. Another example cross-section of the optics for such an optical aperture having a zoom capability is illustrated in Figure 11. In Figure 11, an additional mirror has been added before the imaging sensor. This design allows for flatter imaging optics, thereby allowing for fitment in a thinner form factor.

[0048] The optional field lens is normally placed at or near the location of an image. It is designed to focus the objective lens (in this diagram, that is the ring paraboloid) onto or near the objective lens of the microscope. Since in the described system and method the imaging array is moving, the fixed focus of the field lens would be somewhere along the path of motion of that lens. That microscope has an objective lens that reimages the initial image onto a sensor array.

[0049] Figure 10 and Figure 11 shows that the microscope is in the path of some of the rays of light that are being imaged. However, the design is such that this blockage can be acceptable. This is clarified in Figure 12, which shows a schematic plan view of the zoom telescope. The microscope only blocks a small wedge of the incoming light, and this can be designed to have minimal impact on the final image.

[0050] The first image, that of the parabola-hyperbola combination, is called the primary image. The image of the field lens and objective lens of the microscope is called the secondary image. By motion of the objective lens and the imaging array, also referred to as an imaging sensor, the desired zoom effect can be achieved. This is

SUBSTITUTE SHEET ( RULE 26) most readily seen by making the assumption that the objective lens is a thin lens, and then using the thin lens approximation. If the objective lens has a focal length of f, and it is placed a distance dl from the primary image, then the secondary image will appear a distance d2 from the objective lens, where, according to the thin lens formula:

1/f = 1/dl + l/d2 Eq 1

[0051] To get an image that is in-focus, once dl is chosen, then d2 must be chosen to match this formula. This can be done by mechanical linkages, or by separate control of the positions of the objective lens and the positioning array.

[0052] In this equation, f is fixed, but dl and d2 are adjustable. The magnification M is given by:

M= d2/dl Eq 2

[0053] Using Eq 2 to eliminate d2 from Eq 1, and solving for M, we get

M = f/ (dl-f) Eq 3

[0054] Thus, by changing dl and d2 according to Eq 1, we keep the image in focus, but achieve a variable magnification according to Eq 3. Figure 12 is drawn such that d2 ~ 2 dl, so the zoom magnification is ~ 2. This can be changed by moving the lens and the imaging sensor.

[0055] In some designs, it might be desirable to have the sensor at a fixed position. For this case, a zoom telescope can be achieved by having two moving lenses. However, the positioning of the two lenses involves a complicated formula that is not

SUBSTITUTE SHEET ( RULE 26) easily achieved by mechanical means alone. However, it is easily achieved if a simple microprocessor is used to position the two lenses. A design for the zoom microscope that has a fixed position detector in shown in Figure 13.

[0056] In this Figure, the distance between the primary image (from the parabaloid- hyperbolide-45° mirror combination) is labeled “image 1”. (This is the same as “1st image plane” on Fig 10 and Figure 11.) However in the design of Figure 13, there are two moveable lenses (lens 1 and lens 2) and an imaging sensor array that is fixed at a distance L from the location of Figure 10 and Figure 11. Lens 1 with focal length fl is located a changeable distance 01 from the fixed image. The image is formed at distance 12 to the right of this lens. If fl is the focal length of this lens, then:

1/fl = 1/01 + 1/11 Eq. 4

[0057] Similarly for the second lens, with focal length f2: l/f2 = 1/02 + 1/12 Eq. 5

[0058] We have the length constraint equation:

01 + 11 + 02 + 12 = L Eq. 6

[0059] The magnification of the microscope is the ratio of the sizes of image 3 to that of image 1. The magnification of lens 1 is 11/01; the magnification of lens 2 is 12/02; the magnification of the combination is the product of these:

M = 11 12/(01 02) Eq. 7

[0060] The diagram also shows a field lens. In the optimum configuration, this lens would be positioned at image 2 and have a focal length that images lens 1 onto lens 2.

SUBSTITUTE SHEET ( RULE 26) However, a field lens need not be precisely focused and in many aspects can be fixed in a region in the center of the range of motion of image 2. In Fig 13, the optional field lens is shown in light grey. It is designed to approximately image the face of lens 1 onto the face of lens 2.

[0061] For a given value of 01, we can consider equations 4, 5, 6, and 7 to be four equations with four unknowns: II, 02, 12, and M. Thus, we can solve for all of these using algebra. The magnification M that results from these equations is a function of 01 (the placement of the first lens), assuming that the second lens is correctly placed at the location 01 + 11 + 02 from image 1. For the chart illustrated in Figure 14, L = 24 mm, f 1 = 3 mm, f2 = 2.5 mm. Then, for a given 01, the value of M is calculated from the equations and plotted.

[0062] The chart of Figure 14 shows that if lens 1 is placed 4 mm from image 1, then image 3 on the detector (as distance L from image 1) will be magnified by a factor of 5, that is, will have a 5x zoom. A zoom slightly less than 1 is obtained if 01 is greater than 5.3. This example is illustrative; other values can be obtained by this design by appropriate choice of L, fl, and f2.

[0063] Image stabilization can be achieved by lateral motion of the sensor array, using a separate tilt sensor to compute the required motion.

[0064] The above description is illustrative only and is not limiting. The present invention is defined solely by the claims which follow and their full range of equivalents. It is intended that the following appended claims be interpreted as

SUBSTITUTE SHEET ( RULE 26) including all such alterations, modifications, permutations, and substitute equivalents as fall within the true spirit and scope of the present invention.

SUBSTITUTE SHEET ( RULE 26)