TECHNICAL FIELD

The invention relates to electronic communication devices like mobile telephones and tablet computers.

BACKGROUND

In recent years, the available screen sizes of mobile communication devices have continually increased. The goal of achieving a large size of the displayed image, though is contrary to the goal of achieving a high degree of portability.

SUMMARY

Accordingly, an object of the present invention is to provide an apparatus, which allows for displaying an image or video by a mobile communication device without impairing the mobility of the communication device.

The present invention is defined by the independent claims. Further developments are shown by the dependent claims.

According to a first aspect of the invention, an electronic communication device is provided. The electronic communication device comprises an image source, which is configured to generate modulated light, forming an image. Moreover, the electronic communication device comprises optics, which are configured to focus the modulated light onto a projection surface. By displaying the image on an external projection surface instead of on a screen of the mobile communication device, the achievable image size is independent of the size of the communication device. Therefore, the display of an image without detrimental effects on the mobility of the communication device is achieved.

In an advantageous embodiment, the image source comprises a light source, which is configured to generate light, especially non-modulated light, and a light modulator, which is configured to modulate the light generated by the light source, thereby generating the modulated light forming the image. Separating the light source and the modulator allows the use of a large degree of different technologies, achieving a very flexible construction. According to a further advantageous embodiment, the electronic communication device comprises a liquid-crystal display touchscreen which comprises a liquid-crystal layer, and a backlight. The light modulator is the liquid-crystal layer of the LCD touchscreen of the electronic communication device. The light source is a separate light source from the backlight of the LCD touchscreen of the electronic communication device. The light source preferably has a luminance which is greater than a luminance of the backlight of the LCD touchscreen of the electronic communication device. By using the liquid-crystal layer of the touch screen as a light modulator, a separate light modulator is not necessary. This significantly simplifies the construction. By using a separate light source from the backlight of the touch screen, a significantly higher luminance of the resulting projected image can be achieved than when using the backlight. It should be noted, though, that also the backlight may be used as the light source, instead.

In an advantageous alternative embodiment, the electronic communication device comprises an organic light-emitting diode, OLED, touchscreen. The light modulator is a liquid-crystal light modulator, mounted between the light source and the OLED touchscreen. The OLED touchscreen is transparent or semi-transparent to the modulated light generated by the image source. The light source preferably has a luminance which is greater than a luminance of the OLED touchscreen of the electronic communication device. This allows for the use of the inventive technology together with high-quality OLED screens. A higher image quality on the display of the communication device is thereby achieved while still achieving the image projection capability of the present invention.

According to a further advantageous embodiment, the optics comprise primary optics arranged between the light source and the light modulator. This allows for a very compact design of the electronic communication device.

Further advantageously, the primary optics are tunable optics, and/or the primary optics comprise a tunable lens, and/or the primary optics comprise a liquid-crystal layer with a tunable refractive index. This allows for a very flexible projection, especially at different projection distances, and onto differently shaped projection surfaces. According to a further advantageous embodiment, the optics comprise secondary optics arranged between the light modulator and the projection surface. The secondary optics are mounted to the light modulator directly, or at a distance smaller than a distance between the light source and the light modulator. This allows for an especially high-quality projection of the image, while still achieving a small size of the communication device.

Advantageously, the secondary optics are tunable optics, and/or the secondary optics comprise a tunable lens, and/or the secondary optics comprise a liquid-crystal layer with a tunable refractive index. Also with these measures, the projection quality is significantly increased. Especially, a high degree of flexibility regarding the projection distance and the shape of the projection surface is thereby achieved.

According to a further advantageous embodiment, the image source is a touchscreen, preferably a liquid-crystal display, LCD, touchscreen or an organic light-emitting diode, OLED, touchscreen, configured to generate the modulated light forming the image. The optics comprise a lens, configured to focus the modulated light onto the projection surface and a lens holder, configured to hold the lens parallel to the touchscreen at a preset distance to the touchscreen, the preset distance preferably being 10 mm - 100 mm, especially preferably being 30 mm - 60 mm. An especially simple construction of the communication device is thereby achieved.

Advantageously, the lens is a Fresnel-lens, and/or wherein the lens is fixedly attached to the lens holder, and/or wherein the lens holder is detachably mounted to the electronic communication device, and/or the lens holder and/or the lens cover an area of the touchscreen which is smaller than the touchscreen, and/or wherein the lens holder and/or the lens do not cover a camera of the electronic communication device, mounted on a touchscreen side of the electronic communication device. This achieves a very flexible construction of the communication device, while at the same time achieving a high degree of functionality.

According to a further advantageous embodiment, the electronic communication device is a smartphone or a tablet computer. A very high degree of flexibility of use is thereby achieved.

According to a further advantageous embodiment, the electronic communication device additionally comprises a projection surface sensor, which is configured to capture an image of the projection surface, and/or a shape of the projection surface, and/or a distance of the projection surface. The communication device moreover comprises an augmented reality, AR, processor, configured to generate an AR image based upon the image of the projection surface, and/or the shape of the projection surface and/or the distance of the projection surface captured by the projection surface sensor. The image source is then configured to generate the modulated light to form the AR image, taking the image of the proj ection surface captured by the proj ection surface sensor into account, compensating for color and/or reflectivity of the projection surface. This allows an especially high degree of functionality of the electronic communication device.

In an advantageous embodiment, the optics are configured to focus the modulated light onto the projection surface, taking the shape of the projection surface and/or the distance of the projection surface captured by the projection surface sensor into account, distorting the modulated light to compensate for the shape and/or the distance of the projection surface. An especially high quality of the projected image is thereby achieved.

According to a further advantageous embodiment, the electronic communication device moreover comprises a body function sensor, preferably an infrared, IR, camera, configured to determine at least one body function parameter of a user of the electronic device, the body function parameters including pulse, blood pressure, body temperature.

Additionally or alternatively, the electronic communication device comprises a body scanner, preferably an infrared camera, configured to determine a composition and/or structure of a user’s body, including a position of blood vessels, and/or organs, and/or limbs.

The image source is then configured to generate the modulated light forming the image to incorporate an indicator of the at least one body function parameter and/or the composition and/or structure of the user’s body. Therein, the projection surface is a part of the user’s body. By these measures, an applicability of the inventive electronic communication device in the medical field, especially for medical diagnostics and treatment is achieved.

It is important to note that the invention is not limited to this previously described medical field.

In a further advantageous embodiment, the projection surface sensor comprises a user-facing camera on a touchscreen-side of the electronic communication device, configured to capture images of a user, and configured to capture the image of the projection surface. Additionally or alternatively, the projection surface sensor comprises a proximity sensor, which is configured to detect a proximity of a user, and configured to detect a proximity of the projection surface. Additionally or alternatively, the projection surface sensor comprises a dot/line/grid projector, configured to project a dot pattern or a line pattern or a grid pattern onto a user’s face for an unlocking process of the electronic communication device, and configured to project a dot pattern or a line pattern or a grid pattern onto the projection surface for determining the shape of the projection surface and/or the distance of the projection surface. Additionally or alternatively, the projection surface sensor comprises an infrared camera configured to capture an infrared image of a user for an unlocking process of the electronic communication device, and configured to capture an infrared image of the projection surface for determining the shape of the projection surface and/or the distance of the projection surface. Additionally or alternatively, the projection surface sensor comprises a flood illuminator configured to illuminate a user’s face for an unlocking process of the electronic communication device, and configured to illuminate the projection surface for capturing the image of the projection surface and/or the shape of the projection surface and/or the distance of the projection surface. By using the same sensors, which the electronic communication device already comprises for different purposes, a number of sensors required in total is significantly reduced, achieving a very low construction complexity.

Generally, it has to be noted that all arrangements, devices, elements, units and means and so forth described in the present application could be implemented by software or hardware elements or any kind of combination thereof. Furthermore, the devices may be processors or may comprise processors, wherein the functions of the elements, units and means described in the present applications may be implemented in one or more processors. All steps which are performed by the various entities described in the present application as well as the functionality described to be performed by the various entities are intended to mean that the respective entity is adapted to or configured to perform the respective steps and functionalities. Even if in the following description or specific embodiments, a specific functionality or step to be performed by a general entity is not reflected in the description of a specific detailed element of that entity which performs that specific step or functionality, it should be clear for a skilled person that these methods and functionalities can be implemented in respect of software or hardware elements, or any kind of combination thereof. BRIEF DESCRIPTION OF DRAWINGS

The present invention is in the following explained in detail in relation to embodiments of the invention in reference to the enclosed drawings, in which

Fig. 1 shows a first embodiment of the inventive electronic communication device;

Fig. 2 shows a second embodiment of the inventive electronic communication device;

Fig. 3 shows a third embodiment of the inventive electronic communication device;

Fig. 4 shows a fourth embodiment of the inventive electronic communication device;

Fig. 5 shows a fifth embodiment of the inventive electronic communication device in operation, and

Fig. 6 shows a block diagram of a sixth embodiment of the inventive electronic communication device.

DESCRIPTION OF EMBODIMENTS

First, we demonstrate the general construction and function of an embodiment of the inventive electronic communication device along Fig. 1. With regard to Fig. 2 - Fig. 6, further additional or alternative construction details and functions are shown and described in detail. Similar entities and reference numbers in different figures have been partially omitted.

In Fig. 1, a first embodiment of the inventive electronic communication device 1 is shown. The electronic communication device 1 is for example a smartphone or a tablet computer. The electronic communication device 1 comprises a touchscreen 4, which is comprised of a backlight 41 and a liquid-crystal display, LCD, layer 42. In Fig. 1, the touchscreen 4 faces downwards. This is also the user-facing direction when in regular operation.

The electronic communication device 1 moreover comprises an image source 2, which consists of a light source 21 and a light modulator 22. The light source 21 is for example a light-emitting diode, LED, light source. Here, the light modulator 22 is formed by a part of the liquid-crystal display layer 42 of the touchscreen 4. Moreover, the electronic communication device 1 comprises optics 3, which are configured to focus the modulated light onto a projection surface 7.

In operation, the light source 21 generates light, which passes through the optics 3, here formed by primary optics 31 located between the light source 21 and the light modulator 22. The primary optics 31 may be fixed optics, but may alternatively be tunable optics. The primary optics 31 can moreover comprise a tunable lens or a liquid-crystal layer, with a tunable refractive index.

The light generated by the light source 21 passes the primary optics 31 and passes through the backlight 41, which is transparent or semi-transparent to this light. The light is modulated by the light modulator 22. The modulated light 5 is then projected onto the projection surface 7 forming an image 6.

It is important to note that the projection surface 7 does not have to be flat. As displayed here, the projection surface 7 is curved. The image 6 is projected onto this curved projection surface 7. If the optics 3 comprise tunable elements, the projection may be adapted to the shape and/or distance of the projection surface 7.

In Fig. 2, a further embodiment of an inventive electronic communication device 1 is shown. Here, the touchscreen 4 of the electronic communication device 1 is an OLED touchscreen comprising only an OLED layer 43. This means that the touchscreen 4 here cannot be used as the light modulating element, since OLED layers do not act as light modulators, but generate the image by direct light generation.

Therefore, here, the light source 2 comprises an additional light modulator 23, which here is for example a liquid-crystal display, LCD, layer mounted on the OLED layer 43. In this example, the light modulator 23 is mounted between the touchscreen 4 and the projection surface 7. It is important to note, though, that the light modulator 23 may also be mounted between the light source 21 and the touchscreen 4.

In this embodiment, additional secondary optics 32 are shown. These secondary optics are mounted between the projection surface 7 and the light modulator 23. Again, these secondary optics may be tunable. Especially, the secondary optics 32 may comprise a tunable lens, or a liquid-crystal display layer with a tunable refractive index.

Also, it should be mentioned that in this embodiment primary optics 31 as well as secondary optics 32 are present. For this embodiment, as well as for all other embodiments it is important to note that only some optics in general are necessary. These optics may comprise primary optics or secondary optics or both primary optics or secondary optics, or some other form of optics.

Moreover, it should be noted that in case the light modulator 23 is mounted between the light source 21 and the touchscreen 4, the secondary optics 32 may still be mounted between the touchscreen 4 and the projection surface 7, but may also be mounted between the light modulator 23 and the touchscreen 4.

Moreover, it should be noted that in this embodiment, the OLED layer 43 is transparent or semitransparent to the light of the light source 21.

In both embodiments shown in Fig. 1 and Fig. 2, the luminance of the light generated by the light source 21 is greater than the luminance of the touchscreen. A large size of the projected image 6 can thereby be achieved.

In Fig. 3, a further advantageous embodiment of the inventive electronic communication device 1 is shown. Here, the electronic communication device 1 comprises a touchscreen 4, which forms the image source. The touchscreen 4 is for example a liquid-crystal display, LCD, screen or an organic light-emitting display, OLED, screen. Also, other forms of screen may be used, here. The touchscreen 4 generates the modulated light forming the image. The optics 3 here comprise a lens 34, which is configured to focus the modulated light onto the projection surface, and a lens holder 33, which is configured to hold the lens 34 parallel to the touchscreen 4 at a preset distance. The lens 34 therein may be a Fresnel-lens. The lens may be fixedly attached to the lens holder 33. Alternatively, the lens 34 is mounted detachably from the lens holder 33, and can be replaced with lenses of different focal lengths.

The lens holder 33 therein may be detachably mounted to the electronic communication device 1. By mounting the lens holder 33, the electronic communication device 1 is brought into a projection mode, while when the lens holder 33 is detached, the electronic communication device 1 is in a regular operation mode.

Advantageously, the lens holder 33 does not cover the entire touchscreen 4, but leaves a section 44 open, for controlling the operation of the electronic communication device 1 by a user. Further advantageously, the lens holder 33 and/or the lens 34 do not cover a camera 11 or further sensors of the electronic communication device 1, mounted on a touchscreen side of the electronic communication device 1. This allows for an operation of these further sensors and the camera 11, for example for determining the distance and shape of the projection surface 7.

In operation, the touchscreen 4 generates the modulated light, which then passes through the distance between the touchscreen 4 and the lens 34, and is projected as modulated light 5 onto the projection surface 7.

In Fig. 4, a further advantageous embodiment of the inventive electronic communication device 1 is shown. Here, the electronic communication device 1 furthermore comprises a detachable stand 8. The stand 8 may be mounted to the lens holder 33, using a socket 35.

In Fig. 5, a further advantageous embodiment of the inventive electronic communication device 1 is shown. Here, the electronic communication device 1 comprises a projection surface sensor 11, a body function sensor 12, and a body scanner 13. The projection surface 7 here is the arm of a person. The projection surface sensor 11 is configured to capture an image of the projection surface 7 and/or a shape of the projection surface 7 and/or a distance of the projection surface 7.

The body function sensor 12, which is preferably an infrared, IR, camera, is configured to determine at least one body function parameter of a user of the electronic communication device 1. The body function parameter may be a pulse, a blood pressure, or a body temperature.

The body scanner 13, preferably an IR camera, possibly the same IR camera as the body function sensor 12, is configured to determine a composition and/or structure of a user’s body. This includes, for example, the position of blood vessels and/or organs and/or limbs. Here, the body scanner 13 determines the position of blood vessels.

The image source 2 is then configured to generate the modulated light forming the image to incorporate an indicator of the at least one body function parameter and/or the composition and/or structure of the user’s body. Here, the position of the blood vessels, determined by the body scanner 13, is displayed directly on the projection surface 7, the person’s arm in the correct position. In this application, this augmented reality display of blood vessels may, for example, assist in drawing blood.

Similarly, for example, the position of bones within the body, or of other organs of the body may be displayed directly onto the surface of the body. Also, the vital parameters, such as the previously mentioned blood pressure, pulse, etc. may be directly displayed onto the user’s body. For example, in a region of the heart of the body, a pulsing heart, pulsing in the frequency of the determined pulse may be displayed.

Although in the embodiment of Fig. 5, only the construction of the electronic communication device 1, shown in detail in Fig. 3, is shown, obviously also the electronic communication device 1 according to the embodiments of Fig. 1 and Fig. 2 may be used.

Moreover, it should be noted that the augmented reality applications are not limited to the here- shown medical application. Also, entertainment applications or gaming applications are feasible. A displaying of movies is also an option. A gaming application, for example, could be dual-player chess game or some other game projected onto a table surrounded by a number of people, for example, board games or spin-the-bottle games may be displayed.

Finally, in Fig. 6, a block diagram showing components of the electronic communication device 1 in a further embodiment are shown. The electronic communication device 1 here comprises the before-mentioned image source 2, connected to optics 3. The image source 2 is furthermore connected to an augmented reality processor 14, which is connected to a projection surface sensor 11, a body function sensor 12 and a body scanner 13. It should be pointed out that except for the image source 2 and the optics 3, all further components are optional components.

The projection surface sensor 11 delivers information regarding the shape, and/or size, and/or distance, and/or color, and/or reflectivity, etc. of the projection surface 7 to the augmented reality processor 14.

The body function sensor 12 and the body scanner 13 deliver input data to be displayed.

The augmented reality processor 14 generates the image to be displayed, and provides it to the image source 2. Moreover, the augmented reality processor 14 determines necessary distortions of the image to be displayed based upon the information of the projection surface sensor 11. The augmented reality processor 14 controls the image generation accordingly. Moreover, the augmented reality processor 14 controls the optics 3 in order to distort the projection so as to achieve a maximum image quality. Especially, in case of tunable optics, a high quality of the projected image can thereby be achieved.

It is important to note that the body function sensor 12 and the body scanner 13 are targeted at the medical application described in detail along Fig. 5. For other applications, though, other sensors may be used.

It is important to note that the electronic communication device 1 can re-use a great deal of sensors, which are already present on a typical mobile communication device such as a smartphone or a tablet computer. For example, a user-facing camera on a touchscreen side, which is normally used for capturing images of the user, may be used for capturing images of the projection surface. A proximity sensor, which normally detects the presence of the user, can now detect the presence of a projection surface. A dot/line/grid projector, which is commonly used to project a dot/line/grid pattern onto a user face for an unlocking process of the electronic communication device 1 may now be used for projecting the same pattern onto the projection surface for determining the shape and/or distance thereof. An infrared camera, which is normally used for capturing an infrared image of a user for an unlocking process may be now used for capturing an infrared image of the projection surface for determining the shape and/or distance of the projection surface. Also, this infrared camera may be used as body function sensor 12 and/or body scanner 13. Furthermore, a flood illuminator, which is normally used for illuminating a user’s face for an unlocking process of the electronic communication device 1 may now be used to illuminate the projection surface for capturing the image of the projection surface and/or the shape and/or the distance of the projection surface.

Even without any further sensors, except for the already-present sensors on a typical smartphone, augmented reality applications may be put into practice.

The invention is not limited to the examples, and especially not to the specific medical application, shown. The invention discussed above can be used in a large number of applications. Also, different projection technologies may be employed. The characteristics of the exemplary embodiments can be used in any advantageous combination. The invention has been described in conjunction with various embodiments herein. However, other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure and the appended claims. In the claims, the word “comprising “ does not exclude other elements or steps and the indefinite article “a” or “an” does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in usually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless communication systems.