• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
      TRANSPARENT HEAD-MOUNTED OPTICAL DISPLAY EQUIPMENT WITH MUTUAL OCCLUSION AND OPACITY CONTROL CAPACITY.The present invention comprises a compact transparent head-mounted optical display capable of combining a transparent image path with a virtual image path so that the opacity of the transparent image can be modulated and the virtual image occludes portions of the transparent image and vice -version.
    公开号:BR112014024945A2
    申请号:R112014024945-8
    申请日:2013-04-05
    公开日:2020-10-27
    发明作者:Chunyu Gao；Yuxiang Lin；Hong Hua
    申请人:Magic Leap, Inc.；
    IPC主号:
    专利说明:

    [0001] [0001] This application claims priority for US provisional application number 61 / 620,574, filed on April 5, 2012 and US provisional application number 61 / 620,581, filed on April 5, 2012, publications of which are incorporated herein in full by reference. Government License Rights
    [0002] [0002] The invention was made partially with government support under contract number SBIR W91CRB-12-C-0002 granted by the United States Army. The government has certain rights in the invention. Field of the Invention
    [0003] [0003] The present invention relates generally to Displays of the head-mounted type, and more specifically, but not exclusively, to optical displays of the transparent head-mounted type with opacity control and mutual occlusion capability in which real objects can be occluded by computer-made virtual objects located in the front or vice versa. Background of the Invention
    [0004] [0004] Over the past decades, Augmented Reality (AR) technology has been applied in many fields of application, such as medical and military training, engineering design and prototypes, tele manipulation and tele presence, and systems personal entertainment.
    [0005] [0005] the development of transparent optical HMDs, however, faces complicated technical challenges.
    [0006] [0006] An OCOTS-HMD system typically comprises two key subsystems.
    [0007] [0007] The present invention relates to a transparent head-mounted optical display (OST-HMD) with opacity control and mutual occlusion capability. The display system is typically comprised of a virtual viewing path for viewing a displayed virtual image and a transparent path for viewing an external scenario in the real world. In the present invention, the virtual viewing path includes a miniature image display unit for providing virtual image content and an eye through which a user views an enlarged virtual image. The transparent path comprises an optical lens to directly capture light from the external scene and form at least one intermediate image, a spatial light modulator (SLM) positioned at or near an intermediate image plane on the transparent path to control and modulate opacity transparent vision and an optical look through which the modulated transparent vision is seen by the viewer.
    [0008] [0008] The reflecting surfaces for resending optical paths can be flat, spherical, aspherical mirrors, or free-form surfaces with optical energy. In another important aspect of the present invention, some of the reflecting surfaces can use free-form optical technology. Some of the reflective surfaces can also be strategically designed to be an integral part of the eyepiece or optical objective where the reflective surfaces not only facilitate the resending of the optical path to achieve the compact display design, but also contribute optical energy and correct optical aberrations. In an exemplary embodiment, the present invention can use a single-reflection or multiple-reflection prism such as an eye or optical lens where the prism is a single optical element comprising refractive surfaces and one or more of a reflecting surface for resend the optical path and correct the aberrations.
    [0009] [0009] In another significant aspect of the present invention, the optical lens in the transparent path forms at least one accessible intermediate image, close to which an SLM is placed to provide opacity control and transparent modulation. In the present invention, either a reflection-type SLM or a transmission-type SLM can be used to modulate the transparent view for occlusion control. The longest focal length back to the optical lens is required for a reflection-type SLM than a transmission-type SLM. A reflection-type SLM can have the advantage of greater light efficiency than a transmission-type SLM.
    [0010] [0010] In another significant aspect of the present invention, the transparent path can form an even or odd number of intermediate images. In the case of an odd number of intermediate images, an optical method is provided to invert and / or reverse the transparent view in the transparent path. For example, depending on the number of reflections involved in the transparent path, examples of possible methods include, but are not limited to, insertion of a reflection or additional reflections, use of a covering mirror surface, or insertion of a lens or prism of construction. In the case of an even number of intermediate images, no image-building elements are necessary if there is no change in parity in the transparent view. For example, a free-form prism structure with multiple reflections (typically more than two) can be used as an eyepiece or optical objective, or both, which allow you to resend the transparent optical path within the objective and / or eye prism several times and form intermediate images within the prisms, which eliminates the need to use a reflective construction covering surface. The potential advantage of eliminating the construction prism is that the approach can lead to a more compact model.
    [0011] [0011] The previous summary and the following detailed description of exemplary embodiments of the present invention can be better understood when read in conjunction with the accompanying drawings, in which:
    [0012] [0012] Figure 1 schematically illustrates RA visions seen through a transparent optical HMD: without occlusion capacity (Figure 1A) and with occlusion capacity (Figure 1B).
    [0013] [0013] Figure 2 schematically illustrates an exemplary optical layout according to the present invention shown as a monocular optical module.
    [0014] [0014] Figure 3 schematically illustrates a preferred embodiment according to the present invention based on free-form optical technology. The embodiment comprises a single reflection eye prism, a reflection objective prism, a reflection type SLM and a reflecting coverage surface.
    [0015] [0015] Figure 4 schematically illustrates another preferred embodiment according to the present invention based on free-form optical technology. The embodiment comprises a two-reflection eye prism, a four-reflection lens prism, and a reflection-type SLM.
    [0016] [0016] Figure 5 schematically illustrates another preferred embodiment according to the present invention based on free-form optical technology. The embodiment comprises a two-pronged eye prism, a one-prism lens prism, a transmission-type SLM and a reflective coverage surface.
    [0017] [0017] Figure 6 schematically illustrates another preferred embodiment according to the present invention based on free-form optical technology. The embodiment comprises a two-pronged eye prism, a three-pronged lens prism and a transmission type SLM.
    [0018] [0018] Figure 7 schematically illustrates another preferred embodiment according to the present invention based on free-form optical technology. The embodiment comprises a two-reflection eye prism, a two-reflection lens prism, a reflection-type SLM and a relay lens.
    [0019] [0019] Figure 8 schematically illustrates an exemplary design of an OCOST-HMD system according to the present invention based on an exemplary layout of the Figure
    [0020] [0020] Figure 9 illustrates the plot of the field map of the polychromatic modulation transfer (MTF) functions of the virtual display path of the project in Figure 8 at a cutoff frequency of 401 ps / mm (pairs of lines per millimeter) evaluated using 3 mm in diameter of the pupil.
    [0021] [0021] Figure 10 schematically illustrates an exemplary design of an OCOST-HMD system according to the present invention based on an exemplary layout in Figure 3 with the eyelet and optical objective having an identical free-form structure.
    [0022] [0022] Figure 11 illustrates the plot of the field map of the polychromatic modulation transfer (MTF) functions of the virtual display path of the project in Figure 10 at the cutoff frequency 401 ps / mm (pairs of lines per millimeter) evaluated using 3 mm pupil diameter.
    [0023] [0023] Figure 12 represents a block diagram of an example of an image processing pipeline according to the present invention.
    [0024] [0024] Figure 13 shows Table 1: prescription of optical surface of surface 1 of the eye prism.
    [0025] [0025] Figure 14 shows Table 2: prescription of optical surface of surface 2 of the eye prism.
    [0026] [0026] Figure 15 shows table 3: prescription of the optical surface of the surface 3 of the eye prism.
    [0027] [0027] Figure 16 shows table 4: position and orientation parameters of the eye prism.
    [0028] [0028] Figure 17 shows Table 5: prescription of optical surface of surface 4 of the lens prism.
    [0029] [0029] Figure 18 shows Table 6: optical surface prescription of surface 5 of the lens prism.
    [0030] [0030] Figure 19 shows Table 7: optical surface prescription of surface 6 of the lens prism.
    [0031] [0031] Figure 20 shows Table 8: position and orientation parameters of the lens prism.
    [0032] [0032] Figure 21 shows Table 9: surface parameters for DOE 882 and 884 boards.
    [0033] [0033] Figure 22 shows Table 10: prescription of optical surfaces of surface 1 of the freeform prism.
    [0034] [0034] Figure 23 shows Table 11: prescription of optical surfaces of surface 2 of the freeform prism.
    [0035] [0035] Figure 24 shows Table 12: prescription of optical surfaces of surface 3 of the freeform prism.
    [0036] [0036] Figure 25 shows table 13: position and orientation parameters of the free-form prism such as the eye.
    [0037] [0037] The embodiments according to the present invention will be fully described with reference to the accompanying drawings. The descriptions are presented in order to provide an understanding of the invention. However, it will be evident that the invention can be practiced without these details. In addition, the present invention can be embodied in various forms. However, the embodiments of the present invention described below, should not be construed as limited to the embodiments presented herein. Instead, these embodiments, drawings and examples are illustrative and are intended to avoid obscuring the invention.
    [0038] [0038] A transparent head-mounted optical display system (OCOST-HMD) with occlusion capability typically comprises a virtual viewing path for viewing a displayed virtual image and a transparent path for viewing an external scenario in the real world . Hereinafter, the virtual image observed through the virtual vision path is referred to as the virtual view and the external scenario observed through the transparent path is referred to as the transparent view. In some embodiments of the present invention, The virtual view path includes a microdisplay unit providing the virtual image content and an eye through which a user views an enlarged virtual image. The transparent path comprises an optical lens to capture light from the external scene and form at least one intermediate image, a spatial light modulator (SLM positioned at or near an intermediate image plane on the transparent path to control and modulate the opacity of the view transparent, and an eye through which the modulated transparent vision is seen by the spectator.In the transparent path, the optical objective and the eye act together as an optical retransmission to pass the light from the real world to the eye of the spectator. transparent path is referred to as a transparent image, and an intermediate image modulated by the SLM is referred to as the transparent modulated image, an OCOST-HMD produces a combined view of the virtual and transparent views, in which the virtual view obscures portions of the transparent view.
    [0039] [0039] In some embodiments, the present invention comprises a compact transparent head-mounted optical display 200, capable of combining the transparent path 207 with a virtual vision path 205 so that the opacity of the transparent path can be modulated and the virtual vision occludes parts of the transparent view and vice versa, the display comprising: a. a microdisplay 250 to generate an image to be viewed by a user, the microdisplay having a virtual vision path 205 associated with it; B. a spatial light modulator 240 for modifying light from an external setting in the real world to block portions of the transparent view that must be occluded, the spatial light modulator having a transparent path 207 associated therewith; CC. an optical objective 220 configured to receive the incident light from the external scene and focus the light under the space light modulator 240; d. a beam splitter 230 configured to combine a virtual image from a microdisplay 250 and a transparent modulated image of an external scene passing from a spatial light modulator, producing a combined image; and. an eye 210 configured to enlarge the combined image; f. an exit pupil 202 configured to face the eye, where the user observes a combined view of the virtual and transparent views in which the virtual view encloses portions of the transparent view; g. a plurality of reflecting surfaces configured to resend the virtual vision path 205 and the transparent path 207 in two layers;
    [0040] [0040] In some embodiments, at least three reflective surfaces are used to resend the virtual and transparent paths in two layers. The first reflective surface Ml is arranged under the front layer of the display oriented to reflect the light of the external scene. Optical objective 220 is placed under the front layer of the display. The second reflective surface M2 is arranged under the front layer of the display oriented to reflect the light to the spatial light modulator. The spatial light modulator 240 is arranged on or near an intermediate image plane of the transparent path 207, in optical communication with the optical objective 220 and the eye 210 through the beam separator 230 along the transparent path 207. The microdisplay 250 it is arranged in a focal plane of the eye 210, in optical communication with the eye 210 through the beam separator 230 along the virtual vision path 205. The beam separator 230 is arranged in such a way that the transparent path 207 is combined with the virtual vision path 205 and the light from both the transparent and virtual vision path is directed to eye 210. Eye 210 is arranged under the back layer of the display. The third reflective surface M3 is arranged under the rear layer of the display oriented to reflect light from the eye to the exit pupil 202.
    [0041] [0041] In some embodiments, the optical objective 220 receives light from the external scene, and focuses the light from the external scene and forms a transparent image under the spatial light modulator 240. The spatial light modulator 240 modifies the transparent image to remove portions of the image that must be occluded. The microdisplay 250 projects a virtual image for the beam separator 230. The spatial light modulator 240 transmits the modified transparent image to the beam separator 230, where the beam separator 230 combines the two images producing a combined image in which the image virtual occludes portions of the transparent image. The beam separator 230 then projects the combined image to eye 210, then the eye projects the image to output pupil 202.
    [0042] [0042] In some embodiments, the present invention comprises a transparent 200 head-mounted optical display, capable of combining an external scene in the real world with a virtual view, where the opacity of the external scene is modulated and the virtual view digitally generated it excludes parts of the external scenario and vice versa. The invention comprises a microdisplay 250 that transmits a virtual image, a spatial light modulator 240 to modify the light of an external scenario, an optical objective 220, which captures an external scenario, a beam separator 230 configured to combine the generated virtual image digitally from the microdisplay 250 with the modified external scenario of the spatial light modulator, a 210 eye enlarging the virtual image and the modified external scenario and an exit pupil 202 where the user observes a combined view of the virtual image and the modified external scenario .
    [0043] [0043] In some embodiments, at least three reflective surfaces are used to resend the virtual view path 205 and the transparent view path 207 in two layers. Optical objective 220 is disposed under the front layer of the display, while eye 210 is disposed under the back layer of the display. A series of mirrors can be used to guide the light along the optical paths through the spatial light modulator, beam separator and eye. The spatial light modulator 240 is arranged at or near an intermediate image plane in the transparent path. The microdisplay 250 faces the beam separator 230, so that the light from the microdisplay is transmitted to the beam separator 230. The beam separator 230 combines the light from the microdisplay and the spatial light modulator and is oriented so that the direction the beam separator light transmission is facing eye 210. Eye 210 is arranged so that light from the beam separator passes through the eye and is transmitted to the exit pupil.
    [0044] [0044] In some embodiments, the optical objective 220 receives an image of the external scene, and reflects or refracts the image to the space light modulator 240. The space light modulator 240 modifies the light of the external scene to remove portions of the image that must be occluded, and transmits or reflects light to the beam separator. The microdisplay 250 transits the virtual image to the beam separator 230, and the beam separator 230 combines the two images to produce a combined image in which the virtual image 205 encloses portions of the image of the external scene. The beam separator 230 projects the combined image into eye 210, which passes the image to the exit pupil 208. In this way, the user observes the combined image, in which the virtual image appears to occlude portions of the external scene.
    [0045] [0045] Figure 2 illustrates a schematic layout 200 according to the present invention to obtain a compact OCOST-HMD system. In this exemplary layout 200, the virtual image path 205 (illustrated in dotted lines) represents the light propagation path of the virtual view and comprises a microdisplay 250 to provide display content and eye 210 through which a user views an enlarged image of the displayed content; the transparent path 207 (illustrated in continuous lines) represents the light propagation path of the transparent view and comprises optical objective 220 and eye 210 acting as an optical retransmission to pass light from an external scenario in the real world to the viewer's eye.
    [0046] [0046] As one of its benefits, the optical layout 200 has applicability to many types of optical HMD, including, without limitation, rotationally symmetric optics and non-rotationally symmetrical free-form optics. The reflective surfaces M1I-M3 to resend optical paths can be flat, spherical, aspherical mirrors, or free-form surfaces with optical energy. Some of the reflecting surfaces may use free-form optical technology. Some of the reflective surfaces can also be strategically designed to be an integral part of eye 210 or optical objective 220, where reflective surfaces not only facilitate the resending of optical paths to achieve compact display design, but also contribute optical energy and correct optical aberrations. In an exemplary configuration shown in Figure 3, the present invention demonstrated the use of a free-form reflection prism as an eye and optical objective where the prism is a single optical element comprising "two refractive surfaces and a reflecting surface for resending the optical path and correct aberrations, in other examples of prism configurations free of multiple reflections are demonstrated.
    [0047] [0047] In another relevant aspect of the present invention, in addition to the intermediate image accessible to the SLM 240, the transparent path 207 can form additional intermediate images 260 through the optical lens 220, or eye 210, or both. For example, the multi-reflection freeform prism structure (typically more than two) can be used as an eyepiece or optical objective, or both, which allows the transparent path to be resent within the objective and / or eye prism multiple times and forms intermediate images within the prism. As a result, the transparent path 207 can produce an even or odd total number of intermediate images. The potential advantage of creating more than one intermediate image is the benefit of the extended optical path length, long posterior focal length, and the elimination of real-life construction elements.
    [0048] [0048] Depending on the total number of intermediate images being created and the total number of reflective surfaces being used on the transparent path 207, a transparent path construction method may be needed to invert and / or reverse the transparent view of the transparent path to maintain the parity of the transparent view coordinate system and prevent a viewer from seeing a reversed or reversed transparent view. According to the transparent vision construction method specifically, the present invention considers two different image construction strategies. When a total even number of reflections is involved in the transparent path 207, which does not induce a change in the parity of the transparent path coordinate system, the shape of the eye 210 and the optical objective 220 will be designed so that an even number of intermediate images is created on the transparent path
    [0049] [0049] In one of its relevant aspects, the present invention can use free-form optical technology in the eye, optical objective or both to achieve a lightweight and compact OCOST-HMD. Figure 3 shows a block diagram 300 of an exemplary compact OCOST-HMD design approach according to the present invention based on free-form optical technology. The eyelet 310 in the rear layer 317 is a free-form prism of a reflection comprising three free-form optical surfaces: refractory surface S1, reflective surface S2 and refractory surface S3. In the virtual vision path 305, the light beam emitted from the microdisplay 350, enters eye 310 through the refractory surface S3, then is reflected by the reflective surface S2 and leaves eye 310 through the refractory surface Sl and reaches the pupil of exit 302, where the viewer's eye is aligned to see an enlarged virtual image of microdisplay 350. Optical objective 320 on the front layer 315 is also a reflection freeform prism comprising three freeform optical surfaces: refractory surface S4, reflective surface S5 and refractory surface S6. In the transparent path 307, the optical objective 320 works together with the actuation of the eye 310 as an optical retransmission for the transparent vision.
    [0050] [0050] In this exemplary layout 300, the reflective surface M2 of the schematic layout 200 is strategically designed to be an integral part of the lens prism 320 as a free-form reflective surface S5; the reflective surface M3 of the schematic layout 200 is strategically designed to be an integral part of the eyelet prism 310 as a free-form reflective surface S2; the reflective surface M1 of the schematic layout 200 is designed as a cover mirror 325 for vision construction, since the total number of reflections in the transparent path 307 is 5 (an odd number).
    [0051] [0051] In this exemplary layout 300, the eyelet 310 and the optical objective 320 can have an identical free-form prism structure. The advantage of using an identical structure for the eye and the optical objective is that the optical design strategy of one prism can be easily applied to the other, which helps to simplify the optical design. The symmetrical structure of the eyepiece and optical lens also helps to correct odd aberrations, such as coma, distortion and lateral color.
    [0052] [0052] Figure 4 shows a 400 block diagram of another exemplary approach in a compact OCOST-HMD design according to the present invention based on free-form optical technology.
    [0053] [0053] In this exemplary layout 400, the reflective surface M2 of schematic layout 200 is strategically designed as an integral part of optical objective 420 as reflective surface S6; the reflective surface M3 of the schematic layout 200 is strategically designed to be an integral part of the eye prism 410 as a reflective surface Ss2; the reflective surface M1 of the schematic layout 200 is designed as an integral part of the optical objective 420 as the reflective surface S5. An intermediate image 460 is formed within the optical objective 410 to construct the real view. Since the total number of reflections in the transparent path 407 is 8 (an even number), no cover mirror is required on any of the reflecting surfaces.
    [0054] [0054] Figure 5 shows a block diagram 500 of another exemplary approach in a compact OCOST-HMD design according to the present invention based on free-form optical technology. This approach facilitates the use of a transmission type SLM.
    [0055] [0055] In this exemplary layout 500, the reflective surface Ml of schematic layout 200 is strategically designed as an integral part of optical lens 520 as reflective surface S5; the reflective surface M3 of schematic layout 200 is strategically designed to be an integral part of eye 510 as reflective surface sS2; the reflective surface M2 of the schematic layout 200 is designed as a covering mirror 527 to construct the view since the total number of reflections in the transparent path 507 is 5 (an odd number).
    [0056] [0056] Figure 6 shows a block diagram 600 of another exemplary approach in a compact OCOST-HMD design according to the present invention based on free-form optical technology. This approach also facilitates the use of a transmission type SLM. In an exemplary embodiment, eye 610 is a free-form prism with two reflections and the optical objective 620 is a free-form prism with three reflections. Within the optical objective 620, an intermediate image 660 is formed to construct the transparent view. The eye 610 in the back layer 617 comprises four free-form optical surfaces: refractory surface S1, reflecting surface S2, reflecting surface S1 'and refractory surface S3. In the virtual vision path 605, the beam of light emitted from microdisplay 650, enters eye 610 through the refractory surface Ss3, then is consecutively reflected by the reflective surfaces S1 "'and S2 and leaves eye 610 through the refractory surface Sl and reaches exit pupil 602, where the viewer's eye is aligned to see an enlarged virtual image of the microdisplay 650. The refractory surface Sl and the reflective surface S1 '”can be the same physical surfaces and have the same sets of prescriptions for surface.
    [0057] [0057] In this exemplary layout 600, the reflective surface Ml of schematic layout 200 is strategically designed as an integral part of optical objective 620 as reflective surface S5; the reflective surface M2 of the schematic layout 200 is strategically designed to be an integral part of the optical objective 620 as a reflective surface S6; the reflective surface M3 of the schematic layout 200 is designed as an integral part of eye 610 as the reflective surface S2. An intermediate image 660 is formed within the optical objective 620 as the reflecting surface S2. Since the total number of reflections in the transparent path 607 is 6 (an even number), no cover mirror is needed on any reflective surface.
    [0058] [0058] Figure 7 shows a 700 block diagram of another exemplary compact OCOST-HMD design approach according to the present invention based on free-form optical technology. In an exemplary embodiment, both the eyepiece and the optical lens are two-reflection free-form prisms and have approximately identical structures. The advantage of using an identical structure for the eye and the optical objective is that the optical design strategy of one prism can be easily applied to the other, which helps to simplify the optical design.
    [0059] [0059] In this exemplary layout 700, the reflective surface Ml of schematic layout 200 is strategically designed as an integral part of optical lens 720 as reflective surface S5; the reflective surface M3 of the schematic layout 200 is strategically designed to be an integral part of eye 710 as a reflective surface sS2; the reflective surface M2 of the schematic layout 200 is positioned in the focal plane of the optical objective 720 as the mirror 790 and resends the transparent path 707 towards the virtual vision path 705. The intermediate image 760 is formed in the focal plane of the optical objective 720 to building real vision. Since the total number of reflections in the transparent path 707 is 8 (an even number), no cover mirror is required on any reflective surface.
    [0060] [0060] Figure 8 schematically illustrates an exemplary layout 800 based on the exemplary approach represented in Figure 3. The project reached a 40 degree diagonal FOV, which is 31.7 degrees in the horizontal direction (X-axis direction) and 25, 6 degrees in the vertical direction (y-axis direction), an exit pupil diameter (EPD) of 8 mm (without vignetting), and an eye clearance of 18 mm. The design is based on a 0.8 ”microdisplay with a 5: 4 aspect ratio and pixel resolution
    [0061] [0061] An exemplary optical prescription for eye 810 is listed in tables 1-4. All three optical surfaces in eye 810 are anamorphic aspherical surfaces (AAS). The curve of an AAS surface is defined by: ze 8º t and ARA ADC (+ ADV 1+ 1-1 + KJetx = (1 + K /) egy + BR ((1 - BP) x + (1 + BP ) y º) º + CRI (1 - CP) x + (1 + CP) yºYº + DR ((1 - DP) x + (1 + DP) yºY, where z is the curve of the shape surface free, measured along the z axis of a coordinate system x, yr, z local, c., and Cc, are the vertex curvatures on the x and y axes, respectively, K, and K, are the conical constants on the x and y axes, respectively, AR, BR, CR and DR are rotationally symmetric portions of the 4th, 6th, 8th, 10th order deformation from the conic, AP, BP, CP, and DP are the rotationally asymmetric components of the 4th, 6th, 8th deformation , 10th order from the conical Table 1: Prescription of optical surfaces of surface 1 of the eye prism, see Figure 13. Table 2: prescription of optical surfaces of surface 2 of the eye prism, see Figure 14. Table 3: prescription of optical surfaces of surface 3 of the eye prism, see Figure 15. Table 4: Parameters of p position and orientation of the eyelet prism, see Figure 16.
    [0062] [0062] An exemplary optical prescription for the 820 optical lens is listed in Tables 5-8. All three optical surfaces on the 820 optical lens are anamorphic aspherical surfaces (AAS).
    [0063] [0063] An exemplary prescription for DOE plate 882 and 884 is listed in Table 9.
    [0064] [0064] Figure 9 shows the field map of polychromatic modulation transfer (MTF) functions of the virtual vision path at the cutoff frequency 401 ps / mm (pairs of lines per millimeter) evaluated using a pupil diameter of 3 mm. The cutoff frequency of 401 ps / mm was determined from the pixel size of the microdisplay. The graph shows that the present project has a very good performance for major fields except two upper corners of the display whose MTF values at the cutoff frequency are slightly less than 15%. In all FOV the distortion of the virtual vision path is less than 2.9%, while the distortion of the transparent path is less than 0.5%. The total estimated weight for the optics alone is 33 grams per eye.
    [0065] [0065] Figure 10 schematically illustrates an exemplary project 1000 based on the exemplary approach represented in Figure 3. The project reached a 40 degree diagonal FOV, with 35.2 degrees horizontally (x-axis direction) and 20.2 degrees in the vertical (y-axis direction), an exit pupil diameter (EPD) of 8 mm (without vignetting), and an eye gap of 18 mm. The project is based on a 0.7 ”microdisplay with a 16: 9 aspect ratio and a pixel resolution of 1280x720. The project used an SLM of the same size and resolution as the microdisplay. A wire mesh plate splitter is used to combine the virtual view path and the transparent path. The same freeform prism is used as the eye and the optical lens.
    [0066] [0066] An exemplary optical prescription of the freeform prism is listed in Tables 10-15. Two surfaces of the prism are anamorphic aspherical surfaces (AAS) and one is an aspheric surface (ASP). The curve of an ASP surface is defined by: cr ZE —— re + Arº * + Bró + Crº + Drº + Er + Fr + Griô 1/1206 DER + Hr + Jr2o where z is the surface curve measured along the z axis of a local x, y, z coordinate system, c represents the curvature of the vertex, k is the conic constant , from A to J are deformation coefficients of 4th, 6th, 8th, 10th, 12th, 14th, 16th, 18th and 20th order, respectively.
    [0067] [0067] Figure 11 shows the field map of polychromatic modulation transfer functions (MTF of the virtual vision path at the cutoff frequency 401 ps / mm (pairs of lines per millimeter) evaluated using a pupil diameter of 3 mm. The graph shows that the present project performs very well for majority fields.
    [0068] [0068] Figure 12 represents a block diagram of an example of an image processing pipeline needed for the present invention. First, the depth map of the external scenario is extracted using suitable depth sensing means. Then, the virtual object is compared with the depth map to determine the regions where the occlusion occurs. A mask generation algorithm creates a binary mask image according to the predetermined occlusion regions. The mask image is then displayed on the spatial light modulator to block light from the occlused region in the intermediate image of the external scene. A virtual image of the virtual object is processed and presented in the microdisplay. The viewer observes a combined image of the virtual image and the transparent modulated image of the external scene through the display device of the present invention.
    [0069] [0069] In comparison with the state of the art, the present invention features a combined image path that allows the invention to be compressed into a compact form, more easily wearable as a head-mounted display. In the state of the art (US Patent, 7,639,208 Bl), the optical path is linearly arranged using rotationally symmetric lenses. As a result, state-of-the-art occlusion displays have a long telescopic type shape, which is heavy to wear on the head. The present invention resends the image path using reflective surfaces in two layers so that the spatial light modulator, microdisplay and beam separator, are mounted on top of the head, rather than linearly in front of the eye.
    [0070] [0070] The state of the art is based on only one spatial modulator of light of the type of reflection, whereas the present invention can use either a spatial modulator of light of the type of reflection or transmission. In addition, the state of the art requires a polarized beam separator to modulate the external image, whereas the present invention does not require polarization.
    [0071] [0071] As the present invention is arranged in layers, the eye and the optical objective are not necessarily collinear, as is the case in the state of the art. The optical lens is also not necessarily tele-centered.
    [0072] [0072] In the state of the art, due to the system's optics, the world view is a mirror reflection of the transparent path. The resent image path of the present invention allows a cover mirror to be inserted to maintain parity between the user's view and the external scene. This makes the present invention more functional from the user's perspective.
    [0073] [0073] Compared with the state of the art, the present invention uses free-form optical technology, which allows the system to be made in an even more compact way. Freeform optical surfaces can be designed to reflect light internally multiple times, so that mirrors may not be necessary to re-send the light path.
    [0074] [0074] In the present invention, the reflecting surfaces for resending the optical paths can be flat, spherical, aspheric mirrors, or free-form surfaces with optical energy.
    [0075] [0075] The present invention ensures that the transparent view seen through the system is correctly constructed (not inverted or reversed). Two different optical methods were used in the present embodiments to achieve this, depending on the number of intermediate images formed in the transparent path and the number of reflections involved in the transparent path. In the case of an odd number of intermediate images, an optical method is provided to reverse or reverse the transparent view in the transparent path. For example, depending on the number of reflections involved in the transparent path, examples of possible methods include, but are not limited to, inserting a reflection or additional reflections, using a cover mirror surface, or inserting a construction lens. In the case of an even number of intermediate images, no image-building elements are needed if no parity changes are required. For example, the multi-reflection freeform prism structure (typically more than two) can be used as an eyepiece, optical lens, or both, which allows the transparent optical path to be resent within the multiple lens and / or eyepiece prism times and forms intermediate images within the prism to build the transparent view that eliminates the need to use a reflective building roof surface.
    [0076] [0076] In Figure 3, only an intermediate image is created in the transparent path. This structure used a covering prism 325 to appropriately create a constructed transparent view.
    [0077] [0077] In Figure 4, a free-form prism of four reflections was used as an optical lens that created two intermediate images (one for SLM 440, and one 460 inside the prism). Additionally, there were a total of 8 reflections involved in the transparent path, which results in no change in parity. Therefore, a constructed vision is created. It is important to mention that the structure of the objective and the eye can be modified for the same results.
    [0078] [0078] In Figure 5, 1 intermediate image is created on the transparent path to the SLM. This project used a 527 cover prism to build the transparent view.
    [0079] [0079] In Figure 6, a free-form prism with three reflections was used as an optical lens, which created two intermediate images (one for SLM 640 and one 660 inside the prism). Additionally, there were a total of 6 reflections involved in the transparent path, which leads to no change in parity. Therefore, a constructed vision is created. It is important to mention that the lens and eyelet structures can be exchanged for the same results.
    [0080] [0080] In Figure 7, the optical lens 720 used only 2 reflections, the combination of the beam separator 780 and the mirror 790 facilitated the creation of 2 intermediate images in the transparent path (one for SLM 740 and an additional 760). In addition, a total of 8 reflections were involved in the transparent path. Therefore, a built transparent view was created.
    [0081] [0081] It is very important that the transparent head-mounted display keeps the parity of the external scenario that provides users with a realistic experience according to their usual views without HMD.
    [0082] [0082] Although the preferred embodiment of the present invention has been shown and described, it will be readily apparent to those skilled in the art that modifications can be made to it without exceeding the scope of the appended claims. The reference numbers mentioned in the claims are exemplary and for ease of analysis by the patent office only, and are in no way limiting. In some embodiments, the figures presented in the present patent application are drawn to scale, including angles, dimension relationships, etc. In some embodiments, the figures are representative only and the claims are not limited by the dimensions of the figures.
    [0083] [0083] The reference numbers mentioned in the claims below are for ease of examination of the present patent application, and are exemplary, and are not intended in any way to limit the scope of the claims to particular characteristics having the corresponding reference numbers in the figures.
    权利要求:
    Claims (46)
    [1]
    1. Compact and transparent optical head-mounted display (200), capable of combining a transparent path (207) with a virtual vision path (205) in such a way that the opacity of the transparent path can be modulated and the virtual vision occludes parts of the transparent view and vice versa, the display characterized by the fact that it comprises: a. a microdisplay (250) to generate an image to be viewed by a user, the microdisplay having a virtual vision path (205) associated with it; B. a spatial light modulator (240) to modify the light of an external scenario in the real world to block portions of the transparent view that must be occluded, o The spatial light modulator having a transparent path (207) associated with it; Cs. an objective optic (220) configured to receive the incident light from the external scene and focus the light under the spatial light modulator (240); d. a beam splitter (230) configured to combine a virtual image from a microdisplay (250) and a transparent modulated image of an external scene passing from a spatial light modulator, producing a combined image;
    i 2/35 e. an eye (210) configured to enlarge the combined image;
    f. an exit pupil (202) configured to face the eye, the exit pupil afterwards to the user observes a combined view of the virtual and transparent views in which the virtual view encloses portions of the transparent view;
    O. a plurality of surfaces configured to fold the virtual view path (205) and the transparent path (207) in two layers;
    where the first reflecting surface (M1) is arranged under the front layer of the display oriented to reflect the light of the external scene, where the objective optics (220) is arranged under the front layer of the display, where the second reflecting surface ( M2) is arranged under the front layer of the display oriented to reflect the light to the spatial light modulator, where the spatial light modulator (240) is arranged in or near an intermediate image plane of the transparent path (207), in optical communication with the objective optics (220) and the eye (210) through the beam separator (230) along the transparent path (207), where the microdisplay (250) is arranged in a focal plane of the eye (210) at the along the virtual vision path (205), in optical communication with the eye (210) through the beam separator (230), where the beam separator (230) is arranged in such a way that the transparent path (207) is combined with the virtual vision path (205) and the light from both the path tr ansparente and the virtual vision path is directed to the eye (210), where the eye (210) is arranged under the back layer of the display, where the third reflecting surface (M3) is arranged under the back layer of the display oriented to reflect light from the eye to the exit pupil (202);
    afterwards the objective optics (220) receives light from the external scene, afterwards the objective optics (220) focuses the light from the external scenery and forms a transparent image under the spatial light modulator (240), later on the spatial light modulator (240) modifies the transparent image to remove portions of the image that must be occluded, then the micro display (250) projects a virtual image for the beam separator (230), afterwards the spatial light modulator (240) transmits the modulated transparent image to the beam separator (230), then the beam separator (230) combines the two images producing a combined image in which the virtual image encloses portions of the transparent image, then the beam separator (230) projects the combined image to the eye ( 210), subsequently the eye
    Ê ”4/35 projects the combined image to the exit pupil (202), afterwards the user observes the combined image, in which the virtual image occludes portions of the external scene.
    [2]
    2. Display, according to claim 1, characterized by the fact that the spatial light modulator is a transmission type spatial light modulator, where the spatial light modulator is arranged in front of the beam separator, afterwards the light of objective optics passes through the spatial light modulator before reaching the beam separator, where the opacity of the spatial light modulator is controlled to block light from portions of the external scene.
    [3]
    3. Display, according to claim 1, characterized by the fact that the spatial light modulator is a reflection type spatial light modulator, where the spatial light modulator is placed behind the beam separator, afterwards the light from the beam objective optics passes through the beam separator and is reflected back from the spatial light modulator to the beam separator, where the reflectivity of the space light modulator is controlled to reflect only the light from parts of the external scene that should not be occluded.
    [4]
    4, Display, according to claim 1, characterized by the fact that an intermediate image is formed at one or more points in the transparent path, where the spatial light modulator is arranged on or near one of the intermediate image planes.
    [5]
    S. Display, according to claim 1, characterized by the fact that one or more of the reflecting surfaces (MI-M3) are unique surfaces with optical power to double the optical paths and focus the light.
    [6]
    6. Display, according to claim 1, characterized by the fact that one or more of the reflecting surfaces (M1-M3) are free-form surfaces.
    [7]
    Ta Display, according to claim 1, characterized by the fact that the first and / or second surfaces in the front layer are contained within the objective optics.
    [8]
    8. Display, according to claim 1, characterized by the fact that the reflecting surface (NM3) in the back layer is contained within the eye.
    [9]
    Ss. Display, according to claim 1, characterized by the fact that the objective optics is a freeform prism formed by a plurality of reflective and refractory surfaces to form the image of the external scene in the spatial light modulator.
    [10]
    10. Display, according to claim 1, characterized by the fact that the eye is a prism in shape
    : 6/35 free formed by a plurality of reflective and refractory surfaces to enlarge the virtual image and the modulated transparent image.
    [11]
    11. Display, according to claim 9, characterized by the fact that the first and / or the second reflecting surface (Ml, M2) on the front layer is contained within the objective optics.
    [12]
    12. Display, according to claim 10, characterized by the fact that the third reflecting surface (M3) in the back layer is contained within the eye.
    [13]
    13. Display, according to claim 1, characterized by the fact that an even number of intermediate images are formed along the transparent path to invert the transparent view in order to maintain the parity between the external scenario and the transparent view presented to the viewer.
    [14]
    14. Display, according to claim 1, characterized by the fact that one of the reflecting surfaces is replaced by a cover mirror in order to reverse the transparent view in order to maintain the parity between the external scenario and the transparent view presented to the viewer.
    [15]
    15. Display, according to claim 1, characterized by the fact that both the eye and the objective optics have identical optical structures.
    [16]
    16. Display, according to claim 15, characterized by the fact that both the eyepiece and the objective optics are freeform prisms of identical shape.
    [17]
    17. Display, according to claim 1, characterized by the fact that the beam separator is arranged under the front layer.
    [18]
    18. Display, according to claim 1, characterized by the fact that one or more plates of refractory optical elements (DOE) are positioned in the optical path to correct chromatic aberrations.
    [19]
    19. Display according to any one of claims 1, 3, 6-12 or 14, characterized in that the objective optics is a single reflection prism comprising three optical surfaces: refractory surface S4, reflective surface S5 and refractory surface S6, where the eye is a single reflection prism comprising three optical surfaces: refractory surface S1, refractory surface S2 and refractory surface S3, where the second reflecting surface (M2) is contained within the objective optic and the third reflecting surface (M3) is contained within the eye,
    E 8/35 where a covering mirror replaces the first reflecting surface (Ml) to invert the transparent view, and a spatial light modulator of the reflection type is used to modulate the light of the external scene.
    [20]
    20. Display, according to claim 19, characterized by the fact that afterwards the incident light from the external scene reflected by the mirror (325), enters the objective optics (320) through the refractory surface S4, then it is reflected by the reflective surface S5 and leaves the objective optics (320) through the refractory surface S6 and forms an intermediate image in its focal plane in the spatial light modulator (340), afterwards the spatial light modulator (340) modulates the light in the transparent path to block the light to be occluded, then the spatial light modulator reflects the light modulated to the beam separator (330), then the microdisplay light (350) enters the beam separator (330), then the beam separator (330) combines the light modulated in the transparent path (307) with the light in the virtual vision path (305) and bending towards the eye (310) for viewing, then the beam separator light (330) enters the eye (310) through of the refractory surface S3, then is reflected by the reflective surface S2 and exits the eye (310) through the refractory surface S1 and reaches the exit pupil (302), where the viewer's eye is aligned to have a combined view of a virtual view and a transparent modulated view.
    [21]
    21. Display according to any one of claims 1, 3, 6-13, characterized by the fact that the objective optics is a free-form prism of four reflections comprising six optical surfaces: refractory surface S4, reflective surfaces S5, S4 ', S5' and S6 and refractory surface S7, where the eye is a prism of two reflections comprising four optical surfaces: refractory surface Sl, reflecting surface S2, reflecting surface S1 'and refractory surface S3, where the first reflecting surface (Ml) and the second reflecting surface (M2) are contained within the objective optics and the third reflecting surface (M3) is contained within the eye, where the objective optics form an intermediate image (460) within the objective optics, where an even number of images intermediates are formed along the transparent path to invert the transparent view, where a spatial light modulator of the type of reflection is used to modulate the light of the external scene.
    [22]
    22. Display, according to claim 21, characterized by the fact that subsequently the incident light from the external scene enters the objective optics (420)
    through the refractory surface Ss4, then it is consecutively reflected by the reflective surfaces S5, S4, S5 'and S6, and leaves the objective optics (420) through the refractory surface S7, afterwards the incident light forms an intermediate image in its focal plane in the modulator space light (440), afterwards the space light modulator modulates the light in the transparent path to block the light to be occluded, afterwards the space light modulator reflects the light modulated to the beam separator (430), afterwards the light from the microdisplay (450) enters the beam separator (430), then the beam separator (430) combines the modulated light in the transparent path (407) with the light in the virtual vision path (405) and bends towards the eye (410 ) for viewing, then the beam separator light enters the eye (410) through the refractory surface S3, then it is consecutively reflected by the reflecting surfaces S1 'and S2 and leaves the eye (410) through the refractory surface Sl and reaches the exit pupil (402), where the viewer's eye is aligned to have a combined view of a virtual view and a transparent modulated view.
    [23]
    23. Display, according to claim 21, characterized by the fact that the refractory surface S4 and
    ] 11/35 the reflecting surface S4 'are the same physical surfaces and have the same set of surface requirements.
    [24]
    24. Display according to any one of claims 1, 3, 6-12 or 14, characterized in that the objective optics is a single reflection prism comprising three optical surfaces: refractory surface S4, reflective surface S5 and refractory surface S6, where the eye is a prism of two reflections comprising four optical surfaces: refractory surface S1, reflecting surface s2, reflecting surface S1 'and refractory surface S3, where the first reflecting surface (Ml) is contained within the objective optics and the third reflective surface (M3) is contained within the eye, where a cover mirror (527) replaces the second reflective surface (M2) to reverse the transparent view, where a transmission-type spatial light modulator is used to modulate the light from the external scenario.
    [25]
    25. Display, according to claim 24, characterized by the fact that subsequently the incident light from an external scenario enters the objective optics (520) through the refractory surface S4, then is reflected by the reflective surface S5 and leaves the optics
    Ú 12/35 objective (520) through the refractory surface S6 and is bent by the mirror (527) towards the posterior layer (517) and forms an intermediate image in its focal plane in the spatial light modulator (540), later the modulator space light (540) modulates the light in the transparent path to block the light to be occluded, then the space light modulator transmits the modulated light to the beam separator (530), then the microdisplay light (550) enters the separator beam (530), then the beam separator (530) combines the modulated light in the transparent path (507) with the light in the virtual view path (505) and bends towards the eye (510) for viewing, then the light the beam separator enters the eye (510) through the refractory surface S3, then it is consecutively reflected by the reflective surfaces S1 'and S2, and leaves the eye (510) through the refractory surface S1 and reaches the exit pupil (502), where the eye of the visual The user is aligned to have a combined view of a virtual view and a transparent modulated view.
    [26]
    26. Display according to claim 24, characterized by the fact that the refractory surface Sl and the reflective surface S1 'are the same physical surfaces and have the same set of surface requirements.
    [27]
    27. Display according to any one of claims 1, 2, 6-13, characterized by the fact that the objective optics is a prism of three reflections comprising five free-form optical surfaces: refractory surface S4, reflective surface S5, sa "and S6 and refractory surface S7, where the eye is a prism of two reflections comprising four optical surfaces: refractory surface S1, reflecting surface s2, reflecting surface S1 'and refractory surface S3, where the first reflecting surface (Ml) and the second reflecting surface (M2) are contained within the objective optics and the third reflecting surface (M3) is contained within the eye, where the objective optics forms an intermediate image (660) within the objective optics, where an even number of intermediate images is formed along the transparent path to invert the transparent view, where a spatial light modulator of the transmission type is used to modulate the light of the external scene.
    [28]
    28. Display, according to claim 27, characterized by the fact that afterwards the incident light from an external scenario enters the objective optics (620) through the SA refractory surface, then it is
    “14/35 consecutively reflected by the reflective surfaces S5, S4" 'and S6, and leaves the objective optics (620) through the refractory surface S7, afterwards the incident light forms an intermediate image in its focal plane in the spatial light modulator (640 ), then the spatial light modulator modulates the light in the transparent path to block the light to be occluded, then the spatial light modulator transmits the modulated light to the beam separator (630), then the microdisplay light (650) enters in the beam separator (630), then the beam separator (630) combines the modulated light in the transparent path (607) with the light in the virtual vision path (605) and bends towards the eye (610) for later viewing the light from the beam separator enters the eye (610) through the refractory surface S3, then is consecutively reflected by the reflective surfaces S1 'and S2, and leaves the eye (610) through the refractory surface S1 and reaches the exit pupil (602), where the viewer's eye is aligned to have a combined view of a virtual view and a transparent modulated view.
    [29]
    29. Display according to claim 27, characterized by the fact that the refractory surface Sl and the reflective surface S1 'are the same physical surfaces and have the same set of surface requirements.
    [30]
    30. Display, according to claim 27, characterized by the fact that the refractory surface S4 and the reflective surface S4 'are the same physical surfaces and have the same set of surface requirements.
    [31]
    31. Display according to any one of claims 1, 3, 6-13, characterized by the fact that the objective optics is a prism of two reflections comprising four free-form optical surfaces: refractory surface Sa, reflective surface s5, surface reflective S4 "'and refractory surface S6, where the eye is a prism of two reflections comprising four optical surfaces: refractory surface Sl, reflective surface S2, reflective surface S1' and refractory surface S3, where the first reflective surface (Ml) is contained within the objective optics and the third reflecting surface (M3) is contained within the eye, where the second reflecting surface (Ml) as the mirror (790), together with a first beam separator (780) and a relay lens (770) ) are configured to double a transparent path and create a secondary intermediate image, where an even number of intermediate images is formed along the
    : 16/35 transparent path to invert the transparent view, where a spatial light modulator of the type of reflection is used to modulate the light of the external scene.
    [32]
    32. Display, according to claim 31, characterized by the fact that afterwards the incident light from an external scenario enters the objective optics (720) through the SA refractory surface, then it is consecutively reflected by the reflective surfaces S5, S4 ', and leaves the objective optics (720) through the refractory surface S6, then the incident light is reflected by the beam separator (780) to the mirror (790), where it forms an intermediate image, later the mirror (790) reflects the light from the layer front for the relay lens (770), then the relay lens (770) forms another intermediate image under the space light modulator (740), then the space light modulator modulates the light in the transparent path to block the light to be occlused, afterwards the space light modulator reflects the light modulated for the second | beam separator (730), then the microdisplay light (750) enters the second beam separator (730), then the second beam separator (730) combines the modulated light in the transparent path (707) with the light in the path of virtual vision (705) and bending towards
    E 17/35 to the eye (710) for viewing, then the beam separator light enters the eye (710) through the refractory surface s3, then is consecutively reflected by the reflective surfaces S1 'and S2, and leaves the eye (710) through the refractory surface S1 and reaches the exit pupil (702), where the viewer's eye is aligned to have a combined view of a virtual view and a transparent modulated view.
    [33]
    33. Display according to claim 31, characterized by the fact that the positions of the mirror (790) and the spatial light modulator (740) are interchangeable.
    [34]
    34. Display according to any of claims 19-32, characterized by the fact that one or more of the optical surfaces of the objective optics is an aspherical surface with or without rotating symmetry.
    [35]
    35. Display according to any of claims 19-32, characterized in that one or more of the optical surfaces of the eye prism is an aspherical surface with or without rotating symmetry.
    [36]
    36. Display according to claim 1, characterized by the fact that the beam separator (130) is in the form of a cube or a plate and could be a non-polarized beam separator or a polarized beam separator.
    : 18/35
    [37]
    37. Display according to any of claims 1 to 36, characterized by the fact that it is one of a monocular and a binocular.
    [38]
    38. Compact and transparent optical head-mounted display (300), capable of combining a transparent path (307) with a virtual vision path (305) in such a way that the opacity of the transparent path can be modulated and the virtual vision occludes parts of the transparent view and vice versa, the display characterized by the fact that it comprises: a. a microdisplay (350) to generate an image to be viewed by a user, the microdisplay having a virtual viewing path (305) associated with it; B. a reflection-type spatial light modulator (340) to modify the light of an external scenario in the real world to block portions of the transparent view that must be occluded, the spatial light modulator having a transparent path (307) associated with it ; CC an objective optic (320), facing an external scenario, configured to receive the incident light from the external scenario and to focus the light under the spatial light modulator (340), where the objective optic is a single reflection free form prism comprising three surfaces
    : 19/35 freeform optics: SA refractory surface, S5 reflective surface and S6 refractory surface;
    d. a beam splitter (330) configured to combine a digitally generated virtual image from a microdisplay (350) and a transparent modulated image of an external scenario passing from a spatial light modulator, producing a combined image;
    and. an eye (310) configured to enlarge the combined image, where the eye is a single freeform reflection prism comprising three freeform optical surfaces: refractory surface S1, reflective surface S2 and refractory surface S3;
    £, an exit pupil (302) configured to face the eye, the exit pupil subsequently to the user observes the combined view of the virtual and transparent views in which the virtual view encloses portions of the transparent view;
    q. a cover mirror (325) configured to reflect light from the external scene to the objective optics, where the cover mirror adds an additional reflection to reverse the transparent view in order to maintain parity between the external scene and the transparent view presented to the viewer ;
    where the mirror (325) is arranged under the front layer (315) of the display, where the objective optics (320) is arranged under the front layer (315) of the display, where the spatial light modulator (340) is arranged on the back layer (317) of the display, on or near an intermediate image plane of the transparent path, facing one side of the beam separator (330), where the microdisplay (350) is arranged on the back layer (317) of the display, facing a different side of the beam separator (330), where the beam separator (330) is arranged so that the transparent path (307) is combined with the virtual view path (305) and the light of the combined path is directed to the eye (310), where the eye (310) is arranged under the back layer (317) of the display.
    then the incident light from an external scenario reflected by the mirror (325), enters the objective optics (320) through the refractory surface SA, then is reflected by the reflective surface S5 and leaves the objective prism (320) through the refractory surface S6 and forms an intermediate image in its focal plane in the spatial light modulator (340), later the spatial light modulator (340) modulates the light in the transparent path to occlude portions of the transparent view, later the spatial light modulator reflects the modulated light to the beam separator (330), then the microdisplay light (350) enters the beam separator (330), then the beam separator (330) combines the modulated light in the transparent path (307) with the light in the virtual vision path (305) and bends towards the eye (310) for viewing, then the light from the beam separator enters the eye (310) through the refractory surface S3, then is reflected by the reflected surface ra S2 and leaves the eye (310) through the refractory surface S1 and reaches the exit pupil (302), where the viewer's eye is aligned to have a combined view of a virtual view and a transparent modulated view.
    [39]
    39. Compact and transparent optical head-mounted display (400), capable of combining a transparent path (407) with a virtual vision path (405) in such a way that the opacity of the transparent path can be modulated and the virtual vision occludes parts of the transparent view and vice versa, the display characterized by the fact that it comprises: a microdisplay (450) to generate an image to be viewed by a user, the microdisplay having an associated virtual vision path (405) with the same; B. a reflection-type spatial light modulator (440) to modify the light of an external scenario in the real world to block portions of the transparent view that must be occluded, the spatial light modulator having a transparent path (407) associated with it ;
    Cs are an objective optics (420), facing an external scenario, configured to receive the incident light from the external scenario and focus the light under the spatial light modulator (440), where the objective optics (420) is a free-form prism of four reflections comprising six free-form optical surfaces: refractory surface S4, reflective surfaces S5, S4 ', S5' and S6 and refractory surface S7, where the objective optics are configured to form an intermediate image within the objective optics;
    d. a beam splitter (430) configured to combine a digitally generated virtual image from a microdisplay (450) and a transparent modulated image of an external scene passing from a spatial light modulator (440), producing a combined image;
    and. an eye (410) configured to enlarge the combined image, where the eye (410) is a prism of two free-form reflections comprising four free-form optical surfaces: refractory surface S1, reflecting surface S2, reflecting surface S1 'and refractory surface S3;
    f. an exit pupil (402) configured to face the eye, the exit pupil afterwards to the user observes the combined view of the virtual and transparent views in which the virtual view encloses portions of the transparent view;
    in which the objective optics (420) is disposed under the front layer (415) of the display, where the spatial light modulator (440) is disposed in the rear layer (417) of the display, at or near an intermediate image plane. transparent path, facing one side of the beam separator (430), where the microdisplay (450) is arranged on the back layer (417) of the display, facing a different side of the beam separator (430), where the beam separator (430) ) is arranged so that the transparent path (407) is combined with the virtual vision path (405) and the light from the combined path is directed to the eye (410), where The eye (410) is arranged under the back layer (417) of the display,
    subsequently the incident light from an external scene enters the objective optics (420) through the refractory surface S4, then it is consecutively reflected by the reflective surfaces S5, S4 ', S5' and S6, and exits the objective prism (420) through the refractory surface S7, afterwards the incident light forms an intermediate image in its focal plane in the spatial light modulator (440), later the spatial light modulator modulates the light in the transparent path to occlude portions of the transparent view, later the spatial light modulator reflects the modulated light for the beam separator (430), then the microdisplay light (450) enters the beam separator (430), then the beam separator (430) combines the modulated light in the transparent path (407) with the light in the virtual viewing path (405) and bending towards the eye (410) for viewing, then the beam separator light enters the eye (410) through the refractory surface S3, then it is cons ecutively reflected by the reflecting surfaces S1 'and S2, and leaves the eye (410) through the refractory surface S1 and reaches the exit pupil (402), where the viewer's eye is aligned to have a combined view of a virtual view and a modulated transparent view.
    [40]
    40. Display according to claim 39, characterized by the fact that the refractory surface S4 and the reflecting surface S4 'are the same physical surfaces and have the same set of surface requirements.
    [41]
    41. Compact and transparent optical head-mounted display (500), capable of combining a transparent path (507) with a virtual vision path (505) in such a way that the opacity of the transparent path can be modulated and the virtual vision occludes parts of the transparent view and vice versa, the display characterized by the fact that it comprises:
    The. a microdisplay (550) to generate an image to be viewed by a user, the microdisplay having a virtual viewing path (505) associated with it;
    B. a transmission-type spatial light modulator (540) to modify the light of an external setting to block portions of the transparent view that must be occluded, the spatial light modulator having a transparent path (507) associated with it;
    C. an objective optics (520), facing an external scenario, configured to receive the incident light from the external scenario and focus the light under the spatial light modulator (540), where the objective optics is a single reflection free form prism comprising three free-form optical surfaces: sa refractory surface, reflective surface S5 and refractory surface S6;
    d. a beam splitter (530) configured to combine a digitally generated virtual image from a microdisplay (550) and a transparent modulated image of an external scenario passing from a spatial light modulator, producing a combined image;
    i 26/35 e. an eye (510) configured to enlarge the combined image, where the eye is a prism of two free-form reflections comprising four free-form optical surfaces: refractory surface S1, reflective surface S2, reflective surface S1 'and refractory surface S3;
    f. an exit pupil (502) configured to face the eye, the exit pupil afterwards to the user observes the combined view of the virtual and transparent views in which the virtual view encloses portions of the transparent view;
    g. a cover mirror (527) configured to reflect light from the objective optics to the spatial light modulator, where the cover mirror adds additional reflection to the transparent path to reverse the transparent view in order to maintain parity between the external scene and the transparent view presented to the viewer;
    where the objective optics (520) is arranged under the front layer (515) of the display, where the mirror (525) is arranged in the front layer (515) of the display, where the spatial light modulator (540) is arranged in the layer rear (517) of the display, on or near an intermediate image plane of the transparent path, between the mirror (527) and the beam separator (530), where the microdisplay (550) is arranged on the rear layer of the display, facing a different side of the beam separator (530), where the beam separator (530) is arranged so that the transparent path (507) is combined with the virtual view path (505) and the light from the combined path is directed to the eye (510), where the eye (510) is arranged under the back layer of the display,
    then the incident light from an external scenario enters the objective optics (520) through the refractory surface S4, then is reflected by the reflective surface S5 and leaves the objective optics (520) through the refractory surface S6 and is bent by the mirror (527) in towards the back layer (517) and forms an intermediate image in its focal plane in the spatial light modulator (540), later the spatial light modulator (540) modulates the light in the transparent path to occlude portions of the transparent view, later the modulator of spatial light transmits the modulated light to the beam separator (530), then the microdisplay light (550) enters the beam separator (530), then the beam separator (530) combines the “modulated light in the transparent path ( 507) with the light in the virtual vision path (505) and bending towards the eye (510) for viewing, then the beam separator light enters the eye (510) through the refractory surface S3, and not so
    : 28/35 reflected by the reflective surfaces S1 'and S2 and leaves the eye (510) through the refractory surface S1 and reaches the exit pupil (502), where the viewer's eye is aligned to have a combined view of a virtual view and a transparent modulated view.
    [42]
    42. Display, according to claim 41, characterized by the fact that the refractory surface S1 and the reflecting surface S1 'are the same physical surfaces and have the same set of surface requirements.
    [43]
    43, Compact and transparent optical head-mounted display (600), capable of combining a transparent path (607) with a virtual vision path (605) in such a way that the opacity of the transparent path can be modulated and the virtual vision occludes parts of the transparent view and vice versa, the display characterized by the fact that it comprises: a. a microdisplay (650) to generate an image to be viewed by a user, the microdisplay having a virtual viewing path (605) associated with it; B. a transmission-type spatial light modulator (640) to modify the light of an external scenario in the real world to block portions of the transparent view that must be occluded, the light modulator
    - 29/35 spatial having a transparent path (607) associated with it;
    C. an objective optics (620), facing an external scenario, configured to receive the incident light from the external scenario and focus the light under the spatial light modulator (640), where the objective optics (620) is a freeform prism of three reflections comprising -. five free-form optical surfaces: refractory surface S4, reflective surfaces S5, S4 'and S6 and refractory surface S7, where the objective optics are configured to form an intermediate image within the objective optics;
    d. a beam splitter (630) configured to combine a digitally generated virtual image from a microdisplay (650) and a transparent modulated image of an external scene passing from a spatial light modulator (640), producing a combined image;
    and. an eye (610) configured to enlarge the combined image, where the eye (610) is a prism of two free-form reflections comprising four free-form optical surfaces: refractory surface S1, reflecting surface S2, reflecting surface S1 'and refractory surface S3;
    f ,. an exit pupil (602) configured to face the eye, the exit pupil after the user observes the combined view of the virtual and transparent views
    It is 30/35 in which the virtual view obscures portions of the transparent view;
    where the objective optics (620) is disposed under the front layer (615) of the display, where the spatial light modulator (640) is disposed in the rear layer (617) of the display, in or near an intermediate image plane. transparent path, facing one side of the beam separator (630), where the microdisplay (650) is arranged on the back layer of the display, facing a different side of the beam separator (630), where the beam separator (630) is arranged so that the transparent path (607) is combined with the virtual vision path (605) and the light from the combined path is directed to the eye (610), where the eye (610) is arranged under the back layer of the display,
    subsequently the incident light from an external scenario enters the objective optics (620) through the refractory surface S4, then it is consecutively reflected by the reflective surfaces S5, S4 'and S6, and exits the objective optics (620) through the refractory surface S7, later the incident light forms an intermediate image in its focal plane in the spatial light modulator (640), later the spatial light modulator modulates the light in the transparent path to occlude portions of the transparent vision, later the light modulator
    . Spatial 31/35 transmits the modulated light to the beam separator (630), then the microdisplay light (650) enters the beam separator (630), then the beam separator (630) combines the modulated light in the transparent path ( 607) with the light in the virtual vision path (605) and bending towards the eye (610) for viewing, afterwards the light from the beam separator enters the eye (610) through the refractory surface S3, then it is consecutively reflected by the surfaces reflectors S1 'and S2, and leaves the eye (610) through the refractory surface S1 and reaches the exit pupil (602), where the viewer's eye is aligned to have a combined view of a virtual view and a transparent modulated view.
    [44]
    44, Display according to claim 43, characterized by the fact that the refractory surface S1 and the reflecting surface S1 'are the same physical surfaces and have the same set of surface requirements.
    [45]
    45. Display, according to claim 43, characterized by the fact that the refractory surface S4 and the reflecting surface S4 'are the same physical surfaces and have the same set of surface requirements.
    '32/35
    [46]
    46. Compact and transparent optical head-mounted display (700), capable of combining a transparent path (707) with a virtual vision path (705) in such a way that the opacity of the transparent path can be modulated and the virtual vision occludes parts of the transparent view and vice versa, the display characterized by the fact that it comprises: a. a microdisplay (750) to generate an image to be viewed by a user, the microdisplay having a virtual viewing path (705) associated with it; B. a transmission-type spatial light modulator (740) for modifying light from an external setting to block portions of the transparent view that must be occluded, the spatial light modulator having a transparent path (707) associated with it; Ss an objective optic (720), facing an external scenario, configured to receive the incident light from the external scenario and focus the light under the spatial light modulator (740), where the objective optic (720) is a free-form prism of two reflections comprising four free-form optical surfaces: refractory surface S4, reflective surface S5, S4 '"and refractory surface s6;
    -. 33/35 and qd. a first beam separator (780) configured to reflect the transparent path in a mirror (790);
    and. a retransmission lens (770) configured to generate another intermediate image under the spatial light modulator (740);
    CC. a second beam splitter (730) configured to combine a virtual image from a microdisplay (750) and a transparent modulated image of an external scene passing from a spatial light modulator (740), producing a combined image;
    q. an eye (710) configured to enlarge the combined image, where the eye (710) is a prism of two free-form reflections comprising four free-form optical surfaces: refractory surface S1, reflecting surface S2, reflecting surface S1 'and refractory surface S3;
    H. an exit pupil (702) configured to face the eye, the exit pupil afterwards to the user observes the combined view of the virtual and transparent views in which the virtual view encloses portions of the transparent view;
    à, a mirror (790) to bend the transparent path;
    where the objective optics (720) is arranged under the front layer (715) of the display, where the first separator of a. 34/35 beams (780) are placed under the front layer of the display, where the mirror (790) is placed under the front layer of the display in the focal plane of the objective optics (720), facing the spatial light modulator, where the spatial light modulator (740) is arranged on the back layer (717) of the display, facing the second of the beam separator (730), where the retransmission is arranged between the first and the second beam separator, where the microdisplay (750) it is arranged in the rear layer of the display, facing the second beam separator (730), where the second beam separator (730) is arranged so that the direction of light transmission from the beam separator is facing the eye (710 ), in which the eyelet (710) is placed under the back layer of the display,
    subsequently the incident light from the external scene enters the objective prism (720) through the refractory surface S4, then it is consecutively reflected by the reflective surfaces S5, S4 "and leaves the objective prism (720) through the refractory surface S6, afterwards the incident light is reflected by the beam separator (780) on the mirror (790), where the mirror reflects light from the front layer to the relay lens (770), then the relay lens (770) forms another intermediate image under the modulator space light (740),
    v
    -
    . 35/35
    - subsequently the spatial light modulator modulates the light in the transparent path to remove the light to be occluded, later the spatial light modulator reflects the modulated light for the second beam separator (730), afterwards the microdisplay light (750) enters in the second beam separator (730), then the second beam separator (730) combines the modulated light in the transparent path (707) with the light in the virtual vision path (705) and bends towards the eye (710) for viewing , then the light from the beam separator enters the eye (710) through the refractory surface S3, then is consecutively reflected by the reflective surfaces S1 'and S2, and leaves the eye (710) through the refractory surface S1 and reaches the exit pupil (702), where the viewer's eye is aligned to have a combined view of a virtual view and a modulated transparent view.
    类似技术:
    公开号 | 公开日 | 专利标题
    BR112014024945A2|2020-10-27|transparent head-mounted optical display device with mutual occlusion and opacity control capability
    同族专利:
    公开号 | 公开日
    CN104937475B|2018-01-16|
    NZ725339A|2018-04-27|
    CN107843988B|2021-02-02|
    WO2014011266A3|2015-04-16|
    US10451883B2|2019-10-22|
    KR20210119558A|2021-10-05|
    CA2874576C|2021-12-28|
    US9851563B2|2017-12-26|
    US20210373338A1|2021-12-02|
    CA2869781C|2021-04-27|
    KR102306729B1|2021-09-28|
    EP2834699B1|2020-12-16|
    US20190018249A1|2019-01-17|
    CA2874576A1|2014-01-16|
    CN104541201B|2018-05-25|
    CN104541201A|2015-04-22|
    WO2014011266A2|2014-01-16|
    KR102188748B1|2020-12-08|
    IL275662D0|2020-08-31|
    NZ700887A|2016-11-25|
    US10901221B2|2021-01-26|
    KR102028732B1|2019-10-04|
    NZ725322A|2017-12-22|
    US10048501B2|2018-08-14|
    EP2834699A4|2016-06-29|
    NZ724344A|2018-05-25|
    AU2017201669A1|2017-03-30|
    KR20150009536A|2015-01-26|
    JP6126682B2|2017-05-10|
    EP2841991A1|2015-03-04|
    CN108391033B|2020-10-30|
    KR20210024255A|2021-03-04|
    JP2015519595A|2015-07-09|
    KR20200138449A|2020-12-09|
    JP6944578B2|2021-10-06|
    CA3138549A1|2014-01-16|
    US20140218468A1|2014-08-07|
    KR102345444B1|2021-12-29|
    AU2017203227B2|2018-11-29|
    JP2018139421A|2018-09-06|
    RU2015154980A|2017-06-28|
    KR102099156B1|2020-04-09|
    JP6434076B2|2018-12-05|
    AU2013243380B2|2017-04-20|
    KR20190112218A|2019-10-02|
    US9547174B2|2017-01-17|
    KR20180037336A|2018-04-11|
    NZ740631A|2018-12-21|
    US20180299677A1|2018-10-18|
    KR20180038582A|2018-04-16|
    KR102022719B1|2019-11-05|
    IL275662A|2021-07-29|
    EP2834699A2|2015-02-11|
    US20170315361A1|2017-11-02|
    US10175491B2|2019-01-08|
    CA2869781A1|2013-10-10|
    CN107976818A|2018-05-01|
    JP2022001949A|2022-01-06|
    US20180157046A1|2018-06-07|
    US20190107722A1|2019-04-11|
    KR102124350B1|2020-06-23|
    JP6176747B2|2017-08-09|
    AU2017203227A1|2017-06-08|
    AU2017201669B2|2019-02-07|
    JP6768046B2|2020-10-14|
    US20170031163A1|2017-02-02|
    US9726893B2|2017-08-08|
    KR20180038584A|2018-04-16|
    CN107843988A|2018-03-27|
    JP2017161914A|2017-09-14|
    KR102095330B1|2020-03-31|
    KR102129330B1|2020-07-02|
    CA3111134A1|2013-10-10|
    RU2015156050A|2019-01-18|
    EP3796071A1|2021-03-24|
    BR112014024941A2|2017-09-19|
    US9874752B2|2018-01-23|
    IL261165D0|2018-10-31|
    JP2015518178A|2015-06-25|
    JP2021009398A|2021-01-28|
    EP2841991A4|2016-02-10|
    KR20140141718A|2014-12-10|
    EP2841991B1|2020-01-08|
    CN107976818B|2020-06-19|
    JP2017201406A|2017-11-09|
    US10162184B2|2018-12-25|
    US20180101012A1|2018-04-12|
    CN104937475A|2015-09-23|
    AU2013289157B2|2017-04-06|
    KR20180038583A|2018-04-16|
    CN108391033A|2018-08-10|
    KR102223290B1|2021-03-04|
    EP3608717A1|2020-02-12|
    KR20200035184A|2020-04-01|
    IL284204D0|2021-07-29|
    JP2019035977A|2019-03-07|
    AU2013243380A1|2014-10-30|
    IL261165A|2020-07-30|
    RU2015154980A3|2019-03-26|
    US20140177023A1|2014-06-26|
    JP6322753B2|2018-05-09|
    WO2013152205A1|2013-10-10|
    US20200012109A1|2020-01-09|
    US10061130B2|2018-08-28|
    US20180284456A1|2018-10-04|
    AU2013289157A1|2014-10-30|
    NZ700898A|2017-03-31|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US3909121A|1974-06-25|1975-09-30|Mesquita Cardoso Edgar Antonio|Panoramic photographic methods|
    US4026641A|1975-12-30|1977-05-31|The United States Of America As Represented By The Secretary Of The Army|Toric reflector display|
    JPS6141467B2|1978-03-29|1986-09-16|Olympus Optical Co|
    JPS57171314A|1981-04-15|1982-10-21|Mitsubishi Electric Corp|Optical branching and coupling circuit|
    KR940010879B1|1989-07-28|1994-11-19|캐논 가부시끼가이샤|Image forming apparatus|
    US5136183A|1990-06-27|1992-08-04|Advanced Micro Devices, Inc.|Integrated comparator circuit|
    US5307203A|1990-12-06|1994-04-26|Tandem Scanning Corporation|Confocal tandem scanning reflected light microscope|
    US5135183A|1991-09-23|1992-08-04|Hughes Aircraft Company|Dual-image optoelectronic imaging apparatus including birefringent prism arrangement|
    CA2084111A1|1991-12-17|1993-06-18|William E. Nelson|Virtual display device and method of use|
    US5406415A|1992-09-22|1995-04-11|Kelly; Shawn L.|Imaging system for a head-mounted display|
    US5386313A|1993-03-11|1995-01-31|Szegedi; Nicholas J.|Reflective magneto-optic spatial light modulator assembly|
    JPH0792426A|1993-09-24|1995-04-07|Sony Corp|Visual device|
    US6347744B1|1995-10-10|2002-02-19|Symbol Technologies, Inc.|Retroreflective scan module for electro-optical readers|
    JPH09166759A|1995-12-18|1997-06-24|Olympus Optical Co Ltd|Picture display device|
    JP3222052B2|1996-01-11|2001-10-22|株式会社東芝|Optical scanning device|
    JPH1068899A|1996-08-26|1998-03-10|Asahi Optical Co Ltd|Cascade scanning optical system|
    US6204974B1|1996-10-08|2001-03-20|The Microoptical Corporation|Compact image display system for eyeglasses or other head-borne frames|
    US6377229B1|1998-04-20|2002-04-23|Dimensional Media Associates, Inc.|Multi-planar volumetric display system and method of operation using three-dimensional anti-aliasing|
    US6466185B2|1998-04-20|2002-10-15|Alan Sullivan|Multi-planar volumetric display system and method of operation using psychological vision cues|
    US6215532B1|1998-07-27|2001-04-10|Mixed Reality Systems Laboratory Inc.|Image observing apparatus for observing outside information superposed with a display image|
    JP2000105348A|1998-07-27|2000-04-11|Mr System Kenkyusho:Kk|Picture observation device|
    JP4100531B2|1998-08-11|2008-06-11|株式会社東京大学Ｔｌｏ|Information presentation method and apparatus|
    JP2000171750A|1998-12-03|2000-06-23|Sony Corp|Head-mounted display, display method and provision medium|
    CA2399698A1|2000-02-11|2001-08-16|Laszlo Holakovszky|Optical beam-splitter unit and binocular display device containing such a unit|
    AU4082801A|2000-03-16|2001-09-24|Lee Scott Friend|Imaging apparatus|
    CA2411442C|2000-06-05|2010-07-13|Lumus Ltd.|Substrate-guided optical beam expander|
    US20020000951A1|2000-06-26|2002-01-03|Richards Angus Duncan|Display device enhancements|
    AU1022801A|2000-10-07|2002-04-22|Physoptics Opto Electronic Gmb|Information system|
    US6457834B1|2001-01-24|2002-10-01|Scram Technologies, Inc.|Optical system for display panel|
    EP1231780A3|2001-02-07|2004-01-14|Sony Corporation|Image pickup apparatus|
    JP2002244074A|2001-02-15|2002-08-28|Mixed Reality Systems Laboratory Inc|Picture display device|
    FR2826221B1|2001-05-11|2003-12-05|Immervision Internat Pte Ltd|METHOD FOR OBTAINING AND DISPLAYING A VARIABLE RESOLUTION DIGITAL PANORAMIC IMAGE|
    US7009773B2|2001-05-23|2006-03-07|Research Foundation Of The University Of Central Florida, Inc.|Compact microlenslet arrays imager|
    WO2003001275A2|2001-06-21|2003-01-03|Koninklijke Philips Electronics N.V.|Display device|
    US6593561B2|2001-06-22|2003-07-15|Litton Systems, Inc.|Method and system for gathering image data using multiple sensors|
    US7940299B2|2001-08-09|2011-05-10|Technest Holdings, Inc.|Method and apparatus for an omni-directional video surveillance system|
    US6473241B1|2001-11-27|2002-10-29|The United States Of America As Represented By The Secretary Of The Air Force|Wide field-of-view imaging system using a reflective spatial light modulator|
    US7084904B2|2002-09-30|2006-08-01|Microsoft Corporation|Foveated wide-angle imaging system and method for capturing and viewing wide-angle images in real time|
    US7427996B2|2002-10-16|2008-09-23|Canon Kabushiki Kaisha|Image processing apparatus and image processing method|
    JP2004170386A|2002-10-28|2004-06-17|Seiko Epson Corp|Device and method for inspection, device and method for liquid droplet ejection, device and electronic apparatus|
    JP2004153605A|2002-10-31|2004-05-27|Victor Co Of Japan Ltd|Image pickup device and system for transmitting pick-up image|
    JP4288939B2|2002-12-05|2009-07-01|ソニー株式会社|Imaging device|
    JP4304973B2|2002-12-10|2009-07-29|ソニー株式会社|Imaging device|
    US6870653B2|2003-01-31|2005-03-22|Eastman Kodak Company|Decoupled alignment axis for fold mirror adjustment|
    US7542090B1|2003-03-21|2009-06-02|Aerodyne Research, Inc.|System and method for high-resolution with a small-format focal-plane array using spatial modulation|
    US20050117015A1|2003-06-26|2005-06-02|Microsoft Corp.|Foveated panoramic camera system|
    US7336299B2|2003-07-03|2008-02-26|Physical Optics Corporation|Panoramic video system with real-time distortion-free imaging|
    JP2005094417A|2003-09-18|2005-04-07|Sony Corp|Imaging apparatus|
    AU2003297061A1|2003-12-12|2005-07-14|Headplay Inc.|Optical arrangements for head mounted displays|
    EP1580586B1|2004-03-25|2008-06-11|Olympus Corporation|Scanning confocal microscope|
    KR100491271B1|2004-04-30|2005-05-25|주식회사 나노포토닉스|Panoramic mirror and imaging system using the same|
    US20070182812A1|2004-05-19|2007-08-09|Ritchey Kurtis J|Panoramic image-based virtual reality/telepresence audio-visual system and method|
    US7639208B1|2004-05-21|2009-12-29|University Of Central Florida Research Foundation, Inc.|Compact optical see-through head-mounted display with occlusion support|
    AU2005269256B2|2004-08-03|2008-08-07|Silverbrook Research Pty Ltd|Head mounted display with wave front modulator|
    US20060055811A1|2004-09-14|2006-03-16|Frtiz Bernard S|Imaging system having modules with adaptive optical elements|
    US7532771B2|2004-11-12|2009-05-12|Microsoft Corporation|Image processing system for digital collage|
    US7884947B2|2005-01-20|2011-02-08|Zygo Corporation|Interferometry for determining characteristics of an object surface, with spatially coherent illumination|
    US20070002131A1|2005-02-15|2007-01-04|Ritchey Kurtis J|Dynamic interactive region-of-interest panoramic/three-dimensional immersive communication system and method|
    DE102005012763A1|2005-03-19|2006-09-21|Diehl Bgt Defence Gmbh & Co. Kg|Wide-angle lens|
    US7023628B1|2005-04-05|2006-04-04|Alex Ning|Compact fisheye objective lens|
    EP1798587B1|2005-12-15|2012-06-13|Saab Ab|Head-up display|
    CN101021669A|2006-02-13|2007-08-22|耿忠|Whole-view field imaging and displaying method and system|
    CN100526936C|2006-03-09|2009-08-12|比亚迪股份有限公司|Optical imaging system for helmet display|
    JP2007248545A|2006-03-14|2007-09-27|Konica Minolta Holdings Inc|Video display device and video display system|
    US20080097347A1|2006-09-22|2008-04-24|Babak Arvanaghi|Bendable needle assembly|
    US8072482B2|2006-11-09|2011-12-06|Innovative Signal Anlysis|Imaging system having a rotatable image-directing device|
    CN101029968A|2007-04-06|2007-09-05|北京理工大学|Optical perspective helmet display device of addressing light-ray shielding mechanism|
    EP2142953B1|2007-04-22|2019-06-05|Lumus Ltd|A collimating optical device and system|
    US7589901B2|2007-07-10|2009-09-15|Microvision, Inc.|Substrate-guided relays for use with scanned beam light sources|
    KR100882011B1|2007-07-29|2009-02-04|주식회사 나노포토닉스|Methods of obtaining panoramic images using rotationally symmetric wide-angle lenses and devices thereof|
    US7973834B2|2007-09-24|2011-07-05|Jianwen Yang|Electro-optical foveated imaging and tracking system|
    US20100045773A1|2007-11-06|2010-02-25|Ritchey Kurtis J|Panoramic adapter system and method with spherical field-of-view coverage|
    JP2009122379A|2007-11-14|2009-06-04|Canon Inc|Optical device, control method thereof, imaging device and program|
    JP5201957B2|2007-11-21|2013-06-05|キヤノン株式会社|Imaging device|
    JP5153351B2|2008-01-18|2013-02-27|キヤノン株式会社|Zoom lens and optical apparatus having the same|
    US7952783B2|2008-09-22|2011-05-31|Microvision, Inc.|Scanning mirror control|
    JP2012508366A|2008-11-04|2012-04-05|ウィリアム・マーシュ・ライス・ユニバーシティ|Image mapping spectrometer|
    US20110164108A1|2009-12-30|2011-07-07|Fivefocal Llc|System With Selective Narrow FOV and 360 Degree FOV, And Associated Methods|
    WO2012037290A2|2010-09-14|2012-03-22|Osterhout Group, Inc.|Eyepiece with uniformly illuminated reflective display|
    AU2011220382A1|2010-02-28|2012-10-18|Microsoft Corporation|Local advertising content on an interactive head-mounted eyepiece|
    US20110213664A1|2010-02-28|2011-09-01|Osterhout Group, Inc.|Local advertising content on an interactive head-mounted eyepiece|
    US8743199B2|2010-03-09|2014-06-03|Physical Optics Corporation|Omnidirectional imaging optics with 360°-seamless telescopic resolution|
    US8941559B2|2010-09-21|2015-01-27|Microsoft Corporation|Opacity filter for display device|
    JP2012252091A|2011-06-01|2012-12-20|Sony Corp|Display apparatus|
    EP2732330A4|2011-07-17|2015-07-08|Ziva Corp|Optical imaging with foveation|
    AU2011204946C1|2011-07-22|2012-07-26|Microsoft Technology Licensing, Llc|Automatic text scrolling on a head-mounted display|
    US9256117B2|2011-10-07|2016-02-09|L-3 Communications Cincinnati Electronics Corporation|Panoramic imaging systems comprising rotatable mirrors for image stabilization|
    KR20140118770A|2013-03-27|2014-10-08|가부시키가이샤 한도오따이 에네루기 켄큐쇼|Display device|
    US9494792B2|2013-07-30|2016-11-15|Global Oled Technology Llc|Local seal for encapsulation of electro-optical element on a flexible substrate|
    US20160077345A1|2014-09-17|2016-03-17|Michael Bohan|Eliminating Binocular Rivalry in Monocular Displays|
    EP3163379B1|2015-10-28|2019-10-16|Samsung Electronics Co., Ltd.|See-through holographic display apparatus|GB0522968D0|2005-11-11|2005-12-21|Popovich Milan M|Holographic illumination device|
    GB0718706D0|2007-09-25|2007-11-07|Creative Physics Ltd|Method and apparatus for reducing laser speckle|
    US9965681B2|2008-12-16|2018-05-08|Osterhout Group, Inc.|Eye imaging in head worn computing|
    WO2012136970A1|2011-04-07|2012-10-11|Milan Momcilo Popovich|Laser despeckler based on angular diversity|
    US10670876B2|2011-08-24|2020-06-02|Digilens Inc.|Waveguide laser illuminator incorporating a despeckler|
    EP2748670B1|2011-08-24|2015-11-18|Rockwell Collins, Inc.|Wearable data display|
    WO2013102759A2|2012-01-06|2013-07-11|Milan Momcilo Popovich|Contact image sensor using switchable bragg gratings|
    WO2013167864A1|2012-05-11|2013-11-14|Milan Momcilo Popovich|Apparatus for eye tracking|
    US11138793B2|2014-03-14|2021-10-05|Magic Leap, Inc.|Multi-depth plane display system with reduced switching between depth planes|
    US10430985B2|2014-03-14|2019-10-01|Magic Leap, Inc.|Augmented reality systems and methods utilizing reflections|
    WO2014113455A1|2013-01-15|2014-07-24|The University Of North Carolina At Chapel Hill|Methods, systems, and computer readable media for generating an augmented scene display|
    WO2014188149A1|2013-05-20|2014-11-27|Milan Momcilo Popovich|Holographic waveguide eye tracker|
    US9625723B2|2013-06-25|2017-04-18|Microsoft Technology Licensing, Llc|Eye-tracking system using a freeform prism|
    US10228561B2|2013-06-25|2019-03-12|Microsoft Technology Licensing, Llc|Eye-tracking system using a freeform prism and gaze-detection light|
    US9727772B2|2013-07-31|2017-08-08|Digilens, Inc.|Method and apparatus for contact image sensing|
    US9335604B2|2013-12-11|2016-05-10|Milan Momcilo Popovich|Holographic waveguide display|
    US10274731B2|2013-12-19|2019-04-30|The University Of North Carolina At Chapel Hill|Optical see-through near-eye display using point light source backlight|
    US10254856B2|2014-01-17|2019-04-09|Osterhout Group, Inc.|External user interface for head worn computing|
    US9939934B2|2014-01-17|2018-04-10|Osterhout Group, Inc.|External user interface for head worn computing|
    US9529195B2|2014-01-21|2016-12-27|Osterhout Group, Inc.|See-through computer display systems|
    US9651788B2|2014-01-21|2017-05-16|Osterhout Group, Inc.|See-through computer display systems|
    US9615742B2|2014-01-21|2017-04-11|Osterhout Group, Inc.|Eye imaging in head worn computing|
    US9952664B2|2014-01-21|2018-04-24|Osterhout Group, Inc.|Eye imaging in head worn computing|
    US9846308B2|2014-01-24|2017-12-19|Osterhout Group, Inc.|Haptic systems for head-worn computers|
    US10191279B2|2014-03-17|2019-01-29|Osterhout Group, Inc.|Eye imaging in head worn computing|
    US9298007B2|2014-01-21|2016-03-29|Osterhout Group, Inc.|Eye imaging in head worn computing|
    US9836122B2|2014-01-21|2017-12-05|Osterhout Group, Inc.|Eye glint imaging in see-through computer display systems|
    US20150205135A1|2014-01-21|2015-07-23|Osterhout Group, Inc.|See-through computer display systems|
    US20150241964A1|2014-02-11|2015-08-27|Osterhout Group, Inc.|Eye imaging in head worn computing|
    US9766463B2|2014-01-21|2017-09-19|Osterhout Group, Inc.|See-through computer display systems|
    US20150277120A1|2014-01-21|2015-10-01|Osterhout Group, Inc.|Optical configurations for head worn computing|
    US9494800B2|2014-01-21|2016-11-15|Osterhout Group, Inc.|See-through computer display systems|
    US9811159B2|2014-01-21|2017-11-07|Osterhout Group, Inc.|Eye imaging in head worn computing|
    US9684172B2|2014-12-03|2017-06-20|Osterhout Group, Inc.|Head worn computer display systems|
    US20150205111A1|2014-01-21|2015-07-23|Osterhout Group, Inc.|Optical configurations for head worn computing|
    US9753288B2|2014-01-21|2017-09-05|Osterhout Group, Inc.|See-through computer display systems|
    US9715112B2|2014-01-21|2017-07-25|Osterhout Group, Inc.|Suppression of stray light in head worn computing|
    US9594246B2|2014-01-21|2017-03-14|Osterhout Group, Inc.|See-through computer display systems|
    US9310610B2|2014-01-21|2016-04-12|Osterhout Group, Inc.|See-through computer display systems|
    US9651784B2|2014-01-21|2017-05-16|Osterhout Group, Inc.|See-through computer display systems|
    US9400390B2|2014-01-24|2016-07-26|Osterhout Group, Inc.|Peripheral lighting for head worn computing|
    US9852545B2|2014-02-11|2017-12-26|Osterhout Group, Inc.|Spatial location presentation in head worn computing|
    US9401540B2|2014-02-11|2016-07-26|Osterhout Group, Inc.|Spatial location presentation in head worn computing|
    US20150228119A1|2014-02-11|2015-08-13|Osterhout Group, Inc.|Spatial location presentation in head worn computing|
    US9229233B2|2014-02-11|2016-01-05|Osterhout Group, Inc.|Micro Doppler presentations in head worn computing|
    US9299194B2|2014-02-14|2016-03-29|Osterhout Group, Inc.|Secure sharing in head worn computing|
    AU2017210289B2|2016-01-19|2021-10-21|Magic Leap, Inc.|Augmented reality systems and methods utilizing reflections|
    CN103901615B|2014-03-14|2016-05-25|北京理工大学|Little recessed imaging optical system|
    US20150277118A1|2014-03-28|2015-10-01|Osterhout Group, Inc.|Sensor dependent content position in head worn computing|
    US20160187651A1|2014-03-28|2016-06-30|Osterhout Group, Inc.|Safety for a vehicle operator with an hmd|
    US11227294B2|2014-04-03|2022-01-18|Mentor Acquisition One, Llc|Sight information collection in head worn computing|
    US10529359B2|2014-04-17|2020-01-07|Microsoft Technology Licensing, Llc|Conversation detection|
    US9922667B2|2014-04-17|2018-03-20|Microsoft Technology Licensing, Llc|Conversation, presence and context detection for hologram suppression|
    US10853589B2|2014-04-25|2020-12-01|Mentor Acquisition One, Llc|Language translation with head-worn computing|
    US9158116B1|2014-04-25|2015-10-13|Osterhout Group, Inc.|Temple and ear horn assembly for headworn computer|
    US20150309534A1|2014-04-25|2015-10-29|Osterhout Group, Inc.|Ear horn assembly for headworn computer|
    US9672210B2|2014-04-25|2017-06-06|Osterhout Group, Inc.|Language translation with head-worn computing|
    US9651787B2|2014-04-25|2017-05-16|Osterhout Group, Inc.|Speaker assembly for headworn computer|
    CN104007559B|2014-05-08|2017-05-17|北京理工大学|Foveated imaging system with partial super-resolution scanning function|
    CN104102018B|2014-05-08|2016-10-05|北京理工大学|Double small recessed local high resolution imaging system|
    US9746686B2|2014-05-19|2017-08-29|Osterhout Group, Inc.|Content position calibration in head worn computing|
    US9841599B2|2014-06-05|2017-12-12|Osterhout Group, Inc.|Optical configurations for head-worn see-through displays|
    US9575321B2|2014-06-09|2017-02-21|Osterhout Group, Inc.|Content presentation in head worn computing|
    US10649220B2|2014-06-09|2020-05-12|Mentor Acquisition One, Llc|Content presentation in head worn computing|
    US10663740B2|2014-06-09|2020-05-26|Mentor Acquisition One, Llc|Content presentation in head worn computing|
    US9810906B2|2014-06-17|2017-11-07|Osterhout Group, Inc.|External user interface for head worn computing|
    US9366867B2|2014-07-08|2016-06-14|Osterhout Group, Inc.|Optical systems for see-through displays|
    US20160019715A1|2014-07-15|2016-01-21|Osterhout Group, Inc.|Content presentation in head worn computing|
    US11103122B2|2014-07-15|2021-08-31|Mentor Acquisition One, Llc|Content presentation in head worn computing|
    US10359736B2|2014-08-08|2019-07-23|Digilens Inc.|Method for holographic mastering and replication|
    US9829707B2|2014-08-12|2017-11-28|Osterhout Group, Inc.|Measuring content brightness in head worn computing|
    US9423842B2|2014-09-18|2016-08-23|Osterhout Group, Inc.|Thermal management for head-worn computer|
    US10241330B2|2014-09-19|2019-03-26|Digilens, Inc.|Method and apparatus for generating input images for holographic waveguide displays|
    US10423222B2|2014-09-26|2019-09-24|Digilens Inc.|Holographic waveguide optical tracker|
    US9671613B2|2014-09-26|2017-06-06|Osterhout Group, Inc.|See-through computer display systems|
    US9366868B2|2014-09-26|2016-06-14|Osterhout Group, Inc.|See-through computer display systems|
    US9459201B2|2014-09-29|2016-10-04|Zyomed Corp.|Systems and methods for noninvasive blood glucose and other analyte detection and measurement using collision computing|
    AU2015323940B2|2014-09-29|2021-05-20|Magic Leap, Inc.|Architectures and methods for outputting different wavelength light out of waveguides|
    US9448409B2|2014-11-26|2016-09-20|Osterhout Group, Inc.|See-through computer display systems|
    US10684687B2|2014-12-03|2020-06-16|Mentor Acquisition One, Llc|See-through computer display systems|
    USD743963S1|2014-12-22|2015-11-24|Osterhout Group, Inc.|Air mouse|
    USD751552S1|2014-12-31|2016-03-15|Osterhout Group, Inc.|Computer glasses|
    USD753114S1|2015-01-05|2016-04-05|Osterhout Group, Inc.|Air mouse|
    KR102329295B1|2015-01-09|2021-11-19|삼성디스플레이 주식회사|Head mounted display device|
    WO2016113534A1|2015-01-12|2016-07-21|Milan Momcilo Popovich|Environmentally isolated waveguide display|
    US10105049B2|2015-01-16|2018-10-23|Massachusetts Institute Of Technology|Methods and apparatus for anterior segment ocular imaging|
    WO2016116733A1|2015-01-20|2016-07-28|Milan Momcilo Popovich|Holographic waveguide lidar|
    US9632226B2|2015-02-12|2017-04-25|Digilens Inc.|Waveguide grating device|
    CN105988763B|2015-02-15|2019-10-29|联想有限公司|A kind of information processing method and device|
    US10878775B2|2015-02-17|2020-12-29|Mentor Acquisition One, Llc|See-through computer display systems|
    US20160239985A1|2015-02-17|2016-08-18|Osterhout Group, Inc.|See-through computer display systems|
    CN107645921B|2015-03-16|2021-06-22|奇跃公司|Methods and systems for diagnosing and treating health disorders|
    WO2016146963A1|2015-03-16|2016-09-22|Popovich, Milan, Momcilo|Waveguide device incorporating a light pipe|
    GB2536650A|2015-03-24|2016-09-28|Augmedics Ltd|Method and system for combining video-based and optic-based augmented reality in a near eye display|
    JP2016180955A|2015-03-25|2016-10-13|株式会社ソニー・インタラクティブエンタテインメント|Head-mounted display, display control method, and position control method|
    CN106154640B|2015-03-31|2020-02-21|联想有限公司|Display module and electronic device|
    US10591756B2|2015-03-31|2020-03-17|Digilens Inc.|Method and apparatus for contact image sensing|
    US10274728B2|2015-05-18|2019-04-30|Facebook Technologies, Llc|Stacked display panels for image enhancement|
    WO2016205249A1|2015-06-15|2016-12-22|Magic Leap, Inc.|Virtual and augmented reality systems and methods|
    US9977493B2|2015-06-17|2018-05-22|Microsoft Technology Licensing, Llc|Hybrid display system|
    US10222619B2|2015-07-12|2019-03-05|Steven Sounyoung Yu|Head-worn image display apparatus for stereoscopic microsurgery|
    US10139966B2|2015-07-22|2018-11-27|Osterhout Group, Inc.|External user interface for head worn computing|
    EP3337383A4|2015-08-21|2019-04-03|Magic Leap, Inc.|Eyelid shape estimation|
    CN108135469B|2015-08-21|2021-03-09|奇跃公司|Eyelid shape estimation using eye pose measurements|
    EP3195028A1|2015-09-03|2017-07-26|3M Innovative Properties Company|Head-mounted display|
    US10681489B2|2015-09-16|2020-06-09|Magic Leap, Inc.|Head pose mixing of audio files|
    CA2999261A1|2015-09-23|2017-03-30|Magic Leap, Inc.|Eye imaging with an off-axis imager|
    EP3353711A1|2015-09-23|2018-08-01|Datalogic USA, Inc.|Imaging systems and methods for tracking objects|
    WO2017060665A1|2015-10-05|2017-04-13|Milan Momcilo Popovich|Waveguide display|
    US10163010B2|2015-10-16|2018-12-25|Magic Leap, Inc.|Eye pose identification using eye features|
    CN108369345B|2015-10-20|2021-05-04|奇跃公司|System and method for changing user input mode of wearable device and wearable system|
    JP6983773B2|2015-11-04|2021-12-17|マジック リープ, インコーポレイテッドMagic Leap, Inc.|Dynamic display calibration based on eye tracking|
    US11231544B2|2015-11-06|2022-01-25|Magic Leap, Inc.|Metasurfaces for redirecting light and methods for fabricating|
    CN105404005A|2015-12-10|2016-03-16|合肥虔视光电科技有限公司|Head-mounted display for augmented reality|
    NZ743884A|2016-01-07|2019-11-29|Magic Leap Inc|Virtual and augmented reality systems and methods having unequal numbers of component color images distributed across depth planes|
    NZ744400A|2016-01-19|2019-11-29|Magic Leap Inc|Eye image collection, selection, and combination|
    CN108700743A|2016-01-22|2018-10-23|康宁股份有限公司|Wide visual field individual's display|
    CA3013025A1|2016-01-29|2017-08-03|Magic Leap, Inc.|Display for three-dimensional image|
    US10459230B2|2016-02-02|2019-10-29|Disney Enterprises, Inc.|Compact augmented reality / virtual reality display|
    WO2017134412A1|2016-02-04|2017-08-10|Milan Momcilo Popovich|Holographic waveguide optical tracker|
    AU2017223716B2|2016-02-24|2021-11-18|Magic Leap, Inc.|Low profile interconnect for light emitter|
    CN108700697B|2016-02-24|2021-12-14|奇跃公司|Polarizing beam splitter with low light leakage|
    NZ745294A|2016-02-26|2020-01-31|Magic Leap Inc|Light output system with reflector and lens for highly spatially uniform light output|
    JP6843876B2|2016-02-26|2021-03-17|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Display system with multiple optical pipes for multiple light emitters|
    US10667981B2|2016-02-29|2020-06-02|Mentor Acquisition One, Llc|Reading assistance system for visually impaired|
    AU2017228307B2|2016-02-29|2021-11-04|Magic Leap, Inc.|Virtual and augmented reality systems and methods|
    EP3423887A4|2016-03-01|2019-11-06|Magic Leap, Inc.|Reflective switching device for inputting diifferent wavelengths of light into waveguides|
    US10591728B2|2016-03-02|2020-03-17|Mentor Acquisition One, Llc|Optical systems for head-worn computers|
    EP3424038A4|2016-03-04|2019-10-23|Magic Leap, Inc.|Current drain reduction in ar/vr display systems|
    NZ746021A|2016-03-07|2020-02-28|Magic Leap Inc|Blue light adjustment for biometric security|
    EP3433707B1|2016-03-22|2020-10-28|Magic Leap, Inc.|Head mounted display system configured to exchange biometric information|
    CN105744132B|2016-03-23|2020-01-03|捷开通讯有限公司|Optical lens accessory for panoramic image shooting|
    CN108780224B|2016-03-24|2021-08-03|迪吉伦斯公司|Method and apparatus for providing a polarization selective holographic waveguide device|
    EP3433661A4|2016-03-25|2019-11-20|Magic Leap, Inc.|Virtual and augmented reality systems and methods|
    US9554738B1|2016-03-30|2017-01-31|Zyomed Corp.|Spectroscopic tomography systems and methods for noninvasive detection and measurement of analytes using collision computing|
    US10539763B2|2016-03-31|2020-01-21|Sony Corporation|Optical system, electronic device, camera, method and computer program|
    KR20180124136A|2016-03-31|2018-11-20|매직 립, 인코포레이티드|Pods and interactions with 3D virtual objects using multi-DOF controllers|
    AU2017246901A1|2016-04-08|2018-10-25|Magic Leap, Inc.|Augmented reality systems and methods with variable focus lens elements|
    WO2017178781A1|2016-04-11|2017-10-19|GRANT, Alastair, John|Holographic waveguide apparatus for structured light projection|
    US10001648B2|2016-04-14|2018-06-19|Disney Enterprises, Inc.|Occlusion-capable augmented reality display using cloaking optics|
    US9726896B2|2016-04-21|2017-08-08|Maximilian Ralph Peter von und zu Liechtenstein|Virtual monitor display technique for augmented reality environments|
    KR20180133507A|2016-04-21|2018-12-14|매직 립, 인코포레이티드|Visual aura around the visual field|
    WO2017189450A1|2016-04-26|2017-11-02|Magic Leap, Inc.|Electromagnetic tracking with augmented reality systems|
    US10527851B2|2016-05-06|2020-01-07|Magic Leap, Inc.|Metasurfaces with asymmetric gratings for redirecting light and methods for fabricating|
    US10684478B2|2016-05-09|2020-06-16|Mentor Acquisition One, Llc|User interface systems for head-worn computers|
    CN109414164A|2016-05-09|2019-03-01|奇跃公司|Augmented reality system and method for user health analysis|
    US10824253B2|2016-05-09|2020-11-03|Mentor Acquisition One, Llc|User interface systems for head-worn computers|
    US9922464B2|2016-05-10|2018-03-20|Disney Enterprises, Inc.|Occluded virtual image display|
    US9904058B2|2016-05-12|2018-02-27|Magic Leap, Inc.|Distributed light manipulation over imaging waveguide|
    US10466491B2|2016-06-01|2019-11-05|Mentor Acquisition One, Llc|Modular systems for head-worn computers|
    US9959678B2|2016-06-03|2018-05-01|Oculus Vr, Llc|Face and eye tracking using facial sensors within a head-mounted display|
    JP6850817B2|2016-06-03|2021-03-31|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Augmented reality identification verification|
    US10430988B2|2016-06-03|2019-10-01|Facebook Technologies, Llc|Facial animation using facial sensors within a head-mounted display|
    EP3469251B1|2016-06-10|2021-07-07|Magic Leap, Inc.|Integrating point source for texture projecting bulb|
    EP3472828A4|2016-06-20|2020-02-26|Magic Leap, Inc.|Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions|
    CN109643373A|2016-06-30|2019-04-16|奇跃公司|Estimate the posture in 3d space|
    US9996984B2|2016-07-05|2018-06-12|Disney Enterprises, Inc.|Focus control for virtual objects in augmented realityand virtual realitydisplays|
    US10922393B2|2016-07-14|2021-02-16|Magic Leap, Inc.|Deep neural network for iris identification|
    KR20190028493A|2016-07-14|2019-03-18|매직 립, 인코포레이티드|Iris boundary estimation using corneal curvature|
    CN109788901A|2016-07-25|2019-05-21|奇跃公司|Light field processor system|
    CN109791295A|2016-07-25|2019-05-21|奇跃公司|Use enhancing and the imaging of virtual reality glasses modification, display and visualization|
    US10491402B2|2016-07-29|2019-11-26|Magic Leap, Inc.|Secure exchange of cryptographically signed records|
    WO2018031621A1|2016-08-11|2018-02-15|Magic Leap, Inc.|Automatic placement of a virtual object in a three-dimensional space|
    CN109844854A|2016-08-12|2019-06-04|奇跃公司|Word flow comment|
    IL247360A|2016-08-18|2021-09-30|Veeride Ltd|Augmented reality apparatus and method|
    US9826299B1|2016-08-22|2017-11-21|Osterhout Group, Inc.|Speaker systems for head-worn computer systems|
    CA3034644A1|2016-08-22|2018-03-01|Magic Leap, Inc.|Augmented reality display device with deep learning sensors|
    TWI728175B|2016-08-22|2021-05-21|美商魔法飛躍股份有限公司|Dithering methods and apparatus for wearable display device|
    US10108013B2|2016-08-22|2018-10-23|Microsoft Technology Licensing, Llc|Indirect-view augmented reality display system|
    US10690936B2|2016-08-29|2020-06-23|Mentor Acquisition One, Llc|Adjustable nose bridge assembly for headworn computer|
    US9880441B1|2016-09-08|2018-01-30|Osterhout Group, Inc.|Electrochromic systems for head-worn computer systems|
    US9910284B1|2016-09-08|2018-03-06|Osterhout Group, Inc.|Optical systems for head-worn computers|
    WO2018052901A1|2016-09-13|2018-03-22|Magic Leap, Inc.|Sensory eyewear|
    CN112987303A|2016-09-21|2021-06-18|奇跃公司|System and method for optical system with exit pupil expander|
    CN109997174A|2016-09-22|2019-07-09|奇跃公司|Augmented reality spectrum inspection|
    US10330935B2|2016-09-22|2019-06-25|Apple Inc.|Predictive, foveated virtual reality system|
    KR102357876B1|2016-09-26|2022-01-28|매직 립, 인코포레이티드|Calibration of Magnetic and Optical Sensors in Virtual Reality or Augmented Reality Display Systems|
    JP6964132B2|2016-09-28|2021-11-10|マジック リープ, インコーポレイテッドMagic Leap, Inc.|Face model capture with wearable device|
    RU2016138608A|2016-09-29|2018-03-30|Мэджик Лип, Инк.|NEURAL NETWORK FOR SEGMENTING THE EYE IMAGE AND ASSESSING THE QUALITY OF THE IMAGE|
    WO2018064502A1|2016-09-30|2018-04-05|Visbit Inc.|View-optimized light field image and video streaming|
    EP3523751A4|2016-10-04|2020-05-06|Magic Leap, Inc.|Efficient data layouts for convolutional neural networks|
    KR20210077806A|2016-10-05|2021-06-25|매직 립, 인코포레이티드|Periocular test for mixed reality calibration|
    USD840395S1|2016-10-17|2019-02-12|Osterhout Group, Inc.|Head-worn computer|
    AU2017345780A1|2016-10-21|2019-05-02|Magic Leap, Inc.|System and method for presenting image content on multiple depth planes by providing multiple intra-pupil parallax views|
    JP6913164B2|2016-11-11|2021-08-04|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Full facial image peri-eye and audio composition|
    CN110168477A|2016-11-15|2019-08-23|奇跃公司|Deep learning system for cuboid detection|
    US10860070B2|2016-11-16|2020-12-08|Magic Leap, Inc.|Thermal management systems for wearable components|
    US11067860B2|2016-11-18|2021-07-20|Magic Leap, Inc.|Liquid crystal diffractive devices with nano-scale pattern and methods of manufacturing the same|
    KR20190078635A|2016-11-18|2019-07-04|매직 립, 인코포레이티드|The space-variable liquid crystal diffraction gratings|
    CN110178077A|2016-11-18|2019-08-27|奇跃公司|For redirecting the multilayer liquid crystal diffraction grating of the light with wide-angle range|
    US10531220B2|2016-12-05|2020-01-07|Magic Leap, Inc.|Distributed audio capturing techniques for virtual reality , augmented reality , and mixed realitysystems|
    AU2017370555A1|2016-12-05|2019-06-13|Magic Leap, Inc.|Virtual user input controls in a mixed reality environment|
    KR20180065203A|2016-12-07|2018-06-18|삼성전자주식회사|Electronic apparatus and method for displaying an image|
    KR102298018B1|2016-12-08|2021-09-02|매직 립, 인코포레이티드|Diffraction devices based on cholesteric liquid crystals|
    US10664049B2|2016-12-09|2020-05-26|Nvidia Corporation|Systems and methods for gaze tracking|
    EP3555865A4|2016-12-13|2020-07-08|Magic Leap, Inc.|3d object rendering using detected features|
    CN110291453A|2016-12-14|2019-09-27|奇跃公司|Using the soft imprinting and copying with surface alignment pattern to liquid crystal patterned|
    US10088686B2|2016-12-16|2018-10-02|Microsoft Technology Licensing, Llc|MEMS laser scanner having enlarged FOV|
    US10371896B2|2016-12-22|2019-08-06|Magic Leap, Inc.|Color separation in planar waveguides using dichroic filters|
    US11036049B2|2016-12-22|2021-06-15|Magic Leap, Inc.|Systems and methods for manipulating light from ambient light sources|
    US10746999B2|2016-12-28|2020-08-18|Magic Leap, Inc.|Dual depth exit pupil expander|
    CN106773054A|2016-12-29|2017-05-31|北京乐动卓越科技有限公司|A kind of device and method for realizing that augmented reality is interactive|
    WO2018125428A1|2016-12-29|2018-07-05|Magic Leap, Inc.|Automatic control of wearable display device based on external conditions|
    US10850116B2|2016-12-30|2020-12-01|Mentor Acquisition One, Llc|Head-worn therapy device|
    WO2018125712A1|2016-12-30|2018-07-05|Datalogic Usa, Inc.|Self-checkout with three dimensional scanning|
    USD864959S1|2017-01-04|2019-10-29|Mentor Acquisition One, Llc|Computer glasses|
    CN110431118A|2017-01-05|2019-11-08|奇跃公司|Pass through the patterning of the glass of high refractive index of plasma etching|
    WO2018129398A1|2017-01-05|2018-07-12|Digilens, Inc.|Wearable heads up displays|
    CN110462460A|2017-01-23|2019-11-15|奇跃公司|For virtual, enhancing or the eyepiece of mixed reality system|
    CA3051414A1|2017-01-27|2018-08-02|Magic Leap, Inc.|Diffraction gratings formed by metasurfaces having differently oriented nanobeams|
    US10504397B2|2017-01-31|2019-12-10|Microsoft Technology Licensing, Llc|Curved narrowband illuminant display for head mounted display|
    US10354140B2|2017-01-31|2019-07-16|Microsoft Technology Licensing, Llc|Video noise reduction for video augmented reality system|
    US10298840B2|2017-01-31|2019-05-21|Microsoft Technology Licensing, Llc|Foveated camera for video augmented reality and head mounted display|
    US11187909B2|2017-01-31|2021-11-30|Microsoft Technology Licensing, Llc|Text rendering by microshifting the display in a head mounted display|
    US9983412B1|2017-02-02|2018-05-29|The University Of North Carolina At Chapel Hill|Wide field of view augmented reality see through head mountable display with distance accommodation|
    CA3053571A1|2017-02-23|2018-08-30|Magic Leap, Inc.|Display system with variable power reflector|
    US10852542B2|2017-03-14|2020-12-01|Magic Leap, Inc.|Waveguides with light absorbing films and processes for forming the same|
    KR102302725B1|2017-03-17|2021-09-14|매직 립, 인코포레이티드|Room Layout Estimation Methods and Techniques|
    CA3057134A1|2017-03-21|2018-09-27|Magic Leap, Inc.|Methods, devices, and systems for illuminating spatial light modulators|
    JP2020514824A|2017-03-21|2020-05-21|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Eye imaging device using diffractive optical element|
    JP2020512584A|2017-03-21|2020-04-23|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Thin beam splitter|
    US11269144B2|2017-03-21|2022-03-08|Magic Leap, Inc.|Stacked waveguides having different diffraction gratings for combined field of view|
    CN110651211A|2017-03-21|2020-01-03|奇跃公司|Display system with spatial light modulator illumination for split pupils|
    EP3603055B1|2017-03-21|2022-03-02|Magic Leap, Inc.|Depth sensing techniques for virtual, augmented, and mixed reality systems|
    US10891488B2|2017-03-30|2021-01-12|Hrl Laboratories, Llc|System and method for neuromorphic visual activity classification based on foveated detection and contextual filtering|
    EP3746938A4|2018-01-30|2021-10-06|HRL Laboratories, LLC|System and method for neuromorphic visual activity classification based on foveated detection and contextual filtering|
    US10417975B2|2017-04-03|2019-09-17|Microsoft Technology Licensing, Llc|Wide field of view scanning display|
    US10921593B2|2017-04-06|2021-02-16|Disney Enterprises, Inc.|Compact perspectively correct occlusion capable augmented reality displays|
    US10499021B2|2017-04-11|2019-12-03|Microsoft Technology Licensing, Llc|Foveated MEMS scanning display|
    WO2018194987A1|2017-04-18|2018-10-25|Magic Leap, Inc.|Waveguides having reflective layers formed by reflective flowable materials|
    CN110785688B|2017-04-19|2021-08-27|奇跃公司|Multi-modal task execution and text editing for wearable systems|
    US11112932B2|2017-04-27|2021-09-07|Magic Leap, Inc.|Light-emitting user input device|
    EP3908026A1|2017-05-22|2021-11-10|Magic Leap, Inc.|Pairing with companion device|
    CA3059984A1|2017-05-30|2018-12-06|Magic Leap, Inc.|Power supply assembly with fan assembly for electronic device|
    AU2018277842A1|2017-05-31|2019-12-19|Magic Leap, Inc.|Eye tracking calibration techniques|
    WO2018231784A1|2017-06-12|2018-12-20|Magic Leap, Inc.|Augmented reality display having multi-element adaptive lens for changing depth planes|
    US10810773B2|2017-06-14|2020-10-20|Dell Products, L.P.|Headset display control based upon a user's pupil state|
    KR102314789B1|2017-06-29|2021-10-20|에스케이텔레콤 주식회사|Apparatus for displaying augmented reality contents|
    US10859834B2|2017-07-03|2020-12-08|Holovisions|Space-efficient optical structures for wide field-of-view augmented realityeyewear|
    US10338400B2|2017-07-03|2019-07-02|Holovisions LLC|Augmented reality eyewear with VAPE or wear technology|
    US10908680B1|2017-07-12|2021-02-02|Magic Leap, Inc.|Pose estimation using electromagnetic tracking|
    CN107167921B|2017-07-18|2020-01-21|京东方科技集团股份有限公司|Display device|
    US10422995B2|2017-07-24|2019-09-24|Mentor Acquisition One, Llc|See-through computer display systems with stray light management|
    US10578869B2|2017-07-24|2020-03-03|Mentor Acquisition One, Llc|See-through computer display systems with adjustable zoom cameras|
    JP2020528597A|2017-07-26|2020-09-24|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Neural network training using user interface device representations|
    WO2019023489A1|2017-07-28|2019-01-31|Magic Leap, Inc.|Fan assembly for displaying an image|
    US10969584B2|2017-08-04|2021-04-06|Mentor Acquisition One, Llc|Image expansion optic for head-worn computer|
    US10976551B2|2017-08-30|2021-04-13|Corning Incorporated|Wide field personal display device|
    US10521661B2|2017-09-01|2019-12-31|Magic Leap, Inc.|Detailed eye shape model for robust biometric applications|
    CA3068481A1|2017-09-20|2019-03-28|Magic Leap, Inc.|Personalized neural network for eye tracking|
    EP3688516A4|2017-09-27|2021-06-23|Magic Leap, Inc.|Near eye 3d display with separate phase and amplitude modulators|
    US10867368B1|2017-09-29|2020-12-15|Apple Inc.|Foveated image capture for power efficient video see-through|
    EP3698214A4|2017-10-16|2021-10-27|Digilens Inc.|Systems and methods for multiplying the image resolution of a pixelated display|
    CA3079221A1|2017-10-26|2019-05-02|Magic Leap, Inc.|Broadband adaptive lens assembly for augmented reality display|
    WO2019084322A1|2017-10-26|2019-05-02|Magic Leap, Inc.|Augmented reality display having liquid crystal variable focus element and roll-to-roll method and apparatus for forming the same|
    JP2021501397A|2017-10-27|2021-01-14|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Virtual reticle for augmented reality systems|
    KR20200087780A|2017-11-14|2020-07-21|매직 립, 인코포레이티드|Meta-learning for multi-task learning on neural networks|
    EP3724712A4|2017-12-11|2021-08-04|Magic Leap, Inc.|Waveguide illuminator|
    EP3723580A4|2017-12-15|2021-09-08|Magic Leap, Inc.|Eyepieces for augmented reality display system|
    JP2021509495A|2017-12-15|2021-03-25|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Improved posture determination for display devices|
    TWI647485B|2018-01-03|2019-01-11|國立交通大學|Head-mounted virtual object imaging device|
    AU2018400510A1|2018-01-04|2020-07-02|Magic Leap, Inc.|Optical elements based on polymeric structures incorporating inorganic materials|
    WO2019135796A1|2018-01-08|2019-07-11|Digilens, Inc.|Systems and methods for high-throughput recording of holographic gratings in waveguide cells|
    US10914950B2|2018-01-08|2021-02-09|Digilens Inc.|Waveguide architectures and related methods of manufacturing|
    WO2019143864A1|2018-01-17|2019-07-25|Magic Leap, Inc.|Display systems and methods for determining registration between a display and a user's eyes|
    WO2019143844A1|2018-01-17|2019-07-25|Magic Leap, Inc.|Eye center of rotation determination, depth plane selection, and render camera positioning in display systems|
    US10540941B2|2018-01-30|2020-01-21|Magic Leap, Inc.|Eclipse cursor for mixed reality displays|
    US20190250407A1|2018-02-15|2019-08-15|Microsoft Technology Licensing, Llc|See-through relay for a virtual reality and a mixed environment display device|
    US10735649B2|2018-02-22|2020-08-04|Magic Leap, Inc.|Virtual and augmented reality systems and methods using display system control information embedded in image data|
    WO2019168673A1|2018-02-27|2019-09-06|Magic Leap, Inc.|Matching meshes for virtual avatars|
    CA3090817A1|2018-03-05|2019-09-12|Magic Leap, Inc.|Display system with low-latency pupil tracker|
    NZ757418A|2018-03-07|2020-06-26|Magic Leap Inc|Visual tracking of peripheral devices|
    US10878620B2|2018-03-14|2020-12-29|Magic Leap, Inc.|Display systems and methods for clipping content to increase viewing comfort|
    EP3766004A4|2018-03-16|2021-12-15|Magic Leap, Inc.|Facial expressions from eye-tracking cameras|
    EP3765943A4|2018-03-16|2021-12-22|Magic Leap, Inc.|Depth based foveated rendering for display systems|
    US10690851B2|2018-03-16|2020-06-23|Digilens Inc.|Holographic waveguides incorporating birefringence control and methods for their fabrication|
    US11067805B2|2018-04-19|2021-07-20|Magic Leap, Inc.|Systems and methods for operating a display system based on user perceptibility|
    US10789753B2|2018-04-23|2020-09-29|Magic Leap, Inc.|Avatar facial expression representation in multidimensional space|
    US11257268B2|2018-05-01|2022-02-22|Magic Leap, Inc.|Avatar animation using Markov decision process policies|
    JP2021524627A|2018-05-22|2021-09-13|マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ．|Skeletal system for animating virtual avatars|
    WO2019226691A1|2018-05-22|2019-11-28|Magic Leap, Inc.|Transmodal input fusion for a wearable system|
    WO2019236344A1|2018-06-07|2019-12-12|Magic Leap, Inc.|Augmented reality scrollbar|
    US10986270B2|2018-06-18|2021-04-20|Magic Leap, Inc.|Augmented reality display with frame modulation functionality|
    US11151793B2|2018-06-26|2021-10-19|Magic Leap, Inc.|Waypoint creation in map detection|
    US20210185303A1|2018-07-05|2021-06-17|Pcms Holdings, Inc.|Method and system for near-eye focal plane overlays for 3d perception of content on 2d displays|
    US11106033B2|2018-07-05|2021-08-31|Magic Leap, Inc.|Waveguide-based illumination for head mounted display system|
    USD924204S1|2018-07-24|2021-07-06|Magic Leap, Inc.|Totem controller having an illumination region|
    USD930614S1|2018-07-24|2021-09-14|Magic Leap, Inc.|Totem controller having an illumination region|
    USD918176S1|2018-07-24|2021-05-04|Magic Leap, Inc.|Totem controller having an illumination region|
    US11067808B2|2018-07-24|2021-07-20|Magic Leap, Inc.|Diffractive optical elements with mitigation of rebounce-induced light loss and related systems and methods|
    WO2020023404A1|2018-07-24|2020-01-30|Magic Leap, Inc.|Flicker mitigation when toggling eyepiece display illumination in augmented reality systems|
    US10950024B2|2018-07-27|2021-03-16|Magic Leap, Inc.|Pose space dimensionality reduction for pose space deformation of a virtual character|
    US11002971B1|2018-08-24|2021-05-11|Apple Inc.|Display device with mechanically adjustable optical combiner|
    US11141645B2|2018-09-11|2021-10-12|Real Shot Inc.|Athletic ball game using smart glasses|
    US11103763B2|2018-09-11|2021-08-31|Real Shot Inc.|Basketball shooting game using smart glasses|
    USD934873S1|2018-09-18|2021-11-02|Magic Leap, Inc.|Mobile computing support system having an illumination region|
    USD934872S1|2018-09-18|2021-11-02|Magic Leap, Inc.|Mobile computing support system having an illumination region|
    US10861240B1|2018-09-26|2020-12-08|Facebook Technologies, Llc|Virtual pupil camera in head mounted display|
    EP3871034A2|2018-10-26|2021-09-01|Magic Leap, Inc.|Ambient electromagnetic distortion correction for electromagnetic tracking|
    US11237393B2|2018-11-20|2022-02-01|Magic Leap, Inc.|Eyepieces for augmented reality display system|
    US10939977B2|2018-11-26|2021-03-09|Augmedics Ltd.|Positioning marker|
    JP2022510843A|2018-11-30|2022-01-28|マジック リープ， インコーポレイテッド|Multimode hand location and orientation for avatar movement|
    JP2020122895A|2019-01-31|2020-08-13|株式会社リコー|Imaging device|
    US20200292816A1|2019-03-13|2020-09-17|Hong Kong Applied Science And Technology Research Institute Co., Ltd.|Compact optical structure design for large field of view optical see through head mounted display|
    US10554940B1|2019-03-29|2020-02-04|Razmik Ghazaryan|Method and apparatus for a variable-resolution screen|
    US10466489B1|2019-03-29|2019-11-05|Razmik Ghazaryan|Methods and apparatus for a variable-resolution screen|
    US11016305B2|2019-04-15|2021-05-25|Magic Leap, Inc.|Sensor fusion for electromagnetic tracking|
    CN110913096A|2019-05-05|2020-03-24|华为技术有限公司|Camera module and electronic equipment|
    TWI707193B|2019-05-22|2020-10-11|財團法人國家實驗研究院|Focal plane assembly of remote sensing satellite and image processing method thereof|
    US11029805B2|2019-07-10|2021-06-08|Magic Leap, Inc.|Real-time preview of connectable objects in a physically-modeled virtual space|
    US20210088774A1|2019-09-24|2021-03-25|Rockwell Collins, Inc.|Point Source Detection|
    US11176757B2|2019-10-02|2021-11-16|Magic Leap, Inc.|Mission driven virtual character for user interaction|
    WO2021070970A1|2019-10-12|2021-04-15|国立大学法人奈良先端科学技術大学院大学|See-through display device|
    KR102244445B1|2019-11-22|2021-04-26|인하대학교 산학협력단|Apparatus and method for occlusion capable near-eye display for augmented reality using single dmd|
    USD941353S1|2019-12-09|2022-01-18|Magic Leap, Inc.|Portion of a display screen with transitional graphical user interface for guiding graphics|
    USD940749S1|2019-12-09|2022-01-11|Magic Leap, Inc.|Portion of a display screen with transitional graphical user interface for guiding graphics|
    USD940748S1|2019-12-09|2022-01-11|Magic Leap, Inc.|Portion of a display screen with transitional graphical user interface for guiding graphics|
    USD941307S1|2019-12-09|2022-01-18|Magic Leap, Inc.|Portion of a display screen with graphical user interface for guiding graphics|
    USD940189S1|2019-12-09|2022-01-04|Magic Leap, Inc.|Portion of a display screen with transitional graphical user interface for guiding graphics|
    CN111077679A|2020-01-23|2020-04-28|福州贝园网络科技有限公司|Intelligent glasses display and imaging method thereof|
    USD936704S1|2020-01-27|2021-11-23|Magic Leap, Inc.|Portion of a display screen with avatar|
    WO2021154437A1|2020-01-27|2021-08-05|Magic Leap, Inc.|Gaze timer based augmentation of functionality of a user input device|
    CN111580280A|2020-06-16|2020-08-25|京东方科技集团股份有限公司|See-through head mounted display|
    法律状态:
    2020-11-03| B08F| Application dismissed because of non-payment of annual fees [chapter 8.6 patent gazette]|Free format text: REFERENTE A 7A ANUIDADE. |
    2021-02-23| B08K| Patent lapsed as no evidence of payment of the annual fee has been furnished to inpi [chapter 8.11 patent gazette]|Free format text: EM VIRTUDE DO ARQUIVAMENTO PUBLICADO NA RPI 2600 DE 03-11-2020 E CONSIDERANDO AUSENCIA DE MANIFESTACAO DENTRO DOS PRAZOS LEGAIS, INFORMO QUE CABE SER MANTIDO O ARQUIVAMENTO DO PEDIDO DE PATENTE, CONFORME O DISPOSTO NO ARTIGO 12, DA RESOLUCAO 113/2013. |
    2021-12-07| B350| Update of information on the portal [chapter 15.35 patent gazette]|
    优先权:
    申请号 | 申请日 | 专利标题
    US201261620574P| true| 2012-04-05|2012-04-05|
    US201261620581P| true| 2012-04-05|2012-04-05|
    US61/620,581|2012-04-05|
    US61/620,574|2012-04-05|
    PCT/US2013/035486|WO2014011266A2|2012-04-05|2013-04-05|Apparatus for optical see-through head mounted display with mutual occlusion and opaqueness control capability|
    [返回顶部]