• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    A device is described with a detection unit (1) for the position and position of a first limb of a user (3) and with a display device (4) for displaying a second limb (5). In order to design a device of the type described in the introduction in such a way that the movement space for the two limbs of the user is expanded and at the same time an interaction between the two limbs but also between one of the limbs and a virtual three-dimensional object is made possible, it is proposed that the display device be stereoscopic is formed with the detection unit and a common reference plane as a reference system, that for displaying the stereoscopic display device, a first generator for a position and position of the first limb around the reference plane mirrored virtual second limb and a second generator for a three-dimensional interaction object for display a predetermined position and position relative to the reference plane is provided and that the device is a collision detection unit for outputting a signal upon detection of a collision between the virtual second n limb and the virtual three-dimensional interaction object.
    公开号:AT520385A1
    申请号:T600472017
    申请日:2017-06-07
    公开日:2019-03-15
    发明作者:
    申请人:
    IPC主号:
    专利说明:

    Summary
    The invention relates to a device with a detection unit (1) for the position and location of a first limb of a user (3) and with a display device (4) for displaying a second limb (5). In order to design a device of the type described in the introduction in such a way that the range of motion for the two limbs of the user is expanded and at the same time an interaction between the two limbs but also between one of the limbs and a virtual three-dimensional object is made possible, it is proposed that the display device be stereoscopic is formed and has a common reference plane as the reference system with the detection unit, that for display via the stereoscopic display device a first generator for a virtual second limb mirrored with respect to the position and position of the first limbs around the reference plane and a second generator for a three-dimensional interaction object for display a predetermined position and position relative to the reference plane is provided and that the device has a collision detection unit for outputting a signal upon detection of a collision between the virtual second n limb and the virtual three-dimensional interaction object.
    (Fig. 1) / 14 (41505) E1 / IV
    A device is described with a detection unit for the position and location of a first limb of a user and with a display device for displaying a second limb.
    For use in mirror therapy, devices are known (US 20150313793 A1) which detect a position and a position of a first limb with the aid of a detection unit, in this case a camera, and a virtual second limb which is created by mirroring the captured image on a display device represent. The disadvantage of this, however, is that the possible range of motion is severely restricted because the second limb of the user must always be below the display device or the virtual second limb must always be within the display device so that the effect of the mirror therapy is retained. In particular, this technical solution does not offer the possibility of interacting with both limbs.
    The invention is therefore based on the object of designing a device of the type described at the outset in such a way that the range of motion for the two limbs of the user is expanded and at the same time an interaction between the two limbs but also between one of the limbs and a virtual three-dimensional object is made possible.
    The object of the invention is achieved in that the display device is stereoscopic and has a common reference plane as the reference system with the detection unit, and for the display via the stereoscopic display device a first generator for a virtual second mirrored with respect to the position and location of the first limbs around the reference plane Limbs and
    2/14 a second generator for a three-dimensional interaction object is provided for display at a position and position predetermined with respect to the reference plane and that the device has a collision detection unit for outputting a signal upon detection of a collision between the virtual second limb and the virtual three-dimensional interaction object. As a result of these measures, the user is largely free to move the first limb as long as it is within the detection range of the detection unit. In this context, it is particularly advantageous that the display device and the detection unit have a common reference plane as the reference system, which preferably coincides with the sagittal plane of the user or more precisely the head of the user. This can be achieved, for example, in that the stereoscopic display device is worn by the user in the form of glasses and thus the central plane of the stereoscopic display device coincides with the sagittal plane of the user and thus with the common reference plane and by the detection unit being centered on this display device in the Reference plane is arranged. Of course, the detection unit can also be arranged to deviate from this reference plane, provided that the relative position of the detection unit to the reference plane is known as the reference system. The same applies in principle to the stereoscopic display device, so that stationary stereoscopic display devices are also conceivable, but there is a particular advantage in that the stereoscopic display device as glasses itself essentially coincides with the sagittal plane of the user with its central plane. The stereoscopic display device can be designed in such a way that the first limb of the user remains visible through the display device, while the second limb of the user is blended by a virtual second limb, so that from the user's point of view the second limb is no longer in the real world is visible. However, both the first and the second limb of the user can also be displayed in a common virtual space via the stereoscopic display device. In order in particular to be able to train the fine motor skills of the user, a second generator for a three-dimensional interaction object is also provided, which the user can use via the stereoscopic
    3/14
    Display device is displayed at a predetermined position and position relative to the reference plane. In order to be able to provide the user with feedback about the interaction with the three-dimensional interaction object, a collision detection unit is also provided for outputting a signal upon detection during the collision between the virtual second limb and the virtual three-dimensional interaction object. The collision detection unit can also be expanded to also detect collisions between the first limb and the second limb or the first limb and the virtual three-dimensional interaction object. The signal output by the detection unit can be optically displayed to the user directly via the stereoscopic display device, or else can be converted into an auditory or tactile signal for the user. For the sake of completeness, it should be pointed out that a limb is understood to mean a limb column and / or limb tip, that is to say an upper arm or forearm, thigh or lower leg and / or hand or foot.
    So far, it has been assumed that the user cannot use the second limb or can only use it to an extremely limited extent. If, however, there is measurable muscle activity, sensors for detecting the electromyogram of muscle groups of the second limb of the user can be provided, which are connected via a control unit to the first generator for changing the position and location of the virtual second limb as a function of the detected action potentials. The generated, mirrored virtual second limb can be changed in position and location based on the mirrored model depending on the recorded electromyogram, so that the user has the impression that the virtual second limb is actually in the virtual with the muscle groups he is controlling Space moves. This has the advantage over the known devices that the mirror therapy can be expanded by a direct feedback for the user, so that preliminary exercises for controlling a prosthesis or the like can be carried out. In addition, the posture of the limb itself can be changed based on the recorded action potential, in particular
    4/14 especially when the model of the virtual second limb is designed as a kinematic model of individual limb parts.
    In order to create a realistic impression for the user, the collision detection unit can be connected to the first generator to change the position and location of the virtual second limb depending on the detected collisions. As a result, not only can the virtual three-dimensional interaction object with the two limbs be moved or shifted, but also the virtual second limb can be shifted through an imaginary exertion of force through the first limb or the virtual object, unless, for example, through a corresponding action potential an imaginary back pressure is generated as described above.
    In order to create a complete virtual interaction experience for the user, it is proposed that the detection unit comprise a depth sensor with which the first generator for generating a virtual model of the second limb at a position and position of the first limb mirrored around the reference plane as a virtual second limb connected is. In this case, neither the first nor the second limb are visible to the user, but only virtual models of these first and second limbs, which are displayed in a virtual space via the stereoscopic display device. The fact that the first limb is completely known in terms of its spatial position by the depth sensor in this case results in significantly more interaction possibilities. For example, in combination with the acquisition of the electromyogram of muscle groups of the second limb, an interaction for the user can also be represented, in which both limbs are at different depths, which is impossible with a previously known mirror therapy.
    In order to avoid complex menu navigation, the first generator can have an interaction element memory and can be connected to a gesture recognition unit for selecting one of the interaction elements from the interaction element memory depending on the recognized gesture. Through this
    5/14
    Measures can be displayed to the user depending on the posture of the first limb, a virtual three-dimensional interaction element corresponding to this gesture, for example a pliers grip, which is best suited for an interaction, for example, for the posture of the limb.
    The invention also relates to a method for operating the device according to the invention, in which the position and position of a first limb of a user in relation to a reference plane corresponding to the sagittal plane of the user is recorded and fed to a first generator which changes the position and position of the first limb the reference plane generates mirrored virtual second limbs for display via a stereoscopic display device, a second generator generating a three-dimensional interaction object at a position and position predefined with respect to the reference plane and a collision detection unit when a collision is detected between the virtual second limb and the virtual three-dimensional interaction object Outputs signals.
    In this context, particularly advantageous operating properties result when the second generator only generates the three-dimensional interaction element when the first and / or second limb falls below a predetermined minimum distance from the reference plane. It is also possible to generate the three-dimensional interaction element only after a collision between the first and second limbs.
    As already mentioned above, a gesture recognition unit can be provided which recognizes the gesture carried out with the first or second limb and the second generator selects a three-dimensional interaction element from an interaction element memory as a function of the recognized gesture for display.
    The subject matter of the invention is shown in the drawing, for example. Show it
    Fig. 1 shows a device operated by a user according to the invention in a schematic plan view
    6/14
    Fig. 2 is a schematic view of the display shown to the user in a two-dimensional simplified representation.
    A device according to the invention comprises a detection unit 1 for the position and location of a first limb 2 of a user 3 and a stereoscopic display device 4 for displaying a virtual second limb 5. The detection unit 1 and the stereoscopic display device 4 have a common reference plane 6 as a reference system. The virtual second limb 5 is generated by a first generator 7, which is connected to the detection unit 1 for this purpose. In addition, a second generator 8 is provided for a three-dimensional interaction object 9. To detect a collision between the virtual second limb 5 and the virtual three-dimensional interaction object 9, a collision detection unit 10 is provided, which outputs a signal via a loudspeaker 11 when a collision is detected. For this purpose, the collision detection unit 10 is connected both to the first generator 7 and to the second generator 8. A display control unit 12 is provided for the stereoscopic display device 4, which processes the output signals of the first generator 7 and the second generator 8 and thus controls the stereoscopic display device 4.
    In order to be able to change the position and position of the virtual second limb 5 depending on the action potentials of individual muscle groups of the real second limb 13, in a preferred embodiment the device according to the invention comprises sensors 14 for detecting the electromyogram of muscle groups of the second limb 13, the sensors 14 are connected via a control unit 15 to the first generator 7 for changing the position and location of the virtual second limb 5 as a function of the action potentials detected by the sensors 14.
    The collision detection unit 10 can also be connected to the first generator 7 in order to change the position and position of the virtual second limb 5 as a function of detected collisions.
    7/14
    In the exemplary embodiment shown, the detection unit 1 also comprises a depth sensor, not shown in more detail, which is also connected to the first generator 7. This therefore not only generates a virtual model of the second limb 5, but also a virtual model of the first limb 16, so that the user in the stereoscopic view has a complete virtual space with a first virtual limb 16, a second virtual limb 5 and one virtual three-dimensional interaction element 9 results.
    In order to be able to select an interaction element from an interaction element memory (not shown in more detail) as a function of a gesture, the first generator 7 is connected to a gesture recognition unit 17, which either uses the detection unit 1 or already the models of the first or second limbs 5, 16 generated by User with the respective limb gesture recognizes, whereupon the first generator selects a corresponding virtual interaction element 9 depending on the recognized gesture.
    8/14
    Patent attorneys
    Dipl.-Ing. Helmut Hübscher
    Dipl.-Ing. Gerd pretty
    Dipl.-Ing. Karl Winfried Hellmich
    Spittelwiese 4, 4020 Linz (41505) E1 / IV
    权利要求:
    Claims (13)
    [1]
    1. Device with a detection unit (1) for the position and location of a first limb of a user (3) and with a display device (4) for displaying a second limb (5), characterized in that the display device (4) is stereoscopic and with the detection unit (1) has a common reference plane (6) as a reference system, that for display via the stereoscopic display device (4) a first generator (7) for a position and position of the first limb (2) around the reference plane (6 ) mirrored virtual second limb and a second generator (8) is provided for a three-dimensional interaction object for display at a position and position predetermined with respect to the reference plane (6) and that the device has a collision detection unit (10) for outputting a signal upon detection of a collision between the virtual second limb and the virtual three-dimensional interaction object st.
    [2]
    2. Device according to claim 1, characterized in that sensors for detecting the electromyogram of muscle groups of the second limb of the user (3) are provided, which via a control unit with the first generator (7) for changing the position and location of the virtual second limb depending on the recorded action potentials.
    [3]
    3. Device according to claim 1 or 2, characterized in that the collision detection unit (10) for changing the position and location of the virtual second limb depending on the detected collisions is connected to the first generator (7).
    [4]
    4. Device according to one of claims 1 to 3, characterized in that the detection unit (1) comprises a depth sensor with which the first generator (7) for generating a virtual model of the second limb (5) on one around the reference plane (6 ) mirrored position and location of the first limb (2) is connected as a virtual second limb (5).
    [5]
    5. Device according to one of claims 1 to 4, characterized in that the first generator (7) has an interaction element memory and is connected to a gesture recognition unit (17) for selecting one of the interaction elements from the interaction element memory depending on the recognized gesture.
    [6]
    6. The method for operating a device according to one of claims 1 to 5, characterized in that the position and position of a first limb (2) of a user (3) in relation to a sagittal plane of the user (3) corresponding reference plane (6) and a first generator (7) is supplied, which generates a virtual second limb (5) mirrored with respect to the position and position of the first limb (2) around the reference plane (6) for display via a stereoscopic display device (4), a second generator (8) generates a three-dimensional interaction object at a predetermined position and position with respect to the reference plane (6) and wherein a collision detection unit (10) outputs a signal upon detection of a collision between the virtual second limb (5) and the virtual three-dimensional interaction object.
    [7]
    7. The method according to claim 6, characterized in that the second generator (7, 8) generates the three-dimensional interaction element (9) only when the first and / or second limbs (2, 5) a predetermined minimum distance from the reference plane (6) falls below.
    [8]
    8. The method according to claim 5 or 6, characterized in that a gesture recognition unit (17) recognizes the gesture performed with the first or second limb (2, 5) and the second generator (8) a three-dimensional
    [9]
    9/14
    [10]
    10/14
    Interaction element (9) from an interaction element memory depending on the recognized gesture for display.
    [11]
    11/14
    FIG. 1
    [12]
    12/14
    [13]
    13/14
    FIG. 2nd
    类似技术:
    公开号 | 公开日 | 专利标题
    EP3067874A1|2016-09-14|Method and device for testing a device operated in an aircraft
    DE102016212236A1|2018-01-11|Interaction system and procedure
    EP1569823A1|2005-09-07|Method and device for determining a three-dimension position of passengers of a motor car
    DE102005022005B4|2014-10-30|Method and device for facilitating the movement control of body parts
    AT520385B1|2020-11-15|Device with a detection unit for the position and posture of a first limb of a user
    EP1665023B1|2012-04-04|Method and device for controlling a virtual reality graphic system using interactive techniques
    DE102015003884A1|2016-09-29|Motor vehicle simulation arrangement for simulating a virtual environment with at least a part of a virtual motor vehicle and method for setting a motor vehicle simulation arrangement
    WO2008058783A1|2008-05-22|Integrated circuit for recognizing movements of persons
    EP3394660B1|2020-05-13|Method for operating a virtual reality system, and virtual reality system
    DE102015102459B4|2016-11-03|Method and device for driving a simulator
    WO2010015305A1|2010-02-11|Method for visualizing multi-channel signals
    EP2827224A1|2015-01-21|Method and device for tactile interaction with visualised data
    EP3307159B1|2020-04-08|Method and device for determining a desired movement of a limb
    DE102016205849B4|2020-08-27|Virtual reality system and method for operating such
    EP2148261A1|2010-01-27|Method and device for informing a user about the position of an information source compared with the user's position
    DE102004032079A1|2006-01-26|Environmental images displaying device, has heat variable tracers arranged in receiver, where tracers are provided with information and are reciprocatably effected by frequency or amplitude modulation using electronic controller
    EP3234733B1|2018-10-10|Method for controlling a vehicle system
    EP2653272A1|2013-10-23|Operating method for a computer to program the movements of a maschine
    DE102015003881A1|2016-09-29|A method for providing a simulation of a virtual environment with at least a part of a motor vehicle and motor vehicle simulation arrangement
    DE102020111179B3|2021-08-12|Method for controlling a robot and system
    DE102016008348B3|2018-01-11|Control of a training movement
    DE112019005223T5|2021-07-08|Vigilance maintenance device, control device and program
    AT503007B1|2009-12-15|METHOD AND ARRANGEMENT FOR SHAPING A SUBJECT
    EP3090787B1|2019-07-03|Toy doll and set comprising a toy doll and a receiving device
    DE102017218631A1|2019-04-18|Man-machine interface and method of operating such
    同族专利:
    公开号 | 公开日
    EP3634229A1|2020-04-15|
    WO2018223163A1|2018-12-13|
    AT520385B1|2020-11-15|
    US20200146618A1|2020-05-14|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    DE102010006301A1|2010-01-30|2011-04-21|Deutsches Zentrum für Luft- und Raumfahrt e.V.|Device for reducing phantom pain during amputate, has computing device for controlling model of amputee member based on movement of member, and feedback device for producing feedback based on computed movements of model|
    US20150054850A1|2013-08-22|2015-02-26|Seiko Epson Corporation|Rehabilitation device and assistive device for phantom limb pain treatment|
    WO2015034308A1|2013-09-09|2015-03-12|울산대학교 산학협력단|Pain treatment apparatus for diseases in body with external symmetry|
    US20150242998A1|2014-02-26|2015-08-27|Seiko Epson Corporation|Display system, health apparatus, and display control method|
    US20160263345A1|2014-03-13|2016-09-15|Gary Stephen Shuster|Treatment of Phantom Limb Syndrome and Other Sequelae of Physical Injury|
    KR20160092836A|2015-01-28|2016-08-05|울산대학교 산학협력단|Using virtual reality therapy apparatus for pain treatment of physical asymmetry|
    US20160249008A1|2015-02-24|2016-08-25|Seiko Epson Corporation|Display apparatus, display method, and program|
    JP4025230B2|2003-03-31|2007-12-19|株式会社東芝|Pain treatment support device and method for displaying phantom limb images in a virtual space|
    WO2015094112A1|2013-12-20|2015-06-25|Integrum Ab|System and method for neuromuscular rehabilitation comprising predicting aggregated motions|GB202006090D0|2020-04-24|2020-06-10|Secr Defence|Training Device|
    法律状态:
    优先权:
    申请号 | 申请日 | 专利标题
    AT600472017A|AT520385B1|2017-06-07|2017-06-07|Device with a detection unit for the position and posture of a first limb of a user|AT600472017A| AT520385B1|2017-06-07|2017-06-07|Device with a detection unit for the position and posture of a first limb of a user|
    PCT/AT2018/050011| WO2018223163A1|2017-06-07|2018-05-17|Device with a detection unit for the position and orientation of a first limb of a user|
    US16/619,384| US20200146618A1|2017-06-07|2018-05-17|Device with a detection unit for the position and orientation of a first limb of a user|
    EP18729547.2A| EP3634229A1|2017-06-07|2018-05-17|Device with a detection unit for the position and orientation of a first limb of a user|
    [返回顶部]