• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The general field of the invention is that of the methods of graphical representation of a first image (EVS) resulting from an image sensor of the external landscape superimposed on a second image (SVS) representing a synthetic image of the same external landscape. , the two images being displayed on a display screen of an aircraft visualization system. The first image comprises three rectangular zones (Z1, Z2, Z3) of increasing transparency, each zone having a width equal to that of the first image and a determined height, the sum of the three heights being equal to the height of the first image, the first area at the bottom of the image having a first constant level of transparency, the third area at the top of the image having a second constant level of transparency greater than the first level of transparency, the second area between the first area and the second zone having a continuously variable transparency level between the first level and the second level.
    公开号:FR3046282A1
    申请号:FR1502679
    申请日:2015-12-23
    公开日:2017-06-30
    发明作者:Thierry Ganille；Johanna Lux；Baptiste Perrin；Daniel Maulet
    申请人:Thales SA；
    IPC主号:
    专利说明:

    Method for graphically representing an image from an image sensor superimposed on a second synthetic image of the external landscape
    The field of the invention is that of human-system interfaces for aeronautical applications, and more particularly that of visualization systems combining real image from one or more sensors, and a synthetic image. These systems are known by the acronym "CVS", meaning "Combined Vision System".
    Modern aircraft generally have a first synthetic vision system called "SVS", which stands for "Synthetic Vision System". This system makes it possible to present to the crew a synthetic image of the external landscape generally comprising information on the piloting or the navigation. An SVS system comprises a cartographic database representative of the terrain overflown, a geolocation system and electronic calculation means. The displayed image is a three-dimensional view of the exterior shown in the most realistic way possible.
    These aircraft also have a second visualization system called "EVS", an acronym for "Enhanced Vision System". This second system comprises one or more sensors that can be optical sensors in the visible or infrared range or intensified imaging, or lidars or radars. The image is usually processed. The combined image from SVS and EVS images is called CVS. It is displayed on the display screens that are on the front panel of the aircraft dashboard. The viewpoint displayed is in the axis of the device. The CVS image is an interesting solution to carry out operations known as EVO, acronym of Equivalent Visual Operations for aircraft operating in instrument flight, IFR flight for Instrument Flight Rules or to improve safety of aircraft operating in visual flight, "VFR" flight with a degraded visual environment, VFR being the acronym for "Visual flight
    Rules ". The SVS image improves the situational awareness of the distant terrain while the EVS image does so for the near terrain, making the combination of the two images particularly relevant.
    Superimposing SVS and EVS images is not necessarily simple. One of the possible solutions consists in superimposing the entire EVS image on the SVS, thus masking a useful part of the SVS, possibly with an SVS registration on the EVS by identifying a remarkable element such as an airstrip, which limits the use cases to, for example, landing on the runway. A second solution is to display the EVS image only below the horizon and to display the SVS image only above the horizon. This all-or-nothing solution does not always take advantage of the full potential of both images. A third solution consists in detecting the zones with a contrast greater than a threshold in the EVS image and superimposing only these zones on the SVS image. Here again, the risk of loss of useful information is not negligible.
    The method according to the invention does not have the disadvantages of the previous solutions. The method is based on cutting the EVS image into three distinct parts. The lower part of the EVS image has maximum opacity and can potentially completely mask the SVS image, the upper part of the EVS image has minimal opacity and the middle part presents the EVS image with an opacity gradient between the maximum value at the bottom and the minimum at the top. More specifically, the subject of the invention is a method of graphically representing a first image derived from an image sensor of the external landscape superimposed on a second image representing a synthetic image of the same external landscape, the two images being displayed. on a display screen of an aircraft visualization system, characterized in that the first image comprises three rectangular zones of increasing transparency, each zone having a width equal to that of the first image and a determined height, the sum of the three heights being equal to the height of the first image, the first zone situated at the bottom of the image having a first constant level of transparency, the third zone situated at the top of the image having a second constant level of transparency greater than the first level of transparency, the second zone located between the first zone and the second zone having a level of t continuously variable ransparency between the first level and the second level.
    Advantageously, the height of the first zone represents 30% of the height of the image, the height of the second zone represents 50% of the height of the image and the height of the third zone represents 20% of the height of the image. 'picture.
    Advantageously, the first level of transparency is zero or close to zero and in that the second level of transparency is close to 100%.
    Advantageously, the law of variation of the level of transparency of the second zone is linear.
    Advantageously, the heights of the three zones are adjustable manually by a user.
    Advantageously, the heights of the three zones are automatically adjustable by the avionics system on board according to the flight phase of the aircraft.
    Advantageously, the heights of the three zones are automatically adjustable by the avionics system according to one or more parameters of the aircraft such as pitch, altitude or radio altitude.
    Advantageously, the heights of the three zones are automatically adjustable by the avionics system on the basis of a distance from the terrain in the sensor field calculated from the terrain database.
    Advantageously, the heights of the three zones are automatically adjustable by the avionics system according to the visibility limit of the image sensor.
    Advantageously, the first level of transparency and / or the second level of transparency vary as a function of the altitude of the aircraft when the aircraft is rising, so that the first image is more and more transparent as a function of the altitude, the transparency level changes starting at a first low altitude threshold and ending at a second high altitude threshold, the first image being completely transparent at this second threshold.
    Advantageously, the first level of transparency and / or the second level of transparency vary as a function of the altitude of the aircraft when the aircraft descends, so that the first image is more and more opaque as a function of altitude. , the transparency level changes starting at a third high altitude threshold and ending at a fourth low altitude threshold, the first image being completely transparent at the third threshold.
    Advantageously, the first threshold and the fourth threshold have different values and / or the second threshold and the third threshold have different values. The invention will be better understood and other advantages will become apparent on reading the description which follows given by way of non-limiting example and by virtue of the appended figures among which:
    Figure 1 shows the different areas of the first image from a sensor;
    FIG. 2 represents, along a vertical axis, the variation of transparency of the first image;
    FIG. 3 represents a display comprising the superposition of the first image on the second image.
    The method according to the invention is implemented in an aircraft avionics system. This comprises at least one synthetic display system and one or more image sensors.
    The synthetic visualization system or SVS comprises at least one cartographic database, geolocation means, electronic means for calculating a representation of the main parameters of the aircraft, a graphics calculator and at least one display device. The geolocation means are, for example, type "GPS", acronym for "Global Positioning System" coupled / hybridized or not with inertial units.
    The second visualization system called "EVS", an acronym for "Enhanced Vision System" includes one or more sensors that can be optical sensors in the visible or infrared field or intensified imaging, or lidars or radars. The image is usually processed.
    In what follows, the terms opacity and transparency are used. The opacity level of an image expressed as a percentage is equal to 100% minus its level of transparency expressed as a percentage.
    In the method according to the invention, the EVS image is divided into three distinct and related rectangular zones from bottom to top as seen in FIG. 1. In this figure, the zones are denoted Z1, Z2 and Z3. The lower part Z1 presents the EVS image with a maximum opacity or, which amounts to the same, a minimum transparency, the upper part Z3 represents the EVS image with a minimum opacity or a maximum transparency and the intermediate part Z2 presents the EVS image with an opacity gradient between the maximum value at the bottom and the minimum at the top or with a gradient of transparency between the minimum value at the bottom and the maximum at the top.
    To give orders of magnitude, the height of the first zone Z1 represents 30% of the height of the image, the height of the second zone Z2 represents 50% of the height of the image and the height of the third zone Z3 represents 20% of the height of the image. Other distributions are possible.
    As shown in FIG. 2, the opacity of each point in the intermediate zone Z2 is a function of its distance on the vertical axis Y at the lower edge of the image according to a constantly decreasing law of variation. The law of variation can be of different nature. In FIG. 2, the law of variation is linear. Other variations are possible. By way of example, the first level of transparency is zero or close to zero and the second level of transparency is close to 100%.
    The distribution of the three zones can be constant and independent of the flight phases of the aircraft. A variant of the method according to the invention consists in making the distribution of the three zones variable. Different modes are then interesting: - A manual mode or the pilot settles from a single command the distribution of the three zones; - An automatic mode or the distribution of the zones is a function of one or more parameters of the aircraft, for example pitch, altitude or radio-altitude. Thus, the closer the aircraft approaches the ground and / or the more the aircraft takes a negative pitch, the more the zone Z1 gets bigger; - An automatic mode or the distribution of the zones is a function of the detection in the EVS image of a horizontal line by means of the visibility limit of the sensor at a given time. This detection is based on an analysis of contrasts in the EVS image. An automatic mode or the distribution of the zones is a function of the detection in the SVS image of a horizontal line passing through the lowest point in the field of the sensor whose distance to the aircraft is greater than a given value, for example 500 meters.
    When the aircraft is very high above the terrain, the EVS image is no longer of interest and a single SVS image is presented. One possible solution to avoid the appearance or the sudden disappearance of the first image consists in introducing a smooth transition between the SVS image alone and the EVS image composed of the three rectangular zones described above, when the aircraft approaches the soil or away from it.
    In this case, the first level of transparency and / or the second level of transparency vary as a function of the altitude of the aircraft when the aircraft rises, so that the first image is more and more transparent depending altitude, the changes in levels of transparency beginning at a first low altitude threshold called threshold of beginning of disappearance and ending at a second threshold of high altitude called threshold of end of disappearance, the first image being completely transparent to this second threshold.
    The first level of transparency and the second level of transparency also vary according to the altitude of the aircraft as the aircraft descends, so that the first image is increasingly opaque as a function of altitude, the changes transparency levels beginning at a third high altitude threshold called the end of appearance threshold and ending at a fourth low altitude threshold called onset of appearance threshold, the first image being completely transparent to the third threshold.
    These thresholds of appearance and disappearance are not necessarily confused. Advantageously, the threshold of onset of disappearance is greater than the threshold of onset of appearance and, in the same way, the end of disappearance threshold is greater than the end of appearance threshold. For example, the average transparency variation of the first image may be linear as a function of the altitude between the thresholds of appearance and disappearance. Other variations are possible.
    These thresholds of appearance and disappearance are defined so as to avoid appearances and fugitive disappearances, whatever the profile of the flight and the nature of the terrain. By way of example, FIG. 3 shows the integration of an EVS image in an SVS image obtained with the method according to the invention. The SVS image has lines of a grid that disappear at the bottom of the EVS image in the zone Z1 which is completely opaque and which reappear in the zone Z2 as they are higher in the zone Z2. EVS image which is more and more transparent and totally transparent in the Z3 zone.
    权利要求:
    Claims (12)
    [1" id="c-fr-0001]
    A method of graphically representing a first image (EVS) from an image sensor of the exterior landscape superimposed on a second image (SVS) representing a synthetic image of the same exterior landscape, the two images being displayed on a display screen of an aircraft visualization system, characterized in that the first image comprises three rectangular zones (Z1, Z2, Z3) of increasing transparency, each zone having a width equal to that of the first image and a determined height, the sum of the three heights being equal to the height of the first image, the first region at the bottom of the image having a first constant level of transparency, the third zone at the top of the image having a second level constant transparency greater than the first level of transparency, the second zone located between the first zone and the third zone having a level of transparency ment variable between the first level and the second level.
    [2" id="c-fr-0002]
    2. A method of graphical representation according to claim 1, characterized in that the height of the first zone (Z1) represents 30% of the height of the image, the height of the second zone (Z2) represents 50% of the height. of the image and the height of the third zone (Z3) represents 20% of the height of the image.
    [3" id="c-fr-0003]
    3. A method of graphical representation according to claim 1, characterized in that the first level of transparency is zero or close to zero and in that the second level of transparency is close to 100%.
    [4" id="c-fr-0004]
    4. A method of graphical representation according to claim 1, characterized in that the law of variation of the level of transparency of the second zone is linear.
    [5" id="c-fr-0005]
    5. A method of graphical representation according to claim 1, characterized in that the heights of the three zones are adjustable manually by a user.
    [6" id="c-fr-0006]
    6. A method of graphical representation according to claim 1, characterized in that the heights of the three zones are automatically adjustable by the avionics system on board according to the flight phase of the aircraft.
    [7" id="c-fr-0007]
    7. A method of graphical representation according to claim 1, characterized in that the heights of the three zones are automatically adjustable by the avionics system on board according to one or more parameters of the aircraft such as pitch, altitude or radio-altitude.
    [8" id="c-fr-0008]
    8. A method of graphical representation according to claim 1, characterized in that the heights of the three zones are automatically adjustable by the avionics system on board as a function of a distance from the ground in the sensor field calculated from the base data from the field.
    [9" id="c-fr-0009]
    9. A method of graphical representation according to claim 1, characterized in that the heights of the three zones are automatically adjustable by the avionics system on board according to the visibility limit of the image sensor.
    [10" id="c-fr-0010]
    10. A method of graphical representation according to claim 1, characterized in that the first level of transparency and / or the second level of transparency vary as a function of the altitude of the aircraft when the aircraft rises, so that the first image is more and more transparent as a function of altitude, the transparency level changes starting at a first low altitude threshold and ending at a second high altitude threshold, the first image being completely transparent at this second threshold .
    [11" id="c-fr-0011]
    11. A method of graphical representation according to claim 1, characterized in that the first level of transparency and the second level of transparency vary as a function of the altitude of the aircraft when the aircraft descends, so that the first image is more and more opaque as a function of altitude, the changes in transparency levels beginning at a third high altitude threshold and ending at a fourth low altitude threshold, the first image being completely transparent at the third threshold.
    [12" id="c-fr-0012]
    12. A method of graphical representation according to one of claims 10 and 11, characterized in that the first threshold and the fourth threshold have different values and / or the second threshold and the third threshold have different values.
    类似技术:
    公开号 | 公开日 | 专利标题
    EP0928952A1|1999-07-14|Aircraft terrain collision avoidance method and device
    EP1245929B1|2009-11-25|Method and device for assisting in steering an aircraft, especially for a transport aircraft
    US8493241B2|2013-07-23|Systems, methods and computer readable media for displaying multiple overlaid images to a pilot of an aircraft during flight
    EP3185216A1|2017-06-28|Method for graphically representing an image from an image sensor superimposed on a second synthetic image of the outside landscape
    EP2309474B1|2013-07-31|Surveillance system for an approaching aircraft
    US20130106832A1|2013-05-02|Systems and methods for displaying images with multi-resolution integration
    FR2897975A1|2007-08-31|Aircraft e.g. civil transport aircraft, steering assisting method for pilot, involves presenting, on display screen, characteristic symbol positioned on stability axis at position relative to axes representing altitude and distance values
    EP3226062B1|2019-08-14|Method for synthetic representation of elements of interest in a display system for an aircraft
    FR2897839A1|2007-08-31|Navigation display`s image adjustment method for e.g. transport plane, involves automatically performing display change of display by applying new display configuration that permits to display detected dangerous event on display
    FR3020691A1|2015-11-06|AVIONIC SYSTEM COMPRISING MEANS OF DESIGNATION AND MARKING OF THE FIELD
    FR3058233A1|2018-05-04|METHOD FOR OVERLAYING AN IMAGE FROM A SENSOR ON A SYNTHETIC IMAGE BY AUTOMATICALLY DETECTING THE VISIBILITY LIMIT AND VISUALISION SYSTEM THEREOF
    FR2787907A1|2000-06-30|AID SYSTEM FOR AVOIDING AIRCRAFT COLLISIONS WITH THE GROUND
    FR3038380A1|2017-01-06|METHOD AND SYSTEM FOR DISPLAYING VERTICAL CONSTRAINTS OF AN AIRCRAFT, COMPUTER PROGRAM PRODUCT AND ASSOCIATED AIRCRAFT
    EP3029420B1|2020-01-22|Synthetic display system comprising means for adapting the displayed landscape
    FR2935481A1|2010-03-05|METHOD FOR MONITORING ATMOSPHERIC AREAS FOR AN AIRCRAFT
    EP2884231A1|2015-06-17|Multiscale map display system
    EP3018450B1|2020-06-24|Method for representing a cartographic image in a geopositioned viewing system considering the geopositioning accuracy
    EP3184966A1|2017-06-28|Method for three-dimensional graphical representation of a runway axis
    EP3187827B1|2020-03-11|Method for three-dimensional graphical representation of a runway on an aircraft display device
    EP3187828B1|2018-08-22|Method for graphically representing the relative position of the sky and the ground in an on-board display system for an aircraft
    US10930079B1|2021-02-23|Techniques for displaying augmentations that represent cadastral lines and other near-ground features
    FR3037645A1|2016-12-23|VISUALIZATION SYSTEM COMPRISING A GRAPHICAL REPRESENTATION OF THE DISTANCES IN A PERSPECTIVE MAP VIEW AND ASSOCIATED METHOD
    FR3054686A1|2018-02-02|METHOD OF GRAPHIC MANAGEMENT OF SYMBOLOGY IN A THREE DIMENSIONAL SYNTHETIC VIEW OF THE OUTSIDE LANDSCAPE IN AN AIRCRAFT VISUALIZATION SYSTEM
    FR3035208A1|2016-10-21|METHOD FOR MANAGING AND DISPLAYING GEO-REFERENCE GRAPHIC SYMBOLS AND ASSOCIATED VISUALIZATION SYSTEM
    FR3044401A1|2017-06-02|METHOD FOR CALCULATING AND REPRESENTING RETENTION IN THE TRACK OF A FLIGHT AIRCRAFT
    同族专利:
    公开号 | 公开日
    CN107018356A|2017-08-04|
    US10262463B2|2019-04-16|
    CN107018356B|2020-09-18|
    EP3185216A1|2017-06-28|
    FR3046282B1|2018-01-05|
    US20170186238A1|2017-06-29|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US20120026190A1|2010-07-28|2012-02-02|Honeywell International Inc.|Methods and systems for attitude differentiation in enhanced vision images|
    US6961070B1|2000-02-25|2005-11-01|Information Decision Technologies, Llc|Method to graphically represent weapon effectiveness footprint|
    CN100536541C|2006-01-24|2009-09-02|深圳Tcl新技术有限公司|Display method of transparency-adjustable TV function interface|
    US8767013B2|2011-12-07|2014-07-01|Honeywell International Inc.|System and method for rendering a sky veil on a vehicle display|
    JP6243112B2|2011-12-09|2017-12-06|ソニー株式会社|Information processing apparatus, information processing method, and recording medium|
    US8654149B2|2011-12-20|2014-02-18|Honeywell International Inc.|System and method for displaying enhanced vision and synthetic images|
    US9390559B2|2013-03-12|2016-07-12|Honeywell International Inc.|Aircraft flight deck displays and systems and methods for enhanced display of obstacles in a combined vision display|
    US9934600B2|2015-12-22|2018-04-03|Whatsapp Inc.|Techniques to configure device display|CN109547710A|2018-10-10|2019-03-29|中国航空工业集团公司洛阳电光设备研究所|A kind of enhancing what comes into a driver's and Synthetic vision merge implementation method|
    CA3058251A1|2018-10-11|2020-04-11|Bombardier Inc.|Vision guidance systems and methods for aircraft|
    US20200355518A1|2019-05-10|2020-11-12|Honeywell International Inc.|Systems and methods for managing vision system display|
    法律状态:
    2016-11-28| PLFP| Fee payment|Year of fee payment: 2 |
    2017-06-30| PLSC| Publication of the preliminary search report|Effective date: 20170630 |
    2017-11-27| PLFP| Fee payment|Year of fee payment: 3 |
    2019-11-28| PLFP| Fee payment|Year of fee payment: 5 |
    2020-11-25| PLFP| Fee payment|Year of fee payment: 6 |
    2021-11-26| PLFP| Fee payment|Year of fee payment: 7 |
    优先权:
    申请号 | 申请日 | 专利标题
    FR1502679|2015-12-23|
    FR1502679A|FR3046282B1|2015-12-23|2015-12-23|METHOD FOR GRAPHIC REPRESENTING AN IMAGE FROM A SUPERPOSITION IMAGE SENSOR ON A SECOND SYNTHETIC IMAGE OF THE OUTSIDE LANDSCAPE|FR1502679A| FR3046282B1|2015-12-23|2015-12-23|METHOD FOR GRAPHIC REPRESENTING AN IMAGE FROM A SUPERPOSITION IMAGE SENSOR ON A SECOND SYNTHETIC IMAGE OF THE OUTSIDE LANDSCAPE|
    EP16204475.4A| EP3185216A1|2015-12-23|2016-12-15|Method for graphically representing an image from an image sensor superimposed on a second synthetic image of the outside landscape|
    CN201611199539.XA| CN107018356B|2015-12-23|2016-12-22|Graphical representation of an image from an image sensor superimposed on a synthetic second image of an external landscape|
    US15/390,438| US10262463B2|2015-12-23|2016-12-23|Method for graphically representing an image from an image sensor superimposed on a synthetic second image of the outside landscape|
    [返回顶部]