• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The present invention discloses an inspection apparatus for port machinery, which includes: a group of drones (101), a group of ground locators (102), a ground monitoring and processing device (103), and a data management and evaluation device (104). The drones conduct inspections of a port machinery to obtain images of the port machinery. The ground locator locates the three-dimensional position of the drone. The ground monitoring and processing device communicates with the drone and the ground locator. The ground monitoring and processing device (103) controls the flight of the drone, receives the images acquired by the drone, and monitors the status of the drone. The data management and evaluation device (104) communicates with the ground monitoring and processing device (103). The data management and evaluation device (104) stores the basic data of the port machinery. The data management and evaluation device receives the images from the ground monitoring and processing device, performs disease identification and disease analysis according to the images and generates evaluation results based on the disease identification and disease analysis.
    公开号:EP3680648A1
    申请号:EP17924086.6
    申请日:2017-10-19
    公开日:2020-07-15
    发明作者:Wenjun Li；Yunfu YAN；Lei Luo；Zijian Zhao；Jun Yu；Wei Dai；Qing Yi；Yao LU；Jianguo Shan；Dinggen XIONG；Maohua FU
    申请人:Shanghai Zhenghua Heavy Industries Co Ltd；
    IPC主号:B64C39-00
    专利说明:
    [0001] The present invention relates to the field of port machinery, and more particularly, to inspection and evaluation technologies for port machinery. 2. The Related Art
    [0002] Port machineries are widely used in the field of logistics. Port machineries mainly include shore container cranes, rail cranes, tire cranes, portal cranes and ship unloaders. Due to the heavy transportation tasks and long service life of port machinery, the health inspection of port machinery structure is very important for the normal operation of the port. The key of safe work for port machinery is the steel mechanism. The working position of port machinery is close to the shore, which is a corrosive environment. Therefore, it is necessary to perform regular inspections for port machinery to check its health.
    [0003] The current inspection of port machinery is mainly realized as manual inspections. The inspectors climb the port machinery to inspect the structure of the port machinery, take pictures of the diseased areas, and draft an evaluation report according to the inspection results and pictures. With the enlargement of port machinery, the size of existing port machinery reaches 150m∗30m∗100m. It is difficult for inspectors to climb and the risk is very high. In addition, due to the special structure of the port machinery, some areas can not be reached, or can not be photographed because of the perspective of the inspectors. Therefore some blind spots for inspection are formed. In general, the existing manual inspection methods are inefficient, have long detection cycles, have poor detection results, have many blind spots, and have high safety risks. SUMMARY
    [0004] The present invention discloses an inspection technology for port machinery based on drones.
    [0005] According to an embodiment of the present invention, an inspection apparatus for port machinery is disclosed. The apparatus comprises: a group of drones, a group of ground locators, a ground monitoring and processing device and a data management and evaluation device. The group of drones includes one or more drones, the drone carries out inspections of the port machinery and obtains images of the port machinery. The group of ground locators includes one or more ground locators, the ground locator locates the three-dimensional position of the drone. The ground monitoring and processing device communicates with the drone, controls the flight of the drone, receives the images acquired by the drone and monitors the status of the drone. The data management and evaluation device communicates with the ground monitoring and processing device, the data management and evaluation device stores the basic data of the port machinery, the data management and evaluation device receives the image acquired by the drone from the ground monitoring and processing device, performs disease identification and disease analysis based on the image, and generates evaluation results based on the disease identification and disease analysis.
    [0006] In an embodiment, the ground monitoring and processing device comprises: a main control machine and a hand-held remote controller. The main control machine plans an inspection route for the drone, controls the drone to fly along the inspection route and performs aerial photography so as to obtain the image of the port machinery, the main control machine also monitors the status of the drone. The hand-held remote controller, the hand-held remote controller receives operation instructions, and controls the drone to fly and perform aerial photography so as to obtain images of port machinery according to the operation instructions. Wherein, when the hand-held remote controller is not in operation, the drone is controlled by the main control machine and operates automatically, when the hand-held remote controller is in operation, the drone quits from automatic operation and is controlled by the hand-held remote controller.
    [0007] In an embodiment, the main control machine comprises: an interface interaction module, a front-end data management module, a route planning module, an aerial photography control module, a monitoring module and a communication module. The interface interaction module generates an interactive interface for receiving instructions and displaying information. The front-end data management module obtains the basic data of the port machinery from the data management and evaluation device or the interface interaction module. The route planning module plans an automatic inspection route based on the basic data of port machinery obtained by the front-end data management module, or plans a designate inspection route based on the instructions obtained from the interactive interface. The aerial photography control module controls the drone to fly and perform aerial photography according to the automatic inspection route or designated inspection route planned by the route planning module to obtain the image of port machinery. The monitoring module monitors the 3D position and status of the drone. The communication module communicates with the data management and evaluation device and the hand-held remote controller.
    [0008] In an embodiment, the hand-held remote controller comprises: a hand-held manipulator, a data transmission module and an image transmission module. The hand-held manipulator is held by an operator, receives operation instructions and controls the drone according to the operation instructions. The data transmission module performs data communication with the drone and the main control machine, and monitors the status of the drone. The image transmission module performs image communication with the drone and the main control machine, and obtains the images and videos of the port machinery obtained by the aerial photography of the drone.
    [0009] In an embodiment, the data management and evaluation device comprises: a back-end data management module, an image disease recognition module, an image disease analysis module and an evaluation module. The back-end data management module processes basic data of port machinery, route data, status data of drones, and image data of port machinery. The image disease recognition module identifies disease areas in images of port machinery, marks and classifies disease areas. The image disease analysis module performs quantitative calculation on the disease areas marked and classified by the image disease identification module, and correlates the results of the quantitative calculation with the disease areas. The evaluation module generates an evaluation result based on the result of the quantitative calculation and the correlation between the result of the quantitative calculation and the disease area.
    [0010] In an embodiment, the classification of disease areas includes: corrosion, cracks, missing bolts, paint stripping, or other diseases. The quantitative calculation of the disease areas includes: the size of the corrosion area, the size of the paint stripped area, the length and width of the crack, the number and location of the missing bolts.
    [0011] In an embodiment the basic data of the port machinery includes size data and position data of the port machinery. The route data includes planned route data and actual route data, wherein the planned route data includes automatic inspection route data and designated inspection route data. The status data of drones includes: time, detection point number, plane horizontal coordinate, plane longitudinal coordinate, altitude coordinate, pitch angle, tilt angle, yaw angle, pitch angle of the photography gimbal, tilt angle of the photography gimbal, and yaw angle of the of the photography gimbal. The processing of the basic data, the route data, the status data of drones and image data of port machinery includes: saving, deleting, modifying, encrypting, decrypting, classifying, filtering, statistics, importing, and exporting.
    [0012] In an embodiment, the drone includes: a fuselage, a flight module, a flight control module, a data transmission module, an image transmission module, an obstacle avoidance module, a positioning module, an aerial camera and a tracking camera.
    [0013] According to an embodiment of the present invention, an inspection method for port machinery is discloses. The inspection method utilizes the inspection apparatus for port machinery as mentioned above. The inspection method comprises: a step of route planning, planning an automatic inspection route based on the basic data of port machinery; a step of drone aerial photography, controlling the drone to fly according to automatic inspection route and taking aerial photos of the port machinery, monitoring the status of the drone, and receiving images acquired by the drone; a step of data processing, performing disease recognition and disease analysis on the images acquired by the drone, and generates evaluation results based on the disease recognition and disease analysis.
    [0014] In an embodiment, the inspection method further comprises:a step of route adjusting, generating a designated inspection route according to the instructions obtained from the interactive interface, wherein the drone flies according to the designated inspection route to perform aerial photography of the port machinery.
    [0015] In an embodiment, the inspection method further comprises:a step of manual control, operating the hand-held remote controller, wherein the drone quits automatic operation and is controlled to fly and perform aerial photography of the port machinery under the control of the hand-held remote controller.
    [0016] The inspection apparatus and inspection method for port machinery according to the present invention can automatically plan the route of the drone based on the basic data of the port machinery. The drone automatically flies and performs aerial photography according to the planned route to carry out the inspection and collect images and videos of the port machinery. The image data and video data are transmitted to a data management and evaluation device, which performs disease identification and disease analysis on the images. The data management and evaluation device generates evaluation results based on the disease identification and disease analysis. When necessary, it is able to manually modify the route of the drone or switch the drone to manual operation mode. The inspection device and inspection method have high degree of automation, high detection efficiency, wide application range, and high safety factor. BRIEF DESCRIPTION OF THE DRAWINGS
    [0017] The above and other features, natures, and advantages of the invention will be apparent by the following description of the embodiments incorporating the drawings, wherein,FIG. 1 is a schematic structural diagram of an inspection apparatus for port machinery according to an embodiment of the present invention. FIG. 2 illustrates a structural block diagram of an inspection apparatus for port machinery according to an embodiment of the present invention. FIG. 3 illustrates a structural block diagram of a ground monitoring and processing device in the inspection apparatus for port machinery according to an embodiment of the present invention. FIG. 4a and FIG. 4b disclose an exemplary flow of an inspection method for port machinery according to an embodiment of the present invention. DETAILED DESCRIPTION OF EMBODIMENTS
    [0018] Referring to FIG. 1, FIG. 1 is a schematic structural diagram of an inspection apparatus for port machinery according to an embodiment of the present invention. The inspection apparatus for port machinery includes: a group of drones 101, a group of ground locators 102, a ground monitoring and processing device 103 and a data management and evaluation device 104.
    [0019] The group of drones 101 includes one or more drones, the drone carries out inspections of a port machinery and obtains images of the port machinery. The group of ground locators 102 includes one or more ground locators, the ground locator locates the three-dimensional position of the drone. The ground monitoring and processing device 103 communicates with the drone, controls the flight of the drone, receives the images acquired by the drone and monitors the status of the drone. The data management and evaluation device 104 communicates with the ground monitoring and processing device, the data management and evaluation device stores the basic data of the port machinery, the data management and evaluation device receives the image acquired by the drone from the ground monitoring and processing device, performs disease identification and disease analysis based on the image, and generates evaluation results based on the disease identification and disease analysis.
    [0020] Referring to FIG. 2, FIG. 2 illustrates a structural block diagram of an inspection apparatus for port machinery according to an embodiment of the present invention. FIG. 2 illustrates the structure of the inspection apparatus for port machinery in detail. The group of drones 101 includes one or more drones, and in FIG. 2, each drone in the group of drones 101 is marked as 101.1∼101.n. The drone used here is a drone with the function of automatic tracking flight and aerial photography. In an embodiment, the drone includes: a fuselage, a flight module, a flight control module, a data transmission module, an image transmission module, an obstacle avoidance module, a positioning module, an aerial camera and a tracking camera. The drone with the function of automatic tracking flight and aerial photography is purchased from the market. The basic structure and functions of the drone will not be described here in detail. The group of ground locators 102 includes one or more ground locators, and in FIG. 2, each ground locator in the group of ground locators 102 is marked as 102.1∼102.m. The ground locator locates the three-dimensional position of the drone. In an embodiment, the ground locator locates the three-dimensional position of the drone according to a wireless pulse signal or a satellite signal. Of course, those skilled in the art shall understand that the method of locating the three-dimensional position of the drone by the ground locator is not limited to the wireless pulse signal or satellite signal described above.
    [0021] The ground monitoring and processing device 103 comprises: a main control machine 131 and a hand-held remote controller 132. The main control machine 131 plans an inspection route for the drone, controls the drone to fly along the inspection route and performs aerial photography so as to obtain the image of the port machinery, the main control machine also monitors the status of the drone. The hand-held remote controller 132 receives operation instructions, and controls the drone to fly and perform aerial photography so as to obtain images of port machinery according to the operation instructions. When the hand-held remote controller 132 is not in operation, the drone is controlled by the main control machine 131 and operates automatically. When the hand-held remote controller 132 is in operation, the drone quits from automatic operation and is controlled by the hand-held remote controller 132. FIG. 3 illustrates a structural block diagram of a ground monitoring and processing device in the inspection apparatus for port machinery according to an embodiment of the present invention. As shown in FIG. 3, the main control machine 131 includes: an interface interaction module 301, a front-end data management module 302, a route planning module 303, an aerial photography control module 304, a monitoring module 305 and a communication module 306. The interface interaction module 301 generates an interactive interface for receiving instructions and displaying information. The front-end data management module 302 obtains the basic data of the port machinery from the data management and evaluation device 104 or the interface interaction module 301. In an embodiment, the basic data of the port machinery includes size data and position data of the port machinery. The route planning module 303 plans an automatic inspection route based on the basic data of port machinery obtained by the front-end data management module 302, that is, plans the automatic inspection route based on the size and position of port machinery. Or, the route planning module 303 plans a designate inspection route based on the instructions obtained from the interactive interface. In some cases, it is necessary to modify the automatic inspection route. At this time, an instruction may be input through the interactive interface generated by the interface interaction module 301 to manually modify the inspection route to generate a designated inspection route. After the designated inspection route is generated, the drone flies and performs aerial photography according to the newly modified designated inspection route. The aerial photography control module 304 controls the drone to fly and perform aerial photography according to the automatic inspection route or designated inspection route planned by the route planning module to obtain the image of port machinery. The monitoring module 305 monitors the 3D position and status of the drone. The communication module 306 communicates with the data management and evaluation device 104 and the hand-held remote controller 132. In an embodiment, the front-end data management module 302 processes the basic data, the route data, the status data of drones and image data of port machinery, and the processing of date includes: saving, deleting, modifying, encrypting, decrypting, classifying, filtering, statistics, importing, and exporting. Continue to refer to FIG. 3, the hand-held remote controller 132 comprises: a hand-held manipulator 307, a data transmission module 308 and an image transmission module 309. The hand-held manipulator 307 is held by an operator, receives operation instructions and controls the drone according to the operation instructions. In an embodiment, the hand-held manipulator 307 includes a joystick, buttons, and a wheel. The data transmission module 308 performs data communication with the drone and the main control machine, and monitors the status of the drone. The data transmission module 308 is used for transmission of the basic data of port machinery, the route data and the status data of drones. The image transmission module 309 performs image communication with the drone and the main control machine, and obtains the images and videos of the port machinery obtained by the aerial photography of the drone. The image transmission module 309 is used for transmission of the image date or video data of port machinery.
    [0022] Back to FIG. 2, the data management and evaluation device 104 comprises: a back-end data management module 141, an image disease recognition module 142, an image disease analysis module 143 and an evaluation module 144. The back-end data management module 141 processes basic data of port machinery, route data, status data of drones, and image data of port machinery. In an embodiment, the basic data of the port machinery includes size data and position data of the port machinery. The route data includes planned route data and actual route data. The status data of drones includes: time, detection point number, plane horizontal coordinate (or longitude coordinates), plane longitudinal coordinate (or latitude coordinates), altitude coordinate, pitch angle, tilt angle, yaw angle, pitch angle of the photography gimbal, tilt angle of the photography gimbal, and yaw angle of the of the photography gimbal. The processing of the basic data, the route data, the status data of drones and image data of port machinery includes: saving, deleting, modifying, encrypting, decrypting, classifying, filtering, statistics, importing, and exporting, etc,. The image disease recognition module 142 identifies disease areas in images of port machinery, marks and classifies disease areas. In an embodiment, the classification of disease areas includes: corrosion, cracks, missing bolts, paint stripping, or other diseases. The image disease analysis module 143 performs quantitative calculation on the disease areas marked and classified by the image disease identification module, and correlates the results of the quantitative calculation with the disease areas. In an embodiment, the quantitative calculation of the disease areas includes: the size of the corrosion area, the size of the paint stripped area, the length and width of the crack, the number and location of the missing bolts. The evaluation module generates an evaluation result based on the result of the quantitative calculation and the correlation between the result of the quantitative calculation and the disease area.
    [0023] The present invention further discloses an inspection method for port machinery utilizing the inspection apparatus for port machinery mentioned above, the inspection method comprises: a step of route planning, planning an automatic inspection route based on the basic data of port machinery; a step of drone aerial photography, controlling the drone to fly according to automatic inspection route and taking aerial photos of the port machinery, monitoring the status of the drone, and receiving images acquired by the drone; a step of data processing, performing disease recognition and disease analysis on the images acquired by the drone, and generates evaluation results based on the disease recognition and disease analysis.
    [0024] In an embodiment, when it is necessary to adjust the automatic inspection route, the inspection method for port machinery further comprises: a step of route adjusting, generating a designated inspection route according to the instructions obtained from the interactive interface, wherein the drone flies according to the designated inspection route to perform aerial photography of the port machinery.
    [0025] In an embodiment, when it is necessary to manually operate the drone, the inspection method for port machinery further comprises: a step of manual control, operating the hand-held remote controller, wherein the drone quits automatic operation and is controlled to fly and perform aerial photography of the port machinery under the control of the hand-held remote controller.
    [0026] FIG. 4a and FIG. 4b disclose an exemplary flow of an inspection method for port machinery according to an embodiment of the present invention. The exemplary flow includes the following steps: Step S1: Initiate the ground monitoring and processing device 103, and check to determine that the main controller 131 and the hand-held remote controller 132 are in a normal state. Step S2: Input the size data of the port machinery to be inspected through the interface interaction module 301 of the main control machine 131, or download the size data of the port machinery to be inspected from the back-end data management module 141 through the communication module 306 of the main control machine 131. Step S3: Put the drone 101 and the ground locator 102 in the initial positions respectively. The initial position of the drone 101 is a predefined relative position that refers to the position of the port machinery to be inspected. The ground locator 102 is arranged at an appropriate position on the ground according to the required positioning accuracy of the drone. Step S4: Initiate the drone 101 and the ground locator 102, and check to confirm that both the drone and the ground locator are in a normal state. Step S5: Record the initial position coordinates of the drone 101 in the main control machine 131, including its plane horizontal coordinate (or longitude coordinates), plane longitudinal coordinate (or latitude coordinates), altitude coordinate. Step S6: Based on the size data of the port machinery that had been imported into the main control machine 131, the route planning module 303 executes the route planning program to automatically generate an automatic inspection route matching the port machinery to be inspected. When it is necessary, the operator may manually modify the automatic inspection route through the interface interaction module 301, modify it to be the designated inspection route, and save the designated inspection route as the latest planned route. Step S7: Automatically control the drone 101 to perform aerial photography according to the latest planned route. Step S8: The ground monitoring processing system 103 receives the mission status of the drone 101, and determines whether the aerial photography mission is completed. If it is determined that the aerial photography mission is not completed, proceed to step S9; if it is determined that the aerial photography mission is completed, proceed to step S15. Step S9: The main controller 131 detects the control instruction of the hand-held remote controller 132 in real time, and determines whether any instruction is received. If an instruction is received, proceed to step S10; if no instruction is received, return to step S7. Step S10: The ground monitoring processing system 103 sends an instruction to the drone 101 to control the drone 101 to suspend aerial photography and hover. Step S11: The main control machine 131 displays three options through the interactive interface: route modification, manual control and misoperation, and wait for the operator to make a choice. If the option route modification is chosen, proceed to step S12; if the option manual control is chosen, proceed to step S14; if the option misoperation is chosen, return to step S7. Step S12: The operator manually modifies the route parameters in the main control machine 131 according to the actual requirements, designates the inspection route and saves the designated inspection route as the latest planned route. Step S13: The main control machine 131 inquires the operator through the interactive interface whether to continue the automatic control. If the operator selects No, proceed to step S14, and if the operator selects Yes, return to step S7. Step S14: The operator manually operates the hand-held remote controller 132 to control the drone 101 to perform aerial photography according to the manual control instruction. Step S15: In the automatic control mode, the ground monitoring and processing system 103 automatically controls the drone 101 to complete the flight mission and return to the ground. In the manual control mode, the operator operates the hand-held remote controller 132 to manually control the drone 101 and complete the flight mission and return to the ground. Step S16: The operator imports the image data and video data collected by the drone 101 into the main control machine 131. Step S17: The operator manually checks and filters the images that have been imported into the main control machine 131 according to actual requirements. Step S18: The operator transmits the route data, all or filtered images and video data in the main control machine 131 to the back-end data management module 141 in the data management and evaluation device 104. Step S19: The image disease recognition module 142 in the data management and evaluation device 104 automatically recognizes the structural surface diseases in the image, classifies the surface diseases into corrosion, cracks, missing bolts, paint stripping, or other diseases, and marks the diseased area and type in the image that recognized with disease. The processed image is saved to the back-end data management module 141. Step S20: The image disease analysis module 143 performs quantitative calculation on images that have been recognized and classified as corrosion, cracks, missing bolts or paint stripping. The result of the quantitative calculation includes: the size of the corrosion area, the size of the paint stripped area, the length and width of the crack, the number and location of the missing bolts. The results are correlated with the disease images. Step S21: The evaluation module 144 automatically writes the structural disease images and analysis results as an evaluation result into a pre-stored evaluation report template file to form a basic evaluation report. Step S22: A professional evaluator checks the basic evaluation report in the evaluation module 144, writes recommendations such as maintenance comments into the basic evaluation report, and saves it as a complete evaluation report.
    [0027] The inspection apparatus and inspection method for port machinery according to the present invention can automatically plan the route of the drone based on the basic data of the port machinery. The drone automatically flies and performs aerial photography according to the planned route to carry out the inspection and collect images and videos of the port machinery. The image data and video data are transmitted to a data management and evaluation device, which performs disease identification and disease analysis on the images. The data management and evaluation device generates evaluation results based on the disease identification and disease analysis. When necessary, it is able to manually modify the route of the drone or switch the drone to manual operation mode. The inspection device and inspection method have high degree of automation, high detection efficiency, wide application range, and high safety factor.
    [0028] The above embodiments are provided to those skilled in the art to realize or use the invention, under the condition that various modifications or changes being made by those skilled in the art without departing the spirit and principle of the invention, the above embodiments may be modified and changed variously, therefore the protection scope of the invention is not limited by the above embodiments, rather, it should conform to the maximum scope of the innovative features mentioned in the Claims.
    权利要求:
    Claims (11)
    [0001] An inspection apparatus for port machinery, characterized in that comprises:
    a group of drones, the group includes one or more drones, the drone carries out inspections of a port machinery and obtains images of the port machinery;
    a group of ground locators, the group includes one or more ground locators, the ground locator locates the three-dimensional position of the drone;
    a ground monitoring and processing device, the ground monitoring and processing device communicates with the drone, controls the flight of the drone, receives the images acquired by the drone and monitors the status of the drone;
    a data management and evaluation device, the data management and evaluation device communicates with the ground monitoring and processing device, the data management and evaluation device stores the basic data of the port machinery, the data management and evaluation device receives the image acquired by the drone from the ground monitoring and processing device, performs disease identification and disease analysis based on the image, and generates evaluation results based on the disease identification and disease analysis.
    [0002] The inspection apparatus for port machinery according to claim 1, characterized in that the ground monitoring and processing device comprises:
    a main control machine, the main control machine plans an inspection route for the drone, controls the drone to fly along the inspection route and performs aerial photography so as to obtain the image of the port machinery, the main control machine also monitors the status of the drone;
    a hand-held remote controller, the hand-held remote controller receives operation instructions, and controls the drone to fly and perform aerial photography so as to obtain images of port machinery according to the operation instructions;
    wherein, when the hand-held remote controller is not in operation, the drone is controlled by the main control machine and operates automatically, when the hand-held remote controller is in operation, the drone quits from automatic operation and is controlled by the hand-held remote controller.
    [0003] The inspection apparatus for port machinery according to claim 2, characterized in that the main control machine comprises:
    an interface interaction module, the interface interaction module generates an interactive interface for receiving instructions and displaying information;
    a front-end data management module, the front-end data management module obtains the basic data of the port machinery from the data management and evaluation device or the interface interaction module;
    a route planning module, the route planning module plans an automatic inspection route based on the basic data of port machinery obtained by the front-end data management module, or plans a designate inspection route based on the instructions obtained from the interactive interface;
    an aerial photography control module, the aerial photography control module controls the drone to fly and perform aerial photography according to the automatic inspection route or designated inspection route planned by the route planning module to obtain the image of port machinery;
    a monitoring module, the monitoring module monitors the 3D position and status of the drone;
    a communication module, the communication module communicates with the data management and evaluation device and the hand-held remote controller.
    [0004] The inspection apparatus for port machinery according to claim 2, characterized in that the hand-held remote controller comprises:
    a hand-held manipulator, the hand-held manipulator is held by an operator, receives operation instructions and controls the drone according to the operation instructions;
    a data transmission module, the data transmission module performs data communication with the drone and the main control machine, and monitors the status of the drone;
    an image transmission module, the image transmission module performs image communication with the drone and the main control machine, and obtains the images and videos of the port machinery obtained by the aerial photography of the drone.
    [0005] The inspection apparatus for port machinery according to claim 1, characterized in that the data management and evaluation device comprises:
    a back-end data management module, the back-end data management module processes basic data of port machinery, route data, status data of drones, and image data of port machinery;
    an image disease recognition module, the image disease recognition module identifies disease areas in images of port machinery, marks and classifies disease areas;
    an image disease analysis module, the image disease analysis module performs quantitative calculation on the disease areas marked and classified by the image disease identification module, and correlates the results of the quantitative calculation with the disease areas;
    an evaluation module, the evaluation module generates an evaluation result based on the result of the quantitative calculation and the correlation between the result of the quantitative calculation and the disease area.
    [0006] The inspection apparatus for port machinery according to claim 5, characterized in that,the classification of disease areas includes: corrosion, cracks, missing bolts, paint stripping, or other diseases;the quantitative calculation of the disease areas includes: the size of the corrosion area, the size of the paint stripped area, the length and width of the crack, the number and location of the missing bolts.
    [0007] The inspection apparatus for port machinery according to claim 5, characterized in that,the basic data of the port machinery includes size data and position data of the port machinery;the route data includes planned route data and actual route data, wherein the planned route data includes automatic inspection route data and designated inspection route data;the status data of drones includes: time, detection point number, plane horizontal coordinate, plane longitudinal coordinate, altitude coordinate, pitch angle, tilt angle, yaw angle, pitch angle of the photography gimbal, tilt angle of the photography gimbal, and yaw angle of the of the photography gimbal;the processing of the basic data, the route data, the status data of drones and image data of port machinery includes: saving, deleting, modifying, encrypting, decrypting, classifying, filtering, statistics, importing, and exporting.
    [0008] The inspection apparatus for port machinery according to claim 5, characterized in that the drone includes: a fuselage, a flight module, a flight control module, a data transmission module, an image transmission module, an obstacle avoidance module, a positioning module, an aerial camera and a tracking camera.
    [0009] An inspection method for port machinery utilizing the inspection apparatus for port machinery of any one of claims 1 to 8, characterized in that the inspection method comprises:
    a step of route planning, planning an automatic inspection route based on the basic data of port machinery;
    a step of drone aerial photography, controlling the drone to fly according to automatic inspection route and taking aerial photos of the port machinery, monitoring the status of the drone, and receiving images acquired by the drone;
    a step of data processing, performing disease recognition and disease analysis on the images acquired by the drone, and generates evaluation results based on the disease recognition and disease analysis.
    [0010] The inspection method for port machinery according to claim 9, characterized in that further comprises:a step of route adjusting, generating a designated inspection route according to the instructions obtained from the interactive interface, wherein the drone flies according to the designated inspection route to perform aerial photography of the port machinery.
    [0011] The inspection method for port machinery according to claim 9, characterized in that further comprising:a step of manual control, operating the hand-held remote controller, wherein the drone quits automatic operation and is controlled to fly and perform aerial photography of the port machinery under the control of the hand-held remote controller.
    类似技术:
    公开号 | 公开日 | 专利标题
    CN105825713B|2018-07-24|The method of operation of vehicle-mounted unmanned aerial vehicle DAS |
    US9977434B2|2018-05-22|Automatic tracking mode for controlling an unmanned aerial vehicle
    US10416668B2|2019-09-17|Scanning environments and tracking unmanned aerial vehicles
    CN103941746B|2016-06-01|Image processing system and method is patrolled and examined without man-machine
    US10657827B2|2020-05-19|Drone flight operations
    US20180002010A1|2018-01-04|Unmanned aerial vehicle inspection system
    US9996746B1|2018-06-12|Systems and methods for autonomous perpendicular imaging with a target field of view
    US10218893B2|2019-02-26|Image capturing system for shape measurement of structure, method of capturing image of structure for shape measurement of structure, on-board control device, remote control device, program, and storage medium
    US9753461B1|2017-09-05|Autonomous aerial cable inspection system
    DE112016002057T5|2018-01-25|THREE-DIMENSIONAL MEASURING DEVICE SOLVIBLY COUPLED WITH A ROBOT ARM ON A MOTORIZED MOBILE PLATFORM
    CN105665970B|2018-06-22|For the path point automatic creation system and method for welding robot
    JP6828774B2|2021-02-10|Information processing equipment, information processing methods and computer programs
    US10788428B2|2020-09-29|Positioning system for aerial non-destructive inspection
    US20170300841A1|2017-10-19|Remote measurement via on-site portable platform
    CA2767312C|2018-03-20|Automatic video surveillance system and method
    US10278333B2|2019-05-07|Pruning robot system
    US10031529B2|2018-07-24|Unmanned vehicle | control system
    CN105739512B|2018-11-02|Unmanned plane automatic tour inspection system and method
    JP6387782B2|2018-09-12|Control device, control method, and computer program
    CN107810080B|2020-06-16|Time-of-flight camera for welding machine vision
    US20170313439A1|2017-11-02|Methods and syststems for obstruction detection during autonomous unmanned aerial vehicle landings
    US10377485B2|2019-08-13|System and method for automatically inspecting surfaces
    WO2017082128A1|2017-05-18|Method for maneuvering unmanned moving object and unmanned-moving-object surveillance device
    US20180321692A1|2018-11-08|Three-dimensional robotic inspection system
    JP2020035456A|2020-03-05|Information processor, information processing method, and information processing program
    同族专利:
    公开号 | 公开日
    CN107607543A|2018-01-19|
    WO2019047338A1|2019-03-14|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    法律状态:
    2019-03-16| STAA| Information on the status of an ep patent application or granted ep patent|Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
    2020-06-12| STAA| Information on the status of an ep patent application or granted ep patent|Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
    2020-06-12| PUAI| Public reference made under article 153(3) epc to a published international application that has entered the european phase|Free format text: ORIGINAL CODE: 0009012 |
    2020-07-15| 17P| Request for examination filed|Effective date: 20200408 |
    2020-07-15| AK| Designated contracting states|Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
    2020-07-15| AX| Request for extension of the european patent|Extension state: BA ME |
    2020-12-16| DAV| Request for validation of the european patent (deleted)|
    2020-12-16| DAX| Request for extension of the european patent (deleted)|
    2021-06-23| A4| Supplementary search report drawn up and despatched|Effective date: 20210521 |
    2021-06-23| RIC1| Information provided on ipc code assigned before grant|Ipc: G01N 21/88 20060101AFI20210517BHEP Ipc: G01C 11/02 20060101ALI20210517BHEP Ipc: B64C 39/02 20060101ALI20210517BHEP Ipc: G05D1/10 20060101ALI20210517BHEP |
    优先权:
    申请号 | 申请日 | 专利标题
    [返回顶部]