![]() TWO ARM ROBOTIC SYSTEM FOR ADJUSTING THE HEIGHT OF AN AGRICULTURAL TOOL
专利摘要:
The invention relates to a robotic system for use in agriculture, comprising at least one tool arm (1) for carrying an agricultural implement (O) and able to be controlled to raise or lower the agricultural tool, a sensor (2) for measuring the height of plants, and a computer configured to determine a control setpoint of the at least one tool arm from measurements made by the plant height measurement sensor, characterized in that the tool arm (1) is connected to a connecting member (4) for its installation on an operating arm (3) fitted to an agricultural vehicle, and in that the computer is further configured to determine a control command of the operating arm (3) for raising or lowering the tool arm from measurements made by the plant height sensor. 公开号:FR3038810A1 申请号:FR1556701 申请日:2015-07-16 公开日:2017-01-20 发明作者:Nolwenn Briquet-Kerestedjian;Frederic Colledani;Christophe Duissard;Baptiste Lelong;Delphin Theallier 申请人:Commissariat a lEnergie Atomique CEA;Commissariat a lEnergie Atomique et aux Energies Alternatives CEA; IPC主号:
专利说明:
TWO-ARM ROBOTIC SYSTEM FOR ADJUSTING THE HEIGHT OF AN AGRICULTURAL TOOL DESCRIPTION TECHNICAL AREA The field of the invention is that of agricultural robotic systems. The invention relates more particularly to a system for automatically adjusting the position of an agricultural implement, such as a tool for cutting or tearing plants. It finds particular application in the automation of mechanical castration operations of seed corn production fields. STATE OF THE PRIOR ART Maize is a self-pollinated plant that is highly heterotic, that is to say, to improve the capacity and vigor of the plant in hybrid or heterozygous form compared to the plant in homozygous form. Breeders work schematically to cross homozygous spawning lines in order to obtain a hybrid combination that will be more productive and vigorous and will have interesting agronomic characteristics. The corn plant is monoecious, consisting of a male inflorescence, called panicle, which is at the top of the plant and is responsible for pollen emission, and a female inflorescence at mid-height of the plant , at the base of a leaf. The female inflorescence is composed of receptor stigmas or silks which will be fertilized by the pollen, and will lead to the formation of the ear. Hybrid seed production is carried out by growing in the same plot, usually on interspersed rows, plants from both parent lines of the hybrid. The panicle of the female genital line is removed before flowering for these plants to be fertilized by the pollen of the male breeding line. The ears harvested on this female spawning line thus carry the hybrid seeds that will be marketed. The production of hybrids is not limited to obtaining simple hybrids from two maize lines, and also involves crossing a hybrid and a line (hybrid three-way) or crossing two hybrids (double hybrid). Weed control, that is the removal of the male panicle from female broodstock before flowering, is thus an essential step in the process of producing hybrid maize seed. Indeed, the presence of pollen, even in small quantities, leads to self-fertilization on these female spawners and contamination in the production of hybrids. This topping was traditionally done manually and the cost of labor generated by this step weighed heavily on the cost of hybrid seed production. It has been sought to mechanize this step by means of various tools, in particular knife tools to come cut the crown of plants and roller tools to come tear the panicle or the horn (set of leaves surrounding the panicle). The process of mechanical castration can be performed with one or more knife passages only, or in two stages. At first, a knife crossing is performed on the female breeder ranks: rotating blades cut the top of the male plant. The ideal cutting height is three-quarters of the horn, or three quarters of the panicle if it exceeds the horn. Between two and five days later, when the tassel is a little pushed back (2 to 5 cm) but before it is open enough to emit pollen, tearing on the rollers or tires is done. The objective is to catch the panicle with the rollers or the tires by pulling as little as possible the cornet or the sheets which would be still around. For this, it is necessary to place the rollers at the base of the panicle while remaining above the leaves. The first cut will have resulted in the equalization of the size of the crop so that the panicle that grows faster than the rest of the plant exceeds the foliage. The objective of the second step is to tear off the rest of the panicle and thus eliminate any risk of self-fertilization. During these mechanical castration operations, the farmer visually assesses the optimum cutting height of the tassel, from the nacelle of his machine and controls the height of the cutting or tearing tools. Generally, two contiguous rows are cut simultaneously at the same height which saves time but may penalize the cutting of one of the two rows if the plants are not of uniform size. The quality of the cut is therefore limited by the reactivity of the driver but also by the precision that allows the current architecture of the machine. As a result, many panicles are not cut to the correct height. At the end of the two stages of mechanical castration, only 70% to 80% of panicles are totally eliminated. It is then necessary to carry out a manual castration operation of the remaining panicles (or the remaining parts of cut panicles when the cut did not allow the total elimination of the panicle) in order to meet the purity standards defined by the GNIS ( National Group of Seeds and Seedlings) for seed corn production. This tedious step is performed by seasonal workers and represents a cost for the producer. Unlike manual castration, in all mechanical castration systems currently available, the elimination of the panicle is inseparable from the elimination of leaves, including the leaves of the cornet. This removal of plant material will penalize the plant in its future development and will impact the final yield of the crop and therefore the remuneration of the farmer seed multiplier. The improvement of mechanical castration devices is a real challenge in agricultural machinery. The goal is to optimize tearing of the panicle while minimizing the removal of vegetation. In addition, automated management of the cut should make it possible to release the driver of the machine from the attention necessary to adjust the cut, and thus to increase the speed of evolution of the machine. Finally, the improvement of this castration could make it possible to reduce the costs associated with the final manual verification step. With this in mind, a system proposed by SARL Duissard is based on two batches of transmitting / receiving photocells placed upstream of the cutting tools and located 13cm below each other, on either side of the two rows. These cells operate in direct detection: an infrared beam is emitted by the photocell while a reflector, located opposite, reflects the beam to the cell that receives it. If corn is on the path of the beam, then it will not be received by the photocell. The maximum height is detected when the lower cell sees corn (beam obstructed by the corn and therefore not perceived by the lower cell) and that the upper cell does not see (beam perceived by the upper cell), with precision the distance between the two photocells is 13 cm. Thus, when both cells see corn (the two bundles are clogged) then the cutting height is too low and a jack lengthens so that the arm carrying the cutting tools goes up. Conversely, when neither of the two cells see corn (the two beams are received by the cells) then the cutting height is too high and the rod of the cylinder returns to the arm lowers. The installation of a delay is necessary to keep the setpoint for several seconds because the detection time and the sending of the setpoint are too short compared to the time required to move the arm. This system sends an instruction "all or nothing" to the actuator (up or down) because of the presence of only two photocells. The system therefore tries constantly to adjust the cutting height with repeated and sometimes contrary instructions which solicit strongly. Moreover, as soon as the cells see a void, for example between two feet of corn, the entire arm will descend to have to go back immediately to the level of the next foot. Similarly, at the end of one row the entire system will descend and probably miss the first few feet of the next row. The degree of precision is also limited by the vertical spacing between the two lots of photocells, 13 cm. Cells also process information for two rows simultaneously so the lowest rank cornstalk will be cut too high. Finally, the congestion of the overall system remains a problem for farmers. DISCLOSURE OF THE INVENTION The invention aims to improve the existing systems for automating cutting or tearing operations of plants, and proposes a robotic system for use in agriculture, comprising at least one tool arm for carrying an agricultural implement and operable to raise or lower the agricultural implement, a plant height sensor, and a computer configured to determine a control setpoint of the at least one tool-carrying arm from measurements taken by the plant height measurement sensor, characterized in that the tool-holding arm is connected to a connecting member allowing its installation on an operating arm equipping an agricultural vehicle, and the computer is further configured to determine a command set of the operating arm for raising or lowering the tool arm from measurements made by the plant height sensor. Some preferred but non-limiting aspects of this system are as follows: it comprises at least two tool-carrying arms connected to the connecting member, each tool-carrying arm being associated with a crop row, and the computer is configured to: o determining the control setpoint of each of the tool arms from height measurements of the plants present in the row associated with the tool arm; o calculate an intermediate command setpoint of the operating arm for each row from measurements of the height of the plants present in each row; and o averaging the intermediate instructions calculated for each row to determine the command setpoint of the operating arm; the at least one tool arm has a travel whose amplitude is less than that of the movement of the operating arm; the computer is configured to determine the control setpoint of the at least one tool arm on the basis of plant height measurements present a first distance upstream of the current position of the agricultural tool in the direction of travel of the vehicle, and to determine the command setpoint of the operating arm on the basis of plant height measurements present a second distance upstream of the current position of the agricultural tool in the direction of travel of the vehicle, the second distance being greater than the first distance; the height measuring sensor is a light curtain apparatus or a stereoscopic imaging system; the agricultural tool is a tool for cutting or tearing plants, in particular corn. The invention also extends to agricultural vehicle equipment comprising an operating arm and the system according to the invention pre-installed on the operating arm via the connecting member, as well as to a vehicle equipped with such equipment. BRIEF DESCRIPTION OF THE DRAWINGS Other aspects, objects, advantages and characteristics of the invention will appear better on reading the following detailed description of preferred embodiments thereof, given by way of non-limiting example, and made in reference to the accompanying drawings in which: - Figures 1 and 2 are schematic views of a system according to a possible embodiment of the invention, respectively side and perspective; FIG. 3 is a diagram of a simplified model of a system according to a possible embodiment of the invention. DETAILED PRESENTATION OF PARTICULAR EMBODIMENTS In the following description, the terms "front" and "rear" are to be understood as relating to a direction of travel of an agricultural vehicle. It is the same for the terms "longitudinal" and "transverse", the direction of advancement being carried out longitudinally. Finally, the terms "horizontal" and "vertical" must be understood as relating to a perfectly flat ground on which the agricultural vehicle would progress. The invention relates to a robotic system for use in agriculture. It is generally applicable to any field where a height adjustment of an agricultural implement is necessary, especially for tools for cutting or tearing plants such as those used for the castration of corn or for harvesting cereal. Referring to Figures 1 and 2, the invention relates to a robotic system which comprises at least one tool arm 1 for carrying an agricultural implement and adapted to be controlled to allow to raise and lower the agricultural tool , a plant height measurement sensor 2, and a computer configured to determine a command setpoint of the tool arm from measurements made by the plant height sensor. The agricultural tool O is typically a cutting tool (for example a knife cutting tool) or tearing (for example tires or rollers) of plants. Such a tool generally comprises a cutting or tearing instrument (knives, tires or rollers), an instrument drive motor, a vegetation guide and a protective cover. In the context of the invention, the tool arm 1 is connected to a connecting member 4 for its installation on an operating arm 3 fitted to an agricultural vehicle. The computer is further configured, based on measurements made by the plant height measurement sensor 2, to determine a control setpoint of the operating arm 3 for raising or lowering the tool arm 1. For the castration of corn, the agricultural vehicle used is a straddle that allows to move between rows of corn and cut or tear several rows female spawners contiguous at a time. A straddle generally comprises two or four operating arms upstream of the vehicle, each operating arm carrying two cutting or tearing tools to castrate simultaneously two adjacent rows, which saves time. In a possible embodiment of the invention shown in Figure 2, the system thus comprises two tool holders that can be installed via a connecting member on the same operating arm of the agricultural vehicle. The invention is of course not limited by the number of tool arms that can be jointly installed on the same maneuvering arm. A maneuvering arm 3 is conventionally a parallelogram arm which comprises, as represented in FIGS. 1 and 2, a rear vertical upright 31 forming the main structural connection with the agricultural vehicle, and a vertical upright before 32 at the lower end of which can be mounted the connecting member 4 connected to (x) tool arm 1. The vertical uprights 31 and 32 are interconnected by connecting uprights 33 and 34 pivotally mounted relative to the rear vertical upright 31. A jack 35 is mounted between the rear vertical upright 31 and the connecting upright 33, and provides a means of adjusting, by pivoting the upright 33 relative to the rear upright 31, the height of the front end of the upright. link 33, and thereby the height of the vertical upright before 32 and thus the connecting member 4 of the tool arm or 1. Each tool arm 1 may also be a parallelogram arm which comprises a rear vertical upright 11 mounted on the connecting member 4, and a vertical upright 12 before the lower end of which can be mounted an agricultural tool O. The rear vertical upright 11 of each tool arm 1 is made integral with the vertical upright 32 before the operating arm 3 through the connecting member 4. Alternatively, rather than being operated via a parallelogram of reduction , the tool arm 1 can be actuated in direct attack. Returning to the case of a parallelogram arm, the uprights 11 and 12 of a tool arm 1 are interconnected by connecting uprights 13 and 14 pivotally mounted relative to the rear vertical upright 11. A jack 15 is mounted between the rear vertical post 11 and the connecting post 14, and provides means for adjusting, by pivoting the connecting post 14 with respect to the rear vertical post 11, the height of the front end of the connecting post 15, and thereby the height of the vertical upright 12 before and the agricultural tool O. As shown in Figure 2, two tool arms can be mounted on the connecting member 4, the latter can take the form of a connecting bar mounted at the lower end of the vertical upright 32 front of the operating arm 3. The two tool arms are more precisely arranged on the connecting member 4 so that the tools carried by each of the tool arm can ensure the cutting or tearing of two adjacent rows. A plant height measuring sensor 2 is provided capable of measuring the height of the plants present in a row of crops. The calculator receives the height measurements made for each of the rows, and determines the height at which each of the tools must be placed. The computer is preferably configured to determine a control setpoint of the operating arm 3 for performing a positioning of the tools at an average height at which the tool or tools must be placed. The mass on board the arm is important (it carries two tool arms and two tools) and its movements are therefore not fast. But the height variations of the maneuverable arm are relatively small. A control instruction is also provided individually to each tool-arm by the computer, allowing to individually adjust the height of a tool and thus to individualize cutting or tearing by rank. Each tool arm thus comes to position the tool at the optimum height of cutting or tearing of each foot of a row, as determined by a cutting or tearing strategy, examples of which are detailed below. . The mass carried by a tool arm is relatively small, and its movement is faster than that of the operating arm, which allows to adapt to plant-to-plant height variations that can be relatively large (typically variations included between -200 mm and + 200 mm along a row). It is expected that the tool arm has a lower travel amplitude than the movement of the operating arm. The arm of maneuver, with a large deflection, has the role of automatically being placed at the average height at which the tool or tools must be placed, while the tool arm, lower travel but faster, ensures the cutting or tearing of a row. By using two arms (tool arm and operating arm) to position the tools, it is possible to adjust the maneuverable arm, with greater travel and slower, to an average height and use a tool arm with a shorter, faster travel to adjust precisely and quickly to the height of each foot. By allowing optimized cutting or tearing, this mechanical architecture thus makes it possible to improve the profitability of mechanical castration operations. Tearing of the panicle takes place without excessive removal of vegetation that could have a negative impact on yield. The number of panicles remaining to be torn by hand is also particularly reduced. The automation of the positioning of the tools also allows the driver to be relieved of this task, whereby the speed of evolution of the machine can be increased. The system according to the invention also has the advantage of being able to be installed on operating arms of various models of existing agricultural vehicles. The invention also extends to agricultural vehicle equipment comprising an operating arm and the previously described system preinstalled on the operating arm via the connecting member. In a possible embodiment shown in FIGS. 1 and 2, the plant height measurement sensor 2 is a light curtain apparatus composed of a transmitter E in the form of a column of light sources, and a receiver R in the form of a column of photoreceptors. The emitter E and the receiver R are mounted so as to face each other and to extend in their longitudinal direction perpendicularly to the ground so as to make it possible to measure the height of the plants present between them. Each light source of the emitter E is thus able to emit a beam, for example in the infrared, towards the photoreceptor which faces it. The transmitter E and the receiver R are each carried by a frame 5 mounted on the rear vertical upright 11 of the tool arm 1 which is integral with the vertical upright 32 of the actuating arm 3. This frame 5 may comprise two longitudinal supports 51, 52 connected to a cross bar 53 from which they extend forward. Each of the longitudinal supports 51, 52 can support, for example at its front end, a vertical element adapted to allow the mounting of the emitter E or the receiver R and the adjustment of their height relative to the frame. The frame 5 is dimensioned to allow height measurement of a single crop row between the emitter and the receiver of the plant height sensor. The length of the longitudinal carriers 51, 52 is preferably adjustable so as to adjust the distance separating the light curtain E, R from the tool O. The fact of using a transmitter E in the form of a column of light sources and a receiver R in the form of a column of photoreceptors makes it possible to multiply the sensors upstream of the agricultural tool which allows the development of a set of up or down arms 1, 3 not "all or nothing" but instead accurate and quantified. An example of a height measurement sensor that can be used in the context of the invention is an A-GAGE ™ EZ-ARRAY ™ measuring light curtain proposed by Turck Banner. One can choose a particular sensor whose curtain height is 600 mm with a resolution of 5 mm, scanning from bottom to top in 9.3 ms maximum. It should be noted that this sensor has the advantage of not being disturbed by the solar exposure and the vibrations of the machine. Optionally, a device for blowing compressed air is associated with it to rid the dust or drops that could be deposited on the sensor. This sensor has the advantage of offering several measurement modes, to provide different indications such as the first obstructed beam, the last set beam, the total number of obstructed beams, etc. The mode identifying the last obstructed beam may be preferred because it allows to obtain the profile of the plant by locating the maximum height of the plant using the light curtain. Thus, in one embodiment of the invention, the height measurement sensor is configured to perform a right scan in which all the beams between a light source and a photoreceptor facing each other are scanned in turn from the beam. closer to the ground, and to provide an indication of the last blocked beam. In another possible embodiment, the plant height measurement sensor is a vision sensor, for example a flight time camera or a stereoscopic imaging system whose use is described below. The stereoscopic imaging system comprises two cameras mounted so as to be able to image, from two distant points of view, the same scene located in front of the agricultural tool in the direction of travel of the vehicle. Both cameras are carried by a stereoscopic head. The stereoscopic imaging system further comprises a computer processing unit configured to produce, from the images delivered by the cameras, a 3D reconstruction representative of the relief of the imaged scene. The computer processing unit can be deported from the cameras. The cameras of the stereoscopic imaging system produce at the same time two twin photographs, called stereoscopic pair, slightly offset spatially. These will allow to restore the relief of plants by implementing the following steps: - calibration of the shooting system; - rectification of images; - matching of homologous points between the two images (resulting from the projection of the same point of the environment); - reconstruction of the 3D point of the environment from the pairs of homologous points. Since the baseline between the two cameras is assumed to be fixed, the calibration step is made prior to the reconstruction campaign and remains valid as long as the mechanical stability of the stereoscopic head is guaranteed. The following steps are performed at each moment to produce a new 3D reconstruction of the environment to take into account a change in either the vehicle position or the observed surface. The calibration step can be performed by observing a known object (a pattern) from different angles and viewed simultaneously by the two cameras. The mapping on each pair of images of several characteristic points of the pattern makes it possible to estimate the projection matrix of each camera (intrinsic parameters) as well as the geometric transformation connecting the two cameras (extrinsic parameters). The calibration parameters allow you to apply a grinding function that aligns the lines of the left camera with those of the right camera. This operation makes it possible to accelerate and make more robust the pairing between the points of the two images corresponding to the same 3D point. The chosen transformation must take care to preserve the quality of the signal contained in the image (minimization of smoothing and interpolation). An example of this type of algorithm is presented in the article by Loop and Chang, entitled "Computing rectifying homographies for stereo vision" Int. CVPR Conference, 1999 Once the two images have been corrected, a mapping of the two images provided by the cameras is then performed, the purpose of which is to find the homologous points between the two images, that is to say the projections of the same points of the scene. imaged. We thus identify a point pl in the left image and a point p2 in the right image are the projection of the same point P of the image scene. The X, Y, Z coordinates of this point P can then be calculated. To do this, the first image is scanned and for each pixel of this image, the second image acquired at the same time is searched for the pixel corresponding to the same physical point. Thanks to the correction, this pixel is on the same line of the second image as the original pixel of the first image. This constraint reduces search times and the risks of error. To perform the search, we consider a neighborhood of the original pixel and we search along the line for the pixel having the most similar neighborhood. Different correlation scores have been proposed in the literature, compromised between quality and speed. This search is iterated for all the pixels of the line of the original image, then to all the lines of this same image. Order constraints between successive pairings as well as so-called "global" algorithms make it possible to consolidate the pairings made by eliminating the aberrant results. For each pairing, we can save the distance between the columns of the two paired pixels: we speak of disparity, this disparity being linearly related to the depth of the corresponding 3D point. During the last step, for each pairing made between the two images and using the knowledge of the calibration parameters of the system, the corresponding 3D point can be reconstructed by triangulation. For all the pairings made between the two images, we reconstruct a set of 3D points whose coordinates are expressed in the reference of one of the cameras (or in an arbitrary reference rigidly linked to one of the cameras). By orienting the stereoscopic head towards the rows of maize, the reconstructed 3D points correspond to points of the "canopy". It is thus possible to reconstruct a surface based on these reconstructed 3D points and thus to model the imagined scene. Once reconstructed, this surface can be analyzed to determine the ridges connecting the vertices of the feet belonging to the same rank and the valleys corresponding to the inter-row space. In addition, to facilitate the search for these areas of maximum curvature, the reconstructed 3D surface being expressed in the reference of the stereoscopic head and can therefore be expressed in the reference system of the vehicle, the desired ridge lines and valleys are in one direction parallel to the movement of the vehicle. Depending on the width of the field of view of the stereoscopic head, several rows can be imaged simultaneously. The stereoscopic imaging system can be adapted to simultaneously image and measure the height of several rows of culture. The 3D reconstruction thus provides an information representative of the relief of the scene pictured in matrix form in rows and columns where each point of the matrix provides information representative of the distance between the stereoscopic imaging system (more precisely the midpoint between the cameras on the baseline) and the top of the plants present in the pictorial scene. The computer processing unit can be configured to identify for each line or line portion of the 3D reconstruction the highest point, or calculate for each line or line portion of the 3D reconstruction the average of the points present on the line or line portion of the 3D reconstruction. portion of line, so as to provide the height measurement information on a crop row. The cameras of the stereoscopic imaging system can be mounted so as to be fixed relative to the agricultural vehicle, either being directly on the vehicle or supported by the operating arm. Alternatively, they may be mounted so as to be fixed relative to the tool arm, for example being positioned on its vertical upright before 12. A simplified model of the arms 1, 3 with a tool O and the height measurement sensor 2 of the first embodiment (light curtain) is proposed in FIG. 3. In the following, a method for determining the instructions is thus presented. of control using a measure of height of corn made by a curtain of light. To calculate the absolute height at which the mid-point of the sensor sensor is located, the angle Θ, measured for example by means of an angular position sensor C, between the vertical rear upright 31 and the amount of link 33 of the operating arm 3. It is also possible to use cylinders incorporating a measure of their elongation. By geometry, we obtain the following relation: hE = H ± + H2 - L2 cos Θ (1) We can also determine the following relation: h-absolute but usually a refative sensor but (2) h-E "f" HbLent-sensor "h -referred but With HbLent_sensor the difference in height between the front end of the connecting post 33 (point E) and the middle of the height measurement sensor 2, and hrelative maize the relative height of the corn with respect to the middle of the height measuring sensor ( value between -300 mm and +300 mm for a light curtain of length L 600 mm sensor). The height sensor 2 returns a U sensor voltage between U vacuum sensor> the vacuum sensor voltage, and Umax sensor> 13 maximum sensor voltage (10V for the sensor used), proportional to the height of the last beam obstructed by the corn. The relative height of the maize maize corn with the formula: hrelative but 7J _ jj (JJensensor U vacuum sensor) 0.5 L umax sensor vacuum sensor sensor (3) Similar calculations are applicable in the case where a vision sensor is used as a substitute for the light curtain. These calculations are to be adapted according to whether the vision sensor is integral with the tool arm, the operating arm or the vehicle. Once the corn height has been determined for each row, the computer determines the control instructions for the arms for each row, which consists in determining, for each row, the height of the tool used tools for the tool arm 1, and the height hE of the front end of the connecting post 33 of the operating arm 3. When the operating arm 3 supports a plurality of tool arms, the command setpoint of the operating arm can be the average of the setpoints hE determined for each row. Thus, when the system comprises at least two tool-carrying arms connected to the connecting member, each tool-carrying arm being associated with a crop row, the computer is then configured to: - determine the control setpoint of each of the tool arm from height measurements of the plants present in the row associated with the tool arm; calculating an intermediate instruction for controlling the operating arm for each of the ranks from measurements of the height of the plants present in each of the ranks; and - average the intermediate instructions calculated for each row to determine the control setpoint of the operating arm, after possible filtering of the intermediate setpoints to avoid unnecessary movements. Subsequently, thanks to equation (1), the angle Θ to be enslaved: (4) Finally, we note that: (5) Hence the following relationship setting the angel to enslave between the rear post 11 and the connecting post 14 of the tool arm: (6) According to different possible embodiments of the invention, in equation (6), it is possible to consider hE as being derived from the calculation of the command reference of the operating arm, or as being the height of the point E used at the time of calculation (either H1 + H2 - L2 cos Θ, with Θ the measurement of the angle obtained by the angular position sensor). Different strategies for developing control instructions for arms 1, 3 are detailed below. The objective of the knife cut is to clear the view of the row by cutting just enough leaves and panicles so that they can still push back later. The cut must therefore be relatively homogeneous, without creating too many irregularities. The ideal cutting height of the panicle is three quarters of it. This involves identifying the height of the base and the top of the panicle to locate three quarters, which is difficult to reproduce with sensors, since the panicle can be hidden within the cornet. In addition, imposing a cutting height to a certain number of centimeters below the top of the foot is not suitable because the panicle may as well be close to this vertex as much lower. It is therefore necessary to obtain a relative measure, adapted to each foot of corn and to different architectures of plants (upright growth, drooping leaves, ...). When pulling, it is necessary to remove all panicles that have grown back. As the panicles grow faster than the leaves, the goal is to keep the leaves evenly above the panicle. For this, it is necessary to limit abrupt variations of height during the cutting in order to then be able to follow these variations during the pulling. For the pulling, it is necessary to come to place the rollers or the tires as close as possible to the top of the leaves in order to tear out the panicles that protrude without removing too much leaves. Several strategies can therefore be considered according to their relevance for cutting or grubbing. Each strategy can be based on the fact that the time elapsed between two acquisitions of the height measurement sensor is converted into distance traveled thanks to the speed calculated at each moment. The curtain of light being located upstream of the tools (similarly, a vision sensor comes to image a scene located upstream of the tool or tools), the instruction to send to the actuators of the cylinders 15, 35 at a time t n ' is not calculated thanks to the acquisition of the sensor at the same time t but thanks to the previous acquisitions. Thus, the acquisitions are stored as and then the instruction is calculated from a small sample of acquisitions, the first acquisition being located at a distance d-offset of the current acquisition. The setpoint is then calculated from the acquisitions included over a distance dEch which correspond to the acquisitions of the plants currently at the level of the tools. The setpoints sent are thus calculated from previous measurements made while the measurement sensor was traveling the distance dEch or imagined the canopy over the distance dEch in the direction of travel of the vehicle upstream of the current position of the tool or tools. Thus, the system according to the invention may furthermore comprise a memory in which the measurements made by the height measurement sensor are recorded, and the computer may be configured to supply the control instructions on the basis of measurements previously recorded in the memory and corresponding to the acquisitions relating to plants that are found over a distance dEch upstream of the current position of the tool or tools. In the context of this embodiment, it is important to know precisely the speed of movement of the vehicle to work not in time elapsed but in distance traveled. To do this, the system may comprise a sensor for measuring the speed of travel in the direction of travel of the vehicle, and the computer is then configured to determine the distance traveled along the direction of travel between two measurements successively made by the height measurement sensor. In other words, it is possible to time stamp the samples in memory with the instantaneous speed, to then make it possible to determine, at the time of the calculation of the instructions, which are the samples corresponding to the acquisitions relating to the distance dEch in the direction of vehicle path upstream of the current position of the tool (s) (more or fewer samples depending on whether the movement is fast or slow). The speed measuring sensor may consist of an inductive proximity sensor associated with a plastic wheel fixed in the rim of a wheel of the vehicle and on the perimeter of which metal pins are arranged. At each passage in front of a metal pin, the signal at the output of the sensor is modified. Thus, the speed of advance can be deduced by calculating the time elapsed between two rising edges of the output signal, that is to say between two metal pins, knowing the length of the rope between these two points. In one embodiment, a greater distance dEch is considered for the operating arm (equivalent for example to the distance between 4 to 6 plants) than for the tool arm (equivalent, for example, to the distance between 2 to 4 plants ). Indeed, the objective of the tool arm is to individualize cutting or tearing, tending to a specific plant-to-plant treatment, while the maneuverable arm simply serves to adjust to an average height at which the or the tools must be placed. Thus, in this embodiment, the computer is configured to determine the control setpoint of at least one tool arm on the basis of height measurements of plants present on a first distance upstream of the current position of minus one agricultural tool in the direction of travel of the vehicle, and to determine the control setpoint of the operating arm on the basis of plant height measurements present a second distance upstream of the current position of the at least one tool in the traveling direction of the vehicle, the second distance being greater than the first distance. The calculation of the instructions from measurements of the absolute height of maize maize corn can be achieved in different ways according to the chosen strategy. In one embodiment, the computer is configured to determine a command setpoint of an arm from the average of said measurements previously made by the height measuring sensor over a predetermined distance dEch. This embodiment corresponds to a strategy called "average" according to which for the acquisitions of dEch, one calculates the average height of corn. The instruction sent is then equal to this average height at which we can subtract a height h0ffSet that depends on the cut variety. This strategy has the advantage of encompassing the voids between two feet. It is intended to be used for cutting knives. In another embodiment, the computer is configured to determine a command setpoint of an arm from the maximum of said measurements previously made by the height measurement sensor over a predetermined distance dEch. This embodiment corresponds to a so-called "maximum" strategy according to which, for the acquisitions of dEch, the maximum height among the heights of corn on this sample is determined. The instruction sent is then equal to this maximum height at which we can subtract a height h0 ^ set that depends on the cut variety. This strategy is more for pulling up the rollers. It has indeed been verified that the panicles measuring about 10 mm in diameter are not detectable by the light curtain, only the leaves are detected by drawing a relatively straight profile after cutting the knives. The objective is here to come and place the rollers just at the top of this profile, knowing that everything that exceeds can only be the tassel and will be torn off. In yet another embodiment, the computer is configured to calculate a leaf density indicating, for each height interval of a set of successive intervals, the percentage of measurements among said measurements made by the height measurement sensor on a predetermined distance dEch which have a height greater than the lower limit of the height interval, and to determine a command setpoint of an arm from the lower limit of the height interval corresponding to a threshold percentage. This embodiment corresponds to a strategy called "leaf density" according to which for dEch acquisitions, the minimum height among the corn heights on this sample is identified. Then a loop is created that defines a current height equal to the minimum height incremented by 5 mm for example at each loop turn and the percentage of acquisitions that correspond to a height greater than this new current height is calculated. Thus, for the minimum height of the sample, 100% of the sample acquisitions have a height greater than the minimum height. Then as the current height increases, fewer and fewer acquisitions have a height greater than the current height. This percentage corresponds to what is called a leaf density. A threshold is defined from which it is estimated that the leaf density is sufficiently low to correspond to the optimal cutting height: in fact, the closer one gets to the top of the plant, the more the leaf density is supposed to decrease. It will be noted that conversely the leaf density can be estimated starting from the maximum height and coming to verify the percentage of acquisitions having a lower height. The setpoint sent is then equal to the current height corresponding to this threshold S, from which we can subtract a height h0 ^ set which depends on the cut variety. This strategy is intended to be used for knife cutting. It is closer to the ideal measure of three quarters of panicles: indeed, we imagine that at this ideal height there is only a certain percentage of leaves. In addition, it takes into account the architecture of the plant: for a variety with drooping leaves, there will be more leaves around the panicle than for an upright variety. In the context of the invention, each of the control commands (that of the tool arm or arms and that of the operating arm) can be developed by applying a strategy with a setting of its own. The same strategy is preferably used for each of the setpoints with the same values for h0 ^ set, but considering a greater distance dEch for the operating arm than for the tool arm or arms. The distance d0 ^ set may also be lower for the operating arm than for the tool arm or arms. The invention is not limited to the system as previously described but also extends to a vehicle, in particular a straddle, equipped with one or more operating arms, at least one of which is equipped with the system according to the invention. . It also extends to a method of adjusting the height of an agricultural implement by means of a system according to the invention, comprising the steps of: - acquisition of measurements of the plant height measurement sensor; determining a command setpoint of at least one tool arm from the measurements acquired; - Determining a command set of the operating arm from the acquired measurements.
权利要求:
Claims (14) [1" id="c-fr-0001] A robotic system for use in agriculture, comprising at least one tool arm (1) for carrying an agricultural implement (O) and operable to raise or lower the agricultural implement, a sensor (2) for measuring the height of plants, and a computer configured to determine a control setpoint of the at least one tool arm from measurements made by the plant height measurement sensor, characterized in that the tool-carrying arm (1) is connected to a connecting member (4) enabling it to be installed on an operating arm (3) fitted to an agricultural vehicle, and in that the computer is furthermore configured to determine a command setpoint the operating arm (3) for raising or lowering the tool arm from measurements made by the plant height sensor. [2" id="c-fr-0002] 2. System according to claim 1, comprising at least two toolholder arms connected to the connecting member, each toolholder arm being associated with a crop row, and wherein the computer is configured to: - determine the setpoint controlling each of the tool arms from height measurements of the plants present in the row associated with the tool arm; calculating an intermediate instruction for controlling the operating arm for each of the ranks from measurements of the height of the plants present in each of the ranks; and - average the intermediate instructions calculated for each row to determine the command setpoint of the operating arm. [3" id="c-fr-0003] 3. System according to one of claims 1 and 2, wherein the at least one tool arm has a deflection whose amplitude is less than that of the movement of the operating arm. [4" id="c-fr-0004] 4. System according to one of claims 1 to 3, wherein the computer is configured to determine the control setpoint of the at least one tool arm on the basis of plant height measurements present on a first distance. upstream of the current position of the agricultural implement in the direction of travel of the vehicle, and to determine the control setpoint of the operating arm on the basis of height measurements of plants present a second distance upstream of the current position of the agricultural implement in the vehicle travel direction, the second distance being greater than the first distance. [5" id="c-fr-0005] The system of claim 4, further comprising a speed measuring sensor in the vehicle travel direction, and wherein the computer is further configured to determine the distance traveled along the travel direction. between two measurements successively carried out by the height measurement sensor. [6" id="c-fr-0006] 6. System according to one of claims 4 and 5, wherein the computer is configured to determine the control instructions of the at least one tool arm and the operating arm from the average of said height measurements of plants. [7" id="c-fr-0007] 7. System according to one of claims 4 and 5, wherein the computer is configured to determine the control instructions of the at least one tool arm and the operating arm from the maximum of said height measurements of plants . [8" id="c-fr-0008] 8. System according to one of claims 4 and 5, wherein the computer is configured to calculate a leaf density indicating, for each height interval of a set of successive intervals, the percentage of measurements among said height measurements of which have a height greater than the lower limit of the height interval, and to determine the control instructions for the at least one tool arm and the operating arm from the lower height corresponding to a threshold percentage. [9" id="c-fr-0009] 9. System according to one of claims 1 to 8, wherein the height measuring sensor (2) is a light curtain apparatus composed of a transmitter (E) in the form of a column of light sources and a receiver (R) in the form of a photoreceptor column, the transmitter and the receiver being mounted so as to face each other and extend in their longitudinal direction perpendicularly to the ground to enable the height of the receiver to be measured; plants present between them. [10" id="c-fr-0010] 10. System according to one of claims 1 to 8, wherein the height measuring sensor is a stereoscopic imaging system comprising two cameras mounted so as to be able to image, from two distant points of view, the same scene located in front of the agricultural tool in a direction of travel of the vehicle, and a computer processing unit configured to develop, from the images delivered by the cameras, a 3D reconstruction representative of the relief of the imaged scene. [11" id="c-fr-0011] 11. System according to one of claims 1 to 10, wherein the agricultural tool is a tool for cutting or tearing plants, especially corn. [12" id="c-fr-0012] 12. Agricultural vehicle equipment comprising an operating arm (3) and the system according to one of claims 1 to 11 preinstalled on the operating arm via the connecting member (4). [13" id="c-fr-0013] Vehicle equipped with equipment according to claim 12. [14" id="c-fr-0014] 14. The method of adjusting the height of an agricultural implement (O) by means of a system according to one of claims 1 to 11, comprising the steps of: acquisition of measurements of the plant height measurement sensor. determining a control setpoint of the at least one tool arm from the measurements acquired; determining a command setpoint of the operating arm from the acquired measurements.
类似技术:
公开号 | 公开日 | 专利标题 EP3226672B1|2018-11-28|System and method for the automatic adjustment of the height of an agricultural implement using 3d reconstruction EP3322277B1|2019-06-05|Two-armed robotic system for adjusting the height of an agricultural tool EP1608216B2|2018-08-22|Method and device for analysis of the structure and the composition of rows of vines EP3119182B1|2019-05-15|Machine for harvesting roots such as beets, having a means for automatic adjustment of the harvesting unit FR2994057A1|2014-02-07|Wine grape pruning robot, has controlling unit connected with treatment unit to direct cutting unit on cutting points, and reading and recording unit reading and recording images to project laser beam on grapes and branches RU2747303C2|2021-05-04|System for controlling the working parameter of a harvester EP1976367B2|2016-01-20|Machine for working the soil, such as a disc tiller FR3001102A1|2014-07-25|METHOD FOR CONTROLLING AN AUTONOMOUS AUTOMATED AGRICULTURAL DEVICE EP3226671B1|2018-11-28|System and method for the automatic adjustment of an agricultural implement using a measuring light screen EP3051936B1|2020-08-26|Agricultural machine for revisiting a planted plot; associated method EP0153893A2|1985-09-04|Rotating mechanical drill for simultaneously planting and mulching EP2986981A1|2016-02-24|System for characterising the physiological state of plants and corresponding method EP3918904A1|2021-12-08|Automated method for selecting and harvesting fruit and mechanical equipment implementing the method FR3097096A1|2020-12-18|Machine for harvesting roots, comprising means for automatic adjustment of the harvesting unit FR2800233A1|2001-05-04|Agricultural machine for cutting foliage and lifting root crops, sugar beet, planted in parallel rows, has row of position controlled combined cutting and lifting units mounted on front of a vehicle WO2020250044A1|2020-12-17|Methods of operating tillage implements and working fields FR3099683A1|2021-02-12|Cultivation system and method. FR3098083A1|2021-01-08|Cultivation system and method. FR3108826A1|2021-10-08|Self-adjusting market gardening device McCarthy et al.2007|A preliminary field evaluation of an automated vision-based plant geometry measurement system FR2781975A1|2000-02-11|Control system for regulating density of cultivated plants includes tractor with plant sensors on front, computer control in cab, and plant cutting or killing device on back
同族专利:
公开号 | 公开日 US10602665B2|2020-03-31| WO2017009334A1|2017-01-19| EP3322277B1|2019-06-05| FR3038810B1|2017-07-21| US20180199502A1|2018-07-19| EP3322277A1|2018-05-23|
引用文献:
公开号 | 申请日 | 公开日 | 申请人 | 专利标题 AU5387473A|1973-03-15|1974-10-03|Nicholls John|Harvester improvement| US4183411A|1978-01-09|1980-01-15|Bourquin Design and Mfg., Inc.|Weed puller apparatus| US4197691A|1978-09-25|1980-04-15|Hagie Manufacturing Co.|Detasseling device depth adjusting control system and method| FR2632486A1|1988-06-09|1989-12-15|Garriguenc Bernard|Machine with belts for heading maize with a height-correction device using photoelectric sensors| US20120304610A1|2011-06-06|2012-12-06|Walter Dunn|Cut Sight Gauge| GB2495497A|2011-10-10|2013-04-17|Shelbourne Reynolds Eng|Cutting apparatus having means for measuring load| US3855761A|1972-02-10|1974-12-24|G Louks|Apparatus and method for removing tassels| US3769782A|1972-02-11|1973-11-06|Paul S Machine & Welding|Corn detasseling head| US4197694A|1978-09-25|1980-04-15|Hagie Manufacturing Co.|Crop height sensing assembly for mechanical detasseling devices| JPH0241295B2|1984-03-19|1990-09-17| FR2605834B1|1986-11-05|1989-01-06|Pellenc & Motte|ROBOTIZED MACHINE, PARTICULARLY FOR HARVESTING FRUITS| FR2763786B1|1997-05-30|1999-07-09|Pellenc Sa|ROBOTIZED MACHINE HAVING AT LEAST ONE ARM WITH SYMMETRIC PANTOGRAPH, FOR EXAMPLE FOR HARVESTING FRUITS OR SORTING VARIOUS OBJECTS| CA2874485C|2012-05-23|2017-06-13|Mtd Products Inc|Vertical tine tiller| AU2014290850B2|2013-07-18|2018-04-26|Plant Detection Systems Limited|Improvements in, or relating to, plant maintenance| US9788486B2|2014-12-30|2017-10-17|Agco Corporation|Grain header with swathing and chopping capability|US10342176B2|2016-07-13|2019-07-09|Monsanto Technology Llc|Angled sensor bar for detecting plants| US10238031B2|2016-08-03|2019-03-26|D'arrigo Bros Co. Of California|Harvester for leafy plants| EP3661347A1|2017-08-03|2020-06-10|Vilmorin & Cie|Agricultural tool and agricultural vehicle comprising such agricultural tool|
法律状态:
2016-07-29| PLFP| Fee payment|Year of fee payment: 2 | 2017-01-20| PLSC| Search report ready|Effective date: 20170120 | 2017-07-31| PLFP| Fee payment|Year of fee payment: 3 | 2018-07-27| PLFP| Fee payment|Year of fee payment: 4 | 2019-07-31| PLFP| Fee payment|Year of fee payment: 5 | 2021-04-09| ST| Notification of lapse|Effective date: 20210305 |
优先权:
[返回顶部]
申请号 | 申请日 | 专利标题 FR1556701A|FR3038810B1|2015-07-16|2015-07-16|TWO ARM ROBOTIC SYSTEM FOR ADJUSTING THE HEIGHT OF AN AGRICULTURAL TOOL|FR1556701A| FR3038810B1|2015-07-16|2015-07-16|TWO ARM ROBOTIC SYSTEM FOR ADJUSTING THE HEIGHT OF AN AGRICULTURAL TOOL| US15/743,755| US10602665B2|2015-07-16|2016-07-12|Two armed robotic system for adjusting the height of an agricultural tool| EP16741580.1A| EP3322277B1|2015-07-16|2016-07-12|Two-armed robotic system for adjusting the height of an agricultural tool| PCT/EP2016/066536| WO2017009334A1|2015-07-16|2016-07-12|Two-armed robotic system for adjusting the height of an agricultural tool| 相关专利
Sulfonates, polymers, resist compositions and patterning process
Washing machine
Washing machine
Device for fixture finishing and tension adjusting of membrane
Structure for Equipping Band in a Plane Cathode Ray Tube
Process for preparation of 7 alpha-carboxyl 9, 11-epoxy steroids and intermediates useful therein an
国家/地区
|