Title of Invention

METHOD AND SYSTEM FOR VOLUME-SPECIFIC TREATMENT OF GROUND AND PLANTS

Abstract A system for carrying out the method of treating the ground and plants as required and in a volume-specific manner, especially by the application/metering of spray agents like plant-protective agents and/ or fertilizers as well as water, the working of the soil, undergrowth maintenance and/or the working and treatment of the plants, of trees such as trees along roadways or forest trees or the like, in limited area cultivations, especially grape and fruit cultivation, hops, citrus, olives or the like, shrubs or bushes like bananas or the like in uniformly or nonuniformly planted areas in which the plants are scanned with a monochromatic pulsed laser beam produced by an individual sensor displaced past the plants and circulating onto the plants while affixed to a traveling carrier, the radiation spectrum reflected from the leaf structures being picked up by this sensor and the acquired spectrum being converted into optical signals and these signals being fed to a computer which stores the signal, evaluates them and controls the application/dosing of the spray agent doses as a function of the vegetation state or controls the working of the soil and the treatment of the plants as well as the harvest by outputting of switching commands to control the spray device arranged upon the traveling carrier and blowers and/or working implements with a travelling carrier, for example a vehicle and/or agricultural implement coupled thereto, a sensor affixed to the carrier with a radiation source for transmitting a pulsed laser beam, a mirror rotatable about a vertical axis for training the beam onto a foliage wall, a radiation receiver for collecting the radiation reflected from the foliage wall, a computer for processing the reflected radiation and for controlling nozzles affixed to the carrier of a spray device with a supply vessel for the spray agent whereby the nozzles are arranged at a certain distance from the sensor, a liquid pump for displacing the spray agent to the nozzles, valves for opening and closing the nozzles and a blower for producing a two phase flow characterized in that mirror (41) is configured as a shaped mirror having a partial region (5, 6), inclined at different triangles with respect to the rotational axis of the mirror (4') is arranged eccentrically to the radiation path (10) of the emitted radiation and received radiation.
Full Text ORIGINAL
1009/MUMNP/2003THE PATENTS ACT, 19 7 0 (39 of 1970)
COMPLETE SPECIFICATION See Section 10, rule 13]
METHOD AND SYSTEM FOR VOLUME- SPECIFIC TREATMENT OF GROUND AND PLANTS
KUMMEL, KNUT of HOHENZOLLERN, STRASSE 11, 12 3 0 7 BERLIN, GERMANY, GERMAN national
The following specification particularly describes the nature of the invention and the manner in which it is to be performed : -

liquid pump for displacing the spray agent to the nozzles, valves for opening and closing the nozzles and a blower for producing a two phase flow
The invention relates also to a System for carrying out the method with a 5 traveling carrier, for example a vehicle and/or agricultural implements coupled thereto, a sensor affixed to the carrier with a radiation source for emitting a pulsed laser beam, a mirror rotatable about a vertical axis for training the radiation on a foliage wall, a radiation receiver for collecting the radiation reflected from the foliage wall, a computer for processing the reflected radiation and for controlling at least one 10 agricultural implement affixed to the carrier, whereby the implement devices are spaced at a given distance from the sensor.
In the treatment of plants with liquid plant protective agents and/or fertilizers, a certain predetermined dose of the effective material must be reliably
15 applied to all of the targeted surfaces of the plants or the problem creators thereof. For the application of such effective materials in limited area cultures like grapes, fruit, hops, citrus, olives, among others, blower spray units are used which apply liquid droplets of the atomized plant-protective agent in two-phase free flow to the targeted surfaces of the plants, to the sides and above the spray device as it is
20 transported past them. The spray device thus travels along a path between plant rows. Depending upon the snaps of the vegetation and cultivations, the plants can be so cultivated that they form above the travel path closed vegetation over, especially a pergola cover in the case of wine grapes or a hollow crown configuration in the case of orchards.
25
For the application of local plant-protective agents in limited field cultures like grapes, orchards and hops, spray devices with ultrasonically-controlled nozzles (DE 39 00 221 A1, DE 39 00 223 A1) or optically-controlled or laser-controlled nozzles (see DE 195 18 058 A1, EP 0 554 732 A1, EP 0 743 001A1) are used. This
30 known devices have multiplicities of individual nozzles which are controlled by individual sensors. The individual sensors detect the presence of target surfaces in the sensing regions of the sensors.
3

From the course of the sensor signals, a yes-no decision is derived for each height region so that the treatment of the plants can be immediately interrupted then and there where there is no plant-like target surface which can be riched by the spray jet of the device. 5
In accordance with DE 195 18 058 A1, the plants are detected with individual sensors disposed one above another, preferably optical sensors, in a zonewise manner corresponding to the nozzles assigned to the different heigth regions of the plants. The plants are thus recognized only in small strips in a
10 sampling process over their heights. Between the sensors, horizontally growing branches or tendrills remain unrecognized. Any information as to distance for the respective spacing between nozzle and target which corresponds to the requisite travel path for the droplets of the sprayed agent is not available. This means that for the application of the spray agent, an anticipatory opening and closing of the spray
15 nozzle cannot be achieved and thus the processing agent in zone which are spaced from the spray device, for example open apexes of a tree or vine, are not reliably coated in a targeted manner. These zones are, however, from a phytopathological point of view especially and must, for protection of the cultivation against infection, be reliably treated.
20
From U.S. Patent 5 278 423 A1, there is, further, a solution known in which the individual circulating laser sensors are used for detection of foliage and can be used for the control of an agricultural spray device using an output signal which can be employed to control the spray process. In this spray process a pulsed
25 laser beam is produced utilizing a pulsed trigger signal, the laser beam being emitted from a sensor. A receiver collects reflected laser radiation from apoint on the targeted tree, whereby the receiver can be provided with an outlet for a selected pulsed beam representing a transit time which corresponds to the transit time from the target point to the receiver. The pulsed laser beam scans the foliage of the targeted tree vertically
30 whereby the scanning is determined by an angle which corresponds to the angle of the laser beam relative to a reference angle.
A setting of the sensor during a scanning cycle is determined in which the scanning cycle is a complete circuit of the laser beam around the axis of a spray path
4

in a vertical scanning plane with a setting along the axis defined by the spray movement. Then a number of given spray regions are determined. The spray regions have a predetermined direction and the spray heads arranged on the sprayer open to discharge the spayed agent. The operating regions, the angle and the spacing i information are processed by a microprocessor to the appropriate movement range of the sprayer to take into consideration the tree height and the corresponding setting of the spray head for this height in a scanning measurement.
The sensor used in this known process includes a laser means for 10 determining a range from the sensor to a collection of trees with foliage lying in a row and along which the sensor is moved and for outputting data as to this range, which has a sensor angle for each data output of the range, means for determining a travel stretch for the sensor along the foliage whereby the travel stretch represents the distance between the sensor spray heads, means for processing corresponding 15 output data as to the range and the travel path for determining the presence and the signature of the detected foliage, whereby the processing means outputs control signals form conventional agricultural sprayers.
With this known solution, entire foliages or crowns for shadows areas can 20 be regocnized as units, with the aid of which the nozzles for applying the spray agent can be switched. Neither gaps within these units which take into consideration the development of the vegetation of the plants and their structural information nor information as to the depth of the leaf walls are considered. This means that the application of the spray agent is not spatially specific to the requirements of the 25 plants and remains inexact, as a result of which the spray agent consumption may be correspondingly excessive or ineffective. This known solution is therefore only suitable for very high cultivations with a very large row spacing and upright plants, individually separated in each row.
30 Furthermore all of these known solutions for the measurement of travel
require wheel sensors for a vehicle wheel. The rolling wheel on unconsolidated, differently structured surfaces, continously undergoes slip which, depending upon the arrangement of the sensors and the nozzles, can give rise to errors with respect to the targeting precision in the application of the sprayed agent. Rolling movements of
5

the sprayer during its travel over the unconsolidated traveled way gives rise to lateral discolation of the individual sensors when these are located above or below the rolling center of gravity. This contributes to errors in the distance measurement as a function of the sensor position relative to the rolling center of gravity. The reference 5 measurement points of the individual sensors shift vertically on the foliage wall which can encopass other surfaces than the zones of interest.
In the treatment of the spray edge zone of a plant crown, the rolling movement either gives rise to overspray of the leaf walls or a failure to treat the 10 phytophylologically sensitive peak regions sufficiently at all with the spray unit.
DE 19? 26 917 A1 describes a method for the contactless scanning of
contours in which the contours above the ground are detected by means of a laser
beam transmitter/receiver device which, while the agricultural machine is traveling,
15 continously detects distances to the contour across the scanning width and stores
the values thereof. With a timing unit, a position determination is made.
In DE 44 34 042 C2, an arrangement for the contactless detection of travel related data from spatially separated objects is obtained which move along a
20 travel path, street or track branch as monitoring surfaces, in which a laser, a light receiver and an evaluation device are provided which carry out a distance measurement by means of optical transit time measurement, and can be provided with a scanning device which deflects the laser beam that this describes the envelope of a cone in its circulatory movement, the axis of symmetry and this cone
25 being orthogonal to or inclined to the monitoring surface.
In view of this state of the art the invention has its object to improve upon a method and a system of the type described at the outset wherein the stand of planting is sensed in a spatial gap-free manner and the effect of the ground condition 30 and plant condition can be taken into consideration simultaneously with morphological and plant physiological characteristics in a location-specific und technologically efficient manner.
6

This objects are achieved with a method of the type described at the outset but with the characterizing features of claim 1 and a system with the characterizing features of claim 31 and 32.
5 Advantageous refinements of the method and the system will be
deducible from the dependent claims.
The invention will be described in greater detail in the following in connection with a number of embodiments.

The drawing shows:
Fig. 1 a schematic illustration of the sensor according to the invention,
Fig. 1 a a schematic illustration of the arrangement of the sensor on the
15 carrier,
Fig. 2 a schematic illustration of the scanning of a stand of plant with
laser beams,
Fig. 3, 3a and 3b the process structure and the sequence of the method according
to the invention and
20 Fig. 4 a diagramm of the fundamentals of the ring storage used.
Example 1
The method according to the invention is initially described with 25 respect to the region with uniformly disposed plants of a limited area cultivation like wine grapes.
The system according to the invention for the volume specific application of spray agents, for treatment and for processing of plants in a limited 30 area cultivation whose individual plants are disposed close together in rows defining travel paths between them is comprised basically of a traveling carrier 1, for example a tractor, which supports a spray unit 2, a blower for generating a two-phase flow, a central laser sensor 3 which rotates during travel of the carrier along the traveling path and a computer for processing all of the data obtained by the sensor. A
7

container for receiving a spray agent belongs to the sprayer 2 together with a feed pump for displacing the spray agent to the spray nozzles, and valves for opening and closing the nozzles. When the agricultural [soil-working] implements are used, these are fastened correspondingly to the traveling carrier 1.
5
The sensor 3 comprises, as has been schematically illustrated in Fig. 1 and 1a, a mirror 4'which is arranged to rotate about an axis A. The mirror is inclined differently [at different angles] to the rotational axis A and is configured as a shaped mirror. In this embodiment the mirror 4'is so constructed from pie-shaped 10 circular segments 5 and 6 that the segment 5 has an inclination of 45° with respect to the rotational axis A and the segment 6, an inclination of 67,5° with respect to the rotational axis A, i.e. 22,5° to a normal to the rotational axis A.
The sensor 3 is comprised of a radiation source 7 and a receiver
15 8. The rotary displacement of the mirros 4' is followed by a rotational angle measurement. Light pulses produced by the radiation source 7 are distributed via the deflection mirror 4 and the shaped mirror 4'in space within the travel path. The ovjects which are encountered by the radiation beam (foliage walls, leaves, stems shoots and the like) reflect the radiation back via the deflecting mirror 4 and the
20 shaped mirror 4'and this radiation is focused by an optical system 9 onto the receiver 8.
So that the sensor 3 has a free field of view [aperture] for the transmission and received beams, it must be so fixed on the carrier 1 that a sufficient field of view is ensured. The sensor 3 acquired the plants of the strand laterally and
25 above the sprayer 2 in a grid of iaser scan points which, as the carrier 1 advances along its travel path, passes in a strip shape in helical pattern along the plant row. With an angular resolution of, for example 1°, vertical spacing of the scanning point of several cm on the foliage of plant rows with a row spacing of 5 m is possible without further effort. In this example measured values of a grid pattern of about 5 x 5 cm can
30 be resolved with a high degree of resolution with travel speed usually of 1 to 8 km/h.
The laser beam is so deflected in the travel direction vertically and forwardly to the side that it sweeps over a conical surface segment open in the travel direction. This part of the laser beam encounters the lower regions of the plants
8

along a line which encompasses objects lying next to one another horizontally. The part of the conical surface segment which in the travel direction lies furthest vertically intersects the ground and forms an arrangement in which the laser beam can be deflected opposite to the travel direction. 5
The rotational axis A of the shaped mirror 4'lies eccentrically in the beam path 10 of the sensor 3. Because of this eccentrically, the radiation-sweep plans of the emitted radiation oscillates by an amount corresponding to the eccentricity perpendicular to the main plane H. A corresponding offset is thus superimposed on 10 the conical surface. The amplitude of the offset follows a full sine curve during on revolution of the shaped mirror 4'.
Coarse values can be obtained with the aid of the distance measurement to further removed objects. Objects which lie laterally in the field of view of the sensor
15 3 give rise to offsets relative to the position of the sensor from one angle segment to another whereby the path can be determine when the distance to the observed object is known. In the case of structures with multiple shapes like the foliage walls of plants stands in a limited field culture, the distance measurement must allow for a selection of significant objects by a filtering of the information with respect to the
20 distance to the objects which are recognizable laterally of the carrier 1.
The beam from the pulsed infrared laser source is, as illustrated in Fig. 2, deflected by the rotating shaped mirror 4'for the upper scanning space by about preferably 90° from the beam direction and is distributed in a radiation plane in a
25 circular pattern. The infrared laser source 7 is thus so pulsed that, by means of the shaped mirror with a quasiuniform angular positioning (ratio of the light speed to the velocity of the mirror), the reflection signal from the beam-acquired objects is returned back to the receiver 8 of the sensor 3. The scanned region of the sensor does not lie in a single plane and encompasses a solid angle of more than one-
30 quarter of spherical segment.
Starting from one position on the carrier 1, the scan runs to the side and upwardly in a plane and for this region there is an angle of 45° between the shaped mirror 4'and the rotational axis A. In the travel direction the laser beam is deflected over a
9

reflection angle >45°. Thus the beam sweeps a conical surface which is directed forwardly in the direction of the travel path from the apex of the one, whereby the conical axis intersects the travel path in the center of the track of the carrier 1 ahead of the latter. With the conical surface, the plant rows on the sides (independently from 5 mirror angle and position) are scanned from a region of the beam in an approximately horizontal path or slightly inclined path. In this region, the movement of individual objects (trunks, graps stalks, tree poles or the like) or structures (crown volume, front contours of the crown or the like) are so followed, that the structures are determined therefrom and the pattern of the structure relative to carrier are
10 recognized. From this the distance in the row is determined. Since the plants are cultivated for years in the same place, these positions can be ascertained from the known locations of the plants and the distance therefrom to the carrier and an identification of the plants can be effected. Errors in both measurements can be corrected by appropriate logic.
15
The scanning plane of the radiation path with a 45° inclined mirror 4', acquires the plants, especially wine grapes, in a pergola configuration or a Mediterranean arrangement with a hollow crown in a vertical direction laterally and above the carrier in a closed arc. Because of the eccentricity, the beam in the course
20 of mirror rotation has superimposed thereon the aforementioned sinusoidal offset perpendicular to the travel curve. The amplitude is determined by the eccentricity of the mirror angle. Because of the rotational movement of the mirror 4', the offset has always the same magnitude at each location of the travel curve and since this is taken into consideration, the offset does not bring with it any functional disadvantage.
25 For the localization and measurement of plants and determination of the position of a carrier 1 with a spray device 2 for applying a spray agent in row cultivation, the mirror 4'of the sensor 3 is so configured that a planar and a spatially curved region can be used. The shape and extent of the planar mirror region determines the optical characteristics of the sensor 3 in term of range and sensitivity. A spatially high
30 resolution light-point grid (raster) of a laser beam from a central radiation source 7 avoids measurement errors which can be arise when individual sensors are arrangwed along a line at different positions and as a result of the travel motion of the carrier.
10

The centra! sensor 3 can be positioned in this example in the region of the center of gravity of the carrier so that translation movements and radiation movements of the sensor itself as a consequence of intrinsic movements of the carrier 1 can be taken into consideration and corrected. 5
The space curve with which the region around the carrier 1 ahead of,
laterally of and above the carrier 1 is observed, has in the region of the transsition
from one mirror segment to the other, reduced optical power. In this region, the stand
of plants is always positioned especially close to the sensor 3 so that a reduced
10 optical power is not a problem.
The arrangement of the sensor 3 is possible both on the carrier 1 and upon the implement.
15 The sensor 3 can not only be used to control the application of spray
agents but is also capable of being used for horticultural purposes in limited area cultivation, nonuniform plantings with trees, shrubs, bushes or the like which today are monitored with different sensors and feelers to detect the grape stalks and trunks and are used for control (mowing, cutting of stalks, binding, deleafing or foliage
20 regions, undercutting of weeds of the rows between trunks or stalks, mulching with grass and with pieces of woods, loosening, sowing, fertilizing and transport). It can be especially be used to control the displacement of complete grape harvesters (number, color, ripeness and the like).
25 The system according to the invention is capable of use for automatic
application processes. It eliminates the need for adjustment at the sensor and the carrier. The data acquired with the system according to the invention and such information is useful especially advantageously for stock taking. Especially in the intensive cultivation of fruit, grapes and hops, many different factors can be
30 introduced and combined in order to achive given production targets, including for example, cutting, binding, deleafing, thinning out of fruit, watering, fortilizing and the like. So that certain factors or combinations of factors can be used, the actual situation in the cultivation on the one hand and on the other, the expected or planed development of plants themselves as well as environmental conditions including
11

weathering, must be taken into consideration or are of significance. When the farmer who has to make decisions can access precise information as to the status of his plant stand, his decisions are more sound and the risk of erroneous decisions is minimal. Technologically precise and reproducible measurement relative to the size 5 of plants, which can be fully documented over long time periods, are extremely convenient and when easily made available can be of great utility.
Man have have been cultivating groves of fruit for millennis based upon horticultural factors like cultivation techniques, training and breeding intensively as 10 matched to local conditions including soil, climate and location.
With the aid of the method of the invention and the sensor, georeferenced, locally specific data as to plants can be acquired and used as the basis for a cultivation matched to the locality with optimization of the horticultural
15 processes and handling for the individual plants. For example, with the method according to the invention, the effects of plant protective agents which are used and/or other cultivation features on the plants which are subjected to the treatment, can be determined under the prevailing conditions individually, these conditions including the type of plant, the cultivation, training, fertilization, the climatic
20 conditions, weathering. With this information it is possible to determine dosage for future treatments of the same plant stand with compatible indications so that dosages and application timing of a particular composition or any preparation or other treatment features can be optimized with respect to cost and effectiveness, but also taking into consideration resistance induction and crop yield. This allows also local
25 dosing in individual partial dosages under different treatment conditions or positions and carrying out of horticultural operations as a function of the immediate requirements on individual plants at their individual locations.
With the method according to the invention, it is possible to derive both
30 local distribution of biological and phytophysiological signatures as well as a
distribution in time with each travel of the apparatus through the stand of plants. It is
thus possible to acquire and follow the effects of various factors and the prevalent
boundary conditions of individual plants together with the measurements with the
12

time. It is also possible to compare the influence of weathering on the effectveness over the years and to evaluate it.
With the method of the invention, whose sequence is schematically illustrated in Fig. 5 3, 3a and 3b, different stands of plants can be evaluated in a spatial manner and characterized from the point of view of morphology and physiology. The following morphological parameters of a stand of plants can be obtained:
Location of the objects, spacing of the objects and angular position of 10 the objects with respect to the center,
Contour of the leaf crown (from the course of the spacing measurements),Volume of the crown from the contour (based upon the assumption that the lighting or target is substantially symmetrical to the row center), 15
The location of the row center form the location of the foliage peaks and the trunks/stalks relative to the travel path,
Density from the spacing distribution relative to the dominating front 20 side signal (view through the structure of the foliage wall with impingement on the rear side with exclusion of impingement on objects lying further away by background meaking or cancellation),
Density, especially foliage density, i.e. area obstruction of the leaves in
25 the feaf waif of structure-forming crowns (without trees), spout growth or comparison
of contour and volume measurements with time, Number of fruit of sufficient fruit
size, Yield in number of fruit per area and per plant, As physiological parameters, in
the following are acquired:
Color from the level of the reflection signals based upon the assumption 30 that the objects are similarly colored and that comparable distance from the sensor are comparably reflective.
The absolute color is thus not of interest but rather the relative course of the signal is of interest as a measure of saturation of green coloration and thus the number of chlorophyll. This distribution gives an inication of the plant feeding or the distribution
13

thereof over the area of cultivation. From the color distribution, especially in the
blossoming of fruit trees, the distribution of blosom density can be taken as an
indicator of the alternance of the trees and the treatment to be matched thereto.
Vitality derived from the color distribution,
5 Viltality based upon the fluorescence spectrum upon evaluation of the
reflection radiation.
At a known spacing from an object, the reflection level of the received signal is a measure of the color, orientation and optical surface characteristics of the 10 reflecting object. By analysis of the signal level, a distribution of the optical signal over the area can be determined and used as a measurement for the vitality.
Natural green from a plant reflects light from the lower infrared portion of the spectrum siginicantly better than other objects (green peaks in the reflection
15 spectrum). This is dependent upon the type, the nutritive situation of the plants or the degree of ripeness of the fruit and so forth. If the degree of reflection of different lower infrared spectra are compared, it is possible to distinguish between chlorophyll-retaining enlivened plant parts and object retaining less chlorophyll like ripened fruit and objects which are not chlorophyll-retaining like fence posts.
20
The evaluation and utilization of signal level information presupposes that influences of the distance to the target object which can give rise to a spreading of the radiation and the reduction of the signal level is taken into consideration at increasing distances.
25
Differences in the reflection signal level can be then be quantifiable when the spacing information is taken into consideration and it is understood that it represents comparable target objects, for example leaves of a comparable vegetation stand upon travel through that stand. Signal level measured values at
30 comparable measurement distances supply basic information as to color-dependent cultivation characteristics which can be taken into consideration during the working of the cultivation. Without a differentiation between different spectra, one can obtain indirectly through the course of reflection signal level in space, an indication as to the distribution of vitality based upon the chlorophyll activity.
14

A laser beam encouters upon irradiation of a natural foliage wall individual or multiple leaves or sprouts in a random manner. This requires a special assignement of the corresponding distance information to the individual objects 5 encoutered by the beam. For this purpose, a multiplicity of timing circuits are started simultaneously when the beam is transmitted. Each timing circuit has another level value at which the time is stopped (cascade). With this system, a multiplicity of transmit times are measured for different reflection angles. The distance to partly encoutered objects is thus determined. With the aid of such an arrangement it is 10 possible to detect a particular reflection level arises from a target alone of from various objects, in which case the value is reduced. The vitality indication can thus be formed exclusively from reliable reflection values of individual objects.
The object color in plant cultivations varies within an stand of plants in 15 the green region of the spectrum (yellow green, deep green, blue green, etc.) or in the case of a blossoming stand of apple tree in a white-pink region, From this it can be determined if color variations or signal variations occuring in large volumes have their origins in local conditions or conditions associated with plant structural features. Differences which are derived from small volumes are associated with plant 20 physiological origins and can be the basis for differences in the application of plant protective agents or the selection of horticultural operations and procedures.
The natural leaves fluoresce when they are irradiated with laser light. From the signal level and the frequency, conclusions as to vitality can also be drawn.
25
In Fig. 3, 3a and 3b, the course of the method according to the invention has been schematically diagrammed. The stand of plants is scanned with the laser sensor 3 as has been described previously and the travel data, position data and target location data as data as to the stand are interpreted in a data
30 preprocessor and subjected to a data compression. From these data, the upper contour of the plant stand including gaps is determined. There is then a determination of the lower contour. In a further operating step, the median planes, the crown volume, the front contours and nonuniformities (Fig. 3b) are determined. All of these data are conditioned and fed to ring memory and are stored therein in
15

intermediate storage. The ring memory is defined from position to position, whereby the number of increments of the ring storage is greater than the number of increments which correspond to the spacing between sensor and nozzles. A multiplicity of ring memories are provided for different data components. The different 5 ring memories give data various ring storage positions free. The data required for the respective treatment position is selected from the ring memories whereby the positions of the ring memories are determined by travel position, location position, the distance to the target and the height of the position under consideration (beam deformation) {see Fig. A).
10
Example 2
The method according to the invention is employed for the treatment or working of such plants which in practice do not grow in a regular manner of rows. Initially a travel path as a reference is made through a first transit of the stand of
15 plants based upon objects such as trees or the like which lie along the travel path and are of a marked or striking nature, The localization of these objects allows repetitive travel along this track, for example, in deep forests, in old olive groves or citrus gardens.
The large trees are measured and estimated with the sensor 3. As the vehicle travels through, the light point grid sweeps the laterally lying vertical objects in a close three-diemensional sequence. The inclined scanning plane ensures that a trunk is scanned from the top down in planar disk-shaped scans which are inclined from the upper region downwardly and horizontally. The thus detected tree-dimensional half shells of the trunk of the branches projecting therefrom make it possible to determine the usable volume and the lengths of such straight segment. The growth of wood and thus the individual crop yield of each tree can be determined by repetitive measurement with sufficient spacing in time.
30 If the sensor 3 is used to gauge tree lined up in a row based upon the
branches extending inwardly into the so-called travel path, the sections of branches can be scanned to select for the individual growth of the individual trees, for example based upom different plant structures, reliability considerations or from the point of
16

view of apperance and dead branches removed from consideration or old, sharply hanging branches, or younger lateral sprouts treated in a target manner.
Because of the 3D image of the sensor which can be obtained by the 5 method according to the invention, the manual operations of tree maintenance can be automated and optimized in different directions. Comparable applications of the system according to the invention are possible for the harvesting of large plants, for example banana plantations cacao trees or in natural rubber plantations.
The mentioned applications of the method according to the invention follows a particular travel path along which the plants are detected, localized and measured with the position determination of the plants described in detail previously, the travel track later can be reproduced in nonconsolidated tracts. On the basis of a multiplicity of determinations at different points in time of three dimensional scenery encompassing the plants, an evaluation and selection of the features of significance can be made like the removal of certain plants (trees), plants parts (branchens, fruit and the like).
Example 3
An obvious other application of the method of the invention, namely the picking of grapes, follows the procedure outlined in Example 2. A carrier 1 travels repeately along the same tracks and determines morphological and physiological signatures and surrounding vines. From a comparison of the individual grape branches, the grapes are identified and based upon their reflection levels and their size, determinations are made as to a certain taste, degree of ripeness and material content.
With the localization of such grapes, geometric localization data is available relative to the sensor which can be used for controlling a harvesting gripper 30 including shears for the separation of table grapes from the vine or the harvesting of wine grapes.
The mechanical picking of branches of grapes with so-called full grape harvesters, requires from the driver of the vehicle high concentration over long
17

periods of time to guide the harvester in a centered manner over the plant rows such that a full harvester will be effective on both sides of the plant row with its shaking units symmetrically so that the picking is effective and the vines are completely harvested. 5
The system according to the invention enables the full harvester to be so guided between the vines that the shaking elements follows individual plants in their engagement geometries since the grapes ripen on the vine stalks at different heights, in different densities and number, the targeted spatial guidance of the 10 picking elements of a full harvester increases the useful production of undamaged picked products (berries) and reduces the amount of vine twige and plant parts which are shaken off the vines.
The grape picking thus can utilize physiological data of the grapes and 15 can be carried out in multiple passes, each partially removing the grapes, including for example a prepicking and a final picking, leading overall to an exceptionally complete harvest.
Analogous to the picking, the binding of the vine in the production of
20 wine grapes utilizing a binding implement displace-able along the row is posible. This
implement can be mounted at the front of the carrier and arranged in the field of view
of the travel so that the travel along the rows is effected uitilizing the steering.
Irregularities in the traveled track with previously could not have been detected by the
dryver nor taken into consideration to avoid collections of the plants and of the
25 apparatus, including possible damage to the apparatus in the past could not be
avoided. With the solution according to the invention, the binder implement can be
guided above and along the row so that all overhanging parts are acquired and
collisions with the posts of the plant supports and the wires stretched between the
posts can be reliably avoided.
30
Example 4
The method of the invention can be used in fruit orchard layouts. All previous features of pruning, binding and harvesting are applicable to the individual fruit, the individual branch or limb. Pruning actions on fruit trees are usually carried
18

out in the winter on fruit tree after loss of their leaves. The resulting transparency of the structure forming fruit trees allows the measurement and evaluation of the branches and limb. The evaluation of the plant structure of each branch or limb requires a recognition of the edge thereof, its configuration and orientation to the 5 trunk and its relationship to the sap flow. The history of the branching of an individual plant for pruning purposes can be obtained and the contribution to the visible blossom shoots precisely determined and evaluated. The localization of a pruning implement projecting from the carrier is possible with the aid of the aforedescribed 3D data in the same manner as the individual grape bunches are picked or for the
10 targeted deleafing for apple/citrus fruit harvesting. In the working of fruit or vineyard cultivations with the method of the invention, the soil-working and undergrowth maintenance is included in the travel of the apparatus through the plant stand. With the ring storage described in greater detail in Fig. 4, control of soil-working tools and undergrowth maintenance tools is possible in the same way as has been described
15 for the application of fertilizers for materials effected on the plants.
19

Presentation of the Reference Numbers Used

Traveling carrier 1
Spray device 2
Laser sensor 3
Deflection mirror 4
Shaped mirror 4'
Circular segments of the shaped mirror 5,6
Rotation source 7
Receiver 8
Optics 9
Radiation inlet 10
Rotational axis of 4' A
Positions of the sensor 3 S1...SN
Upper scanning plane TR
Lower scanning plane TU
To this belong 7 sheets of drawing
20
25
20

WE CLAIM:
1. A system for carrying out the method of treating the ground and plants as required and in a volume-specific manner, especially by the application/metering of spray agents like plant-protective agents and/ or fertilizers as well as water, the working of the soil, undergrowth maintenance and/or the working and treatment of the plants, of trees such as trees along roadways or forest trees or the like, in limited area cultivations, especially grape and fruit cultivation, hops, citrus, olives or the like, shrubs or bushes like bananas or the like in uniformly or nonuniformly planted areas in which the plants are scanned with a monochromatic pulsed laser beam produced by an individual sensor displaced past the plants and circulating onto the plants while affixed to a traveling carrier, the radiation spectrum reflected from the leaf structures being picked up by this sensor and the acquired spectrum being converted into optical signals and these signals being fed to a computer which stores the signal, evaluates them and controls the application/dosing of the spray agent doses as a function of the vegetation state or controls the working of the soil and the treatment of the plants as well as the harvest by outputting of switching commands to control the spray device arranged upon the traveling carrier and blowers and/or working implements with a travelling carrier, for example a vehicle and/or agricultural implement coupled thereto, a sensor affixed to the carrier with a radiation source for transmitting a pulsed laser beam, a mirror rotatable about a vertical axis for training the beam onto a foliage wall, a radiation receiver for collecting the radiation reflected from the foliage wall, a computer for processing the reflected radiation and for controlling nozzles affixed to the carrier of a spray device with a supply vessel for the spray agent whereby the nozzles are arranged at a certain distance from the sensor, a liquid pump for displacing the spray agent to the nozzles, valves for opening and closing the nozzles and a blower for producing a two phase flow characterized in that mirror (41) is configured as a shaped mirror having a partial region (5, 6), inclined at different triangles with respect to the rotational axis of the mirror (4') is arranged eccentrically to the radiation path (10) of the emitted radiation and received radiation.
2. A system for carrying out the method of treating the ground and plants as required and in a volume-specific manner, especially by the application/metering of spray agents like plant-protective agents and/or fertilizers as well as water, the working of the soil, undergrowth maintenance and/or the working and treatment of the plants, of trees such as trees along roadways or forest trees or the like, in limited area cultivations, especially grape and fruit cultivation, hops, citrus, olives or the like, shrubs or bushes like bananas or the like in uniformly or nonuniformly planted areas in which the plants are scanned with a monochromatic pulsed laser beam produced by an individual sensor displaced past the plants and circulating onto the plants while affixed to a travelling carrier, the radiation spectrum reflected from the leaf structures being picked up by this sensor and the acquired spectrum being converted into optical signals and these signals being fed to a computer which stores the signal, evaluates them and controls the application/dosing of the spray agent doses as a function of the vegetation state or controls the working of the soil and the treatment of the plants as well as the harvest by outputting of switching commands to control the spray device arranged upon the travelling carrier and blowers and/or working implements with a travelling carrier, for example a vehicle and/or agricultural to implements coupled thereto, a sensor affixed to the carrier with a


radiation source for emitting a pulsed laser beam, a mirror rotatable about a vertical axis for training the radiation on a foliage wall, a radiation receiver for collecting the radiation reflected from the foliage wall, a computer for processing the reflected radiation and for controlling at least one agricultural implement affixed to the carrier, whereby the implement devices are spaced at a given distance from the sensor, characterized in that the mirror (4') is configured as a shaped mirror, whose partial regions (5, 6} are inclined with different angles to the rotational axis (A) and the rotational axis of the mirror (41) is eccentric to the radiation path (10) of the emitted radiation and collected radiation.
3. A system as claimed in claim 1 and 2, wherein the mirror (41) is configured with pie shaped circular segments of which one segment preferably is at an inclination angle of 45°, preferably 15°, with respect to a normal to the rotation axis A of the mirror.
4. A system as claimed in claim 1 through 3, wherein the radiation path (10) is coaxial with the rotation axis A of the mirror (41).
5. A system as claimed in claims 1 through 4, wherein the radiation source (7) is provided with at least one time measurement circuit triggerable by a light pulse.
6. The apparatus as claimed in claims 1 through 5, wherein the receiver (8) is provided with at least one device for acquiring the transit time.
7. A system as claimed in claims 1 through 6, wherein the optics (9) for the radiation configuration is arranged spatially fixed between the radiation source/receiver (7; 8) and the mirror (4).
8. A system as claimed in claims 1 through 7, wherein the sensor (3) follows the movement of the carrier during travel without a lag.
9. A system as claimed in claims 1 through 7, wherein the axis of the sensor (3) is arranged in a forwardly inclined direction preferably in the travel direction.
10. A system as claimed in claim 2, wherein as the agricultural implement, a cutting
device, a digging device, an excavating device, an undercutting device, a binder
device, a shaping device, a clearing device, a shaking device, a sorting device or a
complete harvesting device, is provided.

22

FORM 2
THE PATENTS ACT, 19 7 0 (39 of 1970)
COMPLETE SPECIFICATION See Section 10, rule 13]
METHOD AND SYSTEM FOR VOLUME- SPECIFIC TREATMENT OF GROUND AND PLANTS
KUMMEL, KNUT of HOHENZOLLERN, STRASSE 11, 12 3 0 7 BERLIN, GERMANY, GERMAN national
The following specification particularly describes the nature of the invention and the manner in which it is to be performed : -

liquid pump for displacing the spray agent to the nozzles, valves for opening and closing the nozzles and a blower for producing a two phase flow
The invention relates also to a System for carrying out the method with a 5 traveling carrier, for example a vehicle and/or agricultural implements coupled thereto, a sensor affixed to the carrier with a radiation source for emitting a pulsed laser beam, a mirror rotatable about a vertical axis for training the radiation on a foliage wall, a radiation receiver for collecting the radiation reflected from the foliage wall, a computer for processing the reflected radiation and for controlling at least one 10 agricultural implement affixed to the carrier, whereby the implement devices are spaced at a given distance from the sensor.
In the treatment of plants with liquid plant protective agents and/or fertilizers, a certain predetermined dose of the effective material must be reliably
15 applied to all of the targeted surfaces of the plants or the problem creators thereof. For the application of such effective materials in limited area cultures like grapes, fruit, hops, citrus, olives, among others, blower spray units are used which apply liquid droplets of the atomized plant-protective agent in two-phase free flow to the targeted surfaces of the plants, to the sides and above the spray device as it is
20 transported past them. The spray device thus travels along a path between plant rows. Depending upon the snaps of the vegetation and cultivations, the plants can be so cultivated that they form above the travel path closed vegetation over, especially a pergola cover in the case of wine grapes or a hollow crown configuration in the case of orchards.
25
For the application of local plant-protective agents in limited field cultures like grapes, orchards and hops, spray devices with ultrasonically-controlled nozzles (DE 39 00 221 A1, DE 39 00 223 A1) or optically-controlled or laser-controlled nozzles (see DE 195 18 058 A1, EP 0 554 732 A1, EP 0 743 001A1) are used. This
30 known devices have multiplicities of individual nozzles which are controlled by individual sensors. The individual sensors detect the presence of target surfaces in the sensing regions of the sensors.
3

From the course of the sensor signals, a yes-no decision is derived for each height region so that the treatment of the plants can be immediately interrupted then and there where there is no plant-like target surface which can be riched by the spray jet of the device. 5
In accordance with DE 195 18 058 A1, the plants are detected with individual sensors disposed one above another, preferably optical sensors, in a zonewise manner corresponding to the nozzles assigned to the different heigth regions of the plants. The plants are thus recognized only in small strips in a
10 sampling process over their heights. Between the sensors, horizontally growing branches or tendrills remain unrecognized. Any information as to distance for the respective spacing between nozzle and target which corresponds to the requisite travel path for the droplets of the sprayed agent is not available. This means that for the application of the spray agent, an anticipatory opening and closing of the spray
15 nozzle cannot be achieved and thus the processing agent in zone which are spaced from the spray device, for example open apexes of a tree or vine, are not reliably coated in a targeted manner. These zones are, however, from a phytopathological point of view especially and must, for protection of the cultivation against infection, be reliably treated.
20
From U.S. Patent 5 278 423 A1, there is, further, a solution known in which the individual circulating laser sensors are used for detection of foliage and can be used for the control of an agricultural spray device using an output signal which can be employed to control the spray process. In this spray process a pulsed
25 laser beam is produced utilizing a pulsed trigger signal, the laser beam being emitted from a sensor. A receiver collects reflected laser radiation from apoint on the targeted tree, whereby the receiver can be provided with an outlet for a selected pulsed beam representing a transit time which corresponds to the transit time from the target point to the receiver. The pulsed laser beam scans the foliage of the targeted tree vertically
30 whereby the scanning is determined by an angle which corresponds to the angle of the laser beam relative to a reference angle.
A setting of the sensor during a scanning cycle is determined in which the scanning cycle is a complete circuit of the laser beam around the axis of a spray path
4

in a vertical scanning plane with a setting along the axis defined by the spray movement. Then a number of given spray regions are determined. The spray regions have a predetermined direction and the spray heads arranged on the sprayer open to discharge the spayed agent. The operating regions, the angle and the spacing i information are processed by a microprocessor to the appropriate movement range of the sprayer to take into consideration the tree height and the corresponding setting of the spray head for this height in a scanning measurement.
The sensor used in this known process includes a laser means for 10 determining a range from the sensor to a collection of trees with foliage lying in a row and along which the sensor is moved and for outputting data as to this range, which has a sensor angle for each data output of the range, means for determining a travel stretch for the sensor along the foliage whereby the travel stretch represents the distance between the sensor spray heads, means for processing corresponding 15 output data as to the range and the travel path for determining the presence and the signature of the detected foliage, whereby the processing means outputs control signals form conventional agricultural sprayers.
With this known solution, entire foliages or crowns for shadows areas can 20 be regocnized as units, with the aid of which the nozzles for applying the spray agent can be switched. Neither gaps within these units which take into consideration the development of the vegetation of the plants and their structural information nor information as to the depth of the leaf walls are considered. This means that the application of the spray agent is not spatially specific to the requirements of the 25 plants and remains inexact, as a result of which the spray agent consumption may be correspondingly excessive or ineffective. This known solution is therefore only suitable for very high cultivations with a very large row spacing and upright plants, individually separated in each row.
30 Furthermore all of these known solutions for the measurement of travel
require wheel sensors for a vehicle wheel. The rolling wheel on unconsolidated, differently structured surfaces, continously undergoes slip which, depending upon the arrangement of the sensors and the nozzles, can give rise to errors with respect to the targeting precision in the application of the sprayed agent. Rolling movements of
5

the sprayer during its travel over the unconsolidated traveled way gives rise to lateral discolation of the individual sensors when these are located above or below the rolling center of gravity. This contributes to errors in the distance measurement as a function of the sensor position relative to the rolling center of gravity. The reference 5 measurement points of the individual sensors shift vertically on the foliage wall which can encopass other surfaces than the zones of interest.
In the treatment of the spray edge zone of a plant crown, the rolling movement either gives rise to overspray of the leaf walls or a failure to treat the 10 phytophylologically sensitive peak regions sufficiently at all with the spray unit.
DE 19? 26 917 A1 describes a method for the contactless scanning of
contours in which the contours above the ground are detected by means of a laser
beam transmitter/receiver device which, while the agricultural machine is traveling,
15 continously detects distances to the contour across the scanning width and stores
the values thereof. With a timing unit, a position determination is made.
In DE 44 34 042 C2, an arrangement for the contactless detection of travel related data from spatially separated objects is obtained which move along a
20 travel path, street or track branch as monitoring surfaces, in which a laser, a light receiver and an evaluation device are provided which carry out a distance measurement by means of optical transit time measurement, and can be provided with a scanning device which deflects the laser beam that this describes the envelope of a cone in its circulatory movement, the axis of symmetry and this cone
25 being orthogonal to or inclined to the monitoring surface.
In view of this state of the art the invention has its object to improve upon a method and a system of the type described at the outset wherein the stand of planting is sensed in a spatial gap-free manner and the effect of the ground condition 30 and plant condition can be taken into consideration simultaneously with morphological and plant physiological characteristics in a location-specific und technologically efficient manner.
6

This objects are achieved with a method of the type described at the outset but with the characterizing features of claim 1 and a system with the characterizing features of claim 31 and 32.
5 Advantageous refinements of the method and the system will be
deducible from the dependent claims.
The invention will be described in greater detail in the following in connection with a number of embodiments.

The drawing shows:
Fig. 1 a schematic illustration of the sensor according to the invention,
Fig. 1 a a schematic illustration of the arrangement of the sensor on the
15 carrier,
Fig. 2 a schematic illustration of the scanning of a stand of plant with
laser beams,
Fig. 3, 3a and 3b the process structure and the sequence of the method according
to the invention and
20 Fig. 4 a diagramm of the fundamentals of the ring storage used.
Example 1
The method according to the invention is initially described with 25 respect to the region with uniformly disposed plants of a limited area cultivation like wine grapes.
The system according to the invention for the volume specific application of spray agents, for treatment and for processing of plants in a limited 30 area cultivation whose individual plants are disposed close together in rows defining travel paths between them is comprised basically of a traveling carrier 1, for example a tractor, which supports a spray unit 2, a blower for generating a two-phase flow, a central laser sensor 3 which rotates during travel of the carrier along the traveling path and a computer for processing all of the data obtained by the sensor. A
7

container for receiving a spray agent belongs to the sprayer 2 together with a feed pump for displacing the spray agent to the spray nozzles, and valves for opening and closing the nozzles. When the agricultural [soil-working] implements are used, these are fastened correspondingly to the traveling carrier 1.
5
The sensor 3 comprises, as has been schematically illustrated in Fig. 1 and 1a, a mirror 4'which is arranged to rotate about an axis A. The mirror is inclined differently [at different angles] to the rotational axis A and is configured as a shaped mirror. In this embodiment the mirror 4'is so constructed from pie-shaped 10 circular segments 5 and 6 that the segment 5 has an inclination of 45° with respect to the rotational axis A and the segment 6, an inclination of 67,5° with respect to the rotational axis A, i.e. 22,5° to a normal to the rotational axis A.
The sensor 3 is comprised of a radiation source 7 and a receiver
15 8. The rotary displacement of the mirros 4' is followed by a rotational angle measurement. Light pulses produced by the radiation source 7 are distributed via the deflection mirror 4 and the shaped mirror 4'in space within the travel path. The ovjects which are encountered by the radiation beam (foliage walls, leaves, stems shoots and the like) reflect the radiation back via the deflecting mirror 4 and the
20 shaped mirror 4'and this radiation is focused by an optical system 9 onto the receiver 8.
So that the sensor 3 has a free field of view [aperture] for the transmission and received beams, it must be so fixed on the carrier 1 that a sufficient field of view is ensured. The sensor 3 acquired the plants of the strand laterally and
25 above the sprayer 2 in a grid of iaser scan points which, as the carrier 1 advances along its travel path, passes in a strip shape in helical pattern along the plant row. With an angular resolution of, for example 1°, vertical spacing of the scanning point of several cm on the foliage of plant rows with a row spacing of 5 m is possible without further effort. In this example measured values of a grid pattern of about 5 x 5 cm can
30 be resolved with a high degree of resolution with travel speed usually of 1 to 8 km/h.
The laser beam is so deflected in the travel direction vertically and forwardly to the side that it sweeps over a conical surface segment open in the travel direction. This part of the laser beam encounters the lower regions of the plants
8

along a line which encompasses objects lying next to one another horizontally. The part of the conical surface segment which in the travel direction lies furthest vertically intersects the ground and forms an arrangement in which the laser beam can be deflected opposite to the travel direction. 5
The rotational axis A of the shaped mirror 4'lies eccentrically in the beam path 10 of the sensor 3. Because of this eccentrically, the radiation-sweep plans of the emitted radiation oscillates by an amount corresponding to the eccentricity perpendicular to the main plane H. A corresponding offset is thus superimposed on 10 the conical surface. The amplitude of the offset follows a full sine curve during on revolution of the shaped mirror 4'.
Coarse values can be obtained with the aid of the distance measurement to further removed objects. Objects which lie laterally in the field of view of the sensor
15 3 give rise to offsets relative to the position of the sensor from one angle segment to another whereby the path can be determine when the distance to the observed object is known. In the case of structures with multiple shapes like the foliage walls of plants stands in a limited field culture, the distance measurement must allow for a selection of significant objects by a filtering of the information with respect to the
20 distance to the objects which are recognizable laterally of the carrier 1.
The beam from the pulsed infrared laser source is, as illustrated in Fig. 2, deflected by the rotating shaped mirror 4'for the upper scanning space by about preferably 90° from the beam direction and is distributed in a radiation plane in a
25 circular pattern. The infrared laser source 7 is thus so pulsed that, by means of the shaped mirror with a quasiuniform angular positioning (ratio of the light speed to the velocity of the mirror), the reflection signal from the beam-acquired objects is returned back to the receiver 8 of the sensor 3. The scanned region of the sensor does not lie in a single plane and encompasses a solid angle of more than one-
30 quarter of spherical segment.
Starting from one position on the carrier 1, the scan runs to the side and upwardly in a plane and for this region there is an angle of 45° between the shaped mirror 4'and the rotational axis A. In the travel direction the laser beam is deflected over a
9

reflection angle >45°. Thus the beam sweeps a conical surface which is directed forwardly in the direction of the travel path from the apex of the one, whereby the conical axis intersects the travel path in the center of the track of the carrier 1 ahead of the latter. With the conical surface, the plant rows on the sides (independently from 5 mirror angle and position) are scanned from a region of the beam in an approximately horizontal path or slightly inclined path. In this region, the movement of individual objects (trunks, graps stalks, tree poles or the like) or structures (crown volume, front contours of the crown or the like) are so followed, that the structures are determined therefrom and the pattern of the structure relative to carrier are
10 recognized. From this the distance in the row is determined. Since the plants are cultivated for years in the same place, these positions can be ascertained from the known locations of the plants and the distance therefrom to the carrier and an identification of the plants can be effected. Errors in both measurements can be corrected by appropriate logic.
15
The scanning plane of the radiation path with a 45° inclined mirror 4', acquires the plants, especially wine grapes, in a pergola configuration or a Mediterranean arrangement with a hollow crown in a vertical direction laterally and above the carrier in a closed arc. Because of the eccentricity, the beam in the course
20 of mirror rotation has superimposed thereon the aforementioned sinusoidal offset perpendicular to the travel curve. The amplitude is determined by the eccentricity of the mirror angle. Because of the rotational movement of the mirror 4', the offset has always the same magnitude at each location of the travel curve and since this is taken into consideration, the offset does not bring with it any functional disadvantage.
25 For the localization and measurement of plants and determination of the position of a carrier 1 with a spray device 2 for applying a spray agent in row cultivation, the mirror 4'of the sensor 3 is so configured that a planar and a spatially curved region can be used. The shape and extent of the planar mirror region determines the optical characteristics of the sensor 3 in term of range and sensitivity. A spatially high
30 resolution light-point grid (raster) of a laser beam from a central radiation source 7 avoids measurement errors which can be arise when individual sensors are arrangwed along a line at different positions and as a result of the travel motion of the carrier.
10

The centra! sensor 3 can be positioned in this example in the region of the center of gravity of the carrier so that translation movements and radiation movements of the sensor itself as a consequence of intrinsic movements of the carrier 1 can be taken into consideration and corrected. 5
The space curve with which the region around the carrier 1 ahead of,
laterally of and above the carrier 1 is observed, has in the region of the transsition
from one mirror segment to the other, reduced optical power. In this region, the stand
of plants is always positioned especially close to the sensor 3 so that a reduced
10 optical power is not a problem.
The arrangement of the sensor 3 is possible both on the carrier 1 and upon the implement.
15 The sensor 3 can not only be used to control the application of spray
agents but is also capable of being used for horticultural purposes in limited area cultivation, nonuniform plantings with trees, shrubs, bushes or the like which today are monitored with different sensors and feelers to detect the grape stalks and trunks and are used for control (mowing, cutting of stalks, binding, deleafing or foliage
20 regions, undercutting of weeds of the rows between trunks or stalks, mulching with grass and with pieces of woods, loosening, sowing, fertilizing and transport). It can be especially be used to control the displacement of complete grape harvesters (number, color, ripeness and the like).
25 The system according to the invention is capable of use for automatic
application processes. It eliminates the need for adjustment at the sensor and the carrier. The data acquired with the system according to the invention and such information is useful especially advantageously for stock taking. Especially in the intensive cultivation of fruit, grapes and hops, many different factors can be
30 introduced and combined in order to achive given production targets, including for example, cutting, binding, deleafing, thinning out of fruit, watering, fortilizing and the like. So that certain factors or combinations of factors can be used, the actual situation in the cultivation on the one hand and on the other, the expected or planed development of plants themselves as well as environmental conditions including
11

weathering, must be taken into consideration or are of significance. When the farmer who has to make decisions can access precise information as to the status of his plant stand, his decisions are more sound and the risk of erroneous decisions is minimal. Technologically precise and reproducible measurement relative to the size 5 of plants, which can be fully documented over long time periods, are extremely convenient and when easily made available can be of great utility.
Man have have been cultivating groves of fruit for millennis based upon horticultural factors like cultivation techniques, training and breeding intensively as 10 matched to local conditions including soil, climate and location.
With the aid of the method of the invention and the sensor, georeferenced, locally specific data as to plants can be acquired and used as the basis for a cultivation matched to the locality with optimization of the horticultural
15 processes and handling for the individual plants. For example, with the method according to the invention, the effects of plant protective agents which are used and/or other cultivation features on the plants which are subjected to the treatment, can be determined under the prevailing conditions individually, these conditions including the type of plant, the cultivation, training, fertilization, the climatic
20 conditions, weathering. With this information it is possible to determine dosage for future treatments of the same plant stand with compatible indications so that dosages and application timing of a particular composition or any preparation or other treatment features can be optimized with respect to cost and effectiveness, but also taking into consideration resistance induction and crop yield. This allows also local
25 dosing in individual partial dosages under different treatment conditions or positions and carrying out of horticultural operations as a function of the immediate requirements on individual plants at their individual locations.
With the method according to the invention, it is possible to derive both
30 local distribution of biological and phytophysiological signatures as well as a
distribution in time with each travel of the apparatus through the stand of plants. It is
thus possible to acquire and follow the effects of various factors and the prevalent
boundary conditions of individual plants together with the measurements with the
12

time. It is also possible to compare the influence of weathering on the effectveness over the years and to evaluate it.
With the method of the invention, whose sequence is schematically illustrated in Fig. 5 3, 3a and 3b, different stands of plants can be evaluated in a spatial manner and characterized from the point of view of morphology and physiology. The following morphological parameters of a stand of plants can be obtained:
Location of the objects, spacing of the objects and angular position of 10 the objects with respect to the center,
Contour of the leaf crown (from the course of the spacing measurements),Volume of the crown from the contour (based upon the assumption that the lighting or target is substantially symmetrical to the row center), 15
The location of the row center form the location of the foliage peaks and the trunks/stalks relative to the travel path,
Density from the spacing distribution relative to the dominating front 20 side signal (view through the structure of the foliage wall with impingement on the rear side with exclusion of impingement on objects lying further away by background meaking or cancellation),
Density, especially foliage density, i.e. area obstruction of the leaves in
25 the feaf waif of structure-forming crowns (without trees), spout growth or comparison
of contour and volume measurements with time, Number of fruit of sufficient fruit
size, Yield in number of fruit per area and per plant, As physiological parameters, in
the following are acquired:
Color from the level of the reflection signals based upon the assumption 30 that the objects are similarly colored and that comparable distance from the sensor are comparably reflective.
The absolute color is thus not of interest but rather the relative course of the signal is of interest as a measure of saturation of green coloration and thus the number of chlorophyll. This distribution gives an inication of the plant feeding or the distribution
13

thereof over the area of cultivation. From the color distribution, especially in the
blossoming of fruit trees, the distribution of blosom density can be taken as an
indicator of the alternance of the trees and the treatment to be matched thereto.
Vitality derived from the color distribution,
5 Viltality based upon the fluorescence spectrum upon evaluation of the
reflection radiation.
At a known spacing from an object, the reflection level of the received signal is a measure of the color, orientation and optical surface characteristics of the 10 reflecting object. By analysis of the signal level, a distribution of the optical signal over the area can be determined and used as a measurement for the vitality.
Natural green from a plant reflects light from the lower infrared portion of the spectrum siginicantly better than other objects (green peaks in the reflection
15 spectrum). This is dependent upon the type, the nutritive situation of the plants or the degree of ripeness of the fruit and so forth. If the degree of reflection of different lower infrared spectra are compared, it is possible to distinguish between chlorophyll-retaining enlivened plant parts and object retaining less chlorophyll like ripened fruit and objects which are not chlorophyll-retaining like fence posts.
20
The evaluation and utilization of signal level information presupposes that influences of the distance to the target object which can give rise to a spreading of the radiation and the reduction of the signal level is taken into consideration at increasing distances.
25
Differences in the reflection signal level can be then be quantifiable when the spacing information is taken into consideration and it is understood that it represents comparable target objects, for example leaves of a comparable vegetation stand upon travel through that stand. Signal level measured values at
30 comparable measurement distances supply basic information as to color-dependent cultivation characteristics which can be taken into consideration during the working of the cultivation. Without a differentiation between different spectra, one can obtain indirectly through the course of reflection signal level in space, an indication as to the distribution of vitality based upon the chlorophyll activity.
14

A laser beam encouters upon irradiation of a natural foliage wall individual or multiple leaves or sprouts in a random manner. This requires a special assignement of the corresponding distance information to the individual objects 5 encoutered by the beam. For this purpose, a multiplicity of timing circuits are started simultaneously when the beam is transmitted. Each timing circuit has another level value at which the time is stopped (cascade). With this system, a multiplicity of transmit times are measured for different reflection angles. The distance to partly encoutered objects is thus determined. With the aid of such an arrangement it is 10 possible to detect a particular reflection level arises from a target alone of from various objects, in which case the value is reduced. The vitality indication can thus be formed exclusively from reliable reflection values of individual objects.
The object color in plant cultivations varies within an stand of plants in 15 the green region of the spectrum (yellow green, deep green, blue green, etc.) or in the case of a blossoming stand of apple tree in a white-pink region, From this it can be determined if color variations or signal variations occuring in large volumes have their origins in local conditions or conditions associated with plant structural features. Differences which are derived from small volumes are associated with plant 20 physiological origins and can be the basis for differences in the application of plant protective agents or the selection of horticultural operations and procedures.
The natural leaves fluoresce when they are irradiated with laser light. From the signal level and the frequency, conclusions as to vitality can also be drawn.
25
In Fig. 3, 3a and 3b, the course of the method according to the invention has been schematically diagrammed. The stand of plants is scanned with the laser sensor 3 as has been described previously and the travel data, position data and target location data as data as to the stand are interpreted in a data
30 preprocessor and subjected to a data compression. From these data, the upper contour of the plant stand including gaps is determined. There is then a determination of the lower contour. In a further operating step, the median planes, the crown volume, the front contours and nonuniformities (Fig. 3b) are determined. All of these data are conditioned and fed to ring memory and are stored therein in
15

intermediate storage. The ring memory is defined from position to position, whereby the number of increments of the ring storage is greater than the number of increments which correspond to the spacing between sensor and nozzles. A multiplicity of ring memories are provided for different data components. The different 5 ring memories give data various ring storage positions free. The data required for the respective treatment position is selected from the ring memories whereby the positions of the ring memories are determined by travel position, location position, the distance to the target and the height of the position under consideration (beam deformation) {see Fig. A).
10
Example 2
The method according to the invention is employed for the treatment or working of such plants which in practice do not grow in a regular manner of rows. Initially a travel path as a reference is made through a first transit of the stand of
15 plants based upon objects such as trees or the like which lie along the travel path and are of a marked or striking nature, The localization of these objects allows repetitive travel along this track, for example, in deep forests, in old olive groves or citrus gardens.
The large trees are measured and estimated with the sensor 3. As the vehicle travels through, the light point grid sweeps the laterally lying vertical objects in a close three-diemensional sequence. The inclined scanning plane ensures that a trunk is scanned from the top down in planar disk-shaped scans which are inclined from the upper region downwardly and horizontally. The thus detected tree-dimensional half shells of the trunk of the branches projecting therefrom make it possible to determine the usable volume and the lengths of such straight segment. The growth of wood and thus the individual crop yield of each tree can be determined by repetitive measurement with sufficient spacing in time.
30 If the sensor 3 is used to gauge tree lined up in a row based upon the
branches extending inwardly into the so-called travel path, the sections of branches can be scanned to select for the individual growth of the individual trees, for example based upom different plant structures, reliability considerations or from the point of
16

view of apperance and dead branches removed from consideration or old, sharply hanging branches, or younger lateral sprouts treated in a target manner.
Because of the 3D image of the sensor which can be obtained by the 5 method according to the invention, the manual operations of tree maintenance can be automated and optimized in different directions. Comparable applications of the system according to the invention are possible for the harvesting of large plants, for example banana plantations cacao trees or in natural rubber plantations.
The mentioned applications of the method according to the invention follows a particular travel path along which the plants are detected, localized and measured with the position determination of the plants described in detail previously, the travel track later can be reproduced in nonconsolidated tracts. On the basis of a multiplicity of determinations at different points in time of three dimensional scenery encompassing the plants, an evaluation and selection of the features of significance can be made like the removal of certain plants (trees), plants parts (branchens, fruit and the like).
Example 3
An obvious other application of the method of the invention, namely the picking of grapes, follows the procedure outlined in Example 2. A carrier 1 travels repeately along the same tracks and determines morphological and physiological signatures and surrounding vines. From a comparison of the individual grape branches, the grapes are identified and based upon their reflection levels and their size, determinations are made as to a certain taste, degree of ripeness and material content.
With the localization of such grapes, geometric localization data is available relative to the sensor which can be used for controlling a harvesting gripper 30 including shears for the separation of table grapes from the vine or the harvesting of wine grapes.
The mechanical picking of branches of grapes with so-called full grape harvesters, requires from the driver of the vehicle high concentration over long
17

periods of time to guide the harvester in a centered manner over the plant rows such that a full harvester will be effective on both sides of the plant row with its shaking units symmetrically so that the picking is effective and the vines are completely harvested. 5
The system according to the invention enables the full harvester to be so guided between the vines that the shaking elements follows individual plants in their engagement geometries since the grapes ripen on the vine stalks at different heights, in different densities and number, the targeted spatial guidance of the 10 picking elements of a full harvester increases the useful production of undamaged picked products (berries) and reduces the amount of vine twige and plant parts which are shaken off the vines.
The grape picking thus can utilize physiological data of the grapes and 15 can be carried out in multiple passes, each partially removing the grapes, including for example a prepicking and a final picking, leading overall to an exceptionally complete harvest.
Analogous to the picking, the binding of the vine in the production of
20 wine grapes utilizing a binding implement displace-able along the row is posible. This
implement can be mounted at the front of the carrier and arranged in the field of view
of the travel so that the travel along the rows is effected uitilizing the steering.
Irregularities in the traveled track with previously could not have been detected by the
dryver nor taken into consideration to avoid collections of the plants and of the
25 apparatus, including possible damage to the apparatus in the past could not be
avoided. With the solution according to the invention, the binder implement can be
guided above and along the row so that all overhanging parts are acquired and
collisions with the posts of the plant supports and the wires stretched between the
posts can be reliably avoided.
30
Example 4
The method of the invention can be used in fruit orchard layouts. All previous features of pruning, binding and harvesting are applicable to the individual fruit, the individual branch or limb. Pruning actions on fruit trees are usually carried
18

out in the winter on fruit tree after loss of their leaves. The resulting transparency of the structure forming fruit trees allows the measurement and evaluation of the branches and limb. The evaluation of the plant structure of each branch or limb requires a recognition of the edge thereof, its configuration and orientation to the 5 trunk and its relationship to the sap flow. The history of the branching of an individual plant for pruning purposes can be obtained and the contribution to the visible blossom shoots precisely determined and evaluated. The localization of a pruning implement projecting from the carrier is possible with the aid of the aforedescribed 3D data in the same manner as the individual grape bunches are picked or for the
10 targeted deleafing for apple/citrus fruit harvesting. In the working of fruit or vineyard cultivations with the method of the invention, the soil-working and undergrowth maintenance is included in the travel of the apparatus through the plant stand. With the ring storage described in greater detail in Fig. 4, control of soil-working tools and undergrowth maintenance tools is possible in the same way as has been described
15 for the application of fertilizers for materials effected on the plants.
19

Presentation of the Reference Numbers Used

Traveling carrier 1
Spray device 2
Laser sensor 3
Deflection mirror 4
Shaped mirror 4'
Circular segments of the shaped mirror 5,6
Rotation source 7
Receiver 8
Optics 9
Radiation inlet 10
Rotational axis of 4' A
Positions of the sensor 3 S1...SN
Upper scanning plane TR
Lower scanning plane TU
To this belong 7 sheets of drawing
20
25
20

WE CLAIM:
1. A system for carrying out the method of treating the ground and plants as required and in a volume-specific manner, especially by the application/metering of spray agents like plant-protective agents and/ or fertilizers as well as water, the working of the soil, undergrowth maintenance and/or the working and treatment of the plants, of trees such as trees along roadways or forest trees or the like, in limited area cultivations, especially grape and fruit cultivation, hops, citrus, olives or the like, shrubs or bushes like bananas or the like in uniformly or nonuniformly planted areas in which the plants are scanned with a monochromatic pulsed laser beam produced by an individual sensor displaced past the plants and circulating onto the plants while affixed to a traveling carrier, the radiation spectrum reflected from the leaf structures being picked up by this sensor and the acquired spectrum being converted into optical signals and these signals being fed to a computer which stores the signal, evaluates them and controls the application/dosing of the spray agent doses as a function of the vegetation state or controls the working of the soil and the treatment of the plants as well as the harvest by outputting of switching commands to control the spray device arranged upon the traveling carrier and blowers and/or working implements with a travelling carrier, for example a vehicle and/or agricultural implement coupled thereto, a sensor affixed to the carrier with a radiation source for transmitting a pulsed laser beam, a mirror rotatable about a vertical axis for training the beam onto a foliage wall, a radiation receiver for collecting the radiation reflected from the foliage wall, a computer for processing the reflected radiation and for controlling nozzles affixed to the carrier of a spray device with a supply vessel for the spray agent whereby the nozzles are arranged at a certain distance from the sensor, a liquid pump for displacing the spray agent to the nozzles, valves for opening and closing the nozzles and a blower for producing a two phase flow characterized in that mirror (41) is configured as a shaped mirror having a partial region (5, 6), inclined at different triangles with respect to the rotational axis of the mirror (4') is arranged eccentrically to the radiation path (10) of the emitted radiation and received radiation.
2. A system for carrying out the method of treating the ground and plants as required and in a volume-specific manner, especially by the application/metering of spray agents like plant-protective agents and/or fertilizers as well as water, the working of the soil, undergrowth maintenance and/or the working and treatment of the plants, of trees such as trees along roadways or forest trees or the like, in limited area cultivations, especially grape and fruit cultivation, hops, citrus, olives or the like, shrubs or bushes like bananas or the like in uniformly or nonuniformly planted areas in which the plants are scanned with a monochromatic pulsed laser beam produced by an individual sensor displaced past the plants and circulating onto the plants while affixed to a travelling carrier, the radiation spectrum reflected from the leaf structures being picked up by this sensor and the acquired spectrum being converted into optical signals and these signals being fed to a computer which stores the signal, evaluates them and controls the application/dosing of the spray agent doses as a function of the vegetation state or controls the working of the soil and the treatment of the plants as well as the harvest by outputting of switching commands to control the spray device arranged upon the travelling carrier and blowers and/or working implements with a travelling carrier, for example a vehicle and/or agricultural to implements coupled thereto, a sensor affixed to the carrier with a


radiation source for emitting a pulsed laser beam, a mirror rotatable about a vertical axis for training the radiation on a foliage wall, a radiation receiver for collecting the radiation reflected from the foliage wall, a computer for processing the reflected radiation and for controlling at least one agricultural implement affixed to the carrier, whereby the implement devices are spaced at a given distance from the sensor, characterized in that the mirror (4') is configured as a shaped mirror, whose partial regions (5, 6} are inclined with different angles to the rotational axis (A) and the rotational axis of the mirror (41) is eccentric to the radiation path (10) of the emitted radiation and collected radiation.
3. A system as claimed in claim 1 and 2, wherein the mirror (41) is configured with pie shaped circular segments of which one segment preferably is at an inclination angle of 45°, preferably 15°, with respect to a normal to the rotation axis A of the mirror.
4. A system as claimed in claim 1 through 3, wherein the radiation path (10) is coaxial with the rotation axis A of the mirror (41).
5. A system as claimed in claims 1 through 4, wherein the radiation source (7) is provided with at least one time measurement circuit triggerable by a light pulse.
6. The apparatus as claimed in claims 1 through 5, wherein the receiver (8) is provided with at least one device for acquiring the transit time.
7. A system as claimed in claims 1 through 6, wherein the optics (9) for the radiation configuration is arranged spatially fixed between the radiation source/receiver (7; 8) and the mirror (4).
8. A system as claimed in claims 1 through 7, wherein the sensor (3) follows the movement of the carrier during travel without a lag.
9. A system as claimed in claims 1 through 7, wherein the axis of the sensor (3) is arranged in a forwardly inclined direction preferably in the travel direction.
10. A system as claimed in claim 2, wherein as the agricultural implement, a cutting
device, a digging device, an excavating device, an undercutting device, a binder
device, a shaping device, a clearing device, a shaking device, a sorting device or a
complete harvesting device, is provided.

22

Documents:

1009-mumnp-2003-cancelled pages(15-03-2005).pdf

1009-mumnp-2003-certificate(15-3-2005).pdf

1009-mumnp-2003-claims(3-11-2003).pdf

1009-mumnp-2003-claims(amended)-(15-3-2005).pdf

1009-mumnp-2003-claims(granted)-(15-03-2005).doc

1009-mumnp-2003-claims(granted)-(15-03-2005).pdf

1009-mumnp-2003-claims(granted)-(4-4-2007).pdf

1009-mumnp-2003-claims.doc

1009-mumnp-2003-claims.pdf

1009-mumnp-2003-correspondence(ipo)-(04-04-2007).pdf

1009-mumnp-2003-correspondence(ipo)-(11-6-2007).pdf

1009-mumnp-2003-correspondence(ipo).pdf

1009-mumnp-2003-correspondence.pdf

1009-mumnp-2003-correspondence1(12-02-2004).pdf

1009-mumnp-2003-correspondence2(14-03-2005).pdf

1009-mumnp-2003-description(complete)-(3-11-2003).pdf

1009-mumnp-2003-description(granted)-(4-4-2007).pdf

1009-mumnp-2003-description(granted).pdf

1009-mumnp-2003-descritpion(granted).doc

1009-mumnp-2003-drawing(15-03-2005).pdf

1009-mumnp-2003-drawing(3-11-2003).pdf

1009-mumnp-2003-drawing(granted)-(4-4-2007).pdf

1009-mumnp-2003-drawing.pdf

1009-mumnp-2003-form 19(05-02-2004).pdf

1009-mumnp-2003-form 19.pdf

1009-mumnp-2003-form 1a(03-11-2003).pdf

1009-mumnp-2003-form 1a.pdf

1009-mumnp-2003-form 2(complete)-(3-11-2003).pdf

1009-mumnp-2003-form 2(granted)-(15-03-2005).doc

1009-mumnp-2003-form 2(granted)-(15-03-2005).pdf

1009-mumnp-2003-form 2(granted)-(4-4-2007).pdf

1009-mumnp-2003-form 2(granted).doc

1009-mumnp-2003-form 2(granted).pdf

1009-mumnp-2003-form 2(title page)-(complete)-(3-11-2003).pdf

1009-mumnp-2003-form 2(title page)-(granted)-(4-4-2007).pdf

1009-mumnp-2003-form 2(title page).pdf

1009-mumnp-2003-form 3(05-01-2004).pdf

1009-mumnp-2003-form 3(3-11-2003).pdf

1009-mumnp-2003-form 3.pdf

1009-mumnp-2003-form 5(05-01-2004).pdf

1009-mumnp-2003-form 5(3-11-2003).pdf

1009-mumnp-2003-form 5.pdf

1009-mumnp-2003-form pct other.pdf

1009-mumnp-2003-form pct-ipea-409.pdf

1009-mumnp-2003-form pct-isa-210.pdf

1009-mumnp-2003-form-pct-isa-210(15-03-2005).pdf

1009-mumnp-2003-general power of attorney(15-3-2005).pdf

1009-mumnp-2003-general power of attorney(23-12-2003).pdf

1009-mumnp-2003-petition under rule 137(15-03-2005).pdf

1009-mumnp-2003-petition under rule 137.pdf

1009-mumnp-2003-power of attorney.pdf

1009-mumnp-2003-power of authority(03-11-2003).pdf

1009-mumnp-2003-wo international publication report(3-11-2003).pdf

abstract1.jpg


Patent Number 205538
Indian Patent Application Number 1009/MUMNP/2003
PG Journal Number 31/2008
Publication Date 01-Aug-2008
Grant Date 04-Apr-2007
Date of Filing 03-Nov-2003
Name of Patentee KUMMEL, KNUT
Applicant Address HOHENZOLLERN, STRASSE 11, 12307 BERLIN, GERMANY
Inventors:
# Inventor's Name Inventor's Address
1 KUMMEL, KNUT HOHENZOLLERN, STRASSE 11, 12307 BERLIN, GERMANY
PCT International Classification Number A 01 M
PCT International Application Number PCT/DE02/01777
PCT International Filing date 2002-05-14
PCT Conventions:
# PCT Application Number Date of Convention Priority Country
1 101 23 301 2001-05-14 Germany