CN202890093U - Grape bagging robot system based on machine vision - Google Patents
Grape bagging robot system based on machine vision Download PDFInfo
- Publication number
- CN202890093U CN202890093U CN 201220159580 CN201220159580U CN202890093U CN 202890093 U CN202890093 U CN 202890093U CN 201220159580 CN201220159580 CN 201220159580 CN 201220159580 U CN201220159580 U CN 201220159580U CN 202890093 U CN202890093 U CN 202890093U
- Authority
- CN
- China
- Prior art keywords
- grape
- bagging
- slide rail
- mechanical arm
- robot system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 235000009754 Vitis X bourquina Nutrition 0.000 title claims abstract description 89
- 235000012333 Vitis X labruscana Nutrition 0.000 title claims abstract description 89
- 235000014787 Vitis vinifera Nutrition 0.000 title claims abstract description 89
- 240000006365 Vitis vinifera Species 0.000 title 1
- 241000219095 Vitis Species 0.000 claims abstract description 88
- 230000033001 locomotion Effects 0.000 claims abstract description 17
- 235000013399 edible fruits Nutrition 0.000 claims description 53
- 239000012636 effector Substances 0.000 claims description 38
- 241000219098 Parthenocissus Species 0.000 claims description 27
- 210000002310 elbow joint Anatomy 0.000 claims description 11
- 210000000323 shoulder joint Anatomy 0.000 claims description 11
- 210000003857 wrist joint Anatomy 0.000 claims description 9
- 210000000245 forearm Anatomy 0.000 claims description 8
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 claims description 8
- 238000009434 installation Methods 0.000 claims description 5
- 229910000831 Steel Inorganic materials 0.000 claims description 2
- 239000010959 steel Substances 0.000 claims description 2
- 238000001514 detection method Methods 0.000 abstract description 5
- 229910000639 Spring steel Inorganic materials 0.000 description 11
- 230000005484 gravity Effects 0.000 description 7
- 238000000034 method Methods 0.000 description 7
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000009369 viticulture Methods 0.000 description 5
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 4
- 238000005520 cutting process Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000013138 pruning Methods 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 240000000560 Citrus x paradisi Species 0.000 description 3
- 230000009471 action Effects 0.000 description 3
- 230000004888 barrier function Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000003306 harvesting Methods 0.000 description 3
- 239000002420 orchard Substances 0.000 description 3
- 210000000707 wrist Anatomy 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 201000010099 disease Diseases 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 239000012467 final product Substances 0.000 description 2
- 210000001624 hip Anatomy 0.000 description 2
- 229910052742 iron Inorganic materials 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000007665 sagging Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000009423 ventilation Methods 0.000 description 2
- 229910000838 Al alloy Inorganic materials 0.000 description 1
- 229920000049 Carbon (fiber) Polymers 0.000 description 1
- 241000196324 Embryophyta Species 0.000 description 1
- 230000005526 G1 to G0 transition Effects 0.000 description 1
- 244000068988 Glycine max Species 0.000 description 1
- 235000010469 Glycine max Nutrition 0.000 description 1
- 241000607479 Yersinia pestis Species 0.000 description 1
- 239000003905 agrochemical Substances 0.000 description 1
- 239000000956 alloy Substances 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000004917 carbon fiber Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003638 chemical reducing agent Substances 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000007598 dipping method Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000009313 farming Methods 0.000 description 1
- 239000003337 fertilizer Substances 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- VNWKTOKETHGBQD-UHFFFAOYSA-N methane Chemical compound C VNWKTOKETHGBQD-UHFFFAOYSA-N 0.000 description 1
- 230000002073 mitogenetic effect Effects 0.000 description 1
- 238000010899 nucleation Methods 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 108700002783 roundabout Proteins 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 238000005507 spraying Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000004575 stone Substances 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 230000002459 sustained effect Effects 0.000 description 1
- 238000009966 trimming Methods 0.000 description 1
- 238000009941 weaving Methods 0.000 description 1
- 238000009333 weeding Methods 0.000 description 1
Images
Landscapes
- Manipulator (AREA)
Abstract
The utility model discloses a grape bagging robot system based on machine vision. The grape bagging robot system based on machine vision comprises a robot intelligent moving platform, a computer vision identification location device and a mechanical arm bagging device. The robot intelligent moving platform comprises a crawler, a motion controller, a motor driver, a vehicle-mounted computer, a cloud deck camera and a two-dimensional laser ranging device, wherein the vehicle-mounted computer is positioned in the crawler. The vehicle-mounted computer further comprises an automatic path navigation module and an obstacle detection module. The computer vision identification location device comprises the crawler, a vertical slide rail and a binocular color charge coupled device (CCD) camera used for collecting grape images, wherein the vertical slide rail is positioned on the crawler, the binocular color CCD camera is installed on the vertical slide rail in an up-and-down moving mode, and the vehicle-mounted computer is installed in the crawler. The mechanical arm bagging device comprises a mechanical arm, a terminal actuator and a bag, wherein the mechanical arm is positioned on the crawler, the terminal actuator is arranged on the mechanical arm, and the bag is positioned on the terminal actuator. The grape bagging robot system based on the machine vision can reduce labor intensity and improve work efficiency.
Description
Technical field
The utility model relates to intelligent robot Robotics field, particularly relates to a kind of grape bagging robot system based on machine vision.
Background technology
Grape is one of important deciduous fruit tree kind of China, its result morning, strong adaptability, high efficiency.China's viticulture has obtained by leaps and bounds development since the eighties in 20th century, viticulture and processing have become the main path of promoting economic development, increase farmers' income in many areas.Coming the always sustainable growth of viticulture area and output 30 more.National viticulture area had reached 8,280,000 mu in 2010, and output is up to 8,430,000 tons, and grape-growing areas increases by 300,000 mu every year.The 5th in viticulture area and the output Jun Ju world.Press Table Grape output, China is high ranking first for years.
At present, the production of China's grape is in traditional farming and industrial agriculture mixed type to critical period that modern agriculture strides forward.The a lot of new mode of production and development patterns are incorporating the grape industry fast.The working strength of ploughing deeply, apply fertilizer, spraying the production links such as medicine, weeding, intertillage, pouring, bagging, harvesting, storage and processing from wine-growing to harvesting processing is larger, and mechanization degree is very low, is seriously restricting the grape production of China.
With fruit and external environment isolation, make fruit not be subject to the bad damage of external environment behind the grape bagging.Do like this and be conducive to improve the grape exterior quality, promote fruit color, make the uva face delicate, bright and clean, bright in colour; Be conducive to prevent that grape from suffering disease, worm, bird pest, and the pollution of agricultural chemicals, better realized the production of pollution-free food; Be conducive to improve good fruit rate and the fruit ear weight of grape, increase orchard worker's direct economic benefit.The grape bagging time is after fruit thinning, bears fruit to carry out between stationary phase, and the grape of this moment all is green, only the soybean grain size.
Uva bag kind and the color used at present on the market are many, but its basic structure is similar.Pasted a softer wire on the sack of paper bag, correct bagging method is to strut sack with the right hand, make that bagging is whole to stick out, hold the bottom of bag with left hand, the ventilation bar mouth of a river of bagging two bottom sides is opened, and bag swells, with from bottom to top pull-up of bag, carpopodium is placed on the incision of bag top, makes fruit ear be positioned at the central authorities of bag.At last sack is used the iron wire tighten, avoided rainwater to flow into.
At present grape bagging operation mainly is to be finished by manual operation, works loaded down with trivial details, and labour intensity is high, and efficient is low.Grape bagging work is preferably in about 7 to 10 days and finishes, and for the area of establishing in large scale grape, needs a large amount of manpowers to finish this work.Therefore, for the relatively poorer area of human resources, the application of artificial bagging technology usually is subject to very large restriction.Also might occur producing serious loss for orchard worker's income because artificial deficiency causes the untimely situation of bagging.In the face of this outstanding contradiction, the robot that orchard workers are badly in need of a kind of grape automatic bag sheathing finishes loaded down with trivial details bagging work.
Summary of the invention
In order to overcome large, the ineffective deficiency of labour intensity of existing artificial grape cover bag operation, the utility model provides a kind of grape bagging robot system based on machine vision that reduces labour intensity, increases work efficiency.
The technical scheme that its technical problem that solves the utility model adopts is:
A kind of grape bagging robot system based on machine vision comprises intelligent robot mobile platform, Computer Vision Recognition positioner and mechanical arm bagging device;
Described intelligent robot mobile platform comprises creeper truck, motion controller, motor driver, car-mounted computer, monopod video camera and scanning laser range finder, installation car borne computer in the described creeper truck, described car-mounted computer also comprises the automated path navigation module, the navigation route information that monopod video camera is obtained calculates, and the path navigation parameter that calculates flowed to motion controller, the wheel electrical machine driver carries out path trace according to the two-wheeled differential of motion controller output to creeper truck; The detection of obstacles module utilizes the detection of obstacles sensor of scanning laser range finder that surrounding environment is carried out 180 ° of scannings, the positional information of acquired disturbance thing;
Described Computer Vision Recognition positioner comprises upright slide rail and in order to gather the binocular colorful CCD camera of grape image, described binocular colorful CCD camera can be installed on the described upright slide rail up or down, installation car borne computer in the described creeper truck, described car-mounted computer also comprises in order to determine the two-dimensional coordinate of grape center of gravity in image according to the grape image, recycling binocular solid location algorithm is determined depth information, utilize camera coordinate system and robot coordinate system's coordinate transformation relation, obtain grape center of gravity and the grape center line space coordinates in the robot coordinate system and the grape locating module of form parameter;
The mechanical arm bagging device comprises mechanical arm, end effector and bagging, and described mechanical arm is installed on the described creeper truck, on the described mechanical arm end effector is installed, and on the described end effector bagging is installed.
Further, described mechanical arm comprises pedestal, waist, shoulder joint, large arm, elbow joint, forearm and the wrist joint that connects successively from top to bottom, described pedestal is fixedly mounted on the creeper truck, be rotatably mounted waist on the described pedestal, but the shoulder joint of pitch rotation is installed on the described waist, described shoulder joint is connected with large arm lower end, but described large arm upper end is connected with the elbow joint of pitch rotation, described elbow joint is connected with the forearm lower end, but described forearm upper end is connected with the wrist joint of pitch rotation, on the described wrist joint end effector is installed.
Further again, described end effector comprises the arm link, stepper motor, driving gear, left tooth bar, right tooth bar, left slider, right slide block, slide rail, left hand refers to refer to the right hand, described stepper motor is installed on the described arm link, described driving gear is installed on the output shaft of described stepper motor, described driving gear up and down respectively with left tooth bar, right tooth bar engagement, described left tooth bar is fixedly connected with left slider, described right tooth bar is fixedly connected with right slide block, on the described arm link slide rail is installed, described left slider, right slide block is set on the described slide rail, left hand is installed on the described left slider is referred to, the right hand is installed on the described right slide block is referred to.
Further, the sack of described bagging is provided with two and has flexible elastic steel sheet.
Further again, described fruit bag bracket comprises left fixed mount, right fixed mount, slide rail, left socle and right support, described left fixed mount, right fixed mount are installed in respectively on the creeper truck, between described left fixed mount, the right fixed mount slide rail are installed, and left socle and right support are installed on the described slide rail.
Described car-mounted computer also comprises grape identification locating module, in order to space coordinates and the form parameter in the robot coordinate system according to grape center of gravity and grape center line, calculating machine arm trajectory planning, according to mechanical arm trajectory planning control waist, shoulder joint, elbow joint and wrist action so that end effector arrive grape under; The automatic bag sheathing module rises in order to control end effector, and is that the finger of closure state opens and finishes envelope with original state.
Described car-mounted computer also comprises fruit bag bracket locating module, in order to according to the location parameter of fruit bag bracket on robot moving platform, carry out the mechanical arm trajectory planning, according to mechanical arm trajectory planning control waist, shoulder joint, elbow joint and wrist action, so that end effector arrives fruit bag bracket position; The automatic bag taking module is used for control end effector finger closed, finishes bag taking and struts the operation of bagging.
Described Computer Vision Recognition positioner also comprises background board, and vertical slide rail is installed on the described creeper truck, on the described vertical slide rail background board can be installed up or down.
The beneficial effects of the utility model are mainly manifested in: reduce labour intensity, increase work efficiency.
Description of drawings
Fig. 1 is bagging robot system structural representation.
Fig. 2 is bagging robot end actuator structure figure.
Fig. 3 is the grape bagging after improving.
Fig. 4 is fruit bag bracket schematic diagram.
Fig. 5 is end effector bagging procedure chart, wherein, is that bagging is positioned at the state under the grape (a), (b) is the state that end effector struts bagging; (c) be the intermediateness that end effector moves up; (d) be that grape is positioned at bagging, the state that bagging separates with end effector.
Fig. 6 is that end effector is got the bagging procedure chart, wherein, is that bagging is positioned at the state on the fruit bag bracket (a), (b) is the state that end effector clamps bagging.
Fig. 7 is bagging robot functional block diagram.
Fig. 8 is bagging robot functional flow diagram.
Fig. 9 is grape horizontal rack in-line beta pruning schematic diagram.
Wherein: 1, with the creeper truck (car-mounted computer is arranged in the car) of self-navigation function; 2, monopod video camera; 3, scanning laser range finder; 4, fruit bag bracket device; 5, pedestal; 6, waist; 7, shoulder joint; 8, large arm; 9, elbow joint; 10: forearm; 11, wrist joint; 12, end effector; 13, fruit bag; 14, background board; 15, upright guide rail; 16, vertical guide; 17, binocular CCD camera; 18, arm link; 19, stepper motor; 20, right tooth bar; 21, hand frame; 22, right slide block; 23, the right hand refers to; 24, the first slide rail; 25, the second slide rail; 26, left hand refers to; 27, left slider; 28, left tooth bar; 29, driving gear; 30, right support; 31, slide rail; 32, right fixed support; 33, left socle; 34, left fixed support; 35, spring steel plate; 36, fruit bag.
Embodiment
Below in conjunction with accompanying drawing the utility model is further described.
With reference to Fig. 1～Fig. 9, a kind of grape bagging robot based on machine vision, the cropping pattern of the grape that this robot is applicable is as follows:
Select the cropping pattern of suitable grape can be the more effective identification destination object of robot.The grape of horizontal rack cultivation, the sagging distribution of fruit is that barrier on every side is relatively less in the parallel plane, ground.Simultaneously, the horizontal rack cultivation has wider line-spacing, and such cultivation extremely is conducive to utilize the grape bagging robot of machine vision to carry out the bagging operation.
The ventilation and penetrating light performance that not only can improve the vineyard is done in the cultivation of employing horizontal rack like this, reduces the generation that summer, humidity germinated disease, and can carry out neatly pruning simultaneously.Build the garden by 1m * 4.0m seeding row spacing field planting.Frame height 2m builds with concrete column, and the corner post length is 3.2m * 0.14m * 0.14m, and side column is 2.7m * 0.1m * 0.1m, and fore-set is 2.0m * 0.06m * 0.06m, and the side column spacing is 4m.In order to increase pulling force, all outward-dipping 10 °-15 ° of corner post, side columns, the capital end connects underground buried stone with iron wire to be fixed.Reach the side column backguy all around with No. 8 galvanized wires, side column is to weaving into the refined net of 20 centimetres of spacings with No. 14 galvanized wires between the backguy, in the middle of the frame to each crosspoint fore-set vertical support of backguy.Grid commonly used is 40 centimetres, is encrypted as 20 centimetres of grids, can effectively reduce the sagging background that falls as grape of grape leaf, disturbs robot to carry out the identification of grape, is conducive to faster, the more effective position of identifying grape of bagging robot.
Utilize pruning and finishing, structure in-line tree structure.The characteristics that the horizontal rack in-line is tree-like: mitogenetic two the long masters of level are climing from the trunk of erectting, are straight " one " font, the fruit-bearing shoot cluster of the short tip of row that distributes equably in the above.Fruit-bearing shoot cluster is distributed in main climing both sides uniformly and equidistantly, and the grape position can on an approximate straight line, be conducive to the bagging robot and finish faster the bagging operation after this prune approach can make the result.
The shaping main points are in conjunction with Fig. 9, and concrete prune approach is as follows: First Year, and behind the grape transplanted seedling tree, a strong young sprout is cultivated in every strain, winter it is drawn and ties up on frame, carries out cutting back according to the substantial degree of branch, and sublateral shoot is dredged and gone, and is main climing to form first.Second Year, climing apart from frame 30～50 centimeters the first master vegetative period, cultivate round about 1～2 young sprout, as leading climing preparation branch, the young sprout of its underpart is dredged gone.The young sprout on the first main climing top drawn to both sides respectively tie up, prolong the tip and stay 10～15 leaf pinching.Winter is carried out appropriate cutting back to the first main climing elongated shoot when cutting, and other young sprouts are stayed 1～2 bud, makes it become bearing basal shoot.From the second main climing preparation branch, select a position suitable, the young sprout that growing way is strong, climing as the second master, carry out appropriate cutting back, and with another thin going.Can substantially be shaped in the 3rd year, the climing continuation of two masters that stay is prolonged, arrive and plan no longer to prolong after the length.To the bearing basal shoot that stays, carry out renewal pruning.Later trimming method is identical, make the masters of two row plant climing between at a distance of 200 centimetres.
The intelligent robot mobile platform: the intelligent robot mobile platform has creeper truck 1, motion controller (not to mark among the figure, place in the creeper truck 1), (figure does not mark motor driver, place in the creeper truck 1), car-mounted computer (does not mark among the figure, place in the creeper truck 1), monopod video camera and scanning laser range finder form, and have the self-navigation walking, the detection of obstacles function.
Creeper truck 1 in the intelligent robot mobile platform adopts the rear wheel drive mode, monopod video camera 2 detects the road surface navigation route information in real time, car-mounted computer calculates the navigation route information that monopod video camera obtains, and the guidance path deviation that calculates flowed to motion controller, the wheel electrical machine driver carries out path trace according to the two-wheeled differential of motion controller output to creeper truck.
In order to ensure the safety that the robot self-navigation is moved, the detection of obstacles sensor that uses scanning laser range finder 2 has been installed at creeper truck.This sensor can carry out 180 ° scanning in certain radius, obtain to be present in the distance of the object in this scope in polar mode.Not only can judge the existence that clear is arranged, for mobile barrier, its moving direction, the speed even size of barrier can be inferred.The relevant information of acquired disturbance thing is conducive to take suitable eluding game as far as possible.
The Computer Vision Recognition navigation system: the Computer Vision Recognition navigation system is installed in the creeper truck 1 mainly by car-mounted computer, vertical slide rail 15 and superincumbent background board 14 is installed, upright slide rail 16 and top binocular colorful CCD camera 17 thereof.
The binocular colorful CCD camera 17 of installing on the upright slide rail 16 can move up and down, thereby determines the grape of differing heights.The grape fruit of horizontal greenhouse cultivation is generally all at sustained height, but for the booth of differing heights, the height of grape is also different.Therefore need upright slide rail to regulate the height of camera, thereby enlarge its range of application.After the camera heights adjustment is complete, camera will maintain static.
Although be the grape of under horizontal booth, cultivating, because the grape of bagged stage is green, with its leaf color similarity, be difficult to by color characteristic it be identified, add grape itself complex-shaped.Directly carry out the Computer Vision Recognition difficulty larger, and can consume a large amount of time, reduce the service speed of bagging robot.Therefore be provided with the adjustable background board of a tile height 14 on the opposite of video camera.Do like this and complex background can be oversimplified, be conducive to robot more accurate, identify faster grape, improve bagging efficient.
Robot arm device: the version of mechanical arm roughly has cartesian co-ordinate type, circular cylindrical coordinate type, polar co-ordinate type and joint coordinates type.Wherein, joint type robotic arm agent structure has 4 degree of freedom, mainly is comprised of rotary joint, has the joint corresponding with people's shoulder, elbow, wrist, than the manipulator of the other types arm closer to the people.This type of mechanical arm flexibility is strong, and the compact conformation working range is large and take up room little.This patent adopts the joint type robotic arm, comprises pedestal 5, waist 6, and shoulder joint 7, large arm 8, elbow joint 9, forearm 10, wrist joint 11, end effector 12, package unit is fixed on the creeper truck.According to the bagging job requirements of grape, mechanical arm is selected the 4DOF design, is respectively waist joint rotation, shoulder joint pitching, elbow joint pitching, wrist joint pitching.For alleviate architecture quality and volume as far as possible, reduce the complexity of transmission mechanism, the mechanical structure form in four joints is basic identical, all adopts the kind of drive of direct current torque motor serial connection harmonic speed reducer, realizes the purpose that driving element and operating part unite two into one.Base and joint link lever are designed to thin-wall construction, and under the prerequisite that guarantees Rigidity and strength, aluminum alloy materials is all adopted in base and each joint, and each connecting rod is then selected the carbon fiber pipe of high-strength light.Control system adopts the distributed control based on the CAN bus communication, each joint control of mechanical arm is distributed on each joint, and as the node on the CAN bus, only four lines of need of communicating by letter with host computer, not only greatly simplify system wiring, and can realize easily the joint expansion of mechanical arm.
This device is by the mechanical arm trajectory planning in the car-mounted computer and kinetic control system control.
After the Computer Vision Recognition navigation system is sent to the space coordinates of the grape that identifies and other information in mechanical arm trajectory planning and the kinetic control system, the motion control center will be carried out track and be calculated the rational kinematic parameter in each joint, and to each joint translatory movement instruction, make mechanical arm accurately arrive the bagging position, end effector is realized the bagging operation of grape.
End effector: end effector 12 is fixed on mechanical arm tail end, the pinion and-rack switching mechanism of employing.Mainly by motor, point, gear, tooth bar, slide block, slide rail, the hand frame forms.
Left hand refers to that 26 are fixed by screws on the left slider 27 with left tooth bar 28, and the right hand refers to that 23 are fixed by screws on the right slide block 22 equally with right tooth bar 20.Slide block is fixed on the hand frame 21 by slide rail respectively, and described slide rail comprises the first slide rail 24 and the second slide rail 25 that is arranged side by side, and can be mobile at slide rail.
When motor turned clockwise, finger was closed, can support the operation of bag and bag taking; Otherwise when motor was rotated counterclockwise, finger opened, and namely was the envelope operation.The finger open and closing speed can by control motor rotating speed and turn to accomplished.
Bagging and bagging methods: the kind of uva bag and color are many in the market, but its basic structure is similar.Pasted a softer wire on the sack of paper bag, paper bag is inserted in grape after, with wire sack is tightened, make unlikely the coming off of fruit bag.If robot adopts artificial mode to do this operation, will make end effector of robot structure and control very complicated.Therefore by the simple structure of revising bagging, thereby the bagging of simplifying robot operates.Bagging sack place has two pieces to have flexible spring steel plate, since traditional paper bag poor flexibility, cracky, and the sack place adopts plastic material, is used for encasing two spring steel plates.The spring steel plate below is to adopt traditional bagging paper.The end effector of robot finger firmly one is pressed from both sides, opens behind the spring steel plate pressurized, and sack is expansible, and the end effector of robot finger unclamps sack just can be closed, finishes the bagging action.
The fruit bag bracket: fruit bag bracket 4 Main Functions are to support the fruit bag and place the fruit bag.The fruit bag bracket mainly contains left socle 33, right support 30, and slide rail 31 and left fixed mount 34, right fixed mount 32 forms.Distance between left socle 33 and the right support 30 can be adjusted.Frame bottom can be withstood slide rail 31 with bolt, thereby is fixed.Whole support is bolted on the creeper truck.
Because the bagging that different grape harvest is used varies in size, the distance between the fruit bag bracket is adjustable, thereby satisfies different types of grape bagging needs.When not loading onto the fruit bag, make distance between the support less than the diameter of fruit bag, fruit is packed to be entered the rear spring steel disc and is in by a small margin open configuration, so not only can utilize the tension force of spring steel plate that the fruit bag is fixed on the support, also help end effector more reliable, stable get fruit bag.Spring steel plate width on the fruit bag is 20mm, skids off support in order to prevent the fruit bag, support made V-shaped groove, and reserve the interval of one section 10mm, a plurality of fruit bags of installation that like this can be convenient every 20mm.
The bag taking of bagging robot and bagging process: as can be seen from Figure 6, the fruit bag original state on the fruit frame is the state that parts a little open, and shown in (a), does that like this fruit bag is fixed on the fruit frame, and is conducive to the machine finger and gets the fruit bag.Robot finger's groove can directly clamp spring steel plate on the fruit bag by fruit bag frame, makes the fruit bag strut nature and breaks away from support, shown in (b), thereby carries out next step bagging operation.
Robot passes to mechanical arm trajectory planning and kinetic control system with parameter after obtaining the form parameter and space position parameter of grape by computer vision system.Control system obtains identifying and begins to control mechanical arm behind the signal of grape and arrive fruit bag bracket position, when the motor on the end effector turns clockwise, gear clockwise rotates band carry-over bar move toward one another, the spring steel plate that finger steps up on the fruit bag makes really bag disengaging support, and also having finished simultaneously will the fruit bag operation that struts.At this moment, mechanical arm trajectory planning and kinetic control system calculate rational movement locus by form parameter and the space position parameter of the grape that obtains, and to each joint translatory movement instruction, make mechanical arm accurately arrive grape under, controlling subsequently, end effector vertically rises, overlap gradually the fringe handle place to grape, at this moment, the motor on the end effector rotates counterclockwise, and gear is rotated counterclockwise the band carry-over bar to two lateral movements, thereby unclamped spring steel plate, got final product envelope.Robotic arm returned zero-bit after bagging was finished, and robot moves on.
The bagging robot groundwork process of the present embodiment:
(1) the bagging robot moves along guidance path, the video camera Real-time Collection external image in the binocular vision identification and positioning system.
(2) the binocular vision identification and positioning system constantly carries out the grape identifying processing with the image that collects, and judges whether to have grape in the image that collects and whether have complete grape.Though the grape shape of bagged stage is different, its size is more or less the same.Therefore stipulate an area interval, the area of grape image is positioned at this interval and keeps a period of time not change, and then thinks to have collected complete grape image.
(3) when camera acquisition to complete grape image, then robot stops mobile.
(4) two cameras gather respectively the grape image, and calculate its center of gravity.Utilize the three-dimensional location of binocular vision, obtain its depth information, thereby determine its coordinate in camera coordinate system.Calculate simultaneously the parameter informations such as the length of grape in the vertical direction and width, determine its center line position.
(5) utilize camera coordinate system and robot coordinate system's coordinate transformation relation, the grape center of gravity, the information under camera coordinate system such as center line and fruit ear length are transformed into the corresponding parameter information under the robot coordinate system.
(6) with the grape space coordinates information that obtains after the Coordinate Conversion and the length of grape, width parameter is input in mechanical arm trajectory planning and the kinetic control system, sends startup command to mechanical arm control system simultaneously.
(7) after mechanical arm trajectory planning and kinetic control system are received startup command, make mechanical arm accurately arrive fruit bag bracket position by trajectory planning, the closed operation of finishing bag taking and strutting bagging of end effector finger.
(8) mechanical arm trajectory planning and kinetic control system utilize the length of grape space coordinates information and grape, and width parameter carries out track and calculates the rational kinematic parameter in each joint, and to each joint translatory movement instruction.By the trajectory planning of mechanical arm, make the end effector of bagging robot be positioned at fruit ear under, make the center line of the center line of fruit bag and grape fruit ear on same straight line, overlap gradually straight up envelope to the fringe handle place of grape with the consequence bag.At first the bagging end effector is moved to 50mm place under the grape fruit ear, the position of center line of the grape that the center line of bagging end effector finger and binocular vision system obtain remains on the same straight line.The bagging end effector vertically rises subsequently, and the rising shutheight is the 15mm place, top of grape height, and the end effector finger opens and gets final product envelope.
(9) control system analyzes by analyzing the image behind the bagging whether bagging is finished, if do not finish, then continues repeating step (4).
(10) robotic arm returned zero-bit after bagging was finished, and the robot machine advances.
Claims (6)
1. grape bagging robot system based on machine vision, it is characterized in that: described grape bagging robot system comprises intelligent robot mobile platform, Computer Vision Recognition positioner and mechanical arm bagging device;
Described intelligent robot mobile platform comprises creeper truck, motion controller, motor driver, car-mounted computer, installation car borne computer in monopod video camera and the scanning laser range finder, described creeper truck;
Described Computer Vision Recognition positioner comprises upright slide rail and in order to gather the binocular colorful CCD camera of grape image, on the described creeper truck upright slide rail is installed, and described binocular colorful CCD camera can be installed on the described upright slide rail up or down;
The mechanical arm bagging device comprises mechanical arm, end effector and bagging, and described mechanical arm is installed on the described creeper truck, on the described mechanical arm end effector is installed, and on the described end effector bagging is installed.
2. the grape bagging robot system based on machine vision as claimed in claim 1, it is characterized in that: described mechanical arm comprises the pedestal that connects successively from top to bottom, waist, shoulder joint, large arm, elbow joint; forearm and wrist joint; described pedestal is fixedly mounted on the creeper truck; be rotatably mounted waist on the described pedestal; but the shoulder joint of installation pitch rotation on the described waist; and described shoulder joint is connected with large arm lower end; but described large arm upper end is connected with the elbow joint of pitch rotation; and described elbow joint is connected with the forearm lower end; but be connected with the wrist joint of pitch rotation on the described forearm, on the described wrist joint end effector is installed.
3. the grape bagging robot system based on machine vision as claimed in claim 1 or 2, it is characterized in that: described end effector comprises the arm link, stepper motor, driving gear, left tooth bar, right tooth bar, left slider, right slide block, slide rail, left hand refers to refer to the right hand, described stepper motor is installed on the described arm link, described driving gear is installed on the output shaft of described stepper motor, described driving gear up and down respectively with left tooth bar, right tooth bar engagement, described left tooth bar is fixedly connected with left slider, described right tooth bar is fixedly connected with right slide block, on the described arm link slide rail is installed, described left slider, right slide block is set on the described slide rail, left hand is installed on the described left slider is referred to, the right hand is installed on the described right slide block is referred to.
4. the grape bagging robot system based on machine vision as claimed in claim 1 or 2, it is characterized in that: the sack of described bagging is provided with two and has flexible elastic steel sheet.
5. the grape bagging robot system based on machine vision as claimed in claim 1 or 2, it is characterized in that: the fruit bag bracket is bolted on the creeper truck, described fruit bag bracket comprises left fixed mount, right fixed mount, slide rail, left socle and right support, described left fixed mount, right fixed mount are installed in respectively on the creeper truck, between described left fixed mount, the right fixed mount slide rail is installed, left socle and right support are installed on the described slide rail.
6. the grape bagging robot system based on machine vision as claimed in claim 1 or 2, it is characterized in that: described Computer Vision Recognition positioner also comprises background board, vertical slide rail is installed on the described creeper truck, on the described vertical slide rail background board can be installed up or down.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201220159580 CN202890093U (en) | 2012-04-13 | 2012-04-13 | Grape bagging robot system based on machine vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201220159580 CN202890093U (en) | 2012-04-13 | 2012-04-13 | Grape bagging robot system based on machine vision |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN202890093U true CN202890093U (en) | 2013-04-24 |
Family
ID=48110844
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201220159580 Expired - Fee Related CN202890093U (en) | 2012-04-13 | 2012-04-13 | Grape bagging robot system based on machine vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN202890093U (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461472A (en) * | 2013-09-17 | 2015-03-25 | 西门子公司 | Programming method for a path of an end effector |
| CN105945911A (en) * | 2016-05-18 | 2016-09-21 | 赵士立 | Angle-adjustable mechanical arm |
| CN106818040A (en) * | 2017-03-05 | 2017-06-13 | 张保银 | A kind of cucumber picking robot |
| CN107309899A (en) * | 2017-06-22 | 2017-11-03 | 广东工业大学 | A kind of double freedom articulationes cylindroideus module |
| CN107545247A (en) * | 2017-08-23 | 2018-01-05 | 北京伟景智能科技有限公司 | Three-dimensional cognitive approach based on binocular identification |
| CN110576452A (en) * | 2019-08-07 | 2019-12-17 | 徐州市茗尧机械制造有限公司 | Arm suitable for snatch steel sheet |
| CN114301006A (en) * | 2021-12-29 | 2022-04-08 | 国网瑞嘉(天津)智能机器人有限公司 | Intelligent controller, insulating bucket arm car and live working equipment |
-
2012
- 2012-04-13 CN CN 201220159580 patent/CN202890093U/en not_active Expired - Fee Related
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461472A (en) * | 2013-09-17 | 2015-03-25 | 西门子公司 | Programming method for a path of an end effector |
| US9931751B2 (en) | 2013-09-17 | 2018-04-03 | Siemens Aktiengesellschaft | Programming method for a path to be traveled by an end effector |
| CN104461472B (en) * | 2013-09-17 | 2018-07-06 | 西门子公司 | The setting method of the track to be passed through of end effector |
| CN105945911A (en) * | 2016-05-18 | 2016-09-21 | 赵士立 | Angle-adjustable mechanical arm |
| CN106818040A (en) * | 2017-03-05 | 2017-06-13 | 张保银 | A kind of cucumber picking robot |
| CN107309899A (en) * | 2017-06-22 | 2017-11-03 | 广东工业大学 | A kind of double freedom articulationes cylindroideus module |
| CN107545247A (en) * | 2017-08-23 | 2018-01-05 | 北京伟景智能科技有限公司 | Three-dimensional cognitive approach based on binocular identification |
| CN110576452A (en) * | 2019-08-07 | 2019-12-17 | 徐州市茗尧机械制造有限公司 | Arm suitable for snatch steel sheet |
| CN114301006A (en) * | 2021-12-29 | 2022-04-08 | 国网瑞嘉(天津)智能机器人有限公司 | Intelligent controller, insulating bucket arm car and live working equipment |
| CN114301006B (en) * | 2021-12-29 | 2024-04-12 | 国网瑞嘉(天津)智能机器人有限公司 | Intelligent controller, insulating arm car and live working equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102613041B (en) | Grape bagging robot system based on machine vision | |
| CN202890093U (en) | Grape bagging robot system based on machine vision | |
| CN111758424B (en) | Automatic device of pinching of field cotton | |
| CN209527208U (en) | A kind of strawberry picking machine | |
| CN202818996U (en) | Grapevine pruning robot system | |
| CN109597420A (en) | A kind of intelligent grass-removing boundary is closed processing system and method automatically | |
| CN211745437U (en) | Robot is picked to overhead fruit vegetables intelligence | |
| CN106941791A (en) | A kind of remote-controllable formula Multi-functional tillage pipe device | |
| CN104521435A (en) | Automatic cutting type tea harvester cutting bench automatic levelling method and device | |
| CN108450117B (en) | High pole liquid manure all-in-one based on wireless communication | |
| CN113678587B (en) | Unmanned rice intertillage weeding machine and operation method thereof | |
| CN109964558B (en) | Small arch shed internal intelligent weeding and seedling thinning machine and use method | |
| Liu et al. | Development and field test of an autonomous strawberry plug seeding transplanter for use in elevated cultivation | |
| Peng et al. | Research progress of urban dual-arm humanoid grape harvesting robot | |
| Zhang et al. | Research status of agricultural robot technology | |
| CN107509399A (en) | A kind of green intelligent weed-eradicating robot | |
| CN108323325B (en) | Strawberry picking machine simulating human hands and picking method | |
| CN215122201U (en) | Intelligent multi-arm tea plucking machine | |
| CN202819064U (en) | Grape winter pruning operation device based on machine vision | |
| CN212344481U (en) | Unmanned transplanter based on Beidou navigation and positioning system | |
| CN208079863U (en) | A kind of strawberry picking machine imitating human hand type | |
| CN209215940U (en) | A kind of self-travel type field crop phenotypic information acquisition device | |
| CN201805742U (en) | Manipulator of fruit green house | |
| CN110679317A (en) | Grape winter pruning car | |
| CN110679316A (en) | Grape winter pruning system suitable for T type cultivation mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130424 Termination date: 20160413 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |