Nothing Special   »   [go: up one dir, main page]

CN116017160A - An Intelligent Mineral Processing Method Based on Image Processing System - Google Patents

An Intelligent Mineral Processing Method Based on Image Processing System Download PDF

Info

Publication number
CN116017160A
CN116017160A CN202211597345.0A CN202211597345A CN116017160A CN 116017160 A CN116017160 A CN 116017160A CN 202211597345 A CN202211597345 A CN 202211597345A CN 116017160 A CN116017160 A CN 116017160A
Authority
CN
China
Prior art keywords
image
server
method based
boundary line
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211597345.0A
Other languages
Chinese (zh)
Inventor
张雪男
卓文伟
马国强
张运福
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anhui CRRC Ruida Electric Co Ltd
Original Assignee
Anhui CRRC Ruida Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anhui CRRC Ruida Electric Co Ltd filed Critical Anhui CRRC Ruida Electric Co Ltd
Priority to CN202211597345.0A priority Critical patent/CN116017160A/en
Publication of CN116017160A publication Critical patent/CN116017160A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Image Processing (AREA)

Abstract

The invention discloses an intelligent beneficiation method based on an image processing system, which belongs to the technical field of intelligent beneficiation, and comprises an image server, a patrol robot, a DTU, a PLC control box, an electric push rod assembly, a switch and an AP module; image data of the cradle collected by the inspection robot are transmitted to an image server through WIFI, the image server adopts a deep learning algorithm to mark the boundary between ore grains and impurities, and the image processing algorithm: the marking of the mine line is finished based on the deep learning method, so that the accuracy is high and the effect is good; modular system architecture: the system structure adopts a modularized design, so that the reconfigurability is strong, and the expansibility and compatibility are good; advanced and economical efficiency: mature and mainstream equipment is adopted to construct a system, and the system construction fully utilizes the current latest technologies such as video and audio, data, network and the like, and fully considers the continuous change of requirements and technologies. The system has high overall configuration performance, reasonable price and lower construction cost and investment.

Description

一种基于图像处理系统的智能化选矿方法An Intelligent Mineral Processing Method Based on Image Processing System

技术领域technical field

本发明涉及智能化选矿技术领域,具体为一种基于图像处理系统的智能化选矿方法。The invention relates to the technical field of intelligent mineral processing, in particular to an intelligent mineral processing method based on an image processing system.

背景技术Background technique

传统的锡矿摇床分矿后需要人工移动托盘进行接矿,由于分矿的时间长,摇床的数量多,需要大量的人力成本和时间成本。为了相应国家号召,需要将落后的人工方式替换成先进的智能化方式,基于此,本发明设计了一种基于图像处理系统的智能化选矿方法以解决上述问题。The traditional tin ore shaking table needs to manually move the tray to pick up the ore after separation. Due to the long time of separation and the large number of shaking tables, a lot of labor and time costs are required. In order to respond to the national call, it is necessary to replace the backward manual method with an advanced intelligent method. Based on this, the present invention designs an intelligent mineral processing method based on an image processing system to solve the above problems.

发明内容Contents of the invention

本发明的目的在于提供一种基于图像处理系统的智能化选矿方法,以解决上述背景技术中提出的问题。The object of the present invention is to provide an intelligent mineral processing method based on an image processing system to solve the problems raised in the above-mentioned background technology.

为实现上述目的,本发明提供如下技术方案:一种基于图像处理系统的智能化选矿方法,包括有图像服务器、巡检机器人、DTU、PLC控制箱、电动推杆组件、交换机与AP模块;In order to achieve the above object, the present invention provides the following technical solutions: an intelligent mineral processing method based on an image processing system, including an image server, an inspection robot, a DTU, a PLC control box, an electric push rod assembly, a switch and an AP module;

巡检机器人采集摇床的图像数据通过WIFI传输给图像服务器,图像服务器采用深度学习算法标注出矿粒与杂质的分界线,然后根据分界线位置输出相应的控制信号,控制信号经过DTU模块的转发到PLC控制箱,PLC控制箱控制电动推杆组件自动追踪矿线位置完成接矿任务;The inspection robot collects the image data of the shaker and transmits it to the image server through WIFI. The image server uses a deep learning algorithm to mark the boundary line between mineral particles and impurities, and then outputs the corresponding control signal according to the position of the boundary line. The control signal is forwarded by the DTU module To the PLC control box, the PLC control box controls the electric push rod assembly to automatically track the position of the mine line to complete the mine receiving task;

接矿控制策略方法:Mine access control strategy method:

1)建立坐标系,1) Establish a coordinate system,

以摇床的出水侧边界线与摇床接矿侧边界线交点为坐标原点O,以平行于接矿侧边界线,逆水流方向为正方向建立坐标系;Take the intersection point of the boundary line on the water outlet side of the shaking table and the boundary line on the ore-connecting side of the shaking table as the coordinate origin O, and establish a coordinate system parallel to the boundary line on the ore-connecting side and the reverse flow direction as the positive direction;

2)图像识别数据,2) image recognition data,

图像算法按照不同的筛选精度进行标定分界线,并计算各锡矿分界线与坐标系交点的位置X1,X2,X3;图像算法同时会尝试检测托盘的中心线在坐标系上的位置X0,这一过程可使用目标检测框选出托盘位置,或者在设计时在托盘上人为标记中线位置方便图像识别;The image algorithm calibrates the boundary line according to different screening accuracy, and calculates the positions X1, X2, X3 of the intersection points of each tin mine boundary line and the coordinate system; the image algorithm will also try to detect the position X0 of the center line of the pallet on the coordinate system, which is In the first process, the target detection frame can be used to select the position of the pallet, or the midline position can be artificially marked on the pallet during design to facilitate image recognition;

3)移动控制算法,3) Mobile control algorithm,

1.每次启动后托盘回到坐标原点0位置;1. After each startup, the pallet returns to the coordinate origin 0 position;

2.服器采集第n个时间段的分界线坐标X1_n,X2_n,X3_n以及X0_n的值;同时服务器还应该记录上一次的分界线坐标X1_n-1,X2_n-1,X3_n-1的值;2. The server collects the values of the boundary coordinates X1_n, X2_n, X3_n and X0_n of the nth time period; at the same time, the server should also record the values of the last boundary coordinates X1_n-1, X2_n-1, X3_n-1;

3.按照工况要求选择采用那个分界线坐标Xi_n,i为分界线索引,n为时间段索引,若可以得到X0_n值,则控制器的移动距离d_n=Xi_n-X0_n,若无法得到X0_n,则控制器的移动距离d_n=Xi_n-Xi_n-1;3. Select the coordinate Xi_n of the boundary line according to the requirements of the working conditions, i is the index of the boundary line, and n is the index of the time period. If the value of X0_n can be obtained, the moving distance of the controller is d_n=Xi_n-X0_n. If X0_n cannot be obtained, then The moving distance of the controller d_n=Xi_n-Xi_n-1;

4.服务器下发控制指令,4. The server issues control commands,

服务器计算出d_n后即可下发指定给DTU,在服务器内添加自定义脚本,实现将“移动d_n”转化为推杆控制器可以识别的控制指令;自定义脚本支持Python,JavaScript,Java,Rust,C/C++,Lua,Groovy等语言,支持二次开发,提供API接口,高兼容性,高拓展性。After the server calculates d_n, it can send it to the DTU, and add a custom script in the server to realize the conversion of "moving d_n" into a control command that the actuator controller can recognize; the custom script supports Python, JavaScript, Java, Rust , C/C++, Lua, Groovy and other languages, support secondary development, provide API interface, high compatibility and high scalability.

DTU接收到服务器发来的控制指令后直接转发给接矿设备控制器,实现自动化、智能化接矿操作。After receiving the control command from the server, the DTU directly forwards it to the mine receiving equipment controller to realize automatic and intelligent mine receiving operation.

优选的,在所述摇床组上方搭设龙门架,用于吊装轨道,在过道两边加设三角支撑柱,提高龙门架的结构稳定性,以及避让导轨。Preferably, a gantry frame is set up above the shaker group for hoisting the track, and triangular support columns are added on both sides of the aisle to improve the structural stability of the gantry frame and avoid guide rails.

上场区:设定摄像机在每个摇床前停留10秒,用于采集图像信息,24个摇床一共需要停留240秒;移动路径为:左端→右端→左端;总行程72米,设定移动摄像机运行速度为5米/分钟,完成一个循环大约需要20分钟。Playing area: Set the camera to stay in front of each shaker for 10 seconds to collect image information. The 24 shakers need to stay for 240 seconds in total; the moving path is: left end → right end → left end; the total travel distance is 72 meters, set the movement The camera runs at a speed of 5 m/min and takes approximately 20 minutes to complete a cycle.

优选的,下场区:设定摄像机在每个摇床前停留10秒,用于采集图像信息,22个摇床一共需要停留220秒;移动路径为:左端→右端→左端;总行程72米,设定移动摄像机运行速度为5米/分钟,完成一个循环大约需要20分钟,摇床与水泥墙连接。Preferably, the next field area: set the camera to stay in front of each shaker for 10 seconds to collect image information, and the 22 shakers need to stay for 220 seconds in total; the moving path is: left end → right end → left end; the total stroke is 72 meters, Set the mobile camera to run at a speed of 5 m/min. It takes about 20 minutes to complete a cycle, and the shaker is connected to the cement wall.

优选的,水泥围栏上加装一层U型支架,卡在水泥墙上,在U型支架上设置两排安装孔,与电缸的导轨的安装尺寸相对应;电缸的滑块与分流板连接,电缸滑块带动分流板实现左右移动;分流板采用钣金件。Preferably, a layer of U-shaped support is installed on the cement fence, and it is stuck on the cement wall. Two rows of mounting holes are set on the U-shaped support, corresponding to the installation size of the guide rail of the electric cylinder; the slider of the electric cylinder and the splitter plate Connection, the electric cylinder slider drives the splitter plate to move left and right; the splitter plate is made of sheet metal.

优选的,所述电缸通电后,会反馈给控制器当前滑块的位置信息,摄像机对摇床进行拍照,经过图像处理后,得到水流分界线位置信息,服务器将水流分线位置信息发送到电缸控制器,控制器给电缸发送位置信息指令,电缸的滑块进行移动,并带动分流板移动至指定位置。Preferably, after the electric cylinder is powered on, it will feed back the position information of the current slider to the controller, and the camera will take pictures of the shaker, and after image processing, the position information of the water flow dividing line will be obtained, and the server will send the position information of the water flow dividing line to Electric cylinder controller, the controller sends position information instructions to the electric cylinder, the slider of the electric cylinder moves, and drives the diverter plate to move to the designated position.

优选的,所述图像识别模型的建立需要大量的图像数据信息,基本模型建立至少需要50000张图片;为了尽可能多的识别信息,不仅需要客户提供大量的现场图像信息,还需要在加工现场实时采集图像进行训练;为此系统提供专门的训练模式,在训练模式下,巡检机器人在环形轨道上对各个云锡矿摇床进行巡检拍照,将位置信息和图像信息发送到服务器监控管理软件平台,监控管理软件调用图像模型处理软件对图像模型进行训练。Preferably, the establishment of the image recognition model requires a large amount of image data information, and the establishment of the basic model requires at least 50,000 pictures; in order to identify as much information as possible, not only the customer is required to provide a large amount of on-site image information, but also real-time processing at the processing site. Collect images for training; this system provides a special training mode. In the training mode, the inspection robot inspects and takes photos of each shaker in the Yunnan Tin Mine on the circular track, and sends the location information and image information to the server monitoring and management software. Platform, the monitoring management software calls the image model processing software to train the image model.

优选的,所述监控管理软件平台接收到巡检机器人的拍照图片之后,图像标注软件会在图像上进行标注,需要人工核查标注是否准确,如果标注正确则图片进入训练库,如果标注错误,需要人工修正之后,图片再进入训练库。Preferably, after the monitoring and management software platform receives the picture taken by the inspection robot, the image labeling software will mark the image, and it is necessary to manually check whether the mark is accurate. If the mark is correct, the picture will enter the training library. If the mark is wrong, it needs to After manual correction, the pictures are then entered into the training library.

优选的,所述图像模型处理软件定期使用训练库,对图像模型进行训练,强化模型的识别准确率。Preferably, the image model processing software regularly uses the training library to train the image model to enhance the recognition accuracy of the model.

优选的,所述图像采集的识别流程为:Preferably, the identification process of the image acquisition is:

(1)巡检机器人上设置的摄像机模块对目标区域进行30s摄像采集,设定在采集位置光线的强度小于一定值时,自动打开摄像机旁边的灯光对拍摄位置进行照射补光,避免某一部分位置的角度光线的问题造成拍摄图片的不清晰,不便于后续工作人员对图片进行观察,影响后续判断的结果,且较小部件拍摄的过程中,经过系统判断可自动将摄像头对比尺寸放大,对拍摄的位置进行放大处理拍摄,对后续工作人员的查看具有一定的帮助,可直接观察,不需要工作人员对图片进行其他操作,更快的加速的工作的进行,较为实用;(1) The camera module installed on the inspection robot performs 30s video capture of the target area. When the light intensity at the collection position is set to be less than a certain value, the light next to the camera is automatically turned on to illuminate the shooting position to avoid a certain part of the position. The problem of the angle of light caused the pictures taken to be unclear, which is not convenient for the follow-up staff to observe the pictures, which affects the results of subsequent judgments. In the process of shooting small parts, the comparison size of the camera can be automatically enlarged after the system judgment, which is very important for the shooting. It can be used for direct observation without the need for staff to perform other operations on the picture, and it is more practical to carry out faster and accelerated work;

(2)将采集的目标区域图像数据和定位信息数据传输到服务器中;(2) transmit the collected target area image data and positioning information data to the server;

(3)服务器接收存储目标区域图像数据和定位信息数据、拍摄时间,以及图像拍摄位置数据;(3) The server receives and stores the target area image data and positioning information data, shooting time, and image shooting location data;

(4)服务器将目标区域图像数据进行标注。(4) The server marks the image data of the target area.

与现有技术相比,本发明的有益效果是:Compared with prior art, the beneficial effect of the present invention is:

图像处理算法:基于深度学习的方法完成矿线的标注,精确度高,效果好。Image processing algorithm: The method based on deep learning completes the labeling of mine lines, with high accuracy and good effect.

模块化的系统结构:系统结构采用模块化设计,可重构性强,拓展性和兼容性好。Modular system structure: The system structure adopts a modular design, which has strong reconfigurability, good scalability and compatibility.

先进性与经济性:采用成熟、主流的设备构建系统,系统建设充分利用当前最新的视音频、数据、网络等技术,充分兼顾需求和技术的不断变化。系统整体配置性能高,价格合理,建设成本和投入较低。Advancement and economy: mature and mainstream equipment is used to build the system, and the system construction makes full use of the latest audio-visual, data, network and other technologies, fully taking into account the continuous changes in demand and technology. The overall configuration performance of the system is high, the price is reasonable, and the construction cost and investment are low.

当然,实施本发明的任一产品并不一定需要同时达到以上所述的所有优点。Of course, any product implementing the present invention does not necessarily need to achieve all the above-mentioned advantages at the same time.

附图说明Description of drawings

为了更清楚地说明本发明实施例的技术方案,下面将对实施例描述所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the accompanying drawings that are required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. Those of ordinary skill in the art can also obtain other drawings based on these drawings without any creative effort.

图1为本发明整体结构示意图;Fig. 1 is a schematic diagram of the overall structure of the present invention;

图2为本发明上场区龙门架示意图;Fig. 2 is a schematic diagram of the gantry frame in the field area of the present invention;

图3为本发明下场区龙门架示意图一;Fig. 3 is a schematic diagram of the gantry in the lower field area of the present invention;

图4为本发明下场区龙门架示意图二;Fig. 4 is the second schematic diagram of the gantry frame in the lower field area of the present invention;

图5为本发明三角架示意图;Fig. 5 is a schematic diagram of a tripod of the present invention;

图6为本发明摇床和水泥墙的连接示意图;Fig. 6 is the connection schematic diagram of shaking bed and cement wall of the present invention;

图7为本发明水泥墙和U型支架连接示意图;Fig. 7 is the connection schematic diagram of cement wall and U-shaped support of the present invention;

图8为本发明坐标系选择托盘示意图。Fig. 8 is a schematic diagram of a pallet for selecting a coordinate system in the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其它实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

请参阅图1至图8,本发明提供一种基于图像处理系统的智能化选矿方法技术方案:包括有图像服务器、巡检机器人、DTU、PLC控制箱、电动推杆组件、交换机与AP模块;Please refer to Figures 1 to 8, the present invention provides a technical solution for an intelligent mineral processing system based on an image processing system: including an image server, a patrol robot, a DTU, a PLC control box, an electric push rod assembly, a switch and an AP module;

巡检机器人采集摇床的图像数据通过WIFI传输给图像服务器,图像服务器采用深度学习算法标注出矿粒与杂质的分界线,然后根据分界线位置输出相应的控制信号,控制信号经过DTU模块的转发到PLC控制箱,PLC控制箱控制电动推杆组件自动追踪矿线位置完成接矿任务;The inspection robot collects the image data of the shaker and transmits it to the image server through WIFI. The image server uses a deep learning algorithm to mark the boundary line between mineral particles and impurities, and then outputs the corresponding control signal according to the position of the boundary line. The control signal is forwarded by the DTU module To the PLC control box, the PLC control box controls the electric push rod assembly to automatically track the position of the mine line to complete the mine receiving task;

接矿控制策略方法:Mine access control strategy method:

1)建立坐标系,1) Establish a coordinate system,

以摇床的出水侧边界线与摇床接矿侧边界线交点为坐标原点O,以平行于接矿侧边界线,逆水流方向为正方向建立坐标系;Take the intersection point of the boundary line on the water outlet side of the shaking table and the boundary line on the ore-connecting side of the shaking table as the coordinate origin O, and establish a coordinate system parallel to the boundary line on the ore-connecting side and the reverse flow direction as the positive direction;

2)图像识别数据,2) image recognition data,

图像算法按照不同的筛选精度进行标定分界线,并计算各锡矿分界线与坐标系交点的位置X1,X2,X3;图像算法同时会尝试检测托盘的中心线在坐标系上的位置X0,这一过程可使用目标检测框选出托盘位置,或者在设计时在托盘上人为标记中线位置方便图像识别;The image algorithm calibrates the boundary line according to different screening accuracy, and calculates the positions X1, X2, X3 of the intersection points of each tin mine boundary line and the coordinate system; the image algorithm will also try to detect the position X0 of the center line of the pallet on the coordinate system, which is In the first process, the target detection frame can be used to select the position of the pallet, or the midline position can be artificially marked on the pallet during design to facilitate image recognition;

3)移动控制算法,3) Mobile control algorithm,

1.每次启动后托盘回到坐标原点0位置;1. After each startup, the pallet returns to the coordinate origin 0 position;

2.服器采集第n个时间段的分界线坐标X1_n,X2_n,X3_n以及X0_n的值;同时服务器还应该记录上一次的分界线坐标X1_n-1,X2_n-1,X3_n-1的值;2. The server collects the values of the boundary coordinates X1_n, X2_n, X3_n and X0_n of the nth time period; at the same time, the server should also record the values of the last boundary coordinates X1_n-1, X2_n-1, X3_n-1;

3.按照工况要求选择采用那个分界线坐标Xi_n,i为分界线索引,n为时间段索引,若可以得到X0_n值,则控制器的移动距离d_n=Xi_n-X0_n,若无法得到X0_n,则控制器的移动距离d_n=Xi_n-Xi_n-1;3. Select the coordinate Xi_n of the boundary line according to the requirements of the working conditions, i is the index of the boundary line, and n is the index of the time period. If the value of X0_n can be obtained, the moving distance of the controller is d_n=Xi_n-X0_n. If X0_n cannot be obtained, then The moving distance of the controller d_n=Xi_n-Xi_n-1;

4.服务器下发控制指令,4. The server issues control commands,

服务器计算出d_n后即可下发指定给DTU,在服务器内添加自定义脚本,实现将“移动d_n”转化为推杆控制器可以识别的控制指令;自定义脚本支持Python,JavaScript,Java,Rust,C/C++,Lua,Groovy等语言,支持二次开发,提供API接口,高兼容性,高拓展性。After the server calculates d_n, it can send it to the DTU, and add a custom script in the server to realize the conversion of "moving d_n" into a control command that the actuator controller can recognize; the custom script supports Python, JavaScript, Java, Rust , C/C++, Lua, Groovy and other languages, support secondary development, provide API interface, high compatibility and high scalability.

DTU接收到服务器发来的控制指令后直接转发给接矿设备控制器,实现自动化、智能化接矿操作。After receiving the control command from the server, the DTU directly forwards it to the mine receiving equipment controller to realize automatic and intelligent mine receiving operation.

优选的,在所述摇床组上方搭设龙门架,用于吊装轨道,在过道两边加设三角支撑柱,提高龙门架的结构稳定性,以及避让导轨。Preferably, a gantry frame is set up above the shaker group for hoisting the track, and triangular support columns are added on both sides of the aisle to improve the structural stability of the gantry frame and avoid guide rails.

上场区:设定摄像机在每个摇床前停留10秒,用于采集图像信息,24个摇床一共需要停留240秒;移动路径为:左端→右端→左端;总行程72米,设定移动摄像机运行速度为5米/分钟,完成一个循环大约需要20分钟,下场区:设定摄像机在每个摇床前停留10秒,用于采集图像信息,22个摇床一共需要停留220秒;移动路径为:左端→右端→左端;总行程72米,设定移动摄像机运行速度为5米/分钟,完成一个循环大约需要20分钟,摇床与水泥墙连接,水泥围栏上加装一层U型支架,卡在水泥墙上,在U型支架上设置两排安装孔,与电缸的导轨的安装尺寸相对应;电缸的滑块与分流板连接,电缸滑块带动分流板实现左右移动;分流板采用钣金件,所述电缸通电后,会反馈给控制器当前滑块的位置信息,摄像机对摇床进行拍照,经过图像处理后,得到水流分界线位置信息,服务器将水流分线位置信息发送到电缸控制器,控制器给电缸发送位置信息指令,电缸的滑块进行移动,并带动分流板移动至指定位置,所述图像识别模型的建立需要大量的图像数据信息,基本模型建立至少需要50000张图片;为了尽可能多的识别信息,不仅需要客户提供大量的现场图像信息,还需要在加工现场实时采集图像进行训练;为此系统提供专门的训练模式,在训练模式下,巡检机器人在环形轨道上对各个云锡矿摇床进行巡检拍照,将位置信息和图像信息发送到服务器监控管理软件平台,监控管理软件调用图像模型处理软件对图像模型进行训练,所述监控管理软件平台接收到巡检机器人的拍照图片之后,图像标注软件会在图像上进行标注,需要人工核查标注是否准确,如果标注正确则图片进入训练库,如果标注错误,需要人工修正之后,图片再进入训练库,所述图像模型处理软件定期使用训练库,对图像模型进行训练,强化模型的识别准确率,所述图像采集的识别流程为:Playing area: Set the camera to stay in front of each shaker for 10 seconds to collect image information. The 24 shakers need to stay for 240 seconds in total; the moving path is: left end → right end → left end; the total travel distance is 72 meters, set the movement The running speed of the camera is 5 m/min. It takes about 20 minutes to complete a cycle. The next area: set the camera to stay in front of each shaker for 10 seconds to collect image information. The 22 shakers need to stay for 220 seconds in total; move The path is: left end → right end → left end; the total travel distance is 72 meters, and the moving camera is set at a speed of 5 m/min. It takes about 20 minutes to complete a cycle. The shaker is connected to the cement wall, and a U-shaped layer is installed on the cement fence. The bracket is stuck on the cement wall, and two rows of mounting holes are set on the U-shaped bracket, corresponding to the installation size of the guide rail of the electric cylinder; the slider of the electric cylinder is connected with the manifold, and the slider of the electric cylinder drives the manifold to move left and right The diverter plate is made of sheet metal. After the electric cylinder is powered on, it will feed back the position information of the current slider to the controller. The camera takes pictures of the shaking table. After image processing, the position information of the water flow boundary is obtained, and the server divides the water flow. Line position information is sent to the electric cylinder controller, the controller sends position information instructions to the electric cylinder, the slider of the electric cylinder moves, and drives the diverter plate to move to the designated position. The establishment of the image recognition model requires a large amount of image data information , the establishment of the basic model requires at least 50,000 pictures; in order to identify as much information as possible, not only does the customer need to provide a large amount of on-site image information, but also needs to collect images in real time at the processing site for training; this system provides a special training mode. In this mode, the inspection robot inspects and takes pictures of each shaker of Yunxi Mine on the circular track, sends the location information and image information to the server monitoring and management software platform, and the monitoring management software calls the image model processing software to train the image model. After the monitoring and management software platform receives the pictures taken by the inspection robot, the image labeling software will mark on the image, and it is necessary to manually check whether the label is accurate. If the label is correct, the picture will enter the training library. If the label is wrong, it needs to be corrected manually. , the picture enters the training library again, and the image model processing software regularly uses the training library to train the image model and strengthen the recognition accuracy of the model. The recognition process of the image acquisition is:

(1)巡检机器人上设置的摄像机模块对目标区域进行30s摄像采集,设定在采集位置光线的强度小于一定值时,自动打开摄像机旁边的灯光对拍摄位置进行照射,避免某一部分位置的角度光线的问题造成拍摄图片的不清晰,不便于后续工作人员对图片进行观察,影响后续判断的结果;(1) The camera module installed on the inspection robot collects the target area for 30s. When the light intensity at the collection position is set to be less than a certain value, the light next to the camera is automatically turned on to illuminate the shooting position, avoiding the angle of a certain part of the position. The problem of light makes the pictures taken unclear, which is not convenient for the follow-up staff to observe the pictures, and affects the results of follow-up judgments;

(2)将采集的目标区域图像数据和定位信息数据传输到服务器中;(2) transmit the collected target area image data and positioning information data to the server;

(3)服务器接收存储目标区域图像数据和定位信息数据、拍摄时间,以及图像拍摄位置数据;(3) The server receives and stores the target area image data and positioning information data, shooting time, and image shooting location data;

(4)服务器将目标区域图像数据进行标注。(4) The server marks the image data of the target area.

本发明所提供的产品型号只是为本技术方案依据产品的结构特征进行的使用,其产品会在购买后进行调整与改造,使之更加匹配和符合本发明所属技术方案,其为本技术方案一个最佳应用的技术方案,其产品的型号可以依据其需要的技术参数进行替换和改造,其为本领域所属技术人员所熟知的,因此,本领域所属技术人员可以清楚的通过本发明所提供的技术方案得到对应的使用效果。The product model provided by the present invention is only for the use of this technical solution based on the structural characteristics of the product, and its product will be adjusted and transformed after purchase to make it more matching and in line with the technical solution of the present invention, which is one of the technical solutions The technical solution for the best application, the model of its product can be replaced and transformed according to its required technical parameters, which is well known to those skilled in the art, therefore, those skilled in the art can clearly pass through the provided by the present invention The technical solution obtains the corresponding use effect.

在本说明书的描述中,参考术语“一个实施例”、“示例”、“具体示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, descriptions with reference to the terms "one embodiment", "example", "specific example" and the like mean that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment of the present invention. In an embodiment or example. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

以上公开的本发明优选实施例只是用于帮助阐述本发明。优选实施例并没有详尽叙述所有的细节,也不限制该发明仅为所述的具体实施方式。显然,根据本说明书的内容,可作很多的修改和变化。本说明书选取并具体描述这些实施例,是为了更好地解释本发明的原理和实际应用,从而使所属技术领域技术人员能很好地理解和利用本发明。本发明仅受权利要求书及其全部范围和等效物的限制。The preferred embodiments of the invention disclosed above are only to help illustrate the invention. The preferred embodiments are not exhaustive in all detail, nor are the inventions limited to specific embodiments described. Obviously, many modifications and variations can be made based on the contents of this specification. This description selects and specifically describes these embodiments in order to better explain the principle and practical application of the present invention, so that those skilled in the art can well understand and utilize the present invention. The invention is to be limited only by the claims, along with their full scope and equivalents.

Claims (9)

1.一种基于图像处理系统的智能化选矿方法,其特征在于,包括有图像服务器、巡检机器人、DTU、PLC控制箱、电动推杆组件、交换机与AP模块;1. An intelligent mineral processing method based on an image processing system, characterized in that it includes an image server, an inspection robot, a DTU, a PLC control box, an electric push rod assembly, a switch and an AP module; 巡检机器人采集摇床的图像数据通过WIFI传输给图像服务器,图像服务器采用深度学习算法标注出矿粒与杂质的分界线,然后根据分界线位置输出相应的控制信号,控制信号经过DTU模块的转发到PLC控制箱,PLC控制箱控制电动推杆组件自动追踪矿线位置完成接矿任务;The inspection robot collects the image data of the shaker and transmits it to the image server through WIFI. The image server uses a deep learning algorithm to mark the boundary line between mineral particles and impurities, and then outputs the corresponding control signal according to the position of the boundary line. The control signal is forwarded by the DTU module To the PLC control box, the PLC control box controls the electric push rod assembly to automatically track the position of the mine line to complete the mine receiving task; 接矿控制策略方法:Mine access control strategy method: 1)建立坐标系,1) Establish a coordinate system, 以摇床的出水侧边界线与摇床接矿侧边界线交点为坐标原点O,以平行于接矿侧边界线,逆水流方向为正方向建立坐标系;Take the intersection point of the boundary line on the water outlet side of the shaking table and the boundary line on the ore-connecting side of the shaking table as the coordinate origin O, and establish a coordinate system parallel to the boundary line on the ore-connecting side and the reverse flow direction as the positive direction; 2)图像识别数据,2) image recognition data, 图像算法按照不同的筛选精度进行标定分界线,并计算各锡矿分界线与坐标系交点的位置X1,X2,X3;图像算法同时会尝试检测托盘的中心线在坐标系上的位置X0,这一过程可使用目标检测框选出托盘位置,或者在设计时在托盘上人为标记中线位置方便图像识别;The image algorithm calibrates the boundary line according to different screening accuracy, and calculates the positions X1, X2, X3 of the intersection points of each tin mine boundary line and the coordinate system; the image algorithm will also try to detect the position X0 of the center line of the pallet on the coordinate system, which is In the first process, the target detection frame can be used to select the position of the pallet, or the midline position can be artificially marked on the pallet during design to facilitate image recognition; 3)移动控制算法,3) Mobile control algorithm, 1.每次启动后托盘回到坐标原点0位置;1. After each startup, the pallet returns to the coordinate origin 0 position; 2.服器采集第n个时间段的分界线坐标X1_n,X2_n,X3_n以及X0_n的值;同时服务器还应该记录上一次的分界线坐标X1_n-1,X2_n-1,X3_n-1的值;2. The server collects the values of the boundary coordinates X1_n, X2_n, X3_n and X0_n of the nth time period; at the same time, the server should also record the values of the last boundary coordinates X1_n-1, X2_n-1, X3_n-1; 3.按照工况要求选择采用那个分界线坐标Xi_n,i为分界线索引,n为时间段索引,若可以得到X0_n值,则控制器的移动距离d_n=Xi_n-X0_n,若无法得到X0_n,则控制器的移动距离d_n=Xi_n-Xi_n-1;3. Select the coordinate Xi_n of the boundary line according to the requirements of the working conditions, i is the index of the boundary line, and n is the index of the time period. If the value of X0_n can be obtained, the moving distance of the controller is d_n=Xi_n-X0_n. If X0_n cannot be obtained, then The moving distance of the controller d_n=Xi_n-Xi_n-1; 4.服务器下发控制指令,4. The server issues control commands, 服务器计算出d_n后即可下发指定给DTU,在服务器内添加自定义脚本,实现将“移动d_n”转化为推杆控制器可以识别的控制指令;自定义脚本支持Python,JavaScript,Java,Rust,C/C++,Lua,Groovy等语言。After the server calculates d_n, it can send it to the DTU, and add a custom script in the server to realize the conversion of "moving d_n" into a control command that the actuator controller can recognize; the custom script supports Python, JavaScript, Java, Rust , C/C++, Lua, Groovy and other languages. 2.根据权利要求1所述的一种基于图像处理系统的智能化选矿方法,其特征在于:在所述摇床组上方搭设龙门架,用于吊装轨道,在过道两边加设三角支撑柱。2. An intelligent mineral processing method based on an image processing system according to claim 1, characterized in that: a gantry frame is set up above the shaker group for hoisting the track, and triangular support columns are added on both sides of the aisle. 上场区:设定摄像机在每个摇床前停留10秒,用于采集图像信息,24个摇床一共需要停留240秒;移动路径为:左端→右端→左端;总行程72米,设定移动摄像机运行速度为5米/分钟,完成一个循环大约需要20分钟。Playing area: Set the camera to stay in front of each shaker for 10 seconds to collect image information. The 24 shakers need to stay for 240 seconds in total; the moving path is: left end → right end → left end; the total travel distance is 72 meters, set the movement The camera runs at a speed of 5 m/min and takes approximately 20 minutes to complete a cycle. 3.根据权利要求2所述的一种基于图像处理系统的智能化选矿方法,其特征在于:下场区:设定摄像机在每个摇床前停留10秒,用于采集图像信息,22个摇床一共需要停留220秒;移动路径为:左端→右端→左端;总行程72米,设定移动摄像机运行速度为5米/分钟,完成一个循环大约需要20分钟,摇床与水泥墙连接。3. A kind of intelligent mineral processing method based on image processing system according to claim 2, characterized in that: the next field area: the camera is set to stay in front of each shaker for 10 seconds for collecting image information, 22 shakers The bed needs to stay for a total of 220 seconds; the moving path is: left end → right end → left end; the total travel distance is 72 meters, and the moving camera is set at a speed of 5 m/min. It takes about 20 minutes to complete a cycle. The shaker is connected to the cement wall. 4.根据权利要求3所述的一种基于图像处理系统的智能化选矿方法,其特征在于:水泥围栏上加装一层U型支架,卡在水泥墙上,在U型支架上设置两排安装孔,与电缸的导轨的安装尺寸相对应;电缸的滑块与分流板连接,电缸滑块带动分流板实现左右移动;分流板采用钣金件。4. A kind of intelligent mineral processing method based on image processing system according to claim 3, it is characterized in that: add a layer of U-shaped support on the cement fence, be stuck on the cement wall, set two rows on the U-shaped support The installation hole corresponds to the installation size of the guide rail of the electric cylinder; the slider of the electric cylinder is connected with the manifold, and the slider of the electric cylinder drives the manifold to move left and right; the manifold is made of sheet metal. 5.根据权利要求4所述的一种基于图像处理系统的智能化选矿方法,其特征在于:所述电缸通电后,会反馈给控制器当前滑块的位置信息,摄像机对摇床进行拍照,经过图像处理后,得到水流分界线位置信息,服务器将水流分线位置信息发送到电缸控制器,控制器给电缸发送位置信息指令,电缸的滑块进行移动,并带动分流板移动至指定位置。5. The intelligent mineral processing method based on an image processing system according to claim 4, characterized in that: after the electric cylinder is powered on, it will feed back the position information of the current slider to the controller, and the camera will take pictures of the shaker , after image processing, the position information of the water flow dividing line is obtained, the server sends the position information of the water flow dividing line to the electric cylinder controller, the controller sends the position information command to the electric cylinder, the slider of the electric cylinder moves, and drives the diverter plate to move to the specified location. 6.根据权利要求1所述的一种基于图像处理系统的智能化选矿方法,其特征在于:所述图像识别模型的建立需要大量的图像数据信息,基本模型建立至少需要50000张图片;在训练模式下,巡检机器人在环形轨道上对各个云锡矿摇床进行巡检拍照,将位置信息和图像信息发送到服务器监控管理软件平台,监控管理软件调用图像模型处理软件对图像模型进行训练。6. a kind of intelligent mineral processing method based on image processing system according to claim 1, is characterized in that: the establishment of described image recognition model needs a large amount of image data information, and basic model needs 50000 pictures at least; In this mode, the inspection robot inspects and takes photos of each cloud tin mine shaking table on the circular track, and sends the location information and image information to the server monitoring management software platform, and the monitoring management software calls the image model processing software to train the image model. 7.根据权利要求6所述的一种基于图像处理系统的智能化选矿方法,其特征在于:所述监控管理软件平台接收到巡检机器人的拍照图片之后,图像标注软件会在图像上进行标注,需要人工核查标注是否准确,如果标注正确则图片进入训练库,如果标注错误,需要人工修正之后,图片再进入训练库。7. The intelligent mineral processing method based on an image processing system according to claim 6, characterized in that: after the monitoring and management software platform receives the picture taken by the inspection robot, the image labeling software will mark the image , It is necessary to manually check whether the label is accurate. If the label is correct, the picture will enter the training database. If the label is wrong, it needs to be corrected manually before the picture enters the training database. 8.根据权利要求7所述的一种基于图像处理系统的智能化选矿方法,其特征在于:所述图像模型处理软件定期使用训练库,对图像模型进行训练,强化模型的识别准确率。8. The intelligent mineral processing method based on an image processing system according to claim 7, characterized in that: said image model processing software regularly uses a training library to train the image model to enhance the recognition accuracy of the model. 9.根据权利要求6所述的一种基于图像处理系统的智能化选矿方法,其特征在于:所述图像采集的识别流程为:9. A kind of intelligent mineral processing method based on image processing system according to claim 6, characterized in that: the identification process of the image acquisition is: (1)巡检机器人上设置的摄像机模块对目标区域进行30s摄像采集,设定在采集位置光线的强度小于一定值时,自动打开摄像机旁边的灯光对拍摄位置进行照射;(1) The camera module installed on the inspection robot performs 30s camera capture on the target area, and when the light intensity at the collection position is set to be less than a certain value, the light next to the camera is automatically turned on to illuminate the shooting position; (2)将采集的目标区域图像数据和定位信息数据传输到服务器中;(2) transmit the collected target area image data and positioning information data to the server; (3)服务器接收存储目标区域图像数据和定位信息数据、拍摄时间,以及图像拍摄位置数据;(3) The server receives and stores the target area image data and positioning information data, shooting time, and image shooting location data; (4)服务器将目标区域图像数据进行标注。(4) The server marks the image data of the target area.
CN202211597345.0A 2022-12-12 2022-12-12 An Intelligent Mineral Processing Method Based on Image Processing System Pending CN116017160A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211597345.0A CN116017160A (en) 2022-12-12 2022-12-12 An Intelligent Mineral Processing Method Based on Image Processing System

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211597345.0A CN116017160A (en) 2022-12-12 2022-12-12 An Intelligent Mineral Processing Method Based on Image Processing System

Publications (1)

Publication Number Publication Date
CN116017160A true CN116017160A (en) 2023-04-25

Family

ID=86027411

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211597345.0A Pending CN116017160A (en) 2022-12-12 2022-12-12 An Intelligent Mineral Processing Method Based on Image Processing System

Country Status (1)

Country Link
CN (1) CN116017160A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104570739A (en) * 2015-01-07 2015-04-29 东北大学 Ore dressing multi-production-index optimized decision making system and method based on cloud and mobile terminal
CN207529393U (en) * 2017-09-07 2018-06-22 丹东东方测控技术股份有限公司 Cleaning table group video image analysis and connect ore deposit point optimizing regulation control system
CN208574768U (en) * 2018-02-05 2019-03-05 北矿机电科技有限责任公司 Intelligent shaking table connects mine plate actuator
CN113304869A (en) * 2021-06-03 2021-08-27 昆明理工大学 Method and device for automatically identifying and receiving shaking table ore belt
CN115228595A (en) * 2022-07-20 2022-10-25 云南品视智能科技有限公司 An intelligent segmentation method of ore belt based on target detection

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104570739A (en) * 2015-01-07 2015-04-29 东北大学 Ore dressing multi-production-index optimized decision making system and method based on cloud and mobile terminal
CN207529393U (en) * 2017-09-07 2018-06-22 丹东东方测控技术股份有限公司 Cleaning table group video image analysis and connect ore deposit point optimizing regulation control system
CN208574768U (en) * 2018-02-05 2019-03-05 北矿机电科技有限责任公司 Intelligent shaking table connects mine plate actuator
CN113304869A (en) * 2021-06-03 2021-08-27 昆明理工大学 Method and device for automatically identifying and receiving shaking table ore belt
CN115228595A (en) * 2022-07-20 2022-10-25 云南品视智能科技有限公司 An intelligent segmentation method of ore belt based on target detection

Similar Documents

Publication Publication Date Title
US20240070831A1 (en) Tunnel-inspection image acquisition device, tunnel-inspection system, and tunnel-inspection method
CN202649815U (en) Transformer substation panorama automation inspection system based on robot technology
CN106124512B (en) Suspension type monorail box beam inspection device
CN108960134A (en) A kind of patrol UAV image mark and intelligent identification Method
CN206399860U (en) A bridge crack detection device
CN113788051A (en) Train on-station running state monitoring and analyzing system
CN110766825A (en) Intelligent inspection system for train inspection of metro vehicles
CN210720194U (en) Tunnel inspection image acquisition device and tunnel inspection system
CN116388669A (en) A Swin Transformer-based Foreign Matter Detection and Cleaning Method for Photovoltaic Panels
Hsieh et al. Offline Deep-learning-based Defective Track Fastener Detection and Inspection System.
CN202304746U (en) Electric energy meter detection apparatus based on machine vision
CN110927172B (en) On-line detection device and method for leaking coating of aircraft integral fuel tank sealant
CN109668521A (en) A kind of prefabricated components automation quick three-dimensional modeling system
CN116017160A (en) An Intelligent Mineral Processing Method Based on Image Processing System
CN208092975U (en) The system for realizing semiclosed parking lot management based on long short focus camera
CN113245222B (en) Visual real-time detection and sorting system and sorting method for foreign matters in panax notoginseng
CN108510744B (en) System and method for realizing semi-closed parking lot management based on long and short focal length cameras
CN113304869B (en) Automatic identification and access method and device for shaking table ore belt
CN113885504A (en) Autonomous inspection method and system for train inspection robot and storage medium
CN205333530U (en) Girder steel structure crack detection simulation experiment device
CN117031258B (en) Method for realizing fault detection system of electrolytic circuit based on temperature and monitoring method thereof
CN208207889U (en) Egg of oak silkworm counting device in a kind of agricultural breeding
CN206601342U (en) A kind of intelligent optical detection machine
CN113753154B (en) Transformer substation intelligent inspection system based on 5G and artificial intelligence
CN115112564A (en) Film type tube panel fillet weld appearance quality detection system and working method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination