CN114137856A - Intelligent device control method, system, device and storage medium based on AR technology - Google Patents
Intelligent device control method, system, device and storage medium based on AR technology Download PDFInfo
- Publication number
- CN114137856A CN114137856A CN202111453875.3A CN202111453875A CN114137856A CN 114137856 A CN114137856 A CN 114137856A CN 202111453875 A CN202111453875 A CN 202111453875A CN 114137856 A CN114137856 A CN 114137856A
- Authority
- CN
- China
- Prior art keywords
- technology
- intelligent
- intelligent equipment
- smart device
- communication module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005516 engineering process Methods 0.000 title claims abstract description 44
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000004891 communication Methods 0.000 claims abstract description 54
- 238000012544 monitoring process Methods 0.000 claims abstract description 37
- 238000004590 computer program Methods 0.000 claims description 6
- 238000007689 inspection Methods 0.000 abstract description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000001737 promoting effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses an intelligent device control method, a system, a device and a storage medium based on AR technology, wherein the method comprises the following steps: acquiring a communication signal sent by an intelligent equipment end, and performing communication connection with the intelligent equipment end; background monitoring data of the intelligent equipment end is obtained, and real-scene display patrol is carried out on the intelligent equipment end through an AR technology; and carrying out operation control on the intelligent equipment terminal according to the patrol condition. According to the invention, real-scene display inspection is carried out on the intelligent equipment in the inspection site through the AR technology, the control operation on the real scene of the intelligent equipment within a certain distance is realized by combining the Bluetooth technology, the equipment which can not be reached by some personnel or has higher risk can be remotely controlled, the safety risk problem brought by the control of the equipment in a high-risk scene is avoided, the operation mode is more convenient, and meanwhile, the real experience of an operator during operation can be improved through the AR mode.
Description
Technical Field
The present invention relates to the field of intelligent control, and in particular, to an intelligent device control method, system, device, and storage medium based on AR technology.
Background
At present in scenes such as wisdom garden, the place that needs some to patrol and examine after the construction is ended is often dangerous and the place that personnel are difficult to reach, very easily takes place the incident, through AR controlgear's start-stop, can effectively avoid this problem.
Disclosure of Invention
In view of the above, the present invention has been made to provide an AR technology-based smart device control method, system, device, and storage medium that overcome or at least partially solve the above-mentioned problems.
In a first aspect, an embodiment of the present invention provides an intelligent device control method based on an AR technology, including:
acquiring a communication signal sent by an intelligent equipment end, and performing communication connection with the intelligent equipment end;
background monitoring data of the intelligent equipment end is obtained, and real-scene display patrol is carried out on the intelligent equipment end through an AR technology;
and carrying out operation control on the intelligent equipment terminal according to the patrol condition.
Optionally, a bluetooth tag is arranged at the intelligent device end, so that communication connection with the intelligent device end is achieved.
Optionally, the intelligent device further sends position information through a bluetooth tag, and acquires corresponding background monitoring data through the position information.
Optionally, the background monitoring data includes a picture of an actual operating condition of the smart device.
Optionally, the monitoring device is connected with the monitoring background of the intelligent device end through a network, and background monitoring data of the intelligent device end is obtained.
In a second aspect, an embodiment of the present invention further provides an intelligent device control system based on an AR technology, including:
the first communication module is used for being in communication connection with the intelligent equipment terminal;
the second communication module is used for being in communication connection with the monitoring background of the intelligent equipment end;
the AR display module is used for carrying out real-scene display patrol on the intelligent equipment terminal according to the background monitoring data;
and the control module is used for carrying out operation control on the intelligent equipment terminal through the first communication module.
Optionally, the first communication module communicates with a bluetooth tag set at the smart device side by using a bluetooth communication technology.
Optionally, the control module adopts a bluetooth control technology, and the intelligent device end is controlled and operated through bluetooth.
Optionally, the first communication module is further configured to obtain location information of a space where the intelligent device is located, the second communication module is further configured to send the location information to a monitoring background, and the monitoring background identifies a corresponding intelligent device end according to the location information and returns corresponding background monitoring data through the second communication module.
In a third aspect, an embodiment of the present invention further provides a device equipped with the above-described intelligent device control system based on the AR technology.
Optionally, the device is an intelligent mobile terminal.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the method for controlling an intelligent device based on AR technology is implemented.
The technical scheme provided by the embodiment of the invention has the beneficial effects that: carry out the live-action display inspection to the smart machine who patrols and examines the scene through AR technique, combine bluetooth technology to realize the control operation to the real scene of smart machine in the certain distance, can't reach or dangerous higher equipment remote control some personnel, the safety risk problem of avoiding controlgear to bring under the high-risk scene, make the operating mode more convenient, simultaneously through AR's mode, true experience when can also promoting the operator and operate.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic functional block diagram of an intelligent device control system based on AR technology according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, an embodiment of the present invention provides an intelligent device control system based on AR technology, including a first communication module 11, a second communication module 12, an AR display module 13, and a control module 14. The control module 14 is connected with the AR display module 13 and is in communication connection with the external device terminal through the first communication module 11 and the second communication module 12, respectively.
The following describes the modules of the system of the present invention one by one:
the first communication module 11 is used for being in communication connection with the intelligent device 20. Preferably, the first communication module 11 can use a bluetooth communication technology to communicate with a bluetooth tag disposed on the smart device 20, and can replace a human hand to operate the control panel of the smart device 20 by using the bluetooth communication technology, thereby realizing contactless control within a certain distance. For example, a person may hold a handheld terminal loaded with the system of the present invention, and after entering a signal area of a bluetooth tag of a certain smart device, perform bluetooth communication with the smart device 20, and may control the smart device 20 to turn on, turn off, start, and stop through bluetooth.
And the second communication module 12 is used for being in communication connection with the monitoring background 30 of the intelligent device 20. The monitoring background 30 can be arranged at a cloud or a network terminal, and the monitoring background 30 and the intelligent device 20 communicate with each other through a network to obtain real-time dynamics of the intelligent device 20, such as on, off, on and off states. Therefore, the second communication module 12 adopts wired or wireless network communication to realize remote communication between the system and the monitoring background 30 of the intelligent device 20.
The AR display module 13 is used for performing live-action display patrol on the intelligent device end 20 according to the background monitoring data of the monitoring background 30 on the intelligent device end 20;
the AR (Augmented Reality) technology is a new technology for seamlessly integrating real world information and virtual world information, and is characterized in that entity information (visual information, sound, taste, touch and the like) which is difficult to experience in a certain time space range of the real world originally is overlapped after simulation through scientific technologies such as computers and the like, virtual information is applied to the real world and is perceived by human senses, and therefore sensory experience beyond Reality is achieved. In short, the real environment and the virtual object are superimposed on the same picture or space in real time and exist simultaneously.
Therefore, after the AR display module obtains the real-time data of the smart device 20 from the monitoring background through the second communication module 12, the AR display module can perform the live-action display patrol of the smart device 20 based on the AR technology on the handheld terminal equipped with the present invention.
And the (fourth) control module 14 is configured to perform operation control on the smart device 20 through the first communication module 11. Adopt bluetooth control to replace traditional artifical key operation between the control panel of control module 14 and smart machine end 20, operating personnel can control virtual smart machine end 20 under the AR shows the scene and operate, and this control operation can pass through the real control panel of bluetooth communication transmission to smart machine end 20, realizes the smart machine operational capability of long-distance real scene, can effectively avoid under the dangerous scene, the safety risk problem that direct control smart machine brought.
Preferably, the first communication module 11 is further configured to obtain the location information of the space where the smart device 20 is located through the bluetooth tag, the second communication module 12 is further configured to send the location information to the monitoring backend 30 in the cloud, the monitoring backend 30 identifies the smart device 20 with consistent information according to the location information, returns the backend monitoring data specified by the smart device 20 to the system through the second communication module 12, generates a corresponding picture in the AR display module 13 for display, and can implement AR live-action display patrol according to the location information of the smart device 20.
Based on the intelligent device control system of the above embodiment, the embodiment of the present invention further provides an intelligent device control method based on the AR technology, which mainly includes the following steps:
the first step is as follows: acquiring a communication signal sent by an intelligent equipment end, and performing communication connection with the intelligent equipment end;
this step mainly adopts bluetooth label to realize, through set up bluetooth label at the smart machine end, realizes the bluetooth communication connection between the smart machine end. Furthermore, the intelligent device end can also send position information through the Bluetooth tag, and real-time background monitoring data corresponding to the intelligent device end are acquired from background monitoring through the position information.
The second step is that: background monitoring data of the intelligent equipment end is obtained, and real-scene display patrol is carried out on the intelligent equipment end through an AR technology;
the background monitoring data can comprise pictures of actual running conditions of the intelligent equipment end, the system is connected with the monitoring background of the intelligent equipment end through a network, the background monitoring data of the intelligent equipment end are obtained, AR real-scene display of the position of the intelligent equipment can be achieved based on AR technology, and operating personnel can conveniently patrol the intelligent equipment.
The third step: and carrying out operation control on the intelligent equipment terminal according to the patrol condition.
An operator can control and operate the virtual intelligent equipment end in the AR display scene, the control operation can be transmitted to the real control panel of the intelligent equipment end through Bluetooth communication, the intelligent equipment operation capacity of the remote real scene is realized, and the problem of safety risk caused by directly controlling the intelligent equipment in the dangerous scene can be effectively avoided
In an embodiment, the present invention further provides a device equipped with the intelligent device control system based on AR technology in the foregoing embodiment. The device can be an intelligent mobile terminal, such as a smart phone, a PAD and the like, and the system is an application program (APP) recorded in the smart phone or the PAD.
In one embodiment, the present invention also provides a computer-readable storage medium on which a computer program is stored, which, when executed by a processor, implements the steps one to three of the smart device control method based on AR technology as in the above embodiments.
The technical scheme provided by the embodiment of the invention has the beneficial effects that: carry out the live-action display inspection to the smart machine who patrols and examines the scene through AR technique, combine bluetooth technology to realize the control operation to the real scene of smart machine in the certain distance, can't reach or dangerous higher equipment remote control some personnel, the safety risk problem of avoiding controlgear to bring under the high-risk scene, make the operating mode more convenient, simultaneously through AR's mode, true experience when can also promoting the operator and operate.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (12)
1. An intelligent device control method based on AR technology is characterized by comprising the following steps:
acquiring a communication signal sent by an intelligent equipment end, and performing communication connection with the intelligent equipment end;
background monitoring data of the intelligent equipment end is obtained, and real-scene display patrol is carried out on the intelligent equipment end through an AR technology;
and carrying out operation control on the intelligent equipment terminal according to the patrol condition.
2. The AR technology-based smart device control method according to claim 1, wherein a communication connection with the smart device side is realized by providing a bluetooth tag at the smart device side.
3. The AR technology-based smart device control method of claim 2, wherein the smart device further sends location information through a bluetooth tag, and acquires corresponding background monitoring data through the location information.
4. The AR technology-based smart device control method according to claim 3, wherein the background monitoring data includes a picture of an actual operating condition of the smart device side.
5. The method for controlling an intelligent device based on an AR technology of claim 3, wherein the background monitoring data of the intelligent device is acquired by connecting with the monitoring background of the intelligent device via a network.
6. An intelligent device control system based on AR technology, comprising:
the first communication module is used for being in communication connection with the intelligent equipment terminal;
the second communication module is used for being in communication connection with the monitoring background of the intelligent equipment end;
the AR display module is used for carrying out real-scene display patrol on the intelligent equipment terminal according to the background monitoring data;
and the control module is used for carrying out operation control on the intelligent equipment terminal through the first communication module.
7. The AR technology-based smart device control system of claim 6, wherein the first communication module uses bluetooth communication technology to communicate with a bluetooth tag provided at the smart device.
8. The AR technology-based smart device control system of claim 7, wherein the control module employs a bluetooth control technology, and operates the smart device side through bluetooth control.
9. The AR technology-based smart device control system according to claim 7, wherein the first communication module is further configured to obtain location information of a space where the smart device is located, the second communication module is further configured to send the location information to a monitoring background, and the monitoring background identifies a corresponding smart device end according to the location information and returns corresponding background monitoring data through the second communication module.
10. A device carrying an intelligent device control system based on AR technology according to any one of claims 6 to 9.
11. The device of claim 10, wherein the device is an intelligent mobile terminal.
12. A computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the AR technology-based smart device control method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111453875.3A CN114137856A (en) | 2021-12-01 | 2021-12-01 | Intelligent device control method, system, device and storage medium based on AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111453875.3A CN114137856A (en) | 2021-12-01 | 2021-12-01 | Intelligent device control method, system, device and storage medium based on AR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114137856A true CN114137856A (en) | 2022-03-04 |
Family
ID=80386925
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111453875.3A Pending CN114137856A (en) | 2021-12-01 | 2021-12-01 | Intelligent device control method, system, device and storage medium based on AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114137856A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201893610U (en) * | 2010-11-24 | 2011-07-06 | 航天科工深圳（集团）有限公司 | Power distribution terminal |
| CN103729905A (en) * | 2014-01-13 | 2014-04-16 | 国家电网公司 | Graphical inspection system and inspection method |
| CN203849768U (en) * | 2014-01-13 | 2014-09-24 | 国家电网公司 | Graphical inspection system |
| CN204028654U (en) * | 2014-05-06 | 2014-12-17 | 沈阳工业大学 | A kind of novel switch cubicle intelligent wireless actuation means |
| CN104463055A (en) * | 2014-12-29 | 2015-03-25 | 重庆甲虫网络科技有限公司 | Augmented reality system based on wireless smart label and control method of augmented reality system |
| CN204480344U (en) * | 2015-03-26 | 2015-07-15 | 西安科技大学 | A kind of coal preparation plant portable wireless logging |
| CN206627854U (en) * | 2016-08-19 | 2017-11-10 | 国网浙江台州市路桥区供电公司 | A kind of intelligent residential district power distribution network intellectuality pattern management system |
| CN110865917A (en) * | 2018-08-27 | 2020-03-06 | 国网天津市电力公司 | AR technology-based electric power machine room inspection operation method, system and application |
| CN111337141A (en) * | 2020-04-02 | 2020-06-26 | 沈阳美宝控制有限公司 | Handheld intelligent electric line temperature patrol device, system and method |
| CN113593071A (en) * | 2021-07-16 | 2021-11-02 | 苏州恒力智能科技有限公司 | Inspection method, inspection device, inspection system, computer equipment and storage medium |
| CN113709672A (en) * | 2021-08-25 | 2021-11-26 | 云知声（上海）智能科技有限公司 | AR-based inspection system and inspection method thereof |
-
2021
- 2021-12-01 CN CN202111453875.3A patent/CN114137856A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201893610U (en) * | 2010-11-24 | 2011-07-06 | 航天科工深圳（集团）有限公司 | Power distribution terminal |
| CN103729905A (en) * | 2014-01-13 | 2014-04-16 | 国家电网公司 | Graphical inspection system and inspection method |
| CN203849768U (en) * | 2014-01-13 | 2014-09-24 | 国家电网公司 | Graphical inspection system |
| CN204028654U (en) * | 2014-05-06 | 2014-12-17 | 沈阳工业大学 | A kind of novel switch cubicle intelligent wireless actuation means |
| CN104463055A (en) * | 2014-12-29 | 2015-03-25 | 重庆甲虫网络科技有限公司 | Augmented reality system based on wireless smart label and control method of augmented reality system |
| CN204480344U (en) * | 2015-03-26 | 2015-07-15 | 西安科技大学 | A kind of coal preparation plant portable wireless logging |
| CN206627854U (en) * | 2016-08-19 | 2017-11-10 | 国网浙江台州市路桥区供电公司 | A kind of intelligent residential district power distribution network intellectuality pattern management system |
| CN110865917A (en) * | 2018-08-27 | 2020-03-06 | 国网天津市电力公司 | AR technology-based electric power machine room inspection operation method, system and application |
| CN111337141A (en) * | 2020-04-02 | 2020-06-26 | 沈阳美宝控制有限公司 | Handheld intelligent electric line temperature patrol device, system and method |
| CN113593071A (en) * | 2021-07-16 | 2021-11-02 | 苏州恒力智能科技有限公司 | Inspection method, inspection device, inspection system, computer equipment and storage medium |
| CN113709672A (en) * | 2021-08-25 | 2021-11-26 | 云知声（上海）智能科技有限公司 | AR-based inspection system and inspection method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108899082A (en) | Maintenance service management method, system, terminal and computer readable storage medium | |
| CN105915766B (en) | Control method based on virtual reality and device | |
| EP3111738B1 (en) | Method for controlling operation of an agricultural machine and system | |
| CN104243928A (en) | Electronic terminal and remote monitoring method implemented by same | |
| CN104732323A (en) | Maintenance management system of elevating apparatus | |
| CN112863001A (en) | Power distribution room patrol inspection method, device and system | |
| CN106998605A (en) | A kind of router working station indicator intelligence control system and method | |
| CN112822070A (en) | Internet of things equipment monitoring method | |
| CN114137856A (en) | Intelligent device control method, system, device and storage medium based on AR technology | |
| CN112672272A (en) | Unmanned aerial vehicle, controller, and management device | |
| CN105792025A (en) | Device information obtaining method and terminal | |
| CN108908343A (en) | Intelligent Mobile Robot and scheduling system business operations linkage system and method | |
| CN106796666B (en) | Robot control device, method and system | |
| KR101360242B1 (en) | The monitor strengthening security | |
| KR20140119343A (en) | Remote monitoring and controlling system in environmental qualification laboratory | |
| CN216291210U (en) | Near-end networking law enforcement recording system | |
| CN207409006U (en) | A kind of night watching equipment based on augmented reality | |
| CN107346124B (en) | Operating method and system by a kind of moving machine | |
| CN112518778B (en) | Control method of intelligent man-machine fusion scene based on service robot | |
| CN110036406A (en) | Collection system, terminal program and collection method | |
| CN103533535B (en) | A kind of remote handset card writing system and card writing method | |
| CN209002110U (en) | Integrated network distribution infrastructure project Field Monitoring System | |
| CN105187492B (en) | Terminal data sharing method, system and equipment | |
| CN104135648A (en) | Movable all-dimensional video monitoring system | |
| CN106302624A (en) | A kind of bus tele-control system based on 4G mobile network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |