Nothing Special   »   [go: up one dir, main page]

CN112949503A - Site monitoring management method and system for ice and snow sports - Google Patents

Site monitoring management method and system for ice and snow sports Download PDF

Info

Publication number
CN112949503A
CN112949503A CN202110243764.3A CN202110243764A CN112949503A CN 112949503 A CN112949503 A CN 112949503A CN 202110243764 A CN202110243764 A CN 202110243764A CN 112949503 A CN112949503 A CN 112949503A
Authority
CN
China
Prior art keywords
depth
target person
ice
video
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110243764.3A
Other languages
Chinese (zh)
Other versions
CN112949503B (en
Inventor
姚良才
宋双慧
徐龙
杨忠山
张文波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Safety Measurement And Control Technology Co ltd
Original Assignee
Qiqihar University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qiqihar University filed Critical Qiqihar University
Priority to CN202110243764.3A priority Critical patent/CN112949503B/en
Publication of CN112949503A publication Critical patent/CN112949503A/en
Application granted granted Critical
Publication of CN112949503B publication Critical patent/CN112949503B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G06V20/42Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items of sport video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0205Specific application combined with child monitoring using a transmitter-receiver system
    • G08B21/0208Combination with audio or video communication, e.g. combination with "baby phone" function
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/44Event detection
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Child & Adolescent Psychology (AREA)
  • Theoretical Computer Science (AREA)
  • Psychiatry (AREA)
  • Human Computer Interaction (AREA)
  • Social Psychology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Alarm Systems (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

本申请公开一种用于冰雪体育运动的场地监测管理方法与系统。所述方法包括深度摄像机采集第一深度视频进行初步分析,若确定存在安全隐患目标则向管理服务器发送安全指示;管理服务器向以当前深度摄像机为中心点的半径区域内的所有深度摄像机发送查询指令;每个深度摄像机查找安全隐患目标的运动轨迹,将第二深度视频发送至管理服务器;管理服务器根据第一深度视频和第二深度视频确定目标安全隐患严重程度,选择性向管理人员终端设备发送报警指示。采用本申请技术方案,由深度摄像机进行安全隐患的初步排查,由管理服务器进行安全隐患的进一步确认,由此将图像数据分布在不同的设备中进行处理,提高数据处理的速度,提高冰雪场地监测的安全性。

Figure 202110243764

The present application discloses a field monitoring and management method and system for ice and snow sports. The method includes that a depth camera collects a first depth video for preliminary analysis, and if it is determined that there is a potential safety hazard target, sending a safety instruction to a management server; the management server sends a query instruction to all depth cameras within a radius area with the current depth camera as the center point ; Each depth camera searches for the movement trajectory of the hidden safety hazard target, and sends the second depth video to the management server; the management server determines the severity of the target safety hazard according to the first depth video and the second depth video, and selectively sends an alarm to the terminal equipment of the management personnel instruct. By adopting the technical solution of the present application, the depth camera conducts preliminary investigation of potential safety hazards, and the management server conducts further confirmation of potential safety hazards, thereby distributing the image data in different devices for processing, improving the speed of data processing, and improving the monitoring of ice and snow fields. security.

Figure 202110243764

Description

Site monitoring management method and system for ice and snow sports
Technical Field
The application relates to the technical field of communication, in particular to a site monitoring and management method and system for ice and snow sports.
Background
Snow and ice movement, broadly refers to various movements performed on ice and snow, such as: skiing, curling, etc. With the successful declaration of Olympic games in winter in China, the ice and snow sports become more and more full-name sports. However, the existing ice and snow sports field cannot be timely rescued due to the fact that the area is too large to manage, and therefore a method capable of monitoring safety accidents in the field in real time and timely rescuring in real time is urgently needed to ensure the safety of sports or entertainment personnel.
Disclosure of Invention
The application provides a field monitoring method for ice and snow sports, which comprises the following steps:
the method comprises the steps that a field monitoring device collects a depth video of an ice and snow sports field, determines a target person with potential safety hazards from the depth video, and sends a safety instruction to a management server;
after receiving the safety instruction, the management server takes the current depth camera for acquiring the target character as a central point, acquires all site monitoring equipment within a preset radius, and sends a target character query instruction to all site monitoring equipment within the radius area;
each site monitoring device receiving the command of inquiring the target person inquires a video before the potential safety hazard occurs, determines a previous site monitoring device for shooting the previous motion track of the target person from the video, and sends the video to the management server;
the management server determines the motion state of a target character when the potential safety hazard occurs according to the videos shot by the last site monitoring device and the current site monitoring device, inputs the motion state of the target character and the physical quality of the target character into a pre-created model, determines the severity of the potential safety hazard of the target character, and selectively sends an alarm instruction to the terminal device of a manager according to the severity of the potential safety hazard of the target character.
The field monitoring method for the ice and snow sports as described above, wherein the target person with the potential safety hazard is determined from the depth video, specifically includes the following sub-steps:
the site monitoring equipment extracts a target person depth image from the depth video and extracts a target person skeleton coordinate from an image frame;
the site monitoring equipment preliminarily identifies the initial potential safety hazard degree of the target person according to the target human body proportion and the target person skeleton coordinate in the human body depth image, and sends the human body depth image and the shooting time to the management server;
the management server takes the depth camera for acquiring the falling target as a central point, acquires images of all depth cameras within a preset radius before an accident occurs, and sends instructions to all the depth cameras;
each depth camera extracts an image frame with a target person from a video shot by the depth camera, the depth camera extracted with the target person is used as a previous depth camera, and the accurate potential safety hazard degree of the target person is identified based on the motion trend of the target person in the image frames of the current depth camera and the previous depth camera.
The above field monitoring method for the ice and snow sports, wherein the extracting of the depth image of the target person from the depth video specifically includes the following substeps:
graying the human body depth image to obtain a relatively soft gray image;
carrying out difference processing on the current gray level image and a preset background image and carrying out mathematical morphology processing to obtain a motion framework of the moving target:
the method comprises the steps of storing an original image of an unmanned object in an ice and snow field in a depth camera, using the original image as a preset background image, carrying out filtering pretreatment on a gray image, carrying out background difference treatment on the gray image and the preset background image to extract a target area, and increasing the contrast of the target area.
The method for monitoring the field for the ice and snow sports comprises the steps of defining all possible gesture sets in advance according to the height-width ratio of a rectangular frame where the position of a human body is located, determining the area combination according to each gesture, marking the rectangular frame where the human body is located from a human body depth image, extracting the height and width of a target human body from the rectangular frame, and preliminarily identifying the initial potential safety hazard degree of the target person according to the height-width ratio.
According to the field monitoring method for the ice and snow sports, the skeleton coordinates of the target person and the height and width of the rectangular frame of the human body are obtained from the depth video shot by the last depth camera, the human body pose is determined, the pose change of the target person in a short time is determined according to the comparison between the human body pose of the camera and the human body pose shot during falling, and the accurate potential safety hazard degree of the target person is determined.
The field monitoring method for the ice and snow sports is characterized in that the model is obtained by training a human body motion state, a human body quality and an impact force which can be born by the human body in a large quantity.
The method for monitoring the field for the ice and snow sports comprises the steps of obtaining images of all cameras within a preset radius before an accident occurs by taking the above one-depth camera as a central point after obtaining the last motion track of a target person, determining another last motion track of the target person shot from the images, and repeatedly searching the track.
The application also provides a site monitoring system for the ice and snow sports, which is characterized by comprising site monitoring equipment, a management server and manager terminal equipment, wherein the system executes any one of the site monitoring methods for the ice and snow sports.
The field monitoring system for the ice and snow sports as described above, wherein the field monitoring device includes a plurality of side-by-side monitoring piles symmetrically installed at both ends of the field, a cableway is installed between each opposing set of monitoring piles, a monitoring cable car is slidably connected on the cableway, the monitoring cable car slides between the set of monitoring piles at a preset speed, and a depth camera is installed at the bottom of the monitoring cable car.
As above, the site monitoring system for the ice and snow sports, wherein the depth camera arranged at the bottom of the monitoring cable car is used for shooting the video of the ice and snow sports site, the optical cables for data are connected between all monitoring piles and on the cableway, the depth camera is used for preliminarily identifying the shot site video, then the video of the ice and snow sports site shot by the depth camera is transmitted to the management server through the optical cables for analyzing and monitoring the ice and snow sports site, and whether an alarm instruction is sent to the terminal equipment of a manager or not is determined according to the monitoring result.
The beneficial effect that this application realized is as follows: by adopting the technical scheme, the site monitoring equipment is used for preliminarily checking the potential safety hazard, and the management server is used for further confirming the potential safety hazard, so that the image data can be distributed in different equipment for processing, the data processing speed is increased, and the monitoring safety of the ice and snow site is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present invention, and other drawings can be obtained by those skilled in the art according to the drawings.
Fig. 1 is a flowchart of a field monitoring method for an ice and snow sports according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention are clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
The embodiment of the application provides a site monitoring method for ice and snow sports, which is applied to a site monitoring system, wherein the site monitoring system comprises site monitoring equipment, a management server and manager terminal equipment; the field monitoring equipment comprises a plurality of side-by-side monitoring piles symmetrically installed at two ends of a field, a cableway is installed between every two opposite groups of monitoring piles, a monitoring cable car is connected on the cableway in a sliding mode and slides between the groups of monitoring piles at a preset speed, a depth camera arranged at the bottom of the monitoring cable car is used for shooting a video of the ice and snow sports field, optical cables of data are connected between all the monitoring piles and the cableway, and the video of the ice and snow sports field shot by the depth camera is transmitted to a server through the optical cables to analyze and monitor the ice and snow sports field; and determining whether to send an alarm instruction to the manager terminal equipment or not according to the monitoring result.
Specifically, a depth camera acquires a first depth video, performs preliminary analysis on the first depth video, and sends a safety instruction to a management server if a potential safety hazard target is determined to exist; the management server takes the depth camera as a central point, acquires all depth cameras within a preset radius, and sends query instructions to all depth cameras within the radius area; each depth camera receiving the query instruction searches a motion track of the potential safety hazard target from the depth video shot by the depth camera, and sends a second depth video shot by the depth camera which finds the potential safety hazard target to the management server; and the management server determines the severity of the target potential safety hazard according to the first depth video and the second depth video, and selectively sends an alarm instruction to the terminal equipment of the manager according to the severity of the potential safety hazard of the target person.
As shown in fig. 1, the method for monitoring a field for ice and snow sports specifically includes the following steps:
step 110, collecting a depth video of an ice and snow sports field by field monitoring equipment, determining a target person with potential safety hazards from the depth video, and sending a safety instruction to a management server;
specifically, in the field monitoring system, a depth video in a field is shot in real time by a depth camera installed at the bottom of a monitoring cable car on a cableway, and the video shot in a preset time length and shooting time are recorded for searching a target person from the shot video subsequently and determining the state of the target person before an accident occurs;
the method for determining the target person with the potential safety hazard from the depth video specifically comprises the following substeps:
111, extracting a target person depth image from the depth video and extracting a target person skeleton coordinate from an image frame by using site monitoring equipment;
creating a skeleton event in a depth camera, opening a skeleton tracking function, and acquiring a human body depth image and an RGB (red, green and blue) image containing skeleton data; specifically, the human body depth image is grayed firstly: in the color model RGB, when R ═ G ═ B, then the color (R, G, B) is represented as a black and white color; the process of making the R, G, B component values of the color equal is graying; because the value ranges of R, G and B are 0-255, the gray level is only 256 levels, and the gray image is calculated by adopting the following formula: r ═ G ═ B ═ R + G + B)/3, and a relatively soft grayscale image was obtained. Then, carrying out difference processing on the current gray level image and a preset background image, and carrying out mathematical morphology processing to obtain a motion framework of the moving target: the method comprises the steps of storing an original image of an unmanned object in an ice and snow field in a depth camera, using the original image as a preset background image, carrying out filtering pretreatment on a gray image, carrying out background difference treatment on the gray image and the preset background image to extract a target area, and increasing the contrast of the target area.
Step 112, the site monitoring equipment preliminarily identifies the initial potential safety hazard degree of the target person according to the target human body proportion and the target person skeleton coordinate in the human body depth image, and sends the human body depth image and the shooting time to a management server;
in the embodiment of the application, all possible gesture sets are defined in advance according to the height-width ratio of a rectangular frame where a human body is located, a regional combination of the gesture sets is determined according to each gesture, the rectangular frame where the human body is located is marked out of a human body depth image, then the height and width of a target human body are extracted from the rectangular frame, the normal ratio of the height to the width of the normal human body is 3-5 when the normal human body stands, and if the height-width ratio of the target human body of the current human body depth image is calculated to be 0.2-1, the possibility that the target person falls down is preliminarily identified; and the possibility of falling of the target person can be preliminarily identified by comparing the bone coordinates of the target person with the bone coordinates of the standard human body.
Step 113, the management server takes the depth camera for obtaining the falling target as a central point, obtains images of all depth cameras within a preset radius before an accident occurs, and sends instructions to all depth cameras;
the method comprises the steps that positions of all depth cameras are stored in a management server, unique identification is marked for each depth camera, when the depth cameras within a preset radius need to be determined, an instruction is sent to the corresponding depth cameras, and the instruction comprises the unique identification of the depth cameras, the shooting time of the current depth cameras and a target person image frame.
Step 114, each depth camera extracts an image frame with a target person from a video shot by the depth camera, the depth camera extracted with the target person is used as a previous depth camera, and the accurate potential safety hazard degree of the target person is identified based on the motion trend of the target person in the image frames of the current depth camera and the previous depth camera;
after receiving the instruction of the management server, each depth camera searches for a video (generally within 10 s) shot by itself before the shooting time of the current depth camera, and searches whether a target person exists in the video, wherein the depth camera with the target person is a motion state shot at the last moment of the target person.
Because the depth camera preliminarily judges whether the human body falls down or not, the possibility that the target person independently squats down may exist, and whether the target person falls down or not needs to be further accurately identified according to the pose change of the target human body within a certain short time period (for example, if the first 3s shooting is a standing pose, and if the current shooting is a falling pose, the target person is determined to fall down), a depth video before an accident is taken by all cameras within a circle is taken as a central point, the cameras shooting the target person are found out from the depth video shot by the cameras, the bone coordinates of the target person and the height and width of a rectangular frame of the human body are obtained, the pose of the human body is determined, and the pose change of the target person within a short time period is determined according to the comparison between the pose of the cameras and the pose of the human body shot during the falling down, and determining that the target person has a falling event.
Step 120, after receiving the safety instruction, the management server takes the current depth camera for acquiring the target person as a central point, acquires all site monitoring devices within a preset radius, and sends a target person query instruction to all site monitoring devices within the radius area;
step 130, inquiring videos before potential safety hazards occur by each site monitoring device receiving the command of inquiring the target person, determining a last site monitoring device for shooting a last motion track of the target person, and sending the videos to a management server;
step 140, the management server determines the motion state of the target person when the potential safety hazard occurs according to the videos shot by the previous site monitoring device and the current site monitoring device, inputs the motion state of the target person and the physical quality of the target person into a pre-created model, determines the severity of the potential safety hazard of the target person, and selectively sends an alarm instruction to the terminal device of the manager according to the severity of the potential safety hazard of the target person;
in the embodiment of the application, determining the severity of the potential safety hazard of the target person specifically comprises the following substeps:
141, acquiring different motion conditions of different body qualities and bearable impact force to obtain feature vectors, inputting the feature vectors into a classification model, training the classification model to obtain different sub-classification models, classifying a feature vector set by using each sub-classification model respectively, and estimating a set of weights of each sub-classification model according to a classification result;
specifically, a large amount of data of different physical qualities such as different sexes, heights and widths in historical falling events are collected, the movement conditions of the people with different physical qualities during falling, such as the speed and the acceleration during falling, and the impact force born by the people, namely the force rangeWhen the parameters are different, the data are combined into a feature vector set A { (x)1,y1,z1,t1),(x2,y2,z2,t2),(x3,y3,z3,t3)…(xn,yn,zn,t4) In which x1,x2…xnFor sex characteristics (1 and 2 only, 1 for male and 2 for female), y1,y2…ynTo correspond to aspect ratio features, z1,z2…znCorresponding to the speed characteristic when the person falls down, t is the impact force which can be born correspondingly, and n is the number of collected samples; inputting the feature vector set into the classification model, and training a sub-classification model f by using the feature vector sett(t); reuse sub-classification model ft(t) classifying the feature vector set to obtain a classification result, and adopting a formula according to the classification result
Figure BDA0002963318640000061
Estimating a set of weights for a sub-classification model { μ }1,μ2,μ3......μT}; wherein argmin is
Figure BDA0002963318640000062
The set of μ with the minimum value.
Step 142, searching an optimal value corresponding to each weight in the weight set, and determining the severity of the potential safety hazard through the combination of each sub-classification model and the optimal value of the weight corresponding to the sub-classification model to obtain a potential safety hazard identification model;
calculating each sub-classification model f by particle swarm optimization algorithmtSet of weights of (t) { μ }1,μ2,μ3......μTIn the method, each weight corresponds to an optimal value; by each sub-classification model { f1(t)、f2(t)、f3(t)......fT(t) } and its corresponding optimal value of weight [ mu ]1,μ2,μ3......μTGroup (u) }And (4) determining the severity of the potential safety hazard to obtain a potential safety hazard identification model.
Step 243, determining the physical quality of the target person from the video shot by the previous depth camera, calculating the movement state of the target person when the target person falls down from the video shot by the current depth camera and the video shot by the previous depth camera, inputting the movement state and the physical quality of the target person into a potential safety hazard identification model, and outputting the severity of the potential safety hazard;
preferably, the height and the width of the target person can be determined from the video of the last depth camera, the gender of the target person can be determined according to bone data in the depth video, the video shot by the current depth camera and the last depth camera is used for calculating the falling speed of the target person, the height, the width and the gender of the target person and the falling speed of the target person are input into a potential safety hazard recognition model, the falling impact force of the target person is calculated, if the falling impact force of the target person is higher than the maximum impact force which can be borne by the human body, the high-numerical potential safety hazard severity is output, an alarm instruction is sent to a manager after the high-numerical potential safety hazard severity is output, and the manager is instructed to rescue in time.
Example two
The second embodiment of the application provides a site monitoring system for ice and snow sports, which comprises site monitoring equipment, a management server and manager terminal equipment, wherein the system executes the site monitoring method for ice and snow sports in the first embodiment.
The site monitoring equipment comprises a plurality of side-by-side monitoring piles symmetrically installed at two ends of a site, a cableway is installed between every two opposite groups of monitoring piles, a monitoring cable car is connected on the cableway in a sliding mode and slides at a preset speed between the groups of monitoring piles, and a depth camera is installed at the bottom of the monitoring cable car.
The method comprises the steps that a depth camera arranged at the bottom of a monitoring cable car is used for shooting a video of the ice and snow sports field, optical cables of data are connected between all monitoring piles and on a cableway, the depth camera is used for preliminarily recognizing the shot field video, then the ice and snow sports field video shot by the depth camera is transmitted to a management server through the optical cables to be analyzed and monitored in the ice and snow sports field, and whether an alarm instruction is sent to a terminal device of a manager or not is determined according to a monitoring result.
The above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the present disclosure, which should be construed in light of the above teachings. Are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1.一种用于冰雪体育运动的场地监测方法,其特征在于,包括:1. a site monitoring method for ice and snow sports, is characterized in that, comprising: 深度摄像机采集第一深度视频,对第一深度视频进行初步分析,若确定存在安全隐患目标则向管理服务器发送安全指示;The depth camera collects the first depth video, conducts a preliminary analysis on the first depth video, and sends a safety instruction to the management server if it is determined that there is a potential safety hazard target; 管理服务器以所述深度摄像机为中心点,获取预定半径内的所有深度摄像机,向该半径区域内的所有深度摄像机发送查询指令;The management server takes the depth camera as the center point, obtains all the depth cameras within a predetermined radius, and sends a query instruction to all the depth cameras within the radius area; 每个接收到查询指令的深度摄像机从自身拍摄的深度视频中查找安全隐患目标的运动轨迹,将查找到安全隐患目标的深度摄像机拍摄的第二深度视频发送至管理服务器;Each depth camera that has received the query instruction searches for the motion trajectory of the hidden safety hazard target from the depth video shot by itself, and sends the second depth video shot by the depth camera that found the hidden safety hazard target to the management server; 管理服务器根据第一深度视频和第二深度视频确定目标安全隐患严重程度,根据目标人物的安全隐患严重程度选择性向管理人员终端设备发送报警指示。The management server determines the severity of the target safety hazard according to the first depth video and the second depth video, and selectively sends an alarm indication to the terminal device of the manager according to the severity of the target person's safety hazard. 2.如权利要求1所述的用于冰雪体育运动的场地监测方法,其特征在于,2. the site monitoring method for ice and snow sports as claimed in claim 1, is characterized in that, 场地监测设备采集冰雪运动场地深度视频,从深度视频中确定存在安全隐患的目标人物,向管理服务器发送安全指示;The site monitoring equipment collects the depth video of the ice and snow sports site, determines the target person with potential safety hazards from the depth video, and sends a safety instruction to the management server; 管理服务器接收到安全指示后,以获取到目标人物的当前深度摄像机为中心点,获取预定半径内的所有场地监测设备,向该半径区域内的所有场地监测设备发送查询目标人物指令;After receiving the safety instruction, the management server takes the current depth camera of the target person as the center point, obtains all site monitoring devices within a predetermined radius, and sends an instruction to query the target person to all site monitoring devices within the radius area; 每个接收到查询目标人物指令的场地监测设备查询在安全隐患发生前的视频,从中确定拍摄到目标人物上一运动轨迹的上一场地监测设备,并将该视频发送至管理服务器;Each site monitoring device that has received an instruction to query the target person queries the video before the occurrence of a potential safety hazard, determines the last site monitoring device that captured the last movement track of the target person, and sends the video to the management server; 管理服务器按照上一场地监测设备和当前场地监测设备拍摄的视频确定目标人物发生安全隐患时的运动状况,将目标人物的运动状况、目标人物的身体素质输入预先创建的模型,确定目标人物的安全隐患严重程度,根据目标人物的安全隐患严重程度选择性向管理人员终端设备发送报警指示。The management server determines the motion status of the target person when there is a potential safety hazard according to the videos shot by the previous site monitoring equipment and the current site monitoring equipment, and inputs the target person's motion status and the target person's physical fitness into the pre-created model to determine the target person's safety. The severity of the hidden danger, according to the severity of the security hidden danger of the target person, selectively send an alarm instruction to the terminal equipment of the management personnel. 3.如权利要求2所述的用于冰雪体育运动的场地监测方法,其特征在于,从深度视频中确定存在安全隐患的目标人物,具体包括如下子步骤:3. the site monitoring method for ice and snow sports as claimed in claim 2, is characterized in that, from the depth video, it is determined that there is a target person with potential safety hazard, specifically comprising the following substeps: 场地监测设备从深度视频中提取目标人物深度图像,从图像帧中提取目标人物骨骼坐标;The site monitoring equipment extracts the depth image of the target person from the depth video, and extracts the bone coordinates of the target person from the image frame; 场地监测设备根据人体深度图像中的目标人体比例和目标人物骨骼坐标初步识别目标人物的初始安全隐患程度,将人体深度图像和拍摄时间发送至管理服务器;The site monitoring equipment preliminarily identifies the initial potential safety hazard of the target person according to the target human body proportion in the human body depth image and the target person's skeleton coordinates, and sends the human body depth image and shooting time to the management server; 管理服务器以获取到摔倒目标的深度摄像机为中心点,获取预定半径内的所有深度摄像机在事故发生前的图像,向各深度摄像机发送指示;The management server takes the depth camera that obtained the falling target as the center point, obtains the images of all the depth cameras within the predetermined radius before the accident, and sends instructions to each depth camera; 每个深度摄像机从自身拍摄的视频中提取存在目标人物的图像帧,将提取到目标人物的深度摄像机作为上一深度摄像机,基于当前深度摄像机和上一深度摄像机的图像帧中目标人物的运动趋势识别目标人物的精准安全隐患程度。Each depth camera extracts the image frame where the target person exists from the video shot by itself, and uses the depth camera extracted to the target person as the previous depth camera, based on the current depth camera and the image frame of the previous depth camera. The movement trend of the target person in the camera Identify the precise level of security risks of the target person. 4.如权利要求3所述的用于冰雪体育运动的场地监测方法,其特征在于,从深度视频中提取目标人物深度图像,具体包括如下子步骤:4. the site monitoring method for ice and snow sports as claimed in claim 3, is characterized in that, extracting the depth image of target person from the depth video, specifically comprises the following substeps: 将人体深度图像灰度化得到相对比较柔和的灰度图像;Grayscale the human body depth image to obtain a relatively soft grayscale image; 将当前的灰度图像与预设背景图像进行差分处理并进行数学形态学处理得到运动目标的运动骨架:Differentiate the current grayscale image and the preset background image and perform mathematical morphological processing to obtain the moving skeleton of the moving target: 在深度摄像机中存储有冰雪场地无人物原始图像,将其作为预设背景图像,将灰度图像进行滤波预处理后,与预设背景图像进行背景差分处理提取目标区域,增加目标区域的对比度。In the depth camera, the original image without people in the ice and snow field is stored, which is used as the preset background image. After the grayscale image is filtered and preprocessed, the background difference processing is performed with the preset background image to extract the target area and increase the contrast of the target area. 5.如权利要求3所述的用于冰雪体育运动的场地监测方法,其特征在于,预先根据人体位置所处矩形框的高和宽的比例定义好所有可能的姿态集合,并根据每一个姿态确定其区域组合,从人体深度图像中标注出人体所处的矩形框,然后从矩形框中提取出目标人体的高和宽,根据高和宽比例初步识别目标人物初始安全隐患程度。5. the field monitoring method for ice and snow sports as claimed in claim 3 is characterized in that, all possible pose sets are defined in advance according to the ratio of height and width of the rectangular frame where the position of the human body is located, and according to each pose Determine the combination of its regions, mark the rectangular frame where the human body is located from the human depth image, and then extract the height and width of the target human body from the rectangular frame, and initially identify the initial safety hazard degree of the target person according to the ratio of height and width. 6.如权利要求4所述的用于冰雪体育运动的场地监测方法,其特征在于,从上一深度摄像机拍摄的深度视频中获取目标人物的骨骼坐标以及人体矩形框的高和宽,确定人体位姿,根据该摄像头的人体位姿和摔倒时拍摄的人体位姿进行比对,确定该目标人物在短时间内发生位姿变化,确定目标人物的精准安全隐患程度。6. The site monitoring method for ice and snow sports as claimed in claim 4, wherein the height and width of the skeleton coordinates of the target person and the human body rectangular frame are obtained from the depth video taken by the previous depth camera, and the human body is determined to be According to the comparison of the human body posture of the camera and the human body posture when falling, it is determined that the target person has a change in the posture and posture in a short period of time, and the precise safety hazard level of the target person is determined. 7.如权利要求1所述的用于冰雪体育运动的场地监测方法,其特征在于,在获取到目标人物的上一运动轨迹之后,还包括以上一深度摄像机为中心点,获取预定半径内的所有摄像头在事故发生前的图像,从中确定拍摄到目标人物的再上一运动轨迹,并重复进行轨迹查找。7. The field monitoring method for ice and snow sports as claimed in claim 1, characterized in that, after acquiring the last motion trajectory of the target person, it also comprises that the previous depth camera is the center point, and acquires the distance within a predetermined radius. From the images of all cameras before the accident, the last movement trajectory of the target person is determined, and the trajectory search is repeated. 8.一种用于冰雪体育运动的场地监测系统,其特征在于,所述系统包括场地监测设备、管理服务器和管理人员终端设备,所述系统执行如权利要求1-7任一项所述的用于冰雪体育运动的场地监测方法。8. A site monitoring system for ice and snow sports, wherein the system comprises site monitoring equipment, a management server and a manager terminal device, and the system executes the method described in any one of claims 1-7. Field monitoring method for ice and snow sports. 9.如权利要求8所述的用于冰雪体育运动的场地监测系统,其特征在于,场地监测设备包括对称安装在场地两端的多个并排监测桩,每相对的一组监测桩之间安装索道,在索道上滑动连接监测缆车,监测缆车在一组监测桩之间以预设速度进行滑动,在监测缆车底部安装深度摄像机。9. The field monitoring system for ice and snow sports as claimed in claim 8, wherein the field monitoring equipment comprises a plurality of side-by-side monitoring piles symmetrically installed at both ends of the field, and a cableway is installed between each opposite group of monitoring piles , slide and connect the monitoring cable car on the cableway, the monitoring cable car slides between a group of monitoring piles at a preset speed, and a depth camera is installed at the bottom of the monitoring cable car. 10.如权利要求9所述的用于冰雪体育运动的场地监测系统,其特征在于,通过设置在监测缆车底部的深度摄像机拍摄冰雪体育场地视频,在所有监测桩之间以及索道上均连接有数据的光缆,深度摄像机对拍摄的场地视频进行初步识别,然后再通过光缆将深度摄像机拍摄的冰雪体育场地视频传输至管理服务器进行冰雪体育场地分析和监测,根据监测结果决定是否向管理人员终端设备发送报警指示。10. The site monitoring system for ice and snow sports as claimed in claim 9, wherein the video of the ice and snow sports field is photographed by a depth camera arranged at the bottom of the monitoring cable car, and between all monitoring piles and on the cableway, there are connected The optical cable of the data, the depth camera initially identifies the video of the field, and then transmits the video of the ice and snow stadium captured by the depth camera to the management server through the optical cable for analysis and monitoring of the ice and snow stadium, and decides whether to send the terminal equipment to the management personnel according to the monitoring results. Send an alarm indication.
CN202110243764.3A 2021-03-05 2021-03-05 Site monitoring management method and system for ice and snow sports Active CN112949503B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110243764.3A CN112949503B (en) 2021-03-05 2021-03-05 Site monitoring management method and system for ice and snow sports

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110243764.3A CN112949503B (en) 2021-03-05 2021-03-05 Site monitoring management method and system for ice and snow sports

Publications (2)

Publication Number Publication Date
CN112949503A true CN112949503A (en) 2021-06-11
CN112949503B CN112949503B (en) 2022-08-09

Family

ID=76247816

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110243764.3A Active CN112949503B (en) 2021-03-05 2021-03-05 Site monitoring management method and system for ice and snow sports

Country Status (1)

Country Link
CN (1) CN112949503B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114358580A (en) * 2021-12-31 2022-04-15 北京市商汤科技开发有限公司 Track quality assessment method, apparatus, device and computer-readable storage medium

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1445163A1 (en) * 2002-12-18 2004-08-11 Leo Baumgartner Suspended rope railway for moving a camera and possibly its operator
EP2763116A1 (en) * 2013-02-01 2014-08-06 FamilyEye BVBA Fall detection system and method for detecting a fall of a monitored person
US20140276238A1 (en) * 2013-03-15 2014-09-18 Ivan Osorio Method, system and apparatus for fall detection
US20150154452A1 (en) * 2010-08-26 2015-06-04 Blast Motion Inc. Video and motion event integration system
US20160217325A1 (en) * 2010-08-26 2016-07-28 Blast Motion Inc. Multi-sensor event analysis and tagging system
CN106056035A (en) * 2016-04-06 2016-10-26 南京华捷艾米软件科技有限公司 Motion-sensing technology based kindergarten intelligent monitoring method
WO2017133009A1 (en) * 2016-02-04 2017-08-10 广州新节奏智能科技有限公司 Method for positioning human joint using depth image of convolutional neural network
US20170281054A1 (en) * 2016-03-31 2017-10-05 Zoll Medical Corporation Systems and methods of tracking patient movement
US20170309152A1 (en) * 2016-04-20 2017-10-26 Ulysses C. Dinkins Smart safety apparatus, system and method
US20180137363A1 (en) * 2015-04-03 2018-05-17 Mas-Tech S.R.L. System for the automated analisys of a sporting match
CN109460702A (en) * 2018-09-14 2019-03-12 华南理工大学 Passenger's abnormal behaviour recognition methods based on human skeleton sequence
CN109871775A (en) * 2019-01-22 2019-06-11 北京影谱科技股份有限公司 A kind of the ice rink monitoring method and device of Behavior-based control detection
CN111767888A (en) * 2020-07-08 2020-10-13 北京澎思科技有限公司 Object state detection method, computer device, storage medium, and electronic device
DE102020117543A1 (en) * 2019-07-18 2021-01-21 Limited Liability Company "Itv Group" SYSTEM AND METHOD FOR DETERMINING POTENTIALLY DANGEROUS SITUATIONS THROUGH VIDEO DATA

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1445163A1 (en) * 2002-12-18 2004-08-11 Leo Baumgartner Suspended rope railway for moving a camera and possibly its operator
US20150154452A1 (en) * 2010-08-26 2015-06-04 Blast Motion Inc. Video and motion event integration system
US20160217325A1 (en) * 2010-08-26 2016-07-28 Blast Motion Inc. Multi-sensor event analysis and tagging system
EP2763116A1 (en) * 2013-02-01 2014-08-06 FamilyEye BVBA Fall detection system and method for detecting a fall of a monitored person
US20140276238A1 (en) * 2013-03-15 2014-09-18 Ivan Osorio Method, system and apparatus for fall detection
US20180137363A1 (en) * 2015-04-03 2018-05-17 Mas-Tech S.R.L. System for the automated analisys of a sporting match
WO2017133009A1 (en) * 2016-02-04 2017-08-10 广州新节奏智能科技有限公司 Method for positioning human joint using depth image of convolutional neural network
US20170281054A1 (en) * 2016-03-31 2017-10-05 Zoll Medical Corporation Systems and methods of tracking patient movement
CN106056035A (en) * 2016-04-06 2016-10-26 南京华捷艾米软件科技有限公司 Motion-sensing technology based kindergarten intelligent monitoring method
US20170309152A1 (en) * 2016-04-20 2017-10-26 Ulysses C. Dinkins Smart safety apparatus, system and method
CN109460702A (en) * 2018-09-14 2019-03-12 华南理工大学 Passenger's abnormal behaviour recognition methods based on human skeleton sequence
CN109871775A (en) * 2019-01-22 2019-06-11 北京影谱科技股份有限公司 A kind of the ice rink monitoring method and device of Behavior-based control detection
DE102020117543A1 (en) * 2019-07-18 2021-01-21 Limited Liability Company "Itv Group" SYSTEM AND METHOD FOR DETERMINING POTENTIALLY DANGEROUS SITUATIONS THROUGH VIDEO DATA
CN111767888A (en) * 2020-07-08 2020-10-13 北京澎思科技有限公司 Object state detection method, computer device, storage medium, and electronic device

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
A.K.BOURKE等: ""Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm"", 《GAIT & POSTURE》 *
A.K.BOURKE等: ""Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm"", 《GAIT & POSTURE》, vol. 26, no. 2, 31 July 2007 (2007-07-31) *
姜珊: ""基于分类学习的住院老年人跌倒行为检测研究"", 《中国优秀博硕士学位论文全文数据库(硕士) 医学卫生科技辑》 *
姜珊: ""基于分类学习的住院老年人跌倒行为检测研究"", 《中国优秀博硕士学位论文全文数据库(硕士) 医学卫生科技辑》, no. 08, 15 August 2020 (2020-08-15) *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114358580A (en) * 2021-12-31 2022-04-15 北京市商汤科技开发有限公司 Track quality assessment method, apparatus, device and computer-readable storage medium

Also Published As

Publication number Publication date
CN112949503B (en) 2022-08-09

Similar Documents

Publication Publication Date Title
CN106412501B (en) A kind of the construction safety behavior intelligent monitor system and its monitoring method of video
CN110837784A (en) A detection system for peeping and cheating in examination room based on human head features
JP4956273B2 (en) Throwing ball type discriminating device, discriminator generating device, throwing ball type discriminating program and discriminator generating program
CN109829382B (en) Abnormal target early warning tracking system and method based on intelligent behavior characteristic analysis
CN111401311A (en) High-altitude parabolic recognition method based on image detection
JP2008538623A (en) Method and system for detecting and classifying events during motor activity
CN113191699A (en) Power distribution construction site safety supervision method
CN111401310B (en) Kitchen sanitation safety supervision and management method based on artificial intelligence
CN105187785A (en) Cross-checkpost pedestrian identification system and method based on dynamic obvious feature selection
CN113963315A (en) A method and system for real-time video multi-person behavior recognition in complex scenes
CN110674680B (en) Living body identification method, living body identification device and storage medium
CN113743256A (en) Construction site safety intelligent early warning method and device
CN117911965A (en) A method and device for identifying highway traffic accidents based on aerial images
CN110175553A (en) The method and device of feature database is established based on Gait Recognition and recognition of face
CN111680608B (en) Intelligent sports auxiliary training system and training method based on video analysis
CN112949503A (en) Site monitoring management method and system for ice and snow sports
CN115439925A (en) Action scoring method, terminal and computer readable storage medium
CN107368777A (en) Smile action detection method and device and living body identification method and system
CN118887608A (en) Method and device for monitoring operation of power transmission line, and electronic equipment
JP2019061407A (en) Object detection device
JP4764362B2 (en) Event discrimination device and event discrimination program
CN108805020A (en) Adaptive piecemeal pedestrian recognition methods again based on significance fusion
CN111144240B (en) Image processing method and related equipment
CN115546825A (en) Automatic monitoring method for safety inspection normalization
CN114882074A (en) Target motion state identification method, device, equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20240516

Address after: Room 111-007, Floor 1, Building 2, Science and Technology Innovation Headquarters, Shenzhen (Harbin) Industrial Park, 288 Zhigu Street, Songbei District, Harbin, Heilongjiang Province, 150028

Patentee after: Harbin Safety Measurement and Control Technology Co.,Ltd.

Country or region after: China

Address before: 161006, No. 42, culture street, Jianhua District, Heilongjiang, Qigihar

Patentee before: QIQIHAR University

Country or region before: China

TR01 Transfer of patent right