CN118015712B - Tai Chi scoring method, system, device and medium based on time window - Google Patents
Tai Chi scoring method, system, device and medium based on time window Download PDFInfo
- Publication number
- CN118015712B CN118015712B CN202410424786.3A CN202410424786A CN118015712B CN 118015712 B CN118015712 B CN 118015712B CN 202410424786 A CN202410424786 A CN 202410424786A CN 118015712 B CN118015712 B CN 118015712B
- Authority
- CN
- China
- Prior art keywords
- time window
- model
- tai chi
- gesture
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000013077 scoring method Methods 0.000 title claims abstract description 22
- 239000011159 matrix material Substances 0.000 claims abstract description 52
- 230000009471 action Effects 0.000 claims abstract description 51
- 238000000034 method Methods 0.000 claims description 26
- 230000006870 function Effects 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 18
- 238000003860 storage Methods 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 9
- 238000010276 construction Methods 0.000 claims description 3
- 239000003550 marker Substances 0.000 claims description 3
- 230000009977 dual effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 9
- 238000012549 training Methods 0.000 description 8
- 238000002474 experimental method Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000011156 evaluation Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000010191 image analysis Methods 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 1
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 238000013136 deep learning model Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000004630 mental health Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Tourism & Hospitality (AREA)
- Strategic Management (AREA)
- Educational Technology (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Human Computer Interaction (AREA)
- Educational Administration (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Human Resources & Organizations (AREA)
- General Business, Economics & Management (AREA)
- Economics (AREA)
- Image Analysis (AREA)
Abstract
本发明公开了一种基于时间窗口的太极拳评分方法、系统设备及介质,包括,采集太极拳视频中的太极拳动作关键点,并对视频中的每一个帧数中的关键点进行定义;将定义过关键点中的动作和手势作为关键数据的集合,构建数学矩阵,通过数学矩阵,得到识别模型;根据识别模型,利用时间窗口对数学矩阵中的动作和手势进行划分,通过设置调节系数,对时间窗口划分后的动作和手势进行动态调整,并输出模型结果;本发明利用时间窗口对数学矩阵中的动作和手势进行划分,确定关键帧,从而实现对动作的精准划分;通过设置调节系数,对时间窗口划分后的动作和手势进行动态调整,并输出模型结果,有效提高了模型的鲁棒性,保证了模型输出太极拳得分的准确性。
The invention discloses a Tai Chi scoring method based on a time window, a system device and a medium, comprising: collecting Tai Chi action key points in a Tai Chi video, and defining the key points in each frame number in the video; taking the actions and gestures in the defined key points as a set of key data, constructing a mathematical matrix, and obtaining a recognition model through the mathematical matrix; according to the recognition model, dividing the actions and gestures in the mathematical matrix using a time window, dynamically adjusting the actions and gestures after the time window division by setting an adjustment coefficient, and outputting a model result; the invention divides the actions and gestures in the mathematical matrix using a time window, determines key frames, and thus realizes accurate division of the actions; dynamically adjusting the actions and gestures after the time window division by setting an adjustment coefficient, and outputting a model result, thereby effectively improving the robustness of the model and ensuring the accuracy of the Tai Chi score output by the model.
Description
技术领域Technical Field
本发明涉及太极拳评分技术领域,尤其涉及一种基于时间窗口的太极拳评分方法、系统、设备及介质。The present invention relates to the technical field of Tai Chi scoring, and in particular to a Tai Chi scoring method, system, device and medium based on a time window.
背景技术Background technique
现今,太极拳在高校体育选修课程中作为项目备受推崇,因其蕴含深厚的中国文化传统内涵,且能够影响个人的身体和心理健康,使其成为受欢迎的体育课程。Nowadays, Tai Chi is highly regarded as an elective course in physical education in colleges and universities because it contains profound Chinese cultural traditions and can affect a person's physical and mental health, making it a popular physical education course.
有人提出,可以利用视频方式逐帧分析并对太极拳动作进行打分,以评估动作的正确性。通过此种方式需要使用模型进行训练分析,而传统方法中的深度学习模型训练需要大量的计算资源,且需要提前定义评价标准和特征,这限制了在处理个性化和非传统太极拳表演风格时的灵活性。Some people have suggested that the video can be used to analyze and score Tai Chi movements frame by frame to evaluate the correctness of the movements. This method requires the use of models for training and analysis, while the deep learning model training in traditional methods requires a lot of computing resources and requires the definition of evaluation criteria and features in advance, which limits the flexibility in dealing with personalized and non-traditional Tai Chi performance styles.
发明内容Summary of the invention
本部分的目的在于概述本发明的实施例的一些方面以及简要介绍一些较佳实施例。在本部分以及本申请的说明书摘要和发明名称中可能会做些简化或省略以避免使本部分、说明书摘要和发明名称的目的模糊,而这种简化或省略不能用于限制本发明的范围。The purpose of this section is to summarize some aspects of embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the specification abstract and the invention title of this application to avoid blurring the purpose of this section, the specification abstract and the invention title, and such simplifications or omissions cannot be used to limit the scope of the present invention.
鉴于上述现有存在的问题,提出了本发明。因此,本发明提供了一种基于时间窗口的太极拳评分方法,利用时间窗口对数学矩阵中的动作和手势进行划分,确定关键帧或特征点,从而实现对动作的精准划分;通过设置调节系数,对时间窗口划分后的动作和手势进行动态调整,并输出模型结果,有效提高了模型的鲁棒性,保证了模型输出太极拳得分的准确性。In view of the above existing problems, the present invention is proposed. Therefore, the present invention provides a Tai Chi scoring method based on a time window, which uses the time window to divide the actions and gestures in the mathematical matrix, determines the key frames or feature points, and thus realizes the accurate division of the actions; by setting the adjustment coefficient, the actions and gestures after the time window division are dynamically adjusted, and the model results are output, which effectively improves the robustness of the model and ensures the accuracy of the Tai Chi score output by the model.
为了达到上述目的,本发明采用以下技术方案:In order to achieve the above object, the present invention adopts the following technical solutions:
第一方面,本发明提供了一种基于时间窗口的太极拳评分方法,包括:In a first aspect, the present invention provides a Tai Chi scoring method based on a time window, comprising:
采集太极拳视频中的太极拳动作关键点,并对所述视频中的每一个帧数中的关键点进行定义,所述关键点包括坐标信息和手势标记;Collect key points of Tai Chi movements in Tai Chi videos, and define key points in each frame of the video, wherein the key points include coordinate information and gesture marks;
将定义过关键点中的坐标信息和手势标记作为关键数据的集合,构建数学矩阵,通过所述数学矩阵,得到识别模型;每列对应一个关键点的四维信息;The coordinate information and gesture marks of the defined key points are used as a set of key data to construct a mathematical matrix, and a recognition model is obtained through the mathematical matrix; each column corresponds to the four-dimensional information of a key point;
根据所述识别模型,利用时间窗口对所述数学矩阵中的动作和手势进行划分,通过设置调节系数,对所述时间窗口划分后的动作和手势进行动态调整,并输出模型结果;According to the recognition model, the actions and gestures in the mathematical matrix are divided by using a time window, the actions and gestures after the time window division are dynamically adjusted by setting an adjustment coefficient, and a model result is output;
根据所述识别模型的输出结果,对模型进行整体评估,得到太极拳评分结果。According to the output results of the recognition model, the model is evaluated as a whole to obtain the Tai Chi scoring results.
作为优选的技术方案,采集太极拳视频中的太极拳动作关键点,并对所述关键点中的每一个帧数进行定义,包括:As a preferred technical solution, key points of Tai Chi movements in Tai Chi videos are collected, and each frame number in the key points is defined, including:
对于每一帧,含有若干个关键点,每个关键点均包含坐标信息和手势标记;For each frame, there are several key points, each of which contains coordinate information and gesture markers;
设定有N个关键点,每个关键点的信息表示为四维向量(x, y, t, g);There are N key points, and the information of each key point is represented as a four-dimensional vector (x, y, t, g);
其中,x和y为关键点在太极拳视频中的坐标,t为太极拳视频对应的时间戳,g为手势标记。Among them, x and y are the coordinates of the key point in the Tai Chi video, t is the timestamp corresponding to the Tai Chi video, and g is the gesture marker.
作为优选的技术方案,将定义过关键点中的动作和手势作为关键数据的集合,构建数学矩阵,通过所述数学矩阵,得到识别模型,包括:As a preferred technical solution, the actions and gestures in the defined key points are used as a set of key data to construct a mathematical matrix, and a recognition model is obtained through the mathematical matrix, including:
设定M个帧数,将矩阵表示为,构建所述数学矩阵X,表示为:Set the number of frames to M and express the matrix as , construct the mathematical matrix X, expressed as:
; ;
其中,X表示一个由M帧和N个关键点组成的一个多维矩阵,、、、分别表示第1帧第1个关键点的横坐标、纵坐标、时间和标记的手势;、、、分别表示第1帧第2个关键点的横坐标、纵坐标、时间和标记的手势;、、、分别表示第1帧第N个关键点的横坐标、纵坐标、时间和标记的手势;、、、分别表示第2帧第1个关键点的横坐标、纵坐标、时间和标记的手势;、、、分别表示第M帧第N个关键点的横坐标、纵坐标、时间和标记的手势;Among them, X represents a multidimensional matrix composed of M frames and N key points. , , , Respectively represent the abscissa, ordinate, time and marked gesture of the first key point in the first frame; , , , Respectively represent the abscissa, ordinate, time and marked gesture of the second key point in the first frame; , , , Respectively represent the horizontal coordinate, vertical coordinate, time and marked gesture of the Nth key point in the first frame; , , , Respectively represent the abscissa, ordinate, time and marked gesture of the first key point in the second frame; , , , Respectively represent the horizontal coordinate, vertical coordinate, time and marked gesture of the Nth key point in the Mth frame;
将所述X输入到识别模型f中,得到:Inputting the X into the recognition model f, we get:
; ;
其中,和分别是动作和手势的识别结果。in, and They are the recognition results of actions and gestures respectively.
作为优选的技术方案,在帧数输入所述数学矩阵X时,需要删除关键点检测数量未达到设定阈值的连续帧和关键点检测数量不满足设定阈值的图像帧,同时调整太极拳视频对应的时间戳t。As a preferred technical solution, when the number of frames is input into the mathematical matrix X, it is necessary to delete the continuous frames whose key point detection number does not reach the set threshold and the image frames whose key point detection number does not meet the set threshold, and adjust the timestamp t corresponding to the Tai Chi video.
作为优选的技术方案,根据所述识别模型,利用时间窗口对所述数学矩阵中的动作和手势进行划分,包括:As a preferred technical solution, according to the recognition model, the actions and gestures in the mathematical matrix are divided using a time window, including:
所述识别模型中的时间窗口序列为,手势序列为,The time window sequence in the recognition model is: , the gesture sequence is ,
其中,每个表示视频中第i个时间窗口,每个表示第m个手势;Among them, each represents the i-th time window in the video, each represents the mth gesture;
所述手势序列的开始帧对应所述时间窗口序列的开始帧,从时间窗口的开始帧的后一帧开始,每一帧的手势序列的当前帧为后一帧的时间窗口的开始帧,直至循环到手势序列的当前帧等于时间窗口的开始帧,得到时间窗口序列。The start frame of the gesture sequence The starting frame corresponding to the time window sequence , starting from the frame after the start frame of the time window, the current frame of each frame of the gesture sequence is the start frame of the time window of the next frame, until the current frame of the gesture sequence is equal to the start frame of the time window, and the time window sequence is obtained .
作为优选的技术方案,通过设置调节系数,对所述时间窗口划分后的动作和手势进行动态调整,并输出模型结果,包括:As a preferred technical solution, by setting the adjustment coefficient, the actions and gestures after the time window division are dynamically adjusted, and the model results are output, including:
设置双调节系数和;Setting dual adjustment coefficients and ;
通过对时间窗口序列进行调节,以得到对应手势序列的变化序列;在所述变化序列的基础上,对识别模型进行调节,得到:pass For time window series Adjust to obtain the change sequence corresponding to the gesture sequence ; In the change sequence On this basis, the recognition model is adjusted to obtain:
; ;
其中,表示在时间点t处经过调整后的时间序列值;为时间窗口序列调节系数,为变化序列的动态系数;表示识别模型的时间段,为识别模型输出的太极拳法的得分。in, Indicates that at time point t Adjusted time series values; is the time window series adjustment coefficient, For the change sequence Dynamic coefficient of represents the time period for identifying the model, The score of Tai Chi output by the recognition model.
作为优选的技术方案,还包括:As a preferred technical solution, it also includes:
定义模型损失函数并引入二值变量对所述识别模型的输出结果进行判别;所述损失函数包括动作损失函数和手势损失函数;Define the model loss function and introduce binary variables The output result of the recognition model is judged; the loss function includes an action loss function and a gesture loss function;
若所述二值变量大于,则标记为1,属于可信任模型;否则,则标记为0,属于不可信任模型,返回至构建数学矩阵处,重新建立模型。If the binary variable more than the , it is marked as 1, which is a trustworthy model; otherwise, it is marked as 0, which is an untrustworthy model, and returns to the construction of the mathematical matrix to rebuild the model.
第二方面,本发明提供了一种基于时间窗口的太极拳评分系统,基于所述的基于时间窗口的太极拳评分方法,包括:In a second aspect, the present invention provides a time window-based Tai Chi scoring system, based on the time window-based Tai Chi scoring method, comprising:
视频采集模块,采集太极拳视频中的太极拳动作关键点,并对所述视频中的每一个帧数中的关键点进行定义,所述关键点包括坐标信息和手势标记;A video acquisition module, which acquires key points of Tai Chi movements in Tai Chi videos and defines key points in each frame of the video, wherein the key points include coordinate information and gesture marks;
模型建立模块,将定义过关键点中的坐标信息和手势标记作为关键数据的集合,构建数学矩阵,通过所述数学矩阵,得到识别模型;每列对应一个关键点的四维信息;The model building module uses the coordinate information and gesture marks of the defined key points as a set of key data to construct a mathematical matrix, and obtains the recognition model through the mathematical matrix; each column corresponds to the four-dimensional information of a key point;
模型算法模块,根据所述识别模型,利用时间窗口对所述数学矩阵中的动作和手势进行划分,通过设置调节系数,对所述时间窗口划分后的动作和手势进行动态调整,并输出模型结果;A model algorithm module, which divides the actions and gestures in the mathematical matrix using a time window according to the recognition model, dynamically adjusts the actions and gestures after the time window division by setting an adjustment coefficient, and outputs a model result;
模型结果评分模块,根据所述识别模型的输出结果,对模型进行整体评估,得到太极拳评分结果。The model result scoring module evaluates the model as a whole according to the output result of the recognition model to obtain the Tai Chi scoring result.
第三方面,本发明提供了一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现所述方法的步骤。In a third aspect, the present invention provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method when executing the computer program.
第四方面,本发明提供了一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现所述方法的步骤。In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the method when executed by a processor.
本发明与现有技术相比,具有如下优点和有益效果:Compared with the prior art, the present invention has the following advantages and beneficial effects:
本发明利用时间窗口对数学矩阵中的动作和手势进行划分,确定关键帧或特征点,从而实现对动作的精准划分;通过设置调节系数,对时间窗口划分后的动作和手势进行动态调整,并输出模型结果,有效提高了模型的鲁棒性,保证了模型后续得分的准确性。The present invention utilizes time windows to divide actions and gestures in a mathematical matrix and determines key frames or feature points, thereby achieving accurate division of actions. By setting adjustment coefficients, the actions and gestures after time window division are dynamically adjusted, and the model results are output, which effectively improves the robustness of the model and ensures the accuracy of subsequent scores of the model.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本发明实施例的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。其中:In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:
图1为本发明一个实施例所述的基于时间窗口的太极拳评分方法的总体流程图;FIG1 is an overall flow chart of a time window-based Tai Chi scoring method according to an embodiment of the present invention;
图2为本发明一个实施例所述的基于时间窗口的太极拳评分方法的系统结构图。FIG2 is a system structure diagram of a time window-based Tai Chi scoring method according to an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合说明书附图对本发明的具体实施方式做详细的说明,显然所描述的实施例是本发明的一部分实施例,而不是全部实施例。基于本发明中的实施例,本领域普通人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明的保护的范围。In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.
在下面的描述中阐述了很多具体细节以便于充分理解本发明,但是本发明还可以采用其他不同于在此描述的其它方式来实施,本领域技术人员可以在不违背本发明内涵的情况下做类似推广,因此本发明不受下面公开的具体实施例的限制。In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.
其次,此处所称的“一个实施例”或“实施例”是指可包含于本发明至少一个实现方式中的特定特征、结构或特性。在本说明书中不同地方出现的“在一个实施例中”并非均指同一个实施例,也不是单独的或选择性的与其他实施例互相排斥的实施例。Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.
本发明结合示意图进行详细描述,在详述本发明实施例时,为便于说明,表示器件结构的剖面图会不依一般比例作局部放大,而且所述示意图只是示例,其在此不应限制本发明保护的范围。此外,在实际制作中应包含长度、宽度及深度的三维空间尺寸。The present invention is described in detail with reference to schematic diagrams. When describing the embodiments of the present invention, for the sake of convenience, the cross-sectional diagrams showing the device structure will not be partially enlarged according to the general scale, and the schematic diagrams are only examples, which should not limit the scope of protection of the present invention. In addition, in actual production, the three-dimensional dimensions of length, width and depth should be included.
同时在本发明的描述中,需要说明的是,术语中的“上、下、内和外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。此外,术语“第一、第二或第三”仅用于描述目的,而不能理解为指示或暗示相对重要性。At the same time, in the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "upper, lower, inner and outer" are based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as limiting the present invention. In addition, the terms "first, second or third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.
本发明中除非另有明确的规定和限定,术语“安装、相连、连接”应做广义理解,例如:可以是固定连接、可拆卸连接或一体式连接;同样可以是机械连接、电连接或直接连接,也可以通过中间媒介间接相连,也可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本发明中的具体含义。In the present invention, unless otherwise clearly specified and limited, the terms "install, connect, connect" should be understood in a broad sense, for example: it can be a fixed connection, a detachable connection or an integral connection; it can also be a mechanical connection, an electrical connection or a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
实施例1Example 1
参照图1,为本发明第一个实施例,该实施例提供了一种基于时间窗口的太极拳评分方法,包括:Referring to FIG. 1 , which is a first embodiment of the present invention, the embodiment provides a Tai Chi scoring method based on a time window, comprising:
S1、采集太极拳视频中的太极拳动作关键点,并对视频中的每一个帧数中的关键点进行定义。S1. Collect key points of Tai Chi movements in Tai Chi videos and define key points in each frame of the video.
进一步的,对于每一帧,含有若干个关键点,每个关键点包含坐标信息和手势标记。Furthermore, each frame contains several key points, each of which contains coordinate information and gesture markers.
更进一步的,设定有N个关键点,每个关键点的信息表示为四维向量(x, y, t,g)。Furthermore, there are N key points, and the information of each key point is represented as a four-dimensional vector (x, y, t, g).
其中,x和y为关键点在太极拳视频中的坐标,t为太极拳视频对应的时间戳,g为手势标记。Among them, x and y are the coordinates of the key point in the Tai Chi video, t is the timestamp corresponding to the Tai Chi video, and g is the gesture marker.
应当说明的是,关键点的提取和定义有助于提高太极拳动作的准确性。It should be noted that the extraction and definition of key points help improve the accuracy of Tai Chi movements.
S2、将定义过关键点中的动作和手势作为关键数据的集合,构建数学矩阵,通过数学矩阵,得到识别模型;S2, taking the actions and gestures in the defined key points as a set of key data, constructing a mathematical matrix, and obtaining a recognition model through the mathematical matrix;
进一步的,将定义过关键点中的动作和手势作为关键数据的集合,构建数学矩阵,通过数学矩阵,得到识别模型,包括:Furthermore, the actions and gestures defined in the key points are used as a set of key data to construct a mathematical matrix. Through the mathematical matrix, a recognition model is obtained, including:
更进一步的,设定M个帧数,将矩阵表示为,每行对应一个时间点的数据,每列对应一个关键点的四维信息,构建数学矩阵X,表示为:Furthermore, we set the number of frames to M and express the matrix as , each row corresponds to the data of a time point, each column corresponds to the four-dimensional information of a key point, and the mathematical matrix X is constructed, which is expressed as:
; ;
可以理解的是,为了便于表达和处理,本实施例将这个三维数据集合展开成一个二维矩阵。在这个二维矩阵中,先依次排列第一帧中所有关键点的信息,然后是第二帧,以此类推,直到最后一帧。具体来说,、、、分别表示第一帧第一个关键点的横坐标、纵坐标和标记的手势,它们在二维矩阵中连续排列;、、、分别表示第一帧第二个关键点的相应信息,同样连续排列在矩阵中;依此类推,直到、、、表示第一帧第N个关键点的信息。接着,第二帧的关键点信息、、、开始排列,直到最后一帧的第N个关键点的信息、、、。这样,每行矩阵数据包含了一个时间点(即一帧)内所有关键点的坐标信息和手势标记。另外,每帧内所有关键点的时间是相同的,即与帧本身关联。通过这个展开后的二维矩阵,本实施例可以构建识别模型。It is understandable that, for the sake of ease of expression and processing, this embodiment expands this three-dimensional data set into a two-dimensional matrix. In this two-dimensional matrix, the information of all key points in the first frame is first arranged in sequence, then the second frame, and so on, until the last frame. Specifically, , , , They represent the horizontal coordinate, vertical coordinate and marked gesture of the first key point in the first frame, which are arranged continuously in a two-dimensional matrix; , , , Respectively represent the corresponding information of the second key point in the first frame, and are also arranged continuously in the matrix; and so on until , , , Indicates the information of the Nth key point in the first frame. Next, the key point information of the second frame , , , Start arranging until the information of the Nth key point of the last frame , , , In this way, each row of matrix data contains the coordinate information and gesture marks of all key points in a time point (i.e., a frame). In addition, the time of all key points in each frame is the same, i.e., associated with the frame itself. Through this expanded two-dimensional matrix, the present embodiment can construct a recognition model.
更进一步的,输入数据X被传递给共享特征提取器h,共享特征提取器的输出h(X)被用作动作识别子网络和手势识别子网络的输入。最终,模型f的输出是:Furthermore, the input data X is passed to the shared feature extractor h, and the output h(X) of the shared feature extractor is used as the action recognition sub-network and gesture recognition subnetwork Finally, the output of model f is:
; ;
其中每个子网络都利用共享特征提取器提供的特征h(X)来产生各自任务的识别结果,即和分别是动作和手势的识别结果。Each sub-network uses the features h(X) provided by the shared feature extractor to produce the recognition results of its own task, that is, and They are the recognition results of actions and gestures respectively.
应当说明的是,在帧数输入构建数学矩阵X时,需要删除关键点检测数量未达到设定阈值的连续帧和关键点检测数量不满足设定阈值的图像帧,同时调整太极拳视频对应的时间戳t。It should be noted that when constructing the mathematical matrix X by inputting the number of frames, it is necessary to delete the continuous frames whose key point detection number does not reach the set threshold and the image frames whose key point detection number does not meet the set threshold, and adjust the timestamp t corresponding to the Tai Chi video.
具体的,若关键点检测数量不满足,即缺少x、y的坐标,则对相应缺少点位采用“NaN”进行填补。Specifically, if the number of key point detections is not satisfied, that is, the x and y coordinates are missing, "NaN" is used to fill the corresponding missing points.
S3、根据识别模型,利用时间窗口对数学矩阵中的动作和手势进行划分,通过设置调节系数,对时间窗口划分后的动作和手势进行动态调整,并输出模型结果;S3. According to the recognition model, the actions and gestures in the mathematical matrix are divided using the time window, and the actions and gestures after the time window division are dynamically adjusted by setting the adjustment coefficient, and the model results are output;
进一步的,识别模型中的时间窗口序列为:Furthermore, the time window sequence in the recognition model is:
; ;
手势序列为:The gesture sequence is:
; ;
其中,每个表示视频中第i个时间窗口,每个表示第m个手势。Among them, each represents the i-th time window in the video, each Indicates the mth gesture.
更进一步的,手势序列的开始帧对应时间窗口序列的开始帧,从时间窗口的开始帧的后一帧开始,每一帧的手势序列的当前帧为后一帧的时间窗口的开始帧,直至循环到手势序列的当前帧等于时间窗口的开始帧,得到。Furthermore, the start frame of the gesture sequence The start frame of the corresponding time window sequence , starting from the frame after the start frame of the time window, the current frame of each frame of the gesture sequence is the start frame of the time window of the next frame, until the current frame of the gesture sequence is equal to the start frame of the time window, and the result is .
具体的,表示为:specific, Expressed as:
; ;
应当说明的是,和中的等号为赋值操作。It should be noted that and The equal sign in is an assignment operation.
应当说明的是,手势序列的当前帧等于时间窗口的开始帧,可以实现对手势的实时分析和反馈,并能够实现算法的应用优化。It should be noted that the current frame of the gesture sequence is equal to the start frame of the time window, which can realize real-time analysis and feedback of the gesture and can realize application optimization of the algorithm.
进一步的,设置双调节系数和;Furthermore, set the double adjustment coefficient and ;
更进一步的,通过对时间窗口序列进行调节,以得到对应手势序列的变化序列;Furthermore, through For time window series Adjust to obtain the change sequence corresponding to the gesture sequence ;
具体的,表示为:specific, Expressed as:
; ;
在所述变化序列的基础上,对识别模型进行调节,得到: In the change sequence On this basis, the recognition model is adjusted to obtain:
; ;
其中,表示在时间点t处经过调整后的时间序列值;为时间窗口序列调节系数,为变化序列的动态系数;表示识别模型的时间段,为识别模型输出的太极拳法的得分。in, Indicates that at time point t Adjusted time series values; is the time window series adjustment coefficient, For the change sequence Dynamic coefficient of represents the time period for identifying the model, The score of Tai Chi output by the recognition model.
应当说明的是,通过设置调节系数使得模型的灵活性程度变高,有助于提高模型的鲁棒性。It should be noted that setting the adjustment coefficient makes the model more flexible, which helps to improve the robustness of the model.
进一步的,定义模型损失函数并引入二值变量对模型输出结果进行判别;Furthermore, we define the model loss function and introduce binary variables Determine the model output results;
更进一步的,设表示动作的输出层,表示手势的输出层,识别模型输出表示为:Furthermore, The output layer represents the action, The output layer representing the gesture, the recognition model output is expressed as:
; ;
具体的,损失函数分为动作损失函数和手势损失函数;Specifically, the loss function is divided into action loss function and gesture loss function;
具体的,动作损失函数表示为:Specifically, the action loss function Expressed as:
; ;
具体的,手势损失函数表示为:Specifically, the gesture loss function Expressed as:
; ;
优选的,通过设置动作部分的权重,手势部分的权重,得到总损失值表示为:Preferably, by setting the weight of the action part , the weight of the gesture part , and get the total loss value Expressed as:
; ;
进一步的,和的取值为True或False;表示为二元交叉熵。further, and The value of is True or False; Expressed as binary cross entropy.
应当说明的是,使用二元交叉熵作为损失函数的处理是为了在动作和手势不相等的情况进行类别处理,有助于对模型输出结果进行解释。It should be noted that the use of binary cross entropy as the loss function is to perform category processing when actions and gestures are not equal, which helps to explain the model output results.
更进一步的,若二值变量大于,则标记为1,属于可信任模型;否则,则标记为0,属于不可信任模型,返回至构建数学矩阵处,重新建立模型。Furthermore, if the binary variable more than the , it is marked as 1, which is a trustworthy model; otherwise, it is marked as 0, which is an untrustworthy model, and returns to the construction of the mathematical matrix to rebuild the model.
S4、根据模型输出结果,对模型进行整体评估,得到太极拳评分结果。S4. Based on the model output results, the model is evaluated as a whole to obtain the Tai Chi score results.
基于与上述实施例中的基于时间窗口的太极拳评分方法相同的思想,本发明还提供了基于时间窗口的太极拳评分系统,该系统可用于执行上述基于时间窗口的太极拳评分方法。为了便于说明,基于时间窗口的太极拳评分系统实施例的结构示意图中,仅仅示出了与本发明实施例相关的部分,本领域技术人员可以理解,图示结构并不构成对装置的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Based on the same idea as the time window-based Tai Chi scoring method in the above embodiment, the present invention also provides a time window-based Tai Chi scoring system, which can be used to execute the time window-based Tai Chi scoring method. For ease of explanation, the structural diagram of the embodiment of the time window-based Tai Chi scoring system only shows the parts related to the embodiment of the present invention. Those skilled in the art can understand that the illustrated structure does not constitute a limitation on the device, and may include more or fewer components than the illustrated one, or combine certain components, or arrange the components differently.
进一步的,本实施例还提供一种基于时间窗口的太极拳评分系统,包括:Furthermore, this embodiment also provides a Tai Chi scoring system based on a time window, comprising:
视频采集模块,采集太极拳视频中的太极拳动作关键点,并对所述视频中的每一个帧数中的关键点进行定义;A video acquisition module, which acquires key points of Tai Chi movements in Tai Chi videos and defines key points in each frame of the video;
模型建立模块,将定义过关键点中的动作和手势作为关键数据的集合,构建数学矩阵,通过所述数学矩阵,得到识别模型;A model building module uses the actions and gestures in the defined key points as a set of key data to construct a mathematical matrix, and obtains a recognition model through the mathematical matrix;
模型算法模块,根据所述识别模型,利用时间窗口对所述数学矩阵中的动作和手势进行划分,通过设置调节系数,对所述时间窗口划分后的动作和手势进行动态调整,并输出模型结果;A model algorithm module, which divides the actions and gestures in the mathematical matrix using a time window according to the recognition model, dynamically adjusts the actions and gestures after the time window division by setting an adjustment coefficient, and outputs a model result;
模型结果评分模块,根据所述识别模型的输出结果,对模型进行整体评估,得到太极拳评分结果。The model result scoring module evaluates the model as a whole according to the output result of the recognition model to obtain the Tai Chi scoring result.
本实施例还提供一种计算机设备,适用于基于时间窗口的太极拳评分方法的情况,包括:This embodiment further provides a computer device, which is applicable to the Tai Chi scoring method based on a time window, and includes:
存储器和处理器;存储器用于存储计算机可执行指令,处理器用于执行计算机可执行指令,实现如上述实施例提出的基于时间窗口的太极拳评分方法。Memory and processor; the memory is used to store computer executable instructions, and the processor is used to execute computer executable instructions to implement the Tai Chi scoring method based on time window as proposed in the above embodiment.
该计算机设备可以是终端,该计算机设备包括通过系统总线连接的处理器、存储器、通信接口、显示屏和输入装置。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的通信接口用于与外部的终端进行有线或无线方式的通信,无线方式可通过WIFI、运营商网络、NFC(近场通信)或其他技术实现。该计算机设备的显示屏可以是液晶显示屏或者电子墨水显示屏,该计算机设备的输入装置可以是显示屏上覆盖的触摸层,也可以是计算机设备外壳上设置的按键、轨迹球或触控板,还可以是外接的键盘、触控板或鼠标等。The computer device may be a terminal, and the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covering the display screen, or a key, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.
本实施例还提供一种存储介质,其上存储有计算机程序,该程序被处理器执行时实现如上述实施例提出的基于时间窗口的太极拳评分方法。This embodiment also provides a storage medium on which a computer program is stored. When the program is executed by a processor, the time window-based Tai Chi scoring method proposed in the above embodiment is implemented.
本实施例提出的存储介质与上述实施例提出的数据存储方法属于同一发明构思,未在本实施例中详尽描述的技术细节可参见上述实施例,并且本实施例与上述实施例具有相同的有益效果。The storage medium proposed in this embodiment and the data storage method proposed in the above embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be found in the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.
实施例2Example 2
参照表1和表2,为本发明第二个实施例,该实施例提供了一种基于时间窗口的太极拳评分方法,包括:通过模拟实验的方式验证本发明方法的太极拳模拟的准确性;Referring to Table 1 and Table 2, the second embodiment of the present invention provides a time window-based Tai Chi scoring method, including: verifying the accuracy of Tai Chi simulation of the method of the present invention by means of simulation experiments;
根据模型定义的损失函数,得到对太极拳每个动作的评分,每个模拟实验包括:24个太极拳动作,每个动作的评分范围为1至100分。The loss function defined by the model , get the score of each Tai Chi action ,Each simulation experiment includes: 24 Tai Chi movements, each movement is scored ranging from 1 to 100 points.
实验分为两个独立的组别:第一组进行了10次实验,标记为实验1至10,未使用本发明方式;在该组别中,模型在评分低于5分(不包括5分)时中断对后续动作的评判;参考表1;The experiments were divided into two independent groups: the first group conducted 10 experiments, marked as experiments 1 to 10, without using the method of the present invention; in this group, the model stopped judging the subsequent actions when the score was less than 5 points (excluding 5 points); refer to Table 1;
表1 第一组10次实验的动作评分Table 1 Action scores of the first set of 10 experiments
第二组进行了10次实验,标记为实验11至20,采用了本发明方法,通过划分时间窗口的方式,确保模型在整个评分过程中不会中断对后续动作的判断;参考表2;The second group conducted 10 experiments, marked as experiments 11 to 20, using the method of the present invention to ensure that the model does not interrupt the judgment of subsequent actions during the entire scoring process by dividing the time window; refer to Table 2;
表2 第二组10次实验的动作评分Table 2 Action scores of the second group of 10 experiments
通过表1和表2,可以发现表2中使用本发明方法能够监测到更多的动作,且动作评价分值,即太极拳法的准确度都高于表1的前10组实验数据;From Table 1 and Table 2, it can be found that the method of the present invention can monitor more actions in Table 2, and the action evaluation scores, that is, the accuracy of Tai Chi, are higher than the first 10 groups of experimental data in Table 1;
由此说明,本发明方法能够带来太极拳法准确度的提升以及动作的连续评判,为后续模型训练提升了检测的精确度。This shows that the method of the present invention can improve the accuracy of Tai Chi techniques and the continuous evaluation of movements, thereby improving the accuracy of detection for subsequent model training.
实施例3Example 3
参照表3,为本发明第三个实施例,该实施例提供了一种基于时间窗口的太极拳评分方法,包括:Referring to Table 3, which is a third embodiment of the present invention, this embodiment provides a Tai Chi scoring method based on a time window, including:
生成包含100张图像帧的数据集;每张图像帧均包含10个学生,每个学生独立随机生成15至25个图像帧中的太极拳动作关键点,这些关键点代表模型检测出的人体关键点的数量;按照编号顺序,这100张图像帧被划分成了10个分组进行检测,每个分组包括10张图像帧;Generate a dataset containing 100 image frames; each image frame contains 10 students, and each student independently and randomly generates 15 to 25 key points of Tai Chi movements in the image frames, which represent the number of key points of the human body detected by the model; according to the numbering order, these 100 image frames are divided into 10 groups for detection, and each group includes 10 image frames;
在每个学生的关键点生成中,符合条件大于等于18个的关键点数量将该学生定义为及格目标,否则将其定义为不及格目标;对于每张图像帧,如果该图像帧中及格目标的数量大于等于7个,那么该图像帧即被标记为及格图片;否则,被标记为不及格图片;In the key point generation of each student, if the number of key points that meet the condition is greater than or equal to 18, the student is defined as a passing target, otherwise it is defined as a failing target; for each image frame, if the number of passing targets in the image frame is greater than or equal to 7, then the image frame is marked as a passing picture; otherwise, it is marked as a failing picture;
在分组层面,如果一个分组中的及格图片数量大于等于7张,那么该分组为及格分组;反之,则为不及格分组;At the group level, if the number of qualified images in a group is greater than or equal to 7, then the group is a qualified group; otherwise, it is a failed group;
将上述条件中的关键点和图像帧作为模型训练的和,直至模型输出结果;参考表3;The key points and image frames in the above conditions are used as the training and , until the model outputs the results; refer to Table 3;
表3 将关键点和图像帧输入模型训练后输出的结果对比Table 3 Comparison of the output results after inputting key points and image frames into the model training
由表3可得,不及格的目标、图片和分组数量均小于等于自身值至1/2,说明本发明的时间窗口和手势序列能够在处理连续图像帧时,不产生较大波动,从而为模型增加稳定性和鲁棒性。It can be seen from Table 3 that the number of failed targets, pictures and groups is less than or equal to 1/2 of their own values, indicating that the time window and gesture sequence of the present invention can process continuous image frames without large fluctuations, thereby increasing the stability and robustness of the model.
实施例4Example 4
参照图2,为本发明第四个实施例,该实施例提供了一种基于时间窗口的太极拳评分系统,包括:中央服务器100、边缘服务器200、摄像机300、麦克风400、显示设备500、网络600;2 , which is a fourth embodiment of the present invention, the embodiment provides a time window-based Tai Chi scoring system, including: a central server 100 , an edge server 200 , a camera 300 , a microphone 400 , a display device 500 , and a network 600 ;
中央服务器100包括,The central server 100 includes,
图像存储模块11:用于存储太极拳学生的视频图像;Image storage module 11: used to store video images of Tai Chi students;
模型训练模块12:输入太极拳学生的视频图像进行训练,并输出训练后的模型;Model training module 12: inputting video images of Tai Chi students for training, and outputting the trained model;
边缘服务器200包括,The edge server 200 includes,
数据存储模块21:用于存储视频图像产生的关键点的四维向量;Data storage module 21: used to store the four-dimensional vector of key points generated by the video image;
图像分析模块22:使用模型训练模块12输出的模型分析摄像机300采集的太极拳学生的视频图像;Image analysis module 22: uses the model output by model training module 12 to analyze the video images of Tai Chi students collected by camera 300;
摄像机300包括,The camera 300 includes,
视频采集模块31:用于采集太极拳学生的视频图像;Video acquisition module 31: used to acquire video images of Tai Chi students;
麦克风400包括,The microphone 400 includes,
信息通知模块41:根据图像分析模块22输出的分析结果发出信息通知;Information notification module 41: issues information notification according to the analysis result output by the image analysis module 22;
显示设备500包括,The display device 500 includes,
信息显示模块51:根据图像分析模块22输出的分析结果显示评价结果和改进建议;Information display module 51: displays evaluation results and improvement suggestions according to the analysis results output by the image analysis module 22;
网络600用于连接所述中央服务器100、边缘服务器200、摄像机300、麦克风400、显示设备500。The network 600 is used to connect the central server 100 , the edge server 200 , the camera 300 , the microphone 400 , and the display device 500 .
本领域内的技术人员应明白,本发明实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。本申请实施例中的方案可以采用各种计算机语言实现,例如,面向对象的程序设计语言Java和直译式脚本语言JavaScript等。It should be understood by those skilled in the art that the embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes. The schemes in the embodiments of the present application may be implemented in various computer languages, for example, object-oriented programming language Java and literal scripting language JavaScript, etc.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to the flowcharts and/or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and/or box in the flowchart and/or block diagram, as well as the combination of the processes and/or boxes in the flowchart and/or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate a device for implementing the functions specified in one process or multiple processes in the flowchart and/or one box or multiple boxes in the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.
尽管已描述了本申请的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.
显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410424786.3A CN118015712B (en) | 2024-04-10 | 2024-04-10 | Tai Chi scoring method, system, device and medium based on time window |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410424786.3A CN118015712B (en) | 2024-04-10 | 2024-04-10 | Tai Chi scoring method, system, device and medium based on time window |
Publications (2)
Publication Number | Publication Date |
---|---|
CN118015712A CN118015712A (en) | 2024-05-10 |
CN118015712B true CN118015712B (en) | 2024-07-12 |
Family
ID=90944946
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410424786.3A Active CN118015712B (en) | 2024-04-10 | 2024-04-10 | Tai Chi scoring method, system, device and medium based on time window |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118015712B (en) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113947811A (en) * | 2021-10-15 | 2022-01-18 | 湘潭大学 | A method and system for Taijiquan action correction based on generative confrontation network |
CN114870384A (en) * | 2022-04-30 | 2022-08-09 | 程亚红 | Taijiquan training method and system based on dynamic recognition |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6072494A (en) * | 1997-10-15 | 2000-06-06 | Electric Planet, Inc. | Method and apparatus for real-time gesture recognition |
-
2024
- 2024-04-10 CN CN202410424786.3A patent/CN118015712B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113947811A (en) * | 2021-10-15 | 2022-01-18 | 湘潭大学 | A method and system for Taijiquan action correction based on generative confrontation network |
CN114870384A (en) * | 2022-04-30 | 2022-08-09 | 程亚红 | Taijiquan training method and system based on dynamic recognition |
Also Published As
Publication number | Publication date |
---|---|
CN118015712A (en) | 2024-05-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11747898B2 (en) | Method and apparatus with gaze estimation | |
CN110021051B (en) | A Generative Adversarial Network-based Human Image Generation Method Guided by Text | |
WO2021017606A1 (en) | Video processing method and apparatus, and electronic device and storage medium | |
WO2021120834A1 (en) | Biometrics-based gesture recognition method and apparatus, computer device, and medium | |
US20200026910A1 (en) | Gesture identification, control, and neural network training methods and apparatuses, and electronic devices | |
JP2022505762A (en) | Image Semantic Segmentation Network training methods, equipment, equipment and computer programs | |
CN112819686B (en) | Image style processing method and device based on artificial intelligence and electronic equipment | |
WO2020156245A1 (en) | Action recognition method, apparatus and device and storage medium | |
CN111368788A (en) | Training method and device of image recognition model and electronic equipment | |
CN106407889A (en) | Video human body interaction motion identification method based on optical flow graph depth learning model | |
CN111860362A (en) | Generating face image correction model and method and device for correcting face image | |
JP2023548921A (en) | Image line-of-sight correction method, device, electronic device, computer-readable storage medium, and computer program | |
CN109583509A (en) | Data creation method, device and electronic equipment | |
CN111240476A (en) | Interaction method and device based on augmented reality, storage medium and computer equipment | |
US10401947B2 (en) | Method for simulating and controlling virtual sphere in a mobile device | |
CN103745423A (en) | Mouth-shape teaching system and mouth-shape teaching method | |
US20230290132A1 (en) | Object recognition neural network training using multiple data sources | |
CN114898062A (en) | A map construction method and device based on SLAM in dynamic scenes | |
CN116091541A (en) | Eye movement tracking method, eye movement tracking device, electronic device, storage medium, and program product | |
CN110659702A (en) | Calligraphy copybook evaluation system and method based on generative confrontation network model | |
CN116521797A (en) | A blockchain data visualization method and system based on the snake model | |
CN118015712B (en) | Tai Chi scoring method, system, device and medium based on time window | |
CN104615283B (en) | A kind of laser pen interaction method | |
CN113516735B (en) | Image processing method, device, computer readable medium and electronic device | |
CN111105487B (en) | A face synthesis method and device in a virtual teacher system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |