Nothing Special   »   [go: up one dir, main page]

WO2023147731A1 - 异常数据的处理方法、装置及电子设备 - Google Patents

异常数据的处理方法、装置及电子设备 Download PDF

Info

Publication number
WO2023147731A1
WO2023147731A1 PCT/CN2022/126358 CN2022126358W WO2023147731A1 WO 2023147731 A1 WO2023147731 A1 WO 2023147731A1 CN 2022126358 W CN2022126358 W CN 2022126358W WO 2023147731 A1 WO2023147731 A1 WO 2023147731A1
Authority
WO
WIPO (PCT)
Prior art keywords
end server
power data
local time
application server
server
Prior art date
Application number
PCT/CN2022/126358
Other languages
English (en)
French (fr)
Inventor
于希娟
及洪泉
张淼
宣振文
白晶
赵瑞
温明时
陈艳霞
李亦非
张玉佳
Original Assignee
国网北京市电力公司
国家电网有限公司
北京鼎诚鸿安科技发展有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 国网北京市电力公司, 国家电网有限公司, 北京鼎诚鸿安科技发展有限公司 filed Critical 国网北京市电力公司
Publication of WO2023147731A1 publication Critical patent/WO2023147731A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures

Definitions

  • the present application relates to the field of computer data processing, in particular, to a processing method, device and electronic equipment for abnormal data.
  • Real-time monitoring of grid data has always been an important part of grid operation and maintenance. Through real-time collection of grid data, long-term and stable collection of grid data can be achieved. Using the corresponding data analysis platform can realize the dynamic and accurate grasp of the power grid situation, and can give timely prompts and early warnings of faults or abnormal conditions in the power grid system at the first time. At the same time, the data background management system will realize the orderly storage of historical data, support the query and call of historical data, and realize the further analysis of important historical data.
  • Embodiments of the present application provide a method, device, and electronic device for processing abnormal data, so as to at least solve the technical problem of inconvenient data analysis due to data errors caused by abnormal terminals.
  • a method for processing abnormal data including: the front-end server receives the power data on the power equipment collected by the terminal, wherein the power data at least includes: GPS status, electromagnetic interference status information, Collection time; when the front-end server determines that the GPS state in the power data is abnormal, replace the collection time with the local time of the front-end server; wherein, the GPS state is determined according to the GPS signal, and the GPS state is determined according to the GPS signal.
  • the method further includes: the front-end server sends a request message to the application server , the request message is used to request the local time of the application server from the application server; the front-end server receives the local time of the application server fed back by the application server, and compares the local time of the application server and the local time of the front-end server; when the comparison result indicates an inconsistency, update the local time of the front-end server according to the local time of the application server; use the direct interaction process between the front-end server and the application server Verifying the local time of the front-end server to ensure the accuracy of the collection time in the power data; when the front-end server determines that there is electromagnetic interference status information in the power data, remove the information that has electromagnetic interference from the power data power data.
  • the front-end server judges whether the collection time is consistent with the local time of the front-end server, and when the judgment results are inconsistent, replaces the collection time with the local time of the front-end server.
  • the method further includes: classifying and marking the power data, and sending the classified and marked power data to the application server, wherein the application server sends the power data Stored in the storage space corresponding to the classification mark, the storage space is the storage space in the relational database.
  • the electromagnetic interference state information is indicated by a third flag and a fourth flag, the third flag indicates that there is electromagnetic interference in the power data, and the fourth flag indicates that there is no electromagnetic interference in the power data.
  • the front-end server after the front-end server receives the power data on the power equipment collected by the terminal, it includes: caching the power data into the cache.
  • a device for processing abnormal data including: a receiving module, used for the front-end server to receive the power data on the power equipment collected by the terminal, wherein the power data includes at least: GPS Status, electromagnetic interference status information, collection time; a replacement module, used for the front-end server to replace the collection time with the local time of the front-end server when the GPS status in the power data is determined to be abnormal; wherein, the GPS status According to the GPS signal determination, when the signal-to-noise ratio of the GPS signal is less than a preset threshold, it is determined that the GPS state is abnormal; before the acquisition time is replaced with the local time of the front-end server, the front-end server It is used to send a request message to the application server, and the request message is used to request the local time of the application server from the application server; receive the local time of the application server fed back by the application server, and compare the local time of the application server with the local time of the front-end server and the local time of the
  • the front-end server before replacing the collection time with the local time of the front-end server, the front-end server is also used to judge whether the collection time is consistent with the local time of the front-end server, and when the judgment results are inconsistent, replace the collection time with the previous Set the local time of the server.
  • an electronic device including: a memory, used to store program instructions; a processor, connected to the memory, used to execute the program instructions to realize the following functions: the front-end server receives the terminal Collected power data on power equipment, wherein the power data includes at least: GPS status, electromagnetic interference status information, and collection time; when the front-end server determines that the GPS status in the power data is abnormal, replace the collection time with the previous The local time of the server is set; wherein, the GPS state is determined according to the GPS signal, and when the signal-to-noise ratio of the GPS signal is less than a preset threshold, it is determined that the GPS state is abnormal; the collection time is replaced by the previous Before the local time of the server, the method further includes: the front-end server sends a request message to the application server, and the request message is used to request the application server for the local time of the application server; the front-end server receiving the local time of the application server fed back by the application server, and
  • non-volatile storage medium includes a stored program, wherein, when the program is running, the device where the non-volatile storage medium is located is controlled Execute the above abnormal data processing method.
  • the front-end server uses the The local time of the server is used to replace the collection time.
  • the front-end server removes the power data with electromagnetic interference to achieve the purpose of monitoring the power data, thereby achieving the technical effect of processing abnormal power data. It solves the technical problem that the data is wrong due to the abnormality of the terminal, which makes the data analysis inconvenient.
  • FIG. 1 is a block diagram of a hardware structure of a computer terminal (or electronic device) for implementing a processing method for abnormal data according to an embodiment of the present application;
  • FIG. 2 is a flow chart of a method for processing abnormal data according to an embodiment of the present application
  • Fig. 3 is a flow chart of updating the local time of the front-end server according to an embodiment of the present application
  • Fig. 4 is a structural diagram of an apparatus for processing abnormal data according to an embodiment of the present application.
  • an embodiment of a method for processing abnormal data is provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and, Although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.
  • FIG. 1 shows a block diagram of a hardware structure of a computer terminal (or electronic device) for implementing a method for processing abnormal data.
  • the computer terminal 10 may include one or more (shown by 102a, 102b, ..., 102n in the figure) processors 102 (the processors 102 may include but not limited to micro A processing device such as a processor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device 106 for communication functions.
  • FIG. 1 is only a schematic diagram, and it does not limit the structure of the above-mentioned electronic device.
  • computer terminal 10 may also include more or fewer components than shown in FIG. 1 , or have a different configuration than that shown in FIG. 1 .
  • the one or more processors 102 and/or other data processing circuits described above may generally be referred to herein as "data processing circuits".
  • the data processing circuit may be implemented in whole or in part as software, hardware, firmware or other arbitrary combinations.
  • the data processing circuit may be a single independent processing module, or be fully or partially integrated into any of the other elements in the computer terminal 10 (or electronic equipment).
  • the data processing circuit is used as a processor control (for example, the selection of the terminal path of the variable resistor connected to the interface).
  • the memory 104 can be used to store software programs and modules of application software, such as the program instruction/data storage device corresponding to the abnormal data processing method in the embodiment of the present application.
  • the processor 102 runs the software programs and modules stored in the memory 104, In this way, various functional applications and data processing are performed, that is, the above-mentioned abnormal data processing method is realized.
  • the memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
  • the memory 104 may further include a memory that is remotely located relative to the processor 102 , and these remote memories may be connected to the computer terminal 10 through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the transmission device 106 is used to receive or transmit data via a network.
  • the specific example of the above-mentioned network may include a wireless network provided by the communication provider of the computer terminal 10 .
  • the transmission device 106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet.
  • the transmission device 106 may be a radio frequency (Radio Frequency, RF) module, which is used to communicate with the Internet in a wireless manner.
  • RF Radio Frequency
  • the display may be, for example, a touchscreen liquid crystal display (LCD), which may enable a user to interact with the user interface of the computer terminal 10 (or electronic device).
  • LCD liquid crystal display
  • the computer equipment (or electronic equipment) shown in FIG. 1 may include hardware components (including circuits), software components (including computer code), or a combination of both hardware and software elements. It should be noted that FIG. 1 is only one example of a particular embodiment, and is intended to illustrate the types of components that may be present in the computer device (or electronic device) described above.
  • Fig. 2 is a flowchart of a method for processing abnormal data according to an embodiment of the present application. As shown in Fig. 2, the method includes the following steps:
  • Step S202 the front-end server receives the power data on the power equipment collected by the terminal, wherein the power data at least includes: GPS status, electromagnetic interference status information, and collection time;
  • Step S204 when the front-end server determines that the GPS status in the power data is abnormal, replace the collection time with the local time of the front-end server;
  • step S206 the front-end server removes the power data with electromagnetic interference from the power data when it is determined that the power data has electromagnetic interference status information.
  • the GPS status and electromagnetic interference status information in the power data are judged, and different processing methods are adopted.
  • the GPS status is marked as "abnormal"
  • the collection time will deviate, and the front-end server uses the front-end server's local The time replaces the collection time.
  • the front-end server removes the power data with electromagnetic interference to achieve the purpose of monitoring the power data, thereby realizing the technical effect of processing abnormal power data, and then solving the problem caused by the terminal Abnormalities cause data errors and technical problems that make data analysis inconvenient.
  • step S202 the power data on the power equipment collected by the terminal is at least transmitted in the form of a file stream or a byte stream encapsulated by a specified protocol.
  • the raw power data analyzed by the front-end server also includes at least one of the following: voltage, current, and terminal number. Since there are multiple terminals, different terminals collect power data in different places, so each terminal has a terminal number, which is used to distinguish the source terminal of the original power data.
  • step S202 after the front-end server receives the power data on the power equipment collected by the terminal, the method further includes the following steps: classifying and marking the power data, and sending the classified and marked power data to the application server, wherein the application server Store the power data in the storage space corresponding to the classification mark, the storage space is the storage space in the relational database, the classification mark includes but not limited to one or more of the collection time, voltage, current, harmonic order, and power The data is stored in the storage space corresponding to the classification mark in the way of distributed storage.
  • Step S302 the front-end server sends a request message to the application server, and the request message is used to request the local time of the application server from the application server;
  • Step S304 the front-end server receives the local time of the application server fed back by the application server, and compares the local time of the application server with the local time of the front-end server;
  • Step S306 when the comparison result indicates inconsistency, update the local time of the front-end server according to the local time of the application server.
  • the front-end server judges whether the collection time is consistent with the local time of the front-end server, and replaces the collection time with the local time of the front-end server if the judgment results are inconsistent.
  • the application server Since the application server is mainly used to provide client users with access to business logic for use by client applications, in order to ensure the accuracy of the collection time, it is necessary to ensure the accuracy of the local time of the front-end server. At this time, you can Use the direct interaction process between the front-end server and the application server to verify the local time of the front-end server to ensure the accuracy of the collection time in the above-mentioned power data.
  • the application server since the application server often directly provides corresponding services to the application program, the time precision requirement of the application server is often higher than that of the front-end server. Using the local time of the application server to update the local time of the front-end server is also The above power data can be made more accurate.
  • the terminal is provided with a GPS module, which is used to collect GPS signals in the environment where the terminal is located, and determines the GPS status according to the GPS signals; an electromagnetic interference sensor is provided on the terminal, which is used to collect electromagnetic interference signals , and determine the electromagnetic interference state information according to the electromagnetic interference signal, wherein, the GPS state is indicated by a first mark and a second mark, the first mark indicates that the GPS state is normal, and the second mark represents that the GPS state is abnormal; the electromagnetic interference The status information is indicated by a third flag and a fourth flag, the third flag indicates that there is electromagnetic interference in the power data, and the fourth flag indicates that there is no electromagnetic interference in the power data.
  • determining the GPS state according to the GPS signal specifically includes the following steps: when the signal-to-noise ratio of the collected GPS signal is greater than a preset threshold, determine that the GPS state is normal; when the signal-to-noise ratio of the collected GPS signal is less than When the threshold is preset, it is determined that the GPS status is abnormal.
  • step S202 after the front-end server receives the power data on the power equipment collected by the terminal, the method further includes the following steps: analyzing the power data to obtain the original power data, the front-end server caches the original power data in the cache, and the front-end
  • the configuration server extracts the original power data from the cache to the analysis module in the front-end server for analysis, obtains the analysis results, and transmits the analysis results to the application server.
  • the analysis results are stored into a relational database.
  • the application server is equipped with a display window, which is used to display the analysis results. At the same time, the display window can display the online status of the terminal.
  • the display window When the terminal status is "online”, that is, when the terminal is in the state of transmitting power data, the display window displays One mark, when the status of the terminal is "offline", that is, when the terminal is not transmitting power data, the display window displays the second mark, wherein the first mark and the second mark are distinguished by different colors, such as the first mark is green, The second marker is red.
  • the following steps need to be performed: detecting the remaining capacity of the relational database, and when the remaining capacity of the relational database is lower than a second threshold, control the relational database to prompt, wherein the second threshold is the relational database
  • the preset ratio of the remaining capacity to the total capacity of the relational database for example, the preset ratio is 15% or lower, and the prompting methods include but are not limited to one or more of sound, image, email, and short message.
  • the front-end server analyzes the power data to obtain the original power data, it transmits the original power data to the time-series database server, and stores the original power data into the time-series library server by calling the time-series database interface in the time-series database server In the database, the storage of raw power data is realized.
  • the following steps need to be performed: detect the remaining capacity of the time-series database, and when the remaining capacity of the time-series database is lower than the first threshold, control the time-series database to prompt, wherein the first threshold is the time-series database
  • the preset ratio of the remaining capacity of the time series database to the total capacity of the time series database such as the preset ratio is 15% or lower
  • the prompt method includes but not limited to one or more of sound, image, email, and text message
  • the time series database stores There is an upper limit for the storage time of the original power data, and the original power data exceeding the storage limit will be deleted, and the storage limit is seven days.
  • the transmission of various terminal status data can be realized through the 5G transmission network.
  • the front-end server determines that the power data transmitted by the terminal is abnormal, it can actively process the abnormal power data. This process does not require human intervention and can be carried out in real time. The ability of the system to resist external influences is greatly improved.
  • Fig. 4 is a structural diagram of an abnormal data processing device according to an embodiment of the present application. As shown in Fig. 4, the device includes:
  • the receiving module 40 is used for the front-end server to receive the power data on the power equipment collected by the terminal, wherein the power data at least includes: GPS status, electromagnetic interference status information, and collection time;
  • the replacement module 42 is used for the front-end server to replace the collection time with the local time of the front-end server when it is determined that the GPS status in the power data is abnormal; wherein, the GPS status is determined according to the GPS signal, and the GPS When the signal-to-noise ratio of the signal is less than a preset threshold, it is determined that the GPS state is abnormal; before the collection time is replaced with the local time of the front-end server, the front-end server is used to send a request message to the application server, The request message is used to request the local time of the application server from the application server; receive the local time of the application server fed back by the application server, and compare the local time of the application server with the front server local time; when the comparison result indicates inconsistency, update the local time of the front-end server according to the local time of the application server;
  • the processing module 44 is configured to remove the power data with electromagnetic interference from the power data when the front-end server determines that the power data has electromagnetic interference status information.
  • the receiving module 40, the replacement module 42, and the processing module 44 are respectively a part of the front server.
  • the front-end server caches the power data in the cache after receiving the power data collected by the terminal.
  • the front-end server judges whether the collection time is consistent with the local time of the front-end server, and when the judgment results are inconsistent, replaces the collection time with the local time of the front-end server.
  • the electromagnetic interference state information is indicated by a third flag and a fourth flag, the third flag indicates that there is electromagnetic interference in the power data, and the fourth flag indicates that there is no electromagnetic interference in the power data.
  • the front-end server After the front-end server receives the power data on the power equipment collected by the terminal, it analyzes the power data to obtain the original power data.
  • the front-end server caches the original power data into the cache, and extracts the original power data from the cache to the front-end server.
  • analysis module and analyze it to obtain the analysis results, classify and mark the analysis results corresponding to the power data, and send the power data after the classification and marking to the application server, wherein the application server stores the power data in the storage corresponding to the classification marks
  • the storage space is the storage space in the relational database.
  • the receiving module 40, the replacement module 42, and the processing module 44 can be one or more processors or controllers with communication interfaces capable of implementing communication protocols, and can also include memory and Relevant interfaces, system transmission buses, etc.; the processor or controller executes program-related codes to implement corresponding functions.
  • the receiving module 40, the replacement module 42, and the processing module 44 share an integrated chip or share processors, memories and other devices.
  • the shared processor or chip executes program-related codes to implement corresponding functions.
  • the GPS module is a GPS locator commonly used in the field that can collect GPS signals in the environment where the terminal is located.
  • the analysis module can be one or more processors or controllers with a communication interface capable of implementing a communication protocol, and can also include memory and related interfaces, system transmission buses, etc. if necessary; the processor or controller executes the program The related code realizes the corresponding function.
  • abnormal data processing device shown in Figure 4 is used to implement the abnormal data processing methods shown in Figures 2 to 3, so the relevant explanations in the above abnormal data processing methods are also applicable to this abnormal data The processing device will not be repeated here.
  • the embodiment of the present application also provides a non-volatile storage medium, the non-volatile storage medium includes a stored program, wherein, when the program is running, the device where the non-volatile storage medium is located is controlled to perform the following abnormal data processing method:
  • the front-end server receives the power data on the power equipment collected by the terminal, wherein the power data includes at least: GPS status, electromagnetic interference status information, and collection time;
  • the acquisition time is replaced with the local time of the front-end server; wherein, the GPS status is determined according to the GPS signal, and the signal-to-noise ratio of the GPS signal is less than
  • the threshold is preset, it is determined that the GPS status is abnormal; before replacing the collection time with the local time of the front-end server, the method further includes: the front-end server sends a request message to the application server, the The request message is used to request the local time of the application server from the application server; the front-end server receives the local time of the application server fed back by the application server, and compares the local time of the application server with the The local time of the front-end server; when the comparison result indicates an inconsistency, update the local time of the front-end server according to the local time of the application server;
  • the front-end server removes the power data with electromagnetic interference from the power data when it is determined that the power data has electromagnetic interference status information.
  • the front-end server judges whether the collection time is consistent with the local time of the front-end server, and when the judgment results are inconsistent, replaces the collection time with the local time of the front-end server.
  • the method further includes the following steps: classifying and marking the power data, and sending the classified and marked power data to the application server, wherein, the application server stores the electric power data in the storage space corresponding to the classification mark, and the storage space is the storage space in the relational database.
  • the electromagnetic interference state information in the abnormal data processing method is indicated by a third flag and a fourth flag, the third flag indicates that there is electromagnetic interference in the power data, and the fourth flag indicates that there is no electromagnetic interference in the power data.
  • the front-end server After the front-end server receives the power data on the power equipment collected by the terminal, it caches the power data in the cache.
  • the disclosed technical content can be realized in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units may be a logical function division.
  • multiple units or components may be combined or may be Integrate into another system, or some features may be ignored, or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of units or modules may be in electrical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the present application is essentially or part of the contribution to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions for enabling a computer device (which may be a personal computer, server or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disc, etc., which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Quality & Reliability (AREA)
  • Debugging And Monitoring (AREA)

Abstract

本申请公开了一种异常数据的处理方法、装置及电子设备。其中，该方法包括：前置服务器接收终端采集的电力设备上的电力数据，其中，所述电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；所述前置服务器在确定所述电力数据中的GPS状态为异常的情况下，将所述采集时间替换为前置服务器的本地时间；所述前置服务器在确定所述电力数据存在所述电磁干扰状态信息的情况下，从所述电力数据中去除存在电磁干扰的电力数据。本申请解决了由于终端异常造成数据出错，导致数据分析不便的技术问题。

Description

异常数据的处理方法、装置及电子设备 技术领域
本申请涉及计算机数据处理领域，具体而言，涉及一种异常数据的处理方法、装置及电子设备。
背景技术
电网数据的实时监测一直是电网运维环节中的重要组成部分，通过实时采集电网数据，可以做到对电网数据的长期、稳定收集。利用相应的数据分析平台即可实现对电网情况进行动态、准确的把握，能够第一时间对电网系统中出现的故障或异常状况进行及时提示和预警。同时数据后台管理系统将实现历史数据的有序入库，支持历史数据的查询调用，实现重要历史数据的进一步分析。
5G技术的发展和应用使得电力系统监测终端实现原始波形数据的实时上传、分析成为了可能，数据实时性和数据量得到了提升，为电网监测技术的发展提供了极大的助力。但也因此出现了新的问题，由于单位时间内终端采集和传输的数据量出现了明显的提升，导致一旦终端出现异常，会导致大量数据出错，对后续的数据分析带来困扰。同时，由于采集和存储的数据量很大，也使得数据寻错、纠错变得十分困难。现有技术利用多个服务器作为处理单元，可以实现电力数据的采集和存储，但不涉及分析和处理异常的数据。
针对上述的问题，目前尚未提出有效的解决方案。
发明内容
本申请实施例提供了一种异常数据的处理方法、装置及电子设备，以至少解决由于终端异常造成数据出错，导致数据分析不便的技术问题。
根据本申请实施例的一个方面，提供了一种异常数据的处理方法，包括：前置服务器接收终端采集的电力设备上的电力数据，其中，电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；前置服务器在确定电力数据中的GPS状态为异常的情况下，将采集时间替换为前置服务器的本地时间；其中，所述GPS状态依据GPS信号确定，在所述GPS信号的信噪比小于预设阈值时，确定所述GPS状态为异常；将所述采集时间替换为所述前置服务器的本地时间之前，所述方法还包括：所述前置服务器向应用服务器发送请求消息，所述请求消息用于向所述应用服务器请求所述应用 服务器的本地时间；所述前置服务器接收所述应用服务器反馈的所述应用服务器的本地时间，并比较所述应用服务器的本地时间和所述前置服务器的本地时间；在比较结果指示不一致时，依据所述应用服务器的本地时间更新所述前置服务器的本地时间；利用所述前置服务器和所述应用服务器直接的交互流程对所述前置服务器的本地时间进行验证，以保证所述电力数据中采集时间的准确性；前置服务器在确定电力数据存在电磁干扰状态信息的情况下，从电力数据中去除存在电磁干扰的电力数据。
可选地，在比较结果一致时，前置服务器判断采集时间和前置服务器的本地时间是否一致，在判断结果不一致时，将采集时间替换为前置服务器的本地时间。
可选地，前置服务器接收终端采集的电力设备上的电力数据之后，方法还包括：对电力数据进行分类标记，并将分类标记后的电力数据发送至应用服务器，其中，应用服务器将电力数据存储至与分类标记对应的存储空间中，存储空间为关系数据库中的存储空间。
可选地，电磁干扰状态信息通过第三标识和第四标识指示，第三标识表示电力数据存在电磁干扰，第四标识表示电力数据不存在电磁干扰。
可选地，前置服务器接收终端采集的电力设备上的电力数据之后，包括：将电力数据缓存至缓存中。
根据本申请实施例的另一方面，还提供了一种异常数据的处理装置，包括：接收模块，用于前置服务器接收终端采集的电力设备上的电力数据，其中，电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；替换模块，用于前置服务器在确定电力数据中的GPS状态为异常的情况下，将采集时间替换为前置服务器的本地时间；其中，所述GPS状态依据GPS信号确定，在所述GPS信号的信噪比小于预设阈值时，确定所述GPS状态为异常；将所述采集时间替换为所述前置服务器的本地时间之前，所述前置服务器用于向应用服务器发送请求消息，所述请求消息用于向所述应用服务器请求所述应用服务器的本地时间；接收所述应用服务器反馈的所述应用服务器的本地时间，并比较所述应用服务器的本地时间和所述前置服务器的本地时间；在比较结果指示不一致时，依据所述应用服务器的本地时间更新所述前置服务器的本地时间；处理模块，用于前置服务器在确定电力数据存在电磁干扰状态信息的情况下，从电力数据中去除存在电磁干扰的电力数据。
可选地，将采集时间替换为前置服务器的本地时间之前，所述前置服务器还用于判断采集时间和前置服务器的本地时间是否一致，在判断结果不一致时，将采集时间替换为前置服务器的本地时间。
根据本申请实施例的又一方面，还提供了一种电子设备，包括：存储器，用于存 储程序指令；处理器，与存储器连接，用于执行实现以下功能的程序指令：前置服务器接收终端采集的电力设备上的电力数据，其中，电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；前置服务器在确定电力数据中的GPS状态为异常的情况下，将采集时间替换为前置服务器的本地时间；其中，所述GPS状态依据GPS信号确定，在所述GPS信号的信噪比小于预设阈值时，确定所述GPS状态为异常；将所述采集时间替换为所述前置服务器的本地时间之前，所述方法还包括：所述前置服务器向应用服务器发送请求消息，所述请求消息用于向所述应用服务器请求所述应用服务器的本地时间；所述前置服务器接收所述应用服务器反馈的所述应用服务器的本地时间，并比较所述应用服务器的本地时间和所述前置服务器的本地时间；在比较结果指示不一致时，依据所述应用服务器的本地时间更新所述前置服务器的本地时间；前置服务器在确定电力数据存在电磁干扰状态信息的情况下，从电力数据中去除存在电磁干扰的电力数据。
根据本申请实施例的再一方面，还提供了一种非易失性存储介质，该非易失性存储介质包括存储的程序，其中，在程序运行时控制该非易失性存储介质所在设备执行以上的异常数据的处理方法。
在本申请实施例中，通过判断电力数据中的GPS状态和电磁干扰状态信息，采用不同的处理方式，在GPS状态的标识为“异常”时，采集时间会出现偏差，则前置服务器使用前置服务器的本地时间替换采集时间，在电力数据存在电磁干扰状态信息时，前置服务器去除存在电磁干扰的电力数据，达到了监控电力数据的目的，从而实现了处理异常电力数据的技术效果，进而解决了由于终端异常造成数据出错，导致数据分析不便的技术问题。
附图说明
此处所说明的附图用来提供对本申请的进一步理解，构成本申请的一部分，本申请的示意性实施例及其说明用于解释本申请，并不构成对本申请的不当限定。在附图中：
图1是根据本申请实施例的一种用于实现异常数据的处理方法的计算机终端(或电子设备)的硬件结构框图；
图2是根据本申请实施例的一种异常数据的处理方法的流程图；
图3是根据本申请实施例的一种更新前置服务器的本地时间的流程图；
图4是根据本申请实施例的一种异常数据的处理装置的结构图。
具体实施方式
为了使本技术领域的人员更好地理解本申请方案，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分的实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都应当属于本申请保护的范围。
需要说明的是，本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
根据本申请实施例，提供了一种异常数据的处理方法实施例，需要说明的是，在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行，并且，虽然在流程图中示出了逻辑顺序，但是在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤。
本申请实施例所提供的异常数据的处理方法实施例可以在移动终端、计算机终端或者类似的运算装置中执行。图1示出了一种用于实现异常数据的处理方法的计算机终端(或电子设备)的硬件结构框图。如图1所示，计算机终端10(或电子设备10)可以包括一个或多个(图中采用102a、102b，……，102n来示出)处理器102(处理器102可以包括但不限于微处理器MCU或可编程逻辑器件FPGA等的处理装置)、用于存储数据的存储器104、以及用于通信功能的传输装置106。除此以外，还可以包括：显示器、输入/输出接口(I/O接口)、通用串行总线(USB)端口(可以作为I/O接口的端口中的一个端口被包括)、网络接口、电源和/或相机。本领域普通技术人员可以理解，图1所示的结构仅为示意，其并不对上述电子装置的结构造成限定。例如，计算机终端10还可包括比图1中所示更多或者更少的组件，或者具有与图1所示不同的配置。
应当注意到的是上述一个或多个处理器102和/或其他数据处理电路在本文中通常可以被称为“数据处理电路”。该数据处理电路可以全部或部分的体现为软件、硬件、固件或其他任意组合。此外，数据处理电路可为单个独立的处理模块，或全部或部分 的结合到计算机终端10(或电子设备)中的其他元件中的任意一个内。如本申请实施例中所涉及到的，该数据处理电路作为一种处理器控制(例如与接口连接的可变电阻终端路径的选择)。
存储器104可用于存储应用软件的软件程序以及模块，如本申请实施例中的异常数据的处理方法对应的程序指令/数据存储装置，处理器102通过运行存储在存储器104内的软件程序以及模块，从而执行各种功能应用以及数据处理，即实现上述的异常数据的处理方法。存储器104可包括高速随机存储器，还可包括非易失性存储器，如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中，存储器104可进一步包括相对于处理器102远程设置的存储器，这些远程存储器可以通过网络连接至计算机终端10。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
传输装置106用于经由一个网络接收或者发送数据。上述的网络具体实例可包括计算机终端10的通信供应商提供的无线网络。在一个实例中，传输装置106包括一个网络适配器(Network Interface Controller，NIC)，其可通过基站与其他网络设备相连从而可与互联网进行通讯。在一个实例中，传输装置106可以为射频(Radio Frequency，RF)模块，其用于通过无线方式与互联网进行通讯。
显示器可以例如触摸屏式的液晶显示器(LCD)，该液晶显示器可使得用户能够与计算机终端10(或电子设备)的用户界面进行交互。
此处需要说明的是，在一些可选实施例中，上述图1所示的计算机设备(或电子设备)可以包括硬件元件(包括电路)、软件元件(包括存储在计算机可读介质上的计算机代码)、或硬件元件和软件元件两者的结合。应当指出的是，图1仅为特定具体实例的一个实例，并且旨在示出可存在于上述计算机设备(或电子设备)中的部件的类型。
在上述运行环境下，本申请实施例提供了如图2所示的异常数据的处理方法。图2是根据本申请实施例的一种异常数据的处理方法的流程图，如图2所示，该方法包括如下步骤：
步骤S202，前置服务器接收终端采集的电力设备上的电力数据，其中，电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；
步骤S204，前置服务器在确定电力数据中的GPS状态为异常的情况下，将采集时间替换为前置服务器的本地时间；
步骤S206，前置服务器在确定电力数据存在电磁干扰状态信息的情况下，从电力数据中去除存在电磁干扰的电力数据。
通过上述步骤，判断电力数据中的GPS状态和电磁干扰状态信息，采用不同的处理方式，在GPS状态的标识为“异常”时，采集时间会出现偏差，则前置服务器使用前置服务器的本地时间替换采集时间，在电力数据存在电磁干扰状态信息时，前置服务器去除存在电磁干扰的电力数据，达到了监控电力数据的目的，从而实现了处理异常电力数据的技术效果，进而解决了由于终端异常造成数据出错，导致数据分析不便的技术问题。
在步骤S202中，终端采集的电力设备上的电力数据至少以文件流或指定协议封装的字节流的形式传输。前置服务器解析得到的原始电力数据还包括以下至少之一：电压、电流、终端编号。由于有多个终端，不同的终端采集不同地方的电力数据，所以每个终端有一个终端编号，终端编号用于区分原始电力数据的来源终端。
在步骤S202中，前置服务器接收终端采集的电力设备上的电力数据之后，方法还包括如下步骤：对电力数据进行分类标记，并将分类标记后的电力数据发送至应用服务器，其中，应用服务器将电力数据存储至与分类标记对应的存储空间中，存储空间为关系数据库中的存储空间，分类标记包括但不限于采集时间、电压、电流、谐波次数中的一种或几种，并且电力数据以分布式存储的方式存储至与分类标记对应的存储空间中。
在将采集时间替换为前置服务器的本地时间之前，如图3所示，还可以执行如下步骤：
步骤S302，前置服务器向应用服务器发送请求消息，请求消息用于向应用服务器请求应用服务器的本地时间；
步骤S304，前置服务器接收应用服务器反馈的应用服务器的本地时间，并比较应用服务器的本地时间和前置服务器的本地时间；
步骤S306，在比较结果指示不一致时，依据应用服务器的本地时间更新前置服务器的本地时间。
在步骤S302至步骤S306中，当比较结果一致时，前置服务器判断采集时间和前置服务器的本地时间是否一致，在判断结果不一致时，将采集时间替换为前置服务器的本地时间。
由于应用服务器主要用于为客户端用户提供访问商业逻辑的途径以供客户端应用程序使用，因此，为了保证采集时间的准确性，需要保证前置服务器的本地时间的准 确性，此时，可以利用前置服务器和应用服务器直接的交互流程对前置服务器的本地时间进行验证，以保证上述电力数据中采集时间的准确性。另外，由于应用服务器往往会直接向应用程序提供相应的服务，因此，应用服务器的时间精度要求往往比前置服务器的时间精度要求高，采用应用服务器的本地时间更新前置服务器的本地时间，也可以使得上述电力数据更加准确。
在步骤S202至步骤S206中，终端上设置有GPS模块，用于采集终端所处环境中的GPS信号，并根据GPS信号确定GPS状态；在终端上设置有电磁干扰传感器，用于采集电磁干扰信号，并根据电磁干扰信号确定电磁干扰状态信息，其中，GPS状态通过第一标识和第二标识指示，第一标识表示GPS状态为正常的情况，第二标识表示GPS状态为异常的情况；电磁干扰状态信息通过第三标识和第四标识指示，第三标识表示电力数据存在电磁干扰，第四标识表示电力数据不存在电磁干扰。
在上述过程中，根据GPS信号确定GPS状态，具体包括如下步骤：当采集到的GPS信号的信噪比大于预设阈值时，确定GPS状态为正常，当采集到的GPS信号的信噪比小于预设阈值时，确定GPS状态为异常。
在步骤S202中，前置服务器接收终端采集的电力设备上的电力数据之后，方法还包括如下步骤：对电力数据进行解析，得到原始电力数据，前置服务器将原始电力数据缓存至缓存中，前置服务器从缓存中提取原始电力数据至前置服务器中的分析模块并进行分析，得到分析结果，并将分析结果传输至应用服务器中，通过调用应用服务器中的关系数据库的接口，将分析结果存入关系数据库中。应用服务器设置有显示窗口，显示窗口用于显示分析结果，同时，显示窗口可以显示终端的在线状态，当终端的状态为“在线”时，即终端处于传输电力数据的状态时，显示窗口显示第一标记，当终端的状态为“离线”时，即终端没有传输电力数据时，显示窗口显示第二标记，其中，第一标记和第二标记通过不同的颜色区分，如第一标记为绿色，第二标记为红色。
在将分析结果存入关系数据库之前，需要执行如下步骤：检测关系数据库的剩余容量，当关系数据库的剩余容量低于第二阈值时，控制关系数据库进行提示，其中，第二阈值为关系数据库的剩余容量与关系数据库的总容量的预设比值，如预设比值为15％或者更低，提示方式包括但不限于声音、图像、邮件、短信中的一种或多种。
在上述过程中，前置服务器对电力数据进行解析得到原始电力数据后，通过将原始电力数据传输至时序库服务器，并通过调用时序库服务器中的时序数据库的接口，将原始电力数据存入时序数据库中，实现对原始电力数据的存储。
在将原始电力数据存入时序数据库之前，需要执行如下步骤：检测时序数据库的 剩余容量，当时序数据库的剩余容量低于第一阈值时，控制时序数据库进行提示，其中，第一阈值为时序数据库的剩余容量与时序数据库的总容量的预设比值，如预设比值为15％或者更低；提示方式包括但不限于声音、图像、邮件、短信中的一种或多种；时序数据库中存储的原始电力数据有保存时间上限，超过保存上限的原始电力数据会被删除，其中，保存上限为七天。
通过5G传输网络可以实现多种终端状态数据的传输，当前置服务器判断出终端传输的电力数据存在异常时，可以对异常的电力数据进行主动处理，该过程不需要人为干预，且可以实时进行，大大提高了系统对抗外部影响的能力。
图4是根据本申请实施例的一种异常数据的处理装置的结构图，如图4所示，该装置包括：
接收模块40，用于前置服务器接收终端采集的电力设备上的电力数据，其中，电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；
替换模块42，用于前置服务器在确定电力数据中的GPS状态为异常的情况下，将采集时间替换为前置服务器的本地时间；其中，所述GPS状态依据GPS信号确定，在所述GPS信号的信噪比小于预设阈值时，确定所述GPS状态为异常；将所述采集时间替换为所述前置服务器的本地时间之前，所述前置服务器用于向应用服务器发送请求消息，所述请求消息用于向所述应用服务器请求所述应用服务器的本地时间；接收所述应用服务器反馈的所述应用服务器的本地时间，并比较所述应用服务器的本地时间和所述前置服务器的本地时间；在比较结果指示不一致时，依据所述应用服务器的本地时间更新所述前置服务器的本地时间；
处理模块44，用于前置服务器在确定电力数据存在电磁干扰状态信息的情况下，从电力数据中去除存在电磁干扰的电力数据。
在本申请的一个实施例中，所述接收模块40、替换模块42、处理模块44分别为组成所述前置服务器的一部分。
在上述异常数据的处理装置的接收模块40中，前置服务器接收终端采集的电力设备上的电力数据之后，将电力数据缓存至缓存中。
在比较结果一致时，前置服务器判断采集时间和前置服务器的本地时间是否一致，在判断结果不一致时，将采集时间替换为前置服务器的本地时间。
在该异常数据的处理装置中，电磁干扰状态信息通过第三标识和第四标识指示，第三标识表示电力数据存在电磁干扰，第四标识表示电力数据不存在电磁干扰。
前置服务器接收终端采集的电力设备上的电力数据之后，对电力数据进行解析， 得到原始电力数据，前置服务器将原始电力数据缓存至缓存中，从缓存中提取原始电力数据至前置服务器中的分析模块并进行分析，得到分析结果，对电力数据对应的分析结果进行分类标记，并将分类标记后的电力数据发送至应用服务器，其中，应用服务器将电力数据存储至与分类标记对应的存储空间中，存储空间为关系数据库中的存储空间。
在本申请的实施例中，所述接收模块40、替换模块42、处理模块44分别可以是具有通信接口能够实现通信协议的一个或多个处理器或者控制器，如有需要还可以包括存储器及相关的接口、系统传输总线等；所述处理器或者控制器执行程序相关的代码实现相应的功能。或者，可替换的方案为，所述接收模块40、替换模块42、处理模块44共享一个集成芯片或者共享处理器、存储器等设备。所述共享的处理器或者芯片执行程序相关的代码实现相应的功能。所述GPS模块为本领域常用的能够采集终端所处环境中的GPS信号的GPS定位器。所述分析模块可以是具有通信接口能够实现通信协议的一个或多个处理器或者控制器，如有需要还可以包括存储器及相关的接口、系统传输总线等；所述处理器或者控制器执行程序相关的代码实现相应的功能。
需要说明的是，图4所示的异常数据的处理装置用于实现图2至图3所示的异常数据的处理方法，因此上述异常数据的处理方法中的相关解释说明也适用于该异常数据的处理装置，此处不再赘述。
本申请实施例还提供了一种非易失性存储介质，该非易失性存储介质包括存储的程序，其中，在程序运行时控制该非易失性存储介质所在设备执行以下异常数据的处理方法：
前置服务器接收终端采集的电力设备上的电力数据，其中，电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；
前置服务器在确定电力数据中的GPS状态为异常的情况下，将采集时间替换为前置服务器的本地时间；其中，所述GPS状态依据GPS信号确定，在所述GPS信号的信噪比小于预设阈值时，确定所述GPS状态为异常；将所述采集时间替换为所述前置服务器的本地时间之前，所述方法还包括：所述前置服务器向应用服务器发送请求消息，所述请求消息用于向所述应用服务器请求所述应用服务器的本地时间；所述前置服务器接收所述应用服务器反馈的所述应用服务器的本地时间，并比较所述应用服务器的本地时间和所述前置服务器的本地时间；在比较结果指示不一致时，依据所述应用服务器的本地时间更新所述前置服务器的本地时间；
前置服务器在确定电力数据存在电磁干扰状态信息的情况下，从电力数据中去除 存在电磁干扰的电力数据。
在比较结果一致时，前置服务器判断采集时间和前置服务器的本地时间是否一致，在判断结果不一致时，将采集时间替换为前置服务器的本地时间。
在该异常数据的处理方法中，前置服务器接收终端采集的电力设备上的电力数据之后，方法还包括如下步骤：对电力数据进行分类标记，并将分类标记后的电力数据发送至应用服务器，其中，应用服务器将电力数据存储至与分类标记对应的存储空间中，存储空间为关系数据库中的存储空间。
其中，该异常数据的处理方法中的电磁干扰状态信息通过第三标识和第四标识指示，第三标识表示电力数据存在电磁干扰，第四标识表示电力数据不存在电磁干扰。
在前置服务器接收终端采集的电力设备上的电力数据之后，将电力数据缓存至缓存中。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。
在本申请的上述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其他实施例的相关描述。
在本申请所提供的几个实施例中，应该理解到，所揭露的技术内容，可通过其它的方式实现。其中，以上所描述的装置实施例仅仅是示意性的，例如所述单元的划分，可以为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，单元或模块的间接耦合或通信连接，可以是电性或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一 台计算机设备(可为个人计算机、服务器或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述仅是本申请的优选实施方式，应当指出，对于本技术领域的普通技术人员来说，在不脱离本申请原理的前提下，还可以做出若干改进和润饰，这些改进和润饰也应视为本申请的保护范围。

Claims (8)

  1. 一种异常数据的处理方法，其特征在于，包括：
    前置服务器接收终端采集的电力设备上的电力数据，其中，所述电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；
    所述前置服务器在确定所述电力数据中的GPS状态为异常的情况下，将所述采集时间替换为前置服务器的本地时间，其中，所述GPS状态依据GPS信号确定，在所述GPS信号的信噪比小于预设阈值时，确定所述GPS状态为异常；将所述采集时间替换为所述前置服务器的本地时间之前，所述方法还包括：所述前置服务器向应用服务器发送请求消息，所述请求消息用于向所述应用服务器请求所述应用服务器的本地时间；所述前置服务器接收所述应用服务器反馈的所述应用服务器的本地时间，并比较所述应用服务器的本地时间和所述前置服务器的本地时间；在比较结果指示不一致时，依据所述应用服务器的本地时间更新所述前置服务器的本地时间；所述前置服务器在确定所述电力数据存在所述电磁干扰状态信息的情况下，从所述电力数据中去除存在电磁干扰的电力数据。
  2. 根据权利要求1所述的方法，其特征在于，在比较结果一致时，所述前置服务器判断所述采集时间和所述前置服务器的本地时间是否一致，在判断结果不一致时，将所述采集时间替换为所述前置服务器的本地时间。
  3. 根据权利要求1所述的方法，其特征在于，所述前置服务器接收终端采集的电力设备上的电力数据之后，所述方法还包括：
    对所述电力数据进行分类标记，并将分类标记后的电力数据发送至应用服务器，其中，所述应用服务器将所述电力数据存储至与所述分类标记对应的存储空间中，所述存储空间为关系数据库中的存储空间。
  4. 根据权利要求1所述的方法，其特征在于，所述电磁干扰状态信息通过第三标识和第四标识指示，所述第三标识表示所述电力数据存在电磁干扰，所述第四标识表示所述电力数据不存在电磁干扰。
  5. 根据权利要求1至4中任意一项所述的方法，其特征在于，所述前置服务器接收终端采集的电力设备上的电力数据之后，包括：将所述电力数据缓存至缓存中。
  6. 一种异常数据的处理装置，其特征在于，包括：
    接收模块，用于前置服务器接收终端采集的电力设备上的电力数据，其中，所述电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；
    替换模块，用于所述前置服务器在确定所述电力数据中的GPS状态为异常的 情况下，将所述采集时间替换为前置服务器的本地时间，其中，所述GPS状态依据GPS信号确定，在所述GPS信号的信噪比小于预设阈值时，确定所述GPS状态为异常；将所述采集时间替换为所述前置服务器的本地时间之前，所述前置服务器用于向应用服务器发送请求消息，所述请求消息用于向所述应用服务器请求所述应用服务器的本地时间；接收所述应用服务器反馈的所述应用服务器的本地时间，并比较所述应用服务器的本地时间和所述前置服务器的本地时间；在比较结果指示不一致时，依据所述应用服务器的本地时间更新所述前置服务器的本地时间；
    处理模块，用于所述前置服务器在确定所述电力数据存在电磁干扰状态信息的情况下，从所述电力数据中去除存在电磁干扰的电力数据。
  7. 一种电子设备，其特征在于，包括：
    存储器，用于存储程序指令；
    处理器，与所述存储器连接，用于执行实现以下功能的程序指令：前置服务器接收终端采集的电力设备上的电力数据，其中，所述电力数据至少包括：GPS状态、电磁干扰状态信息、采集时间；所述前置服务器在确定所述电力数据中的GPS状态为异常的情况下，将所述采集时间替换为前置服务器的本地时间，其中，所述GPS状态依据GPS信号确定，在所述GPS信号的信噪比小于预设阈值时，确定所述GPS状态为异常；将所述采集时间替换为所述前置服务器的本地时间之前，还包括：所述前置服务器向应用服务器发送请求消息，所述请求消息用于向所述应用服务器请求所述应用服务器的本地时间；所述前置服务器接收所述应用服务器反馈的所述应用服务器的本地时间，并比较所述应用服务器的本地时间和所述前置服务器的本地时间；在比较结果指示不一致时，依据所述应用服务器的本地时间更新所述前置服务器的本地时间；利用所述前置服务器和所述应用服务器直接的交互流程对所述前置服务器的本地时间进行验证，以保证所述电力数据中采集时间的准确性；所述前置服务器在确定所述电力数据存在所述电磁干扰状态信息的情况下，从所述电力数据中去除存在电磁干扰的电力数据。
  8. 一种非易失性存储介质，其特征在于，所述非易失性存储介质包括存储的程序，其中，在所述程序运行时控制所述非易失性存储介质所在设备执行权利要求1至5中任意一项所述异常数据的处理方法。
PCT/CN2022/126358 2022-02-07 2022-10-20 异常数据的处理方法、装置及电子设备 WO2023147731A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210115454.8 2022-02-07
CN202210115454.8A CN114138771B (zh) 2022-02-07 2022-02-07 异常数据的处理方法、装置及电子设备

Publications (1)

Publication Number Publication Date
WO2023147731A1 true WO2023147731A1 (zh) 2023-08-10

Family

ID=80381942

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/126358 WO2023147731A1 (zh) 2022-02-07 2022-10-20 异常数据的处理方法、装置及电子设备

Country Status (2)

Country Link
CN (1) CN114138771B (zh)
WO (1) WO2023147731A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114138771B (zh) * 2022-02-07 2022-07-19 国网北京市电力公司 异常数据的处理方法、装置及电子设备
CN117411518B (zh) * 2023-10-17 2024-09-27 北京合众科创科技有限公司 一种电力信息采集方法与系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1368648A (zh) * 2001-02-06 2002-09-11 株式会社日立制作所 位置计算方法、位置计算装置及其程序
CN112269940A (zh) * 2020-11-17 2021-01-26 北京嘀嘀无限科技发展有限公司 数据处理方法及装置
CN113311358A (zh) * 2021-05-12 2021-08-27 国网江苏省电力有限公司无锡供电分公司 基于快速成像的接地网故障监测方法与装置
US20220015679A1 (en) * 2018-12-14 2022-01-20 Heartbeam, Inc. Hand held device for automatic cardiac risk and diagnostic assessment
CN114138771A (zh) * 2022-02-07 2022-03-04 国网北京市电力公司 异常数据的处理方法、装置及电子设备

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103048672B (zh) * 2012-12-13 2015-03-11 上海交通大学 一种多模导航数据融合装置及方法
CN108776357B (zh) * 2018-04-16 2019-10-01 中煤科工集团西安研究院有限公司 沉积地层瞬变电磁法电磁干扰的校正方法及装置
CN110286417A (zh) * 2019-07-11 2019-09-27 湖北联网电力设计有限公司 一种电力系统三维勘测工程支援设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1368648A (zh) * 2001-02-06 2002-09-11 株式会社日立制作所 位置计算方法、位置计算装置及其程序
US20220015679A1 (en) * 2018-12-14 2022-01-20 Heartbeam, Inc. Hand held device for automatic cardiac risk and diagnostic assessment
CN112269940A (zh) * 2020-11-17 2021-01-26 北京嘀嘀无限科技发展有限公司 数据处理方法及装置
CN113311358A (zh) * 2021-05-12 2021-08-27 国网江苏省电力有限公司无锡供电分公司 基于快速成像的接地网故障监测方法与装置
CN114138771A (zh) * 2022-02-07 2022-03-04 国网北京市电力公司 异常数据的处理方法、装置及电子设备

Also Published As

Publication number Publication date
CN114138771A (zh) 2022-03-04
CN114138771B (zh) 2022-07-19

Similar Documents

Publication Publication Date Title
WO2023147731A1 (zh) 异常数据的处理方法、装置及电子设备
CN103117879B (zh) 一种计算机硬件运行参数网络监测系统
CN111475370A (zh) 基于数据中心的运维监控方法、装置、设备及存储介质
CN107094086A (zh) 一种信息获取方法和装置
CN113094325B (zh) 设备部署方法、装置、计算机系统和计算机可读存储介质
CN209311603U (zh) 一种基于互联网电压电流的综合管理报修系统
CN117061335A (zh) 云平台设备健康管控方法、装置、存储介质和电子设备
CN113313280A (zh) 云平台的巡检方法、电子设备及非易失性存储介质
CN112141832A (zh) 一种电梯物联网可视化运营平台
CN111176950A (zh) 一种监控服务器集群的网卡的方法和设备
CN103913150A (zh) 智能电能表电子元器件一致性检测方法
CN112737124B (zh) 一种电力设备监测终端构建方法和装置
CN114460519A (zh) 基于电力互感器检验的现场与终端融合管理系统和方法
US11556120B2 (en) Systems and methods for monitoring performance of a building management system via log streams
WO2020000669A1 (zh) 一种数据编码分析的方法及装置
CN114189480B (zh) 一种流量采样方法、装置、电子设备及介质
CN109494872A (zh) 一种配电终端自注册方法及系统
CN109460194A (zh) 一种存储阵列监控系统及方法
CN211509062U (zh) 一种通信管理机及通信系统
CN113691390A (zh) 一种云端协同的边缘节点报警系统及方法
CN105467914A (zh) 一种环境污染因子监测gprs预警分析传输系统及方法
CN106773894B (zh) 一种数字化spc高精密位移传感多路器及其在线校正和数据传输方法
CN115118754B (zh) 针对电动汽车的远程监控测试系统和监控测试方法
CN103793868A (zh) 一种数据传输方法、装置和系统
CN115032965B (zh) 一种车辆下线检测方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22924658

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE