CN111061752B - Data processing method and device and electronic equipment - Google Patents
Data processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN111061752B CN111061752B CN201911341060.9A CN201911341060A CN111061752B CN 111061752 B CN111061752 B CN 111061752B CN 201911341060 A CN201911341060 A CN 201911341060A CN 111061752 B CN111061752 B CN 111061752B
- Authority
- CN
- China
- Prior art keywords
- target
- measuring point
- acquisition
- data
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 31
- 238000000034 method Methods 0.000 claims abstract description 39
- 238000012545 processing Methods 0.000 claims abstract description 23
- 238000005259 measurement Methods 0.000 claims description 149
- 238000004590 computer program Methods 0.000 claims description 11
- 238000013500 data storage Methods 0.000 abstract description 22
- 230000009286 beneficial effect Effects 0.000 abstract description 5
- 238000005457 optimization Methods 0.000 abstract description 5
- 239000002699 waste material Substances 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 7
- 230000002159 abnormal effect Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000004804 winding Methods 0.000 description 2
- 101100208128 Arabidopsis thaliana TSA1 gene Proteins 0.000 description 1
- 101100208421 Candida albicans (strain SC5314 / ATCC MYA-2876) TMP1 gene Proteins 0.000 description 1
- 102100031437 Cell cycle checkpoint protein RAD1 Human genes 0.000 description 1
- 102100033934 DNA repair protein RAD51 homolog 2 Human genes 0.000 description 1
- 101001130384 Homo sapiens Cell cycle checkpoint protein RAD1 Proteins 0.000 description 1
- 101001132307 Homo sapiens DNA repair protein RAD51 homolog 2 Proteins 0.000 description 1
- 101100182720 Homo sapiens LY6E gene Proteins 0.000 description 1
- 101001049829 Homo sapiens Potassium channel subfamily K member 5 Proteins 0.000 description 1
- 101100201844 Homo sapiens RSPH1 gene Proteins 0.000 description 1
- 102100032131 Lymphocyte antigen 6E Human genes 0.000 description 1
- 102100023202 Potassium channel subfamily K member 5 Human genes 0.000 description 1
- 102100035089 Radial spoke head 1 homolog Human genes 0.000 description 1
- 101100153788 Schizosaccharomyces pombe (strain 972 / ATCC 24843) tpx1 gene Proteins 0.000 description 1
- 101150048440 TSA1 gene Proteins 0.000 description 1
- 101150104676 TSA2 gene Proteins 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000008014 freezing Effects 0.000 description 1
- 238000007710 freezing Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data processing method, a data processing device and electronic equipment, and relates to the technical field of data processing, wherein the method is used for predetermining a collection task of a platform area and measuring points included in the collection task, and distributing a record table for the measuring points; firstly judging whether a target measuring point is in a measuring point storage range or not; the measuring point storage range is used for representing the number of measuring points which can be stored in the area; the target measuring point is one of measuring points of the platform area; and if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a record table corresponding to the target measuring point. Therefore, the technical scheme provided by the embodiment of the invention combines the service and field task use environments to perform data storage optimization processing, efficiently compresses the expenditure of the data storage space, is beneficial to reducing the expenditure of the data storage space, and relieves the problem of serious storage space waste existing in the existing data processing method.
Description
Technical Field
The present invention relates to the field of power devices, and in particular, to a data processing method, a data processing device, and an electronic device.
Background
The existing power equipment terminal still has a large bottleneck on data processing, and particularly the object-oriented acquisition terminal pushed out by the national network is needed to be solved in data processing of big data under the condition of multi-task and multi-data item acquisition.
At present, the data processing method for big data in the prior art mainly creates a storage file according to the acquired data items by fixedly distributing the data storage space, does not distinguish the number of measurement points actually distributed by the power equipment acquisition terminal, and uniformly distributes the space according to the maximum measurement points.
In summary, the existing data processing method has the problem of serious storage space waste.
Disclosure of Invention
Accordingly, the present invention is directed to a data processing method, apparatus and electronic device, so as to solve the problem of serious storage space waste in the existing data processing method, and reduce the cost of data storage space.
In a first aspect, an embodiment of the present invention provides a data processing method, which determines an acquisition task of a platform area and measurement points included in the acquisition task in advance, and allocates a record table for the measurement points; the method comprises the following steps:
judging whether the target measuring point is in the measuring point storage range; the measuring point storage range is used for representing the number of measuring points which can be stored in the platform area; wherein the target measurement point is one of the measurement points of the station area;
and if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a record table corresponding to the target measuring point.
With reference to the first aspect, the embodiment of the present invention provides a first possible implementation manner of the first aspect, where the method further includes:
if the target measuring point is not in the measuring point storage range, determining an acquisition task corresponding to the target measuring point;
and deleting the data of all the measurement points in the acquisition task corresponding to the target measurement point.
With reference to the first aspect, the embodiment of the present invention provides a first possible implementation manner of the first aspect, where the method further includes: collecting data items OAD for targets of target measurement points;
judging whether the target acquisition data item OAD is in the recording capacity range of a recording table corresponding to a target measurement point;
and if the target acquisition data item OAD is not in the recording capacity range of the recording table corresponding to the target measurement point, deleting one acquisition data item OAD recorded earliest in the recording table corresponding to the target measurement point, and writing the target acquisition data item OAD into the recording table.
With reference to the second possible implementation manner of the first aspect, the embodiment of the present invention provides a third possible implementation manner of the first aspect, where the method further includes:
and if the target acquisition data item OAD is in the recording capacity range of the recording table corresponding to the target measurement point, writing the target acquisition data item OAD into the recording table.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where the steps of determining, in advance, an acquisition task of a platform area and a measurement point included in the acquisition task, and allocating a record table to the measurement point include:
creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs;
creating a record table of the measurement points; the record table is used for recording the collected data item OAD of the measuring point;
the record table is correspondingly associated with the measurement point.
With reference to the fourth possible implementation manner of the first aspect, the embodiment of the present invention provides a fifth possible implementation manner of the first aspect, wherein the keywords include an acquisition time stamp, a measurement point, and an acquisition data item OAD.
With reference to the first aspect, an embodiment of the present invention provides a sixth possible implementation manner of the first aspect, where each measurement point carries a number identifier, and the step of determining whether the target measurement point is within a storage range of the measurement point includes:
and judging whether the target measuring point is in a measuring point storage range or not based on the number identification of the target measuring points.
In a second aspect, an embodiment of the present invention further provides a data processing apparatus, including:
the method comprises the steps of presetting an acquisition task of a platform area and measurement points included in the acquisition task, wherein the device comprises the following steps:
the judging module is used for judging whether the target measuring point is in the measuring point storage range; the measuring point storage range is used for representing the number of measuring points which can be stored in the platform area; wherein the target measurement point is one of the measurement points of the station area;
and the storage module is used for storing the acquired data of the target measuring point into a record table corresponding to the target measuring point if the target measuring point is in the measuring point storage range.
With reference to the second aspect, an embodiment of the present invention provides a first possible implementation manner of the second aspect, where the apparatus further includes:
the determining module is used for determining an acquisition task corresponding to the target measuring point when the target measuring point is not in the measuring point storage range;
and the deleting module is used for deleting the data of all the measuring points in the acquisition task corresponding to the target measuring point.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements the steps of the data processing method described above when executing the computer program.
In a fourth aspect, embodiments of the present invention also provide a computer readable storage medium having a computer program stored thereon, which when executed by a processor performs the steps of the data processing method described above.
The embodiment of the invention has the following beneficial effects: the data processing method, the data processing device, the electronic equipment and the computer readable storage medium provided by the embodiment of the invention are used for presetting an acquisition task of a platform area and measuring points included in the acquisition task and distributing a record table for the measuring points; firstly judging whether the target measuring point is in a measuring point storage range or not; wherein the measurement point storage range is used for characterizing the number of measurement points that can be stored by the area; the target measuring point is one of the measuring points of the platform area; and if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a record table corresponding to the target measuring point. Therefore, the technical scheme provided by the embodiment of the invention combines the service and field task use environments to perform data storage optimization processing, efficiently compresses the expenditure of the data storage space, is beneficial to reducing the expenditure of the data storage space, and relieves the problem of serious storage space waste existing in the existing data processing method.
In order to make the above objects, features and advantages of the present invention more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a data processing method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating another data processing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a first flow chart of a data processing method according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
At present, two data processing methods aiming at big data in the prior art mainly exist, one method is to fixedly allocate data storage space, create a storage file according to collected data items, not distinguish the number of measurement points actually allocated by a power equipment collection terminal, and uniformly allocate space according to the maximum measurement points; the method has the advantages that the key word retrieval information of the data storage is clear, the designated table records can be deleted conveniently later, but certain defects exist at the same time, namely, when the same data item OAD is acquired by multiple tasks, multiple records exist, and ambiguity such as data repetition exists for the data retrieval block. Meanwhile, under the condition that the number of measurement points is changed, when the data storage is wound, storage coverage update is incomplete or coverage exceeds a plurality of records, but the number of measurement point records is reserved, so that data retrieval abnormality is generated.
Based on the above, the data processing method, the data processing device and the electronic equipment provided by the embodiment of the invention combine the service and the field task use environment to perform data storage optimization processing, efficiently compress the expenditure of the data storage space, are beneficial to reducing the expenditure of the data storage space, and solve the problem that the storage space is seriously wasted in the existing data processing method. Meanwhile, a judging mechanism under abnormal data storage is added, so that efficient and stable data storage is truly realized, and the acquisition of external normal acquisition of power equipment terminal data is facilitated.
For the sake of understanding the present embodiment, a data processing method disclosed in the present embodiment is first described in detail.
Embodiment one:
the embodiment of the invention provides a data processing method, which is applied to the field of power station area acquisition and is executed by electronic equipment in the corresponding field, wherein the electronic equipment can be, for example, a power equipment acquisition terminal, a processing terminal, a controller of the acquisition terminal or a controller of the processing terminal.
Specifically, as shown in fig. 1, the method predetermines an acquisition task of a platform area and measurement points included in the acquisition task, and allocates a record table for the measurement points; the method comprises the following steps:
step S102, judging whether a target measuring point is in a measuring point storage range;
wherein the measurement point storage range is used for representing the number of measurement points which can be stored in the platform area; the target measurement point is one of measurement points of the station area.
Step S104, if the target measuring point is within the measuring point storage range, the acquired data of the target measuring point is stored in a record table corresponding to the target measuring point.
The acquisition data here comprise, among other things, acquisition data items OAD.
It should be noted that each collection task may include one or more measurement points, and the correspondence between the collection tasks and the measurement points may be set according to the field requirements; the record list of all the measuring points of each task shares a task file; the tasks are independent from each other.
In an alternative embodiment, the acquisition task of the area and the measurement points included in the acquisition task are predetermined, and may be implemented by the following steps: the acquisition tasks of the area are determined according to the acquisition data scheme (also called service or service type and the measurement points allocated for each acquisition task are determined.
In an alternative embodiment, the step of predetermining an acquisition task of a platform area and measurement points included in the acquisition task, and allocating a record table to the measurement points includes:
1. creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs;
wherein, the services include real-time services, frozen services, event services and the like; the service identity may be a service name, which may be, for example, numeric, textual, alphabetical, or a combination thereof, to characterize the service; of course, the service identifier may also be represented in other manners or combinations, which are not particularly limited herein.
In an alternative embodiment, the keywords include acquisition time stamp, measurement point, and acquisition data item OAD.
In an alternative embodiment, the step of creating a data file of the acquisition task is performed mainly by:
a, data file creation is carried out according to acquisition TASKs (TASK 1, TASK2 … and TASKn), when the data file is created, an acquisition data scheme (real-time service, freezing service, event service and the like) is required to be specified, and keywords cover acquisition time marks (success, starting and storage), measurement points TSA and acquisition data items OAD;
specifically, the service identifier may be embodied on the naming of the data file; the keywords may then be embodied in subfiles or file content of the data file; the data file can be a folder or a file; when the data file may be a folder, the key may be a subfile under the folder; while the data file may be a file (e.g., excel file), the keywords may be subfiles of the file (e.g., sheet worksheets);
2. creating a record table of the measurement points; the record table is used for recording the collected data item OAD of the measuring point; the OAD here is an abbreviation for object attribute descriptor (Object Attribute Descriptor). Reference may be made to the prior art for its meaning and no further description is given here.
When creating the record table of the measuring points, the record table can be directly created in the data file; the record table may also be created and later transferred (copied, cut or mirrored) into the data file.
3. The record table is correspondingly associated with the measurement point.
Each measuring point corresponds to a record table, and the record tables of all measuring points of each task share a task file; for example, each measurement point TSA1, TSA2 …, TSAn corresponds to a record table REC1, REC2 …, RECn, respectively, each record table containing all the acquisition data items OAD data of the task acquisition scheme, and finally all the records are linked together.
In an alternative embodiment, the record tables of each measuring point are independent, that is, the creation of each record table is independent of any record table, and the file size is dynamically allocated without being limited by the number of the measuring points of the platform area.
In an alternative embodiment, each collection task is mutually independent, that is, each collection task TASKn covers all record tables RECn under the task, is spliced in a task file, is not affected by other tasks, and is not affected by the depth of a collection data scheme (service).
In an alternative embodiment, each measuring point carries a quantity identifier, and the quantity identifier is used for conveniently counting, identifying and judging the measuring points; the number identifier may be, for example, a serial number or a label expressed in the form of a number (a subscript number or a superscript number, or may be, specifically, a number identifier may be allocated to each measurement point when the measurement point is included in the acquisition task;
at this time, the above-mentioned step S102 of determining whether the target measurement point is within the measurement point storage range may be performed by:
1) And judging whether the target measuring point is in a measuring point storage range or not based on the number identification of the target measuring points.
Wherein a measurement point storage range is used to characterize the number of measurement points that the region is capable of fixed spatial storage, e.g. 100;
specifically, comparing the number identification of the target measurement points with a measurement point storage threshold to generate a comparison result, and judging whether the target measurement points are in a measurement point storage range according to the comparison result, for example, judging that the number identification of the target measurement points is in the measurement point storage threshold if the comparison result indicates that the number identification of the target measurement points is in the measurement point storage range, otherwise, judging that the target measurement points are not in the measurement point storage range.
The data processing method provided by the embodiment of the invention comprises the steps of presetting an acquisition task of a platform area and measuring points included in the acquisition task, and distributing a record table for the measuring points; firstly judging whether the target measuring point is in a measuring point storage range or not; wherein the measurement point storage range is used for characterizing the number of measurement points that can be stored by the area; the target measuring point is one of the measuring points of the platform area; and if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a record table corresponding to the target measuring point. Compared with the scheme in the prior art, the method combines service and field task use environments to perform data storage optimization processing, efficiently compresses the expenditure of the data storage space, is beneficial to reducing the expenditure of the data storage space, and relieves the problem that the storage space is seriously wasted in the existing data processing method.
Embodiment two:
referring to fig. 2, another data processing method is provided in an embodiment of the present invention, where an acquisition task of a station area and measurement points included in the acquisition task are predetermined, and a record table is allocated to the measurement points, and the method includes:
step S202, judging whether a target measuring point is in a measuring point storage range;
wherein the measurement point storage range is used for characterizing the number of measurement points that the station area can store; the target measurement point is one of measurement points of the platform area;
step S204, if the target measuring point is within the measuring point storage range, the acquired data of the target measuring point is stored in a record table corresponding to the target measuring point.
Through step S204, when the target measurement point is not within the measurement point storage range, the storage space is fixed at this time, and dynamic allocation is not performed, so that an acceptable space is adopted to replace efficient and stable search conditions; i.e. facilitate data retrieval and viewing.
Step S206, if the target measuring point is not in the measuring point storage range, determining an acquisition task corresponding to the target measuring point; and deleting the data of all the measurement points in the acquisition task corresponding to the target measurement point.
For step S206, specifically, when the target measurement point is not within the measurement point storage range, deleting the data of all measurement points in the data file corresponding to the acquisition task by determining the acquisition task corresponding to the target measurement point, where the data of all measurement points in the data file corresponding to the acquisition task includes the record table corresponding to the measurement point and the acquired data item OAD recorded therein.
Through step S206, the problem of abnormal data retrieval caused by insufficient coverage points is avoided.
In the data processing method provided by the embodiment of the invention, when a measuring point is changed, for example, the measuring point of a station area is increased, a fixed value (namely, in the storage range of the measuring point) is referred to, namely, in the range of a certain measuring point (Pn_Min-Pn_Max), the storage space is fixed, the dynamic allocation is not executed, and an acceptable space is adopted to replace an efficient and stable searching condition; if the measurement points are out of the (Pn_Min-Pn_Max) range, deleting the data of all the measurement points (all the measurement points included in the acquisition task) corresponding to the acquisition task according to the acquisition task corresponding to the changed measurement points, so as to avoid abnormal data retrieval caused by incomplete coverage points.
Considering the case of how data is stored with limited recording space for each recording table, referring to fig. 3, in an alternative embodiment, for a target acquisition data item OAD of a target measurement point, the method further comprises:
step S302, judging whether the target acquisition data item OAD is in the recording capacity range of a recording table corresponding to the target measurement point;
the target acquisition data item OAD may be understood as one of acquisition data items OAD obtained by acquiring data of a target measurement point; the acquisition data item OAD may include acquisition time, data content, time sent to a record table, time stored to a record table, and so forth.
The above capacity range is understood to be the number of collected data items OAD that can be stored in the record table, and is understood to be the size of bytes that can be stored in the record table.
In step S304, if the target acquisition data item OAD is not within the recording capacity range of the recording table corresponding to the target measurement point, deleting the earliest recorded acquisition data item OAD in the recording table corresponding to the target measurement point, and writing the target acquisition data item OAD into the recording table.
Through step S304, if the storage depth is full, i.e. the tail winding starts, the method rolls back to the earliest record, performs coverage filling according to the fixed area, records the latest storage time point, and clears the current depth history record.
In step S306, if the target acquisition data item OAD is within the recording capacity range of the recording table corresponding to the target measurement point, the target acquisition data item OAD is written into the recording table.
Specifically, the recording table records data in chronological order, and thus, writing the target acquisition data item OAD into the recording table herein means writing the target acquisition data item OAD into the recording table before (the one with the nearest acquisition time) behind the acquisition data item OAD, and recording the latest storage time point.
According to the data processing method provided by the embodiment of the invention, the data storage optimization processing is performed by combining the service and the field task use environment, so that the expenditure of the data storage space is efficiently compressed, the judgment mechanism under the abnormal data storage is introduced, the data is really stored efficiently and stably, and the acquisition of the terminal data of the power equipment is conveniently and normally acquired from the outside.
Compared with the traditional storage method, the method has the following advantages:
1. the fixed storage and the dynamic storage are switched, the acquisition and storage efficiency of the power equipment terminal is improved, the space expenditure is saved, and the retrieval data is stable and reliable;
2. the data retrieval is convenient, the specified collection data item OAD can be retrieved according to the specified measurement point TSA, and the corresponding collection data item OAD record can be cleared according to the specified measurement point TSA;
3. under the tail winding condition, a self-maintenance mechanism is provided, so that abnormal data generation (such as data mutation or empty search) can be avoided;
4. under the condition of multitasking multiple OAD reading, the storage of each check data item can be ensured.
Embodiment III:
referring to fig. 4, an embodiment of the present invention provides a data processing apparatus, which predetermines an acquisition task of a station area and a measurement point included in the acquisition task, the apparatus includes:
a judging module 401, configured to judge whether the target measurement point is within a measurement point storage range; the measuring point storage range is used for representing the number of measuring points which can be stored in the platform area; wherein the target measurement point is one of the measurement points of the station area;
and the storage module 402 is configured to store the acquired data of the target measurement point into a record table corresponding to the target measurement point if the target measurement point is within the measurement point storage range.
In an alternative embodiment, the apparatus further comprises:
a determining module 403, configured to determine an acquisition task corresponding to the target measurement point when the target measurement point is not within the measurement point storage range;
and the deleting module 404 is configured to delete data of all measurement points in the acquisition task corresponding to the target measurement point.
In an alternative embodiment, the determining module 401 is further configured to collect the data item OAD for the target of the target measurement point; judging whether the target acquisition data item OAD is in the recording capacity range of a recording table corresponding to a target measurement point; if the target acquisition data item OAD is not in the recording capacity range of the recording table corresponding to the target measurement point, deleting one acquisition data item OAD recorded earliest in the recording table corresponding to the target measurement point, and writing the target acquisition data item OAD into the recording table;
in an alternative embodiment, the determining module 401 is further configured to write the target acquisition data item OAD into the recording table if the target acquisition data item OAD is within a recording capacity range of the recording table corresponding to the target measurement point.
In an alternative embodiment, when determining the acquisition task of the platform area and the measurement points included in the acquisition task in advance and allocating a record table to the measurement points, the method includes: creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs; creating a record table of the measurement points; the record table is used for recording the collected data item OAD of the measuring point; the record table is correspondingly associated with the measurement point.
In an alternative embodiment, the keywords described above include acquisition time stamp, measurement point, and acquisition data item OAD.
In an alternative embodiment, each measurement point carries a number identifier, and the determining module 401 is configured to determine, when determining whether the target measurement point is within the measurement point storage range, whether the target measurement point is within the measurement point storage range based on the number identifier of the target measurement point.
It will be clear to those skilled in the art that, for convenience and brevity of description, reference may be made to the corresponding process in the foregoing method embodiment for the specific working process of the apparatus described above, which is not described herein again.
The data processing device provided by the embodiment of the invention has the same technical characteristics as the data processing method provided by the embodiment, so that the same technical problems can be solved, and the same technical effects can be achieved.
Any particular values in all examples shown and described herein are to be construed as merely illustrative and not a limitation, and thus other examples of exemplary embodiments may have different values.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The embodiment of the invention also provides electronic equipment, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the steps of the method when executing the computer program.
Referring to fig. 5, an electronic device 500 according to an embodiment of the present invention includes: a processor 50, a memory 51, a bus 52 and a communication interface 53, the processor 50, the communication interface 53 and the memory 51 being connected by the bus 52; the processor 50 is arranged to execute executable modules, such as computer programs, stored in the memory 51.
The memory 51 may include a high-speed random access memory (RAM, random Access Memory), and may further include a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory. The communication connection between the system network element and at least one other network element is achieved via at least one communication interface 53 (which may be wired or wireless), and the internet, wide area network, local network, metropolitan area network, etc. may be used.
Bus 52 may be an ISA bus, a PCI bus, an EISA bus, or the like. The buses may be classified as address buses, data buses, control buses, etc. For ease of illustration, only one bi-directional arrow is shown in FIG. 5, but not only one bus or type of bus.
The memory 51 is configured to store a program, and the processor 50 executes the program after receiving an execution instruction, and the method executed by the apparatus for flow defining disclosed in any of the foregoing embodiments of the present invention may be applied to the processor 50 or implemented by the processor 50.
The processor 50 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuitry in hardware in the processor 50 or by instructions in the form of software. The processor 50 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but may also be a digital signal processor (Digital Signal Processing, DSP for short), application specific integrated circuit (Application Specific Integrated Circuit, ASIC for short), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA for short), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be embodied directly in the execution of a hardware decoding processor, or in the execution of a combination of hardware and software modules in a decoding processor. The software modules may be located in a random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in a memory 51 and the processor 50 reads the information in the memory 51 and in combination with its hardware performs the steps of the above method.
Embodiments of the present invention also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the data processing method.
The computer program product for performing the data processing method according to the embodiment of the present invention includes a computer readable storage medium storing a non-volatile program code executable by a processor, where the program code includes instructions for performing the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment and will not be described herein.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer readable storage medium executable by a processor. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Finally, it should be noted that: the above examples are only specific embodiments of the present invention, and are not intended to limit the scope of the present invention, but it should be understood by those skilled in the art that the present invention is not limited thereto, and that the present invention is described in detail with reference to the foregoing examples: any person skilled in the art may modify or easily conceive of the technical solution described in the foregoing embodiments, or perform equivalent substitution of some of the technical features, while remaining within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (7)
1. The data processing method is characterized by comprising the steps of presetting an acquisition task of a platform area and measuring points included in the acquisition task, and distributing a record table for the measuring points; the method comprises the following steps:
judging whether the target measuring point is in the measuring point storage range; wherein the measurement point storage range is used for characterizing the number of measurement points that the station area can store; the target measurement point is one of measurement points of the platform area;
if the target measuring point is within the measuring point threshold range, storing the acquired data of the target measuring point into a record table corresponding to the target measuring point;
if the target measuring point is not in the measuring point storage range, determining an acquisition task corresponding to the target measuring point; deleting the data of all the measurement points in the acquisition task corresponding to the target measurement point;
the step of determining the acquisition task of the platform area and the measurement points included in the acquisition task in advance and distributing a record table for the measurement points comprises the following steps:
creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs;
creating a record table of the measurement points; the record table is used for recording the collected data item OAD of the measuring point;
the record table is correspondingly associated with the measurement point.
2. The method according to claim 1, wherein the method further comprises:
collecting data items OAD for targets of target measurement points;
judging whether the target acquisition data item OAD is in the recording capacity range of a recording table corresponding to a target measurement point;
and if the target acquisition data item OAD is not in the recording capacity range of the recording table corresponding to the target measurement point, deleting one acquisition data item OAD recorded earliest in the recording table corresponding to the target measurement point, and writing the target acquisition data item OAD into the recording table.
3. The method according to claim 2, wherein the method further comprises:
and if the target acquisition data item OAD is in the recording capacity range of the recording table corresponding to the target measurement point, writing the target acquisition data item OAD into the recording table.
4. The method according to claim 1, wherein the keywords comprise acquisition time scale, measurement points and acquisition data item OAD.
5. The method of claim 1, wherein each measurement point carries a quantity identifier, and wherein the step of determining whether the target measurement point is within a measurement point storage range comprises:
and judging whether the target measuring point is in a measuring point storage range or not based on the number identification of the target measuring points.
6. A data processing apparatus for predetermining an acquisition task of a station area and measurement points included in the acquisition task, and assigning a record table to the measurement points, the apparatus comprising:
the judging module is used for judging whether the target measuring point is in the measuring point storage range; the measuring point storage range is used for representing the number of measuring points which can be stored in the platform area; wherein the target measurement point is one of the measurement points of the station area;
the storage module is used for storing the acquired data of the target measuring point into a record table corresponding to the target measuring point if the target measuring point is within the measuring point threshold range;
the determining module is used for determining an acquisition task corresponding to the target measuring point when the target measuring point is not in the measuring point storage range;
the deleting module is used for deleting the data of all the measuring points in the acquisition task corresponding to the target measuring point;
the acquisition task of the predetermined area and the measurement point included in the acquisition task include:
creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs;
creating a record table of the measurement points; the record table is used for recording the collected data item OAD of the measuring point;
the record table is correspondingly associated with the measurement point.
7. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method of any of the preceding claims 1 to 5 when the computer program is executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911341060.9A CN111061752B (en) | 2019-12-23 | 2019-12-23 | Data processing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911341060.9A CN111061752B (en) | 2019-12-23 | 2019-12-23 | Data processing method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111061752A CN111061752A (en) | 2020-04-24 |
| CN111061752B true CN111061752B (en) | 2023-12-08 |
Family
ID=70302552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911341060.9A Active CN111061752B (en) | 2019-12-23 | 2019-12-23 | Data processing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111061752B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112084147A (en) * | 2020-09-10 | 2020-12-15 | 珠海美佳音科技有限公司 | Data storage method, data acquisition recorder and electronic equipment |
| CN112256697A (en) * | 2020-10-14 | 2021-01-22 | 宁波三星医疗电气股份有限公司 | Method for managing data of power acquisition terminal |
| CN112947326B (en) * | 2021-01-28 | 2022-09-06 | 深圳市科陆电子科技股份有限公司 | Fuzzy flexible platform power supply quality data processing method and device and storage medium |
| CN116630091B (en) * | 2023-07-20 | 2023-10-13 | 赛维斯智慧环境科技(山东)有限公司 | Industrial real-time data linkage analysis system |
| CN117389486B (en) * | 2023-12-13 | 2024-04-19 | 浙江国利信安科技有限公司 | Method, computing device and storage medium for real-time processing EPA network data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105656029A (en) * | 2016-01-26 | 2016-06-08 | 国网山东省电力公司青岛供电公司 | Method and device for determining load points outside power supply radius of low-voltage power supply region |
| CN106373372A (en) * | 2016-08-30 | 2017-02-01 | 成都博高信息技术股份有限公司 | Method and system for remotely reading meters |
| CN107908728A (en) * | 2017-11-14 | 2018-04-13 | 广东电网有限责任公司电力科学研究院 | A kind of storage of online monitoring data history value and access method |
| CN107957904A (en) * | 2017-11-21 | 2018-04-24 | 积成电子股份有限公司 | The power information acquisition tasks management method of exchange agreement based on object-oriented |
| CN109614447A (en) * | 2018-10-15 | 2019-04-12 | 国网新疆电力有限公司阿克苏供电公司 | A kind of intelligent electric meter divides the storage method, querying method and device of freezing data |
-
2019
- 2019-12-23 CN CN201911341060.9A patent/CN111061752B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105656029A (en) * | 2016-01-26 | 2016-06-08 | 国网山东省电力公司青岛供电公司 | Method and device for determining load points outside power supply radius of low-voltage power supply region |
| CN106373372A (en) * | 2016-08-30 | 2017-02-01 | 成都博高信息技术股份有限公司 | Method and system for remotely reading meters |
| CN107908728A (en) * | 2017-11-14 | 2018-04-13 | 广东电网有限责任公司电力科学研究院 | A kind of storage of online monitoring data history value and access method |
| CN107957904A (en) * | 2017-11-21 | 2018-04-24 | 积成电子股份有限公司 | The power information acquisition tasks management method of exchange agreement based on object-oriented |
| CN109614447A (en) * | 2018-10-15 | 2019-04-12 | 国网新疆电力有限公司阿克苏供电公司 | A kind of intelligent electric meter divides the storage method, querying method and device of freezing data |
Non-Patent Citations (3)
| Title |
|---|
| 郭文生 ; 韦万寿 ; 李斌 ; 呼松鹤 ; .配电台区温度远程监测系统的开发及应用.中国新技术新产品.2015,(01),全文. * |
| 配电台区温度远程监测系统的开发及应用;郭文生;韦万寿;李斌;呼松鹤;;中国新技术新产品(第01期);全文 * |
| 面向对象的数据交换协议研究与应用;郑安刚;巫钟兴;张乐群;;电测与仪表(24);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111061752A (en) | 2020-04-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111061752B (en) | Data processing method and device and electronic equipment | |
| CN111813756B (en) | Log retrieval system, method and device, electronic equipment and storage medium | |
| CN106294352B (en) | A kind of document handling method, device and file system | |
| CN110109868B (en) | Method, apparatus and computer program product for indexing files | |
| EP3788505B1 (en) | Storing data items and identifying stored data items | |
| US9280551B2 (en) | De-duplication deployment planning | |
| CN109240607B (en) | File reading method and device | |
| CN113568582B (en) | Data management method, device and storage equipment | |
| CN110825694A (en) | Data processing method, device, equipment and storage medium | |
| CN108304259B (en) | Memory management method and system | |
| CN113157600A (en) | Space allocation method of shingled hard disk, file storage system and server | |
| CN107229421B (en) | Method and device for creating video data storage system, method and device for writing file into video data storage system and method and device for reading video data storage system | |
| CN104077082A (en) | Network voting data storage method and device | |
| CN114676130A (en) | Time series data storage method, computing equipment and storage medium | |
| CN112433888A (en) | Data processing method and device, storage medium and electronic equipment | |
| CN116643704A (en) | Storage management method, storage management device, electronic equipment and storage medium | |
| CN109165305B (en) | Characteristic value storage and retrieval method and device | |
| CN116700623A (en) | Data storage method, system, electronic equipment and storage medium | |
| CN102902731B (en) | The storage method of mail index | |
| CN112380174B (en) | XFS file system analysis method containing deleted files, terminal device and storage medium | |
| CN113434492A (en) | Data detection method and device, storage medium and electronic device | |
| CN114416731A (en) | Data storage method, data reading method, data storage device, electronic device and medium | |
| CN112416699A (en) | Index data collection method and system | |
| CN106959888B (en) | Task processing method and device in cloud storage system | |
| CN116662603B (en) | Time shaft control method and system based on kafka, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |