CN114092043A - Data management platform, method, apparatus, and computer-readable storage medium - Google Patents
Data management platform, method, apparatus, and computer-readable storage medium Download PDFInfo
- Publication number
- CN114092043A CN114092043A CN202111321667.8A CN202111321667A CN114092043A CN 114092043 A CN114092043 A CN 114092043A CN 202111321667 A CN202111321667 A CN 202111321667A CN 114092043 A CN114092043 A CN 114092043A
- Authority
- CN
- China
- Prior art keywords
- data
- classification
- module
- identifier
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013523 data management Methods 0.000 title claims abstract description 108
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000012545 processing Methods 0.000 claims abstract description 159
- 230000008569 process Effects 0.000 claims abstract description 22
- 238000004590 computer program Methods 0.000 claims description 14
- 238000012795 verification Methods 0.000 claims description 14
- 238000007726 management method Methods 0.000 claims description 5
- 239000002699 waste material Substances 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 19
- 238000004364 calculation method Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000007792 addition Methods 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000013475 authorization Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000003754 machining Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Strategic Management (AREA)
- Human Resources & Organizations (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- Computational Linguistics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Mathematical Physics (AREA)
- Fuzzy Systems (AREA)
- Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Storage Device Security (AREA)
Abstract
本发明实施例提供了一种数据管理平台、方法、设备及计算机可读存储介质。能够基于用户的第一数据请求进行判断，在判断出不包含第一数据请求对应的第一分类的情况下，根据第一数据请求中的第一数据分类标识建立第一分类。然后在第一分类下根据第一数据请求中的第二数据标识对应的第二数据和数据处理规则进行计算得到第一数据。由此，由于对用户的请求进行了判断，在不包含第一分类的情况下，再进行第一分类的创建，避免了对分类的重复建立，减少了资源的浪费。并且由于是采用数据管理品台对不同用户的请求进行统一的处理，所以防止了不同用户对数据的重复复制和下载而造成的数据的冗余，整体上提高了数据处理的效率。
Embodiments of the present invention provide a data management platform, method, device, and computer-readable storage medium. The judgment can be made based on the first data request of the user, and in the case that it is judged that the first classification corresponding to the first data request is not included, the first classification is established according to the first data classification identifier in the first data request. Then, the first data is obtained by calculating according to the second data corresponding to the second data identifier in the first data request and the data processing rule under the first classification. Therefore, since the user's request is judged, the first category is created when the first category is not included, which avoids the repeated establishment of categories and reduces the waste of resources. And because the data management platform is used to process the requests of different users uniformly, the redundancy of data caused by repeated duplication and downloading of data by different users is prevented, and the efficiency of data processing is improved as a whole.
Description
Technical Field
The present application relates to the field of data processing, and in particular, to a data management platform, method, device, and computer-readable storage medium.
Background
In the current society, the importance of data is becoming higher and higher. In order to make better use of the data, different users often need to acquire a large amount of data and process the data. However, since the different branches of the same user do not communicate with each other, the following problems are caused:
(1) when different branches of the same user process based on the same data, the same data often needs to be downloaded and copied, resulting in redundancy of a large amount of data.
(2) Different branches of the same user often have the same data processing requirements, so that repeated processing of data is caused, and resource waste is caused.
Disclosure of Invention
Embodiments of the present application provide a data management platform, a method, a device, and a computer-readable storage medium, which can avoid data redundancy, reduce resource waste, and improve data processing efficiency.
In a first aspect, an embodiment of the present application provides a data management platform, where the platform includes:
the data management interface is used for responding to the input of a user, generating a first data request and sending the first data request to the approval module; the first data request comprises a first data classification identifier, a second data identifier and a first data processing rule;
the approval module is used for sending the first data request to the classification module under the condition that the first data classification identifier is judged not to be contained;
the classification module is used for establishing a first classification according to a first data classification identifier in the first data request and sending the identifier of the first classification, a second data identifier and a first data processing rule to the processing module;
the processing module is used for acquiring second data according to the second data processing identifier under the first classification corresponding to the first classification identifier and processing the second data according to a first data processing rule to obtain first data; the first data is sent to a classification module for the classification module to store the first data, the second data identification, and the first data processing rule under a first classification.
In an optional implementation manner, the approval module is further configured to send the first data classification identifier to the classification module when it is determined that the identifier includes the first data classification identifier;
the classification module is further configured to obtain a first classification corresponding to the first data classification identifier, and send the first data in the first classification to the data management interface when the first classification contains the first data, so that the data management interface displays the first data.
In an optional embodiment, the classification module is further configured to send, to the processing module, the second data identifier and the first data processing rule stored in the first classification in a case that the first classification does not contain the first data;
the processing module is further used for acquiring second data according to the second data processing identifier under the first classification, and processing the second data according to the first data processing rule to obtain first data;
the first data is sent to the classification module for the classification module to store the first data under the first classification.
In an optional implementation manner, the data indexing module is configured to obtain second data according to the second data identifier sent by the classification module, and send the second data to the classification module.
In an optional implementation manner, the data management interface is further configured to obtain a processing progress of the first data, and display the processing progress.
In an optional embodiment, the platform further comprises: the authority management module is used for acquiring an authority verification request of a user and verifying the authority of the user;
and the data management interface is specifically used for responding to the input of the user to generate a first data request and sending the first data request to the approval module under the condition that the authority verification is passed.
In a second aspect, an embodiment of the present application provides a data management method, where the method includes: acquiring a first data request of a user, wherein the first data request comprises a first data classification identifier, a second data identifier and a first data processing rule;
under the condition that the first data classification identification is judged not to be contained, establishing a first classification according to the first data classification identification;
under the first classification, processing second data corresponding to the second data identification according to a first data processing rule to obtain first data;
the first data, the second data identification, and the first data processing rule are stored to the first classification.
In an optional implementation manner, under the condition that the first data classification identifier is judged to be contained, acquiring a first classification;
when the first data is included in the first classification, the first data in the first classification is displayed.
In a third aspect, an embodiment of the present application provides a data management device, where the device includes: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, performs the method of data management as in the second aspect or any of the alternative embodiments of the second aspect.
In a fourth aspect, the present application provides a readable storage medium, on which computer program instructions are stored, and when executed by a processor, the computer program instructions implement the data management method as in the second aspect or any optional embodiment of the second aspect.
Compared with the prior art, the application has at least the following beneficial effects:
the data management platform, the data management method, the data management device and the computer-readable storage medium can perform judgment based on a first data request of a user, and establish a first classification according to a first data classification identifier in the first data request under the condition that the first classification corresponding to the first data request is not included. And then, under the first classification, calculating according to second data corresponding to the second data identifier in the first data request and the data processing rule to obtain first data, and storing the obtained first data, the second data identifier and the data processing rule under the first classification. Therefore, the request of the user is judged, and the first classification is established under the condition that the first classification is not included, so that the repeated establishment of the classification is avoided, and the waste of resources is reduced. And because the data management platform is adopted to uniformly process the requests of different users, the data redundancy caused by repeated copying and downloading of the data by different users is prevented, and the efficiency of data processing is integrally improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a data management platform provided in an embodiment of the present application;
FIG. 2 is a schematic structural diagram of another data management platform provided in an embodiment of the present application;
FIG. 3 is a schematic structural diagram of another data management platform provided in an embodiment of the present application;
FIG. 4 is a schematic structural diagram of another data management platform provided in an embodiment of the present application;
FIG. 5 is a schematic structural diagram of another data management platform provided in an embodiment of the present application;
fig. 6 is a schematic flowchart of a data management method according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a data management device according to an embodiment of the present application.
Detailed Description
Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are intended to be illustrative only and are not intended to be limiting. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present application by illustrating examples thereof.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
In the current society, many users, which may include banks and large enterprises, require a great deal of data processing. And because different branches often exist inside users, the demands of the different branches on data processing are different. Different branches of the same user often set up different classifications for classifying and storing unprocessed data and processed data. In this process, since there is a case where the unprocessed data required by different data requirements is the same, different branches are caused to download, copy, and store the same unprocessed data. Resulting in a large amount of data redundancy. And because the different branches have the same requirements for data processing, the data processing is repeatedly processed by the different branches, and a large amount of resources are wasted.
In order to solve the problems of the prior art, embodiments of the present application provide a data management platform, a method, a device, and a computer-readable storage medium.
The data management platform 100 provided in the embodiment of the present application is first described below.
Fig. 1 shows a schematic structural diagram of a data management platform 100 according to an embodiment of the present application. As shown in fig. 1, the platform may include:
the system comprises a data management interface 101, an approval module 102, a classification module 103 and a processing module 104.
The data management platform may include a platform capable of supporting multi-user sharing or multi-branch sharing of the same user.
Since sharing can be supported by a plurality of users or a plurality of branches of the same user, sharing of a plurality of users or the same user in a plurality of layers such as data, data processing, and data display can be realized. The method avoids a large amount of data redundancy caused by downloading, copying and storing the same data by different users or different branches of the same user. The waste of a large amount of resources generated by repeated processing of data by different users or different branches of the same user is also avoided.
As an example, the data management platform may be applied in a banking system. Different departments in the bank carry out unified login and operation on the data management platform through interfaces of all departments.
The data management interface 101 is used for responding to input of a user, generating a first data request and sending the first data request to the approval module 102; the first data request includes a first data classification identification, a second data identification, and a first data processing rule.
The data management interface may include, among other things, a smart panel having display and input capabilities. The user's input may include data classification identification, data identification, and data processing rules input by user customization. The second data may include source data used to compute the first data. The first data processing rule may include at least one of a formula of data processing, a cycle of data processing, a frequency of data processing, a type of a value of a result of data processing.
As one example, the second data may include source data stored at the data management platform.
As an example, the data management interface 101 generates the first data request according to the user-input customized data classification identifier, data identifier and data processing rule after receiving the user-input customized data classification identifier, data identifier and data processing rule. The generated first data request is sent to an approval module after the first data request is generated.
As an example, the data management platform 100 may be configured as a web page or an APP, and the data management interface 101 may include at least one display window of the web page or the APP displayed on the intelligent login device after the operator of different departments in the bank system logs in through the intelligent device.
As an example, the data management interface 101 is further configured to obtain a processing progress of the first data, and display the processing progress.
Wherein the processing progress of the first data may include at least one of progress of calculation of the first data, progress of establishment of the first classification, and progress of approval.
As an example, the data management interface 101 may obtain a calculation progress of the first data sent by the processing module 104, obtain a progress of establishment of the first category sent by the classification module 103, and obtain a progress of approval of the first data request of the user sent by the approval module 102.
As an example, the machining path condition, the timeliness condition and the running condition of the data can be visually monitored by setting a data management interface.
The processing progress of the first data can be visualized through the display of the processing progress of the first data by the data management interface, so that a user can obtain the processing path and the processing progress of the first data and the running condition of the data management platform, and the user experience is improved.
The approval module 102 is configured to send the first data request to the classification module 103 when determining that the first data classification identifier is not included.
Wherein the first data class identification may comprise at least one of a name, a characteristic, a storage location of the first data class.
As an example, the approval module 102 determining whether the first data classification identifier is included may include the approval module 102 searching the record of the previous approval of the approval module to determine whether there is a duplicate first data classification identifier.
As an example, the determining, by the approval module 102, whether the first data classification identifier is included may include sending, by the approval module 102, the first data classification identifier to the classification module 103, so that the classification module 103 determines whether all the classes in the classification module 103 include the class corresponding to the first data classification identifier, and sends a determination result to the approval module 102.
As an example, the approval module 102 may further include performing a manual approval on whether the first data request is legitimate. In the event that the first data classification identification is not included and the manual approval is acceptable, the first data request is sent to the classification module 103.
By judging whether the first data classification mark is included, whether the classification which the user wants to establish is already established can be judged. Further, the classification is established only when it is determined that the classification which the user wants to establish is not included. The data query and processing can be prevented from being interfered by a large amount of redundancy of the established classification caused by repeated establishment of the classification.
The classification module 103 is configured to establish a first classification according to a first data classification identifier in the first data request, and send an identifier of the first classification, a second data identifier, and a first data processing rule to the processing module 104.
The first classification comprises a custom classification which needs to be established by a user under the established classification module. The first classification may include a classification having a storage function. The first classification identification may include at least one of a name, a characteristic, or a storage address of the first classification.
As an example, after receiving the first data request, the classification module 103 establishes a first classification according to a first data classification identifier in the first data request, then obtains an identifier of the first classification, and sends the identifier of the first classification, the second data identifier, and the first data processing rule to the processing module 104.
As an example, after the classification is established, the classification module 103 may modify and add the established classification and the data processing rules under the classification according to the input of the user. When modifications and additions are made, a unified package may be used. By using a unified encapsulation, the upper layer applications can be made without much difference.
The processing module 104 is configured to obtain second data according to the second data processing identifier under the first classification corresponding to the first classification identifier, and process the second data according to the first data processing rule to obtain first data. The first data is sent to the classification module 103.
The classification module 103 is further configured to store the first data, the second data identification, and the first data processing rule under the first classification.
Wherein the second data processing identity may comprise at least one of a name, a characteristic, a parameter, or a storage address of the second data.
As an example, after acquiring the second data processing identifier, the processing module 104 acquires corresponding second data according to the second data processing identifier, and then calculates the second data according to a calculation formula in the first data processing rule according to a period in the first data processing rule, and obtains the calculated first data. After obtaining the first data, the first data may be sent to the classification module 103.
As an example, after the processing module 104 obtains the first data, the first data may also be sent to the data management interface 101, so that the data management interface 101 displays the first data.
As an example, after the processing module 104 obtains the second data processing identifier, the first data processing rule, and the first classification identifier, the first data may also be obtained by performing automatic operation according to a period in the first data processing rule.
As an example, the data processing rules may be encapsulated in a uniform encapsulation manner. Processing module 104 is facilitated to process the data processing rules.
As an example, the process module 104 may include a process plant external to the system that may unify the flow batch operations in the calculation rules using unified packaging and calculation logic.
As an example, the processing module 104 may automatically process the data according to a data processing cycle in the first data processing rule.
The first data are automatically acquired by the processing module, so that the data can be automatically processed, the data processing efficiency is improved, and the user experience is improved.
The data management platform can judge based on a first data request of a user, and establish a first classification according to a first data classification identifier in the first data request under the condition that the first classification corresponding to the first data request is not included. And then, under the first classification, calculating according to second data corresponding to the second data identifier in the first data request and the data processing rule to obtain first data, and storing the obtained first data, the second data identifier and the data processing rule under the first classification. Therefore, the request of the user is judged, and the first classification is established under the condition that the first classification is not included, so that the repeated establishment of the classification is avoided, and the waste of resources is reduced. And because the data management platform is adopted to uniformly process the requests of different users, the data redundancy caused by repeated copying and downloading of the data by different users is prevented, and the efficiency of data processing is integrally improved.
In some embodiments, the data management platform has established a first classification of user needs, and under the first classification, has processed the first data. In order to avoid the repeated setting of the first classification, the embodiment of the present application further provides a schematic structural diagram of another data management platform 200, as shown in fig. 2, the data management platform 200 differs from the data management platform 100 in that, in 200:
the approval module 102 is further configured to send the identifier of the first data classification to the classification module 103 when it is determined that the identifier of the first data classification is included.
As an example, in a case that the approval module 102 determines that the data management platform has established the first category, it rejects the request of the user for establishing the first category, and obtains an identifier of the first data category in the first data request of the user, and then sends the identifier of the first data category to the classification module 103.
As an example, denying the user's request to establish the first category may include sending information to the data management interface 101 indicating that the data management platform has established the first category.
The classification module 103 is further configured to obtain a first classification corresponding to the first data classification identifier, and send the first data in the first classification to the data management interface 101 when the first classification contains the first data.
The first data included in the first classification may include a first classification already established by a classification module in the data management platform, and in the first classification, the second data is already obtained according to the second data identifier, and the second data is already processed according to the first data processing rule to obtain the first data.
As one example, where the first data is contained under the first classification, the classification module may send the first data to a data management interface. Wherein the first data may include data presented in at least one of a table, an image, or a curve.
The data management interface 101 is used for displaying the first data.
As an example, the displaying of the first data by the data management interface 101 may include displaying the first data by the data management interface through a display panel of a smart device of the user, so that the user acquires the first data.
As an example, the data management interface 101 may include at least one of a web page, an APP window, and a display interface capable of being displayed through a display panel.
Under the condition that the classification required by the user exists, the request for establishing the classification can be rejected, and the redundancy of a large number of classifications caused by repeated setting of the classification is avoided. Furthermore, the interference of a large number of repeated classifications on the acquired data when the user acquires the classified data is avoided.
In some embodiments, the data management platform has established a first category that the user needs, but has not yet processed under the first category to obtain the first data that the user needs to obtain. In order to avoid the repeated setting of the first classification, the embodiment of the present application further provides a schematic structural diagram of another data management platform 300, as shown in fig. 3, the data management platform 300 differs from the data management platform 200 in that, in 300:
the classification module 103 is further configured to send the second data identifier and the first data processing rule stored in the first classification to the processing module 104 when the first classification does not contain the first data.
As an example, classification module 103 establishes only a first classification under which the first data is not stored. After receiving the first data request sent by the approval module 102, the classification module 103 sends the second data identifier and the first data processing rule to the processing module. Wherein the second data identification and the first data processing rule have been previously stored under the first classification.
As an example, after receiving the first data request sent by the approval module 102, the classification module 103 obtains a first classification corresponding to the first data classification identifier according to the first data classification identifier in the first data request, and then obtains that the first data is not stored in the first classification, and then sends a second data identifier and a first data processing rule, which are pre-stored in the first classification, to the processing module 104.
The processing module 104 is further configured to obtain second data according to the second data processing identifier under the first classification, and process the second data according to the first data processing rule to obtain the first data. And sends the first data to the classification module 103.
As an example, after acquiring the second data identifier and the first data processing rule sent by the classification module 103, the processing module 104 acquires the second data stored on the data management platform according to the second data identifier, and then calculates the second data according to a calculation formula in the first data processing rule to obtain the first data.
As an example, the processing module 104 sends the first data to the classification module after obtaining the first data.
As an example, the processing module 104 may include a plurality of processing modules 104, and a corresponding processing module 104 is correspondingly disposed under each classification.
The classification module 103 is also configured to store the first data under the first classification.
As an example, the classification module 103 stores the first data under the corresponding first classification after acquiring the first data sent by the processing module 104.
As an example, after acquiring the first data sent by the processing module 104, the classification module 103 may also send the first data to the data management interface 101, so that the user acquires the first data at the data management interface 101.
When the classification module in the data management platform has established the corresponding first classification, but the first data is not stored in the first classification, the classification module may obtain the second data identifier and the first data processing rule stored in the first classification according to the first data request sent by the user, and then send the second data identifier and the first data processing rule to the processing module, so that the processing module processes the first data to obtain the first data. Therefore, the second data identification and the first data processing rule can be prevented from being repeatedly stored, and waste of storage resources is avoided.
In order to obtain the second data faster according to the second data identifier, the data management platform 400 provided in this embodiment of the application may further include a data indexing module 105, as shown in fig. 4, which is a schematic structural diagram of another data management platform 400 provided in this embodiment of the application. The data management platform 400 differs from the data management platform 100 in that the data management platform 400 may further include:
and the data index module is used for acquiring second data according to the second data identifier sent by the processing module and sending the second data to the processing module. Wherein the second data identification may include at least one of an index directory, a statement, and a code of the second data in the data indexing module.
As an example, after acquiring the second data identifier sent by the classification module 103, the processing module 104 sends the second data identifier to the data indexing module. After acquiring the second data identifier, the data indexing module acquires second data according to a corresponding relationship between a second data storage location in the data indexing module and the index directory, and sends the acquired second data to the processing module 104.
By arranging the data index module, the second data can be acquired faster when the second data is acquired, the data processing speed is increased, and the data processing efficiency is improved.
The method aims to manage the authority of the user so as to prevent data on the data management platform from being maliciously stolen by illegal users. The data management platform 500 provided in the embodiment of the present application may further include a rights management module 106, and as shown in fig. 5, is a schematic structural diagram of another data management platform 500 provided in the embodiment of the present application. The data management platform 500 differs from 100 in that 500 may further include:
the right management module 106 is configured to obtain a right verification request of the user and verify the right of the user.
The data management interface 101 is specifically configured to, in a case that the authority verification passes, respond to an input of a user, generate a first data request, and send the first data request to the approval module. Wherein the authorization verification request of the user may include at least one of identity information of the user, a login password of the user, or biometric information of the user.
As an example, after acquiring the authentication request of the user, the rights management module 106 compares the authentication information in the user authentication request with the pre-stored authentication information of the user, and determines that the authentication request of the user passes if the comparison result is consistent.
As an example, in the case that the comparison result is inconsistent, the information of the verification failure may be sent to the data management interface 101, so that the data management interface 101 displays the information of the verification failure to the user, so that the user resends the authority verification request.
The authority verification module is arranged to verify the authority of the user, so that the data on the data management platform can be prevented from being maliciously stolen by illegal users, and the data security is improved.
Based on the same inventive concept, an embodiment of the present application further provides a data management method 600, as shown in fig. 6, which is a schematic flow chart of the data management method 600, and as shown in fig. 6, the method may include:
s610, a first data request of a user is obtained, wherein the first data request comprises a first data classification identifier, a second data identifier and a first data processing rule.
S620, under the condition that the first data classification identification is judged not to be contained, establishing a first classification according to the first data classification identification.
And S630, under the first classification, processing second data corresponding to the second data identification according to the first data processing rule to obtain first data.
And S640, storing the first data, the second data identifier and the first data processing rule into the first classification.
In the data management method provided by the embodiment of the application, the judgment can be performed based on the first data request of the user, and the first classification is established according to the first data classification identifier in the first data request under the condition that the first classification corresponding to the first data request is not included. And then, under the first classification, calculating according to second data corresponding to the second data identifier in the first data request and the data processing rule to obtain first data, and storing the obtained first data, the second data identifier and the data processing rule under the first classification. Therefore, the request of the user is judged, and the first classification is established under the condition that the first classification is not included, so that the repeated establishment of the classification is avoided, and the waste of resources is reduced. And because the data management platform is adopted to uniformly process the requests of different users, the data redundancy caused by repeated copying and downloading of the data by different users is prevented, and the efficiency of data processing is integrally improved.
In some embodiments, the method further comprises:
and acquiring the first classification under the condition that the first data classification identification is judged to be contained.
When the first data is included in the first classification, the first data in the first classification is displayed.
Under the condition that the classification required by the user exists, the request for establishing the classification can be rejected, and the redundancy of a large number of classifications caused by repeated setting of the classification is avoided. Furthermore, the interference of a large number of repeated classifications on the acquired data when the user acquires the classified data is avoided.
In some embodiments, the method further comprises:
and under the condition that the first data is not contained in the first classification, acquiring second data according to the second data processing identifier in the first classification, and processing the second data according to the first data processing rule to obtain the first data.
And displaying the first data.
When the classification module in the data management platform has established the corresponding first classification, but the first data is not stored in the first classification, the classification module may obtain the second data identifier and the first data processing rule stored in the first classification according to the first data request sent by the user, and then send the second data identifier and the first data processing rule to the processing module, so that the processing module processes the first data to obtain the first data. Therefore, the second data identification and the first data processing rule can be prevented from being repeatedly stored, and waste of storage resources is avoided.
In some embodiments, prior to obtaining the first data request of the user, the method may further comprise:
acquiring a permission verification request of a user, and verifying the permission of the user;
in the case that the authority verification is passed, a first data request is generated in response to an input of a user.
The authority verification module is arranged to verify the authority of the user, so that the data on the data management platform can be prevented from being maliciously stolen by illegal users, and the data security is improved.
As an example method may further include:
and acquiring the processing progress of the first data, and displaying the processing progress.
The processing progress of the first data can be visualized through displaying the processing progress of the first data, so that a user can obtain a processing path and a processing progress of the first data and an operation condition of a data management platform, and the user experience is improved.
Fig. 7 shows a hardware structure diagram of a data management device according to an embodiment of the present application.
The data management device may include a processor 701 and a memory 702 storing computer program instructions.
Specifically, the processor 701 may include a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement the embodiments of the present Application.
In one example, the Memory 702 may be a Read Only Memory (ROM). In one example, the ROM may be mask programmed ROM, programmable ROM (prom), erasable prom (eprom), electrically erasable prom (eeprom), electrically rewritable ROM (earom), or flash memory, or a combination of two or more of these.
The processor 701 reads and executes the computer program instructions stored in the memory 702 to implement the methods/steps S210 to S250 in the embodiment shown in fig. 2, and achieve the corresponding technical effects achieved by the embodiment shown in fig. 2 executing the methods/steps thereof, which are not described herein again for brevity.
In one example, the data management device may also include a communication interface 703 and a bus 710. As shown in fig. 7, the processor 701, the memory 702, and the communication interface 703 are connected by a bus 710 to complete mutual communication.
The communication interface 703 is mainly used for implementing communication between modules, apparatuses, units and/or devices in this embodiment of the application.
In addition, in combination with the data management method in the foregoing embodiments, the embodiments of the present application may provide a computer storage medium to implement. The computer storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement any of the data management methods in the above embodiments.
It is to be understood that the present application is not limited to the particular arrangements and instrumentality described above and shown in the attached drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications, and additions or change the order between the steps after comprehending the spirit of the present application.
The functional blocks shown in the above structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic Circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the present application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium may include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data management apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data management apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such a processor may be, but is not limited to, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable logic circuit. It will also be understood that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware for performing the specified functions or acts, or combinations of special purpose hardware and computer instructions.
As will be apparent to those skilled in the art, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application.
Claims (10)
1. A data management platform, the platform comprising:
the data management interface is used for responding to input of a user, generating a first data request and sending the first data request to the approval module; the first data request comprises a first data classification identifier, a second data identifier and a first data processing rule;
the approval module is used for sending the first data request to the classification module under the condition that the first data classification identifier is judged not to be contained;
the classification module is used for establishing a first classification according to a first data classification identifier in the first data request, and sending the identifier of the first classification, the second data identifier and a first data processing rule to a processing module;
the processing module is used for acquiring second data according to the second data processing identifier under the first classification corresponding to the first classification identifier, and processing the second data according to the first data processing rule to obtain first data; sending the first data to the classification module for the classification module to store the first data, a second data identification, and a first data processing rule under the first classification.
2. The platform of claim 1, wherein the approval module is further configured to send the identifier of the first data category to the classification module if the identifier of the first data category is determined to be included;
the classification module is further configured to obtain a first classification corresponding to the first data classification identifier, and send the first data in the first classification to the data management interface when the first data is included in the first classification, so that the data management interface displays the first data.
3. The platform of claim 2, wherein the classification module is further configured to send the second data identifier and a first data processing rule stored in the first classification to the processing module if the first data is not included in the first classification;
the processing module is further configured to obtain second data according to the second data processing identifier under the first classification, and process the second data according to the first data processing rule to obtain first data;
sending the first data to the classification module for the classification module to store the first data under the first classification.
4. The platform of claim 1, further comprising: and the data index module is used for acquiring the second data according to the second data identifier sent by the processing module and sending the second data to the processing module.
5. The platform of claim 1, wherein the data management interface is further configured to obtain a processing progress of the first data, and display the processing progress.
6. The platform of claim 1, further comprising: the authority management module is used for acquiring an authority verification request of the user and verifying the authority of the user;
the data management interface is specifically used for responding to input of a user under the condition that the authority verification is passed, generating the first data request and sending the first data request to an approval module.
7. A method for managing data, the method comprising:
acquiring a first data request of a user, wherein the first data request comprises a first data classification identifier, a second data identifier and a first data processing rule;
under the condition that the first data classification identification is judged not to be contained, establishing a first classification according to the first data classification identification;
under the first classification, processing second data corresponding to the second data identification according to a first data processing rule to obtain first data;
storing the first data, the second data identification, and the first data processing rule to a first classification.
8. The method of claim 7, further comprising: under the condition that the first data classification identification is judged to be contained, acquiring the first classification;
displaying the first data in the first classification if the first data is included in the first classification.
9. A data management apparatus, characterized in that the apparatus comprises: a processor, and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement the data management method of any one of claims 7 to 8.
10. A computer-readable storage medium having computer program instructions stored thereon which, when executed by a processor, implement the data management method of any one of claims 7-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111321667.8A CN114092043B (en) | 2021-11-09 | 2021-11-09 | Data management platform, method, device and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111321667.8A CN114092043B (en) | 2021-11-09 | 2021-11-09 | Data management platform, method, device and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114092043A true CN114092043A (en) | 2022-02-25 |
| CN114092043B CN114092043B (en) | 2024-12-24 |
Family
ID=80299759
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111321667.8A Active CN114092043B (en) | 2021-11-09 | 2021-11-09 | Data management platform, method, device and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114092043B (en) |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001027720A2 (en) * | 1999-10-14 | 2001-04-19 | Universal Internet Product Code, Inc. | Universal product classification method and system for use with an internet worked computer system |
| US20080270312A1 (en) * | 2007-04-24 | 2008-10-30 | Microsoft Corporation | Taxonomy extension generation and management |
| CN101354709A (en) * | 2007-07-26 | 2009-01-28 | 富士施乐株式会社 | Information classifying apparatus, information classifying method and computer readable medium |
| US8346664B1 (en) * | 2008-11-05 | 2013-01-01 | Intuit Inc. | Method and system for modifying financial transaction categorization lists based on input from multiple users |
| CN105531977A (en) * | 2013-07-31 | 2016-04-27 | 赛门铁克公司 | Mobile device connection control for synchronization and remote data access |
| US20170139977A1 (en) * | 2015-11-17 | 2017-05-18 | International Business Machines Corporation | Validation rule management across entities |
| US20170193389A1 (en) * | 2015-12-30 | 2017-07-06 | Symantec Corporation | Systems and methods for efficiently classifying data objects |
| US20170270526A1 (en) * | 2016-03-15 | 2017-09-21 | Hrb Innovations, Inc. | Machine learning for fraud detection |
| CN107844530A (en) * | 2017-10-17 | 2018-03-27 | 广东欧珀移动通信有限公司 | A kind of data processing method, device, server and computer-readable recording medium |
| CN108573371A (en) * | 2018-04-18 | 2018-09-25 | 平安科技（深圳）有限公司 | The data measures and procedures for the examination and approval, device, computer equipment and storage medium |
| CN108572970A (en) * | 2017-03-09 | 2018-09-25 | 腾讯科技（深圳）有限公司 | A kind of processing method and distributed processing system(DPS) of structural data |
| CN109815013A (en) * | 2019-01-02 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Business data processing method, device, computer equipment and storage medium |
| CN110209681A (en) * | 2019-05-22 | 2019-09-06 | 深圳壹账通智能科技有限公司 | Block chain data enter chain method, apparatus, computer equipment and storage medium |
| CN110263024A (en) * | 2019-05-20 | 2019-09-20 | 平安普惠企业管理有限公司 | Data processing method, terminal device and computer storage medium |
| CN111400289A (en) * | 2020-02-23 | 2020-07-10 | 中国平安财产保险股份有限公司 | Intelligent user classification method, server and storage medium |
| CN111460404A (en) * | 2020-03-04 | 2020-07-28 | 深圳壹账通智能科技有限公司 | Double-recording data processing method and device, computer equipment and storage medium |
| US20200310599A1 (en) * | 2019-03-29 | 2020-10-01 | Microsoft Technology Licensing, Llc | Self-serve content classification platform |
| CN111831682A (en) * | 2020-06-29 | 2020-10-27 | 中国建设银行股份有限公司 | Method, device, equipment and computer readable medium for processing accumulation fund service |
-
2021
- 2021-11-09 CN CN202111321667.8A patent/CN114092043B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001027720A2 (en) * | 1999-10-14 | 2001-04-19 | Universal Internet Product Code, Inc. | Universal product classification method and system for use with an internet worked computer system |
| US20080270312A1 (en) * | 2007-04-24 | 2008-10-30 | Microsoft Corporation | Taxonomy extension generation and management |
| CN101354709A (en) * | 2007-07-26 | 2009-01-28 | 富士施乐株式会社 | Information classifying apparatus, information classifying method and computer readable medium |
| US8346664B1 (en) * | 2008-11-05 | 2013-01-01 | Intuit Inc. | Method and system for modifying financial transaction categorization lists based on input from multiple users |
| CN105531977A (en) * | 2013-07-31 | 2016-04-27 | 赛门铁克公司 | Mobile device connection control for synchronization and remote data access |
| US20170139977A1 (en) * | 2015-11-17 | 2017-05-18 | International Business Machines Corporation | Validation rule management across entities |
| CN107016544A (en) * | 2015-11-17 | 2017-08-04 | 国际商业机器公司 | Managed across the proof rule of entity |
| CN108604239A (en) * | 2015-12-30 | 2018-09-28 | 华睿泰科技有限责任公司 | System and method for effective grouped data object |
| US20170193389A1 (en) * | 2015-12-30 | 2017-07-06 | Symantec Corporation | Systems and methods for efficiently classifying data objects |
| US20170270526A1 (en) * | 2016-03-15 | 2017-09-21 | Hrb Innovations, Inc. | Machine learning for fraud detection |
| CN108572970A (en) * | 2017-03-09 | 2018-09-25 | 腾讯科技（深圳）有限公司 | A kind of processing method and distributed processing system(DPS) of structural data |
| CN107844530A (en) * | 2017-10-17 | 2018-03-27 | 广东欧珀移动通信有限公司 | A kind of data processing method, device, server and computer-readable recording medium |
| CN108573371A (en) * | 2018-04-18 | 2018-09-25 | 平安科技（深圳）有限公司 | The data measures and procedures for the examination and approval, device, computer equipment and storage medium |
| CN109815013A (en) * | 2019-01-02 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Business data processing method, device, computer equipment and storage medium |
| US20200310599A1 (en) * | 2019-03-29 | 2020-10-01 | Microsoft Technology Licensing, Llc | Self-serve content classification platform |
| CN110263024A (en) * | 2019-05-20 | 2019-09-20 | 平安普惠企业管理有限公司 | Data processing method, terminal device and computer storage medium |
| CN110209681A (en) * | 2019-05-22 | 2019-09-06 | 深圳壹账通智能科技有限公司 | Block chain data enter chain method, apparatus, computer equipment and storage medium |
| CN111400289A (en) * | 2020-02-23 | 2020-07-10 | 中国平安财产保险股份有限公司 | Intelligent user classification method, server and storage medium |
| CN111460404A (en) * | 2020-03-04 | 2020-07-28 | 深圳壹账通智能科技有限公司 | Double-recording data processing method and device, computer equipment and storage medium |
| CN111831682A (en) * | 2020-06-29 | 2020-10-27 | 中国建设银行股份有限公司 | Method, device, equipment and computer readable medium for processing accumulation fund service |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114092043B (en) | 2024-12-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11068583B2 (en) | Management of login information affected by a data breach | |
| CN104580112B (en) | A kind of service authentication method, system and server | |
| CN107682336B (en) | Geographic position-based identity authentication method and device | |
| US20180152478A1 (en) | Systems and methods for generation and selection of access rules | |
| CN112995357B (en) | Domain name management method, device, medium and electronic equipment based on cloud hosting service | |
| CN112084234A (en) | Data acquisition method, apparatus, device and medium | |
| CN113704826A (en) | Privacy protection-based business risk detection method, device and equipment | |
| CN113360868A (en) | Application program login method and device, computer equipment and storage medium | |
| CN112182506A (en) | Data compliance detection method, device and equipment | |
| CN115935321B (en) | Method, device and storage medium for accessing algorithm library | |
| CN111522580A (en) | Method and device for establishing code branch and computer equipment | |
| CN105721425A (en) | Information processing method and electronic device | |
| CN112084527A (en) | Data storage and acquisition method, device, equipment and medium | |
| CN114138590A (en) | Operation and maintenance processing method, device and electronic device of Kubernetes cluster | |
| CN112788017B (en) | Security verification method, device, equipment and medium | |
| KR101745919B1 (en) | User authentication method and system using software-based HSM without password exposure | |
| CN114092043B (en) | Data management platform, method, device and computer-readable storage medium | |
| CN107230080B (en) | Service processing method and device and intelligent terminal | |
| CN109699030B (en) | Unmanned aerial vehicle authentication method, device, equipment and computer readable storage medium | |
| CN111209552A (en) | Identity authentication method and device based on user behaviors | |
| CN107679865B (en) | Identity verification method and device based on touch area | |
| CN111444483A (en) | Authentication method, device and equipment | |
| CN114417366A (en) | Authority processing method and device, vehicle-mounted terminal and readable storage medium | |
| CN115905145A (en) | File processing method, device, equipment and computer storage medium | |
| CN111953637B (en) | Application service method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |