CN110046143B - Integrated architecture optimization system and optimization method of integrated data platform - Google Patents

Abstract

The invention discloses an integral architecture optimization system of an integrated data platform, which belongs to the technical field of platform optimization and comprises a database, wherein the database is electrically output and connected with a database running state monitoring module, the database running state monitoring module is electrically output and connected with a management end and an optimization scheme selection module, a hard disk and a server are both electrically connected with an allocation adjustment module in a bidirectional mode, the allocation adjustment module is electrically connected with an optimization model generation module in a bidirectional mode, an adjustment command confirmation module is electrically input and connected with the management end, and the allocation adjustment module is electrically output and connected with a process optimization module, a process optimization module and an optimization module, and the server is electrically output and connected.

Description

An overall architecture optimization system and optimization method for an integrated data platform

technical field

The invention relates to the technical field of platform optimization, in particular to an overall architecture optimization system and optimization method of an integrated data platform.

Background technique

The database is the most important data storage device in today's big data era. The quality of the database directly affects the value and function of the data. During peak hours, there are too many people using the database, which can easily cause the database to run slowly, freeze, or even It is a server crash. At this time, the server needs to be optimized. The traditional way is to manually optimize the server through the administrator to improve the operating efficiency of the server. If the database is always running at the highest efficiency, it will cause a lot of energy waste. For Therefore, we propose an overall architecture optimization system and optimization method for an integrated data platform.

Contents of the invention

The purpose of the present invention is to provide an overall architecture optimization system of an integrated data platform to solve the problems raised in the above-mentioned background technology.

In order to achieve the above object, the present invention provides the following technical solutions: an overall architecture optimization system of an integrated data platform, including a database, the database electrical output is connected to the database operation status monitoring module, the database operation status monitoring module electrical output is connected to the management terminal and Optimization scheme selection module, management terminal electrical output connection optimization scheme selection module, optimization scheme selection module electrical output connection optimization model generation module, optimization model generation module electrical output optimization model analysis module, optimization model analysis module electrical output connection algorithm Adjustment module, algorithm adjustment module bidirectional electrical connection optimization model generation module, database bidirectional electrical output connection hard disk and server, hard disk and server are both bidirectional electrical connection distribution adjustment module, distribution adjustment module bidirectional electrical connection optimization model generation module, optimization The electrical input of the model generation module is connected to the adjustment command confirmation module, the electrical input of the adjustment command confirmation module is connected to the management terminal, and the electrical output of the allocation adjustment module is connected to the process optimization module. The process optimization module's electrical output is connected to the server.

Preferably, the allocation adjustment module includes a server monitoring module and a hard disk monitoring module, the server monitoring module is electrically connected to the analysis module, the analysis module is bidirectionally electrically connected to the hard disk monitoring module, and the hard disk monitoring module is electrically connected to the hard disk allocation module.

Preferably, the electrical input of the hard disk monitoring module is connected to the hard disk, the electrical input of the hard disk monitoring module is connected to the server, the electrical input of the hard disk monitoring module is connected to the optimization model generation module, the electrical output of the server monitoring module is connected to the process optimization module, and the electrical output of the hard disk distribution module Connect the hard drive.

Preferably, the optimization model generation module includes a model adjustment module, a model adjustment module, an electrical output connection model generation module, a model adjustment module, an electrical output connection allocation adjustment module and an algorithm adjustment module, and a model generation module, an electrical output connection optimization model analysis module.

Preferably, the process optimization module includes a process analysis module, the electrical output of the process analysis module is connected to the process end module, the electrical input of the process analysis module is connected to the allocation adjustment module, and the electrical output of the process end module is connected to the server.

Preferably, the optimization scheme selection module includes a manual selection module and an automatic selection module, and the manual selection module and the automatic selection module share an electrical output connection scheme library.

Preferably, the electrical input of the module is manually selected to connect to the management terminal, the electrical input of the selected module is automatically connected to the database operation state monitoring module, and the electrical output of the scheme library is connected to the optimization model generation module.

Preferably, an optimization method for an overall architecture optimization system of an integrated data platform:

S1. The database operation status monitoring module monitors the operation status of the database, automatically analyzes it, and transmits the analyzed data to the optimization scheme selection module, and the optimization scheme selection module automatically selects the optimization scheme according to the data of the database operation status monitoring module, and allocates the adjustment module Analyze the running status of the hard disk and server, and transmit the data to the optimization model generation module. At the same time, the database operation status monitoring module also transfers the data to the optimization model generation module. The optimization model generation module adjusts the module and the database operation status monitoring module according to the allocation. The data, and the scheme of the optimization scheme selection module automatically generate an optimization model;

S2. The optimization model analysis module analyzes the model generated in the optimization model generation module, and adjusts the near part through the algorithm adjustment module, and then optimizes the model by allocating the data of the adjustment module and the database operation status monitoring module, and optimizes the model analysis The module transmits the analysis results to the database operation status monitoring module, which is convenient for people to check. When people see the analysis results and decide to adopt the analysis plan, they can issue control commands through the adjustment command confirmation module;

S3. The allocation adjustment module adjusts and allocates the storage space of the hard disk according to the model in the optimization model generation module, and transmits the adjustment command to the process optimization module. The process optimization module identifies and actively terminates useless running programs to speed up the running speed of the server , to optimize the performance of the database.

Compared with prior art, the beneficial effect of the present invention is:

1. The present invention monitors the operation of the database through the database operation status monitoring module, and transmits the data to the management terminal and the optimization scheme selection module after data analysis. There are multiple optimization schemes to choose from in the optimization scheme selection module, which can be operated according to the database. The specific operation scheme of the status monitoring module is used to select different optimization schemes, so that the operation of the database is efficient and energy-saving;

2. The present invention connects the algorithm adjustment module and the distribution adjustment module through the electrical input of the optimization model generation module, and the optimization model analysis module can adjust the scheme in the optimization model generation module in real time, and the optimization effect can be predicted in advance through the simulation of the model. The distribution adjustment module and the process optimization module adjust the hard disk and the server separately, which can make the operation of the database reach the highest efficiency and increase the value of the data.

Description of drawings

Fig. 1 is a schematic diagram of the present invention;

Fig. 2 is a functional block diagram of the distribution adjustment module of the present invention;

Fig. 3 is a functional block diagram of the optimization model generation module of the present invention;

Fig. 4 is the functional block diagram of the optimization scheme selection module of the present invention;

Fig. 5 is a functional block diagram of the process optimization module of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Please refer to Figures 1-5, the present invention provides a technical solution: an overall architecture optimization system of an integrated data platform, including a database 1, the electrical output of the database 1 is connected to the database operation status monitoring module 2, and the operation status of the database 1 is monitored , the electrical output of the database running state monitoring module 2 is connected to the management terminal 3 and the optimization scheme selection module 4, the manager checks the monitoring information through the management terminal 3, and the data of the database running state monitoring module 2 is automatically judged in the optimization scheme selection module 4, Automatically select the optimization scheme, the management terminal 3 electrical output connection optimization scheme selection module 4, the manager can also manually select the scheme through the management terminal 3, the optimization scheme selection module 4 electrical output connection optimization model generation module 5, generate an optimization model, optimize Model generation module 5, electrical output optimization model analysis module 6, the generated model is calculated, analysis and optimization efficiency, optimization model analysis module 6 electrical output connection algorithm adjustment module 7, algorithm adjustment database, algorithm adjustment module 7 two-way electrical connection The optimization model generation module 5, the database 1 is bidirectionally electrically connected to the hard disk 8 and the server 9, the operation of the hard disk 8 and the server 9 is analyzed, and the hard disk 8 is adjusted, and the hard disk 8 and the server 9 are bidirectionally electrically connected to the allocation adjustment module 10 , distribution adjustment module 10 two-way electrical connection optimization model generation module 5, optimizes the optimization model generation module 5 according to the data of distribution adjustment module 10, optimization model generation module 5 electric input connection adjustment order confirmation module 11, adjustment order confirmation module 11 electrical input connection management terminal 3, distribution adjustment module 10 electrical output connection process optimization module 12 process optimization module 12 electrical output connection server 9.

Wherein, the allocation adjustment module 10 includes a server monitoring module 101 and a hard disk monitoring module 102, the server monitoring module 101 is electrically output connected to the analysis module 103, the analysis module 103 is electrically connected to the hard disk monitoring module 102 in two directions, and the hard disk monitoring module 102 is electrically output connected to the hard disk The allocation module 104 monitors the server and the hard disk, and adjusts the hard disk 8;

The hard disk monitoring module 102 is electrically input connected to the hard disk 8, the hard disk monitoring module 102 is electrically connected to the server 9, the hard disk monitoring module 102 is electrically connected to the optimization model generation module 5, the server monitoring module 101 is electrically output connected to the process optimization module 12, and the hard disk The distribution module 104 is electrically output and connected to the hard disk 8, so as to directly adjust the distribution of the hard disk 8;

The optimization model generation module 5 includes a model adjustment module 51, the model adjustment module 51 is electrically output and connected to a model generation module 52, the model adjustment module 51 is electrically output connected to the allocation adjustment module 10 and the algorithm adjustment module 7, and the model generation module 52 is electrically output and connected Optimize the model analysis module 6, generate a forecast model, and adjust the model in real time to maximize the optimization efficiency;

Process optimization module 12 includes process analysis module 121, process analysis module 121 electrical output connection process end module 122, process analysis module 121 electrical input connection distribution adjustment module 10, process end module 122 electrical output connection server 9, to server 9 Analyze, monitor processes, and force useless processes to end;

The optimization scheme selection module 4 includes a manual selection module 41 and an automatic selection module 42, the manual selection module 41 and the automatic selection module 42 are electrically output connection scheme library 43, the automatic selection module 42 automatically selects the scheme according to the situation, and can also be selected by the manual selection module. 41 for manual selection;

The manual selection module 41 is connected to the management terminal 3 by electrical input, which is convenient for manual selection of the scheme. The automatic selection module 42 is connected to the database running status monitoring module 2 by default. ;

An optimization method for an overall architecture optimization system of an integrated data platform:

S1, the database operation state monitoring module 2 monitors the operation of the database 1, and automatically analyzes it, and transmits the analyzed data to the optimization scheme selection module 4, and the optimization scheme selection module 4 automatically selects and optimizes according to the data of the database operation state monitoring module 2 scheme, the allocation adjustment module 10 analyzes the operating status of the hard disk 8 and the server 9, and transmits the data to the optimization model generation module 5, and the database operation status monitoring module 2 also transmits the data to the optimization model generation module 5, and the optimization model generation Module 5 automatically generates an optimization model according to the data of distribution adjustment module 10 and database operation status monitoring module 2, and the scheme of optimization scheme selection module 4;

S2, the optimization model analysis module 6 analyzes the model generated in the optimization model generation module 5, and adjusts the near part by the algorithm adjustment module 7, and then adjusts the model by distributing the data of the adjustment module 10 and the database operation status monitoring module 2 Optimization, the optimized model analysis module 6 transmits the analyzed results to the database operation status monitoring module 2, which is convenient for people to check. When people see the analysis results and decide to adopt the analysis plan, they send control commands through the adjustment command confirmation module 11;

S3, the allocation adjustment module 10 adjusts and allocates the storage space of the hard disk 8 according to the model in the optimization model generation module 5, and transmits the adjustment command to the process optimization module 12, and the process optimization module 12 identifies and actively terminates useless running programs, Speed up server 9 to optimize database 1 performance.

Although the embodiments of the present invention have been shown and described, those skilled in the art can understand that various changes, modifications and substitutions can be made to these embodiments without departing from the principle and spirit of the present invention. and modifications, the scope of the invention is defined by the appended claims and their equivalents.

Claims (8)

1. An integral architecture optimization system of an integral data platform comprises a database (1), and is characterized in that: the optimization system comprises a database (1), a database running state monitoring module (2), a management terminal (3) and an optimization scheme selection module (4), wherein the management terminal (3) is electrically connected with the optimization scheme selection module (4), the optimization scheme selection module (4) is electrically connected with an optimization model generation module (5), the optimization model generation module (5) is electrically connected with an optimization model analysis module (6), the optimization model analysis module (6) is electrically connected with an algorithm adjustment module (7), the algorithm adjustment module (7) is electrically connected with the optimization model generation module (5) in a bidirectional mode, the database (1) is electrically connected with a hard disk (8) and a server (9) in a bidirectional mode, the hard disk (8) and the server (9) are both electrically connected with an allocation adjustment module (10) in a bidirectional mode, the allocation adjustment module (10) is electrically connected with the optimization model generation module (5), the optimization model generation module (5) is electrically connected with an adjustment command confirmation module (11), the adjustment command confirmation module (11) is electrically connected with the management terminal (3), and the allocation adjustment module (10) is electrically connected with the process optimization module (12) and the server (9) is electrically connected with the optimization module (12).

2. The system of claim 1, wherein the data platform comprises: the distribution adjusting module (10) comprises a server monitoring module (101) and a hard disk monitoring module (102), the server monitoring module (101) is electrically output and connected with an analysis module (103), the analysis module (103) is electrically connected with the hard disk monitoring module (102) in a bidirectional mode, and the hard disk monitoring module (102) is electrically output and connected with a hard disk distribution module (104).

3. The system of claim 2, wherein the system comprises: the system comprises a hard disk monitoring module (102), a server (9), an optimization model generating module (5), a server monitoring module (101), a process optimizing module (12) and a hard disk distribution module (104), wherein the hard disk monitoring module (102) is electrically connected with a hard disk (8) in an input mode, the hard disk monitoring module (102) is electrically connected with the server (9) in an input mode, the hard disk monitoring module (102) is electrically connected with the optimization model generating module (5) in an input mode, and the hard disk distribution module (104) is electrically connected with the hard disk (8) in an output mode.

4. The system of claim 1, wherein the data platform comprises: the optimization model generation module (5) comprises a model adjusting module (51), the model adjusting module (51) is electrically output and connected with a model generation module (52), the model adjusting module (51) is electrically output and connected with a distribution adjusting module (10) and an algorithm adjusting module (7), and the model generation module (52) is electrically output and connected with an optimization model analysis module (6).

5. The system of claim 1, wherein the data platform comprises: the process optimization module (12) comprises a process analysis module (121), the process analysis module (121) is electrically connected with a process ending module (122), the process analysis module (121) is electrically connected with an input and distribution adjustment module (10), and the process ending module (122) is electrically connected with the output and server (9).

6. The system of claim 1, wherein the data platform comprises: the optimization scheme selection module (4) comprises a manual selection module (41) and an automatic selection module (42), and the manual selection module (41) and the automatic selection module (42) both electrically output a connection scheme library (43).

7. The system of claim 6, wherein the data platform further comprises: the manual selection module (41) is electrically input and connected with the management terminal (3), the automatic selection module (42) is electrically input and connected with the database running state monitoring module (2), and the scheme library (43) is electrically output and connected with the optimization model generation module (5).

8. An optimization method of an integral architecture optimization system of an integrated data platform is characterized in that:

s1, a database running state monitoring module (2) monitors the running condition of a database (1), automatically analyzes the running condition and transmits the analyzed data to an optimization scheme selection module (4), the optimization scheme selection module (4) automatically selects an optimization scheme according to the data of the database running state monitoring module (2), a distribution adjustment module (10) analyzes the running states of a hard disk (8) and a server (9) and transmits the data to an optimization model generation module (5), meanwhile, the database running state monitoring module (2) also generates a data transmission word optimization model in the optimization model generation module (5), and the optimization model generation module (5) automatically generates an optimization model according to the data of the distribution adjustment module (10) and the database running state monitoring module (2) and the scheme of the optimization scheme selection module (4);

s2, an optimization model analysis module (6) analyzes the model generated in the optimization model generation module (5), near adjustment is carried out through an algorithm adjustment module (7), the model is optimized through data of a distribution adjustment module (10) and a database running state monitoring module (2), the optimization model analysis module (6) transmits an analysis result to the database running state monitoring module (2), so that people can conveniently check the analysis result, and after people see the analysis result and decide to adopt an analysis scheme, a control command is sent out through an adjustment command confirmation module (11);

s3, the allocation adjusting module (10) adjusts and allocates the storage space of the hard disk (8) according to the model in the optimization model generating module (5), and transmits the adjusting command to the process optimizing module (12), the process optimizing module (12) identifies and actively ends useless running programs, the running speed of the server (9) is accelerated, and the performance of the database (1) is optimized.

Images