CN102982145A - System for allocating database operating requests - Google Patents

Abstract

The invention discloses a system (1000) for allocating database operation requests, which includes: a device (200) for allocating database operation requests; one or more application program servers (300-1,...,300-n), suitable for Sending an operation request for the database to the device (200); the master database server (400a) and one or more slave database servers (400b1, ..., 400bn), adapted to respond to the check of the device (200), send the device (200) return its status, and receive the operation request assigned by the device (200); and the device (200) for assigning the database operation request includes: a network interface (201), adapted to receive an operation request for the database; an operation request resolver (203), adapted to parse the operation request to detect a type annotation in the operation request and determine a database server corresponding to the type annotation; and an operation request dispatcher (207) adapted to assign the operation request to the determined database server.

Description

A system for distributing database operation requests

technical field

The invention relates to database technology, in particular to a system for allocating database operation requests.

Background technique

With the rapid development of computer networks, network applications with a large number of users appear, and these network applications need to store a large amount of user data and related data. The previous data storage method of a single data storage server can no longer meet the data storage requirements of current network applications. At present, databases generally adopt a master-slave architecture (generally speaking, there is one master database and multiple slave databases). The slave database only undertakes read operations, and all write operations are performed by the master database. In order to ensure data consistency, the slave database will continuously synchronize the latest written data from the master database to the slave database. Application programmers need to send database operation statements to the master database or slave database respectively according to the type of read and write of database operations, which increases the burden on application programmers and increases development costs.

In addition, the data synchronization from the master database to the slave database is not completely real-time, but there is a certain delay time, which brings problems. Imagine the following situation: the application program writes a piece of data to the database. As mentioned above, the data will be written into the master database, and then the data will be read out again immediately. The read operation is performed by the slave database, but the slave database has not yet had time When the data is synchronized from the main database to the local, the execution result of the read operation must be that the data is not found or the old version of the data is read, which causes errors. In addition, if a database server fails and the program still imports requests to the unavailable machine, an error will occur. At this time, it can only be solved by modifying the program, and the maintenance cost is very high.

Contents of the invention

In view of the above problems, the present invention is proposed to provide a system for allocating database operation requests that overcomes the above problems or at least partially solves the above problems.

According to one aspect of the present invention, a system for distributing database operation requests is provided, including: a device for distributing database operation requests; one or more application program servers, adapted to send the device an operation request for the database; and a master database The server and one or more slave database servers are adapted to respond to the check of the device, return its status to the device, and receive the operation request assigned by the device; wherein, the device for assigning the database operation request includes: a network interface, adapted to receive an operation request for the database; an operation request parser, adapted to parse the operation request, to detect a type annotation in the operation request, and determine a database server corresponding to the type annotation; and an operation request distributor, adapted to The operation request is assigned to the determined database server.

Optionally, in the device for allocating database operation requests according to an embodiment of the present invention, when the operation request parser does not detect the type annotation in the operation request, parse the operation request to determine the type of the operation request , determining a database server corresponding to the type of the operation request; and the operation request distributor assigns the operation request to the determined database server corresponding to the type of the operation request.

Optionally, in the device for allocating database operation requests according to the embodiment of the present invention, types of the operation requests include write operations and read operations.

Optionally, in the device for distributing database operation requests according to an embodiment of the present invention, the database server includes a master database server and a slave database server, the database server corresponding to the write operation is the master database server, and the database server corresponding to the read operation The server is the slave database server.

Optionally, the device for allocating database operation requests further includes a database checker adapted to check the database server; and the operation request allocator allocates the operation request to the corresponding database server or returns an error prompt according to the check result.

The present invention provides the above-mentioned system for allocating database operation requests. According to the embodiment of the present invention, the received operation request for the database can be parsed to detect the type annotation in the operation request, and according to the type annotation, the corresponding database server can be determined and the operation request can be assigned to it. In this way, the application developer can determine to allocate the operation request to a specific database server by using, for example, the meaningless comment statement in the operation request such as SQL statement, thereby greatly improving the flexibility of application development. For read operations with high real-time requirements, you only need to simply add a type annotation indicating the type of the main database to the operation request, and the operation request can be automatically assigned to the main database server to avoid the occurrence of not being able to find the requested data Or a problem reading an older version of the data.

In addition, according to the embodiment of the present invention, after the database server to which the operation request is assigned is determined, the database server can be checked, and the operation request is assigned to the corresponding database server or an error prompt is returned according to the inspection result. In this way, when one or more database servers in the database server cluster fail, the failure can be automatically detected, and the operation request is no longer allocated to the failed database server. Among them, in the case of failure of the primary database server, the write operation cannot be performed, but the read operation is not affected; and in the case of a failure of the secondary database server, the read operation can be assigned to the primary database server instead, so as to read and write Operations are not affected. This process is completely transparent to the application program, and the application programmer does not need to make any modification to the application program, which reduces the maintenance cost of the application program.

The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:

1 is a flowchart of a method for allocating database operation requests according to an embodiment of the present invention;

FIG. 2 is a flow chart of steps of a method for allocating database operation requests according to an embodiment of the present invention; and

Fig. 3 is a block diagram of a device and a system for allocating database operation requests according to an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

Fig. 1 schematically illustrates a flowchart of a method 100 for allocating database operation requests according to an embodiment of the present invention.

According to an embodiment of the present invention, the database may be, for example, a MySQL database. In the following, the MySQL database is taken as an example to describe the principle of the present invention. However, this is only for the purpose of illustration, and the scope of the present invention is not limited thereto. The principle of the present invention is also applicable to other types of databases.

As shown in FIG. 1 , the method 100 for allocating database operation requests according to an embodiment of the present invention starts at step S101 , wherein an operation request for a database is received. The operation request for the database comes from one or more application servers, for example.

Fig. 2 schematically illustrates a flow chart of steps of a method for allocating database operation requests according to an embodiment of the present invention, and the principle of the present invention will be described in detail below in conjunction with Fig. 2 .

Referring to FIG. 2 , firstly, an operation request for the database is received from the application server, if not received, then continue to wait; if received, then enter the next step, that is, step S103 shown in FIG. 1 .

In step S103, the operation request is parsed, so as to detect the type annotation in the operation request. According to an embodiment of the present invention, the operation request may include a database program language statement, and the database program language may be SQL (Structured Query Language, Structured Query Language), that is, the operation request includes an SQL statement. However, the SQL language and SQL statements are only examples to help readers understand the principles of the present invention, and the scope of the present invention is not limited thereto, but is equally applicable to other appropriate database programming languages and corresponding statements.

When parsing the operation request, for example, it may be detected whether the beginning of the SQL statement contains a type annotation, that is, whether it contains a master database type annotation such as "/*master*/". If it is included, that is, the type annotation in the operation request is detected, it may enter step S105 as shown in FIG. 1 . In step S105, the database server corresponding to the detected type annotation is determined. Optionally, before this, as shown in FIG. 2 , the type annotation can be deleted from the operation request.

According to an embodiment of the present invention, the database server may include a master database server and a slave database server. In step S105, it is detected whether the type annotation indicates the type of the master database server, and if so, that is, for example, the type annotation is "/*master*/", then the database server corresponding to the type annotation can be determined to be the master database server. In this way, in the subsequent step S107, the operation request can be allocated to the main database server.

However, if in step S103, the type annotation is not detected by parsing the operation request, step S103' can be executed, that is, further parsing the operation request to determine the type of the operation request.

According to an embodiment of the present invention, types of operation requests include write operations and read operations. In step S103', the type of the operation request can be determined according to the keywords in the SQL statement. For example, the first word in the SQL statement can be detected, and if the word is a word indicating a write operation such as INSERT, UPDATE, REPLACE, etc., then the type of the operation request is judged to be a write operation; and if the word does not indicate a write operation If other words are used, it is judged that the type of the operation request is a read operation. Then, step S105' is executed to determine the database server corresponding to the type of operation request. According to an embodiment of the present invention, the database server corresponding to the write operation is the master database server, and the database server corresponding to the read operation is the slave database server.

Optionally, in the above step S105, if it is detected that the comment type does not represent the main database server type, as shown in Figure 2, it is also possible to consider performing steps S103' and S105', that is, to parse the operation request and determine the operation request type and determine the database server corresponding to that type.

After step S105', step S107 is executed, wherein the operation request is allocated to the database server corresponding to the type of the operation request, that is, if the type of the operation request is a write operation, the operation request is allocated to the main database server; And if the type of the operation request is a read operation, the operation request is assigned to the slave database server.

According to an embodiment of the present invention, before the above step S107, step S106 may also be performed, wherein the determined database server is checked, and in step S107, the operation request is allocated to the corresponding database server or an error is returned according to the check result hint. Wherein, as shown in FIG. 2 , in the case that the determined database server is a slave database server, when the check result indicates that the status of the slave database server is normal, the operation request is allocated to the slave database server. When the check result shows that the status of the slave database server is abnormal, check the master database server. When the status of the master database server is normal, assign the operation request to the master database server; An unavailable error message, for example, returns a "database unavailable" error message to the application server.

In the case that the determined database server is the master database server, when the check result shows that the master database server is in normal state, the operation request is assigned to the master database server; An error message that the server is unavailable, for example, return a "database unavailable" error message to the application server.

In the following, in order to help readers understand the present invention, the principle of the present invention will be described in conjunction with three example SQL statements.

(1) Assuming that the SQL statement contained in the operation request is: INSERT INTOmytable VALUES(1,'abc'), first check whether the beginning of the SQL statement contains a type comment, if the SQL statement does not contain a comment, then determine the type of the operation request, check The first word in the SQL statement is found to be INSERT, so it can be judged that the type of operation request is a write operation, which should be assigned to the main database server, check the main database server, and if the status of the main database server is normal, assign the operation request to it, If the status of the main database server is abnormal, an error message of "database is unavailable" may be returned to the application server.

(2) Assuming that the SQL statement contained in the operation request is: SELECT*FROMmytable, first check whether the beginning of the SQL statement contains a type comment, if the SQL statement does not contain a comment, then determine the type of the operation request, and check the first The word is found to be SELECT, so it can be judged that the type of operation request is a read operation, which should be assigned to the slave database server, check the slave database server, if its status is normal, assign the operation request to it, if its status is not normal, then check the master database server, if the state of the main database server is normal, then assign an operation request to it; if the state of the main database server is not normal, then an error prompt of "database is unavailable" may be returned to the application server.

(3) Assuming that the SQL statement contained in the operation request is: /*master*/SELECT*FROM mytable, first check whether the beginning of the SQL statement contains a type comment. This SQL sentence contains a comment, and the content of the comment is /*master*/, Indicates the main database server, check the main database server, if the main database server status is normal, assign operation request to it, if the main database server status is not normal, you can return the error message of "database is unavailable" to the application server.

The invention provides a method for allocating database operation requests. According to the embodiment of the present invention, the received operation request for the database can be parsed to detect the type annotation in the operation request, and according to the type annotation, the corresponding database server can be determined and the operation request can be assigned to it. In this way, the application developer can determine to allocate the operation request to a specific database server by using, for example, the meaningless comment statement in the operation request such as SQL statement, thereby greatly improving the flexibility of application development. For read operations with high real-time requirements, you only need to simply add a type annotation indicating the type of the main database to the operation request, and the operation request can be automatically assigned to the main database server to avoid the occurrence of not being able to find the requested data Or a problem reading an older version of the data.

In addition, according to the embodiment of the present invention, after the database server to which the operation request is assigned is determined, the database server can be checked, and the operation request is assigned to the corresponding database server or an error prompt is returned according to the inspection result. In this way, when one or more database servers in the database server cluster fail, the failure can be automatically detected, and the operation request is no longer allocated to the failed database server. Among them, in the case of failure of the primary database server, the write operation cannot be performed, but the read operation is not affected; and in the case of a failure of the secondary database server, the read operation can be assigned to the primary database server instead, so as to read and write Operations are not affected. This process is completely transparent to the application program, and the application programmer does not need to make any modification to the application program, which reduces the maintenance cost of the application program.

Corresponding to the above method 100, the present invention also provides a device 200 for allocating database operation requests. Fig. 3 schematically illustrates an apparatus 200 for allocating database operation requests according to an embodiment of the present invention. Referring to FIG. 3 , the device 200 mainly includes a network interface 201 , an operation request parser 203 , and an operation request distributor 207 .

According to an embodiment of the present invention, the network interface 201 is adapted to receive operation requests for the database. The operation request parser 203 is adapted to parse the operation request to detect type annotations in the operation request. The operation request parser 203 is also adapted to determine the database server corresponding to the type annotation. The operation request distributor 207 is adapted to distribute the operation requests to the determined database servers. The network interface 201 , the operation request resolver 203 , and the operation request distributor 207 can be respectively used to execute steps S101 , S103 , and S105 , S107 in the method 100 for distributing database operation requests.

According to an embodiment of the present invention, the operation request parser 203 parses the operation request, thereby detecting the type annotation in the operation request. According to an embodiment of the present invention, the operation request may include a database program language statement, and the database program language may be SQL, that is, the operation request includes an SQL statement. When parsing the operation request, the operation request parser 203 can detect, for example, whether the beginning of the SQL statement contains a type annotation, that is, whether it contains a master database type annotation such as "/*master*/". If included, the operation request parser 203 has detected the type annotation in the operation request. Subsequently, the operation request resolver 203 determines the database server corresponding to the detected type annotation. Optionally, before this, the operation request parser 203 may delete the type annotation from the operation request.

According to an embodiment of the present invention, the database server may include a master database server and a slave database server. The operation request resolver 203 detects whether the type annotation represents the master database server type, and if so, that is, for example, the type annotation is "/*master*/", the operation request resolver 203 can determine the database server corresponding to the type annotation as the primary database server. In this way, the operation request distributor 207 can then distribute the operation requests to the main database server.

However, when the operation request parser 203 does not detect the type annotation in the operation request, it parses the operation request to determine the type of the operation request.

According to an embodiment of the present invention, types of operation requests include write operations and read operations. The operation request parser 203 can determine the type of the operation request according to the keywords in the SQL statement. For example, the operation request parser 203 can detect the first word in the SQL statement, if the word is a word representing a write operation such as INSERT, UPDATE, REPLACE, etc., then it is judged that the type of the operation request is a write operation; and if the word is For other words that do not indicate a write operation, the operation request parser 203 determines that the type of the operation request is a read operation. Then, the operation request parser 203 determines the database server corresponding to the type of operation request. According to an embodiment of the present invention, the database server corresponding to the write operation is the master database server, and the database server corresponding to the read operation is the slave database server.

Optionally, if the operation request resolver 203 detects that there is a type annotation in the operation request, but the annotation type does not represent the main database server type, then the operation request resolver 203 parses the operation request, judges the type of the operation request, and operates the request resolver 203 Determine the database server corresponding to the type. Subsequently, the operation request distributor 207 distributes the operation request to the database server corresponding to the type of the operation request, that is, if the type of the operation request is a write operation, the operation request distributor 207 distributes the operation request to the main database server; And if the type of the operation request is a read operation, the operation request distributor 207 distributes the operation request to the slave database server.

According to an embodiment of the present invention, after the operation request resolver 203 determines the database server, the database server is checked by the database checker 205, and then the operation request distributor 207 assigns the operation request to the corresponding database server or returns an error prompt according to the inspection result . Wherein, in the case that the operation request resolver 203 determines that it is a slave database server, when the check result shows that the slave database server state is normal, the operation request distributor 207 distributes the operation request to the slave database server; When the server status is abnormal, the database checker 205 checks the master database server. When the master database server status is normal, the operation request distributor 207 distributes the operation request to the master database server. When the master database server status is abnormal, the operation request distributor 207 returns an error message indicating that the database server is unavailable. And in the case that the database server determined by the operation request resolver 203 is the primary database server, when the check result indicates that the status of the primary database server is normal, the operation request allocator 207 distributes the operation request to the primary database server; When the state of the database server is abnormal, the operation request dispatcher 207 returns an error message indicating that the database server is unavailable.

Since the foregoing device (device) embodiments correspond to the aforementioned method embodiments, detailed descriptions of the respective device embodiments are omitted.

According to yet another aspect of the present invention, a system 1000 for allocating database operation requests is also provided. Referring to Fig. 3, the system 1000 includes the above-mentioned device 200; one or more application program servers 300-1, ..., 300-n, adapted to send an operation request for the database to the device 200; and the main database server 400a and one or more The slave database servers 400b1, . . . , 400bn are adapted to respond to the check of the device 200, return its status to the device 200, and receive operation requests assigned by the device 200.

The algorithms and displays presented herein are not inherently related to any particular computer, virtual system, or other device. Various generic systems can also be used with the teachings based on this. The structure required to construct such a system is apparent from the above description. Furthermore, the present invention is not specific to any particular programming language. It should be understood that various programming languages can be used to implement the content of the present invention described herein, and the above description of specific languages is for disclosing the best mode of the present invention.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Several modules in an embodiment can be combined into one module or unit or assembly, and further they can be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or procedures or modules are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

The various apparatus embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some or all modules in the apparatus according to the embodiment of the present invention. The present invention can also be implemented as an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

Claims (9)

1. the system of an allocation database operation requests (1000) comprising:

The equipment of allocation database operation requests (200);

One or more apps server (300-1 ..., 300-n), be suitable for to the operation requests of described equipment (200) transmission for database;

Main database server (400a) and one or more are from database server (400b1,, 400bn), be suitable for the inspection in response to described equipment (200), return its state to described equipment (200), and receive the operation requests that described equipment (200) distributes; And

The equipment of described allocation database operation requests (200) comprising:

Network interface (201) is suitable for receiving the operation requests for database;

Operation requests resolver (203) is suitable for resolving described operation requests, detecting the types of comments in the described operation requests, and determines the database server corresponding with described types of comments; And

Operation requests divider (207) is suitable for described operation requests is distributed to determined database server.

2. the system as claimed in claim 1, wherein when described operation requests resolver (203) does not detect types of comments in the described operation requests, resolve described operation requests, judging the type of described operation requests, and determine the database server corresponding with the type of described operation requests; And

Described operation requests divider (207) is distributed to the determined database server corresponding with the type of described operation requests with described operation requests.

3. system as claimed in claim 2, the type of wherein said operation requests comprises write operation and read operation.

4. system as claimed in claim 3, wherein said database server comprises main database server and from database server, database server corresponding to write operation is main database server, is from database server corresponding to the database server of read operation.

5. such as each the described system in the claim 1 to 4, the equipment of described allocation database operation requests (200) also comprises:

Database auditing device (205) is suitable for checking determined database server; And

Described operation requests divider (207) is distributed to described operation requests corresponding database server or is returned miscue according to check result.

6. such as each the described system in the claim 1 to 5, wherein when described operation requests resolver (203) detects types of comments in the described operation requests, detect described types of comments and whether represent the main database server type, represent in the situation of main database server type detecting described types of comments, determine that the database server corresponding with described types of comments is main database server.

7. system as claimed in claim 2, wherein when described operation requests resolver (203) does not detect types of comments in the described operation requests, according to the key word in the database program language statement that comprises in the described operation requests, judge the type of described operation requests.

8. system as claimed in claim 5, wherein

Determined at described operation requests resolver (203) is in the situation of database server, represent that in check result when normal from the database server state, described operation requests divider (207) distributes to described operation requests from database server; Represent when undesired from the database server state in check result, described database auditing device (205) checks main database server, when the main database server state is normal, described operation requests divider (207) is distributed to main database server with described operation requests, when the main database server state was undesired, described operation requests divider (207) returned the disabled miscue of expression database server; Perhaps

In the situation of main database server at the determined database server of described operation requests resolver (203), when check result represented that the main database server state is normal, described operation requests divider (207) was distributed to main database server with described operation requests; When check result represented that the main database server state is undesired, described operation requests divider (207) returned the disabled miscue of expression database server.

9. system as claimed in claim 7, wherein said database program language is Structured Query Language (SQL) SQL, described database is the MySQL database.

Images