TWI578173B - Statistical e-commerce transaction data, e-commerce transaction data statistics system and application server - Google Patents

Description

Method for counting e-commerce transaction data, e-commerce transaction data statistics system and application server

The present application relates to network technologies, and in particular, to a method for counting e-commerce transaction data, an application server, and an e-commerce transaction data statistics system.

With the rapid development of Internet technology, e-commerce has gradually become a necessity for people's daily life, and various e-commerce websites have risen rapidly. For a large e-commerce website, it is especially important to analyze transaction data in real time and conduct business analysis based on transaction data.

In the research and practice of the prior art, the inventors found that the following problems exist in the prior art: for a large e-commerce website, the e-commerce transaction system generally saves the transaction data to the database of the e-commerce transaction system, and There are tens of millions of database operations every day. Due to the real-time data statistics and updates, the acquired data must be processed continuously. If the transaction data is directly counted in the database of the e-commerce transaction system, the burden of the database of the e-commerce transaction system will be greatly increased, and the impact will be greatly affected. A normal business transaction may cause the database of the e-commerce transaction system to crash, which may result in the entire e-commerce website being unavailable.

The purpose of the embodiment of the present application is to provide a method for statistical e-commerce transaction data, an application server, and an e-commerce transaction data statistics system, so as to realize real-time statistical e-commerce transaction data, and does not increase the burden of the e-commerce transaction system database. Therefore, it does not affect normal business transactions.

To solve the above technical problem, the embodiment of the present application provides a method for counting e-commerce transaction data, which is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system, and the e-commerce transaction system includes a first application server and a first database, the e-commerce transaction data statistics system is configured to collect transaction data obtained from the e-commerce transaction system, the e-commerce transaction data statistics system comprises a second application server and a second database The method includes: the second application server immediately obtains the transaction data sent by the first application server; after each time the transaction data is obtained, the second application server analyzes the transaction data to obtain the category of the transaction data. Information; the second application server obtains historical transaction data of the category from the second database according to the information of the category to which the transaction data belongs, wherein the second database is not immediately queried and obtained from the data warehouse system Transaction data that meets the pre-set conditions, and the transaction data obtained Corresponding transaction data to compare, update transaction data inconsistency; the second application server in conjunction with the transaction data and the category of historical transaction data, get the current transaction data that category.

To solve the above technical problem, the embodiment of the present application further provides an application server, which is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system, where the e-commerce transaction system includes a first application. a server and a first database, the e-commerce transaction data statistics system is configured to collect transaction data obtained from the e-commerce transaction system, the e-commerce transaction data statistics system includes the application server and a second database, the application server The device includes: a transaction data processing unit and a transaction data statistics unit; the transaction data processing unit is configured to obtain the transaction data sent by the first application server in real time, and send the transaction data to the transaction after each transaction data is obtained. The data statistics unit is configured to obtain and analyze the transaction data, obtain information about the category of the transaction data, and obtain historical transaction data of the category from the second database according to the information of the category of the transaction data. And combine the transaction data with the history of the category The easy data obtains the current transaction data of the category; wherein the second database non-instantly queries the data warehouse system and obtains transaction data that meets the preset conditions, and compares the obtained transaction data with the corresponding transaction data. , update inconsistent transaction data.

To solve the above technical problem, the embodiment of the present application further provides an e-commerce transaction data statistics system, which is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system, and the e-commerce transaction system includes a first application server and a first database, the e-commerce transaction data statistics system is configured to collect transaction data obtained from the e-commerce transaction system, the e-commerce transaction data statistics system comprises: a second application server and a second data The second application server is configured to obtain the transaction data sent by the first application server in real time, analyze the transaction data after obtaining the transaction data, and obtain information about the category of the transaction data, according to the transaction data. The information of the category, the historical transaction data of the category is obtained from the second database, and the current transaction data of the category is obtained by combining the transaction data and the historical transaction data of the category; the second database is used for storing the transaction data. , not instant query and acquisition of the data warehouse system Preconditions transaction data, transaction data will be compared with the corresponding prior transaction data, updated inconsistent transaction data.

To solve the above technical problem, the embodiment of the present application further provides a method for counting e-commerce transaction data, which is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system, and the e-commerce transaction system The first application server and the first database are used, and the e-commerce transaction data statistics system is configured to collect transaction data obtained from the e-commerce transaction system, and the e-commerce transaction data statistics system comprises a second application server and a second data. The method includes: the second application server immediately obtains the transaction data sent by the first application server; and after the transaction data is obtained, the second application server stores the transaction data to the second database And analyzing the transaction data to obtain information about the category of the transaction data, wherein the second database does not immediately query the data warehouse system and obtain transaction data that meets the preset conditions, and the obtained transaction data is Corresponding transaction data is compared to update inconsistent transaction data; The application server obtains the transaction data and the historical transaction data of the category from the second database according to the information of the category of the transaction data; the second application server combines the transaction data with the historical transaction data of the category, Get current transaction data for this category.

To solve the above technical problem, the embodiment of the present application further provides an application server, which is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system, and the e-commerce transaction system The first application server and the first database are used, and the e-commerce transaction data statistics system is configured to collect transaction data obtained from the e-commerce transaction system, and the e-commerce transaction data statistics system comprises the application server and the second database. The application server includes: a transaction data processing unit and a transaction data statistics unit; the transaction data processing unit is configured to obtain the transaction data sent by the first application server in real time, and store the transaction data each time the transaction data is obtained. Go to the second database, analyze the transaction data, obtain the information of the category of the transaction data, and send a trigger message to the transaction data statistics unit that carries the information of the category of the transaction data, and the trigger message is used to trigger the transaction. Data statistics unit statistical transaction data; the transaction The material statistics unit is configured to obtain the transaction data and the historical transaction data of the category from the second database according to the information of the category of the transaction data, and combine the transaction data with the historical transaction data of the category to obtain the category The current transaction data; wherein, the second database non-instantly queries the data warehouse system and obtains transaction data that meets the preset conditions, compares the obtained transaction data with the corresponding transaction data, and updates the inconsistent transaction data.

To solve the above technical problem, the embodiment of the present application further provides an e-commerce transaction data statistics system, which is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system, and the e-commerce transaction system includes a first application server and a first database, the e-commerce transaction data statistics system is configured to collect transaction data obtained from the e-commerce transaction system, the e-commerce transaction data statistics system comprises: a second application server and a second data The second application server is configured to obtain the transaction data sent by the first application server in real time, and the second application server stores the transaction data in the second database after obtaining the transaction data each time. Analyzing the transaction data, obtaining information about a category of the transaction data, obtaining the transaction data and historical transaction data of the category from the second database according to the information of the category of the transaction data, and the second application server is combined with the transaction information Transaction data and historical transaction data of this category, get the current assignment of the category Data; the second database is used for storing transaction data, and is not immediately inquiring to the data warehouse system and obtaining transaction data that meets the preset conditions, comparing the obtained transaction data with the corresponding transaction data, and updating the inconsistent transaction. data.

It can be seen that, in the embodiment of the present application, the e-commerce transaction data statistics system immediately obtains the transaction data from the application server of the e-commerce transaction system, instead of obtaining the transaction data from the database of the e-commerce transaction system, so that the e-commerce transaction is not increased. The burden of the system's database will not affect the normal business transactions, and will not cause the e-commerce transaction system's database to be down, thus avoiding the entire e-commerce website being unavailable.

The embodiment of the present application provides a method for counting e-commerce transaction data, an application server, and an e-commerce transaction data statistics system.

Before introducing the method for calculating the e-commerce transaction data, the application server, and the e-commerce transaction data statistics system, the network environment and some professional knowledge involved in the application of the present application are first introduced.

The network environment applied in the embodiment of the present application is as shown in FIG. 1. The client 103 can log in to the e-commerce transaction system 101 to perform an e-commerce transaction operation, for example, to perform operations such as establishing a transaction, payment, etc., and the e-commerce transaction system 101 can log the transaction data. And logging to the data repository system 102.

The e-commerce transaction system 101 can provide functions such as merchandise display, transaction creation, transaction management, payment, and the like.

The e-commerce transaction system 101 can include an application server and a database, and the application server can also store the transaction data and the like into the database. In the prior art, in order to count transaction data, a network entity generally needs to obtain transaction data from a database.

The data warehouse system 102 is a subject-oriented, integrated, non-renewable, time-varying data collection record carrier for supporting decision analysis processing of a business or organization. Specifically, the material warehouse system 102 records a detailed change history of the transaction data, and the transaction data changes generated by the user using any operation of the client 101 in the electronic commerce transaction system 101 are recorded in the material warehouse system 102.

The transaction data may refer to information related to the transaction, such as user account number, operation type, transaction amount and the like, and the operation type is, for example, an event such as establishing a transaction or payment.

It should be noted that, in the embodiment of the present application, an e-commerce transaction data statistics system is added on the basis of FIG. 1. As shown in FIG. 2, the e-commerce transaction data statistics system 104 can interact with the e-commerce transaction system 101, or Interact with the data repository system 102. The embodiment of the present application refers to a network system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system as an e-commerce system. In an e-commerce system, an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data The statistical system is connected in pairs. Of course, the e-commerce system can also include other network subsystems and other network entities. For example, other network entities refer to the user terminals that conduct e-commerce transactions in the e-commerce transaction system and manage e-commerce transaction data. The user side used by the administrator of the statistical system. As mentioned above, the e-commerce transaction system 101 can include an application server and a database. For the convenience of the following description, the application server included in the e-commerce transaction system is referred to as a first application server, and the e-commerce is used. The database included in the trading system is called the first database. The e-commerce transaction data statistics system 104 is used to collect transaction data obtained from the e-commerce transaction system 101. The e-commerce transaction data statistics system 104 also includes an application server. For convenience of the following description, the embodiment of the present application collects e-commerce transaction data. The application server included in the system is referred to as a second application server, and the database included in the e-commerce transaction data statistics system is referred to as a second database. All the technical solutions of the embodiments of the present application are applicable to the above electronic commerce system.

The above-mentioned objects, features and advantages of the embodiments of the present application can be more clearly understood and understood by those skilled in the art. Give further details.

First, a method for statistical e-commerce transaction data according to an embodiment of the present application is introduced. As mentioned above, the method is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system. The transaction system includes a first application server and a first database, and the e-commerce transaction data statistics system is configured to collect transaction data obtained from the e-commerce transaction system, the e-commerce transaction data statistics system includes a second application server and a Two databases. As shown in Figure 3, this method includes:

S301: The second application server obtains the transaction data sent by the first application server in real time.

Specifically, the first application server can provide transaction data to the e-commerce transaction data statistics system independent of the e-commerce transaction system and the data warehouse system, and the first application server provides the transaction information to the second application server. Transaction information.

The first application server can immediately provide transaction data to the second application server in such a manner that the first application server can issue an asynchronous message, and the asynchronous message carries the transaction data. An asynchronous message can carry a data generated by a user performing an operation. The asynchronous message can be either a reliable asynchronous message or an unreliable asynchronous message. If the first application server sends a reliable asynchronous message, the asynchronous message may arrive at the second application server without being lost; if the first application server sends an unreliable asynchronous message, then the The phenomenon that the asynchronous message is lost occurs, or the second application server may not receive the asynchronous message. In this case, the second application server may not be able to obtain some transaction data.

In practical applications, the cost of using reliable asynchronous messages will be higher, and the cost of using unreliable asynchronous messages will be lower.

In addition, the action of the first application server to issue the asynchronous message is negligible for the first application server, that is, the action of the first application server to send the asynchronous message does not affect the e-commerce transaction system. Normal business transactions.

After executing S301, S302 is executed: after each transaction data is obtained, the second application server analyzes the transaction data to obtain information about the category of the transaction data.

In the embodiment of the present application, the transaction data may be divided into a plurality of categories, for example, according to the user or the transaction operation type. For example, a transaction data may be data generated by a user performing an e-commerce operation in an e-commerce transaction system by a user, and such transaction data may be considered as transaction materials belonging to the user. For another example, a transaction data may be data generated by a user performing an e-commerce operation in an e-commerce transaction system through a user terminal, and an e-commerce operation is, for example, an operation of paying a seller (ie, a transaction is successful), then Such transaction data can be considered as transaction materials belonging to such e-commerce operations. Of course, the transaction data can also be divided according to other methods, and will not be exemplified here.

After obtaining the transaction data, the second application server may analyze the transaction data to determine the category to which the transaction data belongs, that is, obtain the information of the category to which the transaction data belongs. In the specific implementation, the transaction data sent by the first application server can not only carry the data content of the transaction data, but also carry the information of the category of the transaction data. In this case, the second application server can directly from the transaction data. Get information about the category of the transaction data. The second application server may also pre-store a mapping table for mapping the relationship between the keyword and the category information. One category information may correspond to only one keyword, one category information may also correspond to multiple keywords, and the second application server may obtain transaction data. After that, keywords can be extracted from the transaction data, and the category information corresponding to the keyword can be found in the mapping table by using the keyword, so that the information of the category to which the transaction data belongs can also be obtained. Of course, the second application server can also analyze the transaction data in various other ways to obtain the information of the category of the transaction data, which will not be exemplified here.

After executing S302, executing S303: the second application server obtains historical transaction data of the category from the second database according to the information of the category to which the transaction data belongs, wherein the second database is not instantaneous to the data warehouse The system queries and obtains transaction data that meets the preset conditions, compares the obtained transaction data with the corresponding transaction data, and updates the inconsistent transaction data.

After obtaining the information of the category to which the transaction data belongs, the second application server may send a request message to the second database, where the request message carries the information of the category to which the transaction data belongs, and the request message is used to indicate the historical transaction data of the category to which the transaction data is requested to be provided. After receiving the request message, the second database may use the information of the category of the transaction data carried by the request message as a keyword to locally search the historical transaction data of the category to which the transaction data belongs, and return the found historical transaction data to the second. Application server. In a special case, because the second database may not store the transaction data of the category to which the transaction data belongs, the second database may return a response message to the second application server after receiving the request message, and the response message is used. It means that there is no history transaction data such as the category of the transaction data.

As mentioned earlier, if the first application server sends an unreliable asynchronous message, the second application server may not receive some asynchronous messages, which may result in the second application server may not be able to get some transactions. data. In this regard, the second database may inquire non-instantly to the data warehouse system and obtain transaction data that meets the preset conditions, compare the obtained transaction data with the corresponding transaction data, and update the inconsistent transaction data.

In practical applications, the second database can query the data warehouse system and obtain transaction data that meets the preset conditions every preset period. The preset period can be set by a person skilled in the art according to actual needs, for example, 10 minutes. The preset condition can also be set by a person skilled in the art according to actual needs, for example, all the changed data in the most recent period, and all the changed data can refer to the newly added data.

The second database can compare the obtained transaction data that meets the preset conditions with the previously saved transaction data that meets the preset conditions. If they are consistent, the transaction data may be left unprocessed, and if there is inconsistent data, the inconsistent transaction is updated. data.

After executing S303, executing S304: the second application server combines the transaction data and the historical transaction data of the category to obtain current transaction data of the category.

In a specific implementation, the second application server may perform real-time statistics on the transaction data according to statistical rules. Before the second application server performs real-time statistical processing on the transaction data according to the statistical rule, the statistical rule for statistical processing of the transaction data set by the user end can be obtained. For example, before the second application server performs statistical processing on the transaction data according to the statistical rule, the administrator who manages the e-commerce transaction data statistics system sets a statistical rule on the user end, and the user terminal provides the statistical rule to the second application server. In this way, the second application server obtains the statistical rules set by the client.

In practical applications, the above statistical rules include, for example, a provision for superimposing transaction data of the same category. In this case, the second application server may superimpose the obtained transaction data with the historical transaction data of the same category.

For example, the user belongs to the category in which the transaction data belongs. The second database can store the transaction record of the user in units of one user, or each user information only corresponds to one transaction record, and each transaction record only corresponds to one user information. The transaction data of this user is recorded in the transaction record. In a specific implementation, after obtaining the transaction data of the user and the historical transaction data of the user, the second application server superimposes the transaction data of the user and the historical transaction data of the user to obtain the current transaction data of the user, and then The current transaction data of the user is stored in the transaction record of the user saved in the second database.

For example, suppose that the transaction record of the user 1 records the account number of the user 1, the number of transactions established, the total amount of the transaction, and the like, and assumes that the user 1 completes a transaction in the e-commerce transaction system through the user terminal, and the first application server is The transaction data generated includes the transaction amount, and after the second application server obtains the transaction data, if it is determined that the transaction data corresponds to the user 1, the second application server requests the second database to provide the historical transaction of the user 1. After the second database finds the transaction record corresponding to the user 1, the second database returns the historical transaction data of the user 1 to the second application server. After that, the second application server adds the transaction amount obtained to the original transaction total amount in the transaction record corresponding to the user 1 (ie, the acquired transaction data of the user 1 and the historical transaction data of the user 1) to obtain a new transaction. The total amount (ie the current transaction data of User 1). . After the second application server obtains the total amount of the new transaction, the total amount of the new transaction can be provided to the client used by the administrator, or the display curve of the total transaction amount of the user 1 is plotted according to the total amount of the new transaction, the administrator By displaying the curve, it is possible to intuitively understand the trend of the total amount of the transaction of the user 1.

Take the category of the transaction data as an example of the type of transaction operation. Each transaction data corresponds to at least one transaction data category, such as the total amount of transactions over a period of time, the total number of transactions established over a period of time, or the total number of successful transactions over a period of time. In a specific implementation, after obtaining the transaction data of the transaction operation type and the historical transaction data of the transaction operation type, the second application server superimposes the transaction information of the transaction operation type and the historical transaction data of the transaction operation type to obtain The current transaction data for this transaction type.

For example, suppose that the second application server needs to count the total amount of transactions over a period of time (the type of transaction operation is payment and/or collection, which may not distinguish users), and assume that user 1 completes in the e-commerce transaction system through the client. a transaction, the transaction data generated by the second application server for this includes the transaction amount, and after the second application server obtains the transaction data, if it is determined that the transaction amount in the transaction data corresponds to the payment and/or collection category, then The second application server requests the second database to provide the historical transaction amount corresponding to the payment and/or payment, and the second database finds the historical transaction amount corresponding to the payment and/or the payment, and then sends the second transaction server to the second application server. Returns the historical transaction amount corresponding to the payment and/or receipt. Thereafter, the second application server adds the obtained transaction amount to the historical transaction amount corresponding to the payment and/or the receipt, and obtains the new transaction total amount corresponding to the payment and/or the receipt. After obtaining the new transaction total amount corresponding to the payment and/or payment, the second application server may provide the total amount of the new transaction to the client used by the administrator, or draw the total amount of the new transaction for a period of time according to the total amount of the new transaction. The display curve of the total amount of transactions within the transaction, the administrator can intuitively understand the trend of the total amount of transactions over a period of time by displaying the curve.

As mentioned above, the transaction data of the second database obtained from the data warehouse system that meets the preset conditions may not be consistent with the previously saved transaction data that meets the preset conditions. If the transaction data of the second database obtained from the data warehouse system that meets the preset conditions is inconsistent with the previously saved transaction data that meets the preset conditions, the second application server may perform statistics based on the data provided by the data warehouse system. That is to say, the data provided by the second database to the second application server is complete and accurate data stored by the data warehouse system, so that the second application server is based on complete and accurate data.

For example, suppose that within 10 minutes, user 1 completes a transaction in the e-commerce transaction system through the client, the first application server issues an asynchronous message, and the non-synchronized message carries the first application server as the transaction. The generated transaction data, the transaction data includes the transaction amount, but the second application server does not receive the asynchronous message. At the end of 10 minutes, the second database sent a request to the data warehouse system to query the data that changed within 10 minutes. The data warehouse system returned the data that changed within 10 minutes to the second database. The changed information includes the transaction amount mentioned above, and the second database compares the data obtained by the data warehouse system within 10 minutes with the data saved within 10 minutes, and determines that the user has not obtained the user. 1 transaction data generated by a transaction completed within 10 minutes. For this, the second database saves the transaction data generated by the user 1 for a transaction completed within 10 minutes to the transaction record corresponding to the user 1, After that, the second application server may modify the display curve corresponding to the transaction amount of the user 1, and provide the modified display curve to the client used by the administrator.

Optionally, after executing S301, the second application server may record the log of obtaining the transaction data in the transaction data log table in the second database. The transaction data log table can construct a record in units of a user-initiated event, or construct a record in units of an asynchronous message.

In addition, the second application server can store the transaction data in the second database after obtaining the transaction data each time. The second database can also analyze the transaction data, obtain the information of the category of the transaction data, and bind the transaction data with the information of the category to which it belongs. In this way, when the second database searches for the transaction data of this category, it can find all the transaction materials bound to the category according to the binding relationship.

In addition, in practical applications, the administrator managing the e-commerce system may need to query the transaction data. In this case, the client used by the administrator may send a request to the second application server to query the transaction data that meets certain conditions. The message, after the second application server obtains the request message, may send a transaction data that meets the condition to the second database, and the second database returns the transaction data that meets the condition, and returns the information to the second application server. The transaction data of the condition, the second application server returns the transaction data that meets the condition to the client used by the administrator.

Corresponding to the embodiment of the method for monitoring an event of the present application, the present application also provides an embodiment of an application server disposed in an e-commerce transaction data statistics system. The application server is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system. The e-commerce transaction system includes a first application server and a first database, and the e-commerce transaction data The statistical system is configured to count transaction data obtained from the e-commerce transaction system, and the e-commerce transaction data statistics system includes the application server and the second database. As shown in FIG. 4, the application server includes: a transaction data processing unit 401 and a transaction data statistics unit 402. The transaction data processing unit 401 is configured to obtain the transaction data sent by the first application server in real time, and obtain the transaction each time. After the data is sent, the transaction data is sent to the transaction data statistics unit 402. The transaction data statistics unit 402 is configured to obtain and analyze the transaction data, and obtain information about the category of the transaction data, according to the information of the category of the transaction data. The second database obtains the historical transaction data of the category, and combines the transaction data with the historical transaction data of the category to obtain the current transaction data of the category; wherein the second database is not immediately queried to the data warehouse system and Obtain transaction data that meets the preset conditions, compare the obtained transaction data with the corresponding transaction data, and update the inconsistent transaction data.

In an actual application, the transaction data processing unit 401 sends the transaction data to the transaction data statistics unit 402 each time the transaction data is obtained, and the essence is that the transaction data statistics unit 402 is triggered to perform statistical processing on the transaction data. In a specific implementation, the transaction data processing unit 401 may send a trigger message to the transaction data statistics unit 402 for triggering the transaction data statistics unit 402 to perform statistics on the transaction data, and the trigger message carries the transaction data.

In an actual application, after the transaction data statistics unit 402 obtains the transaction data, the transaction data may be analyzed to determine the category to which the transaction data belongs, that is, the information of the category to which the transaction data belongs. In a specific implementation, the transaction data sent by the first application server can not only carry the data content of the transaction data, but also carry the information of the category of the transaction data. In this case, the transaction data statistics unit 402 can directly from the transaction data. Get information about the category of the transaction data. The transaction data statistic unit 402 may also pre-store a mapping table of the mapping relationship between the record keyword and the category information. One category information may correspond to only one keyword, one category information may also correspond to multiple keywords, and the transaction data statistic unit 402 obtains transaction data. After that, keywords can be extracted from the transaction data, and the category information corresponding to the keyword can be found in the mapping table by using the keyword, so that the information of the category to which the transaction data belongs can also be obtained. Of course, the transaction data statistics unit 402 can also analyze the transaction data in various other ways to obtain the information of the category to which the transaction data belongs, and no further examples are given here.

After obtaining the information of the category to which the transaction data belongs, the transaction data statistics unit 402 may send a request message to the second database, the request message carries the information of the category to which the transaction data belongs, and the request message is used to indicate the historical transaction data of the category to which the transaction data is requested to be provided. After receiving the request message, the second database may use the information of the category of the transaction data carried in the request message as a keyword, locally search the historical transaction data of the category to which the transaction data belongs, and return the found historical transaction data to the transaction data. Statistics unit 402. In a special case, since the second database may not store the transaction data of the category to which the transaction data belongs, the second database may return a response message to the transaction data statistics unit 402 after receiving the request message, and the response message is used. It means that there is no history transaction data such as the category of the transaction data.

In practical applications, the transaction data statistics unit 402 can perform real-time statistics on transaction data according to statistical rules. The transaction data statistics unit 402 can obtain the statistical rules for statistical processing of the transaction data set by the client before performing the real-time statistical processing on the transaction data according to the statistical rules. For example, before the transaction data statistics unit 402 performs statistical processing on the transaction data according to the statistical rule, the administrator managing the e-commerce transaction data statistics system sets a statistical rule on the user end, and the user terminal provides the statistical rule to the transaction data statistical unit 402. Thus, the transaction data statistic unit 402 obtains the statistical rules set by the client.

In practical applications, the above statistical rules include, for example, a provision for superimposing transaction data of the same category. In this case, the transaction data statistics unit 402 may superimpose the obtained transaction data with the historical transaction data of the same category.

In an actual application, if the transaction data obtained by the second database from the data warehouse system that meets the preset condition is inconsistent with the previously saved transaction data that meets the preset condition, the transaction data statistics unit 402 may use the data provided by the data warehouse system. For the purpose of statistics. That is to say, the data provided by the second database to the transaction data statistics unit 402 is complete and accurate data stored by the data warehouse system. Thus, the transaction data statistics unit 402 performs statistics based on complete and accurate data.

In an actual application, the transaction data processing unit 401 may record the log of the obtained transaction data in the transaction data log table in the second database after each time the transaction data is obtained.

In an actual application, the transaction data processing unit 401 may store the transaction data in the second database after obtaining the transaction data each time. After obtaining the transaction data, the transaction data statistics unit 402 may also store the transaction data in the second database. In an actual application, one of the transaction data processing unit 401 and the transaction data statistics unit 402 may store the transaction data in the second database.

In an actual application, an administrator managing the e-commerce system may need to query the transaction data. In this case, the client used by the administrator may send a request message to the transaction data statistics unit 402 to query the transaction data that meets certain conditions. After obtaining the request message, the transaction data statistics unit 402 may issue a transaction data that meets the condition to the second database. After the second database finds the transaction data that meets the condition, the transaction data statistic unit 402 returns a condition that meets the condition. In the transaction data, the transaction data statistic unit 402 returns the transaction data that meets the conditions to the client used by the administrator.

Since the application server embodiment shown in FIG. 4 is an embodiment corresponding to the method embodiment shown in FIG. 3, the functions and mutual cooperation relationships of the respective functional units in the application server shown in FIG. For a description, reference may be made to the related description in the method embodiment shown in FIG. 3, and details are not described herein again.

It can be seen from the method shown in FIG. 3 that many steps in the method shown in FIG. 3 are performed by using an application server included in the e-commerce transaction data statistics system, and the application server shown in FIG. 4 is also disposed. The e-commerce transaction data statistics system, therefore, the embodiment of the present application also provides an e-commerce transaction data statistics system. The e-commerce transaction data statistics system is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system, the e-commerce transaction system including a first application server and a first database, the electronic The business transaction data statistics system is used to count transaction data obtained from the e-commerce transaction system.

As shown in FIG. 5, the e-commerce transaction data statistics system includes a second application server and a second database 502. The second application server 501 is configured to obtain the transaction data sent by the first application server in real time. After obtaining the transaction data, analyzing the transaction data, obtaining the information of the category of the transaction data, obtaining the historical transaction data of the category from the second database 502 according to the information of the category of the transaction data, and combining the transaction data and The historical transaction data of the category obtains the current transaction data of the category; the second database 502 is used for storing the transaction data, and is not an instant query to the data warehouse system and obtaining the transaction data that meets the preset conditions, and the transaction data to be obtained. Compare with the corresponding transaction data to update the inconsistent transaction data.

Optionally, the second database 502 may be provided with a transaction data log table for storing the log of the transaction data and a transaction data reference table for storing the transaction data. In the transaction data log table, a record can be in units of a user-initiated event. In the transaction data reference table, a record can be in units of one user. The second application server 501 can record the log of the transaction data in the transaction data log table.

For a detailed description of the specific functions and the mutual cooperation relationship between the second application server 501 and the second database 502, reference may be made to the method embodiment shown in FIG. 3 and the related description in the application server embodiment shown in FIG. Let me repeat.

In addition to the method implementation shown in FIG. 3, the embodiment of the present application also provides a method for counting e-commerce transaction data. The method is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system and an e-commerce transaction data statistics system, the e-commerce transaction system comprising a first application server and a first database, the e-commerce transaction data statistics system For counting transaction data obtained from the e-commerce transaction system, the e-commerce transaction data statistics system includes a second application server and a second database. As shown in Figure 6, the method includes:

S601: The second application server immediately obtains the transaction data sent by the first application server.

Specifically, the first application server can provide transaction data to the e-commerce transaction data statistics system independent of the e-commerce transaction system and the data warehouse system, and the first application server provides the transaction information to the second application server. Transaction information.

The first application server can immediately provide transaction data to the second application server in such a manner that the first application server can issue an asynchronous message, and the asynchronous message carries the transaction data. An asynchronous message can carry a data generated by a user performing an operation. The asynchronous message can be either a reliable asynchronous message or an unreliable asynchronous message. If the first application server sends a reliable asynchronous message, the asynchronous message may arrive at the second application server without being lost; if the first application server sends an unreliable asynchronous message, then the The phenomenon that the asynchronous message is lost occurs, or the second application server may not receive the asynchronous message. In this case, the second application server may not be able to obtain some transaction data.

In practical applications, the cost of using reliable asynchronous messages will be higher, and the cost of using unreliable asynchronous messages will be lower.

In addition, the action of the first application server to issue the asynchronous message is negligible for the first application server, that is, the action of the first application server to send the asynchronous message does not affect the e-commerce transaction system. Normal business transactions.

S602: After obtaining the transaction data, the second application server stores the transaction data in the second database, and analyzes the transaction data to obtain information about the category of the transaction data, wherein the second database Non-instantly querying and obtaining the transaction data that meets the preset conditions to the data warehouse system, comparing the obtained transaction data with the corresponding transaction data, and updating the inconsistent transaction data.

In the embodiment of the present application, the transaction data may be divided into a plurality of categories, for example, according to the user or the transaction operation type.

After the second application server obtains the transaction data, the transaction data is stored in the second database, and the transaction data is also analyzed to obtain the information of the category of the transaction data. In practical applications, storing the transaction data in the second database and analyzing the transaction data can be performed simultaneously or sequentially. If it is performed sequentially, then there is no inevitable sequence, or which operation can be performed first.

In the specific implementation, the transaction data sent by the first application server can not only carry the data content of the transaction data, but also carry the information of the category of the transaction data. In this case, the second application server can directly from the transaction data. Get information about the category of the transaction data. The second application server may also pre-store a mapping table for mapping the relationship between the keyword and the category information. One category information may correspond to only one keyword, one category information may also correspond to multiple keywords, and the second application server may obtain transaction data. After that, keywords can be extracted from the transaction data, and the category information corresponding to the keyword can be found in the mapping table by using the keyword, so that the information of the category to which the transaction data belongs can also be obtained. Of course, the second application server can also analyze the transaction data in various other ways to obtain the information of the category of the transaction data, which will not be exemplified here.

As mentioned earlier, if the first application server sends an unreliable asynchronous message, the second application server may not receive some asynchronous messages, which may result in the second application server may not be able to get some transactions. data. In this regard, the second database may inquire non-instantly to the data warehouse system and obtain transaction data that meets the preset conditions, compare the obtained transaction data with the corresponding transaction data, and update the inconsistent transaction data.

In practical applications, the second database can query the data warehouse system and obtain transaction data that meets the preset conditions every preset period. The preset period can be set by a person skilled in the art according to actual needs, for example, 10 minutes. The preset condition can also be set by a person skilled in the art according to actual needs, for example, all the changed data in the most recent period, and all the changed data can refer to the newly added data.

The second database can compare the obtained transaction data that meets the preset conditions with the previously saved transaction data that meets the preset conditions. If they are consistent, the transaction data may be left unprocessed, and if there is inconsistent data, the inconsistent transaction is updated. data.

S603: The second application server obtains the transaction data and the historical transaction data of the category from the second database according to the information of the category to which the transaction data belongs.

After obtaining the information of the category to which the transaction data belongs, the second application server may send a request message to the second database, where the request message carries the information of the category to which the transaction data belongs, and the request message is used to indicate all the transaction materials requesting to provide the category of the transaction data. Includes acquired transaction data and historical transaction data. After receiving the request message, the second database may use the information of the category of the transaction data carried by the request message as a key to locally search all the transaction materials of the category to which the transaction data belongs, and return all the found transaction data to the second. Application server. In special cases, the second database may not store historical transaction data of the category of the above transaction data for one reason or some reasons. In this case, the second database can only return to the second application server. The transaction data of the category of the transaction data obtained by the application server is not returned to the historical transaction data of the category of the transaction data.

S604: The second application server combines the transaction data and the historical transaction data of the category to obtain current transaction data of the category.

It should be noted that although the second application server has previously stored the obtained transaction data into the second database, the second database may simply bind the obtained transaction data to the corresponding category, instead of The same type of transaction data is superimposed and the like. In this case, the transaction data of this category stored in the second database includes at least the transaction data obtained by the second application server and the historical transaction data of this category. Therefore, the transaction data of the category obtained by the second application server from the second database includes at least the transaction data obtained by the second application server and the historical transaction data of the category. Therefore, the second application server can combine the transaction data obtained by itself and the historical transaction data of this category to obtain the current transaction data of this category.

In a specific implementation, the second application server may perform real-time statistics on the transaction data according to statistical rules. Before the second application server performs real-time statistical processing on the transaction data according to the statistical rule, the statistical rule for statistical processing of the transaction data set by the user end can be obtained. For example, before the second application server performs statistical processing on the transaction data according to the statistical rule, the administrator who manages the e-commerce transaction data statistics system sets a statistical rule on the user end, and the user terminal provides the statistical rule to the second application server. In this way, the second application server obtains the statistical rules set by the client.

In practical applications, the above statistical rules include, for example, a provision for superimposing transaction data of the same category. In this case, the second application server may superimpose the obtained transaction data with the historical transaction data of the same category.

As mentioned above, the transaction data of the second database obtained from the data warehouse system that meets the preset conditions may not be consistent with the previously saved transaction data that meets the preset conditions. If the transaction data of the second database obtained from the data warehouse system that meets the preset conditions is inconsistent with the previously saved transaction data that meets the preset conditions, the second application server may perform statistics based on the data provided by the data warehouse system. That is to say, the data provided by the second database to the second application server is complete and accurate data stored by the data warehouse system, so that the second application server is based on complete and accurate data.

Optionally, after executing S601, the second application server may record the log of obtaining the transaction data in the transaction data log table in the second database. The transaction data log table can construct a record in units of a user-initiated event, or construct a record in units of an asynchronous message.

In addition, after the second application server stores the transaction data in the second database, the second database may also analyze the transaction data, obtain the information of the category of the transaction data, and bind the transaction data with the information of the category to which it belongs. In this way, when the second database searches for the transaction data of this category, it can find all the transaction materials bound to the category according to the binding relationship.

In addition, in practical applications, the administrator managing the e-commerce system may need to query the transaction data. In this case, the client used by the administrator may send a request to the second application server to query the transaction data that meets certain conditions. The message, after the second application server obtains the request message, may send a transaction data that meets the condition to the second database, and the second database returns the transaction data that meets the condition, and returns the information to the second application server. The transaction data of the condition, the second application server returns the transaction data that meets the condition to the client used by the administrator.

The method embodiment shown in FIG. 6 has the same technical features as the method embodiment shown in FIG. 3 . For a detailed description of the same technical features, reference may be made to the related description in the method embodiment shown in FIG. 3 , and details are not described herein again. .

Corresponding to the method embodiment shown in FIG. 6, the present application also provides an embodiment of an application server disposed in an e-commerce transaction data statistics system. The application server is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system. The e-commerce transaction system includes a first application server and a first database, and the e-commerce transaction data The statistical system is configured to count transaction data obtained from the e-commerce transaction system, and the e-commerce transaction data statistics system includes the application server and the second database. Referring to FIG. 4 again, the application server includes: a transaction data processing unit 401 and a transaction data statistics unit 402. The transaction data processing unit 401 is configured to obtain the transaction data sent by the first application server in real time, and obtain the transaction data each time. And storing the transaction data in the second database, analyzing the transaction data, obtaining information about the category of the transaction data, and sending a trigger message to the transaction data statistics unit 402 that carries the information of the category to which the transaction data belongs. The trigger message is used to trigger the transaction data statistics unit 402 to count the transaction data; the transaction data statistics unit 402 is configured to obtain the transaction data and the historical transaction data of the category from the second database according to the information of the category to which the transaction data belongs, and Combining the transaction data with the historical transaction data of the category, obtaining current transaction data of the category; wherein the second database is non-instantly querying the data warehouse system and obtaining the transaction data meeting the preset condition, and the transaction to be obtained The data is compared with the corresponding transaction data to update the inconsistent transaction data.

A significant difference between this application server embodiment and the previously described application server embodiment is that in this application server embodiment, the transaction data processing unit 401, after obtaining the information of the category to which the transaction data belongs, to the transaction data The statistic unit 402 issues a trigger message that does not carry the transaction data but carries the information of the category to which the transaction material belongs. The transaction data statistics unit 402 obtains from the second database the transaction data obtained by the transaction data processing unit 401 and the historical transaction data of this category.

This application server embodiment has many of the same technical features as the application server embodiment described above. For example, the transaction data processing unit 401 records the log of the transaction data in the second database each time the transaction data is obtained. The transaction data in the log table. For a detailed description of these same technical features, reference may be made to the related description in the application server embodiment described above, and details are not described herein again.

In addition, the application server embodiment corresponds to the method embodiment shown in FIG. 6. Therefore, the functions and mutual cooperation relationships of the functional units in the application server can be implemented by referring to the method shown in FIG. 6. The related descriptions in the examples are not described here.

It can be seen from the method shown in FIG. 6 that many steps in the method shown in FIG. 6 are performed by using an application server included in the e-commerce transaction data statistics system, and the corresponding application server is also set in the e-commerce transaction. In the data statistics system, the embodiment of the present application further provides an e-commerce transaction data statistics system. The e-commerce transaction data statistics system is applicable to an e-commerce system including an e-commerce transaction system, a data warehouse system, and an e-commerce transaction data statistics system, the e-commerce transaction system including a first application server and a first database, the electronic The business transaction data statistics system is used to count transaction data obtained from the e-commerce transaction system. Referring to FIG. 5, the e-commerce transaction data statistics system includes: a second application server 501 and a second database 502. The second application server 501 is configured to obtain the transaction data sent by the first application server in real time. After the transaction data is obtained, the second application server 501 stores the transaction data in the second database 502, analyzes the transaction data, and obtains information about the category of the transaction data, according to the information of the category of the transaction data. The second database 502 obtains the transaction data and the historical transaction data of the category, and the second application server 501 combines the transaction data and the historical transaction data of the category to obtain the current transaction data of the category; the second database 502 In the storage of the transaction data, it is not instantaneous to query the data warehouse system and obtain the transaction data that meets the preset conditions, compare the obtained transaction data with the corresponding transaction data, and update the inconsistent transaction data.

Optionally, the second database 502 may be provided with a transaction data log table for storing the log of the transaction data and a transaction data reference table for storing the transaction data. In the transaction data log table, a record can be in units of a user-initiated event. In the transaction data reference table, a record can be in units of one user. The second application server 501 can record the log of the transaction data in the transaction data log table.

For a detailed description of the specific functions of the second application server 501 and the second database 502 and the mutual cooperation relationship, reference may be made to the related embodiments in the method embodiment and the corresponding application server embodiment shown in FIG. 6, and details are not described herein again.

It can be seen from the description of the foregoing embodiments that, in the embodiment of the present application, the application server of the e-commerce transaction data statistics system obtains the transaction data from the application server of the e-commerce transaction system in real time, instead of the database from the e-commerce transaction system. Instant access to transaction data, which will not increase the burden of the e-commerce transaction system database, so as not affecting normal business transactions, and will not cause the e-commerce transaction system database to crash, thereby avoiding the entire e-commerce website. Not available.

In addition, the application server of the e-commerce transaction system can provide transaction data to the e-commerce transaction data statistics system by issuing asynchronous and unreliable messages, which will not affect the normal business transactions in the e-commerce transaction system, and also reduce the implementation cost. .

In addition, the e-commerce transaction data statistics system can obtain the data that meets certain conditions from the data warehouse system in a non-instantaneous manner, especially the transaction data that has changed in the most recent cycle, so that even if the e-commerce transaction data statistics system is in a cycle If all the unsynchronized messages are not received, or if all the transaction data are not received within one cycle, then the e-commerce transaction data statistics system can be guaranteed to obtain all the transaction data after the end of the cycle, so that Statistical processing provides a more accurate data base.

As can be seen from the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of a software plus a necessary universal hardware platform. Based on such understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in the form of a software product, which can be stored in a storage medium such as a ROM/RAM, a disk, A disc or the like includes instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the present application or portions of the embodiments.

The various embodiments in the specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

This application can be used in a variety of general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics devices, network PCs, small computers, Large computers, decentralized computing environments including any of the above systems or devices, and more.

The application can be described in the general context of computer-executable instructions executed by a computer, such as a program module. Generally, a program module includes routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types. The present application can also be practiced in a distributed computing environment where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.

While the present invention has been described by the embodiments of the present invention, it will be understood by those skilled in the art .

101. . . E-commerce trading system

102. . . Data warehouse system

103. . . user terminal

104. . . E-commerce transaction data statistics system

401. . . Transaction data processing unit

402. . . Transaction data statistic unit

501. . . Second application server

502. . . Second database

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only Some of the embodiments described in the application can be used to obtain other drawings based on these drawings without departing from the prior art.

1 is a schematic diagram of a network environment applied to an embodiment of the present application;

2 is a schematic diagram of a network environment including an e-commerce transaction data statistics system applied in an embodiment of the present application;

3 is a flowchart of a method for counting e-commerce transaction data according to an embodiment of the present application;

4 is a schematic diagram of a logical structure of an application server according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a logical structure of an e-commerce transaction data statistics system according to an embodiment of the present application; FIG.

FIG. 6 is a flowchart of another method for counting e-commerce transaction data according to an embodiment of the present application.

Claims (16)

A method for counting e-commerce transaction data, the method comprising: receiving, from a first application server of an e-commerce transaction system, one or more non-synchronized messages including transaction data, the e-commerce transaction system including the first application server and Storing a first database of the transaction data, wherein the one or more non-synchronized messages are unreliable and prone to data loss: analyzing the received transaction data to identify a category of the received transaction data, the analysis Including extracting a keyword from the received transaction data, and searching for the category of the received transaction data in the keyword and category mapping relationship according to the keyword; at least in part according to the category of the received transaction data, from the second data Obtaining historical transaction data in the library, wherein the historical transaction data includes a predetermined time condition and is different from the e-commerce transaction system by a predetermined time interval in response to the unreliable one or more asynchronous messages Transaction data obtained by querying the data warehouse system, wherein the transaction data conforming to the preset condition includes Transaction data that has changed in the most recent time interval; and the transaction data received from the first application server is compared with the historical transaction data received from the second database to update the inconsistency in the historical transaction data And combining the received transaction data and the historical transaction data to generate current transaction data. The method of claim 1, wherein the connection is The category of the transaction data received is based on the type of user or transaction operation. The method of claim 1, further comprising storing the received transaction data in the second database. The method of claim 1, further comprising storing the log of the received transaction data in a transaction data log table in the second database. The method of claim 4, wherein the transaction data log table records data in a unit for recording by a user-initiated event, or the one or more non-received from the first application server. The sync message is a unit for recording to record data. An application server of an e-commerce transaction data statistics system, implemented by one or more computing devices, the application server comprising: a transaction data processing unit; and a transaction data statistics unit, the transaction data processing unit is used for: e-commerce The transaction system receives the transaction data, and transmits the received transaction data to the transaction data statistics unit; and the transaction data statistics unit is configured to: analyze the received transaction data, and obtain history from the database of the e-commerce transaction statistics system Transaction data, and combining the received transaction data and the obtained historical transaction data to generate current transaction data, wherein the first transaction received from the application server The previously acquired transaction data is tied to a category and is not superimposed with other historical transaction data for that category in the database. The application server of claim 6, wherein the transaction data processing unit or the transaction data statistics unit stores the received transaction data in the database. The application server of claim 6, wherein the transaction data processing unit stores the log of the received transaction data in a transaction data log table in the database. The application server according to claim 8, wherein the application server includes a second application server, and the transaction data log table records the data in a unit for recording by a user-initiated event, or The asynchronous message sent by the first application server to the second application server is a unit for recording to record data. The application server of claim 6, wherein the transaction data processing unit receives one or more asynchronous messages from the electronic commerce transaction system, the one or more asynchronous messages including the received transaction data. The application server of claim 6, wherein the category belongs to one of a plurality of categories including a total amount of transactions, a total number of transactions established, and a total number of successful transactions. The application server of claim 6, wherein the transaction data processing unit stores the received transaction data in the database, and transmits a trigger message to the transaction data statistics unit, the trigger message indicating the The type of transaction data received and trigger the transaction statistics The unit performs statistics on the received transaction data. An e-commerce transaction data statistics system is implemented by one or more computing devices, the e-commerce transaction data statistics system includes: a second application server and a second database; the second application server is configured to: The application server and the first application server of the e-commerce transaction system of the first database receive one or more asynchronous messages, and the e-commerce transaction system is different from the e-commerce transaction data statistics system, and analyzes the received transaction. Data to identify a category of the received transaction data, the analysis comprising extracting a keyword from the received transaction data, and searching for the category of the received transaction data in the keyword and category mapping relationship according to the keyword, from the The second database obtains historical transaction data under the category, and combines the received transaction data with historical transaction data of the category to generate current transaction data and the second database is used: by responding to unreliable The one or more asynchronous messages that are prone to data loss are different from the e-commerce every preset time interval The statistical trading system and the data warehouse system of the e-commerce transaction system query to obtain the transaction data that meets the preset condition, wherein the obtained transaction data that meets the preset condition includes the transaction data that changes during the most recent time interval. , Receiving, from the second application server, a request message including a category of the received transaction data, using the category of the received transaction data included in the request message as the keyword to find a transaction data in the received transaction data The historical transaction data under the category, and providing the historical transaction data to the second application server. The e-commerce transaction data statistics system of claim 13, wherein the second application server stores the log of the received transaction data in a transaction data log table in the second database. The e-commerce transaction data statistics system of claim 14, wherein the transaction data log table records the data in a unit for recording by a user-initiated event, or one received from the first application server. Or multiple non-synchronous messages are records for the unit used for recording. The e-commerce transaction data statistics system of claim 13, wherein the category of the received transaction data is based on a user or a type of transaction operation.