CN109408751A - A kind of data processing method, terminal, server and storage medium - Google Patents
A kind of data processing method, terminal, server and storage medium Download PDFInfo
- Publication number
- CN109408751A CN109408751A CN201811134278.2A CN201811134278A CN109408751A CN 109408751 A CN109408751 A CN 109408751A CN 201811134278 A CN201811134278 A CN 201811134278A CN 109408751 A CN109408751 A CN 109408751A
- Authority
- CN
- China
- Prior art keywords
- data
- server
- cache
- business
- business datum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
In a kind of data processing method provided in an embodiment of the present invention, terminal, server and storage medium, this method comprises: obtaining the source business datum of its storage from business data server；The source business datum is handled according to pre-set business classifying rules, obtains cache file, the cache file characterization carries out the data after taxonomic revision to source data；The cache file is distributed at least one service server, for being used when the response business access request of at least one described service server.
Description
Technical field
The present invention relates in computer internet field data processing technique more particularly to a kind of data processing method,
Terminal, server and storage medium.
Background technique
Caching technology is to promote one of the important means of internet product experience.Caching is exactly the buffer area of data exchange
(referred to as Cache) can search the number of needs when the business access request based on user is wanted to read data from caching first
According to, if having found directly execute business access request, can not find if if looked for from data server, finishing service access
The response of request.
Currently, accessing the same business datum server by multiple service servers in the scheme of distributed caching
In data formed distributed system.Wherein, the foundation of caching generallys use LRU (Least Recently Used) scheme, i.e.,
The business datum that user's request uses is temporarily stored in local memory by each service server, straight when next time visits again
It connects and reads above-mentioned business datum.That is, this caching requested and established based on user is using service server
The caching of business datum is carried out, when user carries out business access request, obtaining for business datum is carried out by service server
It takes, is first searched from the caching in service server, if not stored mistake, go to carry out industry in the business datum server of rear end
The acquisition for data of being engaged in.
However, in each service server cold-start phase, data cached hit rate is using above-mentioned buffering scheme
Under relatively low, and in distributed system, each service server may have the read-write operation of business datum server very much,
So when carrying out business access request, meeting when being requested using the data response business access of the caching in service server
There are problems that data consistency.
Summary of the invention
The embodiment of the present invention provides a kind of data processing method, terminal, server and storage medium, can guarantee that data are visited
Data consistency when asking, and improve the hit rate data cached in cold-start phase.
The technical solution of the embodiment of the present invention is achieved in that
The embodiment of the present invention provides a kind of data processing method, comprising:
The source business datum of its storage is obtained from business data server；
The source business datum is handled according to pre-set business classifying rules, obtains cache file, the caching text
Part characterization carries out the data after taxonomic revision to source data；
The cache file is distributed at least one service server, is responded at least one described service server
Business access uses when requesting.
The embodiment of the present invention also provides a kind of data processing method, comprising:
Receive the cache file of cache server distribution；The cache file is that the cache server takes business datum
What the source business datum in business device obtained after being handled；
Data in the cache file are loaded onto local cache；
When the business access for receiving terminal is requested, the industry is read from the cache file of the local cache
The business requested target service data of access request；
Give the target service data feedback to the terminal.
The embodiment of the present invention provides a kind of data processing method again, comprising:
It is asked in the client by calling the access interface of service server to send business access to the service server
It asks, executes response operation to trigger the service server:
The business access is read from the cache file of local cache requests requested target service data；Its
In, the cache file be after being handled by the cache server the source business datum in business datum server by
The cache server distribution, and load in the local cache；
The target service data are received, and the target service data are presented.
The embodiment of the present invention provides a kind of cache server, comprising:
First receiving unit, for obtaining the source business datum of its storage from business data server；
Processing unit obtains caching text for handling according to pre-set business classifying rules the source business datum
Part, the cache file characterization carry out the data after taxonomic revision to source data；
First transmission unit, for the cache file to be distributed at least one service server, for it is described at least
It is used when one service server response business access request.
The embodiment of the present invention provides a kind of service server, comprising:
Second receiving unit, for receiving the cache file of cache server distribution；The cache file is the caching
What server obtained after handling the source business datum in business datum server；
Loading unit, for the data in the cache file to be loaded onto local cache；
Acquiring unit, for when the business access for receiving terminal is requested, from the caching of local cache text
The business access is read in part requests requested target service data；
Second transmission unit, for giving the target service data feedback to the terminal.
The embodiment of the present invention provides a kind of terminal, comprising:
Third transmission unit, in the client by calling the access interface of service server to the business service
Device sends business access request, executes response operation to trigger the service server:
The business access is read from the cache file of local cache requests requested target service data；Its
In, the cache file be after being handled by the cache server the source business datum in business datum server by
The cache server distribution, and load in the local cache；
Third receiving unit, for receiving the target service data,
Display unit, for rendering target service data.
The embodiment of the present invention also provides a kind of cache server, comprising:
First memory, for storing executable data processing instructions；
First processor when for executing the executable data processing instructions stored in the first memory, realizes institute
The data processing method for the cache server side stated.
The embodiment of the present invention also provides a kind of service server, comprising:
Second memory, for storing executable data processing instructions；
Second processor when for executing the executable data processing instructions stored in the second memory, realizes institute
The data processing method for the service server side stated.
The embodiment of the present invention also provides a kind of terminal, comprising:
Third memory, for storing executable data processing instructions；
Third processor when for executing the executable data processing instructions stored in the third memory, realizes institute
The data processing method for the terminal side stated.
The embodiment of the present invention provides a kind of computer readable storage medium, is stored with executable data processing instructions, is used for
When first processor being caused to execute, the data processing method of the cache server side is realized.
The embodiment of the present invention provides a kind of computer readable storage medium, which is characterized in that is stored at executable data
Reason instruction when for causing second processor to execute, realizes the data processing method of the service server side.
The embodiment of the present invention provides a kind of computer readable storage medium, which is characterized in that is stored at executable data
Reason instruction when for causing third processor to execute, realizes the data processing method of the terminal side.
In a kind of data processing method provided in an embodiment of the present invention, terminal, server and storage medium, by from business
The source business datum of its storage is obtained in data server；According to pre-set business classifying rules to the source business datum at
Reason, obtains cache file, and the cache file characterization carries out the data after taxonomic revision to source data；By the cache file point
It is sent at least one service server, for being used when the response business access request of at least one described service server.Using
Above scheme realizes technology, due to the cache server acquisition for carrying out cache file unified from business data server and more
Newly, therefore, the data in the local cache in service server are distributed by cache server is unified, thus avoid due to
The inconsistent problem of data directly caused by access business datum server, also, due to the cache file in local cache
It is cache server actively distribution, therefore in service server in cold-start phase, even if receiving business access for the first time
It requests, is also can have existing for cache file in local cache, business datum can be read from local cache, carry out business
The response of access request, therefore improve data cached hit rate.
Detailed description of the invention
Fig. 1 is an optional structural schematic diagram of data processing system framework provided in an embodiment of the present invention；
Fig. 2 is an optional structural schematic diagram of data processing equipment provided in an embodiment of the present invention；
Fig. 3 is an optional structural schematic diagram of cache server provided in an embodiment of the present invention；
Fig. 4 is an optional structural schematic diagram of service server provided in an embodiment of the present invention；
Fig. 5 is an optional structural schematic diagram of terminal provided in an embodiment of the present invention；
Fig. 6 is an optional flow diagram of data processing method provided in an embodiment of the present invention；
Fig. 7 is another optional flow diagram one of data processing method provided in an embodiment of the present invention；
Fig. 8 is another optional flow diagram two of data processing method provided in an embodiment of the present invention；
Fig. 9 is another optional flow diagram of data processing method provided in an embodiment of the present invention；
Figure 10 is an interactive schematic diagram of data processing method provided in an embodiment of the present invention；
Figure 11 is an illustrative interaction schematic diagram of data processing method provided in an embodiment of the present invention；
Figure 12 is the interface schematic diagram of an illustrative terminal of data processing method provided in an embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention make into
It is described in detail to one step, described embodiment is not construed as limitation of the present invention, and those of ordinary skill in the art are not having
All other embodiment obtained under the premise of creative work is made, shall fall within the protection scope of the present invention.
Unless otherwise defined, all technical and scientific terms used herein and belong to technical field of the invention
The normally understood meaning of technical staff is identical.Term used herein is intended merely to the purpose of the description embodiment of the present invention,
It is not intended to limit the present invention.
It may be noted that term " first second third " involved in the embodiment of the present invention is only to be similar pair of difference
As not representing the particular sorted for object, it is possible to understand that ground, " first second third " can be interchanged in the case where permission
Specific sequence or precedence so that the embodiment of the present invention described herein can in addition to illustrate or describe herein with
Outer sequence is implemented.
Before the embodiment of the present invention is further elaborated, to noun involved in the embodiment of the present invention and term
It is illustrated, noun involved in the embodiment of the present invention and term are suitable for following explanation.
1) LRU is usually used in page replacement algorithm, i.e. a kind of page replacement algorithm of memory management, in memory but
Unused data block (memory block) is called LRU again, and operating system can belong to LRU according to which data and be moved out memory and rise
Space loads other data out.
2) cache hit, it can be understood as data cached hit, when user initiate a request (business access request),
Application in terminal receives this request, the lookup for the data that the caching gone in service server makes requests.If caching
The data of the entry of request are had found, are found as soon as characterizing a data by a label, this data will be used,
It is called cache hit.,
3) in response to the condition or state relied on for indicating performed operation, when the relied on condition of satisfaction
Or when state, performed one or more operations be can be in real time, it is possible to have the delay of setting；Do not saying especially
In the case where bright, there is no the limitations for executing sequencing for performed multiple operations.
Illustrate the exemplary application for realizing the data processing equipment of the embodiment of the present invention below, it is provided in an embodiment of the present invention
Data processing equipment may be embodied as various types of user terminals such as smart phone, tablet computer, laptop, i.e., eventually
End, also may be embodied as server (service server and cache server i.e. in the embodiment of the present invention).
It is an optional configuration diagram of data processing system 100 provided in an embodiment of the present invention referring to Fig. 1, Fig. 1,
An exemplary application is supported to realize, terminal 400 (illustrating terminal 400-1 and terminal 400-2) passes through network 200
At least one service server 300 is connected, at least one service server 300 and a cache server 500 carry out data friendship
Mutually, also, cache server 500 can be with the read operation of the progress business datum of business datum server 600, wherein network 200
It can be wide area network or local area network, or be combination, realize that data are transmitted using Radio Link.
Terminal 400 carries out the triggering of business access request, generates business visit for showing in content in graphical interfaces
It asks request, and the business access is requested to send a service server at least one service server 300；At least one
A service server in service server 300 is read from the local cache of oneself for responding business access request
Business access requests requested target service data, and feeds back to terminal 400, completes this visit.Before this, until
A few service server 300, for receiving the cache file of the distribution of cache server 500；The cache file is described slow
It deposits and obtains after server 500 handles the source business datum in business datum server；And it will be in the cache file
Data be loaded onto local cache；When the business access for receiving terminal 400 is requested, from the described slow of the local cache
It deposits and reads the requested target service data of the business access request in file；By the target service data feedback to described
Terminal 400.Cache server 500, for obtaining the source business datum of its storage from business data server 600；According to pre-
If business classifying rules handles the source business datum, cache file is obtained, the cache file characterization is to source data
Data after carrying out taxonomic revision；The cache file is distributed at least one service server 300, for described at least one
A service server 300 uses when responding business access request.
That is, in embodiments of the present invention, the framework based on Fig. 1 is equipped with needed for various users in terminal and answers
With, for example have application (such as Video Applications, audio broadcasting application, game application, the ocr software, chat application of amusement function
Applied with live streaming), for another example have the application of service function (such as digital map navigation application purchases by group application, camera application).So exist
When carrying out some function by the application of terminal, or carry out some business realizing business access, generates business access and ask
It asks, business access request is sent to the business or applies corresponding background server by terminal, i.e., on service server, then
Pass through the requested business datum of service server requested service access request.
In embodiments of the present invention, some application of terminal can correspond at least one service server (i.e. at least one
Business), and at least one service server can correspond to one or more business datum servers, business datum server can
For storage this some apply corresponding business datum.
Data processing equipment provided in an embodiment of the present invention may be embodied as the mode of hardware or software and hardware combining, below
Illustrate the various exemplary implementations of data processing equipment provided in an embodiment of the present invention.
Referring to fig. 2, Fig. 2 is 700 1 optional structural schematic diagrams of data processing equipment provided in an embodiment of the present invention.This
Data processing equipment 700 in inventive embodiments can be terminal 400, service server 300 and cache server 500,
That is the hardware configuration of terminal 400, service server 300 and cache server 500 can use data processing equipment
1 structure realizes that the embodiment of the present invention is with no restriction.Wherein, terminal 400 can be mobile phone, computer, digital broadcasting
Terminal, information transceiving equipment, game console, tablet device, Medical Devices, body-building equipment, personal digital assistant etc..
Data processing equipment 700 shown in Fig. 2 includes: at least one processor 710, memory 740, at least one network
Interface 720 and user interface 730.Various components in data processing equipment 700 are coupled by bus system 750.It can
Understand, bus system 750 is for realizing the connection communication between these components.Bus system 750 except include data/address bus in addition to,
It further include power bus, control bus and status signal bus in addition.But for the sake of clear explanation, by various buses in Fig. 2
All it is designated as bus system 750.
User interface 730 may include display, keyboard, mouse, trace ball, click wheel, key, button, touch-sensitive plate or
Person's touch screen etc..
Memory 740 can be volatile memory or nonvolatile memory, may also comprise volatile and non-volatile
Both memories.Wherein, nonvolatile memory can be read-only memory (ROM, Read Only Memory), programmable
Read memory (PROM, Programmable Read-Only Memory), Erasable Programmable Read Only Memory EPROM (EPROM,
Erasable Programmable Read-Only Memory), flash memory (Flash Memory) etc..Volatile memory can be with
It is random access memory (RAM, Random Access Memory), is used as External Cache.By exemplary but not
It is restricted explanation, the RAM of many forms is available, such as static random access memory (SRAM, Static Random
Access Memory), synchronous static random access memory (SSRAM, Synchronous Static Random Access
Memory).The memory 740 of description of the embodiment of the present invention is intended to include the memory of these and any other suitable type.
Wherein, the memory 740 in the embodiment of the present invention can storing data to support the behaviour of data processing equipment 700
Make.The example of these data includes: any computer program for operating on data processing equipment 700, such as operating system
741 and executable program 742.Wherein, operating system 741 includes various system programs, such as ccf layer, core library layer, driving
Layer etc., for realizing various basic businesses and the hardware based task of processing.Executable program may include various using journey
Sequence, such as executable data processing instructions.
Illustratively, the embodiment of the present invention provides a kind of cache server, comprising:
First memory, for storing executable data processing instructions；
First processor when for executing the executable data processing instructions stored in the first memory, realizes institute
The data processing method for the cache server side stated.
The embodiment of the present invention provides a kind of service server, comprising:
Second memory, for storing executable data processing instructions；
Second processor when for executing the executable data processing instructions stored in the second memory, realizes institute
The data processing method for the service server side stated.
The embodiment of the present invention also provides a kind of terminal, comprising:
Third memory, for storing executable data processing instructions；
Third processor when for executing the executable data processing instructions stored in the third memory, realizes institute
The data processing method for the terminal side stated.
Wherein, when data processing equipment 700 is cache server, first memory can be memory 740, at first
Reason device is at least one processor 710；When data processing equipment 700 is service server, second memory can be storage
Device 740, second processor are at least one processor 710；When data processing equipment 700 is terminal, third memory can be with
For memory 740, third processor is at least one processor 710.
It should be noted that in embodiments of the present invention, being adapted to property of other component in data processing equipment 700
It is disposed according to actual needs in cache server, service server and terminal, the embodiment of the present invention is with no restriction.Example
Such as, sending and receiving for the data in service server, cache server and terminal is realized by network interface 720,
And the presentation of the data in terminal is realized by user interface 730.
As the example that method provided in an embodiment of the present invention uses software and hardware combining to implement, the embodiment of the present invention is provided
Data processing method can be embodied directly in and combined by the software module that processor 740 executes, software module, which can be located at, deposits
In storage media, storage medium is located at memory 740, and processor 710 reads the executable journey that software module includes in memory 740
Sequence (i.e. executable data processing instructions), in conjunction with necessary hardware (e.g., including processor 740 and be connected to bus 750
Other assemblies) complete data processing method provided in an embodiment of the present invention.
As an example, processor 710 can be a kind of IC chip, and the processing capacity with signal, for example, it is general
Processor, digital signal processor (DSP, Digital Signal Processor) or other programmable logic device are divided
Vertical door or transistor logic, discrete hardware components etc., wherein general processor can be microprocessor or any normal
The processor etc. of rule.
Illustrate the exemplary structure of software module below, in some embodiments, illustratively, as shown in figure 3, caching clothes
Business device 500 in software module may include:
First receiving unit 501, for obtaining the source business datum of its storage from business data server；
Processing unit 502 is cached for handling according to pre-set business classifying rules the source business datum
File, the cache file characterization carry out the data after taxonomic revision to source data；
First transmission unit 503, for the cache file to be distributed at least one service server, for it is described extremely
It is used when few service server response business access request.
In some embodiments of the invention, the pre-set business classifying rules includes: business function classification, wherein
The processing unit 502 is specifically used for carrying out function classification to the source business datum according to business function classification
Processing, it is corresponding data cached to obtain business function type；Data cached institute is stored as the business function type is corresponding
The corresponding relationship for stating the gentle deposit data of caching type, obtains the cache file.
In some embodiments of the invention, the pre-set business classifying rules includes: business datum classification, wherein institute
Processing unit 502 is stated, is specifically used for carrying out data classification processing to the source business datum according to business datum classification, obtains industry
Data type of being engaged in is corresponding data cached；By the traffic data type it is corresponding it is data cached be stored as the caching type and
Data cached corresponding relationship obtains the cache file.
In some embodiments, illustratively, as shown in figure 4, the software module in service server 300 may include:
Second receiving unit 301, for receiving the cache file of cache server distribution；The cache file is described slow
It deposits and obtains after server handles the source business datum in business datum server；
Loading unit 302, for the data in the cache file to be loaded onto local cache；
Acquiring unit 303, for when receive terminal business access request when, from the caching of the local cache
The business access is read in file requests requested target service data；
Second transmission unit 304, for giving the target service data feedback to the terminal.
In some embodiments of the invention, the cache file includes the corresponding relationship for caching the gentle deposit data of type；
The acquiring unit 303 is specifically used for determining requested target cache type according to business access request；
According to the corresponding relationship and target cache type of the gentle deposit data of caching type, the institute in the cache file is read
State target service data.
In some embodiments, illustratively, as shown in figure 5, the software module in terminal 400 may include:
Third transmission unit 401, in the client by calling the access interface of service server to the business
Server sends business access request, executes response operation to trigger the service server:
The business access is read from the cache file of local cache requests requested target service data；Its
In, the cache file be after being handled by the cache server the source business datum in business datum server by
The cache server distribution, and load in the local cache；
Third receiving unit 402, for receiving the target service data,
Display unit 403, for rendering target service data.
The example of hardware implementation, method provided by the embodiment of the present invention are used as method provided in an embodiment of the present invention
The processor 410 of hardware decoding processor form can be directly used (for example, at first processor, second processor and third
Reason device) completion is executed, for example, by one or more application specific integrated circuit (ASIC, Application Specific
Integrated Circuit), DSP, programmable logic device (PLD, Programmable Logic Device), complexity can
Programmed logic device (CPLD, Complex Programmable Logic Device), field programmable gate array (FPGA,
Field-Programmable Gate Array) or other electronic components execute and realize at data provided in an embodiment of the present invention
Reason method.
In practical applications, above-mentioned receiving unit and transmission unit can realize that display unit can pass through by network interface
User interface is realized, and other units can then be realized by processor, and the embodiment of the present invention is with no restriction.
Below in conjunction with the exemplary application and implementation of the data processing equipment above-mentioned for realizing the embodiment of the present invention, explanation
Realize the data processing method of the embodiment of the present invention.
It is an optional flow diagram of data processing method provided in an embodiment of the present invention referring to Fig. 6, Fig. 6, shows
Example property, it is illustrated applied to the step of in cache server, being shown below in conjunction with Fig. 6.
S101, the source business datum that its storage is obtained from business data server；
S102, source business datum is handled according to pre-set business classifying rules, obtains cache file, cache file table
Levy the data after carrying out taxonomic revision to source data；
S103, cache file is distributed at least one service server, responds industry at least one service server
It is used when access request of being engaged in.
In embodiments of the present invention, it when carrying out business access by terminal, needs from business data server
Target service data required for the business access are obtained, but the target service data as needed for above-mentioned business access are
Therefore data through carrying out caching in service server can carry out target industry from the local cache of service server
The acquisition for data of being engaged in, to realize above-mentioned business access.
In embodiments of the present invention, the concept of cache server is introduced, which is used to take from business datum
The business datum being engaged in device in pulling data library calculates data processing in other words by caching, is converted into cache file, actively
Cache file is distributed to the service server communicated with to cache, the service server can encounter terminal in this way
When carrying out business access, required target service data are directly read from caching, to realize business access.
In S101, cache server is can communicate with business datum server, which can be with
By accessing business datum server, the source business datum stored in business datum server is got.
In some embodiments of the invention, cache server can be timing and obtain source industry from business data server
It is engaged in data, wherein source business datum is requesting with user access operation or user of storing in business datum server
The relevant business datum of the read operations such as business access.
In some embodiments of the invention, cache server can be according to identical time interval from business data service
The source business datum stored in the service server is obtained in device, it can also be with the time interval of dynamic change from there is business datum
The source business datum is obtained in server.
Illustratively, cache server is at interval of 2 seconds from being obtained in the business datum server in business data server
The data of storage, i.e. source business datum.
It should be noted that the process that cache server timing obtains source business datum from service server can wrap
Include: cache server timing carries out business datum acquisition request to service server, and the business datum server is in response to above-mentioned
Business datum acquisition request feeds back current source business datum to cache server.
In some embodiments of the invention, cache server can also get business datum server in original state
In whole source business datums, and later can only in business datum server active service data updating when only carry out
The acquisition of the source business datum of update with it is synchronous.Wherein, source service data updating includes the increasing of business datum, the processing such as deletes, changes,
The concrete implementation mode embodiment of the present invention is with no restriction.
In embodiments of the present invention, business datum server and cache server can be used as the two of storage source business datum
A server, wherein business datum server can be understood as a primary server, and cache server be understood that based on take
The slave server of business device, carries out write operation with primary server, carries out read operation with from server.
Here be describe one it is specific when get off to embody cache server can be used as from business data server from
The realization of server.
Business datum server and cache server can two MySQL servers, a business datum server conduct
Primary server, cache server group are used as from server, and primary server carries out write operation, carries out read operation from server.Business
What is stored in data server can be understood as primary database, and what is stored in cache server can be understood as from database.
So, it the data in primary database and to be consistent from the data in database, for example, a object in primary database
Lane database have a b, c, d table, that database and b that should just have identical a object from lane database, c, d table.Master data
Library can unanimously be realized with from the data in database by synchronous account.Each it will use a MySQL account from database
Number primary database is connected, then creating account in primary database, and the account will authorize REPLICATION
SLAVE permission can be newly created, to be also possible in original primary database account from the MySQL account in database, this
A account and password can be stored in plain text in master.info file.If from database using newly created account,
So, newly creation account uses " CREATE USER ", licenses " GRANT " order to new creation account, authorizes
REPLICATION SLAVE permission.
Illustratively, an account is created, the entitled repl of account, password: repl123 only allows the IP of 192.168.1.
Duan Denglu, as follows:
1, mysql > CREATE USER'repl'@' 192.168.1.%'IDENTIFIED BY'repl123'；
2, mysql > GRANT REPLICATION SLAVE ON*.*TO'repl'@' 192.168.1.%'；
After creating synchronous account, 1), configuration primary database, the MySQL restarted in business datum server are carried out
The configuration of master data can use binary log (binary logging), and create a unique Server ID,
Value range is 1 to (232) -1, in this way, can send change note when the data in business datum server change
The binary log that the server in cache server relies on is recorded to realize.MySQL and volume are closed in the configuration of business datum server
My.cnf my.ini file is collected, configuration: binary log and Server ID is added under [mysqld] node.For example, opening
With binary log, for log file name using " mysql-bin " as prefix, Server ID is configured to 1.2) it configures from database,
Similarly, it needs to close MySQL, to distribute a unique Server ID, restart again after modification is good, as follows:
1、[mysqld]
2, server-id=2
3, # may specify to the library of duplication
4, replicate-do-db=test# does not specify binlog-do-db at the end master, uses at the end slave
Replication-do-db is filtered
5, the library that replicate-ignore-db=mysql# ignores
Wherein, if there is multiple from server, it is unique as IP that the server-id of each server, which cannot be repeated,
Mark is not coupled to primary server from server if server-id is not arranged or is set as 0；It does not need generally
Binary log is enabled from server, if that can do data backup with it enabling binary log from server
With collapse restore, or do more complicated thing (such as this from server be used to as other main services from server
Device).
3) information of configuration connection primary server is as follows:
mysql>stop slave；
mysql>CHANGE MASTER TO
-> MASTER_HOST='192.168.1.233',
-> MASTER_USER='repl',
-> MASTER_PASSWORD='repl123',
-> MASTER_LOG_FILE='mysql-bin.000002',
-> MASTER_LOG_POS=313；
mysql>start slave；
This way it is possible to realize adding a business datum or record in primary server will also add from server
Add a business datum or record.
So, read and write abruption just sees the realization of detailed programs, read and write abruption, the operation exactly " write " all in primary database,
The operation of " reading " is all from database.
Illustratively, read and write abruption demonstration is done using the frame SpeedPHP of light weight, as follows:
In some embodiments of the invention, the source business datum stored in business datum server can pass through for user
The business datum for the write operation that terminal carries out business datum server, business datum are to believe using the data of corresponding function
Breath.
Illustratively, the source business datum in business datum server can be with some using corresponding user account pair
The business datum answered, the even business datum for the different function of the user account can also be the function of some application
Corresponding interface data information or interface entrance load information etc., the embodiment of the present invention is with no restriction.
It is understood that cache server can be deposited to what the business datum in business datum server synchronized
Storage, ensure that the consistency with the data in business datum server, then the data in cache server be just used as user into
The business datum that industry is engaged in access request is not in change business datum in use, the consistency of data is guaranteed
The conflict of data write operation and read operation in server, ensure that the consistency of business datum.
In S102, cache server, can after the acquisition for realizing source business datum in business data server
It is performed some processing and is stored in cache server with the source business datum that will acquire, in order to need in cache server
It can directly fetch when middle progress read operation and just use.Then, cache server can be according to pre-set business classifying rules pair
Source business datum is handled, and cache file is obtained, and cache file characterization carries out the data after taxonomic revision to source data, should
Cache file can be used directly to use as data cached.
In embodiments of the present invention, pre-set business classifying rules includes: business function classification and/or business datum classification.
That is, in embodiments of the present invention, cache server can be according to the type pair of business function or business datum itself
Source business datum carries out the processing such as taxonomic revision, obtains cache file, the cache file is as data cached use.
In some embodiments of the invention, when pre-set business classifying rules includes: business function classification, buffer service
Device is handled source business datum according to pre-set business classifying rules, obtains the implementation of cache file are as follows: according to business
Function classification carries out function classification processing to source business datum, and it is corresponding data cached to obtain business function type；By business function
The corresponding data cached corresponding relationship for being stored as the gentle deposit data of caching type of energy type, obtains cache file.
Here, due to the corresponding business datum of different function that source business datum can be the same application, then, slow
It deposits after server gets source business datum, which can classify source business datum according to business function
Processing, sorts out the corresponding business datum of different business function, i.e. business function type is corresponding data cached, by business function
Type is interpreted as caching type, has just obtained the corresponding relationship of the gentle deposit data of caching type, and then caching type is eased up and is deposited
The corresponding relationship of data is as cache file.
In some embodiments of the invention, when pre-set business classifying rules includes: business datum classification, buffer service
Device is handled source business datum according to pre-set business classifying rules, obtains the implementation of cache file are as follows: according to business
Data classification carries out data classification processing to source business datum, and it is corresponding data cached to obtain traffic data type；By business number
According to the corresponding data cached corresponding relationship for being stored as the gentle deposit data of caching type of type, cache file is obtained.
Here, since source business datum can be the corresponding business datum of the same application, but traffic data type
Can be different, traffic data type may include picture, text, audio data or video data etc., then, in cache server
After getting source business datum, which can be carried out source business datum at classification according to traffic data type
Reason, sorts out the corresponding business datum of different business data type, i.e. traffic data type is corresponding data cached, by business number
It is interpreted as caching type according to type, has just obtained the corresponding relationship of the gentle deposit data of caching type, then caching type is eased up
The corresponding relationship of deposit data is as cache file.
It should be noted that the data at least corresponding storage in the form of caching the gentle deposit data of type in cache file
, it is also possible to the corresponding storage of the gentle deposit data of the caching type carried out for different user accounts, it is specific slow
The corresponding data of deposit data can also include which is stored as an entry, can be determined according to the composition of actual traffic data
Fixed, the embodiment of the present invention is with no restriction.
In some embodiments of the invention, cache server is after the classification processing for having carried out source business datum, also
Caching can have been carried out for the cache file that classification has been carried out to calculate, then obtain final cache file.
Wherein, caching calculating is handled cache file according to cache algorithm, and cache algorithm is that one of instruction is bright
Thin table, for prompting which entry in cache file that should be left out.
It should be noted that not can be carried out unconfined data cached storage, institute based on the considerations of spatial cache size
It is directed to cache file with cache server, can be filtered using cache algorithm, so that finally obtained cache file, meets
The buffer size of at least one service server.
Illustratively, cache algorithm can using least commonly using algorithm (LFU), least recently used algorithm (LRU),
Adaptive cache replaces algorithm (ARC), nearest longest using algorithm (MRU) etc., and the embodiment of the present invention is with no restriction.
It should be noted that in embodiments of the present invention, since cache algorithm is based on user by terminal to business
The access situation of data, or the filtering of the service condition progress for business datum, and these are by least one industry
The business server user's usage record that can recorde, therefore, at least one service server can timing give buffer service
Device carries out the feedback of user's usage record, so that cache server can carry out the update or filtering of timely cache file.
In some embodiments of the invention, for cache server after obtaining the cache file after classification processing, words can
After calculating caching for cache file, then obtain final cache file.
Here, cache server can first get at least one cache size of at least one service server, according to
The smallest cache size at least one cache size (target cache size) carries out caching calculating to cache file, obtains
The cache file of cache file not superorder mark cache size.
In S103, cache server is after processing has obtained cache file, since terminal carries out business access request
It is the acquisition that business datum is carried out by service server, therefore, general cache business access requests institute in service server
The business datum needed, the realization of business access can be rapidly performed by convenient for terminal, then, in embodiments of the present invention, delay
It deposits server and the source business datum for guaranteeing data consistency with business datum server has been obtained, and be processed into
It can be directly used for the data of caching, therefore, which can actively be distributed to cache file at least one business
In server, for being used when the response business access request of at least one service server.
In some embodiments of the invention, cache file periodically can be distributed at least one business by cache server
In server.Timing can be same time interval, or the time interval of dynamic change, the number of specific time interval
It is worth the embodiment of the present invention with no restriction.
It should be noted that in embodiments of the present invention, the time of timing is unsuitable too long, so as to guarantee business datum
The update of business datum in server timely can generate cache file by buffer service, update and arrive at least one business
In server, used when being requested for the business access that at least one service server handles user.
It is understood that due to the acquisition of cache server progress cache file unified from business data server
And update, therefore, the data in local cache in service server are distributed by cache server is unified, are thus avoided
Due to the inconsistent problem of data caused by directly accessing business datum server, also, due to the caching in local cache
File is cache server actively distribution, therefore in service server in cold-start phase, even if receiving business for the first time
Access request is also can have existing for cache file in local cache, business datum can be read from local cache, carries out
The response of business access request, therefore improve data cached hit rate.
It is data processing provided in an embodiment of the present invention referring to Fig. 7, Fig. 7 on the basis of above-mentioned data processing method
One optional flow diagram of method is illustratively applied in service server, below in conjunction with the step shown in Fig. 7
Suddenly it is illustrated.
S201, the cache file for receiving cache server distribution；Cache file is cache server to business datum service
What the source business datum in device obtained after being handled；
S202, the data in cache file are loaded onto local cache；
S203, when receive terminal business access request when, read business access from the cache file of local cache
Request requested target service data；
S204, by target service data feedback to terminal.
Framework based on Fig. 1, service server can be at least one, and station of the embodiment of the present invention is in a service server
Angle carry out the description of data processing method, the data processing method in each service server is the same.
In S201, service server real-time or timing can receive the caching text sent by cache server
Part, when these cache files by cache server after obtaining source business datum in business data server, by classification processing
Being storable in for obtaining afterwards is data cached in caching.
In embodiments of the present invention, service server real-time or timing can receive cache server active push
Cache file, and the time interval of timing is generally unsuitable too long, to guarantee the consistency of data.
That is, service server, which can constantly receive cache server, updates the cache file that push comes, make
For data cached use.
In S202, in embodiments of the present invention, service server is after having got cache file, just by the caching
Data in cache file are loaded onto local cache by file as data cached carry out load store, i.e. service server.
It should be noted that at least one industry can be directed to since cache server is during generating cache file
The cache size of business server carries out the processing of cache file, and therefore, cache file here must can satisfy at least one
The buffer size of any service server in a service server.
In some embodiments of the invention, service server is after having received cache file, so that it may to caching
File carries out caching calculation processing, loads in local cache, makes when carrying out business access request by terminal for subsequent user
With.
In some embodiments of the invention, the buffer setting in service server is first to calculate cache size, and definition is slow
The total cache size for depositing file storage, calculates the size of current cache, obtains the cache path of current cache, creates file management
Object obtains all subpaths under current cache path, traverses all subfiles splicing fullpaths, when meeting spatial cache
When, the cache file is loaded in completing path.
Illustratively, service server can carry out the write operation of cache file by installation good-storage plug-in unit,
Load.The code that cache file is loaded in local cache can be such that
In S203 and S204, service server receive for being sent by terminal business access request when
It waits, so that it may which requested target service data, and feedback target industry are read from local cache according to business access request
Data of being engaged in are to terminal, so that user obtains desired business datum.
In embodiments of the present invention, the business access request that user is carried out by the application of terminal, i.e. read operation request, all
It is to be realized by service server.The type of requested data, such service server are contained in business access request
When receiving business access request, since cache server is above-mentioned in advance using in corresponding business datum server
Source business datum is all brought, and is processed into cache file to service server, which is buffered in local
Caching suffers, and therefore, which directly can request requested data type according to business access, from local cache
It is middle to read requested target service data.
In embodiments of the present invention, also need will be requested when just receiving business access request every time for service server
The storage of access process, i.e. search history, and load, so that cache server demand user uses or access data cases, carry out
When cache file updates request, used when being requested in response to updating.
Illustratively, search history is stored, the code for loading the search history of local cache is as follows:
It is understood that due to the acquisition of cache server progress cache file unified from business data server
And update, therefore, the data in local cache in service server are distributed by cache server is unified, are thus avoided
Due to the inconsistent problem of data caused by directly accessing business datum server, also, due to the sheet in service server
Cache file in ground caching is that cache server is actively distributed, therefore, even if in service server in cold-start phase,
Business access request is received for the first time, is also can have existing for cache file in local cache, it can be from local cache
Business datum is read, the response of business access request is carried out, therefore improves data cached hit rate, and service server
In business access request in local cache whether there is cache file there is no relationships, that is to say, that the meter of cache file
The process for calculating asynchronous decoupling when processing and business access request, has no effect on, and cache file also only needs to calculate each other
Portion will not increase the pressure of database with the increase of service server, reduce the pressure of business datum server.
It in some embodiments, is one of data processing method provided in an embodiment of the present invention optional referring to Fig. 8, Fig. 8
Flow diagram, cache file include cache type ease up deposit data corresponding relationship when, S203 shown in Fig. 8 from local
Business access is read in the cache file of caching requests requested target service data that can realize by S2031 to S2032,
It will be illustrated in conjunction with each step.
S2031, requested target cache type is determined according to business access request；
S2032, ease up the corresponding relationship and target cache type of deposit data according to caching type, reads cache file
In target service data.
In embodiments of the present invention, cache file may include the corresponding relationship for caching the gentle deposit data of type, then industry
Be engaged in data server read business access request requested target service data when, first according to business access request in carry
Traffic data type determine requested target cache type, it is gentle from caching type then according to target cache type
In the corresponding relationship of deposit data, the target service data in cache file are read.
In embodiments of the present invention, caching type can be traffic data type and/or business function type, above-mentioned target
Caching type can correspond to traffic data type, can also correspond to business function type.
It is data processing provided in an embodiment of the present invention referring to Fig. 9, Fig. 9 on the basis of above-mentioned data processing method
One optional flow diagram of method is illustratively applied in terminal, the step of progress is shown below in conjunction with Fig. 9
Explanation.
S301, in the client by call service server access interface to service server send business access ask
It asks, executes response operation to trigger service server:
Business access is read from the cache file of local cache requests requested target service data；Wherein, it caches
File is to be distributed after being handled by cache server the source business datum in business datum server by cache server,
And it loads in local cache；
S302, target service data are received, and target service data is presented.
In embodiments of the present invention, the application installed in terminal can be present in terminal in the form of client, at end
End side is asked in the client of terminal by calling the access interface of service server to send business access to service server
It asks, executes response operation to trigger service server: reading business access from the cache file of local cache and requested
Target service data；Since cache file is to be carried out by cache server to the source business datum in business datum server
Distributed after processing by cache server, and loaded in local cache；In this way, no matter when terminal is carrying out business access
Request can receive task server in response to the target service data of business access request feedback, and mesh is presented
Business datum is marked to user.
It should be noted that service server execute operation in the data processing method of service server side into
Explanation is gone, details are not described herein again.
In some embodiments of the invention, the request for the write operation that user is carried out by terminal, passes through service server
It acts in business datum server.
It is understood that due to that can be cached with always and business datum service in the local cache in service server
The cache file of being consistent property of business datum in device, and the generation of cache file is that cache server takes from business datum
Obtain what source business datum obtained in business device, it is unrelated with the request of the business access of terminal, it is not influenced by business access request, that
Even if being cold-started in service server, when terminal carries out business access request to service server by client,
It is available to arrive target service data, to provide cache hit rate.
It is at data provided in an embodiment of the present invention referring to Figure 10, Figure 10 on the basis of above-mentioned data processing method
One optional flow diagram of reason method, as follows:
S401, cache server obtain the source business datum of its storage from business data server；
S402, cache server are handled source business datum according to pre-set business classifying rules, obtain cache file,
Cache file characterization carries out the data after taxonomic revision to source data；
Cache file is distributed at least one service server by S403, cache server；
Data in cache file are loaded onto local cache by S404, at least one service server；
S405, terminal request at least one business to take by calling the access interface of service server to send business access
It is engaged in a service server in device；
S406, a service server are requested in response to business access, read business from the cache file of local cache
The requested target service data of access request；
S407, a service server send target service data to terminal；
Target service data are presented in S408, terminal.
It is understood that due to the acquisition of cache server progress cache file unified from business data server
And update, therefore, the data in local cache in service server are distributed by cache server is unified, are thus avoided
Due to the inconsistent problem of data caused by directly accessing business datum server, also, due to the sheet in service server
Cache file in ground caching is that cache server is actively distributed, therefore, even if in service server in cold-start phase,
Business access request is received for the first time, is also can have existing for cache file in local cache, it can be from local cache
Business datum is read, the response of business access request is carried out, therefore improves data cached hit rate, and service server
In business access request in local cache whether there is cache file there is no relationships, that is to say, that the meter of cache file
The process for calculating asynchronous decoupling when processing and business access request, has no effect on, and cache file also only needs to calculate each other
Portion will not increase the pressure of database with the increase of service server, reduce the pressure of business datum server.
In the following, will illustrate exemplary application of the embodiment of the present invention in an actual application scenarios.
Data processing architecture as shown in figure 11 is said by taking the game social application installed in mobile phone 1 (terminal) as an example
It is bright.Mobile phone 1 carries out read operation by the local cache of at least one game social interaction server device 2 (at least one service server),
And data cached in the local cache of game social interaction server device 2 be by game social activity cache server 3 (cache server) from
After game function data (source business datum) classification processing that game social data server 4 (business datum server) obtains
It arrives.Also, after mobile phone 1 carries out write operation by least one game social interaction server device 2, it is stored directly in game social data
In server 4.It is accomplished by detail
S501, game social activity cache server obtain the game function number of its storage from game social data server
According to；
S502, game social activity cache server are handled game function data according to game function classification, are obtained not
With the game cache file of game function；
Game cache file is distributed at least one game social interaction server device by S503, game social activity cache server；
Data in cache file are loaded onto local cache by S504, at least one game social interaction server device；
S505, mobile phone are by calling the access interface of game social interaction server device to send the recommendation access in game social application
It requests in a game social interaction server device at least one game social interaction server device；
S506, a game social interaction server device are read from the game of local cache caching text in response to recommending access request
Take the game related data recommended in the page；
S507, a game social interaction server device send the game related data in the recommendation page to mobile phone；
It is presented on S508, mobile phone and recommends the page.
Wherein, recommending the game related data in page E (as shown in figure 12) includes the game picture data A discussed warmly
With lteral data B.And the game topic that users discuss, such as sprout the comment that friend says C characterization.
It should be noted that being exactly mobile phone when user is sprouting the region said of friend and carried out the write operation of new comment
Comment write request is sent to game social interaction server device, game social interaction server device is written in game social data server, exists in this way
Game social activity cache server can be got when executing S501 comprising the game function data including new comment data
, when executing the process of S502-S508, can show when other mobile phones carry out recommendation access request and exist comprising new comment
The interior recommendation page.
Illustratively, the embodiment of the present invention provides a kind of computer readable storage medium, is stored with executable data processing
Instruction when for causing first processor to execute, realizes the data processing method of the cache server side.
The embodiment of the present invention provides a kind of computer readable storage medium, which is characterized in that is stored at executable data
Reason instruction when for causing second processor to execute, realizes the data processing method of the service server side.
The embodiment of the present invention provides a kind of computer readable storage medium, which is characterized in that is stored at executable data
Reason instruction when for causing third processor to execute, realizes the data processing method of the terminal side.
In some embodiments, storage medium can be FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface and deposit
The memories such as reservoir, CD or CD-ROM；Be also possible to include one of above-mentioned memory or any combination various equipment.
In some embodiments, executable instruction can use program, software, software module, the form of script or code,
By any form of programming language (including compiling or interpretative code, or declaratively or process programming language) write, and its
It can be disposed by arbitrary form, including be deployed as independent program or be deployed as module, component, subroutine or be suitble to
Calculate other units used in environment.
As an example, executable instruction can with but not necessarily correspond to the file in file system, can be stored in
A part of the file of other programs or data is saved, for example, being stored in hypertext markup language (HTML, Hyper Text
Markup Language) in one or more scripts in document, it is stored in the single file for being exclusively used in discussed program
In, alternatively, being stored in multiple coordinated files (for example, the file for storing one or more modules, subprogram or code section).
As an example, executable instruction can be deployed as executing in a calculating equipment, or it is being located at one place
Multiple calculating equipment on execute, or, be distributed in multiple places and by multiple calculating equipment of interconnection of telecommunication network
Upper execution.
In conclusion being avoided through the embodiment of the present invention due to data caused by directly accessing business datum server
Inconsistent problem improves data cached hit rate, the calculation processing of cache file and business access asynchronous solution when requesting
Coupling has no effect on each other, also reduces the pressure of business datum server.
The above, only the embodiment of the present invention, are not intended to limit the scope of the present invention.It is all in this hair
Made any modifications, equivalent replacements, and improvements etc. within bright spirit and scope, be all contained in protection scope of the present invention it
It is interior.
Claims (15)
1. a kind of data processing method characterized by comprising
The source business datum of its storage is obtained from business data server；
The source business datum is handled according to pre-set business classifying rules, obtains cache file, the cache file table
Levy the data after carrying out taxonomic revision to source data；
The cache file is distributed at least one service server, responds business at least one described service server
It is used when access request.
2. the method according to claim 1, wherein the pre-set business classifying rules includes: business function point
Class, wherein it is described that the source business datum is handled according to pre-set business classifying rules, obtain cache file, comprising:
Function classification processing is carried out to the source business datum according to business function classification, it is corresponding slow to obtain business function type
Deposit data；
By the corresponding data cached corresponding relationship for being stored as the gentle deposit data of caching type of the business function type, obtain
To the cache file.
3. method according to claim 1 or 2, which is characterized in that the pre-set business classifying rules includes: business datum
Classification, wherein it is described that the source business datum is handled according to pre-set business classifying rules, obtain cache file, comprising:
Data classification processing is carried out to the source business datum according to business datum classification, it is corresponding slow to obtain traffic data type
Deposit data；
By the corresponding data cached corresponding relationship for being stored as the gentle deposit data of caching type of the traffic data type, obtain
To the cache file.
4. a kind of data processing method characterized by comprising
Receive the cache file of cache server distribution；The cache file is the cache server to business datum server
In source business datum handled after obtain；
Data in the cache file are loaded onto local cache；
When the business access for receiving terminal is requested, the business is read from the cache file of the local cache and is visited
Ask request requested target service data；
Give the target service data feedback to the terminal.
5. according to the method described in claim 4, it is characterized in that, the cache file includes the gentle deposit data of caching type
Corresponding relationship；Wherein, the business access is read in the cache file of the local cache requests requested target industry
Business data, comprising:
Requested target cache type is determined according to business access request；
According to the corresponding relationship and target cache type of the gentle deposit data of caching type, read in the cache file
The target service data.
6. a kind of data processing method characterized by comprising
In the client by calling the access interface of service server to send business access request to the service server, with
It triggers the service server and executes response operation:
The business access is read from the cache file of local cache requests requested target service data；Wherein,
The cache file is after being handled by the cache server the source business datum in business datum server by institute
Cache server distribution is stated, and is loaded in the local cache；
The target service data are received, and the target service data are presented.
7. a kind of cache server characterized by comprising
First receiving unit, for obtaining the source business datum of its storage from business data server；
Processing unit obtains cache file, institute for handling according to pre-set business classifying rules the source business datum
It states cache file characterization and carries out the data after taxonomic revision to source data；
First transmission unit, for the cache file to be distributed at least one service server, for it is described at least one
It is used when service server response business access request.
8. a kind of service server characterized by comprising
Second receiving unit, for receiving the cache file of cache server distribution；The cache file is the buffer service
What device obtained after handling the source business datum in business datum server；
Loading unit, for the data in the cache file to be loaded onto local cache；
Acquiring unit, for when receive terminal business access request when, from the cache file of the local cache
It reads the business access and requests requested target service data；
Second transmission unit, for giving the target service data feedback to the terminal.
9. a kind of terminal characterized by comprising
Third transmission unit, in the client by calling the access interface of service server to send out to the service server
It send business access to request, executes response operation to trigger the service server:
The business access is read from the cache file of local cache requests requested target service data；Wherein,
The cache file is after being handled by the cache server the source business datum in business datum server by institute
Cache server distribution is stated, and is loaded in the local cache；
Third receiving unit, for receiving the target service data,
Display unit, for rendering target service data.
10. a kind of cache server characterized by comprising
First memory, for storing executable data processing instructions；
First processor when for executing the executable data processing instructions stored in the first memory, realizes that right is wanted
Seek 1 to 3 described in any item methods.
11. a kind of service server characterized by comprising
Second memory, for storing executable data processing instructions；
Second processor when for executing the executable data processing instructions stored in the second memory, realizes that right is wanted
Seek 4 or 5 described in any item methods.
12. a kind of terminal characterized by comprising
Third memory, for storing executable data processing instructions；
Third processor when for executing the executable data processing instructions stored in the third memory, realizes that right is wanted
Method described in asking 6.
13. a kind of computer readable storage medium, which is characterized in that executable data processing instructions are stored with, for causing
When one processor executes, the described in any item methods of claims 1 to 3 are realized.
14. a kind of computer readable storage medium, which is characterized in that executable data processing instructions are stored with, for causing
When two processors execute, the described in any item methods of claim 4 or 5 are realized.
15. a kind of computer readable storage medium, which is characterized in that executable data processing instructions are stored with, for causing
When three processors execute, method of claim 6 is realized.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811134278.2A CN109408751B (en) | 2018-09-27 | 2018-09-27 | Data processing method, terminal, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811134278.2A CN109408751B (en) | 2018-09-27 | 2018-09-27 | Data processing method, terminal, server and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109408751A true CN109408751A (en) | 2019-03-01 |
| CN109408751B CN109408751B (en) | 2022-08-30 |
Family
ID=65465418
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811134278.2A Active CN109408751B (en) | 2018-09-27 | 2018-09-27 | Data processing method, terminal, server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109408751B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110898434A (en) * | 2019-11-06 | 2020-03-24 | 上饶市中科院云计算中心大数据研究院 | Method, server, system, and computer-readable program medium for processing data |
| CN111061719A (en) * | 2019-12-26 | 2020-04-24 | 广州市百果园信息技术有限公司 | Data collection method, device, equipment and storage medium |
| CN111339139A (en) * | 2020-02-21 | 2020-06-26 | 广州市百果园信息技术有限公司 | Data processing method, device, equipment and storage medium |
| CN111460322A (en) * | 2020-04-16 | 2020-07-28 | 腾讯科技(成都)有限公司 | Data processing method, device, equipment and readable storage medium |
| CN111475519A (en) * | 2020-04-01 | 2020-07-31 | 深圳市思迪信息技术股份有限公司 | Data caching method and device |
| CN111767093A (en) * | 2020-06-29 | 2020-10-13 | 北京字节跳动网络技术有限公司 | Data processing method, device and storage medium |
| CN113391933A (en) * | 2021-06-21 | 2021-09-14 | 山东国晟华文信息技术有限公司 | Method for processing fund |
| CN113688158A (en) * | 2021-09-07 | 2021-11-23 | 京东科技控股股份有限公司 | Processing method, device, equipment, system and medium for business rule verification |
| CN114281269A (en) * | 2021-12-31 | 2022-04-05 | 中企云链（北京）金融信息服务有限公司 | Data caching method and device, storage medium and electronic device |
| CN117556065A (en) * | 2024-01-11 | 2024-02-13 | 江苏古卓科技有限公司 | Deep learning-based large model data management system and method |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010021949A1 (en) * | 1997-10-14 | 2001-09-13 | Alacritech, Inc. | Network interface device employing a DMA command queue |
| US20110099152A1 (en) * | 2009-10-26 | 2011-04-28 | Microsoft Corporation | Alternate data stream cache for file classification |
| CN102446222A (en) * | 2011-12-22 | 2012-05-09 | 华为技术有限公司 | Webpage content preloading method, device and system |
| CN103581051A (en) * | 2012-08-02 | 2014-02-12 | 深圳市腾讯计算机系统有限公司 | File buffering storage method and device and system |
| CN103716343A (en) * | 2012-09-29 | 2014-04-09 | 重庆新媒农信科技有限公司 | Distributed service request processing method and system based on data cache synchronization |
| CN104270271A (en) * | 2011-12-21 | 2015-01-07 | 北京奇虎科技有限公司 | Disaster tolerance backup system and method in internet application |
| CN104850509A (en) * | 2015-04-27 | 2015-08-19 | 交通银行股份有限公司 | Method and system for operating bank business data memory cache |
| CN104951857A (en) * | 2014-11-27 | 2015-09-30 | 国网山东省电力公司应急管理中心 | Power-grid-GIS-based meteorological data invoking and pretreatment method and system |
| CN104967651A (en) * | 2015-03-02 | 2015-10-07 | 深圳市腾讯计算机系统有限公司 | Data push, storage and downloading methods and devices based on CDN architecture |
| CN105245560A (en) * | 2014-07-11 | 2016-01-13 | 阿里巴巴集团控股有限公司 | Method, device and system for realizing distributed cache |
| CN106789259A (en) * | 2016-12-26 | 2017-05-31 | 中国科学院信息工程研究所 | A kind of LoRa core network systems and implementation method |
| CN107277050A (en) * | 2017-07-27 | 2017-10-20 | 维沃移动通信有限公司 | A kind of data processing method, server, terminal and computer-readable recording medium |
| CN107370806A (en) * | 2017-07-12 | 2017-11-21 | 北京京东尚科信息技术有限公司 | HTTP conditional codes monitoring method, device, storage medium and electronic equipment |
| CN206775541U (en) * | 2017-05-22 | 2017-12-19 | 北京中科奥科技有限公司 | Distributed game services system |
| US20180034929A1 (en) * | 2008-11-13 | 2018-02-01 | At&T Intellectual Property I, L.P. | System And Method For Selectively Caching Hot Content In a Content Distribution Network |
| CN107659623A (en) * | 2017-09-06 | 2018-02-02 | 深圳震有科技股份有限公司 | A kind of NP data distributing methods and system |
| CN107832354A (en) * | 2017-10-23 | 2018-03-23 | 珠海许继芝电网自动化有限公司 | A kind of power distribution network intelligence O＆M managing and control system of distributed caching |
| CN107948314A (en) * | 2017-12-21 | 2018-04-20 | 泰康保险集团股份有限公司 | Method for processing business, device and the server of rule-based file |
| CN108170802A (en) * | 2017-12-28 | 2018-06-15 | 武汉楚鼎信息技术有限公司 | A kind of data classification caching delivery method and system and device |
| CN108366110A (en) * | 2018-02-05 | 2018-08-03 | 山东地主网络科技创新有限公司 | A kind of website data interactive system and method |
-
2018
- 2018-09-27 CN CN201811134278.2A patent/CN109408751B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010021949A1 (en) * | 1997-10-14 | 2001-09-13 | Alacritech, Inc. | Network interface device employing a DMA command queue |
| US20180034929A1 (en) * | 2008-11-13 | 2018-02-01 | At&T Intellectual Property I, L.P. | System And Method For Selectively Caching Hot Content In a Content Distribution Network |
| US20110099152A1 (en) * | 2009-10-26 | 2011-04-28 | Microsoft Corporation | Alternate data stream cache for file classification |
| CN104270271A (en) * | 2011-12-21 | 2015-01-07 | 北京奇虎科技有限公司 | Disaster tolerance backup system and method in internet application |
| CN102446222A (en) * | 2011-12-22 | 2012-05-09 | 华为技术有限公司 | Webpage content preloading method, device and system |
| CN103581051A (en) * | 2012-08-02 | 2014-02-12 | 深圳市腾讯计算机系统有限公司 | File buffering storage method and device and system |
| CN103716343A (en) * | 2012-09-29 | 2014-04-09 | 重庆新媒农信科技有限公司 | Distributed service request processing method and system based on data cache synchronization |
| CN105245560A (en) * | 2014-07-11 | 2016-01-13 | 阿里巴巴集团控股有限公司 | Method, device and system for realizing distributed cache |
| CN104951857A (en) * | 2014-11-27 | 2015-09-30 | 国网山东省电力公司应急管理中心 | Power-grid-GIS-based meteorological data invoking and pretreatment method and system |
| CN104967651A (en) * | 2015-03-02 | 2015-10-07 | 深圳市腾讯计算机系统有限公司 | Data push, storage and downloading methods and devices based on CDN architecture |
| CN104850509A (en) * | 2015-04-27 | 2015-08-19 | 交通银行股份有限公司 | Method and system for operating bank business data memory cache |
| CN106789259A (en) * | 2016-12-26 | 2017-05-31 | 中国科学院信息工程研究所 | A kind of LoRa core network systems and implementation method |
| CN206775541U (en) * | 2017-05-22 | 2017-12-19 | 北京中科奥科技有限公司 | Distributed game services system |
| CN107370806A (en) * | 2017-07-12 | 2017-11-21 | 北京京东尚科信息技术有限公司 | HTTP conditional codes monitoring method, device, storage medium and electronic equipment |
| CN107277050A (en) * | 2017-07-27 | 2017-10-20 | 维沃移动通信有限公司 | A kind of data processing method, server, terminal and computer-readable recording medium |
| CN107659623A (en) * | 2017-09-06 | 2018-02-02 | 深圳震有科技股份有限公司 | A kind of NP data distributing methods and system |
| CN107832354A (en) * | 2017-10-23 | 2018-03-23 | 珠海许继芝电网自动化有限公司 | A kind of power distribution network intelligence O＆M managing and control system of distributed caching |
| CN107948314A (en) * | 2017-12-21 | 2018-04-20 | 泰康保险集团股份有限公司 | Method for processing business, device and the server of rule-based file |
| CN108170802A (en) * | 2017-12-28 | 2018-06-15 | 武汉楚鼎信息技术有限公司 | A kind of data classification caching delivery method and system and device |
| CN108366110A (en) * | 2018-02-05 | 2018-08-03 | 山东地主网络科技创新有限公司 | A kind of website data interactive system and method |
Non-Patent Citations (2)
| Title |
|---|
| CHUNCONG XU ET AL.: "Using Memcached to Promote Read Throughput in Massive Small-File Storage System", 《2010 NINTH INTERNATIONAL CONFERENCE ON GRID AND CLOUD COMPUTING》 * |
| 熊安萍 等: "一种基于混合索引的HDFS小文件存储策略", 《重庆邮电大学学报(自然科学版)》 * |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110898434A (en) * | 2019-11-06 | 2020-03-24 | 上饶市中科院云计算中心大数据研究院 | Method, server, system, and computer-readable program medium for processing data |
| CN110898434B (en) * | 2019-11-06 | 2023-07-25 | 上饶市中科院云计算中心大数据研究院 | Method, server, system and computer readable program medium for processing data |
| CN111061719A (en) * | 2019-12-26 | 2020-04-24 | 广州市百果园信息技术有限公司 | Data collection method, device, equipment and storage medium |
| CN111061719B (en) * | 2019-12-26 | 2023-08-29 | 广州市百果园信息技术有限公司 | Data collection method, device, equipment and storage medium |
| CN111339139A (en) * | 2020-02-21 | 2020-06-26 | 广州市百果园信息技术有限公司 | Data processing method, device, equipment and storage medium |
| CN111475519B (en) * | 2020-04-01 | 2024-03-15 | 深圳市思迪信息技术股份有限公司 | Data caching method and device |
| CN111475519A (en) * | 2020-04-01 | 2020-07-31 | 深圳市思迪信息技术股份有限公司 | Data caching method and device |
| CN111460322B (en) * | 2020-04-16 | 2022-08-12 | 腾讯科技(成都)有限公司 | Data processing method, device, equipment and readable storage medium |
| CN111460322A (en) * | 2020-04-16 | 2020-07-28 | 腾讯科技(成都)有限公司 | Data processing method, device, equipment and readable storage medium |
| CN111767093A (en) * | 2020-06-29 | 2020-10-13 | 北京字节跳动网络技术有限公司 | Data processing method, device and storage medium |
| CN111767093B (en) * | 2020-06-29 | 2023-08-08 | 抖音视界有限公司 | Data processing method, apparatus and storage medium |
| CN113391933A (en) * | 2021-06-21 | 2021-09-14 | 山东国晟华文信息技术有限公司 | Method for processing fund |
| CN113688158A (en) * | 2021-09-07 | 2021-11-23 | 京东科技控股股份有限公司 | Processing method, device, equipment, system and medium for business rule verification |
| CN114281269A (en) * | 2021-12-31 | 2022-04-05 | 中企云链（北京）金融信息服务有限公司 | Data caching method and device, storage medium and electronic device |
| CN114281269B (en) * | 2021-12-31 | 2023-08-15 | 中企云链（北京）金融信息服务有限公司 | Data caching method and device, storage medium and electronic device |
| CN117556065A (en) * | 2024-01-11 | 2024-02-13 | 江苏古卓科技有限公司 | Deep learning-based large model data management system and method |
| CN117556065B (en) * | 2024-01-11 | 2024-03-26 | 江苏古卓科技有限公司 | Deep learning-based large model data management system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109408751B (en) | 2022-08-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109408751A (en) | A kind of data processing method, terminal, server and storage medium | |
| US10909064B2 (en) | Application architecture supporting multiple services and caching | |
| US8356274B2 (en) | System and methods to create a multi-tenancy software as a service application | |
| CN105210392B (en) | Communication means and computer-readable non-transitory storage media | |
| US9996453B2 (en) | On-demand software test environment generation | |
| US20180276215A1 (en) | Sharing container images between mulitple hosts through container orchestration | |
| CN110751275B (en) | Graph training system, data access method and device, electronic device and storage medium | |
| US8788760B2 (en) | Adaptive caching of data | |
| CN104572278B (en) | The method, device and equipment of light application calling local side ability | |
| CN109412853B (en) | Distributed service registration storage method, system, device and storage medium | |
| CN108334562A (en) | A kind of page display method and device | |
| CN103109291A (en) | People directory with social privacy and contact association features | |
| US9830333B1 (en) | Deterministic data replication with conflict resolution | |
| US10430441B1 (en) | Tagging resources of a remote computing service based on locality | |
| CN108683668A (en) | Resource checksum method, apparatus, storage medium and equipment in content distributing network | |
| CN111177613A (en) | Page processing method, device, equipment and storage medium | |
| CN108280237A (en) | A kind of gray scale dissemination method and device, system, computer storage media | |
| CN113821307B (en) | Method, device and equipment for quickly importing virtual machine images | |
| CN107968807A (en) | Automatically update the method and device of local cache resource | |
| CN109639813A (en) | Video file transfer processing method and processing device, electronic equipment and storage medium | |
| CN110209964A (en) | A kind of page display method, device and equipment | |
| CN111314454A (en) | Application access method and device, electronic equipment and storage medium | |
| US20170134934A1 (en) | Communicating information about an update of an application | |
| CN116233254A (en) | Business cut-off method, device, computer equipment and storage medium | |
| CN110417919A (en) | A kind of flow abduction method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40002490 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |