CN109151061A - A kind of date storage method and device - Google Patents
A kind of date storage method and device Download PDFInfo
- Publication number
- CN109151061A CN109151061A CN201811142161.9A CN201811142161A CN109151061A CN 109151061 A CN109151061 A CN 109151061A CN 201811142161 A CN201811142161 A CN 201811142161A CN 109151061 A CN109151061 A CN 109151061A
- Authority
- CN
- China
- Prior art keywords
- networking
- business datum
- server
- view
- depending
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000003860 storage Methods 0.000 title claims abstract description 13
- 230000006855 networking Effects 0.000 claims abstract description 210
- 230000005540 biological transmission Effects 0.000 claims abstract description 14
- 238000013500 data storage Methods 0.000 claims description 7
- 238000005516 engineering process Methods 0.000 description 20
- 238000010586 diagram Methods 0.000 description 12
- 238000012545 processing Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 6
- 238000009826 distribution Methods 0.000 description 5
- RTZKZFJDLAIYFH-UHFFFAOYSA-N Diethyl ether Chemical compound CCOCC RTZKZFJDLAIYFH-UHFFFAOYSA-N 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000011144 upstream manufacturing Methods 0.000 description 2
- 241000700605 Viruses Species 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000002155 anti-virotic effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a kind of date storage methods, the method is applied to view networking, the view networking includes view networking primary server, depending on networking data library server, depending on master cache server of networking, depending on networked terminals, when the method includes: that the business datum for receiving the view networked terminals transmission in the first preset time depending on networking primary server is more than preset quantity, the business datum is sent to the view networking master cache server, it is described to be used to cache the business datum depending on networking master cache server, and the business datum is sent to view networking data library server；The access request of the business datum that the view networked terminals are received depending on networking primary server；The view networking primary server obtains the business datum from the view networking data library server according to the access request, and the business datum is back to the view networked terminals.Solve the problems, such as that business datum is lost because backing up not in time.
Description
Technical field
The present invention relates to view networking technology fields, more particularly to a kind of date storage method and a kind of data storage dress
It sets.
Background technique
With the fast development of the network technology, the two-way communications such as video conference, video teaching the life of user, work,
Study etc. is widely available, and has played positive effect in life and work application.
Wherein, since the operation that the database depending on networking directly reads and is written can not meet view networking in real time
The property stability requirement of communication, causes task to be lost, and causes adverse effect and consequence for important meeting.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind
A kind of date storage method and a kind of corresponding data storage device to solve the above problems.
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of date storage method, the method is applied to view
Networking, the view networking include view networking primary server, view networking data library server, view networking master cache server, view connection
Network termination, the method include: it is described depending on networking primary server the view networked terminals are received in the first preset time
When the business datum of transmission is more than preset quantity, the business datum is sent to the view networking master cache server, it is described
Depending on networking master cache server for caching the business datum, and the business datum is sent to the view networking data library
Server；The access request of the business datum that the view networked terminals are received depending on networking primary server；The view connection
Host server obtains the business datum from the view networking data library server according to the access request, and by the industry
Business data are back to the view networked terminals.
The embodiment of the invention also discloses a kind of data storage device, described device is applied to view networking, the view networking
Including view networking primary server, view networking data library server, view networking master cache server, view networked terminals, the dress
Setting includes: business datum cache module, and the view connection is received in the first preset time depending on networking primary server for described
When the business datum that network termination is sent is more than preset quantity, the business datum is sent to the view networking master cache service
Device, it is described to be sent to the view connection for caching the business datum, and by the business datum depending on networking master cache server
Grid database server；Access request receiving module, for the institute for receiving the view networked terminals depending on networking primary server
State the access request of business datum；Business datum return module, for view networking primary server according to the access request
The business datum is obtained from the view networking data library server, and the business datum is back to the view and is networked eventually
End.
The embodiment of the present invention includes following advantages:
It is described that the view networked terminals are received in the first preset time depending on networking primary server in the embodiment of the present invention
When the business datum of transmission is more than preset quantity, the business datum is sent to the view networking master cache server, it is described
Depending on networking master cache server for caching the business datum, and the business datum is sent to the view networking data library
Server；The access request of the business datum that the view networked terminals are received depending on networking primary server；The view connection
Host server obtains the business datum from the view networking data library server according to the access request, and by the industry
Business data are back to the view networked terminals.It realizes when a large number of services data pour in, the backup of real-time perfoming business datum, solution
The problem of business datum of having determined is lost because backing up not in time.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking of the invention；
Fig. 2 is a kind of hardware structural diagram of node server of the invention；
Fig. 3 is a kind of hardware structural diagram of access switch of the invention；
Fig. 4 is the hardware structural diagram that a kind of Ethernet association of the invention turns gateway；
Fig. 5 is a kind of step flow chart of date storage method embodiment of the invention；
Fig. 6 is a kind of structural block diagram of data storage device embodiment of the invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real
Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission,
Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service
Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring
Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication
All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or
Computer realizes that high-definition quality video plays.
Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below:
Depending on networking, applied portion of techniques is as described below:
Network technology (Network Technology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network
Video flow.(Circuit is exchanged different from simple network packet packet switch (Packet Switching) or lattice network
Switching), Streaming demand is met using Packet Switching depending on networking technology.Has grouping depending on networking technology
Flexible, the simple and low price of exchange, is provided simultaneously with the quality and safety assurance of circuit switching, it is virtually electric to realize the whole network switch type
The seamless connection of road and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack
It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis
It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually
The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform
Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy
Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media
Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and
Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media
Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes
Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but
The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time
The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black
The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net
The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich
The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type "
Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below:
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class
Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines
Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases
Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal.
Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve
Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end
Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve
Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area
The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat
Platform can form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or
National net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment are as follows:
Node server:
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array
Module 204；
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine
Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet；
And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close
It is full, then it abandons；All pack buffer queues of 202 poll of switching engine mould, are forwarded: 1) port if meeting the following conditions
It is less than to send caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, including
The operation such as initialization, read-write to hard disk；CPU module 203 is mainly responsible between access switch, terminal (not shown)
Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table)
Configuration, and, the configuration to disk array module 204.
Access switch:
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module
302), switching engine module 303 and CPU module 304；
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould
Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met,
It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould
The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 204 is come in enters switching engine
Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet；
If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier
(stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet
Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
Then abandon.
All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in embodiments of the present invention:
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1)
It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained；
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded:
1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.
Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval
Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and,
Configuration to rate control module 308.
Ethernet association turns gateway:
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module
402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan
Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined
Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet
DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting
Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410
(2byte), and enter corresponding receive and cache, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze
Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway
SA, Ethernet length or frametype, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal:
It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network
Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine
Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes: node server, node switch, metropolitan area server.
Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes
Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes,
payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections:
| DA | SA | Reserved | Payload | CRC |
Wherein:
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet
Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address,
Seven, the 8th bytes are access net address；
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA)；
Reserve bytes are made of 2 bytes；
The part payload has different length according to the type of different datagrams, is if it is various protocol packages
64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly；
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment
It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server
Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment
System, introduces parameter in embodiments of the present invention: label, uniquely to describe a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification
Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just
There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters
The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into
0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN)
Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with
The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:
| DA | SA | Reserved | Label | Payload | CRC |
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its
In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position
Set is between the reserve bytes and payload of data packet.
Based on the above-mentioned characteristic of view networking, one of the core concepts of the embodiments of the present invention is proposed, it then follows regard the association of networking
View shows that server receives the emergency command that the view networked terminals are sent and requests by the service state of local terminal, service state exhibition
Show that accident information is ranked up by server according to the accident gradation information, requests to send by emergency command according to ranking results
It is sent to view networked server to web server, then by web server, realizes service state displaying terminal and view networked terminals
Carry out the purpose of emergency command video connection.
Referring to Fig. 5, a kind of step flow chart of date storage method embodiment of the invention is shown, this method is applied to
Depending on networking, the view networking includes view networking primary server, view networking data library server, view networking master cache server, view
Networked terminals can specifically include following steps:
Step 501, described to receive what the view networked terminals were sent in the first preset time depending on networking primary server
When business datum is more than preset quantity, the business datum is sent to the view networking master cache server, the view networking
The business datum is sent to the view networking data library and serviced by master cache server for caching the business datum
Device；
In the embodiment of the present invention, the business datum generated during carrying out service request depending on networked terminals is usually by regarding
Networking primary server is received and is handled, and is worked as and received within a period of time (the first preset time) depending on networking primary server
The largely business datum of (preset quantity) has exceeded the processing capacity of view networking primary server, can will connect depending on networking primary server
The business datum received is forwarded to view networking master cache server in real time.
Wherein, the business datum received is cached into a period of time depending on network caching server, and during this period of time will
Business datum is sent to view networking data library server.
Certainly, the first preset time and preset quantity are by related technical personnel according to the data processing of view networking primary server
Ability setting, the embodiments of the present invention are not limited thereto.
Preferably, the view networking master cache server is associated with the sub- cache server of multiple views networkings, the view networking master
Cache server is also used to:
The business datum is written sequentially in time in preset data queue；
Every the second preset time, the sub- cache server of each view networking is prompted to read in the preset data queue
The business datum, the view network sub- cache server in third preset time, the business datum to be sent to
View networking data library server.
It is main slow when view networking master cache server is associated with multiple sub- cache servers of views networking in the embodiment of the present invention
Server is deposited after receiving business datum, business datum is distributed to the sub- cache server of each view networking.
Specifically, the business datum received is safeguarded using redis write-in redis depending on networking master cache server first
A set of real-time data queue, wherein Redis is substantially the memory database of a key_value type, entire database
It completely loads and is operated in memory, periodically database data is flushed on hard disk by asynchronous operation and is saved.
Because being pure internal memory operation, the performance of Redis is very outstanding, and the read-write operation per second that can handle more than 100,000 times, is known
The most fast Key-Value database of performance.
Specifically, when business datum write-in redis is safeguarded in a set of real-time data queue, when second is default
Between, prompt is each to read the business datum in the data queue depending on sub- cache server of networking, to realize that business datum joins in each view
Real-time update on net cache server.
Specifically, after receiving the third preset time of business datum depending on sub- cache server of networking, by business datum
It is sent to view networking data library server, is stored.
Wherein, business datum caching method does not limit the above redis for stating description and realizes that this is not added in the embodiment of the present invention
With limitation.
Preferably, further includes:
Step A1, the view networking primary server receive the view and network sub- cache server in the reading preset data
When the business datum in queue is successful, the backup successful information of transmission；
In the embodiment of the present invention, when view networking boss's cache server read preset data queue in business datum at
Function can send message to view networking primary server, to show itself to be updated successfully.
Step A2, it is described that the backup successful information is stored in preset backup log depending on networking primary server.
It specifically, will be each when the backup successful information for receiving the sub- cache server of each view networking depending on networking primary server
It information and corresponding is stored in preset backup log depending on the sub- cache server information of networking.
Preferably, the sub- cache server of each view networking is interrelated, described to be also used to depending on sub- cache server of networking:
If reading the business datum failure in the preset data queue, obtain in the view networking primary server
The preset backup log；
By the preset backup log, the sub- buffer service of other views networking for successfully caching the business datum is obtained
Device；
The business datum is downloaded by the sub- cache server of other views networkings.
It is respectively interrelatedly, when a sub- buffer service of view networking depending on sub- cache server of networking in the embodiment of the present invention
Device obtain preset data queue in business datum failure, can first request view network primary server on store it is preset
Backup log, and then the sub- cache server title of view networking being updated successfully is obtained, pass through the sub- cache server of view networking
Title connects the view and networks sub- cache server, and further obtains at this depending on the business number that caches on sub- cache server of networking
According to.
Step 502, the access request of the business datum that the view networked terminals are received depending on networking primary server；
In the embodiment of the present invention, in the access request for the business datum for receiving any view networked terminals depending on networking primary server
When, obtain the specifying information of the business datum in the service request.
Step 503, described to be obtained from described depending on networking data library server depending on networking primary server according to the access request
The business datum is taken, and the business datum is back to the view networked terminals.
Specifically, it according to the specifying information of the business datum of above-mentioned acquisition, is found from depending on networking data library server pair
The business datum answered simultaneously is downloaded to local, and the business datum that downloading is completed is back to view networked terminals.
In embodiments of the present invention, described that the view networking is received in the first preset time eventually depending on networking primary server
When the business datum that end is sent is more than preset quantity, the business datum is sent to the view networking master cache server, institute
It states depending on networking master cache server for caching the business datum, and the business datum is sent to the view networking data
Library server；The access request of the business datum that the view networked terminals are received depending on networking primary server；The view
Networking primary server obtains the business datum from the view networking data library server according to the access request, and will be described
Business datum is back to the view networked terminals.It realizes when a large number of services data pour in, the backup of real-time perfoming business datum,
Solve the problems, such as that business datum is lost because backing up not in time.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to
According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented
Necessary to example.
Referring to Fig. 6, a kind of structural block diagram of data storage device embodiment of the invention is shown, which is applied to view
Networking, the view networking include view networking primary server, view networking data library server, view networking master cache server, view connection
Network termination can specifically include following module:
Business datum cache module 601, for it is described received in the first preset time depending on networking primary server it is described
When being more than preset quantity depending on the business datum that networked terminals are sent, the business datum is sent to the view networking master cache clothes
Business device, it is described to be used to cache the business datum depending on networking master cache server, and the business datum is sent to the view
Networking data library server；
Preferably, the view networking master cache server is associated with the sub- cache server of multiple views networkings, the view networking master
Cache server is also used to:
The business datum is written sequentially in time in preset data queue；
Every the second preset time, the sub- cache server of each view networking is prompted to read in the preset data queue
The business datum, the view network sub- cache server in third preset time, the business datum to be sent to
View networking data library server.
Preferably, further includes:
It is described pre- in reading to receive the sub- cache server of the view networking for view networking primary server for backup module
When setting the business datum success in data queue, the backup successful information of transmission；
The backup successful information is stored in pre- purchase depending on networking primary server for described by backup information memory module
In part log.
Preferably, the sub- cache server of each view networking is interrelated, described to be also used to depending on sub- cache server of networking:
If reading the business datum failure in the preset data queue, obtain in the view networking primary server
The preset backup log；
By the preset backup log, the sub- buffer service of other views networking for successfully caching the business datum is obtained
Device；
The business datum is downloaded by the sub- cache server of other views networkings.
Access request receiving module 602, for the industry for receiving the view networked terminals depending on networking primary server
The access request for data of being engaged in；
Business datum return module 603 joins according to the access request from the view for view networking primary server
Grid database server obtains the business datum, and the business datum is back to the view networked terminals.
In embodiments of the present invention, business datum cache module, for view networking primary server when first is default
When the interior business datum for receiving the view networked terminals transmission is more than preset quantity, the business datum is sent to described
Depending on master cache server of networking, the view networking master cache server is used to cache the business datum, and by the business number
According to being sent to view networking data library server；Access request receiving module receives institute for view networking primary server
State the access request of the business datum of view networked terminals；Business datum return module, for view networking primary server
The business datum is obtained from the view networking data library server according to the access request, and the business datum is returned
To the view networked terminals.It realizes when a large number of services data pour in, the backup of real-time perfoming business datum solves business number
The problem of according to being lost because backing up not in time.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple
Place illustrates referring to the part of embodiment of the method.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these
Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices
Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram
The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices
In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet
The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that
Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart
And/or in one or more blocks of the block diagram specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases
This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap
Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited
Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
Above to a kind of date storage method provided by the present invention and a kind of data storage device, detailed Jie has been carried out
It continues, used herein a specific example illustrates the principle and implementation of the invention, and the explanation of above embodiments is only
It is to be used to help understand method and its core concept of the invention；At the same time, for those skilled in the art, according to this hair
Bright thought, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage
Solution is limitation of the present invention.
Claims (8)
1. a kind of date storage method, which is characterized in that the method is applied to view networking, and the view networking includes view networking master
Server, view networking data library server, view networking master cache server, view networked terminals, the method include:
It is described depending on networking primary server received in the first preset time it is described view networked terminals transmission business datum be more than
When preset quantity, the business datum is sent to the view networking master cache server, the view networking master cache server
View networking data library server is sent to for caching the business datum, and by the business datum；
The access request of the business datum that the view networked terminals are received depending on networking primary server；
The view networking primary server obtains the business number from the view networking data library server according to the access request
According to, and the business datum is back to the view networked terminals.
2. the method according to claim 1, wherein view networking master cache server is associated with multiple view networkings
Sub- cache server, described to be also used to depending on networking master cache server:
The business datum is written sequentially in time in preset data queue；
Every the second preset time, the sub- cache server of each view networking is prompted to read described in the preset data queue
Business datum, the view network sub- cache server for the business datum being sent to described in third preset time
Depending on networking data library server.
3. according to the method described in claim 2, it is characterized in that, further including
It is described to receive institute of the sub- cache server of the view networking in the reading preset data queue depending on networking primary server
When stating business datum success, the backup successful information of transmission；
It is described that the backup successful information is stored in preset backup log depending on networking primary server.
4. according to the method described in claim 3, sub- cache server is interrelated it is characterized in that, each view is networked, institute
It states and is also used to depending on sub- cache server of networking:
If reading the business datum failure in the preset data queue, the institute in the view networking primary server is obtained
State preset backup log；
By the preset backup log, the sub- cache server of other views networking for successfully caching the business datum is obtained；
The business datum is downloaded by the sub- cache server of other views networkings.
5. a kind of data storage device, which is characterized in that described device is applied to view networking, and the view networking includes view networking master
Server, view networking data library server, view networking master cache server, view networked terminals, the device include:
Business datum cache module receives the view networking eventually depending on networking primary server for described in the first preset time
When the business datum that end is sent is more than preset quantity, the business datum is sent to the view networking master cache server, institute
It states depending on networking master cache server for caching the business datum, and the business datum is sent to the view networking data
Library server；
Access request receiving module, for the business datum for receiving the view networked terminals depending on networking primary server
Access request；
Business datum return module, for the view network primary server according to the access request from the view networking data library
Server obtains the business datum, and the business datum is back to the view networked terminals.
6. device according to claim 5, which is characterized in that the view networking master cache server is associated with multiple view networkings
Sub- cache server, described to be also used to depending on networking master cache server:
The business datum is written sequentially in time in preset data queue；
Every the second preset time, the sub- cache server of each view networking is prompted to read described in the preset data queue
Business datum, the view network sub- cache server for the business datum being sent to described in third preset time
Depending on networking data library server.
7. device according to claim 6, which is characterized in that further include:
Backup module receives the view for view networking primary server and networks sub- cache server in the reading preset number
When successful according to the business datum in queue, the backup successful information of transmission；
The backup successful information is stored in preset backup day depending on networking primary server for described by backup information memory module
In will.
8. device according to claim 7, which is characterized in that the sub- cache server of each view networking is interrelated, institute
It states and is also used to depending on sub- cache server of networking:
If reading the business datum failure in the preset data queue, the institute in the view networking primary server is obtained
State preset backup log；
By the preset backup log, the sub- cache server of other views networking for successfully caching the business datum is obtained；
The business datum is downloaded by the sub- cache server of other views networkings.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811142161.9A CN109151061B (en) | 2018-09-28 | 2018-09-28 | Data storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811142161.9A CN109151061B (en) | 2018-09-28 | 2018-09-28 | Data storage method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109151061A true CN109151061A (en) | 2019-01-04 |
| CN109151061B CN109151061B (en) | 2021-08-03 |
Family
ID=64813412
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811142161.9A Active CN109151061B (en) | 2018-09-28 | 2018-09-28 | Data storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109151061B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109977167A (en) * | 2019-02-22 | 2019-07-05 | 视联动力信息技术股份有限公司 | Database backup method and device based on view networking |
| CN110287248A (en) * | 2019-05-24 | 2019-09-27 | 视联动力信息技术股份有限公司 | A kind of data read-write method and system |
| CN113127484A (en) * | 2020-12-31 | 2021-07-16 | 重庆帮企科技集团有限公司 | Efficient and quick data storage method and device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645928A (en) * | 2009-08-26 | 2010-02-10 | 成都市华为赛门铁克科技有限公司 | Content resource caching method, device and system |
| CN101771699A (en) * | 2010-01-06 | 2010-07-07 | 华南理工大学 | Method and system for improving SaaS application security |
| CN103716343A (en) * | 2012-09-29 | 2014-04-09 | 重庆新媒农信科技有限公司 | Distributed service request processing method and system based on data cache synchronization |
| CN104980472A (en) * | 2014-04-10 | 2015-10-14 | 腾讯科技（深圳）有限公司 | Network traffic control method and device |
| CN105635196A (en) * | 2014-10-27 | 2016-06-01 | 中国电信股份有限公司 | Method and system of file data obtaining, and application server |
| CN105701168A (en) * | 2015-12-31 | 2016-06-22 | 北京金山安全软件有限公司 | Data storage method and device and electronic equipment |
| US9547598B1 (en) * | 2013-09-21 | 2017-01-17 | Avego Technologies General Ip (Singapore) Pte. Ltd. | Cache prefill of cache memory for rapid start up of computer servers in computer networks |
| CN106407398A (en) * | 2016-09-21 | 2017-02-15 | 福建中金在线信息科技有限公司 | A data storage method and system |
| CN106713391A (en) * | 2015-11-13 | 2017-05-24 | 北京新媒传信科技有限公司 | Session information sharing method and sharing system |
-
2018
- 2018-09-28 CN CN201811142161.9A patent/CN109151061B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645928A (en) * | 2009-08-26 | 2010-02-10 | 成都市华为赛门铁克科技有限公司 | Content resource caching method, device and system |
| CN101771699A (en) * | 2010-01-06 | 2010-07-07 | 华南理工大学 | Method and system for improving SaaS application security |
| CN103716343A (en) * | 2012-09-29 | 2014-04-09 | 重庆新媒农信科技有限公司 | Distributed service request processing method and system based on data cache synchronization |
| US9547598B1 (en) * | 2013-09-21 | 2017-01-17 | Avego Technologies General Ip (Singapore) Pte. Ltd. | Cache prefill of cache memory for rapid start up of computer servers in computer networks |
| CN104980472A (en) * | 2014-04-10 | 2015-10-14 | 腾讯科技（深圳）有限公司 | Network traffic control method and device |
| CN105635196A (en) * | 2014-10-27 | 2016-06-01 | 中国电信股份有限公司 | Method and system of file data obtaining, and application server |
| CN106713391A (en) * | 2015-11-13 | 2017-05-24 | 北京新媒传信科技有限公司 | Session information sharing method and sharing system |
| CN105701168A (en) * | 2015-12-31 | 2016-06-22 | 北京金山安全软件有限公司 | Data storage method and device and electronic equipment |
| CN106407398A (en) * | 2016-09-21 | 2017-02-15 | 福建中金在线信息科技有限公司 | A data storage method and system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109977167A (en) * | 2019-02-22 | 2019-07-05 | 视联动力信息技术股份有限公司 | Database backup method and device based on view networking |
| CN110287248A (en) * | 2019-05-24 | 2019-09-27 | 视联动力信息技术股份有限公司 | A kind of data read-write method and system |
| CN113127484A (en) * | 2020-12-31 | 2021-07-16 | 重庆帮企科技集团有限公司 | Efficient and quick data storage method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109151061B (en) | 2021-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108075920B (en) | A kind of management method and system regarding networked terminals | |
| CN108234816B (en) | The method and device of resource information real-time synchronization is monitored between a kind of monitoring device | |
| CN108965372A (en) | A kind of service scheduling method and device | |
| CN110475102A (en) | A kind of monitoring data processing method and system based on view networking | |
| CN109617956A (en) | A kind of data processing method and device | |
| CN109474715A (en) | A kind of resource allocation method and device based on view networking | |
| CN110225083A (en) | Data push method and device based on view networking | |
| CN109284265A (en) | A kind of date storage method and system | |
| CN109151061A (en) | A kind of date storage method and device | |
| CN108206927A (en) | A kind of meeting synchronous method and device | |
| CN110048903A (en) | A kind of association turns gateway status monitoring method and device | |
| CN109347930A (en) | A kind of task processing method and device | |
| CN110287248A (en) | A kind of data read-write method and system | |
| CN110035307A (en) | A kind of fragment storage method and device | |
| CN110022500A (en) | A kind of loss treating method and device | |
| CN110048911A (en) | A kind of Cascading Methods and server based on view networking | |
| CN109922297A (en) | Call method and device | |
| CN109698790A (en) | A kind of storage method and system regarding networking data | |
| CN109067895A (en) | A kind of method and apparatus remotely controlled | |
| CN108965219A (en) | A kind of data processing method and device based on view networking | |
| CN108881965B (en) | A kind of server processes operating method and device | |
| CN110381029A (en) | A kind of monitoring resource synchronization method and device | |
| CN110535683A (en) | A kind of report method and device of end message | |
| CN110493555A (en) | Request processing method, user terminal, Core server, equipment and storage medium | |
| CN110377403A (en) | A kind of processing method and processing device of database access |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 33rd Floor, No.1 Huasheng Road, Yuzhong District, Chongqing 400013 Patentee after: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. Country or region after: China Address before: 100000 Beijing Dongcheng District Qinglong Hutong 1 Song Hua Building A1103-1113 Patentee before: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. Country or region before: China |