WO2019075978A1

WO2019075978A1 - Data transmission method and apparatus, computer device, and storage medium

Info

Publication number: WO2019075978A1
Application number: PCT/CN2018/077154
Authority: WO
Inventors: 乐伟
Original assignee: 平安科技（深圳）有限公司
Priority date: 2017-10-16
Filing date: 2018-02-24
Publication date: 2019-04-25
Also published as: CN107819828B; CN107819828A

Abstract

A data transmission method, comprising: acquiring target data needing to be transmitted; cutting the target data to be k pieces of sub-data to be transmitted, where k is an integer greater than 1; respectively establishing a data transmission channel with N target servers in a server set, where N is an integer greater than 1; sending a data transmission request to a corresponding target server via the data transmission channel, wherein the data transmission request carries one or more pieces of the sub-data, so that each of the target servers stores the received sub-data to a pre-set storage device.

Description

Data transmission method, device, computer device and storage medium

Cross-reference to related applications

This application claims the priority of the Chinese Patent Application entitled "Data Transmission Methods, Apparatus, Computer Equipment, and Storage Media", filed on October 16, 2017, the entire contents of which is hereby incorporated by reference. In this application.

Technical field

The application relates to a data transmission method, apparatus, computer device and storage medium.

Background technique

With the development of computer technology, more and more information is generated and the amount of information is increasing. In many scenarios, there is a need to upload data to a storage space on the network for storage, for example, to prevent data. Lost, upload the video file to a network storage device for backup.

However, the inventors have realized that when data is uploaded to a network storage device for storage, data transmission failure rate is high and transmission efficiency is low in the process of data transmission due to large amount of data and unstable network transmission.

Summary of the invention

According to various embodiments disclosed herein, a data transmission method, apparatus, computer device, and storage medium are provided.

A data transmission method includes:

Obtaining target data to be transmitted; dividing the target data into k sub-data to be transmitted, where k is an integer greater than 1;

Establishing a data transmission channel with N target servers in the server set, where N is an integer greater than 1;

Transmitting, by the data transmission channel, a data transmission request to a corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers store the received sub-data to a pre- Set on the storage device.

A data transmission device comprising:

a target data acquisition module, configured to acquire target data to be transmitted; a target data segmentation module, configured to divide the target data into k sub-data to be transmitted, where k is an integer greater than 1;

a channel establishing module, configured to establish a data transmission channel with N target servers in the server set, where N is an integer greater than one;

a transmission module, configured to send, by using the data transmission channel, a data transmission request to a corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers will receive the The sub data is stored on a preset storage device.

A computer apparatus comprising a memory and one or more processors having stored therein computer readable instructions that, when executed by a processor, implement the steps of a data transfer method provided in any one of the embodiments of the present application.

One or more non-transitory computer readable storage mediums storing computer readable instructions, when executed by one or more processors, cause one or more processors to be implemented in any one embodiment of the present application The steps of the data transfer method provided.

Details of one or more embodiments of the present application are set forth in the accompanying drawings and description below. Other features and advantages of the present invention will be apparent from the description, drawings and claims.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings to be used in the embodiments will be briefly described below. Obviously, the drawings in the following description are only some embodiments of the present application, Those skilled in the art can also obtain other drawings based on these drawings without any creative work.

1 is an application environment diagram of a data transmission method provided in accordance with one or more embodiments.

2 is a flow diagram of a method of data transmission in accordance with one or more embodiments.

3 is a flow chart of a data transmission method in another embodiment.

4 is a flow chart of a data transmission method in another embodiment.

Figure 5 is a flow chart of a data transmission method in another embodiment.

FIG. 6 is a block diagram of a data transmission device in accordance with one or more embodiments.

Figure 7 is a block diagram of a data transmission device in another embodiment.

Figure 8 is a block diagram of a data transmission device in another embodiment.

Figure 9 is a block diagram of a data transmission device in another embodiment.

Figure 10 is a block diagram of a computer device in accordance with one or more embodiments.

Detailed ways

In order to make the technical solutions and advantages of the present application more clear, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

It will be understood that the terms "first," "second," and the like, as used herein, may be used to describe various elements, and the elements are not limited by these terms unless specifically stated. These terms are only used to distinguish one element from another. For example, a first server may be referred to as a second server, and similarly, a second server may be referred to as a first server, without departing from the scope of the present application.

1 is an application environment diagram of a data transmission method provided in an embodiment. As shown in FIG. 1 , the application environment includes a terminal 110, a server set 120 composed of multiple servers, a storage device 130, and a storage cluster 140. . When data is to be transmitted, the target data in the terminal 110 is acquired, the target data is divided into a plurality of sub-data to be transmitted, and then all of the plurality of target servers in the server set, such as the server 1 to the server M, or A part of the server establishes a data transmission channel, and the terminal 110 sends a data transmission request to each target server through the established transmission channel, where the data transmission request carries one or more sub-data, and the server stores the sub-data to the storage device after receiving the sub-data. 130. If the transmission of all the sub data is completed, the terminal 110 may transmit a data merge request to one of the servers in the set of servers, and the server that has received the data merge request merges the subdata stored on the storage device 130.

In some embodiments, the merged target data may be sent to the storage cluster 140. For example, the terminal may send a request to merge and upload the data to the storage cluster to the first server in the server set. After receiving the request, the first server receives the request. The child data is merged to obtain the target data, and the target data is sent to the storage cluster 140 for storage.

In some embodiments, after the merged target data is sent to the storage cluster 140, the first server may delete the sub-data on the storage device 130.

In some embodiments, storage device 130 may include a NAS ((Network Attached Storage)) volume.

In some embodiments, the terminal 110 may establish a data transmission channel with all the servers in the server set, and may also establish a transmission channel with a part of the server, which is not limited herein.

In some embodiments, the terminal 110 may randomly select a server in the server set to establish a data transmission channel, or set the terminal 110 to establish a data transmission channel with a specific server. For example, the server that establishes the data transmission channel with the terminal may be determined by the load balancing device according to the load balancing algorithm. The load balancing algorithm can be set as needed. For example, the server can be determined according to the performance of each server, the number of established network connections, and the like. Alternatively, the domain name server sets an IP address of each server in the domain name corresponding server set. When the domain name server receives the domain name resolution request sent by the terminal, the domain name server returns multiple IP addresses to the terminal 110, and the terminal receives multiple IP addresses according to the received address. Establish data transmission channels with multiple servers.

In some embodiments, the information transmission method provided by the embodiment of the present application may be implemented by installing an SDK (Software Development Kit) on the terminal.

It should be noted that the terminal 110 may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto. For example, in some embodiments, the method provided by the embodiments of the present application may also be performed in a server.

As shown in FIG. 2, in some embodiments, a data transmission method is provided, which may be applied to the terminal 110, and may specifically include the following steps:

Step 202: Acquire target data that needs to be transmitted.

Specifically, the target data may include one or more of video data, image data, text data, and audio data, and may be other forms of data, which is not limited herein. The target data may be determined based on the received data transmission request. For example, when the video data needs to be stored in the network storage device, the user can select the video data and click the upload button. After receiving the operation of the user clicking the upload button, the terminal acquires the video data as the target data.

In step 204, the target data is divided into k sub-data to be transmitted, and k is an integer greater than 1.

Specifically, the number of sub-data is greater than 1, but the specific number may be set as needed. For example, the number of sub-data to be sliced may be set in advance, for example, the target data is sliced into 8 sub-datas each time.

In some embodiments, the number of sub-data may be determined based on attribute information of the target data, such as the amount of data. For example, if the sub-data whose size is divided into 2 MB is set in advance, the number of sub-data obtained after the division is determined according to the size of the target data. It can be understood that if the target data is not an integer multiple of 2 MB, the size of the partial sub-data is less than 2 MB. For example, suppose a video data is 5MB, you can split the data into 3 sub-data, 2MB, 2MB and 1MB.

Step 206: Establish a data transmission channel with N target servers in the server set, where N is an integer greater than 1.

Specifically, there are multiple servers in the server set, and the target server is part or all of the servers in the server set. The number of target servers is greater than 1, but the specific values can be set according to actual needs. The N servers in the server set can be randomly selected to establish a data transmission channel, and the terminal can also establish a data transmission channel with a specific server. For example, the target server of establishing a data transmission channel with the terminal in the server set may be determined by the load balancing device according to the load balancing algorithm. The load balancing algorithm can be set as needed.

In some embodiments, the load balancing device may determine the target server based on the performance of each server in the set of servers, the amount of load on the server, and the like. For example, according to the current connection situation of the server, dynamically select a plurality of servers in which the current backlog connection number is less as a target server to establish a data transmission channel with the terminal, so as to improve transmission efficiency as much as possible, and reasonably distribute the load to the server set. server.

In some embodiments, a data transmission channel may be set up with a preset number of servers, or the number of sub-data may be set to be positively correlated with the number of servers that need to establish a data transmission channel. For example, you can set the ratio of K to N to 4:1.

In some embodiments, a domain name may be set in the domain name server to correspond to an IP address of multiple servers. When data is to be transmitted, the terminal sends a domain name resolution request to the domain name server. When the domain name server receives the domain name resolution request sent by the terminal, The domain name returns multiple IP addresses to the terminal. The terminal establishes a data transmission channel with the corresponding multiple servers according to the received IP address.

In some embodiments, the load balancing device sets the weighting factor of each server according to the performance of the server, and the server with high performance has a high weighting coefficient. The server is then assigned a corresponding number of key values based on the weighting factor. When receiving the data transmission request, the hash calculation is performed according to the identifier of the sub-data and the size of the sub-data, and the hash value is obtained, and then a modulo operation is performed with a preset value, and the obtained modulo result and the weight coefficient are obtained. The key value assigned to the server is matched, and then the network connection address of the matching server, such as an IP address, is returned to the terminal, and the terminal establishes a data transmission channel with the corresponding server according to the received network connection address.

For example, if there are two servers in the server set, you can set the weight of the A server to 0.3, the weight of the B server to 0.7, and the default value to 1000. Therefore, you can assign the key value of the A server to 0 to 300, and the B server. The corresponding key value is 301 to 999. If the hash value obtained by hash calculation is 1006, the value obtained by modulo calculation is 6 and matches the key value of the A server. Therefore, the terminal establishes a data transmission channel with the A server.

Step 208: Send a data transmission request to the corresponding target server through the data transmission channel, where the data transmission request carries one or more sub-data, so that the target server stores the received sub-data on the preset storage device.

Specifically, the sub data is distributed to the established data transmission channel for transmission until the sub data is transmitted. That is, after each sub-data is transmitted through one data transmission channel, the other data transmission channels will not transmit the sub-data. The subdata transmitted by each data transmission channel can be set as needed. For example, the selection may be performed at random or in the order of the target data in the order of the sub-files. After the transmission of the sub-data corresponding to each transmission request is completed, the data transmission channel established with the target server may be released, and the untransferred sub-data may be further transmitted by using the data transmission channel. For example, if there are 10 sub-data, there are 5 servers in the server set, and the terminal establishes a data transmission channel with the 3 target servers, then the sub-data can be transmitted to the corresponding 3 target servers by using the respective data transmission channels. After the target server transmits a sub-data, the terminal queries whether there is still untransferred sub-data. If it still exists, it can continue to send a data transmission request to the target server. Or disconnect the data transmission channel with the target server, and establish a new data transmission channel with other servers in the server collection, and use the new data transmission channel to transmit the untransferred sub data.

The above data transmission method, when data transmission is to be performed, acquires target data, divides the target data into a plurality of sub-data, and establishes a data transmission channel with a plurality of servers, and then sends the sub-data to the preset through each data transmission channel. On the storage device, since the data is divided into a plurality of sub-data when the data is transmitted and the sub-data is transmitted to the storage device by establishing communication with the plurality of servers, the target data is equivalent to being transmitted to the storage device in parallel, so The transmission efficiency can be improved, the transmission time is reduced, and the probability of transmission failure due to network instability can be reduced, and the data transmission success rate is high.

For example, through experiments, in the Internet environment, the target data of 20M or more is divided into multiple sub-data, the transmission success rate is 99.998%, and the transmission efficiency is increased by 200%.

In some embodiments, if the sub-data is transmitted to the terminal due to a network error or the like during the transmission, the breakpoint position of the sub-data may be recorded, and after the transmission is resumed, the sub-data may be transmitted from the breakpoint position.

In some embodiments, a transmission credential can be generated based on the user information and a preset algorithm, and the transmission credential is carried when the transmission request is sent. The target server may generate a voucher according to the user information and store it in advance. When the target server receives the transmission request, it matches the voucher stored by itself with the transmission voucher in the transmission request, and if the matching succeeds, the sub-data is received. To improve the security of data transmission. The preset algorithm can be set as needed. For example, the preset algorithm may be a CRC (Cyclic Redundancy Check) algorithm, a MD5 (Message-Digest Algorithm 5) algorithm, and a SHA (Secure Hash Algorithm) series algorithm.

In some embodiments, as shown in FIG. 3, the data transmission method may further include step S302: sending a storage space creation request to the first server in the server set, where the storage space creation request carries the target storage space identifier to enable the first server Create a target storage space on the storage device based on the target storage space identifier and associate the target storage space identifier with the target storage space. Step S208 is to send a data transmission request to the corresponding target server through each data transmission channel, where the data transmission request carries one or more sub-data, so that the target server stores the sub-data on the preset storage device, including: The data transmission channel sends a data transmission request to the corresponding target server, where the data transmission request carries the target storage space identifier and one or more sub-data, so that the target server stores the received sub-data according to the target storage space identifier to the target storage space. .

Specifically, the first server may be one of the target servers, or may be other servers in the server set. The first server may be randomly selected or may be obtained according to a load balancing algorithm. The load balancing algorithm may be specifically performed by referring to the methods provided in other embodiments of the present application, and details are not described herein again. After receiving the storage space creation request, the first server creates a target storage space on the storage device according to the target storage space identifier, associates the target storage space identifier with the target storage space, and returns a message that the target storage space is successfully created. After receiving the successfully created message, the terminal may send a data transmission request to the corresponding target server through each data transmission channel, where the data transmission request carries one or more sub-data and a target storage space identifier, so that the target server receives the data transmission. After the request, the corresponding target storage space is found according to the target storage space identifier, and then the sub data is stored on the target storage space.

In some embodiments, after establishing a data transmission channel with one of the target servers, a storage space creation request is sent through the data transmission channel.

In some embodiments, the first server may create a folder on the storage device that stores the child data, the identity of the folder being the target storage space identifier.

In some embodiments, in some embodiments, as shown in FIG. 4, the data transmission method may further include steps S402 and S404. Details are as follows:

Step S402, assigning a sub-data identifier to the sub-data according to the position of the target data according to the sub-data.

Specifically, the position of the sub data in the target data refers to the order in which the sub data is arranged in the target data. The target data is divided as a whole according to the order in which the data is arranged, and the sub-data is assigned an identifier in order. The composition rule of the sub-data identifier can be set according to actual needs, for example, one or more of letters and numbers can be used, as long as the sub-data can be identified at the location of the target data. For example, for a video file, it is divided into 5 sub-videos according to the playing order. According to the playing order, the sub-videos can be identified as 0, 1, 2, 3, 4, respectively, or can be identified as A, B, C, D, E. .

Step S208 is to send a data transmission request to the corresponding target server through each data transmission channel, and the step of carrying one or more sub-data in the data transmission request includes: sending a data transmission request to the corresponding target server through each data transmission channel, and the data transmission request The sub-data identifier corresponding to one or more sub-data and the carried sub-data is carried in.

Step S404: Send a data merge request to the second server in the server set, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain target data.

Specifically, after obtaining the identifier of the sub-data, the data transmission request sent to the target server carries the one or more sub-data and the sub-data identifier corresponding to the carried sub-data, so that the target server can associate the sub-data with the corresponding sub-data identifier. storage. The second server may be one of the target servers or other servers in the server set, and the first server and the second server may be the same or different. After the sub-data transmission is completed, the terminal may send a data merge request to the second server in the server set, and after receiving the data merge request, the second server acquires the sub-data identifier, and merges the sub-data according to the order corresponding to the sub-data identifier to obtain the merge. After the target data. For example, if the sub-data is identified as 0, 1, 2, 3, and 4, respectively, the sub-data corresponding to 0, 1, 2, 3, and 4 may be combined in order to obtain target data.

In some embodiments, as shown in FIG. 5, the data transmission method may further include the following steps:

Step S502, after the target data transmission is completed, the verification information corresponding to the target data is acquired.

Specifically, the verification information is used to verify whether the sub-data of the target data is correctly and completely transmitted. The verification information may include attribute information of the target data, such as the size of the target data, the format of the target data, the sub-data identifier corresponding to the target data, the number of sub-data, and the size of each sub-data. In some embodiments, the check value may also be generated according to the attribute of the target data and the hash algorithm, and the check information may include at least one of the check value and the attribute information of the target data.

In some embodiments, the hash algorithm may be an MD5 (Message-Digest Algorithm 5) algorithm and a SHA (Secure Hash Standard) algorithm, and the like.

Step S504, the verification information is sent to the third server in the server set, so that the third server performs verification on the sub-data on the storage device according to the verification information, and returns a verification result, where the verification result includes verification. Success or verification failed.

Specifically, the third server may be one of the target servers or other servers in the server set. For example, the third server may be randomly selected or may be obtained according to a load balancing algorithm. The load balancing algorithm may be specifically performed by referring to the method provided in the embodiment of the present application, and details are not described herein again. It can be understood that the first server, the second server, and the third server may be the same or different. The third server acquires the attribute information of each sub-data on the storage device. After the verification information sent by the terminal includes the attribute information of the target data, the attribute information of the sub-data is matched with the attribute information of the target data. When the verification information sent by the terminal includes the verification generated according to the attribute information of the target data, another verification value is obtained according to the attribute information of the sub data and calculated by using a hash algorithm. The received check value is then matched against the calculated check value.

In some embodiments, when the verification information includes the attribute information or the check value of the target data, if the attribute information or the check value of the target data is successfully matched, the corresponding verification result is that the verification is successful. Otherwise, the verification result is a verification failure. When the verification information includes the attribute information of the target data and the check value, if the attribute information and the check value of the target data match successfully, the verification result is that the verification is successful, and any one of the attribute information and the check value matches When it fails, the verification result is a verification failure. For example, the verification information sent by the terminal may include the size of the target data, and the third server obtains the sum of the sizes of the sub-data on the storage device, and then compares with the size of the target data sent by the terminal. If the size is consistent, the verification result is The verification was successful.

In some embodiments, when the verification result includes the verification success, the terminal sends a data merge request to the second server, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain the target data.

In some embodiments, when the verification result includes the verification failure, the third server may return the verification failure information, and when the terminal receives the verification failure result, the target data may be re-uploaded.

In some embodiments, when the verification result includes a verification failure, the verification result may include a matching result of the verification information, where the matching result is used to indicate that the specific verification information is a matching failure or a matching success. The terminal obtains the sub-data of the failed match according to the matching result and re-uploads the sub-data to reduce the amount of re-transmitted data. For example, when the check information includes the size of each sub-data, the sub-data identifier whose sub-data size matching fails may be returned, and the terminal re-transmits the corresponding sub-data according to the returned sub-data identifier.

It should be understood that although the various steps in the above-described flowcharts are sequentially displayed as indicated by the arrows, these steps are not necessarily performed in the order indicated by the arrows. Except as explicitly stated herein, the execution of these steps is not strictly limited, and the steps may be performed in other orders. Moreover, at least a portion of the steps of the above-described flowcharts may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be executed at different times, the execution of these sub-steps or stages The order is also not necessarily sequential, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of the other steps.

As shown in FIG. 6 , in some embodiments, a data transmission device is provided. The data transmission device may be integrated into the terminal 110, and may specifically include:

The target data obtaining module 602 is configured to acquire target data that needs to be transmitted;

The target data slicing module 604 is configured to divide the target data into k sub-data to be transmitted, where k is an integer greater than one;

The channel establishing module 606 is configured to establish a data transmission channel with the N target servers in the server set, where N is an integer greater than one;

The transmission module 608 is configured to send a data transmission request to the corresponding target server through the data transmission channel, where the data transmission request carries one or more sub-data, so that each target server stores the received sub-data on the preset storage device. .

As shown in FIG. 7, in some embodiments, the apparatus further includes:

The space creation module 702 is configured to send a storage space creation request to the first server in the server set, where the storage space creation request carries the target storage space identifier, so that the first server creates the target storage space on the storage device according to the target storage space identifier. And associate the target storage space identifier with the target storage space;

The transmission module 608 is configured to: send, by each data transmission channel, a data transmission request to the corresponding target server, where the data transmission request carries the target storage space identifier and one or more sub-data, so that the target server stores the sub-data according to the target storage space identifier. Go to the target storage space.

As shown in FIG. 8, in some embodiments, the apparatus further includes:

An identifier allocation module 802, configured to allocate a sub-data identifier for the sub-data according to the location of the target data according to the sub-data;

The transmission module 608 is configured to: send a data transmission request to the corresponding target server by using each data transmission channel, where the data transmission request carries one or more sub-data and a sub-data identifier corresponding to the carried sub-data, so that each target server will sub-data Stored on a preset storage device;

The device further includes a merge request sending module 804, configured to send a data merge request to the second server in the server set, so that the second server merges the child data on the storage device according to the child data identifier to obtain target data.

As shown in FIG. 9, in some embodiments, the apparatus further includes:

The verification information obtaining module 902 is configured to acquire verification information corresponding to the target data after the target data transmission is completed;

The verification information sending module 904 is configured to send the verification information to the third server in the server set, so that the third server performs verification on the sub-data on the storage device according to the verification information, and returns a verification result. The verification result includes verification success or verification failure.

In some embodiments, the merge request sending module 804 is configured to: when the verification result includes the verification success, send a data merge request to the second server, so that the second server performs the sub-data on the storage device according to the sub-data identifier. Consolidate to get the target data.

For the specific definition of the data transmission device, reference may be made to the above definition of the data transmission method, and details are not described herein again. The various modules in the above data transmission device may be implemented in whole or in part by software, hardware, and combinations thereof. Each of the above modules may be embedded in or independent of the processor in the computer device, or may be stored in a memory in the computer device in a software form, so that the processor invokes the operations corresponding to the above modules.

As shown in FIG. 10, which is an internal structural diagram of a computer device in an embodiment, the computer device may be a terminal, and the computer device is connected to a processor, a non-volatile storage medium, an internal memory, and a network interface through a system connection bus. The non-volatile storage medium can be a non-transitory computer readable storage medium. The non-volatile storage medium of the computer device can store an operating system and computer readable instructions that, when executed, cause the processor to perform a data transfer method. The processor of the computer device is used to provide computing and control capabilities to support the operation of the entire computer device. The internal memory can store computer readable instructions that, when executed by the processor, cause the processor to perform a method of data transmission. The network interface of the computer device is used for network communication, such as sending a data transmission request. It will be understood by those skilled in the art that the structure shown in FIG. 10 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation of the computer device to which the solution of the present application is applied. The specific computer device may include More or fewer components than shown in the figure, or some components combined, or with different component arrangements.

In some embodiments, the data transfer apparatus provided herein can be implemented in the form of a computer readable instruction that can be run on a computer device as shown in FIG. 10, non-volatile storage of the computer device The medium may store various program modules constituting the data transmission device, such as the target data acquisition module 602, the target data segmentation module 604, the channel establishment module 606, and the transmission module 608 in FIG. Each of the program modules includes computer readable instructions for causing a computer device to perform the steps in the data transfer method of various embodiments of the present application described in this specification. For example, the computer device can be as shown in FIG. The target data acquisition module 602 in the data transmission device acquires the target data to be transmitted; the target data is divided into k sub-data to be transmitted by the target data segmentation module 604, where k is an integer greater than 1, and the channel establishment module 606 is Establishing a data transmission channel with N target servers in the server set, respectively, N is an integer greater than 1; sending, by the transmission module 608, a data transmission request to the corresponding target server through the data transmission channel, where the data transmission request carries one or more sub-data So that each target server stores the received sub-data on a preset storage device.

A computer device comprising a memory and one or more processors having stored therein computer readable instructions, the computer readable instructions being executed by the processor such that the one or more processors perform the steps of: acquiring a target to be transmitted Data; dividing the target data into k sub-data to be transmitted, the k being an integer greater than 1; respectively establishing a data transmission channel with N target servers in the server set, the N being an integer greater than 1 And sending, by the data transmission channel, a data transmission request to the corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers will receive the sub-data Stored on a preset storage device.

One or more non-transitory computer readable storage mediums storing computer readable instructions, when executed by one or more processors, cause one or more processors to perform the steps of: obtaining a transmission requiring Target data; the target data is divided into k sub-data to be transmitted, the k is an integer greater than 1; respectively, a data transmission channel is established with N target servers in the server set, and the N is greater than 1. And transmitting, by the data transmission channel, a data transmission request to the corresponding target server, where the data transmission request carries one or more of the subdata, so that the respective target servers will receive the sub The data is stored on a preset storage device.

One of ordinary skill in the art can understand that all or part of the process of implementing the above embodiments can be completed by computer readable instructions, which can be stored in a non-volatile computer. The readable storage medium, which when executed, may include the flow of an embodiment of the methods as described above. Any reference to a memory, storage, database or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of formats, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronization chain. Synchlink DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM).

The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.

The above-mentioned embodiments are merely illustrative of several embodiments of the present application, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the claims. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the present application. Therefore, the scope of the invention should be determined by the appended claims.

Claims

A data transmission method includes:

Obtain target data that needs to be transferred;

Splitting the target data into k sub-data to be transmitted, where k is an integer greater than one;

Establishing a data transmission channel with N target servers in the server set, where N is an integer greater than 1;

Transmitting, by the data transmission channel, a data transmission request to a corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers store the received sub-data to a pre- Set on the storage device.
The method of claim 1 comprising:

Sending a storage space creation request to the first server in the server set, the storage space creation request carrying a target storage space identifier, so that the first server creates a target on the storage device according to the target storage space identifier Storing a space and associating the target storage space identifier with the target storage space; and

Transmitting, by the respective data transmission channels, a data transmission request to a corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers store the sub-data to a pre- The storage device provided includes:

Transmitting, by the respective data transmission channels, a data transmission request to a corresponding target server, where the data transmission request carries the target storage space identifier and one or more of the sub-data, so that the target server is configured according to the target The storage space identifier stores the received sub-data onto the target storage space.
The method according to claim 1 or 2, comprising:

Allocating a sub-data identifier to the sub-data according to the location of the target data according to the sub-data;

Transmitting, by the respective data transmission channels, a data transmission request to a corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers will receive the sub-data Storage to a preset storage device includes:

Sending, by the respective data transmission channels, a data transmission request to the corresponding target server, where the data transmission request carries one or more of the sub-data and the sub-data identifier corresponding to the carried sub-data, so that the respective The target server stores the sub data on a preset storage device; and

The method further includes:

Sending a data merge request to the second server in the server set, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain the target data.
The method of claim 3, comprising:

After the target data transmission is completed, acquiring verification information corresponding to the target data; and

Sending the verification information to a third server in the server set, so that the third server performs verification on the sub-data on the storage device according to the verification information, and returns a verification result. The verification result includes a verification success or a verification failure.
The method according to claim 4, wherein the sending a data merge request to the second server, so that the second server merges the sub-data on the storage device according to the sub-data identifier , get the target sub-data including:

When the verification result includes the verification success, sending a data merge request to the second server, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain a Target data.
A data transmission device comprising:

a target data acquisition module, configured to acquire target data to be transmitted;

a target data slicing module, configured to divide the target data into k sub-data to be transmitted, where k is an integer greater than 1;

a channel establishing module, configured to establish a data transmission channel with N target servers in the server set, where N is an integer greater than 1;

a transmission module, configured to send, by using the data transmission channel, a data transmission request to a corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers will receive the The sub data is stored on a preset storage device.
The device according to claim 6, comprising:

a space creation module, configured to send a storage space creation request to the first server in the server set, where the storage space creation request carries a target storage space identifier, so that the first server identifies the target storage space according to the Creating a target storage space on the storage device, and associating the target storage space identifier with the target storage space; and

The transmission module is used to:

Transmitting, by the respective data transmission channels, a data transmission request to a corresponding target server, where the data transmission request carries the target storage space identifier and one or more of the sub-data, so that the target server is configured according to the target The storage space identifier stores the sub data onto the target storage space.
The device according to claim 6 or 7, comprising:

An identifier allocation module, configured to allocate a sub-data identifier for the sub-data according to the location of the target data according to the sub-data;

The transmission module is used to:

Transmitting, by the respective data transmission channels, a data transmission request to the corresponding target server, where the data transmission request carries the one or more sub-data and the sub-data identifier corresponding to the carried sub-data, so that the respective targets are The server stores the sub data on a preset storage device; and

The device also includes:

a merge request sending module, configured to send a data merge request to the second server in the server set, so that the second server merges the sub-data on the storage device according to the sub-data identifier, to obtain the Target data.
The device according to claim 8, comprising:

a verification information obtaining module, configured to acquire verification information corresponding to the target data after the target data transmission is completed; and

a verification information sending module, configured to send the verification information to a third server in the server set, so that the third server performs the sub-data on the storage device according to the verification information. Verifies and returns a verification result, which includes verification success or verification failure.
The apparatus according to claim 9, wherein said merge request sending module is configured to:

When the verification result includes the verification success, sending a data merge request to the second server, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain a Target data.
A computer device comprising a memory and one or more processors having stored therein computer readable instructions, the computer readable instructions being executed by the one or more processors to cause the one or more The processors perform the following steps:

Obtain target data that needs to be transferred;

Splitting the target data into k sub-data to be transmitted, where k is an integer greater than one;

Establishing a data transmission channel with N target servers in the server set, where N is an integer greater than 1;

Transmitting, by the data transmission channel, a data transmission request to a corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers store the received sub-data to a pre- Set on the storage device.
The computer apparatus according to claim 11, wherein said processor further performs the following steps when said computer readable instructions are executed:

Sending a storage space creation request to the first server in the server set, the storage space creation request carrying a target storage space identifier, so that the first server creates a target on the storage device according to the target storage space identifier Storing a space and associating the target storage space identifier with the target storage space; and

Transmitting, by the processor, the data transmission request to the corresponding target server by using the respective data transmission channels, where the data transmission request carries one or more of the sub-data, so that the respective target servers will The storing of the sub data to a preset storage device includes:

Transmitting, by the respective data transmission channels, a data transmission request to a corresponding target server, where the data transmission request carries the target storage space identifier and one or more of the sub-data, so that the target server is configured according to the target The storage space identifier stores the received sub-data onto the target storage space.
A computer apparatus according to claim 11 or 12, wherein said processor further performs the following steps when said computer readable instructions are executed:

Allocating a sub-data identifier to the sub-data according to the location of the target data according to the sub-data;

Transmitting, by the processor, the data transmission request to the corresponding target server by using the respective data transmission channels, where the data transmission request carries one or more of the sub-data, so that the respective target servers will The receiving the received sub-data to the preset storage device includes:

Sending, by the respective data transmission channels, a data transmission request to the corresponding target server, where the data transmission request carries one or more of the sub-data and the sub-data identifier corresponding to the carried sub-data, so that the respective The target server stores the sub data on a preset storage device; and

The processor also performs the following steps when executing the computer readable instructions:

Sending a data merge request to the second server in the server set, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain the target data.
The computer apparatus according to claim 13, wherein said processor further performs the following steps when said computer readable instructions are executed:

After the target data transmission is completed, acquiring verification information corresponding to the target data; and

Sending the verification information to a third server in the server set, so that the third server performs verification on the sub-data on the storage device according to the verification information, and returns a verification result. The verification result includes a verification success or a verification failure.
The computer device according to claim 14, wherein said executing by said processor transmits a data merge request to said second server to cause said second server to identify said The sub-data on the storage device is merged to obtain the target sub-data including:

When the verification result includes the verification success, sending a data merge request to the second server, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain a Target data.
One or more non-transitory computer readable storage mediums storing computer readable instructions, when executed by one or more processors, cause the one or more processors to perform the following steps:

Obtain target data that needs to be transferred;

Splitting the target data into k sub-data to be transmitted, where k is an integer greater than one;

Establishing a data transmission channel with N target servers in the server set, where N is an integer greater than 1;

Transmitting, by the data transmission channel, a data transmission request to a corresponding target server, where the data transmission request carries one or more of the sub-data, so that the respective target servers store the received sub-data to a pre- Set on the storage device.
The storage medium of claim 16, wherein the processor further performs the following steps when the computer readable instructions are executed:

Sending a storage space creation request to the first server in the server set, the storage space creation request carrying a target storage space identifier, so that the first server creates a target on the storage device according to the target storage space identifier Storing a space and associating the target storage space identifier with the target storage space; and

Transmitting, by the processor, the data transmission request to the corresponding target server by using the respective data transmission channels, where the data transmission request carries one or more of the sub-data, so that the respective target servers will The storing of the sub data to a preset storage device includes:

Transmitting, by the respective data transmission channels, a data transmission request to a corresponding target server, where the data transmission request carries the target storage space identifier and one or more of the sub-data, so that the target server is configured according to the target The storage space identifier stores the received sub-data onto the target storage space.
A storage medium according to claim 16 or 17, wherein said processor further performs the following steps when said computer readable instructions are executed:

Allocating a sub-data identifier to the sub-data according to the location of the target data according to the sub-data;

Transmitting, by the processor, the data transmission request to the corresponding target server by using the respective data transmission channels, where the data transmission request carries one or more of the sub-data, so that the respective target servers will The receiving the received sub-data to the preset storage device includes:

Sending, by the respective data transmission channels, a data transmission request to the corresponding target server, where the data transmission request carries one or more of the sub-data and the sub-data identifier corresponding to the carried sub-data, so that the respective The target server stores the sub data on a preset storage device; and

The processor also performs the following steps when executing the computer readable instructions:

Sending a data merge request to the second server in the server set, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain the target data.
The storage medium of claim 18, wherein the processor further performs the following steps when the computer readable instructions are executed:

After the target data transmission is completed, acquiring verification information corresponding to the target data; and

Sending the verification information to a third server in the server set, so that the third server performs verification on the sub-data on the storage device according to the verification information, and returns a verification result. The verification result includes a verification success or a verification failure.
The storage medium of claim 19, wherein the processor performs a data merge request to the second server to cause the second server to identify the The sub-data on the storage device is merged to obtain the target sub-data including:

When the verification result includes the verification success, sending a data merge request to the second server, so that the second server merges the sub-data on the storage device according to the sub-data identifier to obtain a Target data.