CN111400751A - Disaster recovery cloud storage system construction method based on block chain technology - Google Patents
Disaster recovery cloud storage system construction method based on block chain technology Download PDFInfo
- Publication number
- CN111400751A CN111400751A CN202010168454.5A CN202010168454A CN111400751A CN 111400751 A CN111400751 A CN 111400751A CN 202010168454 A CN202010168454 A CN 202010168454A CN 111400751 A CN111400751 A CN 111400751A
- Authority
- CN
- China
- Prior art keywords
- data
- cloud storage
- block chain
- storage system
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000011084 recovery Methods 0.000 title claims abstract description 39
- 238000005516 engineering process Methods 0.000 title claims abstract description 25
- 238000010276 construction Methods 0.000 title claims abstract description 19
- 238000000034 method Methods 0.000 claims description 18
- 238000013500 data storage Methods 0.000 claims description 6
- 230000003993 interaction Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000008859 change Effects 0.000 claims description 4
- 238000007726 management method Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6227—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database where protection concerns the structure of data, e.g. records, types, queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/602—Providing cryptographic facilities or services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/80—Database-specific techniques
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- Quality & Reliability (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a block chain technology-based disaster recovery cloud storage system construction method, which specifically comprises the following steps: s1, construction of a cloud storage system framework: the invention relates to the technical field of cloud storage systems, and discloses a distributed disaster recovery cloud storage system operation framework based on a block chain. According to the block chain technology-based disaster recovery cloud storage system construction method, a distributed disaster recovery cloud storage system operation framework based on a block chain is constructed, a main control node, a storage node and a metadata log server are established in the cloud storage system framework constructed in the step S1, and the block chain technology is applied to the field of disaster recovery cloud storage, so that a many-to-many contact relation can be directly established between a plurality of network storage devices and storage requirements, a unified management platform does not need to be established, construction, operation and management costs of the cloud storage system are greatly reduced, and the safety of stored data can be effectively guaranteed by adopting asymmetric encryption.
Description
Technical Field
The invention relates to the technical field of cloud storage systems, in particular to a disaster recovery cloud storage system construction method based on a block chain technology.
Background
The cloud storage is a mode of online storage on the internet, that is, data is stored in a plurality of virtual servers generally hosted by a third party, rather than dedicated servers, a hosting company operates a large-scale data center, and a person who needs to host data storage meets the requirement of data storage by purchasing or leasing a storage space to the person.
In the prior art, the cloud storage system is generally constructed in a single-to-single node connection mode, a plurality of nodes are managed by constructing a unified platform, the construction, operation and management costs of the cloud storage system are improved, the technical problem of constructing the distributed cloud storage system is solved to a great extent due to the block chain technology, the block chain technology has natural decentralized characteristics, intercommunication and mutual trust among network nodes can be achieved through a consensus algorithm, and it is expected that the block chain technology is applied to the disaster recovery cloud storage field, many-to-many contact relations can be directly established among a plurality of network storage devices and storage requirements, and the unified management platform does not need to be constructed, so that the construction, operation and management costs of the system are greatly reduced.
Disclosure of Invention
Technical problem to be solved
Aiming at the defects of the prior art, the invention provides a block chain technology-based disaster recovery cloud storage system construction method, which solves the problem that the construction, operation and management costs of a cloud storage system in the prior art are high.
(II) technical scheme
In order to achieve the purpose, the invention is realized by the following technical scheme: a disaster recovery cloud storage system construction method based on a block chain technology specifically comprises the following steps:
s1, construction of a cloud storage system framework: constructing a distributed disaster recovery cloud storage system operation framework based on a block chain;
s2, constituting a block chain: a main control node, a storage node and a metadata log server are established in the cloud storage system framework constructed in the step S1, the index data of the data to be stored by the client are stored in blocks by the storage node, after the index data of the storage data are stored in blocks by the storage node, the main control node controls the storage node, and the independent blocks after storage are connected into a block chain;
s3, verifying the stored data: mounting Merkle in the block chain formed in the step S2, and verifying the storage data in each independent block in the block chain through the Merkle;
s4, encryption of index data: carrying out encryption protection on the index data by adopting an asymmetric algorithm;
s5, data retrieval: the user provides a private key of the index data to the cloud storage system, the system calls the storage data from the storage nodes, the private key provided by the user is used for decrypting the storage data, and finally the decrypted file is sent to the user side.
Preferably, in step S1, the direct interaction between the client and the storage node is realized by canceling the centralized platform in the cloud storage system, so that the whole cloud storage system achieves decentralized distributed autonomy.
Preferably, in step S1, when performing disaster recovery cloud storage, the client divides the data to be stored into two parts, namely a data text and index data, backs up the data text in the local area and in at least two storage nodes, and divides the index data into a plurality of index data packets, encrypts the index data packets, and stores the encrypted index data packets in the plurality of storage nodes.
Preferably, in step S2, the main control node is mainly responsible for managing the service control flow of the user and each data storage node, scheduling reading and writing files, recovering and restoring file space, and copying between multiple nodes.
Preferably, in step S2, the storage node is mainly responsible for data flow with the user, listens to the schedule from the master node, provides storage space, and provides data transmission for the client.
Preferably, in step S2, the metadata log server is mainly responsible for backing up the change log of the master node.
Preferably, in step S3, if there is data loss after the stored data is verified by the Merkle method, the storage node sends information to the user side, and the user performs corresponding data completion or secondary data uploading backup.
Preferably, in step S4, each storage node corresponds to a set of public key and private key, and the user is required to provide the private key corresponding to the storage data when the storage data is retrieved.
(III) advantageous effects
The invention provides a block chain technology-based disaster recovery cloud storage system construction method. Compared with the prior art, the method has the following beneficial effects:
(1) the method for constructing the block chain technology-based disaster recovery cloud storage system comprises the steps of constructing a block chain-based distributed disaster recovery cloud storage system operating frame, establishing a main control node, a storage node and a metadata log server in the cloud storage system frame constructed in the step S1, carrying out block storage on index data of data to be stored of a client through the storage node, controlling the storage node by the main control node after the storage node completes block storage on the index data of the storage data, connecting the independent blocks after storage into a block chain, carrying Merkle in the block chain constructed in the step S2, checking the storage data in each independent block in the block chain through the Merkle, carrying out encryption protection on the index data by adopting an asymmetric algorithm, providing a private key of the index data to the cloud storage system by a user, and calling the storage data from the storage node by the system, the private key provided by the user is used for decrypting the stored data, the decrypted file is sent to the user side, the block chain technology is applied to the disaster recovery cloud storage field, many-to-many contact relation can be directly established between a plurality of network storage devices and storage requirements, a unified management platform does not need to be established, and therefore the establishing, running and management cost of the system is greatly reduced, and the safety of the stored data can be effectively guaranteed by adopting asymmetric encryption.
(2) The disaster recovery cloud storage system construction method based on the block chain technology realizes direct interaction between a client and storage nodes by canceling a centralized platform in a cloud storage system, so that the whole cloud storage system achieves decentralized distributed autonomy, the client divides data to be stored into two parts of data texts and index data when performing disaster recovery cloud storage, backups the data texts in local and at least two storage nodes, divides the index data into a plurality of index data packets, encrypts and stores the index data packets in the plurality of storage nodes, a main control node is mainly responsible for management of service control flows of users and each data storage node, file read-write scheduling, file space recovery and recovery, copying among the plurality of nodes, the storage nodes are mainly responsible for data flows between the users, scheduling from the main control node provides storage space and provides data transmission for the clients, the metadata log server is mainly responsible for backing up change logs of the main control node, when a user accesses the cloud storage system, the user firstly sends a request to the main control node, the main control node dynamically appoints a storage node server to perform data interaction with the user according to the load condition of the storage node, the service flow is obtained by accessing the main control node, and the data flow is obtained by accessing the storage node, so that the data access efficiency is greatly improved.
Drawings
Fig. 1 is a flowchart of a method for constructing a disaster recovery cloud storage system based on a block chain technology according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, an embodiment of the present invention provides a technical solution: a disaster recovery cloud storage system construction method based on a block chain technology specifically comprises the following steps:
s1, construction of a cloud storage system framework: constructing a distributed disaster recovery cloud storage system operation framework based on a block chain;
s2, constituting a block chain: a main control node, a storage node and a metadata log server are established in the cloud storage system framework constructed in the step S1, the index data of the data to be stored by the client are stored in blocks by the storage node, after the index data of the storage data are stored in blocks by the storage node, the main control node controls the storage node, and the independent blocks after storage are connected into a block chain;
s3, verifying the stored data: mounting Merkle in the block chain formed in the step S2, and verifying the storage data in each independent block in the block chain through the Merkle;
s4, encryption of index data: carrying out encryption protection on the index data by adopting an asymmetric algorithm;
s5, data retrieval: the user provides a private key of the index data to the cloud storage system, the system calls the storage data from the storage nodes, the private key provided by the user is used for decrypting the storage data, and finally the decrypted file is sent to the user side.
In the invention, in step S1, the direct interaction between the client and the storage node is realized by canceling the centralized platform in the cloud storage system, so that the whole cloud storage system achieves decentralized distributed autonomy.
In the invention, in step S1, when performing disaster recovery cloud storage, the client divides the data to be stored into two parts, namely a data text and index data, backs up the data text in the local and at least two storage nodes, and divides the index data into a plurality of index data packets, encrypts the index data packets, and stores the encrypted index data packets in the plurality of storage nodes.
In the present invention, in step S2, the main control node is mainly responsible for managing the service control flow of the user and each data storage node, file read-write scheduling, file space recovery and recovery, and copying among multiple nodes.
In the present invention, in step S2, the storage node is mainly responsible for data flow with the user, listens to the schedule of the slave main control node, provides storage space, and provides data transmission for the client.
In the present invention, in step S2, the metadata log server is mainly responsible for backing up the change log of the master node.
In the invention, in step S3, if the data is missing after the stored data is verified by the Merkle method, the storage node sends information to the user side, and the user performs corresponding data completion or secondary data uploading backup.
In the present invention, in step S4, each storage node corresponds to a set of public key and private key, and when retrieving the storage data, the user is required to provide the private key corresponding to the storage data.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (8)
1. A disaster recovery cloud storage system construction method based on a block chain technology is characterized in that: the method specifically comprises the following steps:
s1, construction of a cloud storage system framework: constructing a distributed disaster recovery cloud storage system operation framework based on a block chain;
s2, constituting a block chain: a main control node, a storage node and a metadata log server are established in the cloud storage system framework constructed in the step S1, the index data of the data to be stored by the client are stored in blocks by the storage node, after the index data of the storage data are stored in blocks by the storage node, the main control node controls the storage node, and the independent blocks after storage are connected into a block chain;
s3, verifying the stored data: mounting Merkle in the block chain formed in the step S2, and verifying the storage data in each independent block in the block chain through the Merkle;
s4, encryption of index data: carrying out encryption protection on the index data by adopting an asymmetric algorithm;
s5, data retrieval: the user provides a private key of the index data to the cloud storage system, the system calls the storage data from the storage nodes, the private key provided by the user is used for decrypting the storage data, and finally the decrypted file is sent to the user side.
2. The method for constructing a disaster recovery cloud storage system based on a block chain technology according to claim 1, wherein: in the step S1, the direct interaction between the client and the storage node is realized by canceling the centralized platform in the cloud storage system, so that the whole cloud storage system achieves decentralized distributed autonomy.
3. The method for constructing a disaster recovery cloud storage system based on a block chain technology according to claim 1, wherein: in step S1, when performing disaster recovery cloud storage, the client divides the data to be stored into two parts, i.e., a data text and index data, backs up the data text in the local area and in at least two storage nodes, and splits the index data into a plurality of index data packets, encrypts the index data packets, and stores the index data packets in the plurality of storage nodes.
4. The method for constructing a disaster recovery cloud storage system based on a block chain technology according to claim 1, wherein: in step S2, the main control node is mainly responsible for managing the service control flow of the user and each data storage node, file read-write scheduling, file space recovery and recovery, and copying among multiple nodes.
5. The method for constructing a disaster recovery cloud storage system based on a block chain technology according to claim 1, wherein: in step S2, the storage node is mainly responsible for data flow with the user, listens to the schedule of the slave main control node, provides storage space, and provides data transmission for the client.
6. The method for constructing a disaster recovery cloud storage system based on a block chain technology according to claim 1, wherein: in step S2, the metadata log server is mainly responsible for backing up the change log of the master node.
7. The method for constructing a disaster recovery cloud storage system based on a block chain technology according to claim 1, wherein: in step S3, if the data is missing after the stored data is verified by the Merkle method, the storage node sends information to the user side, and the user performs corresponding data completion or secondary data upload backup.
8. The method for constructing a disaster recovery cloud storage system based on a block chain technology according to claim 1, wherein: in step S4, each storage node corresponds to a set of public key and private key, and the user is required to provide the private key corresponding to the storage data when the storage data is called.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010168454.5A CN111400751A (en) | 2020-03-12 | 2020-03-12 | Disaster recovery cloud storage system construction method based on block chain technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010168454.5A CN111400751A (en) | 2020-03-12 | 2020-03-12 | Disaster recovery cloud storage system construction method based on block chain technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111400751A true CN111400751A (en) | 2020-07-10 |
Family
ID=71428763
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010168454.5A Pending CN111400751A (en) | 2020-03-12 | 2020-03-12 | Disaster recovery cloud storage system construction method based on block chain technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111400751A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112347491A (en) * | 2020-09-24 | 2021-02-09 | 上海对外经贸大学 | Method for endogenous data secure interaction of double-middlebox double-chain architecture |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534317A (en) * | 2016-11-17 | 2017-03-22 | 杭州云象网络技术有限公司 | Disaster recovery cloud storage system construction method based on block chain technology |
| EP3598363A1 (en) * | 2018-07-17 | 2020-01-22 | Siemens Aktiengesellschaft | Resource reservation for transactions of a distributed database system |
-
2020
- 2020-03-12 CN CN202010168454.5A patent/CN111400751A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534317A (en) * | 2016-11-17 | 2017-03-22 | 杭州云象网络技术有限公司 | Disaster recovery cloud storage system construction method based on block chain technology |
| EP3598363A1 (en) * | 2018-07-17 | 2020-01-22 | Siemens Aktiengesellschaft | Resource reservation for transactions of a distributed database system |
Non-Patent Citations (1)
| Title |
|---|
| 秦玉春等: "基于分布式文件系统的开源云存储的技术研究", 《南钢科技与管理》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112347491A (en) * | 2020-09-24 | 2021-02-09 | 上海对外经贸大学 | Method for endogenous data secure interaction of double-middlebox double-chain architecture |
| CN112347491B (en) * | 2020-09-24 | 2023-06-27 | 上海对外经贸大学 | Endogenous data security interaction method for double-middle-platform double-chain architecture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107193490B (en) | Distributed data storage system and method based on block chain | |
| US11157366B1 (en) | Securing data in a dispersed storage network | |
| US10713379B2 (en) | Distributed storage system for long term data storage | |
| US11531495B2 (en) | Distributed storage system for long term data storage | |
| Zhang et al. | Ensure data security in cloud storage | |
| US9960979B1 (en) | Data migration service | |
| US8321688B2 (en) | Secure and private backup storage and processing for trusted computing and data services | |
| CN104580395B (en) | A kind of cloudy collaboration Storage Middleware Applying system based on existing cloud storage platform | |
| RU2531569C2 (en) | Secure and private backup storage and processing for trusted computing and data services | |
| US9021264B2 (en) | Method and system for cloud based storage | |
| US10693640B2 (en) | Use of key metadata during write and read operations in a dispersed storage network memory | |
| CN111209262B (en) | Large-scale distributed secure storage system based on block chain | |
| CN111406260B (en) | Object storage system with secure object replication | |
| CN111258780B (en) | System and method for data exchange based on front-end processor | |
| CN109241754B (en) | Cloud file repeated data deleting method based on block chain | |
| WO2007113836A2 (en) | Peer to peer syncronization system and method | |
| US11169973B2 (en) | Atomically tracking transactions for auditability and security | |
| TW561735B (en) | Internet-based shared file service with native PC client access and semantics | |
| Atan et al. | Formulating a security layer of cloud data storage framework based on multi agent system architecture | |
| CN110555783A (en) | block chain-based power marketing data protection method and system | |
| CN111400751A (en) | Disaster recovery cloud storage system construction method based on block chain technology | |
| CN112613049B (en) | Unified cloud storage system based on block chain and method for realizing data security | |
| CN111831743B (en) | Block chain data storage system and method based on cloud storage | |
| Peiris et al. | Vault-a shared distributed and redundant storage solution | |
| WO2014031217A2 (en) | Management of database deployment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200710 |