Nothing Special   »   [go: up one dir, main page]

CN112988910B - Block chain data storage method and device and electronic equipment - Google Patents

Block chain data storage method and device and electronic equipment Download PDF

Info

Publication number
CN112988910B
CN112988910B CN202110495070.9A CN202110495070A CN112988910B CN 112988910 B CN112988910 B CN 112988910B CN 202110495070 A CN202110495070 A CN 202110495070A CN 112988910 B CN112988910 B CN 112988910B
Authority
CN
China
Prior art keywords
node
data
tree
key
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110495070.9A
Other languages
Chinese (zh)
Other versions
CN112988910A (en
Inventor
陆钟豪
卓海振
俞本权
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ant Blockchain Technology Shanghai Co Ltd
Original Assignee
Alipay Hangzhou Information Technology Co Ltd
Ant Blockchain Technology Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alipay Hangzhou Information Technology Co Ltd, Ant Blockchain Technology Shanghai Co Ltd filed Critical Alipay Hangzhou Information Technology Co Ltd
Priority to CN202110495070.9A priority Critical patent/CN112988910B/en
Publication of CN112988910A publication Critical patent/CN112988910A/en
Application granted granted Critical
Publication of CN112988910B publication Critical patent/CN112988910B/en
Priority to PCT/CN2022/090294 priority patent/WO2022233274A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A block chain data storage method and device and electronic equipment are provided, and the method comprises the following steps: acquiring a key-value key value pair of block chain data to be stored; converting the key-value key value pair of the block chain data to be stored into a root node, a middle node and a leaf node on a logical tree structure; the root node and the middle node comprise a plurality of positions for storing characters in keys of the blockchain data, and each position comprises a plurality of slot positions for storing the characters in the keys of the blockchain data; the slot position is used for storing a hash value of a next layer node linked with the node; storing the key-value pairs of the root node, the intermediate nodes and the leaf nodes in a database; in the key-value key value pairs of the leaf node, the intermediate node and the root node, value is the storage content of the node, and key is the hash value of the storage content of the node.

Description

Block chain data storage method and device and electronic equipment
Technical Field
One or more embodiments of the present disclosure relate to the field of blockchain technologies, and in particular, to a method and an apparatus for storing blockchain data, and an electronic device.
Background
The block chain technology, also called as distributed ledger technology, is an emerging technology in which a plurality of node devices participate in accounting together, and a complete distributed database is stored and maintained together.
For node devices of a blockchain, blockchain data which needs to be stored and maintained generally includes blockchain data and account status data corresponding to blockchain accounts in the blockchain; the tile data may further include tile header data, tile transaction data in the tile, and a transaction receipt corresponding to the tile transaction data in the tile, etc.
When storing the various blockchain data shown above, the node device of the blockchain can organize the various blockchain data into a Merkle tree to be stored in a database in the form of key-value key value pairs. When the various blockchain data stored in the node device need to be queried, the data can be efficiently queried by traversing the Merkle tree by taking the keys of the various blockchain data as query indexes.
Disclosure of Invention
This specification proposes a method for storing data in a block chain, including:
acquiring a key-value key value pair of block chain data to be stored;
converting the key-value key value pair of the block chain data to be stored into a root node, a middle node and a leaf node on a logical tree structure; the root node and the middle node comprise a plurality of positions for storing characters in keys of the blockchain data, and each position comprises a plurality of slot positions for storing the characters in the keys of the blockchain data; the slot position is used for storing a hash value of a next layer node linked with the node;
storing the key-value pairs of the root node, the intermediate nodes and the leaf nodes in a database; in the key-value key value pairs of the leaf node, the intermediate node and the root node, value is the storage content of the node, and key is the hash value of the storage content of the node.
This specification also provides an apparatus for storing data in a block chain, including:
the acquisition module is used for acquiring a key-value key value pair of the block chain data to be stored;
the conversion module is used for converting the key-value key value pair of the block chain data to be stored into a root node, a middle node and a leaf node on a logic tree structure; the root node and the middle node comprise a plurality of positions for storing characters in keys of the blockchain data, and each position comprises a plurality of slot positions for storing the characters in the keys of the blockchain data; the slot position is used for storing a hash value of a next layer node linked with the node;
the storage module is used for storing the key-value key value pairs of the root node, the middle node and the leaf node in a database; in the key-value key value pairs of the leaf node, the intermediate node and the root node, value is the storage content of the node, and key is the hash value of the storage content of the node.
In the above technical solution, on one hand, each root node and each intermediate node in the logical tree structure includes a plurality of positions respectively representing different characters; each position further comprises a plurality of slot positions which respectively represent different characters; therefore, by means of the design, each root node and each intermediate node have larger data storage capacity and data carrying capacity, so that when the root nodes and the intermediate nodes in the logical tree structure are written into the database for storage; or when accessing the root node and the intermediate node in the logical tree structure stored in the database, the data storage capacity of the root node and the intermediate node can be more adaptive to the capacity of single IO read-write of the storage medium bearing the database, so that the IO read-write capability of the storage medium bearing the database can be fully utilized, and the data read-write efficiency is improved; moreover, the improvement of the data storage capacity and the data carrying capacity of the nodes on the logical tree structure will also lead to the improvement of the data storage capacity and the data carrying capacity of the whole logical tree structure, so that more block chain data can be stored on the logical tree structure;
in the second aspect, each root node and each intermediate node in the logical tree structure adopt a unified data structure; for the root node and the intermediate node in the logical tree structure, the character length of the character prefix of the key of the block chain data actually stored in the root node and the intermediate node is kept fixed; therefore, through the design, the frequent splitting of the nodes caused by the fact that the actually stored character lengths of the root node and the middle node are not fixed can be avoided, and the number of layers of the root node and the middle node contained in the logic tree structure can be ensured to be in a relatively stable state all the time;
in a third aspect, each root node and intermediate node will have greater data storage capacity and data carrying capacity due to the design; the number of layers of the root node and the intermediate node contained in the tree structure of the logical tree structure is in a relatively stable state; therefore, the storage capacity of the root node and the intermediate node is improved, the layer number of the root node and the intermediate node is relatively stable, and the root node and the intermediate node of the logical tree structure can have fewer layer numbers to some extent; therefore, on the basis that the root node and the middle node have larger data storage capacity and data bearing capacity and the root node and the middle node of the logical tree structure have fewer layers, when the system is in cold start and needs to load the root node and the middle node of the first N layers of the logical tree structure into the memory as data needing to be frequently read from the storage medium bearing the database, the IO read times when the root node and the middle node of the first N layers stored in the storage medium are read into the memory and the overall read time when the root node and the middle node of the first N layers of the logical tree structure are loaded into the memory can be obviously reduced, and further the start delay of the system in cold start is radically shortened.
Drawings
FIG. 1 is a schematic diagram of an organization of account state data for blockchains into an MPT state tree provided by an exemplary embodiment;
FIG. 2 is a diagram of organizing contract data stored in storage space corresponding to a contract account into an MPT storage tree, according to an exemplary embodiment;
FIG. 3 is a flow chart of a method of blockchain data storage provided by an exemplary embodiment;
FIG. 4 is a tree structure diagram of an FDMT tree provided by an exemplary embodiment;
FIG. 5 is a tree structure diagram of another FDMT tree provided by an exemplary embodiment;
FIG. 6 is a block diagram of a Tree node provided in an exemplary embodiment;
FIG. 7 is a block diagram of a bucket according to an exemplary embodiment;
FIG. 8 is a schematic diagram illustrating setting node IDs for nodes in an FDMT tree in accordance with an exemplary embodiment;
FIG. 9 is a schematic diagram of an exemplary embodiment providing for writing account status data to an FDMT tree;
FIG. 10 is a schematic diagram of an electronic device according to an exemplary embodiment;
fig. 11 is a block diagram of a blockchain data storage device provided in an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with one or more embodiments of the present specification. Rather, they are merely examples of apparatus and methods consistent with certain aspects of one or more embodiments of the specification, as detailed in the claims which follow.
It should be noted that: in other embodiments, the steps of the corresponding methods are not necessarily performed in the order shown and described herein. In some other embodiments, the method may include more or fewer steps than those described herein. Moreover, a single step described in this specification may be broken down into multiple steps for description in other embodiments; multiple steps described in this specification may be combined into a single step in other embodiments.
Blockchains are generally divided into three types: public chain (Public Blockchain), Private chain (Private Blockchain) and alliance chain (Consortium Blockchain). Furthermore, there may be a combination of the above types, such as private chain + federation chain, federation chain + public chain, and so on.
Among them, the most decentralized is the public chain. Participants joining the public chain (also referred to as nodes in the blockchain) can read the data records on the chain, participate in transactions, compete for accounting rights for new blocks, and so on. Moreover, each node can freely join or leave the network and perform related operations.
Private chains are the opposite, with the network's write rights controlled by an organization or organization and the data read rights specified by the organization. Briefly, a private chain may be a weakly centralized system with strict restrictions on nodes and a small number of nodes. This type of blockchain is more suitable for use within a particular establishment.
A federation chain is a block chain between a public chain and a private chain, and "partial decentralization" can be achieved. Each node in a federation chain typically has a physical organization or organization corresponding to it; the nodes are authorized to join the network and form a benefit-related alliance, and block chain operation is maintained together.
Based on the basic characteristics of a blockchain, a blockchain is usually composed of several blocks. The time stamps corresponding to the creation time of the block are recorded in the blocks respectively, and all the blocks form a time-ordered data chain according to the time stamps recorded in the blocks strictly.
The data generated outside the chain can be constructed into a standard transaction (transaction) format supported by the blockchain, then the data is issued to the blockchain, the node devices in the blockchain perform consensus on the transaction, and after the consensus is achieved, the node devices serving as accounting nodes in the blockchain package the transaction into blocks, and the persistent evidence is stored in the blockchain.
In the field of blockchain, an important concept is Account (Account); in practical applications, the accounts can be generally divided into two categories, namely external accounts and contract accounts; the external account is an account directly controlled by the user and is also called as a user account; and the contract account is created by the user through an external account, the account containing the contract code (i.e. the smart contract).
For accounts in a blockchain, the account status of the account is usually maintained through a structure. When a transaction in a block is executed, the status of the account associated with the transaction in the block chain is also typically changed.
In one example, the structure of an account typically includes fields such as Balance, Nonce, Code, and Storage. Wherein:
a Balance field for maintaining the current account Balance of the account;
a Nonce field for maintaining a number of transactions for the account; the counter is used for guaranteeing that each transaction can be processed only once, and replay attack is effectively avoided;
a Code field for maintaining a contract Code for the account; in practical applications, only the hash value of the contract Code is typically maintained in the Code field; thus, the Code field is also commonly referred to as the Codhash field.
A Storage field for maintaining the Storage content of the account; for a contract account, an independent persistent storage space is generally allocated to store contract data stored in the storage space corresponding to the contract account; this separate storage space is often referred to as the account storage of the contract account.
The storage content of the contract account is usually stored in the independent storage space in a data structure constructed as an mpt (media Patricia trie) tree in the form of key-value key value pairs. An MPT tree is a logical tree structure in the field of blockchains for storing and maintaining blockchain data, and typically includes root nodes, intermediate nodes, and leaf nodes in the tree structure.
In which, the Storage content based on the contract account is constructed into an MPT tree, which is also commonly referred to as a Storage tree. Whereas the Storage field typically maintains only the hash value of the root node of the Storage tree; therefore, the Storage field is also commonly referred to as the Storage Root hash field. Wherein, for the external account, the field values of the Code field and the Storage field shown above are both null values.
For most blockchain models, a Merkle tree is usually used; or a logical tree structure based on Merkle tree varieties of the Merkle tree data structure to store and maintain data. For example, the MPT tree is a Merkle tree variant that merges the tree structures of Trie dictionary trees for storing and maintaining blockchain data.
The following description will be given taking the example of using an MPT tree to store block chain data;
in one example, blockchain data that needs to be stored and maintained in the blockchain, typically includes account status (state) data, transaction data, and receipt data; therefore, in practical applications, the above account status data, transaction data and receipt data may be organized into three MPT trees, such as an MPT status tree, an MPT transaction tree and an MPT receipt tree, in the form of key-value key value pairs, and stored and maintained respectively.
In addition to the three MPT trees, the contract data stored in the Storage space corresponding to the contract account is usually constructed as an MPT Storage tree (hereinafter, referred to as a Storage tree). The hash value of the root node of the Storage tree is added to the Storage field in the struct of the contract account corresponding to the Storage tree.
The MPT state tree is organized by account state data of all accounts (including external accounts and contract accounts) in the block chain in the form of key-value key value pairs; the MPT transaction tree is organized by transaction (transaction) data in a block chain in a key-value key value pair form; the MPT receipt tree is an MPT tree which is organized in a key-value key value pair mode, wherein a transaction (receipt) receipt corresponding to each transaction is generated after the transactions in the block are executed.
The hash values of the root nodes of the MPT state tree, the MPT transaction tree, and the MPT receipt tree shown above are eventually added to the block header of the corresponding block.
The MPT transaction tree and the MPT receipt tree correspond to the blocks, namely each block has the MPT transaction tree and the MPT receipt tree. The MPT state tree is a global MPT tree, which does not correspond to a specific tile, but covers account state data of all accounts in the tile chain. Each time a block chain generates a latest block, the account status of the accounts (which may be external accounts or contract accounts) related to the executed transaction in the block chain is usually changed after the transaction in the latest block is executed.
For example, when a "transfer transaction" is completed in a block, the balances of the transferring party account and the transferring party account associated with the "transfer transaction" (i.e., the field values of the Balance fields of these accounts) are usually changed. After the transaction in the latest block generated by the blockchain is completed, the node device needs to construct an MPT state tree according to the current account state data of all accounts in the blockchain because the account state in the current blockchain changes, so as to maintain the latest state of all accounts in the blockchain.
That is, each time a latest block is generated in the block chain and the transaction in the latest block is completed, which results in a change of the account status of some accounts in the block chain, the node device needs to reconstruct an MPT status tree based on the latest account status data of all accounts in the block chain. In other words, each block in the block chain has a corresponding MPT state tree; the MPT status tree maintains the latest account status of all accounts in the blockchain after the transaction in the block is completed.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an example of organizing account status data of each blockchain account in a blockchain into an MPT status tree in the form of key-value key value pairs according to this specification.
The MPT tree is a relatively traditional modified Merkle tree variety, and combines the advantages of two tree structures, namely a Merkle tree and a Trie dictionary tree (also called as a prefix tree).
Three types of nodes are typically included in the MPT tree, namely leaf nodes (leaf nodes), extension nodes (extension nodes), and branch nodes (branch nodes). Wherein, the root node of the MPT tree may be an extended node in general; the intermediate nodes of the MPT tree may typically be branch nodes or other extended nodes.
The extension node and the branch node may be collectively referred to as a character node, and are used for storing a character prefix portion of a character string corresponding to a key (i.e., an account address) of the account status data; for the MPT tree, the above-mentioned character prefix part usually refers to a shared character prefix; the shared character prefix refers to a prefix formed by one or more identical characters possessed by keys (namely, block chain account addresses) of all account state data. The leaf node is used for storing the Value (i.e. specific account status data) and the suffix part of the character string corresponding to the key of the block chain data.
And the extension node is used for storing one or more characters (namely, shared nibbles shown in fig. 1) in the shared character prefix of the account address and a hash value (namely, Next node shown in fig. 1) of a node at the Next layer linked with the extension node. The branch node comprises 17 slot positions, the first 16 slot positions correspond to 16 possible hexadecimal characters in the key, one character corresponds to one nibble, each slot position in the first 16 slot positions respectively represents one character in a shared character prefix of an account address, and the slot positions are used for filling a hash value of a node at the next layer linked with the branch node. The last slot is a value slot, typically null.
A leaf node for storing a character suffix (i.e., key-end shown in fig. 1) of the account address, and a value of the account status data (i.e., the structure of the account described above); the character suffix of the account address and the shared character prefix of the account address jointly form a complete account address; the character suffix refers to a suffix composed of the last one or more characters except the shared character prefix of the account address.
Assume that account state data that needs to be organized into an MPT state tree is shown in table 1 below:
Figure 63992DEST_PATH_IMAGE001
it should be noted that, in table 1, the block chain accounts corresponding to the account addresses in the first three rows are external accounts, and the Codehash and Storage root fields are null values. The block chain account corresponding to the account address in the 4 th row is a contract account, and the Codehash field maintains the hash value of the contract code corresponding to the contract account; the Storage root field maintains a hash value of the root node of the Storage tree of which the Storage contents of the contract account constitute.
The MPT state tree is finally organized according to the account state data in the table 1, as shown in FIG. 1; the MPT state tree is composed of 4 leaf nodes, 2 branch nodes, and 2 extension nodes (one of which serves as a root node).
In fig. 1, the prefix field is a prefix field that the extension node and the leaf node have in common. Different field values of the prefix field may be used to indicate different node types.
For example, the value of the prefix field is 0, which indicates that an extension node includes an even number of nibbles; as previously mentioned, a nibble represents a nibble, consisting of a 4-bit binary, and one nibble may correspond to one character that makes up an account address. The value of the prefix field is 1, and the prefix field represents an expansion node containing odd number of nibbles(s); the value of the prefix field is 2, which represents a leaf node containing an even number of nibbles; the value of the prefix field is 3, which indicates that the leaf node contains an odd number of nibbles(s).
And the branch node does not have the prefix field because the branch node is a character node of a parallel single neighbor.
A Shared neighbor field in the extension node, corresponding to a key value of a key-value pair contained in the extension node, represents a common character prefix between account addresses; for example, all account addresses in the table above have a common character prefix a 7. The Next Node field is filled with the hash value (hash pointer) of the Next Node.
The field of the 16-system characters 0-f in the branch node corresponds to the key value of the key value pair contained in the branch node; if the branch node is an intermediate node of the account address on the search path on the MPT tree, the Value field of the branch node may be null. And the 0-f field is used for filling the hash value of the next layer of nodes.
The Key-end in a leaf node, corresponding to the Key value of the Key-value pair contained in that leaf node, represents the last few characters of the account address (the character suffix of the account address). The key values of the nodes on the search path from the root node to the leaf nodes form a complete account address. Filling account state data corresponding to the account address in a Value field of the leaf node; for example, a structure composed of fields such as Balance, Nonce, Code, and storage may be encoded and filled in the Value field of the leaf node.
Further, the node on the MPT state tree shown in fig. 1 is finally stored in the database in the form of Key-Value Key Value pair;
when a node on the MPT state tree is stored in the database, a key in a key value pair of the node on the MPT state tree can be a hash value of data content contained in the node; value in the key Value pair of the node on the MPT state tree is the data content contained in the node.
When a node in the MPT state tree is stored in the database, a hash Value of data content contained in the node can be calculated (i.e., the whole node is subjected to hash calculation), the calculated hash Value is used as a Key, the data content contained in the node is used as a Value, and a Key-Value Key Value pair is generated; and then storing the generated Key-Value Key Value pair into a database.
The node on the MPT state tree is stored in a Key-value Key value pair mode; the Key may be a hash Value of data content contained in the node, and the Value may be data content contained in the node; therefore, when a node on the MPT state tree needs to be queried, content addressing can be performed as a key based on the hash value of the data content contained in the node.
Referring to fig. 2, fig. 2 is a schematic diagram illustrating organization of contract data stored in a storage space corresponding to a contract account into an MPT storage tree according to this specification.
With continued reference to table 1, the account with the account address "a 77d 397" shown in table 1 is a contract account, so that the contract data stored in the storage space corresponding to the contract account is organized into a storage tree; the hash value S1 of the root node of the storage tree is added to the storage root field in the leaf node corresponding to the contract account in the MPT state tree shown in fig. 1.
Assume that the contract data stored in the storage space of the contract account is as shown in table 2 below:
Figure 528602DEST_PATH_IMAGE002
it should be noted that, the contract data stored in the storage space of the contract account may be generally in the form of a state variable; when storing, the state variable names can be organized into a storage tree as shown in fig. 2 in the form of key-value key value pairs for storage.
For example, in one example, a hash value of the account address of the contract account and a storage location of the state variable in the account storage of the contract account may be used as a key, and a value of a variable corresponding to the state variable may be used as a value.
The basic structure of the storage tree shown in fig. 2 is similar to the MPT state tree shown in fig. 1, and is not described in detail in this specification. As can be seen from the above description of fig. 1 and fig. 2, based on the tree structure design of the MPT tree, the branch node may store one of the characters in the shared character prefixes of all account addresses; and the extension node may store one or more characters in the shared character prefix of all account addresses.
In practical application, the character length of the shared character prefix of the key of all data stored on the MPT tree is not fixed generally; moreover, when new data is written into the MPT tree, the character length of the shared character prefix may change accordingly; therefore, the expansion nodes on the MPT tree can be split to generate new branch nodes; that is, the splitting condition of the nodes in the MPT tree is that the character length of the shared character prefix is changed;
for example, taking the MPT state tree shown in fig. 1 as an example, assuming that account state data of an account address with first two digits of "a 8" of an account address is added to the MPT state tree, the Shared character prefix stored in the "Shared ribbon" field of the extension node shown in fig. 1 as the root node is changed from "a 7" to "a"; according to the splitting condition of the nodes of the MPT state tree, the extension node serving as the root node is split into a stored extension node with a shared character prefix of 'a'; and one branch node with the character "8" occupied.
Once the expansion nodes on the MPT tree are split, the number of node layers of the MPT tree may also change, which results in that the number of node layers of the MPT tree is not stable enough. The character length of the shared character prefix of the key of all the data stored in the MPT tree can be changed frequently along with the writing of new data in the MPT tree; therefore, according to the node splitting manner shown above, frequent splitting of nodes is caused, and data storage efficiency when new data is written into the MPT tree is further affected.
In view of the above, the present specification proposes a new logical tree structure design scheme.
When the logic tree structure is realized, the logic tree structure still can comprise a root node, a middle node and a leaf node; the root node and the intermediate node are used for storing characters in keys of the block chain data; the leaf node is used to store the value of the blockchain data.
Different from the MPT tree, the root node and the intermediate node may include a plurality of positions for storing characters in keys of blockchain data, and each position may further include a plurality of slots for storing characters in keys of blockchain data; and the slot can be used for storing the hash value of the next layer node linked with the node.
When the node device in the block chain stores the block chain data, the key-value key value pair of the block chain data to be stored can be obtained, and then the block chain data to be stored is converted into a root node, a middle node and a leaf node on the logical tree structure; then, further storing the key-value key value pairs of the root node, the intermediate node and the leaf node in a database; in the key-value key value pairs of the leaf node, the intermediate node and the root node, a value may be the storage content of the node, and a key may be the hash value of the storage content of the node.
In the above technical solution, on one hand, each root node and each intermediate node in the logical tree structure includes a plurality of positions respectively representing different characters; each position further comprises a plurality of slot positions which respectively represent different characters; therefore, by means of the design, each root node and each intermediate node have larger data storage capacity and data carrying capacity, so that when the root nodes and the intermediate nodes in the logical tree structure are written into the database for storage; or when accessing the root node and the intermediate node in the logical tree structure stored in the database, the data storage capacity of the root node and the intermediate node can be more adaptive to the capacity of single IO read-write of the storage medium bearing the database, so that the IO read-write capability of the storage medium bearing the database can be fully utilized, and the data read-write efficiency is improved; moreover, the improvement of the data storage capacity and the data carrying capacity of the nodes on the logical tree structure will also lead to the improvement of the data storage capacity and the data carrying capacity of the whole logical tree structure, so that more block chain data can be stored on the logical tree structure;
in the second aspect, each root node and each intermediate node in the logical tree structure adopt a unified data structure; for the root node and the intermediate node in the logical tree structure, the character length of the character prefix of the key of the block chain data actually stored in the root node and the intermediate node is kept fixed; therefore, through the design, the frequent splitting of the nodes caused by the fact that the actually stored character lengths of the root node and the middle node are not fixed can be avoided, and the number of layers of the root node and the middle node contained in the logic tree structure can be ensured to be in a relatively stable state all the time;
in a third aspect, each root node and intermediate node will have greater data storage capacity and data carrying capacity due to the design; the number of layers of the root node and the intermediate node contained in the tree structure of the logical tree structure is in a relatively stable state; therefore, the storage capacity of the root node and the intermediate node is improved, the layer number of the root node and the intermediate node is relatively stable, and the root node and the intermediate node of the logical tree structure can have fewer layer numbers to some extent; therefore, on the basis that the root node and the middle node have larger data storage capacity and data bearing capacity and the root node and the middle node of the logical tree structure have fewer layers, when the system is in cold start and needs to load the root node and the middle node of the first N layers of the logical tree structure into the memory as data needing to be frequently read from the storage medium bearing the database, the IO read times when the root node and the middle node of the first N layers stored in the storage medium are read into the memory and the overall read time when the root node and the middle node of the first N layers of the logical tree structure are loaded into the memory can be obviously reduced, and further the start delay of the system in cold start is radically shortened.
Referring to fig. 3, fig. 3 is a flowchart illustrating a method for storing blockchain data according to an exemplary embodiment. The method is applied to block chain node equipment; the method comprises the following steps:
step 302, acquiring a key-value key value pair of block chain data to be stored;
step 304, converting the key-value key value pair of the block chain data to be stored into a root node, a middle node and a leaf node on a logic tree structure; the root node and the middle node comprise a plurality of positions for storing characters in keys of the blockchain data, and each position comprises a plurality of slot positions for storing the characters in the keys of the blockchain data; the slot position is used for storing a hash value of a next layer node linked with the node;
step 306, storing the key-value key value pairs of the root node, the middle node and the leaf node in a database; in the key-value key value pairs of the leaf node, the intermediate node and the root node, value is the storage content of the node, and key is the hash value of the storage content of the node.
In this specification, in order to avoid frequent splitting of nodes, a logical tree structure with fixed number of layers of character nodes in a key for storing block chain data of the first N layers is proposed.
The logical tree structure is a structure in which physical storage structures completely corresponding to the tree structure do not exist in the underlying physical storage of the database, but only physical data of each node on the tree structure and link relation data between the nodes are stored in the database, so that the tree structure can be logically restored based on the physical data and the link relation data of each node stored in the database.
The logical tree structure may specifically include a root node, a middle node, and a leaf node; the nodes on the logic tree structure can be linked with the nodes on the upper layer through the hash value of the nodes. The root node and the intermediate node are specifically used for storing at least one character in a key-value key value pair of the block chain data; the leaf node is specifically used for storing the value of the blockchain data (i.e., the specific content of the blockchain data). The number of layers of the intermediate node may be one or more, and is not particularly limited in this specification.
For example, in one example, the key of the above tile chain data may still include a character prefix portion (Shared neighbor) and a character suffix portion (key-end); in this case, the root node and the intermediate node may be used to store the characters in the character prefixes; the leaf node may be used to store values of the character suffix and the blockchain data.
On one hand, because of the root node and the middle node in the logical tree structure, the characters in the keys of the block chain data can be stored; therefore, the tree structure of the logic has the characteristics of a Trie dictionary tree; on the other hand, the nodes on the logical tree structure can be linked with the nodes on the upper layer through the hash value of the nodes; therefore, the logical tree structure described above also has the characteristics of a Merkle tree. In summary, the logical tree structure described in this specification is actually a Merkle tree variation of the tree structure similar to the MPT tree, which merges Trie dictionary trees.
Please refer to fig. 4, fig. 4 is a tree structure diagram of an fdmt (fixed Depth Merkle tree) tree shown in the present specification. The above-mentioned FDMT tree is a Merkle tree variety of a tree structure in which a Trie dictionary tree is fused.
As shown in fig. 4, in the Tree structure of the FDMT Tree shown in this specification, the Tree node of the first N layers (3 layers are shown in fig. 4, which is only schematic) and the Leaf node (i.e., Leaf node) of the last layer are included. Among the Tree nodes of the first N layers, the first layer is the Tree node serving as the root node, and the other layers are the Tree nodes serving as the intermediate nodes.
Different from the MPT Tree described above, the Tree nodes (i.e., the root node and the middle node) in the N-layer before the FDMT Tree adopt a uniform data structure, so that the node splitting caused by the change in the length of the stored character due to the newly written data can be avoided.
As shown in fig. 4, the Tree nodes in the first N layers of the FDMT Tree may each include a plurality of blocks respectively representing different characters; the block is the "location" of the character in the key used to store the block chain data. Each block may further comprise a plurality of slots respectively representing different characters; the slot is also used for storing characters in keys of the blockchain data.
For example, fig. 4 shows that each Tree node includes N blocks; each block further comprises N slots. Among the nodes in each layer of the FDMT tree, the nodes may still be linked by filling the nodes in the previous layer with the hash value (hash pointer) of the nodes in the next layer. That is, the nodes in the above-described FDMT tree are linked to the nodes of the upper layer by their own hash values. Correspondingly, the slot may be specifically used to fill a hash value of a next node linked by the current Tree node. The node at the next layer of the Tree node may be the Tree node or a Leaf node.
In practical application, after the hash value filled in any slot in any block of the Tree node in the FDMT Tree is updated, the hash value of the Tree node is usually recalculated, and the node in the previous layer is linked again according to the calculated hash value.
When the hash value of the Tree node is calculated, all data filled in the Tree node is generally required to be used as calculation parameters for hash calculation; therefore, when the Tree node adopts the data structure shown in fig. 4, if the hash value of the Tree node needs to be calculated, the hash of each block included in the Tree node needs to be calculated first, then the hashes of the blocks need to be concatenated, and then secondary hash calculation is performed on the concatenated hash.
By the method, when the hash value filled in any slot in any block in the Tree node on the FDMT is updated, and the hash value of the Tree node is recalculated, even if data of other blocks in the Tree node is not updated, the other blocks still need to be used as calculation parameters to participate in hash calculation, and obviously, the problem of large calculation amount of hash calculation exists.
In view of this, in the present specification, in order to reduce the amount of computation in computing the hash of the Tree node, the Tree node may specifically adopt a data structure of a main block (i.e., a main position) and a plurality of sub-blocks (i.e., sub-positions).
Referring to fig. 5, fig. 5 is a tree structure diagram of another FDMT tree shown in the present specification.
As shown in fig. 5, in the Tree structure of the FDMT Tree shown in this specification, the Tree nodes of the first N layers and the leaf nodes of the last layer are still included.
Unlike the structure of the FDMT Tree shown in fig. 4, the Tree nodes of the first N layers on the FDMT Tree shown in fig. 5 may each include a main block (i.e., a root block shown in fig. 5) and a plurality of sub-blocks respectively representing different characters; each block can further comprise a plurality of slot positions; for example, fig. 5 shows that each Tree node includes one main block and N sub-blocks; and each sub-block further comprises N slots.
The functions of the slot positions contained in the main block and the sub-block can be different; as shown in fig. 5, for the main block, a plurality of slots respectively corresponding to the sub-blocks may be included, and each slot may be specifically used to fill a hash of data content stored in the corresponding sub-block;
for example, when calculating the hash of any sub-block, the hash values filled in the slots in the sub-block may be specifically spliced together, and then secondary hash calculation is performed on the spliced hash to obtain the hash of the sub-block.
For the subblock, a plurality of slots respectively representing different characters may be included, and each slot may be specifically used to fill a hash value of a node on a next layer of the Tree node link.
In this specification, according to the structure of the Tree node shown in fig. 5, the hash value of the master block in the Tree node may be used to represent the hash value of the Tree node; therefore, under the condition, after the hash value filled in the slot in any one sub-block in the Tree node on the FDMT Tree is updated, when the hash value of the Tree node is recalculated, the hash value filled in each slot in the sub-block with the updated data is only needed to be spliced, the spliced hash value is used as a calculation parameter to perform hash calculation again, the calculated hash value is filled in the slot corresponding to the sub-block in the main block in the Tree node, the hash filled in each slot in the main block is spliced, and the spliced hash value is used as a calculation parameter to perform hash calculation again to obtain the hash of the Tree node.
In the whole process, the hash values filled in the slots in other subblocks without data updating are not needed to be spliced and then are used as calculation parameters to participate in hash calculation, so that the hash calculation amount and the calculation time length when the hash value of the Tree node is recalculated can be reduced, and the calculation efficiency of the hash calculation is improved.
It should be noted that the link relationships between the nodes in the above-mentioned FDMT tree layers shown in fig. 4 and fig. 5 are only schematic, and do not refer to a specific limitation on the link relationships between the nodes in the above-mentioned FDMT tree layers.
With continued reference to fig. 4 and 5, each Tree node on the FDMT Tree shown in fig. 4 and 5 may be used to store at least a portion of the characters in the key of the blockchain data.
For each Tree node on the FDMT Tree shown in fig. 4, the actually stored characters may be specifically a character represented by a block in the Tree node (that is, a non-empty block with at least one slot filled with a hash value), and a character string generated by splicing the characters represented by the slots in the block filled with the hash value (that is, the non-empty slots).
For each Tree node on the FDMT Tree shown in fig. 5, the actually stored characters may be specifically a character represented by a sub-block in the Tree node, and a character string generated by splicing the characters represented by the slots filled with the hash value in the block.
It should be noted that, in practical application, each block in the Tree node may represent only one character; that is, based on the storage format of the Tree node shown in fig. 4 and 5, each of the partial characters in the character prefix of the key of the block chain data actually stored by the Tree node is a character string having a length of 2-bit characters.
For example, please refer to fig. 6, fig. 6 is a structural diagram of a Tree node shown in the present specification;
as shown in fig. 6, the Tree node contains 16 sub-blocks representing different 16-ary characters; each sub-block further comprises 16 slots each representing a different 16-ary character (only the 16 slots contained in block6 are shown in fig. 6); assuming that a sub-block 6 (representing 16-system character 6) in the Tree node is a non-empty block, and a slot4 (representing 16-system character 4), a slot6 (representing 16-system character 6) and a slot9 (representing 16-system character 9) in the sub-block are non-empty slots which fill hash values of nodes at the next layer of the Tree node link; the partial characters in the character prefix of the key of the above block chain data stored by the Tree node are 16-ary character strings "64", "66" and "69", respectively.
The number of sub-blocks included in the Tree node and the number of slots included in each sub-block are not particularly limited in this specification; in practical applications, the number of subblocks included in the Tree node may be determined based on the number of types of character elements included in a character string corresponding to the key of the block chain data; and the number of slots contained in the sub-block;
for example, assume that the key corresponding to the blockchain data is a 16-ary character string, and at this time, the number of types of character elements included in the character string corresponding to the key of the blockchain data is 16; the number of sub-blocks included in the Tree node and the number of slots included in each sub-block may be 16.
In practical applications, the number of sub-blocks included in the Tree node and the number of slots included in the sub-blocks may be the same;
for example, in an example, taking the character string corresponding to the key of the block chain data as a 16-ary character string, in this case, the Tree nodes of the first N layers may each include 16 sub-blocks respectively representing different 16-ary characters; and each sub-block may further comprise 16 slots each representing a different 16-ary character.
In this way, the single Tree node in each of the first N layers of the FDMT Tree may have 16 × 16=256 slots, and it is obvious that the Tree node in the FDMT Tree shown in fig. 4 has a larger storage capacity than the node for storing the character prefix in the MPT Tree shown in fig. 1.
Currently, in practical applications, the number of sub-blocks included in the Tree node and the number of slots included in the sub-blocks may be different;
for example, in practical applications, the string corresponding to the key of the block chain data may be a string composed of two different binary characters; for example, the character string corresponding to the key of the block chain data may specifically be a character string formed by mixing 16-ary characters and 10-ary characters, in this case, the Tree nodes of the first N layers may each include 16 sub-blocks respectively representing different 16-ary characters; each sub-block may further comprise 10 slots respectively representing different 10-system characters; or, the Tree nodes of the first N layers may each include 10 sub-blocks respectively representing different 10-ary characters; and each sub-block may further comprise 16 slots each representing a different 16-ary character.
In an embodiment shown, the number of layers of the Tree node included in the FDMT Tree may be a fixed value; in practical application, the value of N may be an integer greater than or equal to 1; that is, the FDMT Tree may be a Merkle Tree which contains at least one layer of Tree nodes and the number of layers of the Tree nodes is relatively fixed.
For example, in an example, taking the key of the above blockchain data as the blockchain account address as an example, assuming that the blockchain account addresses supported by the blockchain system are designed such that the first 6 address characters can be the same, in this case, the address character of the first 6 bits of the blockchain account address can be used as the character prefix of the blockchain account address; moreover, the length of the character in the character prefix of the block chain account address stored by the Tree node is 2-bit; thus, the above-described FDMT Tree can be designed to have a Tree structure including three levels of Tree nodes.
Based on the Tree structure design of the FDMT Tree shown in fig. 4 and 5, on one hand, each Tree node in the FDMT Tree includes a plurality of blocks respectively representing different characters; each block further comprises a plurality of slot positions which respectively represent different characters; therefore, by the design, each Tree node has larger data storage capacity and data carrying capacity, so that when the Tree nodes in the FDMT Tree are written into a database for storage; or, when the Tree node in the FDMT Tree stored in the database is accessed, the data storage capacity of the Tree node can be more adaptive to the capacity of single IO read-write of the storage medium bearing the database, so that the IO read-write capability of the storage medium bearing the database can be fully utilized, and the data read-write efficiency is improved; moreover, the improvement of the data storage capacity and the data carrying capacity of a single Tree node in the FDMT Tree will also lead to the improvement of the data storage capacity and the data carrying capacity of the whole FDMT Tree, so that more block chain data can be stored in the FDMT Tree;
for example, taking a storage medium carrying the database as a disk with a single physical sector of 4KB size as an example, assuming that the capacity of one IO read and write of the disk is 4KB (one sector), and assuming that 16 fields included in a Branch Node all fill a hash value of 32 bytes for 1 Branch Node on the MPT tree described in fig. 1, the data storage capacity of the Branch Node is about 32 bytes 16=512 bytes; obviously, the maximum capacity of one IO reading of a Branch node can only be about 512 bytes, which is much smaller than the maximum reading capacity of 4Kb of the disk for one IO reading, which obviously cannot fully utilize the IO reading capacity of the disk, and there is serious performance waste.
However, if the Tree structure design of the FDMT Tree shown in fig. 4 and 5 is adopted, it is assumed that the Tree nodes of the first N layers may each include 16 blocks respectively representing different 16-ary characters; each block may further include 16 slots each representing a different 16-ary character, and a single Tree node in each of the first N layers of the FDMT may have 16 × 16=256 slots; assuming that each slot is filled with a hash value of 32 bytes, the maximum storage capacity of a Tree node is 256 × 32 bytes =8192 bytes =8kb, which is exactly the capacity of two sectors, when all slots are fully loaded. Obviously, the data storage capacity of each Tree node in the Tree structure of the FDMT shown in fig. 4 and 5 is more adaptive to the capacity of single IO read/write of the disk, so that the IO read/write capability of the disk can be fully utilized, and the data read/write efficiency is improved.
Moreover, the improvement of the data storage capacity and the data carrying capacity of a single Tree node on the FDMT will also lead to the improvement of the overall data storage capacity and the data carrying capacity of the FDMT, so that more block chain data can be stored on the FDMT;
for example, assuming that the Tree structure of the FDMT shown in fig. 4 and 5 includes 3 layers of Tree nodes, the Tree nodes of each layer may each include 16 sub-blocks respectively representing different 16-ary characters; each block may further comprise 16 slots each representing a different 16-ary character; then, a single Tree node in each layer may have 16 by 16=256 slots; then the three layers of Tree nodes can bear 256 × 256=16.77M character combinations, and 16.77M bucket data blocks can be linked in total; assuming that a user defines that each packet data block can carry 16 data records, the whole FDMT tree can carry 16.77M by 16 block chain data at most; it is obvious that the above-described FDMT shown in fig. 4 and 5 can store more blockchain data and have a larger data carrying capacity than the MPT tree shown in fig. 1.
In the second aspect, each Tree node in the FDMT adopts a uniform data structure; for the Tree nodes of each layer in the above FDMT, the character length of the key character prefix of the block chain data actually stored in the Tree nodes will also be kept fixed; therefore, through the design, the frequent splitting of the nodes caused by the fact that the actually stored character length of each layer of the Tree node is not fixed can be avoided, and the number of the Tree nodes contained in the Tree structure of the FDMT can be ensured to be always in a relatively stable state.
In a third aspect, each Tree node will have greater data storage capacity and data carrying capacity due to the design; the number of layers of the Tree node included in the Tree structure of the FDMT is relatively stable; therefore, the storage capacity of the Tree node is improved, the number of the Tree node layers is relatively stable, and the fact that the Tree node of the FDMT has fewer layer numbers can be ensured to some extent; therefore, on the basis that the Tree nodes have larger data storage capacity and data carrying capacity and the Tree nodes of the FDMT have fewer layers, when the system is in cold start and needs to load the Tree nodes of the front N layer of the FDMT into a memory as data needing to be frequently read from a storage medium bearing the database, the IO reading times of reading the Tree nodes of the front N layer stored in the storage medium into the memory and the overall reading time of loading the Tree nodes of the front N layer of the FDMT into the memory can be obviously reduced, and further the starting time delay of the system in cold start is radically shortened.
For example, the FDMT shown in fig. 4 and 5 is fixed for 3-layer Tree nodes, and each layer of Tree node includes 16 blocks representing different 16-ary characters; each block further comprises 16 slots respectively representing different 16-system characters as an example, and under the condition that all the slots are fully loaded, the maximum storage capacity of one Tree node is 256 × 32 bytes =8192 bytes =8 kb; for the MPT tree shown in fig. 1, the number of layers of the MPT tree is not fixed because it needs to perform frequent node splitting; moreover, the storage capacity of a single Branch Node is 512 bytes, which is much smaller than the Tree nodes on the FDMT Tree shown in fig. 4 and 5; it is necessary to make the MPT tree have a larger number of layers (for example, the MPT tree can reach 64 layers at maximum and is much larger than 3 layers). When the system is in cold start and reads the front N layers of the FDMT tree into the memory, the data is read layer by layer generally; therefore, based on the MPT tree shown in fig. 1, it is apparent that more reading times are required.
Moreover, the storage capacity of a single Branch Node on the MPT tree is 512 bytes, which is only one eighth of 4KB of a single physical sector carrying the database, and the reading efficiency is very low; therefore, even if the MPT tree of fig. 1 and the FDMT tree shown in fig. 4 and 5 store the same data, the number of IO reads for the MPT tree may be at least 8 times the number of IO reads for the FDMT tree shown in fig. 4 and 5 when the system is cold-started.
Obviously, the number of IO reads for the above FDMT tree shown in fig. 4 and 5 will be much smaller than the number of IO reads for the MPT tree shown in fig. 1 when the system is in cold start; therefore, the tree structure design of the above-described FDMT tree shown in fig. 4 and 5 will be more friendly to system cold start.
In an embodiment shown, the character string corresponding to the key of the above block chain data may still include a character prefix and a character suffix; in this case, the Tree node may be configured to store a character in a character prefix of the key of the blockchain data; the leaf node may be configured to store a character suffix of the key of the blockchain data and a Value of the blockchain data.
It should be noted that, because the data actually stored by the leaf node generally has a larger data capacity than the Tree node; for example, the value of the block chain data actually stored by the leaf node is usually the original content of the block chain data, and the original content of the block chain data occupies a larger storage space compared to the character prefix of the block chain data; therefore, in this specification, in order to ensure that the leaf node can have a larger data capacity, the leaf node may store data in the form of a large data block.
The specific form and storage structure of the data block are not particularly limited in this specification;
in an embodiment shown, the leaf node may be in the form of a bucket; the bucket may be a container or a storage space for storing data.
Referring to fig. 7, fig. 7 is a structural diagram of a bucket shown in this specification;
as shown in fig. 7, in the above bucket (i.e. the bucket node shown in fig. 7), several data records may be included; it should be noted that the plurality of data records contained in the bucket may not be a whole in logic, but may be a plurality of different data records separated in logic. Each data record corresponds to a block chain data respectively and is used for storing the value of the block chain data; that is, a data record refers to a stored record whose stored data content includes the value of the blockchain data.
It should be noted that the plurality of data records included in the bucket data bucket are not logically an entirety, which means that each data record may correspond to an independent query key value (key), so that each data record in the bucket data bucket may be accurately queried based on the query key value of each data record, and all data records stored in the bucket data bucket are not required to be read as an entirety.
The specific form and the specific content of the query key value corresponding to each data record are not particularly limited in this specification, and may be any form of character string that can be used as a query index for each data record.
In an illustrated embodiment, the query key value corresponding to each data record may specifically be a hash value of data content included in each data record; the data records contained in the bucket data bucket may specifically include a key-value key value pair composed of a hash value of the blockchain data and data content corresponding to the value of the blockchain data.
Of course, in practical applications, the query key value corresponding to each data record may also be a character string that can be used as a query index for each data record, except for a hash value, and is not particularly limited in this description; for example, in an example, the query key value corresponding to each data record may specifically be a unique identifier (such as a number) set by the node device for each data record.
In one embodiment, if the Tree node is used to store a character in the character prefix of the key of the blockchain data; the leaf node is configured to store the suffix of the key of the blockchain data and the Value of the blockchain data;
accordingly, the data record included in the bucket data bucket may be a hash value obtained by hash calculation of the whole data content corresponding to the value of the blockchain data and the character suffix of the blockchain data and a key-value key value pair formed by the data content corresponding to the value of the blockchain data and the character suffix of the blockchain data.
In practical applications, the data records may be in other types of data forms besides key-value key value pairs, and are not listed in this specification.
With the above embodiment, because the several data records contained in the leaf nodes in the FDMT tree are no longer logically an integer, but are logically separated several key-value pairs; therefore, the data contained in the leaf node in the FDMT tree is no longer accessed as a whole as an access unit in the database, and each key-value key value pair contained in the leaf node is used as an independent access unit in the database, so that the data access to the database is more flexible;
for example, when the value of the blockchain data is the latest account status data corresponding to the blockchain account in the blockchain, and the key of the blockchain data is the blockchain account address, in this case, the key of the key-value pair corresponding to the data record contained in the bucket may be a hash value of the data content of the two parts, i.e., the character suffix of the blockchain account address and the corresponding account status data; the value of the key-value key value pair may be the data content of both the character suffix of the blockchain account address and the corresponding account status data.
Assuming that a character suffix of a specific account address and corresponding account status data contained in the bucket data bucket need to be read, each key-value key value pair in the bucket data bucket is an independent access unit; therefore, content addressing is carried out on the database only based on the hash values of the data contents of the character suffix of the specific account address and the corresponding account state data, all the data contents contained in the leaf node do not need to be read into the memory from the database, and the character suffix of the account address to be read and the corresponding account state data are further searched in the memory;
correspondingly, if a character suffix of a new account address and corresponding account state data need to be written into the bucket data bucket, or account state data corresponding to a specific account address contained in the bucket data bucket is updated, a key-value key value pair can be directly constructed according to the character suffix of the new account address and the corresponding account state data, and the key-value key value pair is written into the bucket data bucket; or based on the hash value of the data content of the two parts, namely the character suffix of the specific account address and the corresponding account state data, performing content addressing in the database, searching the corresponding key-value key value pair, then writing the updated account state data corresponding to the specific account address, and updating the original value of the key-value key value pair.
The number of data records contained in the bucket is not particularly limited in this specification; in an implementation manner shown, the number of data records contained in the bucket may be specifically configured by a user in a customized manner.
For example, taking the blockchain data as the latest account status data corresponding to the blockchain account in the blockchain, and taking the key of the blockchain data as the blockchain account address as an example, in this case, each data record in the bucket corresponds to the account status of one blockchain account; the number of data records in the bucket actually represents the account carrying capacity of the bucket for accommodating the blockchain account; therefore, the user can flexibly customize the account bearing capacity of the bucket by customizing the number of data records which can be contained in the bucket; for example, in one example, the number of data records contained in the above-mentioned bucket may be configured by the user into 16 or 64, so that a single bucket may carry status data of 16 or 64 blockchain accounts.
It should be noted that, the total storage capacity of the data records stored in the bucket is not particularly limited in this specification; in an implementation manner shown, the total storage capacity of the data records stored in the bucket may be specifically configured by a user in a customized manner.
For example, in implementation, taking the storage medium carrying the database as a disk with a single physical sector of 4KB size as an example, in this case, the user may set the maximum storage capacity of the data records stored in the bucket to 4 KB; or an integer multiple of 4KB, such that the maximum storage capacity of the bucket can be adapted to the storage capacity of a single physical sector of the storage medium.
In the present specification, as described above, the Tree nodes in the top N layer of the FDMT Tree adopt a uniform data structure; therefore, node splitting will not occur for each Tree node in the top N layers of the FDMT Tree. The leaf nodes in the FDMT tree can still be split when a certain splitting condition is satisfied.
Unlike the MPT tree, in the present specification, when a leaf node on the FDMT tree is split into nodes, the splitting may be performed according to the storage capacity of the leaf node instead of the length of the character sharing the character prefix. And splitting the intermediate node from the leaf node when the storage capacity of the leaf node on the FDMT tree meets the node splitting condition. It should be noted that the split intermediate node is an upper node of the leaf node. Multiple splits may be performed for the same leaf node.
The node splitting condition may include any type of condition related to the storage capacity of the leaf node, and is not particularly limited in this specification;
in an embodiment shown, the node splitting condition may be specifically any one of conditions 1 and 2 shown below; alternatively, a combination of conditions 1 and 2 shown below is also possible:
condition 1: the total number of data records stored in the leaf node is greater than a threshold value;
condition 2: the total storage capacity of the data records stored in the leaf nodes is greater than a threshold.
For example, in one example, the node splitting condition may be set to be when the total number of data records stored in the leaf node is greater than 64; and/or, when the total storage capacity of the stored data records stored in the leaf node is larger than 4KB, splitting the intermediate node from the leaf node.
In this specification, the extended node, which is also an intermediate node of the FDMT Tree, may adopt a data structure identical to the Tree node described above, and is specifically configured to store characters split from a character suffix stored in the leaf node;
for example, an extended node split from a leaf node may also include a plurality of blocks each representing a different character; each block may further comprise a plurality of slots respectively representing different characters; the slot may be specifically used to fill a hash value of a node of a next level linked to the node. For example, for an extended node, the next node is the leaf node; therefore, the slot contained in the block in the extended node can be used to fill the hash value of the next leaf node linked by the extended node.
In this specification, for an extended node split from the above leaf nodes, merging with the leaf node of the lower layer linked thereto may be performed according to the storage capacity of the extended node. When the storage capacity of an extended node on the above-mentioned FDMT tree satisfies the node merging condition, the extended node can be merged to a leaf node of a lower layer linked thereto.
The merging of an extended node to a lower leaf node linked thereto means writing a character stored in the extended node as the character suffix to one or more lower leaf nodes linked to the extended node.
The node merge condition may include any type of condition related to the storage capacity of the extended node, and is not particularly limited in this specification;
in an embodiment shown, the node merge condition may be specifically any one of conditions 3 and 4 shown below; alternatively, a combination of conditions 3 and 4 shown below is also possible:
condition 3: the total number of characters stored in the extended node is less than or equal to a threshold; that is, the total number of non-empty slots (i.e., slots filled with a hash value) in each block in the extended node;
condition 4: the total storage capacity of the characters stored in the extended node is less than or equal to the threshold. That is, the total storage capacity of the hash value filled in the non-empty slot in each block in the extended node;
for example, in one example, the node merging condition may be set to be when the total number of characters stored in the extended node is less than or equal to 1; and/or when the total storage capacity of the characters stored in the extended node is less than or equal to 1KB, writing the characters stored in the extended node as a character suffix into one or more leaf nodes at the lower layer linked by the extended node.
As can be seen from the above description, an extended node described in this specification may be a dynamically scalable intermediate node on the above-mentioned FDMT tree; when the storage capacity of any leaf node on the FDMT tree meets the node splitting condition, at least one extended node and at least one leaf node can be split from the leaf node; when the storage capacity of any extended node satisfies the node merge condition, the extended node can be merged to the leaf node of the lower layer linked thereto.
In this specification, the block chain data to be stored may specifically include at least the following four types of data:
transactions captured in blocks; a transaction receipt corresponding to the transaction recorded in the block after the transaction in the block is completed; after the transaction in the block is executed, latest account state data corresponding to a block chain account in the block chain; the storage content of the intelligent contract account;
accordingly, the FDMT tree may specifically include:
a transaction tree for storing transactions embodied in blocks; a receipt tree for storing transaction receipts corresponding to transactions included in the block; a state tree for storing the latest account state data corresponding to blockchain accounts in the blockchain; and the storage tree is used for storing the storage content of the intelligent contract account.
Of course, in practical applications, only the tree structure of the FDMT tree may be used to store some types of data in the four types of data; for example, only the FDMT tree is used to store the latest account status data corresponding to the block chain account, and other types of data may be stored using other forms of binary trees (e.g., MPT or other forms of binary trees).
Wherein, the hash value of the root nodes of the transaction tree, the receipt tree and the state tree can be stored in the block header; the hash value of the root node of the Storage tree may be stored in a Storage field in a structure of the contract account corresponding to the Storage tree.
The key of the block chain data may specifically refer to a corresponding search key value of the block chain data in a database; correspondingly, the Value of the blockchain data may be the original content of the blockchain data;
in practical application, the search key value may be a character string corresponding to the blockchain data; when the block chain data are different types of data, the corresponding keys have certain differences;
for example, when the blockchain data is a transaction for listing in a block; or, after the transaction in the block is completed, when the transaction receipt corresponding to the transaction recorded in the block is received, the key corresponding to the block chain data at this time may be specifically the serial number of the transaction in the block; or other forms of transaction identification.
When the blockchain data is the latest account status data corresponding to the blockchain account in the blockchain after the transaction in the block is completed, the key corresponding to the blockchain data may be specifically the account address of the blockchain account.
When the blockchain data is the storage content of the intelligent contract account, the key corresponding to the blockchain data at this time may specifically be an account address of the contract account and a hash value of a storage location of the storage content in the account storage of the contract account; for example, in an example, the storage content may be a state variable in general, and then a hash value of the account address of the contract account and a storage location of the state variable in the account storage of the contract account may be used as a key.
In this specification, when a node device in a block chain stores block chain data, a key-value key value pair of the block chain data to be stored may be obtained first; for example, in one example, the node device may process blockchain data to be stored into a key-value key value pair when acquiring the blockchain data;
after the key-value key value pair of the blockchain data to be stored is obtained, the key-value key value pair of the blockchain data to be stored can be converted into a root node, a middle node and a leaf node on the logical tree structure;
for example, in an example, the node device may carry a storage interface or a storage service corresponding to the FDMT tree, where the storage interface or the storage service may be specifically configured to convert key-value key pairs of blockchain data to be stored into nodes in the FDMT tree; after acquiring the key-value key value pair of the blockchain data to be stored, the node device may convert the key-value key value pair of the blockchain data to be stored into a root node, an intermediate node, and a leaf node in fig. 4 or fig. 5 by calling the storage interface or the storage service according to the tree structure of the FDMT tree shown in fig. 4 or fig. 5.
After converting the key-value pairs of the stored blockchain data into the root node, the intermediate node and the leaf node on the logical tree structure, the root node, the intermediate node and the leaf node may be stored in the database in the form of the key-value pairs;
for example, the database is usually stored in a persistent storage medium (such as a storage disk) mounted on the node device; the storage medium is a physical storage corresponding to the database; when the FDMT tree is stored in the database, the commit command may be executed to further write the nodes in the FDMT tree into the memory of the node device in the form of Key-Value Key Value pairs, and the storage medium carrying the database.
The specific type of the database is not particularly limited in this specification, and those skilled in the art can flexibly select the database based on actual needs;
in an implementation manner, the database may be a Key-Value type database; for example, in one example, the database may be a LevelDB database with a multi-level storage structure; or, a database based on a levelDB architecture; for example, the Rocksdb database is a typical database based on a LevelDB database architecture.
It should be noted that, when the nodes in the FDMT tree are stored in the database in the form of Key-Value Key Value pairs, the Key of the Key-Value Key Value pair may be specifically the node IDs of the nodes in the FDMT tree;
the node ID may specifically include identification information that can uniquely identify a node in the FDMT tree;
for example, in one implementation, the node ID may specifically be a hash value of data content contained in a node in the FDMT tree; in this case, when the node on the above-mentioned FDMT tree needs to be queried, content addressing can be performed as a key based on the hash value of the data content contained in the node.
In another implementation, the node ID may specifically include path information of a node in the FDMT tree; that is, the path information of the node in the FDMT tree is used as the node ID of the node; the path information may specifically include any form of information that can describe a link relationship between a node and another node, and a position of the node on the FDMT tree;
for example, referring to fig. 8, fig. 8 is a schematic diagram illustrating setting node IDs for nodes in an FDMT tree according to the present disclosure; for the FDMT Tree including three levels of Tree nodes as shown in fig. 8, assuming that the node ID of the Tree node as the root node is represented by 0x00, the node ID of the bucket node shown in fig. 8 may be represented by 0x 00123456.
Where 0x00 is the node ID of the root node; 123456 denotes path information of the bucket node from a root node to the bucket node on the FDMT tree; 12 represents the 2 nd slot of the first block of the first layer tree node; 34 represents the 4 th slot of the 3 rd block of the second layer tree node; 56 denotes the 6 th slot of the 5 th block of the third level tree node.
Based on the node ID, the link relation between the bucket node and other nodes and the specific position of the bucket node on the FDMT tree can be determined; for example, based on the node ID, it can be determined that the bucket node is linked to the 6 th slot of the 5 th block of the third layer tree node; the tree node of the third layer is linked with the 4 th slot of the 3 rd block of the tree node of the second layer; the tree node of the second layer is further linked with the 2 nd slot of the 1 st block of the tree node of the first layer as the root node.
In this manner, a particular slot in the FDMT tree at which a node is located can be precisely located when the node ID is used to retrieve the node stored on the FDMT tree.
In another implementation manner, the node ID may specifically include a relative position of a node in the FDMT tree, and a hash value of data content included in the node (in this case, the node ID may also be used as a hash identifier of the node); that is, the relative position of the node in the FDMT tree and the hash value of the data content included in the node are used as the node ID of the node.
For example, in implementation, a character string generated by splicing the relative position of a node in the FDMT tree and a hash value of data content included in the node may be used as a node ID of the node; of course, in practical application, in the process of performing the splicing, other types of information besides the relative position and the hash value may also be further introduced to generate the node ID; are not listed in this specification.
In this way, in addition to content addressing based on the hash value of the data content contained by the node as a key, the specific slot where the node is located in the FDMT tree can be precisely located when the node ID is used to retrieve the node stored in the FDMT tree.
It should be noted that the storage medium used for bearing the database on the node device may specifically be a persistent storage medium; for example, it may be a disk, a memory or other forms of storage media capable of persistently storing data, and these are not listed in this specification.
In this specification, before writing the key-value key values of the nodes in the FDMT tree into the database, the nodes in the FDMT tree may be encoded in advance, and then the key-value key values of the encoded nodes may be stored in the database.
The Tree node and the extended node on the FDMT Tree are both adopted and comprise a plurality of blocks, and each block further comprises a data structure of a plurality of slots; therefore, in the present specification, when encoding is performed on the FDMT Tree, bitmap encoding may be performed on blocks in the Tree node and extended node on the FDMT Tree.
It should be noted that when a bitmap coding is executed for a block (which may include a main block and a sub block) in a Tree node and an extended node in the FDMT Tree, it may be specifically counted whether each slot in the block in the Tree node and the extended node is filled with a hash value, then a statistical result is expressed by using a special coding character to obtain bitmap coding information, and finally the bitmap coding information is added to the block to complete a bitmap coding process for the block;
for example, in an example, the bitmap encoding information may specifically be a 16-ary character string used to identify whether each slot in the block is filled with a hash value; it is assumed that a block to be encoded (which may be a main block or a sub block) contains 16 slots in total; the 0 th bit, the 8 th bit, the 9 th bit, the 10 th bit and the 11 th bit in the 16 slots are respectively filled with a hash value; then the statistical result of whether the hash is filled in each slot in the block can be represented by a binary string 0000111100000001; wherein, the leftmost bit of the binary string is the 15 th bit of the highest bit, and the rightmost bit is the 0 th bit of the lowest bit; finally, the binary string may be converted into a 16-ary string 0x0f 01; at this time, the 16-ary character string 0x0f01 is bitmap encoding information of the block.
It should be noted that, when performing bitmap encoding on the block in the Tree node and the extended node in the FDMT Tree, the processing procedure of using bitmap encoding is completely the same regardless of the main block or the sub-block.
In this way, as the block contained in the Tree node and the extended node in the encoded FDMT Tree is added, whether each slot in the block is filled with bitmap encoding information with a hash value or not can be indicated; therefore, when data filled in a block in each Tree node stored in a database needs to be inquired, non-empty slots in the block can be determined through bitmap coding information in the block, and the slots in the block do not need to be traversed, so that the searching efficiency can be improved.
Wherein, the leaf node on the FDMT Tree adopts a data structure completely different from the Tree node and extended node; therefore, when encoding leaf nodes in the FDMT Tree, a completely different encoding scheme from the Tree node and extended node may be used.
In the illustrated embodiment, when encoding is performed on the leaf nodes on the above-mentioned FDMT tree, RLP (Recursive Length Prefix) encoding may be still specifically employed; the RLP coding is a coding method commonly used in the MPT tree shown in fig. 1, and a specific coding process thereof will not be described in detail in this specification.
Of course, in practical applications, the encoding method used for encoding the leaf nodes on the FDMT tree may be other encoding methods besides RLP encoding, and in practical applications, the encoding method can be flexibly selected, and is not described in this specification.
In this specification, after encoding is completed for the node on the FDMT tree, the key-value key value pair of the node on the FDMT tree may be stored in the database.
In an embodiment shown, for the Tree node and the extended node in the FDMT Tree, before the key-value key value pair of the coded Tree node and the extended node is stored in the database, an empty slot in the block, which is not filled with a hash value, may be determined according to bitmap coding information added to the block in the coded Tree node and the extended node, and then the determined empty slot may be deleted from the block.
By the mode, when the Tree node and extended node-value key value pairs are stored in the database, the empty slot positions in the blocks can be deleted, the storage space occupied when the Tree nodes and the extended nodes are stored in the database can be further saved, and the storage efficiency is improved.
It should be noted that, for an encoded block, when a hash value of the block is calculated, hash calculation may be performed on bitmap encoding information contained in the encoded block and the hash value filled in a non-empty character slot as a whole; of course, bitmap encoding information may be excluded.
In this specification, after the key-value key value pairs of the nodes in the FDMT Tree are written into the database, if a value corresponding to a certain piece of blockchain data written in the FDMT Tree is updated, the leaf nodes of the FDMT Tree for storing the character suffix and the value of the blockchain data, the extended nodes split from the leaf nodes, and the Tree nodes for storing the character prefix of the key of the blockchain data may need to be updated.
Of course, if the leaf nodes for storing the character suffixes and the values of the blockchain data are not split, only the leaf nodes for storing the character suffixes and the values of the blockchain data and the Tree nodes for storing the character prefixes of the keys of the blockchain data in the FDMT Tree may be updated respectively.
In this case, the node device may search the database for a node corresponding to the blockchain data that needs data update; wherein, the specific searching mode is not described again; and reading the searched nodes from the database into a memory, modifying and updating the nodes in the memory, and further writing the updated nodes into the database to update the original updated nodes.
For example, updating the leaf node on which the data update occurs in the FDMT tree may specifically include updating the value of the blockchain data stored in the leaf node. After the update is completed, the hash value of the leaf node may be recalculated, and the node on the previous layer of the node is re-linked based on the hash value.
Updating an extended node or a Tree node on an upper layer of a leaf node on the FDMT Tree where data update occurs, which may specifically include updating a slot in the extended node or the Tree node filled with a hash value of the leaf node; after the update is completed, the hash value of the extended node or the Tree node can be recalculated, and the relinking with the node on the layer above the node is continued based on the hash value.
In an embodiment shown, the splitting judgment and the specific node splitting operation for the leaf node in the FDMT Tree may be performed at a stage of recalculating the hash value of the leaf node and re-linking with a node (which may be a Tree node or an extended node) at a layer above the leaf node based on the hash value.
In this case, the node device may determine whether data update occurs to a leaf node on the FDMT Tree, and if data update occurs to any leaf node on the FDMT Tree, the node device may further determine whether the storage capacity of the leaf node satisfies a node splitting condition before recalculating a hash value of the leaf node and re-linking with a Tree node or an extended node on an upper layer of the leaf node based on the hash value; if the storage capacity of the leaf node satisfies the node splitting condition, at least one extended node can be further split from the leaf node.
For example, in one example, when the storage capacity of a leaf node satisfies the node splitting condition, in order to rapidly reduce the storage capacity of the leaf node, the leaf node may be split into one extended node and a plurality of leaf nodes.
The splitting strategy of the extended node is split from the leaf nodes, which is not particularly limited in the specification, and in practical application, a user can perform custom setting according to specific splitting requirements;
in an embodiment shown, the splitting policy may specifically include: the latest data record written to the leaf node in the current blocking period is split from the leaf node, and an extended node and the leaf node are additionally created based on the latest data.
In this case, when node splitting is performed on any target leaf node, it may be determined that the latest data record written into the target leaf node is written in the current blocking period; deleting the latest data records from the target data node, and splitting character prefixes from character suffixes contained in the latest data records;
for example, in one example, the first two bits of these most recent data records may be split out by default; alternatively, when a shared character prefix exists in the character suffixes contained in the latest data records and the length of the shared character prefix reaches two bits, the shared character prefix is split.
Then, at least one extended node for storing the split character prefix and at least one leaf node for storing the latest data record after the character prefix is split are further created.
In this way, the latest data record written into the target leaf node in the current blocking period can be deleted from the target leaf node, and at least one extended node and at least one leaf node are re-created as the split-out nodes based on the deleted latest data record; therefore, for the target leaf node, after the target leaf node performs node splitting, the data record actually stored by the target leaf node is completely consistent with the data record stored by the target leaf node in the last blocking period; the hash value of the target leaf node does not change any way with respect to the last blocking period. Therefore, when the target leaf node writes new block chain data in the current blocking period, and the storage capacity of the target leaf node meets the node splitting condition, the newly written data record is only required to be split out to recreate additional extended nodes and leaf nodes, and the hash value of the target leaf node does not need to be recalculated to be re-linked with the node of the previous layer; by the splitting mode, the hash value of the leaf node meeting the node splitting condition can be ensured to be in a stable state, and the calculation times for recalculating the hash value of the leaf node can be reduced.
In another illustrated embodiment, the splitting policy may specifically include: and splitting a shared character prefix among character suffixes contained in a plurality of data records stored in a leaf node from the leaf node, and additionally creating an extended node based on the shared character prefix.
In this case, when node splitting is performed on any target leaf node, it may be determined whether shared character prefixes exist among character suffixes included in a plurality of data records stored by the target leaf node; if a shared character prefix exists among character suffixes contained in a plurality of data records stored by the target leaf node, the shared character prefix can be deleted from the plurality of data records, and at least one extended node for storing the shared character prefix is created.
For example, since the extended node may also adopt the same data structure as the Tree node; therefore, the characters stored by the extended node may also be a character string with a length of two bits, which is formed by splicing the characters represented by the block and the characters represented by the slots filled with the hash value in the block; a shared character prefix exists among the character suffixes contained in the data records stored in the target leaf node, and when the length of the shared character prefix reaches two bits, the shared character prefix can be split from the data records.
In an embodiment shown, the merge judgment and the specific node merge operation for the extended node on the FDMT may be performed at a stage of recalculating the hash value of the extended node and performing a relinking with a node on a layer above the extended node based on the hash value.
In this case, the node device may determine whether a data update occurs to an extended node on the FDMT tree, and if a data update occurs to any extended node split from a leaf node on the FDMT tree, the node device may further determine whether a storage capacity of the extended node satisfies a node merge condition before recalculating a hash value of the extended node and relinking with a node on an upper layer of the extended node based on the hash value;
if the storage capacity of the extended node satisfies the node splitting condition, the extended node may be further merged to a leaf node of a next layer linked with the extended node.
For example, in implementation, a leaf node at the next layer of the extended node link may be determined first; for example, the leaf node of the next layer linked by the extended node may be determined according to a hash value filled in a non-empty slot in a block included in the extended node; then, the character stored in the extended node may be written into the leaf node of the next layer linked to the determined extended node as a part of the character suffix.
Of course, in practical applications, when a leaf node is subjected to multiple node splits, the leaf node may split into multiple layers of extended nodes; in this case, when any extended node satisfies the node merging condition, if the node on the lower layer is still an extended node and is not a leaf node, the extended node cannot perform node merging for a while; in this case, after the extended node on the lower layer and the leaf node on the lower layer are merged to form a new leaf node, the new leaf node and the new leaf node on the lower layer may be merged for the second time, and the specific merging manner is not described again.
A specific process of writing the blockchain data into the FDMT tree shown in fig. 4 and 5 in the form of key-value key value pairs is described in detail below, taking the blockchain data as the latest account status data corresponding to the blockchain account, and taking the key of the blockchain data as the blockchain account address as an example.
When the method is implemented, a user client accessing the block chain can pack transaction data into a standard transaction format supported by the block chain and then release the transaction data to the block chain; the node equipment in the block chain can carry out consensus on the transactions issued to the block chain by the user client based on the carried consensus algorithm together with other node equipment so as to generate the latest block for the block chain; wherein, the specific consensus process is not repeated.
After the node devices in the blockchain execute the transactions in the target blocks, the account status of the target accounts in the blockchain related to the executed transactions is usually changed; therefore, after the transaction in the target block is completed, the node device may acquire the latest account status data after the account update of the target account occurs (i.e., the account status after the transaction in the target block is performed), and process the acquired latest account status data of the target account into a key-value key value pair; wherein the key of the key-value key value pair is the account address of the target account; the value of the key-value pair is the latest account status of the target account.
After the obtained latest account state data of the target account is processed into a key-value key value pair, the key-value key value pair may be converted into a Tree node, an extended node, and a Leaf node on the FDMT Tree, and the key-value key value pairs of the Tree node, the extended node, and the Leaf node may be stored in a database.
Referring to fig. 9, fig. 9 is a schematic diagram illustrating a process for writing account status data into an FDMT status tree according to the present disclosure;
in the above FDMT state Tree shown in fig. 9, the first three layers are Tree nodes, and the last layer is a leaf node; the leaf node may adopt the storage structure of the bucket described above. Each layer of Tree node comprises a main block and 16 sub-blocks which respectively represent different 16-system characters from 0 to f; and each sub-block further comprises 16 slots which respectively represent different 16-system characters 0-f.
Assuming that the account address of the target account is "a 71135125", the latest account status data is "state 1"; at this time, the character prefix (Shared neighbor) of the account address is "a 71135"; the suffix (key-end) of the character is "125".
When the account status data "state 1" of the account address "a 71135125" is written into the FDMT Tree in the form of key-value key value pairs, first, a Tree node serving as a root node on the FDMT Tree may be located in the database (for example, the root node may be located according to the hash of the root node filled in the block header); if the data is written in for the first time and the root node is not established, the root node can be established at the moment; and determining a character slot position corresponding to the character prefix 'a 71135' of the account address in three layers of Tree nodes in sequence from the root node1 of the first layer. As shown in fig. 9, the character slot corresponding to the character prefix "a 71135" of the account address specifically includes: slot 8 (representing character 7) in the 11 th sub-block (representing character a) of Tree node 1; slot 2 (representing character 1) in sub-block 2 (representing character 1) of Tree node 2; slot6 (representing character 5) in sub-block 4 (representing character 3) of Tree node 3.
After the above slot positions are determined, a data record composed of a character suffix "125" and state data "state 1" may be written in the bucket node linked with the 6 th slot position of the 4 th sub-block of the Tree node 3; of course, if there is already a data record corresponding to the character suffix "125" in the bucket node, it indicates a value corresponding to the historical account status data written with the above account address "a 71135125" on the FMDT tree; at this time, Value stored in the data record may be updated to "state 1".
After the data writing is completed, the hash value of the data content contained in the bucket node may be recalculated, the hash value is filled into the 6 th slot of the 4 th block of the Tree node3, and the original hash value of the slot is updated.
Further, after the original hash value in the 6 th slot of the 4 th block of the Tree node3 is updated, the hash value of the data content contained in the main block of the Tree node3 is recalculated, the 2 nd slot of the 2 nd block of the Tree node2 is filled with the hash value, and the original hash value in the slot is updated.
Then, after updating the original hash value of the slot 2 of the block 2 of the Tree node2, recalculating the hash value of the data content contained in the master block of the Tree node2, continuously filling the hash value into the slot 8 of the block 11 of the Tree node1 (i.e., the root node), and updating the original hash value of the slot.
When the original hash value of the 8 th slot of the 11 th block of the root node Tree node1 is updated, the hash value of the data content contained in the main block of the root node Tree node1 is recalculated, and the hash value of the root node of the FDMT state Tree stored in the block header is updated based on the hash value. When the hash value of the root node of the FDMT state tree stored in the block header is updated, and the update of the FDMT state tree is completed, the key-value key value pair formed by the account address "a 71135512" and the corresponding account state data "state 1" is successfully written into the FDMT state tree.
It should be emphasized that the above-mentioned block chain data is taken as the latest account status data corresponding to the block chain account as an example, and is only exemplary; in practical applications, when the block chain data is other types of block chain data of the 4 types of block chain data described above, a specific process of writing the block chain data into the corresponding FDMT tree is similar to the implementation process described above, and is not described in detail in this specification.
Corresponding to the method embodiment, the application also provides an embodiment of the device.
Corresponding to the above method embodiments, the present specification also provides an embodiment of a block chain data storage device.
The embodiments of the block chain data storage apparatus of the present specification can be applied to electronic devices. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. Taking a software implementation as an example, as a logical device, the device is formed by reading, by a processor of the electronic device where the device is located, a corresponding computer program instruction in the nonvolatile memory into the memory for operation.
From a hardware aspect, as shown in fig. 10, the block chain data storage device in this specification is a hardware structure diagram of an electronic device where the block chain data storage device is located, and except for the processor, the memory, the network interface, and the nonvolatile memory shown in fig. 10, the electronic device where the block chain data storage device is located in the embodiment may also include other hardware according to an actual function of the electronic device, which is not described again.
Fig. 11 is a block diagram of a blockchain data storage device shown in an exemplary embodiment of the present description.
Referring to fig. 11, the block chain data storage apparatus 110 may be applied in the electronic device shown in fig. 10, where the apparatus 110 includes:
the obtaining module 1101 is configured to obtain a key-value key value pair of block chain data to be stored;
the conversion module 1102 is configured to convert the key-value key value pairs of the to-be-stored blockchain data into a root node, a middle node, and a leaf node on a logical tree structure; the root node and the middle node comprise a plurality of positions for storing characters in keys of the blockchain data, and each position comprises a plurality of slot positions for storing the characters in the keys of the blockchain data; the slot position is used for storing a hash value of a next layer node linked with the node;
the storage module 1103 stores the key-value pairs of the root node, the intermediate nodes and the leaf nodes in a database; in the key-value key value pairs of the leaf node, the intermediate node and the root node, value is the storage content of the node, and key is the hash value of the storage content of the node.
In this embodiment, the number of layers of the root node and the middle node is a fixed value.
In this embodiment, the root node and the intermediate node are configured to store at least a part of characters in the key of the blockchain data; the at least part of characters stored in the root node and the intermediate node are character represented by the position in the root node and the intermediate node, and character strings generated by splicing the characters represented by the slot position filled with the hash value in the position.
In this embodiment, the leaf node is a bucket; the bucket data barrel comprises a plurality of data records; the data content stored in the data record includes a value of the blockchain data.
In this embodiment, the character string corresponding to the key of the blockchain data includes a character prefix and a character suffix; the root node and the middle node comprise a plurality of positions for storing characters in the character prefix, and each position comprises a plurality of slot positions for storing the characters in the character prefix; the data content stored in the data record includes the character suffix and the value of the blockchain data.
In this embodiment, the number of the positions included in the root node and the intermediate node is the same as the number of the slots included in the positions.
In this embodiment, the root node and the intermediate node include 16 positions respectively representing different 16-ary characters; the positions include 16 slots each representing a different 16-ary character.
In this embodiment, the block chain data includes any one of the following:
transactions captured in blocks;
a transaction receipt corresponding to the transaction embodied in the block;
latest account status data corresponding to blockchain accounts in the blockchain;
the stored content of the intelligent contract account.
In this embodiment, the logical tree structure includes any one of the following:
a transaction tree for storing transactions embodied in blocks;
a receipt tree for storing transaction receipts corresponding to transactions included in the block;
a state tree for storing the latest account state data corresponding to blockchain accounts in the blockchain;
and the storage tree is used for storing the storage content of the intelligent contract account.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. A typical implementation device is a computer, which may take the form of a personal computer, laptop computer, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.
In a typical configuration, a computer includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic disk storage, quantum memory, graphene-based storage media or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The terminology used in the description of the one or more embodiments is for the purpose of describing the particular embodiments only and is not intended to be limiting of the description of the one or more embodiments. As used in one or more embodiments of the present specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in one or more embodiments of the present description to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of one or more embodiments herein. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
The above description is only for the purpose of illustrating the preferred embodiments of the one or more embodiments of the present disclosure, and is not intended to limit the scope of the one or more embodiments of the present disclosure, and any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the one or more embodiments of the present disclosure should be included in the scope of the one or more embodiments of the present disclosure.

Claims (20)

1. A method of storing data in a blockchain, comprising:
acquiring a key-value key value pair of block chain data to be stored;
converting the key-value key value pair of the block chain data to be stored into a root node, a middle node and a leaf node on a logical tree structure; the root node and the middle node comprise a plurality of positions for storing characters in keys of the blockchain data, and each position comprises a plurality of slot positions for storing the characters in the keys of the blockchain data; the slot position is used for storing a hash value of a next layer node linked with the node where the slot position is located;
storing the key-value pairs of the root node, the intermediate nodes and the leaf nodes in a database; in the key-value key value pairs of the leaf node, the intermediate node and the root node, value is the storage content of the node, and key is the hash value of the storage content of the node.
2. The method of claim 1, the number of layers of the root node and the intermediate node being a fixed value.
3. The method of claim 1, the root node, intermediate nodes to store at least a portion of characters in keys of the blockchain data; the at least part of characters stored in the root node and the intermediate node are character represented by the position in the root node and the intermediate node, and character strings generated by splicing the characters represented by the slot position filled with the hash value in the position.
4. The method of claim 3, the leaf node being a bucket data bucket; the bucket data barrel comprises a plurality of data records; the data content stored in the data record includes a value of the blockchain data.
5. The method of claim 4, the key-corresponding string of blockchain data comprising a character prefix and a character suffix; the root node and the middle node comprise a plurality of positions for storing characters in the character prefix, and each position comprises a plurality of slot positions for storing the characters in the character prefix; the data content stored in the data record includes the character suffix and the value of the blockchain data.
6. The method of claim 1, the root node, an intermediate node comprising the same number of locations as the number of slots the locations comprise.
7. The method of claim 6, the root node, intermediate nodes comprising 16 positions each representing a different 16-ary character; the positions include 16 slots each representing a different 16-ary character.
8. The method of claim 1, the blockchain data comprising any one of:
transactions captured in blocks;
a transaction receipt corresponding to the transaction embodied in the block;
latest account status data corresponding to blockchain accounts in the blockchain;
the stored content of the intelligent contract account.
9. The method of claim 8, the logical tree structure comprising any of:
a transaction tree for storing transactions embodied in blocks;
a receipt tree for storing transaction receipts corresponding to transactions included in the block;
a state tree for storing the latest account state data corresponding to blockchain accounts in the blockchain;
and the storage tree is used for storing the storage content of the intelligent contract account.
10. An apparatus for storing data in a blockchain, comprising:
the acquisition module is used for acquiring a key-value key value pair of the block chain data to be stored;
the conversion module is used for converting the key-value key value pair of the block chain data to be stored into a root node, a middle node and a leaf node on a logic tree structure; the root node and the middle node comprise a plurality of positions for storing characters in keys of the blockchain data, and each position comprises a plurality of slot positions for storing the characters in the keys of the blockchain data; the slot position is used for storing a hash value of a next layer node linked with the node where the slot position is located;
the storage module is used for storing the key-value key value pairs of the root node, the middle node and the leaf node in a database; in the key-value key value pairs of the leaf node, the intermediate node and the root node, value is the storage content of the node, and key is the hash value of the storage content of the node.
11. The apparatus of claim 10, the number of layers of the root node and the intermediate node is a fixed value.
12. The apparatus of claim 10, the root node, intermediate node to store at least a portion of characters in keys of the blockchain data; the at least part of characters stored in the root node and the intermediate node are character represented by the position in the root node and the intermediate node, and character strings generated by splicing the characters represented by the slot position filled with the hash value in the position.
13. The apparatus of claim 12, the leaf node being a bucket data bucket; the bucket data barrel comprises a plurality of data records; the data content stored in the data record includes a value of the blockchain data.
14. The apparatus of claim 13, the key-corresponding string of blockchain data comprising a character prefix and a character suffix; the root node and the middle node comprise a plurality of positions for storing characters in the character prefix, and each position comprises a plurality of slot positions for storing the characters in the character prefix; the data content stored in the data record includes the character suffix and the value of the blockchain data.
15. The apparatus of claim 10, the root node, an intermediate node comprising the same number of locations as the number of slots the locations comprise.
16. The apparatus of claim 15, the root node, intermediate node comprising 16 positions each representing a different 16-ary character; the positions include 16 slots each representing a different 16-ary character.
17. The apparatus of claim 10, the blockchain data comprising any one of:
transactions captured in blocks;
a transaction receipt corresponding to the transaction embodied in the block;
latest account status data corresponding to blockchain accounts in the blockchain;
the stored content of the intelligent contract account.
18. The apparatus of claim 17, the logical tree structure comprising any of:
a transaction tree for storing transactions embodied in blocks;
a receipt tree for storing transaction receipts corresponding to transactions included in the block;
a state tree for storing the latest account state data corresponding to blockchain accounts in the blockchain;
and the storage tree is used for storing the storage content of the intelligent contract account.
19. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the method of any one of claims 1-9 by executing the executable instructions.
20. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, carry out the steps of the method according to any one of claims 1 to 9.
CN202110495070.9A 2021-05-07 2021-05-07 Block chain data storage method and device and electronic equipment Active CN112988910B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110495070.9A CN112988910B (en) 2021-05-07 2021-05-07 Block chain data storage method and device and electronic equipment
PCT/CN2022/090294 WO2022233274A1 (en) 2021-05-07 2022-04-29 Block chain data storage method and apparatus, and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110495070.9A CN112988910B (en) 2021-05-07 2021-05-07 Block chain data storage method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN112988910A CN112988910A (en) 2021-06-18
CN112988910B true CN112988910B (en) 2021-09-24

Family

ID=76337213

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110495070.9A Active CN112988910B (en) 2021-05-07 2021-05-07 Block chain data storage method and device and electronic equipment

Country Status (2)

Country Link
CN (1) CN112988910B (en)
WO (1) WO2022233274A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112988910B (en) * 2021-05-07 2021-09-24 支付宝(杭州)信息技术有限公司 Block chain data storage method and device and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108446376A (en) * 2018-03-16 2018-08-24 众安信息技术服务有限公司 Date storage method and device
CN111488614A (en) * 2020-04-08 2020-08-04 北京瑞策科技有限公司 Digital identity storage method and device based on service data block chain

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10303673B2 (en) * 2015-05-11 2019-05-28 Apple Inc. Hierarchical data storage
KR102322729B1 (en) * 2019-03-04 2021-11-05 어드밴스드 뉴 테크놀로지스 씨오., 엘티디. Blockchain World State Merkle Patricia Trie Subtree Update
CN110275884B (en) * 2019-05-31 2020-08-04 阿里巴巴集团控股有限公司 Data storage method and node
CN110334154B (en) * 2019-06-28 2020-07-21 阿里巴巴集团控股有限公司 Block chain based hierarchical storage method and device and electronic equipment
WO2019179538A2 (en) * 2019-07-11 2019-09-26 Alibaba Group Holding Limited Shared blockchain data storage
CN112102840B (en) * 2020-09-09 2024-05-03 中移(杭州)信息技术有限公司 Semantic recognition method, semantic recognition device, terminal and storage medium
CN112632077A (en) * 2020-12-28 2021-04-09 深圳壹账通智能科技有限公司 Data storage method, device, equipment and storage medium based on redis
CN114153848B (en) * 2021-05-07 2024-06-28 支付宝(杭州)信息技术有限公司 Block chain data storage method and device and electronic equipment
CN112988761B (en) * 2021-05-07 2022-04-08 支付宝(杭州)信息技术有限公司 Block chain data storage method and device and electronic equipment
CN112988909B (en) * 2021-05-07 2021-09-28 支付宝(杭州)信息技术有限公司 Block chain data storage method and device and electronic equipment
CN112988911B (en) * 2021-05-07 2021-09-24 支付宝(杭州)信息技术有限公司 Block chain data storage method and device and electronic equipment
CN112905607B (en) * 2021-05-07 2022-02-01 支付宝(杭州)信息技术有限公司 Block chain data storage method and device and electronic equipment
CN112988910B (en) * 2021-05-07 2021-09-24 支付宝(杭州)信息技术有限公司 Block chain data storage method and device and electronic equipment
CN112988912B (en) * 2021-05-07 2021-11-02 支付宝(杭州)信息技术有限公司 Block chain data storage method and device and electronic equipment
CN113220685B (en) * 2021-05-11 2022-04-19 支付宝(杭州)信息技术有限公司 Traversal method and device for intelligent contract storage content and electronic equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108446376A (en) * 2018-03-16 2018-08-24 众安信息技术服务有限公司 Date storage method and device
CN111488614A (en) * 2020-04-08 2020-08-04 北京瑞策科技有限公司 Digital identity storage method and device based on service data block chain

Also Published As

Publication number Publication date
WO2022233274A1 (en) 2022-11-10
CN112988910A (en) 2021-06-18

Similar Documents

Publication Publication Date Title
CN110334154B (en) Block chain based hierarchical storage method and device and electronic equipment
CN110457319B (en) Block chain state data storage method and device and electronic equipment
CN112988908B (en) Block chain data storage method and device and electronic equipment
CN110471795B (en) Block chain state data recovery method and device and electronic equipment
CN112988909B (en) Block chain data storage method and device and electronic equipment
CN112988912B (en) Block chain data storage method and device and electronic equipment
CN113220685B (en) Traversal method and device for intelligent contract storage content and electronic equipment
CN112988761B (en) Block chain data storage method and device and electronic equipment
CN110347684B (en) Block chain based hierarchical storage method and device and electronic equipment
CN112905607B (en) Block chain data storage method and device and electronic equipment
CN110347660B (en) Block chain based hierarchical storage method and device and electronic equipment
CN114706848A (en) Block chain data storage, updating and reading method and device and electronic equipment
CN115221176A (en) Block chain data storage method and device and electronic equipment
US20100161668A1 (en) Method and system for index serialization
CN112988910B (en) Block chain data storage method and device and electronic equipment
CN112988911B (en) Block chain data storage method and device and electronic equipment
CN115374127B (en) Data storage method and device
CN118897732A (en) Method for constructing and reading world state based on tree structure and computer equipment
CN118797106A (en) Method for constructing world state based on tree structure and computer equipment
CN115982781A (en) Method for creating account in block chain and block chain link point
CN118939653A (en) Method and computer equipment for constructing world state based on Merker dictionary tree
CN118860288A (en) Method for searching basic page/increment page and computer equipment
CN118797105A (en) Method for storing world state of tree structure, recovering method and computer equipment
CN116401412A (en) Index searching method, system, electronic device and readable storage medium
CN116188160A (en) Method and block link point for executing transaction in block chain system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20241008

Address after: Room 803, floor 8, No. 618 Wai Road, Huangpu District, Shanghai 200010

Patentee after: Ant blockchain Technology (Shanghai) Co.,Ltd.

Country or region after: China

Address before: 310000 801-11 section B, 8th floor, 556 Xixi Road, Xihu District, Hangzhou City, Zhejiang Province

Patentee before: Alipay (Hangzhou) Information Technology Co.,Ltd.

Country or region before: China

Patentee before: Ant blockchain Technology (Shanghai) Co.,Ltd.