CN109542911B - Metadata organization method, system, equipment and computer readable storage medium - Google Patents
Metadata organization method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109542911B CN109542911B CN201811463459.XA CN201811463459A CN109542911B CN 109542911 B CN109542911 B CN 109542911B CN 201811463459 A CN201811463459 A CN 201811463459A CN 109542911 B CN109542911 B CN 109542911B
- Authority
- CN
- China
- Prior art keywords
- metadata
- target
- full flash
- memory
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000008520 organization Effects 0.000 title claims abstract description 66
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000012545 processing Methods 0.000 claims description 25
- 238000013075 data extraction Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 11
- 238000013507 mapping Methods 0.000 claims description 9
- 238000000605 extraction Methods 0.000 claims description 6
- 230000000875 corresponding effect Effects 0.000 description 28
- 238000004891 communication Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000005055 memory storage Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a metadata organization method, a system, equipment and a computer readable storage medium, which are applied to full flash storage, wherein the method comprises the following steps: acquiring a target metadata set; organizing a target metadata group by adopting a B + tree structure to obtain B + tree metadata; storing the B + tree metadata in a full flash memory; the target metadata set is stored directly in the disk of the full flash storage. According to the metadata organization method, the B + tree metadata are stored in the memory of the full flash memory through the full flash memory, the target metadata group is directly stored in the disk of the full flash memory, and therefore when the metadata are reorganized, only the B + tree structure in the memory needs to be reorganized. The metadata organization system, equipment and computer readable storage medium disclosed by the application also solve the corresponding technical problems.
Description
Technical Field
The present application relates to the field of full flash storage technologies, and more particularly, to a metadata organization method, system, device, and computer-readable storage medium.
Background
The development of the information era has higher and higher requirements on high load and low time delay of storage equipment, and full flash memory storage is produced in order to support increasingly inflated mass data services. The larger the capacity of the full flash memory is, the more the corresponding metadata is needed, and the memory capacity of the full flash memory cannot be infinite, so that the metadata needs to be reasonably organized.
One existing metadata organization method is: and storing the cloud data in a B + tree form, and storing the B + tree in a memory and a disk of the full flash storage.
However, in the conventional metadata organization method, when metadata needs to be reorganized in a disk, the entire B + tree needs to be organized, which is inefficient.
In summary, how to improve the organization efficiency of the metadata organization method is a problem to be solved urgently by those skilled in the art.
Disclosure of Invention
The present application aims to provide a metadata organization method, which can solve the technical problem of how to improve the organization efficiency of the metadata organization method to a certain extent. The application also provides a metadata organization system, equipment and a computer readable storage medium.
In order to achieve the above purpose, the present application provides the following technical solutions:
a metadata organization method is applied to full flash storage and comprises the following steps:
acquiring a target metadata set;
organizing the target metadata group by adopting a B + tree structure to obtain B + tree metadata;
storing the B + tree metadata in a memory of the full flash storage;
and directly storing the target metadata group in the disk of the full flash storage.
Preferably, after the storing the target metadata group directly in the disk of the full flash storage, the method further includes:
performing data extraction on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata;
and storing the secondary metadata into the memory of the full flash memory.
Preferably, after performing data extraction on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata, the method further includes:
judging whether a write request is received;
and if so, processing the secondary metadata based on the write request, and then processing the target metadata group in the disk of the full flash storage based on the write request.
Preferably, after performing data extraction on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata, the method further includes:
judging whether a read request is received;
and if so, directly processing the secondary metadata based on the read request.
Preferably, after performing data extraction on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata, the method further includes:
judging whether the data structure of the target metadata group changes or not;
if yes, migrating the target metadata group in the full-flash-storage disk based on the data structure of the target metadata group, and updating the secondary metadata.
Preferably, after the storing the secondary metadata in the memory of the full flash memory, the method further includes:
and establishing and storing a storage mapping relation between the secondary metadata and the memory of the full flash storage.
Preferably, after the storing the target metadata group directly in the disk of the full flash storage, the method further includes:
judging whether the target metadata group in the disk stored in the full flash is complete or not;
and if not, expanding the B + tree metadata to obtain the target metadata group, and updating the disk of the full flash storage based on the target metadata group.
A metadata organization system is applied to full flash storage and comprises:
a first obtaining module, configured to obtain a target metadata set;
the first organizing module is used for organizing the target metadata group by adopting a B + tree structure to obtain B + tree metadata;
the first storage module is used for storing the B + tree metadata in the memory of the full flash storage;
and the second storage module is used for directly storing the target metadata group in the disk of the full flash storage.
A metadata organization apparatus, comprising:
a memory for storing a computer program;
a processor for implementing the metadata organization method as described in any one of the above when executing the computer program.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out a metadata organization method as claimed in any one of the above.
The metadata organization method is applied to full flash storage and is used for acquiring a target metadata group; organizing a target metadata group by adopting a B + tree structure to obtain B + tree metadata; storing the B + tree metadata in a full flash memory; the target metadata set is stored directly in the disk of the full flash storage. According to the metadata organization method, the B + tree metadata are stored in the memory of the full flash memory through the full flash memory, the target metadata group is directly stored in the disk of the full flash memory, and therefore when the metadata are reorganized, only the B + tree structure in the memory needs to be reorganized. The metadata organization system, the metadata organization equipment and the computer-readable storage medium solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a first flowchart of a metadata organization method according to an embodiment of the present application;
fig. 2 is a second flowchart of a metadata organization method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a metadata organization system according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a metadata organization apparatus according to an embodiment of the present application;
fig. 5 is another schematic structural diagram of a metadata organization apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The development of the information era has higher and higher requirements on high load and low time delay of storage equipment, and full flash memory storage is produced in order to support increasingly inflated mass data services. The larger the capacity of the full flash memory is, the more the corresponding metadata is needed, and the memory capacity of the full flash memory cannot be infinite, so that the metadata needs to be reasonably organized. One existing metadata organization method is: and storing the cloud data in a B + tree form, and storing the B + tree in a memory and a disk of the full flash storage. However, in the conventional metadata organization method, when metadata needs to be reorganized in a disk, the entire B + tree needs to be organized, which is inefficient. The metadata organization method can improve the metadata organization efficiency.
Referring to fig. 1, fig. 1 is a first flowchart of a metadata organization method according to an embodiment of the present application.
The metadata organization method provided by the embodiment of the application is applied to full flash storage and can comprise the following steps:
step S101: a target metadata set is obtained.
In practical application, the full flash memory may obtain the target metadata set first, the specific content and type of the target metadata set may be determined according to specific needs, and the amount of metadata included in the target metadata set may also be determined according to actual needs. The acquired target metadata set may be a target metadata set acquired through a transmission port of the flash memory, or a target metadata set obtained by selecting a metadata set prestored in the flash memory as the target metadata set under an external specification.
Step S102: and organizing the target metadata group by adopting a B + tree structure to obtain B + tree metadata.
In practical application, after the target metadata set is obtained, the target metadata set can be organized by using a B + tree structure to obtain B + tree metadata. A B + tree as referred to herein is a tree data structure that is an n-ary ordered tree, each node typically having a plurality of children, a B + tree that includes a root node, which may be a leaf node, or a node that includes two or more child nodes, internal nodes, and leaf nodes. The process of organizing the target metadata group by using the B + tree structure to obtain the B + tree metadata may refer to the prior art, and is not described herein again, nor is it particularly limited.
Step S103: and storing the B + tree metadata in a memory of the full flash memory.
In practical application, after the B + tree metadata is obtained, the B + tree metadata can be stored in the memory of the full flash memory, and since the capacity of the memory cannot be infinite, the B + tree metadata is stored in the memory of the full flash memory, the capacity of the memory of the full flash memory can be saved, and more metadata can be contained in the content of the full flash memory.
Step S104: the target metadata set is stored directly in the disk of the full flash storage.
In practical application, after the target metadata set is obtained, the target metadata set can be directly stored in a disk of the full flash storage. Due to the expandability of the full-flash storage disk, the target metadata group is directly stored in the full-flash storage disk, and although more disk space is occupied, the target metadata group is convenient to be directly processed, such as read-write operation on the target metadata group.
In a specific application scenario, in order to facilitate processing of a target metadata set, after the target metadata set is directly stored in a full flash storage disk, data extraction can be performed on the target metadata set according to a preset metadata length to obtain corresponding secondary metadata; and storing the secondary metadata into a memory of the full flash memory. The preset metadata length may be 8M, etc. Since the target metadata group is subjected to data extraction to obtain the secondary metadata, the secondary metadata can be processed to realize the processing of the single metadata, for example, the secondary metadata is migrated to realize the migration of the single metadata. Specifically, when the target metadata group needs to be written, in order to improve efficiency, after data extraction is performed on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata, whether a write request is received can be judged; if yes, processing the secondary metadata based on the write request, and then processing a target metadata group in the disk of the full flash storage based on the write request. Specifically, when a target metadata group needs to be read, in order to improve efficiency, after data extraction is performed on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata, whether a read request is received can be judged; and if so, directly processing the secondary metadata based on the read request.
In a specific application scenario, a situation that a data structure of a target metadata group changes may exist, and in order to synchronize the data structure of the target metadata group, after data extraction is performed on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata, whether the data structure of the target metadata group changes or not can be judged; if yes, migrating the target metadata group in the disk of the full flash storage based on the data structure of the target metadata group, and updating secondary metadata. That is, when the data structure of the target metadata group changes and the secondary metadata is stored in the fully-flash-stored memory, the target metadata group in the fully-flash-stored disk needs to be migrated based on the data structure of the target metadata group to synchronize the data structure of the target metadata group in the fully-flash-stored disk, and the secondary metadata in the fully-flash-stored memory is updated, so that the secondary metadata in the fully-flash-stored memory is synchronized with the target metadata group in the fully-flash-stored disk.
In a specific application scenario, in order to facilitate fast processing of the secondary metadata in the fully-flash-stored memory, after the secondary metadata is stored in the fully-flash-stored memory, a storage mapping relationship between the secondary metadata and the fully-flash-stored memory may be established and stored. Therefore, the storage position of the secondary metadata in the memory of the full flash storage can be determined directly according to the storage mapping relation subsequently, and the processing efficiency of the secondary metadata is improved.
In a specific application scenario, after the target metadata group is directly stored in the disk of the full flash storage, whether the target metadata group in the disk of the full flash storage is complete can be judged; if not, expanding the B + tree metadata to obtain a target metadata group, and updating the disk of the full flash storage based on the target metadata group. In order to avoid this situation, it is necessary to determine whether the target metadata in the disk stored in the full flash is complete, specifically, it may be determined whether the target metadata in the disk stored in the full flash is complete at all times, or it may be determined whether the target metadata in the disk stored in the full flash is complete according to a preset time interval.
The metadata organization method is applied to full flash storage and is used for acquiring a target metadata group; organizing a target metadata group by adopting a B + tree structure to obtain B + tree metadata; storing the B + tree metadata in a full flash memory; the target metadata set is stored directly in the disk of the full flash storage. According to the metadata organization method, the B + tree metadata are stored in the memory of the full flash memory through the full flash memory, the target metadata group is directly stored in the disk of the full flash memory, and therefore when the metadata are reorganized, only the B + tree structure in the memory needs to be reorganized.
Referring to fig. 2, fig. 2 is a second flowchart of a metadata organization method according to an embodiment of the present application.
In practical applications, a metadata organization method provided by the embodiment of the present application may include the following steps:
step S201: a target metadata set is obtained.
Step S202: and organizing the target metadata group by adopting a B + tree structure to obtain B + tree metadata.
Step S203: and storing the B + tree metadata in a memory of the full flash memory.
Step S204: the target metadata set is stored directly in the disk of the full flash storage.
Step S205: and performing data extraction on the target metadata group according to the preset metadata length to obtain corresponding secondary metadata.
Step S206: and storing the secondary metadata into a memory of the full flash memory.
Step S207: and establishing and storing a storage mapping relation between the secondary metadata and the memory of the full flash storage.
Step S208: and judging whether the data structure of the target metadata group is changed, if so, executing step S209, and if not, directly executing step S210.
Step S209: and migrating the target metadata group in the disk of the full flash storage based on the data structure of the target metadata group, and updating the secondary metadata.
Step S210: judging whether a target metadata group in a disk of the full flash storage is complete or not; if not, step S211 is executed, and if yes, step S212 is directly executed.
Step S211: and expanding the B + tree metadata to obtain a target metadata group, and updating the disk of the full flash storage based on the target metadata group.
Step S212: judging whether a write request is received; if so, step S213 is executed, otherwise, step S214 is directly executed.
Step S213: and processing the secondary metadata based on the write request, and processing a target metadata group in the disk of the full flash storage based on the write request.
Step S214: judging whether a read request is received; if yes, go to step S215.
Step S215: the secondary metadata is processed directly based on the read request.
The application also provides a metadata organization system, which has the corresponding effect of the metadata organization method provided by the embodiment of the application. Referring to fig. 3, fig. 3 is a schematic structural diagram of a metadata organization system according to an embodiment of the present application.
The metadata organization system provided by the embodiment of the application is applied to full flash storage and can include:
a first obtaining module 101, configured to obtain a target metadata set;
a first organizing module 102, configured to organize a target metadata group by using a B + tree structure to obtain B + tree metadata;
the first storage module 103 is configured to store the B + tree metadata in a full flash memory;
and a second storage module 104, configured to store the target metadata set directly in a disk of the full flash storage.
The metadata organization system provided by the embodiment of the application is applied to full flash storage, and may further include:
the first extraction module is used for extracting data of the target metadata group according to the preset metadata length after the target metadata group is directly stored in the disk of the full flash storage by the second storage module to obtain corresponding secondary metadata;
and the third storage module is used for storing the secondary metadata to the memory of the full flash storage.
The metadata organization system provided by the embodiment of the application is applied to full flash storage, and may further include:
the first judgment module is used for the first extraction module to extract data of the target metadata group according to the preset metadata length to obtain corresponding secondary metadata and then judge whether a write request is received or not; if yes, processing the secondary metadata based on the write request, and then processing a target metadata group in the disk of the full flash storage based on the write request.
The metadata organization system provided by the embodiment of the application is applied to full flash storage, and may further include:
the second judgment module is used for the first extraction module to extract data of the target metadata group according to the preset metadata length to obtain corresponding secondary metadata and then judge whether a reading request is received or not; and if so, directly processing the secondary metadata based on the read request.
The metadata organization system provided by the embodiment of the application is applied to full flash storage, and may further include:
the third judgment module is used for the first extraction module to extract data of the target metadata group according to the preset metadata length to obtain corresponding secondary metadata and then judge whether the data structure of the target metadata group changes or not; if yes, migrating the target metadata group in the disk of the full flash storage based on the data structure of the target metadata group, and updating secondary metadata.
The metadata organization system provided by the embodiment of the application is applied to full flash storage, and may further include:
and the first establishing module is used for establishing and storing a storage mapping relation between the secondary metadata and the memory of the full flash storage after the third storage module stores the secondary metadata to the memory of the full flash storage.
The metadata organization system provided by the embodiment of the application is applied to full flash storage, and may further include:
the fourth judging module is used for judging whether the target metadata group in the disk of the full flash storage is complete or not after the target metadata group is directly stored in the disk of the full flash storage by the second storage module; if not, expanding the B + tree metadata to obtain a target metadata group, and updating the disk of the full flash storage based on the target metadata group.
The application also provides metadata organization equipment and a computer readable storage medium, which have the corresponding effects of the metadata organization method provided by the embodiment of the application. Referring to fig. 4, fig. 4 is a schematic structural diagram of a metadata organization apparatus according to an embodiment of the present application.
The metadata organization device provided by the embodiment of the present application includes a memory 201 and a processor 202, wherein the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program stored in the memory 201:
acquiring a target metadata set;
organizing a target metadata group by adopting a B + tree structure to obtain B + tree metadata;
storing the B + tree metadata in a full flash memory;
the target metadata set is stored directly in the disk of the full flash storage.
The metadata organization device provided by the embodiment of the present application includes a memory 201 and a processor 202, wherein a computer subprogram is stored in the memory 201, and the following steps are specifically implemented when the processor 202 executes the computer subprogram stored in the memory 201: directly storing the target metadata group in a disk of full flash storage, and then extracting data of the target metadata group according to a preset metadata length to obtain corresponding secondary metadata; and storing the secondary metadata into a memory of the full flash memory.
The metadata organization device provided by the embodiment of the present application includes a memory 201 and a processor 202, wherein a computer subprogram is stored in the memory 201, and the following steps are specifically implemented when the processor 202 executes the computer subprogram stored in the memory 201: performing data extraction on the target metadata group according to the preset metadata length to obtain corresponding secondary metadata, and then judging whether a write request is received; if yes, processing the secondary metadata based on the write request, and then processing a target metadata group in the disk of the full flash storage based on the write request.
The metadata organization device provided by the embodiment of the present application includes a memory 201 and a processor 202, wherein a computer subprogram is stored in the memory 201, and the following steps are specifically implemented when the processor 202 executes the computer subprogram stored in the memory 201: performing data extraction on the target metadata group according to the preset metadata length to obtain corresponding secondary metadata, and judging whether a reading request is received or not; and if so, directly processing the secondary metadata based on the read request.
The metadata organization device provided by the embodiment of the present application includes a memory 201 and a processor 202, wherein a computer subprogram is stored in the memory 201, and the following steps are specifically implemented when the processor 202 executes the computer subprogram stored in the memory 201: performing data extraction on the target metadata group according to the preset metadata length to obtain corresponding secondary metadata, and then judging whether the data structure of the target metadata group changes or not; if yes, migrating the target metadata group in the disk of the full flash storage based on the data structure of the target metadata group, and updating secondary metadata.
The metadata organization device provided by the embodiment of the present application includes a memory 201 and a processor 202, wherein a computer subprogram is stored in the memory 201, and the following steps are specifically implemented when the processor 202 executes the computer subprogram stored in the memory 201: and after the secondary metadata is stored in the memory of the full flash storage, establishing and storing a storage mapping relation between the secondary metadata and the memory of the full flash storage.
The metadata organization device provided by the embodiment of the present application includes a memory 201 and a processor 202, wherein a computer subprogram is stored in the memory 201, and the following steps are specifically implemented when the processor 202 executes the computer subprogram stored in the memory 201: after the target metadata group is directly stored in the disk of the full flash storage, judging whether the target metadata group in the disk of the full flash storage is complete; if not, expanding the B + tree metadata to obtain a target metadata group, and updating the disk of the full flash storage based on the target metadata group.
Referring to fig. 5, another metadata organization apparatus provided in the embodiment of the present application may further include: an input port 203 connected to the processor 202, for transmitting externally input commands to the processor 202; a display unit 204 connected to the processor 202, for displaying the processing result of the processor 202 to the outside; and the communication module 205 is connected with the processor 202 and is used for realizing the communication between the metadata organization device and the outside world. The display unit 204 may be a display panel, a laser scanning display, or the like; the communication method adopted by the communication module 205 includes, but is not limited to, mobile high definition link technology (HML), Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), and wireless connection: wireless fidelity technology (WiFi), bluetooth communication technology, bluetooth low energy communication technology, ieee802.11s based communication technology.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps:
acquiring a target metadata set;
organizing a target metadata group by adopting a B + tree structure to obtain B + tree metadata;
storing the B + tree metadata in a full flash memory;
the target metadata set is stored directly in the disk of the full flash storage.
An embodiment of the present application provides a computer-readable storage medium, in which a computer subprogram is stored, where the computer subprogram, when executed by a processor, specifically implements the following steps: directly storing the target metadata group in a disk of full flash storage, and then extracting data of the target metadata group according to a preset metadata length to obtain corresponding secondary metadata; and storing the secondary metadata into a memory of the full flash memory.
An embodiment of the present application provides a computer-readable storage medium, in which a computer subprogram is stored, where the computer subprogram, when executed by a processor, specifically implements the following steps: performing data extraction on the target metadata group according to the preset metadata length to obtain corresponding secondary metadata, and then judging whether a write request is received; if yes, processing the secondary metadata based on the write request, and then processing a target metadata group in the disk of the full flash storage based on the write request.
An embodiment of the present application provides a computer-readable storage medium, in which a computer subprogram is stored, where the computer subprogram, when executed by a processor, specifically implements the following steps: performing data extraction on the target metadata group according to the preset metadata length to obtain corresponding secondary metadata, and judging whether a reading request is received or not; and if so, directly processing the secondary metadata based on the read request.
An embodiment of the present application provides a computer-readable storage medium, in which a computer subprogram is stored, where the computer subprogram, when executed by a processor, specifically implements the following steps: performing data extraction on the target metadata group according to the preset metadata length to obtain corresponding secondary metadata, and then judging whether the data structure of the target metadata group changes or not; if yes, migrating the target metadata group in the disk of the full flash storage based on the data structure of the target metadata group, and updating secondary metadata.
An embodiment of the present application provides a computer-readable storage medium, in which a computer subprogram is stored, where the computer subprogram, when executed by a processor, specifically implements the following steps: and after the secondary metadata is stored in the memory of the full flash storage, establishing and storing a storage mapping relation between the secondary metadata and the memory of the full flash storage.
An embodiment of the present application provides a computer-readable storage medium, in which a computer subprogram is stored, where the computer subprogram, when executed by a processor, specifically implements the following steps: after the target metadata group is directly stored in the disk of the full flash storage, judging whether the target metadata group in the disk of the full flash storage is complete; if not, expanding the B + tree metadata to obtain a target metadata group, and updating the disk of the full flash storage based on the target metadata group.
The computer-readable storage media to which this application relates include Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage media known in the art.
For a description of a relevant part in a metadata organization system, a device and a computer readable storage medium provided in the embodiments of the present application, refer to a detailed description of a corresponding part in a metadata organization method provided in the embodiments of the present application, and are not described herein again. In addition, parts of the above technical solutions provided in the embodiments of the present application, which are consistent with the implementation principles of corresponding technical solutions in the prior art, are not described in detail so as to avoid redundant description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (7)
1. A metadata organization method is applied to full flash storage and comprises the following steps:
acquiring a target metadata set;
organizing the target metadata group by adopting a B + tree structure to obtain B + tree metadata;
storing the B + tree metadata in a memory of the full flash storage;
directly storing the target metadata set in a disk of the full flash storage;
wherein, after the directly storing the target metadata group in the disk of the full flash storage, the method further comprises:
performing data extraction on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata;
storing the secondary metadata into the memory of the full flash memory;
after performing data extraction on the target metadata group according to a preset metadata length to obtain corresponding secondary metadata, the method further includes:
judging whether the data structure of the target metadata group changes or not;
if yes, migrating the target metadata group in the full-flash-storage disk based on the data structure of the target metadata group, and updating the secondary metadata;
after the storing the secondary metadata in the memory of the full flash storage, the method further includes:
and establishing and storing a storage mapping relation between the secondary metadata and the memory of the full flash storage.
2. The method of claim 1, wherein after the extracting the target metadata group according to the preset metadata length to obtain the corresponding secondary metadata, further comprising:
judging whether a write request is received;
and if so, processing the secondary metadata based on the write request, and then processing the target metadata group in the disk of the full flash storage based on the write request.
3. The method of claim 1, wherein after the extracting the target metadata group according to the preset metadata length to obtain the corresponding secondary metadata, further comprising:
judging whether a read request is received;
and if so, directly processing the secondary metadata based on the read request.
4. The method of any of claims 1 to 3, wherein after storing the target set of metadata directly in the disk of the full flash storage, further comprising:
judging whether the target metadata group in the disk stored in the full flash is complete or not;
and if not, expanding the B + tree metadata to obtain the target metadata group, and updating the disk of the full flash storage based on the target metadata group.
5. A metadata organization system, which is applied to full flash storage, comprises:
a first obtaining module, configured to obtain a target metadata set;
the first organizing module is used for organizing the target metadata group by adopting a B + tree structure to obtain B + tree metadata;
the first storage module is used for storing the B + tree metadata in the memory of the full flash storage;
the second storage module is used for directly storing the target metadata group in the disk of the full flash storage;
wherein, still include:
the first extraction module is used for extracting data of the target metadata group according to a preset metadata length after the target metadata group is directly stored in the full-flash-storage disk by the second storage module to obtain corresponding secondary metadata;
the third storage module is used for storing the secondary metadata into the memory of the full flash storage;
wherein, still include:
the third judgment module is used for judging whether the data structure of the target metadata group changes or not after the first extraction module performs data extraction on the target metadata group according to the preset metadata length to obtain corresponding secondary metadata; if yes, migrating the target metadata group in the full-flash-storage disk based on the data structure of the target metadata group, and updating the secondary metadata;
wherein, still include:
and the first establishing module is used for establishing and storing a storage mapping relation between the secondary metadata and the memory of the full flash storage after the third storage module stores the secondary metadata into the memory of the full flash storage.
6. A metadata organizing device, comprising:
a memory for storing a computer program;
a processor for implementing the metadata organization method as claimed in any one of claims 1 to 4 when executing said computer program.
7. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the metadata organization method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811463459.XA CN109542911B (en) | 2018-12-03 | 2018-12-03 | Metadata organization method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811463459.XA CN109542911B (en) | 2018-12-03 | 2018-12-03 | Metadata organization method, system, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109542911A CN109542911A (en) | 2019-03-29 |
| CN109542911B true CN109542911B (en) | 2021-10-29 |
Family
ID=65852620
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811463459.XA Active CN109542911B (en) | 2018-12-03 | 2018-12-03 | Metadata organization method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109542911B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110134340B (en) * | 2019-05-23 | 2020-03-06 | 苏州浪潮智能科技有限公司 | Method, device, equipment and storage medium for updating metadata |
| CN110532201B (en) * | 2019-08-23 | 2021-08-31 | 北京浪潮数据技术有限公司 | Metadata processing method and device |
| CN110502457B (en) * | 2019-08-23 | 2022-02-18 | 北京浪潮数据技术有限公司 | Metadata storage method and device |
| CN111881064A (en) * | 2020-07-24 | 2020-11-03 | 北京浪潮数据技术有限公司 | Method, device and equipment for processing access request in full flash memory storage system |
| CN113836051B (en) * | 2021-11-29 | 2022-03-22 | 苏州浪潮智能科技有限公司 | Metadata space recovery method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103294786A (en) * | 2013-05-17 | 2013-09-11 | 华中科技大学 | Metadata organization and management method and system of distributed file system |
| CN103309820A (en) * | 2013-06-28 | 2013-09-18 | 曙光信息产业(北京)有限公司 | Implementation method for disk array cache |
| CN105159616A (en) * | 2015-09-11 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Disk space management method and device |
| CN106202492A (en) * | 2016-07-19 | 2016-12-07 | 浪潮(北京)电子信息产业有限公司 | The Metadata Service optimization method of a kind of NFS and system |
| CN106708825A (en) * | 2015-07-29 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data file processing method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108228649B (en) * | 2016-12-21 | 2021-08-24 | 伊姆西Ip控股有限责任公司 | Method and apparatus for data access |
-
2018
- 2018-12-03 CN CN201811463459.XA patent/CN109542911B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103294786A (en) * | 2013-05-17 | 2013-09-11 | 华中科技大学 | Metadata organization and management method and system of distributed file system |
| CN103309820A (en) * | 2013-06-28 | 2013-09-18 | 曙光信息产业(北京)有限公司 | Implementation method for disk array cache |
| CN106708825A (en) * | 2015-07-29 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data file processing method and system |
| CN105159616A (en) * | 2015-09-11 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Disk space management method and device |
| CN106202492A (en) * | 2016-07-19 | 2016-12-07 | 浪潮(北京)电子信息产业有限公司 | The Metadata Service optimization method of a kind of NFS and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109542911A (en) | 2019-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109542911B (en) | Metadata organization method, system, equipment and computer readable storage medium | |
| US9292217B2 (en) | Logical volume space sharing | |
| KR101994021B1 (en) | File manipulation method and apparatus | |
| CN110018998B (en) | File management method and system, electronic equipment and storage medium | |
| CN107835986B (en) | Data operation method of electronic equipment and electronic equipment | |
| CN104636464B (en) | The method and apparatus for accessing file | |
| WO2014110940A1 (en) | A method, apparatus and system for storing, reading the directory index | |
| CN103647850A (en) | Data processing method, device and system of distributed version control system | |
| CN101763433B (en) | Data storage system and method | |
| CN104484460A (en) | Metadata heat degree statistical method of distributed file system | |
| CN109213450B (en) | Associated metadata deleting method, device and equipment based on flash memory array | |
| CN111090397B (en) | Data deduplication method, system, equipment and computer readable storage medium | |
| CN109697019A (en) | The method and system of data write-in based on FAT file system | |
| CN113297432B (en) | Method, processor-readable medium, and system for partition splitting and merging | |
| CN110990356A (en) | Real-time automatic capacity expansion method and system for logical mirror image | |
| CN114297196A (en) | Metadata storage method and device, electronic equipment and storage medium | |
| CN104063377A (en) | Information processing method and electronic equipment using same | |
| CN113127438B (en) | Method, apparatus, server and medium for storing data | |
| CN109542357B (en) | Command parameter assembling method, system, equipment and computer storage medium | |
| WO2014014876A1 (en) | Multi-dimensional file system | |
| CN107665210A (en) | Data processing method and device | |
| CN111104403B (en) | LSM tree data processing method, system, equipment and computer medium | |
| CN113986134B (en) | Method for storing data, method and device for reading data | |
| CN109800273A (en) | A kind of method, apparatus of data processing, computer storage medium and terminal | |
| CN111459411B (en) | Data migration method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |