JP5998517B2 - Storage system - Google Patents

Description

  The present invention relates to a storage system, and more particularly to a storage system having a duplicate storage elimination function.

  In recent years, with the development and spread of computers, various types of information have been converted into digital data. As a device for storing such digital data, there are storage devices such as a magnetic tape and a magnetic disk. Since the data to be stored increases day by day and becomes enormous, a large-capacity storage system is required. In addition, reliability is required while reducing the cost of the storage device. In addition to this, it is necessary that data can be easily retrieved later. As a result, there is a demand for a storage system that can automatically increase storage capacity and performance, eliminate duplicate storage, reduce storage costs, and have high redundancy.

  In response to such a situation, in recent years, a content address storage system has been developed as shown in Patent Document 1. In this content address storage system, data is distributed and stored in a plurality of storage devices, and the storage location where the data is stored is specified by a unique content address specified according to the content of the data.

  Specifically, in the content address storage system, block data obtained by dividing predetermined data is further divided into a plurality of fragment data, and fragment data that becomes redundant data (parity data) is added to the plurality of fragment data. Distributed and stored in a plurality of storage devices. Then, by designating the content address later, the data stored in the storage location specified by the content address, that is, fragment data can be read, and the predetermined data before division can be restored from a plurality of fragment data. it can.

  Further, the content address is generated so as to be unique according to the content of data. For this reason, if it is duplicate data, the data of the same content can be acquired by referring to the data at the same storage position. Therefore, it is not necessary to store the duplicate data separately, and duplicate recording can be eliminated and the data capacity can be reduced.

  And in recent years, in order to meet the demand for optimization of IT resource investment by companies, ASP companies and others want to provide a single deduplication storage system usage service as described above to multiple different companies. There is a need. In this case, one deduplication storage system is used by a plurality of different companies, but it is required to limit the use capacity for each user company or to charge according to the use amount. In a deduplication storage system, data is stored with duplicates removed, so the amount used here should be based on the “physical capacity”, which is the amount of resources actually consumed, and used by each user company. It is necessary to know the physical capacity that is being used.

JP 2005-235171 A

  On the other hand, in the deduplication storage system as described above, in order to increase the duplication rate, a file to be stored is divided into block data of a predetermined capacity on some basis, and deduplication is performed in units of blocks. For this reason, it is difficult to grasp the reference state of each block data for each user. That is, since the size of the block data is small and many exist, it is difficult to efficiently manage the reference state for each block in terms of performance and capacity. Therefore, there is a problem that it is difficult to grasp the used capacity for each user who uses the deduplication storage system.

  Therefore, an object of the present invention is to solve the above-described problem that it is difficult to grasp the storage capacity used for each user who uses a storage system having a deduplication function.

A storage system according to an aspect of the present invention
A storage device for storing block data obtained by dividing the file, and storing reference data for referring to the stored block data;
When the file is newly stored in the storage device, the block data obtained by dividing the file and the reference data referring to the block data are stored in the storage device and the file is newly stored The file that newly stores the data already stored in the storage device using the reference data when the block data obtained by dividing the block data has the same data content as the data already stored in the storage device Data storage control means to be referred to as the block data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
With
The data storage control means stores the reference data that refers to the block data in association with user identification information that identifies a user who uses the file that is the division source of the block data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information associated with the reference data.
The configuration is as follows.

An information processing apparatus according to another aspect of the present invention
When storing the block data obtained by dividing the file and storing the reference data referring to the stored block data, when the file is newly stored, the block data obtained by dividing the file and the block data When the reference data that refers to block data is stored in the storage device, and the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device Data storage control means for making reference to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
With
The data storage control means stores the reference data that refers to the block data in association with user identification information that identifies a user who uses the file that is the division source of the block data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information associated with the reference data.
The configuration is as follows.

Moreover, the program which is the other form of this invention is:
In the information processing device,
When storing the block data obtained by dividing the file and storing the reference data referring to the stored block data, when the file is newly stored, the block data obtained by dividing the file and the block data When the reference data that refers to block data is stored in the storage device, and the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device Data storage control means for making reference to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
And realize
The data storage control means stores the reference data that refers to the block data in association with user identification information that identifies a user who uses the file that is the division source of the block data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information associated with the reference data.
It is a program for realizing this.

In addition, an information processing method according to another aspect of the present invention includes:
The block data obtained by dividing the file when the file is newly stored in the storage device that stores the block data obtained by dividing the file and stores the reference data that refers to the stored block data. When the reference data referring to the block data is stored in the storage device, and the block data obtained by dividing the newly stored file has the same data content as the data already stored in the storage device A data storing step of referring to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management step of calculating and storing the storage capacity in the storage device in which the block data is stored for each user who uses the file that is the division source of the block data; and
Have
In the data storing step, the reference data for referring to the block data is stored in association with user identification information for identifying a user who uses the file that is a division source of the block data,
The storage capacity management step calculates a storage capacity for each user in the storage device based on the user identification information associated with the reference data.
The configuration is as follows.

  With the configuration as described above, the present invention can easily grasp the used storage capacity for each user who uses the storage system having the deduplication function.

It is a block diagram which shows the structure of the whole system in Embodiment 1 of this invention. FIG. 2 is a block diagram illustrating an outline of a configuration of a storage system disclosed in FIG. 1. FIG. 3 is a block diagram showing a configuration of a storage system disclosed in FIG. 2. FIG. 3 is an explanatory diagram for explaining an operation of the storage system disclosed in FIG. 2. FIG. 3 is an explanatory diagram for explaining an operation of the storage system disclosed in FIG. 2. FIG. 3 is a diagram illustrating an example of data stored in the storage system disclosed in FIG. 2. FIG. 3 is a diagram illustrating an example of data stored in the storage system disclosed in FIG. 2. FIG. 3 is a diagram illustrating an example of data stored in the storage system disclosed in FIG. 2. 3 is a flowchart showing the operation of the storage system disclosed in FIG. 2. 3 is a flowchart showing the operation of the storage system disclosed in FIG. 2. It is a block diagram which shows the structure of the storage system in Embodiment 2 of this invention. It is a figure which shows an example of the data memorize | stored in the storage system disclosed in FIG. 12 is a flowchart showing the operation of the storage system disclosed in FIG. 12 is a flowchart showing the operation of the storage system disclosed in FIG. 12 is a flowchart showing the operation of the storage system disclosed in FIG. 12 is a flowchart showing the operation of the storage system disclosed in FIG. It is a functional block diagram which shows the structure of the storage system in attachment 1 of this invention.

<Embodiment 1>
A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing the configuration of the entire system. FIG. 2 is a block diagram showing an outline of the storage system, and FIG. 3 is a block diagram showing a detailed configuration of the storage system. 4 to 5 are explanatory diagrams for explaining the operation of the storage system, and FIGS. 6 to 8 are diagrams illustrating an example of data stored in the storage system. 9 to 10 are flowcharts showing the operation of the storage system.

  Here, in the present embodiment, a case will be described in which the storage system is configured by connecting a plurality of server computers. However, the storage system according to the present invention is not limited to being configured by a plurality of computers, and may be configured by a single computer (information processing apparatus).

  As shown in FIG. 1, a storage system 10 according to the present invention is connected to a backup system 11 that controls backup processing via a network N. Then, the backup system 11 acquires the backup target data stored in the backup target device 12 connected via the network N and requests the storage system 10 to store it. Thereby, the storage system 10 stores the backup target data requested to be stored for backup. The storage system 10 according to the present embodiment is described by way of example in which backup target data is stored. However, this is an example, and any data may be stored.

  As shown in FIG. 2, the storage system 10 according to this embodiment has a configuration in which a plurality of server computers are connected. Specifically, the storage system 10 includes an accelerator node 20 that is a server computer that controls storage and reproduction operations in the storage system 10 itself, and a storage node 30 that is a server computer including a storage device that stores data. Yes. Note that the number of accelerator nodes 20 and the number of storage nodes 30 are not limited to those shown in FIG. 2, and more nodes 20 and 30 may be connected.

  Furthermore, the storage system 10 according to the present embodiment divides and makes the data redundant, stores the data in a plurality of storage devices, and stores the data by a unique content address set according to the content of the stored data. It is a content address storage system for specifying a stored location. This content address storage system will be described in detail later.

  FIG. 3 shows a detailed configuration of the storage system 10. Here, the storage system 10 will be described as being configured as one system without distinguishing the accelerator node 20 and the storage node 30 described above.

  First, as shown in FIG. 3, the storage system 10 first performs operations such as a file operation input unit 1 configured by a network interface and the CPU (Central Processing Unit) provided in the accelerator node 20 and the storage node 30. And a data processing device 2 constructed by incorporating a program into the device. The data processing apparatus 2 includes a file operation execution unit 21 and a used physical capacity management unit 22.

  In addition, the storage system 10 mainly includes an FS structure storage unit 31, a block ID list storage unit 32, a block related data storage unit 33, and block data storage, which are configured in the storage device 3 provided in the storage node 30. Unit 34 and a used physical capacity storage unit 35. Hereinafter, each configuration and operation of the storage system 10 will be described in detail.

  The file operation input unit 1 receives the backup target data transmitted from the backup target device 12 or the like via the backup system 11 and passes it to the file operation execution unit 21.

  The file operation execution unit 21 (data storage control means) receives the backup target data transmitted from the backup target device 12 via the file operation input unit 1 as described above, and stores the data in the storage device 3. Control to store. Specifically, the file operation execution unit 21 distributes backup target data to a storage device constituted by a plurality of storage nodes 30 and disks, and stores them while eliminating duplication. In addition, the file operation execution unit 21 performs a process of reading the distributed and stored data. Here, an example of the distributed storage process by the file operation execution unit 21 will be described with reference to FIGS.

  First, the basic distributed storage processing operation by the file operation execution unit 21 will be described with reference to FIGS. 4 and 5. FIG. First, when the file operation execution unit 21 receives an input of the data A constituting the file that is the backup target data (arrow Y1 in FIGS. 4 and 5), as shown by the arrow Y2 in FIGS. Data A is divided into block data D having a predetermined capacity (for example, 64 KB). Based on the data content of the block data D, a unique hash value H representing the data content is calculated (arrow Y3 in FIG. 5). For example, the hash value H is calculated from the data content of the block data D using a preset hash function.

  Subsequently, the file operation execution unit 21 performs deduplication processing using the hash value H of the block data D in order to eliminate duplicate recording of the block data D having the same contents. Specifically, first, the block data D that has already been stored is registered in association with the hash value H of the block data D and the content address CA representing the storage position, as will be described later. If the hash value H of the block data D already exists, it can be determined that the same block data D has already been stored. In this case, the content address CA associated with the registered hash value H that matches the hash value H of the block data D before storage is acquired. Then, the content address CA is referred to as the content address CA of the block data D requested to be written. As a result, the already stored data referred to by the content address CA is used as the block data D requested to be written, and there is no need to store the block data D related to the write request.

  Further, when it is determined that the block data D relating to the write request is not yet stored, the file operation execution unit 21 performs a process of storing the block data D. Specifically, first, the block data D is divided into a plurality of pieces of fragment data (divided data) having a predetermined capacity. For example, as shown by symbols D1 to D9 in FIG. 4, the data is divided into nine fragment data (divided data 41). Further, the storage system 10 generates redundant data so that the original block data D can be restored even if some of the divided fragment data is missing, and adds it to the divided fragment data 41. . For example, three pieces of fragment data (redundant data 42) are added as indicated by reference numerals D10 to D12 in FIG. As a result, a data set 40 composed of 12 pieces of fragment data composed of nine divided data 41 and three redundant data 42 is generated (arrow Y4 in FIG. 5).

  Then, the file operation execution unit 21 stores each fragment data generated as described above in the block data storage unit 34. For example, as shown in FIG. 4, when 12 pieces of fragment data D1 to D12 are generated, each of the data storage areas formed in the block data storage unit 34 constituted by a plurality of storage nodes 30 is shown. Each of the fragment data D1 to D12 is stored in the component C one by one and distributedly stored (see arrow Y5 in FIG. 5).

  When the fragment data is stored as described above, the storage system 10 determines the storage position of the fragment data D1 to D12, that is, the storage position of the block data D restored by the fragment data D1 to D12. A content address CA to represent is generated. At this time, the content address CA includes, for example, a part of the hash value H (short hash) calculated based on the contents of the stored block data D (for example, the top 8B (bytes) of the hash value H) and the logical storage position. And information representing the information is generated. The content address CA is associated with the identification information of each block data constituting the file that is the backup target data and the content address CA in the accelerator node 20 that manages the file system in the storage system 10. The file operation execution unit 21 manages the file system. Note that the block data identification information itself may be a content address CA that refers to the block data.

  In addition, when the file operation execution unit 21 receives a file read request, the file operation execution unit 21 specifies the storage location specified by the content address CA corresponding to the requested file, and stores each of the storage locations specified in the specified storage location. The fragment data can be read as the data requested to be read. As described above, the storage system 10 has a function of reading and writing data.

  Here, the process of storing data in the storage device 3 and managing the file system by the file operation execution unit 21 in the present embodiment will be described in more detail with reference to FIG.

  When a file is newly created, the file operation execution unit 21 first stores a directory structure indicating the existence of the file 31a in the file system in the FS structure storage unit 31. Accordingly, a block ID list is created by creating a block ID list in which an area (block ID entry) for storing each block ID 32a (block identification data) for identifying each block data when the file 31a is divided into a plurality of blocks is formed. The block ID list is stored in the storage unit 32 and associated with the file 31 a stored in the FS structure storage unit 31.

  Subsequently, the file operation execution unit 21 divides the data of the file 31a into a plurality of block data, and calculates a block ID for identifying each block data. At this time, for example, a hash value of block data is used as the block ID. Then, the file operation execution unit 21 determines whether or not the block data has already been stored in the block data storage unit 34 using, for example, the calculated hash value and the information in the block related data storage unit 33. Investigate. In the block related data storage unit 33, as will be described later, a hash value for determining the data content of the block data is stored.

  When the block data is not yet stored in the storage system 10, the file operation execution unit 21 stores the block data 34a in the block data storage unit 34 and associates the block data 34a with reference to the block data 34a. The block related data 33 a to be stored is stored in the block related data storage unit 33. The block related data 33a stores information on the associated block data 34a, for example, size information indicating the data size of the block data 34a, and a hash value indicating the data content of the block data 34a. Then, the file operation execution unit 21 stores the block ID 32a calculated as described above in the block ID list in the block ID list storage unit 32 corresponding to the newly stored file 31a. At this time, the block ID 32a is stored in association with the block related data 33a so as to refer to the block related data 33a associated with the corresponding stored block data 34a. The association between the block ID 32a and the block related data 33a may be associated with a content address referring to the block related data 33a to the block ID 32a, or a content address referring to the block related data 33a may be used as the block ID 32a itself. .

  Accordingly, when reading the file 31a, the block ID list of the file 31a is read by referring to the FS structure storage unit 31, and the block related data 33a referred to by the block ID 32a included in the list is referred to. The block data 34a constituting the file 31a can be read. Thus, the block ID 32a (block identification data) and the block-related data 33a function as reference data for referring to the stored block data 34a. The block ID 32a and the block-related data 33a may be composed of one piece of data (reference data).

  In addition, as described above, the file operation execution unit 21 stores the directory structure and the block ID list of the newly stored file 34a, and then the block data constituting the newly stored file 34a has already been stored in the storage system 10. If it is determined that it is stored, a process for referring to the already stored block data 34a is performed. That is, the block ID 32a of the block data to be newly stored is calculated and stored in the block ID list, and the block ID 32a is referred to the block related data 33a associated with the block data 34a already stored. It is stored in association with the related data 33a. As a result, the block data is referred to from different files as shown in FIG. 6, for example, and it is possible to exclude the same block data 34a from being stored repeatedly.

  When deleting a file, the file operation execution unit 21 first refers to the FS structure storage unit 31 to obtain the position of the block ID list corresponding to the file 31a and refers to the block ID list storage unit 32. Then, the block ID 32a of the block data to be deleted is acquired. Subsequently, the file operation execution unit 21 deletes the block ID 32a from the block ID list. Then, when there is no longer any reference to the block data to be deleted, the file operation execution unit 21 deletes the block related data 33a in the block related data storage unit 33 and the block data 34a in the block data storage unit 34. . In addition, when the file itself is deleted, the file operation execution unit 21 also updates the FS structure storage unit 31 to delete the existence of the file 31a, and the corresponding block ID list in the block ID list storage unit 32 is also updated. delete.

  Further, when rewriting a file, the file operation execution unit 21 processes as a combination of deletion of old data and writing of new data as described above.

  Further, the file operation execution unit 21 calculates the used storage capacity for each user who uses the file 31 a stored in the storage device 3 when writing the file in cooperation with the used physical capacity management unit 22. The processing to do is performed as follows. First, an outline of such processing will be described with reference to FIG. Note that the processing described below may be executed when a file is stored, or may be executed at an arbitrary timing.

  First, when storing the file 31a, the file operation execution unit 21 stores a user ID (for identifying a user who uses the file 31a to be stored in the block ID list in the block ID list storage unit 32 corresponding to the file 31a). User identification information) is stored in association with each other. That is, the user ID of the user who uses the file 31a that is the division source of each block data 34a is associated with the block ID 32a that identifies each block data 34a constituting the file 31a. In the example illustrated in FIG. 7, a user ID such as “user1” is associated with a block ID list including a plurality of block ID groups corresponding to the file 31a.

  Further, when a plurality of files used by the same user refer to the same block data, the file operation execution unit 21 assigns each block ID for identifying each block data constituting the file to “same user”. Associate as a "chain". Specifically, the file operation execution unit 21 sets another block ID of the same user who refers to the same block data, that is, the block related data 33 a associated with the block data, in each block ID entry in the block ID list storage unit 32. Store a pointer to the entry. As a result, as indicated by the dotted lines between file1A, file1B, and file1C in FIG. 7, the block ID group of the same user “user1” referring to the same block data is the same user chain (same user chain) for the user “user1”. Associated. At this time, as indicated by the dotted line between file2A and file2B in FIG. 7, the block ID group of the same user “user2” referring to the same block data is also associated as the same user chain (same user chain) in the user “user2”. . That is, as shown in the direction of arrow Y11 in FIG. 7, the block ID group is associated for each user.

  In addition, when a plurality of files used by different users refer to the same block data, the file operation execution unit 21 assigns each block ID for identifying each block data constituting the file to “another user chain”. As ”. Specifically, as described above, the file operation execution unit 21 uses one block ID in each user chain between the same user chains each including a block ID group in which block IDs are associated with each user. Are associated with each other to form another user chain. For example, in the example of FIG. 7, another block of file2A and file2B that refers to the block related data 33a associated with the same block data in the first block ID entry of the user chain of the user “user1” of file1A, file1B, and file1C A pointer to the first block ID entry in the user chain of the user “user2” is stored. That is, as shown in the arrow Y12 direction, block ID groups between different users are associated.

  Furthermore, the file operation execution unit 21 refers to the block related data 33a in the block related data storage unit 33, and the block ID of the head of any one of the same user chains referring to the block data referred to by the block related data 33a. A pointer to the entry is associated and stored. For example, in the example of FIG. 7, a pointer to only the block ID of file1A used by the user “user1” is stored in the block related data 33a of block data referenced from a plurality of files.

  Through the above processing, a group of block IDs that refer to the same block data referenced in file1A, file1B, file1C, file2A, and file2B are associated with each other via the above-described user chain and another user chain. (Same block chain).

  Here, in the above-described user chain and another user chain, a pointer to a block ID entry that associates block IDs is expressed by a combination of the storage position of the block ID list and the position of the entry in the list. In the example of FIG. 7 described above, the block IDs in the same user chain and another user chain are associated with each other by referring to the pointers in both directions, but this association method is an example, and the block IDs are associated with each other. The association method is not limited to the above method.

  Then, using the above-described user chain and another user chain, the used physical capacity management unit 22 (storage capacity management means) determines the storage capacity in which each user physically uses the storage device 3 as the user. Calculate every time. Specifically, the used physical capacity management unit 22 first checks whether or not each user refers to block data. Then, the used physical capacity management unit 22 calculates the storage capacity for each user by summing the values of the block data size information included in the block related data 33a referred to by the same user, as shown in FIG. This is stored in the used physical capacity storage unit 35.

  At this time, the used physical capacity storage unit 35 stores a limit value of the used storage capacity preset for each user. For this reason, the used physical capacity management unit 22 compares the used storage capacity calculated for each user with the stored limit value, and when the used storage capacity exceeds the limit value, Control writing so that writing errors occur.

  Here, in the above description, the used physical capacity management unit 22 calculates the used storage capacity for each user by summing only the sizes of the block data. However, the block-related data or block ID entry that refers to the block data is further calculated. The used storage capacity for each user may be calculated by adding the storage capacity. In the above description, the used physical capacity management unit 22 compares the used storage capacity with the limit value, but may simply perform a process of calculating the used storage capacity. The calculation of the used physical capacity by the used capacity management unit 22 may be executed when a file is written, or may be executed at a preset timing.

  Next, the operation of the storage system 10 described above, particularly the operation when writing a file will be described with reference to FIGS. In the following, detailed descriptions of some operations such as dividing a file into block data and dividing and storing into fragment data are omitted.

  First, it is determined whether block data that overlaps block data obtained by dividing a file to be written already exists in the storage device 3 (step A10). When the block data to be written does not exist in the storage device 3 (No in step A10), the user who uses the file to be written is specified, and the current used physical capacity and the limit value of the user are used. Obtained from the capacity storage unit 35. Then, the size information of the block data to be written is added to the current used physical capacity of the user, and it is checked whether “current used capacity + block size” exceeds the limit value of the used physical capacity of the user. If it exceeds (Yes in Step A11), a write error is assumed (Step A16). If not exceeded (No in step A11), the block data to be written is stored in the block data storage unit 34 (step A12), and the size information of the block data stored in the current used physical capacity of the user is added (step S12). A13), and stored in the used physical capacity storage unit 35. Further, a pointer to the block ID entry of the block data written this time is recorded in the block related data (step A14), and the writing is successful (step A15).

  In step A10, when block data that overlaps the block data to be written already exists in the storage device 3 (Yes in step A10), block related data associated with the already existing block data. The block ID entry pointed to by the pointer is referred to, and another user chain is traced from there to check whether there is already a reference from the user writing this time (steps A20 and A21). When there is no reference (No in Step A21), as described above, it is checked whether the “current use capacity + block size” of the user exceeds the limit value of the use capacity of the user (Step A22). If it exceeds (Yes in Step A22), a write error is assumed (Step A16). If not exceeded (No in step A22), the size information of the block data stored in the current used physical capacity of the user is added (step A23) and stored in the used physical capacity storage unit 35. Further, the block ID entry of the block data written this time is added to another user chain (step A24), and the writing is successful (step A15). When there is a reference at step A21 (Yes at step A21), the block ID entry of the block data written this time is added to the same user chain (step A25), and the writing is successful (step A15).

  Next, the operation when the user deletes a file from the storage device 3 will be described with reference to the flowchart of FIG. First, for each block data corresponding to the file to be deleted, it is checked whether there is an entry other than the block ID entry to be deleted this time in the same user chain referring to the block data (step B10). If it does not exist (No in step B11), the size information value of the block data to be deleted is reduced from the used physical capacity of the user (step B12), and the block ID entry of the block data to be deleted this time is removed from another user chain (step B13). If it exists (Yes in step B11), the block ID entry of the block data to be deleted this time is removed from the user chain (step B14). If the removed block ID entry is the head entry of the same user chain (Yes in step B15), the preceding or succeeding block ID entries or blocks are set so that the head of the remaining block ID entry enters another user chain. The pointer of related data is updated (step B16).

  As described above, according to the storage system of this embodiment, the processing for managing the used physical capacity for each user can be performed efficiently. In particular, since there is little duplication of data between different users (companies), the length of the above-mentioned other user chain is shortened (typically, only one user refers to and the length is 1). . For this reason, the process of checking whether or not there is a reference from the same user necessary for managing the used physical capacity is made efficient, and it becomes easy to grasp and manage the used physical capacity for each user.

<Embodiment 2>
Next, a second embodiment of the present invention will be described with reference to FIGS. FIG. 11 is a block diagram showing the configuration of the storage system in this embodiment, and FIG. 12 is a diagram showing an example of data stored in the storage system. 13 to 16 are bath charts showing the operation of the storage system.

  The storage system according to the present embodiment has substantially the same configuration as that of the first embodiment described above. In addition, this embodiment includes a reference bitmap storage unit 36 as shown in FIG. Accordingly, in this embodiment, the file operation execution unit 21 and the used physical capacity management unit 22 included in the data processing device 2 have the following functions.

  The file operation execution unit 21 in the present embodiment cooperates with the used physical capacity management unit 22 to store the storage device for each user who uses the file stored in the storage device 3 when writing the file. Processing for calculating the capacity is performed as follows. First, an outline of such processing will be described with reference to FIG. Note that the processing described below may be executed when a file is stored, or may be executed at an arbitrary timing.

  First, when storing the file 31a, the file operation execution unit 21 sets, for each block data constituting the file 31a, a reference bitmap 36a indicating whether or not the user has referred to the block data as block data. It is stored in the reference bitmap storage unit 36 in association with the associated block-related data. For example, as shown in FIG. 12, the reference bitmap 36a is a bitmap having a plurality of bits for each user, and each bit is set with information indicating the presence / absence of each user's reference to the associated block data. Information area. As an example, “1” is set in the bit corresponding to the user who refers to the associated block data in the reference bitmap 36a. Therefore, when block data is referenced by a plurality of users, “1” is set to a plurality of bits corresponding to each user in the reference bitmap 36a associated with the block data. . As described above, each bit of the reference bitmap 36a functions as user identification information for identifying a user who is referring to the associated block data.

  The reference bitmap 36a is stored in the reference bitmap storage unit 36a so that bitmaps having the same data content do not overlap. Therefore, even when different block data are referred to, the reference bitmaps 36a are the same when the referring users are completely the same, and a plurality of block related data respectively associated with the plurality of block data are assigned one The reference bitmap 36a will be associated. At this time, the block related data in the block related data storage unit 33 stores a pointer to the reference bitmap in the associated reference bitmap storage unit 36. Note that a conversion function for acquiring a pointer to the reference bitmap from the reference bitmap is required, but it can be realized using, for example, a hash.

  Further, the used physical capacity management unit 22 calculates, for each user, a storage capacity in which each user physically uses the storage device 3 using the reference bitmap 36a described above. Specifically, the used physical capacity management unit 22 refers to each block data according to the position of the bit in which “1” is set in the reference bitmap 36a associated with each block-related data 33a. While grasping the user, the storage capacity for each user is calculated using the value of the size information included in the block related data 33a. Further, as shown in FIG. 8, the used physical capacity management unit 22 stores the calculated storage capacity for each user in the used physical capacity storage unit 35 and limits the preset storage capacity for each user. Compare with the value. When the used storage capacity exceeds the limit value, the writing from the user is limited and control is performed so that a writing error occurs.

  The file operation execution unit 21 and the used physical capacity management unit 22 also have a function of deleting the reference bitmap 36 a that is no longer used in the reference bitmap storage unit 36. Further, the file operation execution unit 21 and the used physical capacity management unit 22 execute a deletion reflection batch process according to a user instruction or a set schedule to reflect the deletion of the block data and store the block related data. The pointer to the reference bitmap 36a in the unit 33, the reference bitmap 36a in the reference bitmap storage unit 36, and the used physical capacity in the used physical capacity storage unit 35 are updated to the latest state.

  Here, in the above description, the used physical capacity management unit 22 calculates the used storage capacity for each user by summing only the sizes of the block data. However, the block-related data or block ID entry that refers to the block data is further calculated. The used storage capacity for each user may be calculated by adding the storage capacity. In the above description, the used physical capacity management unit 22 compares the used storage capacity with the limit value, but may simply perform a process of calculating the used storage capacity. The calculation of the used physical capacity by the used capacity management unit 22 may be executed when a file is written, or may be executed at a preset timing.

  Next, the operation of the storage system 10 described above, particularly the operation when writing a file will be described with reference to FIGS. In the following, detailed descriptions of some operations such as dividing a file into block data and dividing and storing into fragment data are omitted.

  First, it is determined whether block data that overlaps block data obtained by dividing a file to be written already exists in the storage device 3 (step C10). When the block data to be written does not exist in the storage device 3 (No in Step C10), the user who uses the file to be written is specified, and the current used physical capacity and the limit value of the user are used. Obtained from the capacity storage unit 35. Then, the size information of the block data to be written is added to the current used physical capacity of the user to check whether “current used capacity + block size” exceeds the limit value of the used capacity of the user. If it exceeds (Yes in Step C11), a write error is determined (Step C20). If it does not exceed (No in step C11), the block data to be written is stored in the block data storage unit 34 (step C12), and a reference bitmap in which “1” is set to the bit corresponding only to the user who is currently writing 36a is created (step C13), and a pointer to the same reference bitmap as that in the reference bitmap storage unit 36 is obtained (step C14). If the pointer cannot be obtained, that is, if the same reference bitmap does not exist (No in step C15), the reference bitmap 36a is stored in the reference bitmap storage unit 36, and the pointer to the reference bitmap 36a is stored. Is acquired (step C16). Then, the obtained pointer is stored in the block-related data (step C17), the size information of the block data is added to the used physical capacity of the user who is writing (step C18), and the writing is successful (step C19).

  If the same reference bitmap exists at step C15 (Yes at step C15), a pointer to the existing reference bitmap 36a is stored in the block-related data (step C17). Then, the size information of the block data is added to the used physical capacity of the user who is writing (step C18), and the writing is successful (step C19).

  On the other hand, if the block data to be written already exists in the storage device 3 in step C10 (Yes in step C10), the reference is made using the pointer stored in the block related data 33a referring to the block data. The corresponding reference bitmap 36a is acquired from the bitmap storage unit 36 (step C30), and it is checked whether the user currently writing is already included in the reference bitmap 36a (step C31). If it is included (Yes in Step C31), it is assumed that the writing has succeeded (Step C19). If not included (No in step C31), as described above, it is checked whether the “current used capacity + block size” of the user exceeds the limit value of the used physical capacity of the user (step C32). If it exceeds (Yes in Step A32), a write error is determined (Step C20). If not exceeded (No in step A32), the user who is currently writing is added to the reference bitmap (step C33), and a pointer to the same bitmap in the bitmap storage unit 36 is obtained as described above (step S33). Step C14). When the pointer could not be obtained, that is, when the same reference bitmap does not exist (No in Step C15), the reference bitmap 36a is stored in the reference bitmap storage unit 36, and the pointer to the reference bitmap 36a is stored. Is acquired (step C16). Then, the obtained pointer is stored in the block-related data (step C17), the size information of the block data is added to the used physical capacity of the user who is writing (step C18), and the writing is successful (step C19).

  When the user deletes data, the reference bitmap and the used physical capacity are not processed at that time. However, the following processing is performed in the deletion reflection batch processing executed according to a user instruction or a set schedule.

  First, following the directory structure of all file systems, the following processing is performed for all files (step D10) and for all block data referenced by each file (step D11).

  It is determined whether the block data to be processed is the first block found (step D12). If it is the first block data found (step D12), a temporary reference bitmap is associated with the block data (step D13). The temporary reference bitmap is set to “1” only for the user who uses the reference source file (step D14). If the block data is not found for the first time (No in step D12), the user who uses the reference source file is added to the temporary reference bitmap already associated with the block data (step D15).

  Then, after the loop processing in step D10 described above, for all the stored block data (step D20), the corresponding reference bitmap from the reference bitmap storage unit 36 is used using the pointer stored in the block related data. (Step D21), and for each user (step D22), the following processing is performed. If the user is included in the reference bitmap (Yes in step D23) and not included in the temporary bitmap (No in step D24), the block size is subtracted from the physical capacity used by the user (step S24). D25). After the loop of step D22, if the reference bitmap is different from the temporary bitmap (Yes in step D26), a pointer to the same reference bitmap as the temporary bitmap is acquired from the reference bitmap storage unit 36, or If the same reference bitmap as the temporary bitmap does not exist, a pointer to the temporary bitmap is stored in the reference bitmap storage unit 36 to obtain the pointer (step D27), and the pointer is associated with the block-related data. Is stored (step D28). Finally, the reference bitmap that is no longer referenced in the reference bitmap storage unit 36 is deleted (step D29).

  In the deletion reflection batch processing described above, the used capacity is subtracted when there is no more reference to the block data. However, the temporary used capacity for each user is set to zero at the beginning of the batch processing, and the reference is changed. A method may be used in which the sizes of the block data are added when they remain, and finally stored in the used physical capacity storage unit 35.

  As described above, according to the storage system of this embodiment, the processing for managing the used physical capacity for each user can be performed efficiently. In particular, since there is little duplication of data between different users (businesses), the patterns that can be taken by the reference bitmap are reduced, that is, the same patterns often appear. For this reason, by setting the size of the pointer to the reference bitmap smaller than the size of the reference bitmap, the amount of data can be reduced compared to the case where each block data has a bitmap. Therefore, the amount of data necessary for managing the used physical capacity can be greatly reduced, and the used physical capacity for each user can be easily grasped and managed.

<Appendix>
Part or all of the above-described embodiment can be described as in the following supplementary notes. The outline of the configuration of the storage system (see FIG. 17), information processing apparatus, program, and information processing method in the present invention will be described below. However, the present invention is not limited to the following configuration.

(Appendix 1)
A storage device 110 for storing block data obtained by dividing the file and storing reference data for referring to the stored block data;
When the file is newly stored in the storage device, the block data obtained by dividing the file and the reference data referring to the block data are stored in the storage device and the file is newly stored The file that newly stores the data already stored in the storage device using the reference data when the block data obtained by dividing the block data has the same data content as the data already stored in the storage device Data storage control means 100 to be referred to as the block data of
A storage capacity management unit 102 that calculates and stores the storage capacity in the storage device in which the block data is stored for each user who uses the file that is the division source of the block data;
With
The data storage control unit 101 associates and stores user identification information for identifying a user who uses the file, which is a division source of the block data, with the reference data that refers to the block data,
The storage capacity management unit 102 calculates a storage capacity for each user in the storage device based on the user identification information associated with the reference data.
Storage system 100.

(Appendix 2)
The storage system according to attachment 1, wherein
The data storage control means identifies, as the reference data, block identification data that identifies the block data obtained by dividing the file to be newly stored and is associated with the user identification information of a user who uses the file, and the block Block-related data including size information indicating the data size of the referenced block data by referring to the block data stored in the storage device and referenced by the identification data is stored in the storage device, and When the block data obtained by dividing the file to be stored in the file has the same data content as the data already stored in the storage device, the block identification data for identifying the block data is already stored in the storage device. Refer to the block related data that refers to the data being ,
The storage capacity management unit is configured for each user in the storage device based on the user identification information associated with the block identification data and the size information included in the block related data referred to by the block identification data. Calculate the storage capacity of
Storage system.

(Appendix 3)
The storage system according to appendix 2,
The data storage control means associates and stores a group of the block identification data referring to the same block related data as the same block chain,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the information of the same block chain.
Storage system.

(Appendix 4)
The storage system according to attachment 3, wherein
The data storage control means stores a group of the block identification data associated with the same user identification information in the group of the block identification data associated as the same block chain in association with each other as the same user chain. ,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the same block chain information and the same user chain information.
Storage system.

(Appendix 5)
The storage system according to appendix 4, wherein
The data storage control means is configured to connect the block identification data of each group associated as the same user chain different from each other in the group of block identification data associated as the same block chain. The block identification data is associated with each other among the identification data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the same block chain information and the same user chain information.
Storage system.

(Appendix 6)
The storage system according to attachment 1, wherein
The data storage control means, as the reference data, block identification data for identifying the block data obtained by dividing the file to be newly stored, and the block identification data referred to and stored in the storage device Block-related data including block data and size information indicating a data size of the block data to be referred to and user identification information of a user who uses the file that is a division source of the block data; When the block data obtained by dividing the file to be newly stored is the same data content as the data already stored in the storage device, the block identification data for identifying the block data Related to the block referring to data already stored in the storage device To see over data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block related data.
Storage system.

(Appendix 7)
The storage system according to appendix 6, wherein
The data storage control means is the information corresponding to a user who uses the file that is a division source of the block data referred to by the block related data with respect to the user identification information in which an information area for each user is formed. Set predetermined information in an area, store the user identification information in association with the block-related data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block related data.
Storage system.

(Appendix 8)
The storage system according to appendix 7,
The data storage control means uses, as the information area for each user, the file serving as a division source of the block data referred to by the block related data for the user identification information having a bit corresponding to each user. A predetermined information is set in the bit corresponding to a user, and the user identification information is stored in association with the block related data;
The storage capacity management means is based on the information stored in each bit of the user identification information associated with the block related data and the size information associated with the block related data. Calculate the storage capacity for each user at
Storage system.

(Appendix 9)
When storing the block data obtained by dividing the file and storing the reference data referring to the stored block data, when the file is newly stored, the block data obtained by dividing the file and the block data When the reference data that refers to block data is stored in the storage device, and the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device Data storage control means for making reference to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
With
The data storage control means stores the reference data that refers to the block data in association with user identification information that identifies a user who uses the file that is the division source of the block data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information associated with the reference data.
Information processing device.

(Appendix 10)
An information processing apparatus according to appendix 9, wherein
The data storage control means identifies, as the reference data, block identification data that identifies the block data obtained by dividing the file to be newly stored and is associated with the user identification information of a user who uses the file, and the block Block-related data including size information indicating the data size of the referenced block data by referring to the block data stored in the storage device and referenced by the identification data is stored in the storage device, and When the block data obtained by dividing the file to be stored in the file has the same data content as the data already stored in the storage device, the block identification data for identifying the block data is already stored in the storage device. Refer to the block related data that refers to the data being ,
The storage capacity management unit is configured for each user in the storage device based on the user identification information associated with the block identification data and the size information included in the block related data referred to by the block identification data. Calculate the storage capacity of
Information processing device.

(Appendix 11)
An information processing apparatus according to appendix 9, wherein
The data storage control means, as the reference data, block identification data for identifying the block data obtained by dividing the file to be newly stored, and the block identification data referred to and stored in the storage device Block-related data including block data and size information indicating a data size of the block data to be referred to and user identification information of a user who uses the file that is a division source of the block data; When the block data obtained by dividing the file to be newly stored is the same data content as the data already stored in the storage device, the block identification data for identifying the block data Related to the block referring to data already stored in the storage device To see over data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block related data.
Information processing device.

(Appendix 12)
In the information processing device,
When storing the block data obtained by dividing the file and storing the reference data referring to the stored block data, when the file is newly stored, the block data obtained by dividing the file and the block data When the reference data that refers to block data is stored in the storage device, and the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device Data storage control means for making reference to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
And realize
The data storage control means stores the reference data that refers to the block data in association with user identification information that identifies a user who uses the file that is the division source of the block data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information associated with the reference data.
A program to make things happen.

(Appendix 13)
The program according to attachment 12, wherein
The data storage control means identifies, as the reference data, block identification data that identifies the block data obtained by dividing the file to be newly stored and is associated with the user identification information of a user who uses the file, and the block Block-related data including size information indicating the data size of the referenced block data by referring to the block data stored in the storage device and referenced by the identification data is stored in the storage device, and When the block data obtained by dividing the file to be stored in the file has the same data content as the data already stored in the storage device, the block identification data for identifying the block data is already stored in the storage device. Refer to the block related data that refers to the data being ,
The storage capacity management unit is configured for each user in the storage device based on the user identification information associated with the block identification data and the size information included in the block related data referred to by the block identification data. Calculate the storage capacity of
program.

(Appendix 14)
The program according to attachment 12, wherein
The data storage control means, as the reference data, block identification data for identifying the block data obtained by dividing the file to be newly stored, and the block identification data referred to and stored in the storage device Block-related data including block data and size information indicating a data size of the block data to be referred to and user identification information of a user who uses the file that is a division source of the block data; When the block data obtained by dividing the file to be newly stored is the same data content as the data already stored in the storage device, the block identification data for identifying the block data Related to the block referring to data already stored in the storage device To see over data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block related data.
program.

(Appendix 15)
The block data obtained by dividing the file when the file is newly stored in the storage device that stores the block data obtained by dividing the file and stores the reference data that refers to the stored block data. When the reference data referring to the block data is stored in the storage device, and the block data obtained by dividing the newly stored file has the same data content as the data already stored in the storage device A data storing step of referring to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management step of calculating and storing the storage capacity in the storage device in which the block data is stored for each user who uses the file that is the division source of the block data; and
Have
In the data storing step, the reference data for referring to the block data is stored in association with user identification information for identifying a user who uses the file that is a division source of the block data,
The storage capacity management step calculates a storage capacity for each user in the storage device based on the user identification information associated with the reference data.
Information processing method.

(Appendix 16)
An information processing method according to attachment 15, wherein
The data storing step includes identifying block data obtained by dividing the file to be newly stored as the reference data and block identification data associated with the user identification information of a user who uses the file, and the block identification Block related data including size information indicating the data size of the block data referred to by referring to the block data stored in the storage device and referred to by the data is stored in the storage device, and newly When the block data obtained by dividing the file to be stored has the same data content as the data already stored in the storage device, the block identification data for identifying the block data is already stored in the storage device. The block related data referring to the data being referred to,
The storage capacity management step is performed for each user in the storage device based on the user identification information associated with the block identification data and the size information included in the block related data referred to by the block identification data. Calculate the storage capacity of
Information processing method.

(Appendix 17)
An information processing method according to attachment 15, wherein
The data storage step includes, as the reference data, block identification data for identifying the block data obtained by dividing the file to be newly stored, and the block that is referred to by the block identification data and stored in the storage device Block related data including size information indicating the data size of the block data to be referred to and the user identification information of the user who uses the file that is the division source of the block data in the storage device. When the block data obtained by dividing the file to be stored and newly stored has the same data content as the data already stored in the storage device, the block identification data for identifying the block data stores the block data. The block related data referring to data already stored in the device. To see,
The storage capacity management step calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block-related data.
Information processing method.

  Note that the above-described program is stored in a storage device or recorded on a computer-readable recording medium. For example, the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

  Although the present invention has been described with reference to the above-described embodiment and the like, the present invention is not limited to the above-described embodiment. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

10 Storage System 11 Backup System 12 Backup Target Device 20 Accelerator Node 30 Storage Node 1 File Operation Input Unit 2 Data Processing Device 21 File Operation Execution Unit 22 Used Physical Capacity Management Unit 3 Storage Device 31 FS Structure Storage Unit 32 Block ID List Storage Unit 33 Block-related data storage unit 34 Block data storage unit 35 Used physical capacity storage unit 36 Reference bitmap storage unit 31a File 32a Block ID
33a Block-related data 34a Block data 36a Reference bitmap

Claims (11)

A storage device for storing block data obtained by dividing the file, and storing reference data for referring to the stored block data;
When the file is newly stored in the storage device, the block data obtained by dividing the file and the reference data referring to the block data are stored in the storage device and the file is newly stored The file that newly stores the data already stored in the storage device using the reference data when the block data obtained by dividing the block data has the same data content as the data already stored in the storage device Data storage control means to be referred to as the block data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
With
The data storage control means identifies, as the reference data, block identification data associated with user identification information of a user who uses the file and identifies the block data obtained by dividing the file to be newly stored, and the block identification Block-related data including size information indicating the data size of the block data referred to by referring to the block data stored in the storage device and referenced in the data is stored in the storage device, and the same Storing a group of the block identification data referring to the block related data in association with each other as the same block chain;
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information associated with the block identification data and information on the same block chain.
Storage system. The storage system according to claim 1,
The data storage control unit, when the block data obtained by dividing the file to be stored newly is already the same data content and data stored in the storage device, the block identification identifying the block data Refer to the block related data referring to data already stored in the storage device by data,
The storage capacity management unit is configured for each user in the storage device based on the user identification information associated with the block identification data and the size information included in the block related data referred to by the block identification data. Calculate the storage capacity of
Storage system. The storage system according to claim 1 or 2 ,
The data storage control means stores a group of the block identification data associated with the same user identification information in the group of the block identification data associated as the same block chain in association with each other as the same user chain. ,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the same block chain information and the same user chain information.
Storage system. The storage system according to claim 3 ,
The data storage control means is configured to connect the block identification data of each group associated as the same user chain different from each other in the group of block identification data associated as the same block chain. The block identification data is associated with each other among the identification data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the same block chain information and the same user chain information.
Storage system. A storage device for storing block data obtained by dividing the file, and storing reference data for referring to the stored block data;
When the file is newly stored in the storage device, the block data obtained by dividing the file and the reference data referring to the block data are stored in the storage device and the file is newly stored The file that newly stores the data already stored in the storage device using the reference data when the block data obtained by dividing the block data has the same data content as the data already stored in the storage device Data storage control means to be referred to as the block data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
With
The data storage control means, as the reference data, block identification data for identifying the block data obtained by dividing the file to be newly stored, and the block identification data referred to and stored in the storage device Block-related data including size information indicating the data size of the referenced block data with reference to block data, and user identification information of a user who uses the file associated with the block-related data and from which the block data is divided Is stored in the storage device, and the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device, the block data is identified. Already stored in the storage device as block identification data And refers to the block associated data referring to over data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block related data.
Storage system. The storage system according to claim 5 ,
The data storage control means is the information corresponding to a user who uses the file that is a division source of the block data referred to by the block related data with respect to the user identification information in which an information area for each user is formed. Set predetermined information in an area, store the user identification information in association with the block-related data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block related data.
Storage system. The storage system according to claim 6 ,
The data storage control means uses, as the information area for each user, the file serving as a division source of the block data referred to by the block related data for the user identification information having a bit corresponding to each user. A predetermined information is set in the bit corresponding to a user, and the user identification information is stored in association with the block related data;
The storage capacity management means is based on the information stored in each bit of the user identification information associated with the block related data and the size information associated with the block related data. Calculate the storage capacity for each user at
Storage system. In the information processing device,
When storing the block data obtained by dividing the file and storing the reference data referring to the stored block data, when the file is newly stored, the block data obtained by dividing the file and the block data When the reference data that refers to block data is stored in the storage device, and the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device Data storage control means for making reference to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
And realize
The data storage control means identifies, as the reference data, block identification data associated with user identification information of a user who uses the file and identifies the block data obtained by dividing the file to be newly stored, and the block identification Block-related data including size information indicating the data size of the block data referred to by referring to the block data stored in the storage device and referenced in the data is stored in the storage device, and the same Storing a group of the block identification data referring to the block related data in association with each other as the same block chain;
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information associated with the block identification data and information on the same block chain.
A program to make things happen. In the information processing device,
When storing the block data obtained by dividing the file and storing the reference data referring to the stored block data, when the file is newly stored, the block data obtained by dividing the file and the block data When the reference data that refers to block data is stored in the storage device, and the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device Data storage control means for making reference to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management means for calculating and storing a storage capacity in the storage device in which the block data is stored for each user who uses the file that is a division source of the block data;
And realize
The data storage control means, as the reference data, block identification data for identifying the block data obtained by dividing the file to be newly stored, and the block identification data referred to and stored in the storage device Block-related data including size information indicating the data size of the referenced block data with reference to block data, and user identification information of a user who uses the file associated with the block-related data and from which the block data is divided Is stored in the storage device, and the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device, the block data is identified. Already stored in the storage device as block identification data And refers to the block associated data referring to over data,
The storage capacity management means calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block related data.
A program to make things happen. The block data obtained by dividing the file when the file is newly stored in the storage device that stores the block data obtained by dividing the file and stores the reference data that refers to the stored block data. When the reference data referring to the block data is stored in the storage device, and the block data obtained by dividing the newly stored file has the same data content as the data already stored in the storage device A data storing step of referring to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management step of calculating and storing the storage capacity in the storage device in which the block data is stored for each user who uses the file that is the division source of the block data; and
Have
The data storage step includes identifying block data obtained by dividing the file to be newly stored as the reference data, and block identification data associated with user identification information of a user who uses the file, and the block identification data And the block related data including size information indicating the data size of the block data to be referred to by referring to the block data stored in the storage device and stored in the storage device. Storing a group of the block identification data referring to block related data in association with each other as the same block chain;
The storage capacity management step calculates a storage capacity for each user in the storage device based on the user identification information associated with the block identification data and information on the same block chain.
Information processing method. The block data obtained by dividing the file when the file is newly stored in the storage device that stores the block data obtained by dividing the file and stores the reference data that refers to the stored block data. When the reference data referring to the block data is stored in the storage device, and the block data obtained by dividing the newly stored file has the same data content as the data already stored in the storage device A data storing step of referring to the block data of the file for newly storing data already stored in the storage device using the reference data;
A storage capacity management step of calculating and storing the storage capacity in the storage device in which the block data is stored for each user who uses the file that is the division source of the block data; and
Have
The data storage step includes, as the reference data, block identification data for identifying the block data obtained by dividing the file to be newly stored, and the block that is referred to by the block identification data and stored in the storage device Block-related data including size information indicating the data size of the block data to be referred to and data, and user identification information of a user who uses the file associated with the block-related data and from which the block data is divided The block for identifying the block data when the block data obtained by dividing the file to be newly stored has the same data content as the data already stored in the storage device Data already stored in the storage device as identification data The block related data referred to see,
The storage capacity management step calculates a storage capacity for each user in the storage device based on the user identification information and the size information associated with the block-related data.
Information processing method.

Images