CN111078467A

CN111078467A - Method and device for realizing remote copy consistency

Info

Publication number: CN111078467A
Application number: CN201911117866.XA
Authority: CN
Inventors: 孙先宁
Original assignee: Suzhou Inspur Intelligent Technology Co Ltd
Current assignee: Suzhou Inspur Intelligent Technology Co Ltd
Priority date: 2019-11-15
Filing date: 2019-11-15
Publication date: 2020-04-28

Abstract

The invention provides a method and a device for realizing remote copy consistency.A main storage end maps a plurality of divided storage volumes to an application of a host so that the application writes data into the storage volumes; the storage volumes are transmitted to a standby storage end at the main storage end to perform data backup for the first time, and then snapshot operation is periodically performed on all the storage volumes of the main storage end at the same time; responding to a snapshot at a certain time point to record that data in a storage volume of the main storage end has no error and has data change compared with a snapshot at a previous time point, and transmitting all changed data to the standby storage end for backup; and in response to the fact that data in the storage volume of the main storage end are in error according to snapshot records at a certain time point, suspending data transmission from the main storage end to the standby storage end. The invention can periodically carry out snapshot on the data of the main storage end to detect whether the data has errors or not, thereby improving the consistency and the safety of the data.

Description

Method and device for realizing remote copy consistency

Technical Field

The present invention relates to the field of computers, and more particularly, to a method and apparatus for implementing remote copy consistency.

Background

With the development of new technologies such as cloud computing and big data, a large amount of data is generated, and the security requirement of the data is higher and higher. To ensure data security, we often use remote replication to solve the data protection problem. When a plurality of storage volumes are provided for applications, a common volume remote copy method cannot ensure data consistency, for example, when one of the volumes has a problem, other volumes still transmit data to a remote end, and it cannot be guaranteed that the data is completely and synchronously transmitted to the remote end, and the storage and backup of the data to the remote end are meaningless.

Due to the rapid development and large-scale use of big data and database applications, the storage device serves as an infrastructure of a data platform to provide a large amount of data support for large-scale applications, and the security and data consistency of the storage device are particularly important.

Disclosure of Invention

In view of this, an object of the embodiments of the present invention is to provide a method and an apparatus for implementing remote copy consistency, so as to solve the problem that the remote volume data is inconsistent and cannot be used for application recovery.

Based on the above object, an aspect of the embodiments of the present invention provides a method for implementing remote copy consistency, including the following steps:

the method comprises the steps that a primary storage side maps a plurality of divided storage volumes to an application of a host, so that the application can write data into the storage volumes;

the storage volumes are transmitted to a standby storage end at the main storage end for primary data backup, and after the primary data backup, snapshot operation is periodically executed on all the storage volumes of the main storage end at the same time;

responding to a snapshot at a certain time point to record that data in a storage volume of the main storage end has no error and has data change compared with a snapshot at a previous time point, and transmitting all changed data to the standby storage end for backup;

and in response to the fact that data in the storage volume of the main storage end are in error according to snapshot records at a certain time point, suspending data transmission from the main storage end to the standby storage end.

In some embodiments, in response to a snapshot at a certain time point recording that a data error occurs in a storage volume of the primary storage side, suspending data transmission from the primary storage side to the backup storage side further includes:

and recovering the application by using the data in the standby storage terminal.

In some embodiments, the transmitting the plurality of storage volumes to the backup storage side at the primary storage side for a first data backup, and after the first data backup, periodically performing the snapshot operation on all the storage volumes of the primary storage side at the same time includes:

and setting a period for executing snapshot operation on all storage volumes of the main storage end according to the operation frequency of the application.

In some embodiments, the responding to the snapshot at a certain time point recording that the data in the storage volume of the primary storage end has no error and there is a data change compared with the snapshot at the previous time point, and transmitting all the changed data to the backup storage end for backup includes:

and storing the recorded data changed by the main storage end into a change volume, and transmitting the change volume to the backup storage end for backup.

In some embodiments, the backup storage is remotely located and remotely connected to the host via a network.

Another aspect of the embodiments of the present invention provides an apparatus for implementing remote copy consistency, including:

at least one processor; and

a memory storing program code executable by the processor, the program code implementing the following steps when executed by the processor:

The invention has the following beneficial technical effects: the method and the device for realizing the remote copy consistency can periodically carry out snapshot on the data of the main storage end so as to detect whether the data has errors or not, thereby improving the consistency and the safety of the data; and after the snapshot display data has problems, the data can be conveniently recovered through the standby storage terminal, the total maintenance cost is greatly reduced, and the safety, the reliability and the usability of the system are improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.

FIG. 1 is a flow chart of a method of implementing remote copy consistency in accordance with the present invention;

FIG. 2 is a schematic diagram of an implementation of remote copy in accordance with the present invention;

FIG. 3 is a flow diagram of a method of implementing remote copy consistency in accordance with one embodiment of the present invention;

fig. 4 is a hardware structure diagram of an apparatus for implementing remote copy consistency according to the present invention.

Detailed Description

Embodiments of the present invention are described below. However, it is to be understood that the disclosed embodiments are merely examples and that other embodiments may take various and alternative forms. The figures are not necessarily to scale; certain features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention. As one of ordinary skill in the art will appreciate, various features illustrated and described with reference to any one of the figures may be combined with features illustrated in one or more other figures to produce embodiments that are not explicitly illustrated or described. The combination of features shown provides a representative embodiment for a typical application. However, various combinations and modifications of the features consistent with the teachings of the present invention may be desired for certain specific applications or implementations.

In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.

In view of the above object, an aspect of the embodiments of the present invention provides a method for implementing remote copy consistency, as shown in fig. 1, including the following steps:

step S101: the method comprises the steps that a primary storage side maps a plurality of divided storage volumes to an application of a host, so that the application can write data into the storage volumes;

step S102: the storage volumes are transmitted to a standby storage end at the main storage end for primary data backup, and after the primary data backup, snapshot operation is periodically executed on all the storage volumes of the main storage end at the same time;

step S103: responding to a snapshot at a certain time point to record that data in a storage volume of the main storage end has no error and has data change compared with a snapshot at a previous time point, and transmitting all changed data to the standby storage end for backup;

step S104: and in response to the fact that data in the storage volume of the main storage end are in error according to snapshot records at a certain time point, suspending data transmission from the main storage end to the standby storage end.

In some embodiments, in response to a snapshot at a certain time point recording that an error occurs in data in a storage volume of the primary storage end, suspending data transmission from the primary storage end to the backup storage end further includes: and recovering the application by using the data in the standby storage terminal.

In some embodiments, first, a primary storage device is connected to the same application, wherein the application may comprise a single or multiple hosts, and the application is deployed by partitioning multiple storage volumes into the application.

In some embodiments, the transmitting the plurality of storage volumes to the backup storage side at the primary storage side for a first data backup, and after the first data backup, periodically and simultaneously performing the snapshot operation on all the storage volumes at the primary storage side includes: and setting a period for executing snapshot operation on all storage volumes of the main storage end according to the operation frequency of the application. For example, the snapshot operation may be executed every 5 to 10 minutes, and whether an error occurs in the snapshot data is determined, and if no error occurs, the snapshot data is further compared with the data in the previous snapshot to determine whether there is a data change.

In some embodiments, the responding to the snapshot at a certain time point recording that data in the storage volume of the primary storage end has no error and there is a data change compared with the snapshot at a previous time point, and transmitting all the changed data to the backup storage end for backup includes: and storing the recorded data changed by the main storage end into a change volume, and transmitting the change volume to the backup storage end for backup.

In some embodiments, the host application writes data into the volume of the primary storage, after a cycle period, the storage detects whether each volume is read or written normally, if so, the change of the volume data in the period is recorded by changing the volume, and all the volume change data is synchronized to the volume of the backup storage. When one or more volumes in the main storage end have a fault, for example, the volumes are offline, and the problem of volume asynchronism is identified through periodic snapshot, all changed volume data changes and data synchronization of the main storage end are frozen, and the whole main storage end does not synchronize data to the standby storage end any more. Therefore, the storage backup volume can be ensured to have normal consistent data of each volume.

In some embodiments, as shown in FIGS. 2 and 3, a remote copy consistency component is configured to enable transfer control of the storage volume through the remote copy consistency component. The method comprises the steps of creating a remote copy relationship with a changed volume under a consistency component, managing the remote copy relationship of a plurality of storage volumes through the consistency component in a unified mode, setting a cyclic copy period of all remote copies through the consistency component in a unified mode, determining time for recording changed data, and after the time is up, ensuring that the data of all the storage volumes are consistent through consistency snapshot by a consistency group. And starting a consistency group, and starting the data synchronization of the main and standby storage volumes by each storage volume. The host application writes data into the storage volume of the main storage end, after a cycle period, the storage detects whether the storage volume is read and written normally, if the storage volume is read and written normally, the change of the volume data in the cycle is recorded in a volume changing mode, and all the volume changing data are synchronized to the volume of the standby storage end.

When one or more storage volumes of the main storage end fail, for example, the volumes are offline, the main storage end recognizes that the storage volume synchronization problem exists, the remote copy consistency component freezes data changes and data synchronization of all changed volumes in the consistency group, and the whole consistency group does not synchronize data to the standby storage end any more. Therefore, the backup storage end volume can be ensured to have the normal consistent data of each volume.

Where technically feasible, the technical features listed above for the different embodiments may be combined with each other or changed, added, omitted, etc. to form further embodiments within the scope of the invention.

It can be seen from the foregoing embodiments that the method for implementing remote copy consistency provided in the embodiments of the present invention can periodically perform snapshot on data in the main storage to detect whether data has errors, so as to improve data consistency and security; and after the snapshot display data has problems, the data can be conveniently recovered through the standby storage terminal, the total maintenance cost is greatly reduced, and the safety, the reliability and the usability of the system are improved.

In view of the foregoing, in another aspect of the embodiments of the present invention, an apparatus for implementing remote copy consistency is provided, including:

at least one processor; and

In some embodiments, the transmitting the plurality of storage volumes to the backup storage side at the primary storage side for a first data backup, and after the first data backup, periodically and simultaneously performing the snapshot operation on all the storage volumes at the primary storage side includes: and setting a period for executing snapshot operation on all storage volumes of the main storage end according to the operation frequency of the application.

Fig. 4 is a schematic hardware structural diagram of an apparatus for implementing remote copy consistency according to an embodiment of the present invention.

Taking the computer device shown in fig. 4 as an example, the computer device includes a processor 401 and a memory 402, and may further include: an input device 403 and an output device 404.

The processor 401, the memory 402, the input device 403 and the output device 404 may be connected by a bus or other means, and fig. 4 illustrates an example of a connection by a bus.

The memory 402, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules corresponding to the method for implementing remote copy consistency in the embodiments of the present application. The processor 401 executes various functional applications of the server and data processing by running nonvolatile software programs, instructions and modules stored in the memory 402, that is, the method for implementing remote copy consistency of the above-described method embodiments.

The memory 402 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to a method of achieving remote copy consistency, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 402 may optionally include memory located remotely from processor 401, which may be connected to local modules via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 403 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus implementing the method of remote copy consistency. The output device 404 may include a display device such as a display screen.

Program instructions/modules corresponding to the one or more methods for implementing remote copy consistency are stored in the memory 402, and when executed by the processor 401, perform the method for implementing remote copy consistency in any of the above-described method embodiments.

Any embodiment of the computer device executing the method for implementing remote copy consistency can achieve the same or similar effects as any corresponding method embodiment.

Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes in the methods of the above embodiments may be implemented by a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a Random Access Memory (RAM), or the like.

In addition, the apparatuses, devices and the like disclosed in the embodiments of the present invention may be various electronic terminal devices, such as a mobile phone, a Personal Digital Assistant (PDA), a tablet computer (PAD), a smart television and the like, or may be a large terminal device, such as a server and the like, and therefore the scope of protection disclosed in the embodiments of the present invention should not be limited to a specific type of apparatus, device. The client disclosed in the embodiment of the present invention may be applied to any one of the above electronic terminal devices in the form of electronic hardware, computer software, or a combination of both.

Furthermore, the method disclosed according to an embodiment of the present invention may also be implemented as a computer program executed by a CPU, and the computer program may be stored in a computer-readable storage medium. The computer program, when executed by the CPU, performs the above-described functions defined in the method disclosed in the embodiments of the present invention.

Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.

Further, it should be appreciated that the computer-readable storage media (e.g., memory) described herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.

The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions described herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP, and/or any other such configuration.

The steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.

In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk, an optical disk, or the like.

The above-described embodiments are possible examples of implementations and are presented merely for a clear understanding of the principles of the invention. Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of an embodiment of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.

Claims

1. A method for implementing remote copy consistency, comprising the steps of:

2. The method of claim 1, wherein in response to a snapshot at a certain time point recording an error in data in a storage volume of the primary storage, suspending data transmission from the primary storage to the backup storage further comprises:

3. The method of claim 1, wherein the transmitting the plurality of storage volumes to a backup storage at the primary storage for a first data backup, and wherein periodically performing snapshot operations on all storage volumes of the primary storage simultaneously after the first data backup comprises:

4. The method of claim 1, wherein the responding to the snapshot at a time point recording that data in the storage volume of the primary storage side has no errors and there are data changes compared to the snapshot at a previous time point, and transmitting all the changed data to the backup storage side for backup comprises:

5. The method of claim 1, wherein the backup storage is remotely located and remotely connected to the host via a network.

6. An apparatus for implementing remote copy consistency, comprising:

at least one processor; and

7. The apparatus of claim 1, wherein in response to a snapshot at a certain time point recording an error in data in the storage volume of the primary storage, suspending data transmission from the primary storage to the backup storage further comprises:

8. The apparatus of claim 1, wherein the transferring the plurality of storage volumes to a backup storage at the primary storage for a first data backup, and wherein periodically performing snapshot operations on all storage volumes of the primary storage simultaneously after the first data backup comprises:

9. The apparatus of claim 1, wherein the responding to the snapshot at a time point recording that data in the storage volume of the primary storage side has no errors and there are data changes compared to the snapshot at a previous time point, and the transmitting all the changed data to the backup storage side for backup comprises:

10. The apparatus of claim 1, wherein the backup storage is remotely located and remotely connected to the host via a network.