CN104283959A - Performance-grading-based storage mechanism suitable for cloud platform - Google Patents
Performance-grading-based storage mechanism suitable for cloud platform Download PDFInfo
- Publication number
- CN104283959A CN104283959A CN201410543045.3A CN201410543045A CN104283959A CN 104283959 A CN104283959 A CN 104283959A CN 201410543045 A CN201410543045 A CN 201410543045A CN 104283959 A CN104283959 A CN 104283959A
- Authority
- CN
- China
- Prior art keywords
- lun
- cloud platform
- volume
- storage
- logical volume
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45504—Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the field of cloud computing, in particular to a performance-grading-based storage mechanism suitable for a cloud platform. The storage mechanism includes the steps that LUN dividing is firstly carried out inside special storage devices, and storage resources are outwards provided in an SAN mode; then, LUN devices are found and logged in to, and the storage devices are localized; logical volume groups are created on physical servers through the localized devices and shared; after sharing on all the LUN devices is completed, when virtual machines are created, the storage devices are selected according to the requirements of the virtual machines for IO speeds, and then logical volumes corresponding to the sizes of hard disks of the virtual machines are created on the volume groups corresponding to the storage devices; images of the virtual machines are injected into the logical volumes created on the corresponding volume groups, and the virtual machines are created through the logical volumes. By means of the storage mechanism, the capacity of balancing IO load storage of the whole cloud platform is provided, and the cloud platform can be scheduled on the physical servers; the storage mechanism can be used for storage management of the cloud platform.
Description
Technical field
The present invention relates to field of cloud calculation, refer to a kind of memory mechanism based on grading performance being applicable to cloud platform especially.
Background technology
Under traditional mode, when large corporation carries out informatization, purchasing special memory device (as IP-SAN etc.) as memory device is a kind of selection generally; The storage of high-performance and high reliability can be provided like this.Along with the development of memory technology, and application improving constantly memory requirement, large corporation unavoidably can update to special purpose memory devices, and therefore, these are in-house generally exists the special purpose memory devices that multiple stage belongs to different generation, performance height differs.Old special purpose memory devices how is utilized always to be a difficult problem.On cloud platform, generally these equipment can be assigned to different clusters, the physical server be mounted in cluster uses as memory space.This using method can bring following drawback:
1, under the cluster being assigned to the lower memory device of performance, because IO speed is lower, the physical server under this cluster needs I/O request to be processed also less comparatively speaking, and the load of whole cluster is relatively low; On the contrary, under the cluster being assigned to the higher memory device of performance, the load of whole cluster is relatively high, and the performance of whole cloud platform has no idea to balance, and the treatment effeciency of platform is lower.
2, concerning whole memory space, because memory space is divided in different clusters, can not carry out planning and dispatching in the use of podium level in the face of memory space, therefore, this method easily brings the waste of memory space, and single memory device easily causes fragment.
Summary of the invention
The technical problem that the present invention solves is to provide a kind of memory mechanism based on grading performance being applicable to cloud platform, solve the deficiency that conventional method exists, promote the IO efficiency of whole cloud platform, reduce the generation of memory space fragment, improve the solution of memory space utilance.
The technical scheme that the present invention solves the problems of the technologies described above is:
Comprise the steps:
Step 1: log in each special purpose memory devices by supervising the network, carries out LUN division in inside, and externally provides storage resources by LUN in SAN mode;
Step 2: need at cloud platform the physical server of use memory space finds and logs in LUN equipment, make its localization;
Step 3 a: physical server utilizes the memory device of localization to create logical volume group wherein, make this physical server and other physical servers share this volume group;
Step 4: the LUN equipment in all special purpose memory devices is all shared according to previous step, after completing, all multiple volume group of carry on every platform physical server;
Step 5: when creating virtual machine, selects memory device according to virtual machine to the height of IO speed requirement, then to the logical volume that the volume group of memory device should create corresponding virtual hard disk size;
Step 6: the mirror image of virtual machine is injected into corresponding volume and forms on the logical volume built, use establishing logical volume virtual machine.
Described step a kind, LUN (Logical Unit Number) is LUN, for describing the logical volume divided by each special purpose memory devices; SAN is the storage area network of high speed private networks or subnet, in order to provide connection between data server and different types of data storage device.
The localization of described step 2 is bases that memory device creates logical volume group, and after LUN is mounted to physical server by SAN mode, the LUN localization of first being come by carry, then does further operation to LUN.
In described step 3, the storage pool that volume group (Volume Group, VG) is made up of one or more physical volume, volume group can create one or more logical volume;
Described physical volume (Physical Volume, PV) fdisk is referred to, or DISK to Image or software PLC (the Redundant Arrays of independent Disks that created, disk array), it is the basic memory device of LVM (Logical Volume Manager, logical volume management);
Described logical volume (Logical Volume, LV) is the block device of a standard, is based upon on volume group; File system can be set up on logical volume.
The IO speed requirement of described step 5, mainly virtual machine is for the speed requirement of storage volume access data.
Mechanism of the present invention provides the ability that the whole cloud platform of balance stores IO load, cloud platform can be dispatched on each physical server, in the volume group that the high-performance memory device that virtual machine high for IO load is operated on different physical server is corresponding, and then promote the IO efficiency of whole cloud platform; Mechanism of the present invention provides the ability of dispatching whole cloud platform memory space, IO load is in the virtual machine of medium level, the size that can take up room according to its magnetic disk of virtual machine, dispatch according to the preferential object of the little storage of remaining space that uses, the generation of memory space fragment can be reduced, improve the utilance of memory space; Mechanism of the present invention, due to the division adopting volume group to carry out memory space, therefore can provide the characteristic of storage volume dynamic expansion.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, the present invention is further described:
Fig. 1 is flow chart of the present invention;
Fig. 2 is model support composition of the present invention.
Embodiment
Embodiments of the present invention have multiple, and at this, exterior storage LUN is illustrated wherein a kind of implementation method for IP-SAN carry to the mode of physical server, as shown in Figure 1, 2, specific implementation process is as follows
1, log in each special purpose memory devices by supervising the network, carry out the division of LUN in inside, and externally provide storage resources by LUN in IP-SAN mode;
Here by memory device client LUN is mounted on multiple physical servers of specifying.
2, need at cloud platform the physical server of use memory space finds and logs in LUN equipment, make its localization;
Find LUN, bottom order is as follows:
#iscsiadm-m discovery-t sendtargets-p 10.10.10.3:3260--finds IQN
#iscsiadm-m node-p 10.10.10.3:3260-T iqn.2lun.com-l--according to IQN,
Search LUN device number
#ll/dev/disk/by-path|grep " iqn.2lun.com "--list LUN quantity
#fdisk-l|grep device number--search LUN size
Parameter interpretation:
-p 10.10.10.3:3260 storage pool server ip and port, IP externally provides the IP of storage network card interface for concentrated storage, and port is generally 3260 constant.
Log in LUN equipment:
#iscsiadm-m node-T [device]-o update--namenode.session.auth.authmethod--value=CHAP
#iscsiadm-m node-T [device]-o update--name node.session.auth.username--value=[user name]
#iscsiadm-m node-T [device]-o update--name node.session.auth.password--value=[password]
3, a physical server utilizes the memory device of localization to create logical volume group wherein, make this physical server and other physical servers share this volume group;
LUN is made physical volume by #pvcreate/dev/sdd--
#vgcreate VG_XenStorage-3bd23141/dev/sdd--makes VG volume group on physical machine volume basis
4, the LUN equipment in all special purpose memory devices is all shared according to step 3, after completing, all multiple volume group of carry on every platform physical server;
Other physical servers perform to issue orders, and share this volume group
#lvscan grep volumegroup name--check volume group state
#lvchange-ay/dev/ volumegroup name claims--and activate and share this volume group
When 5, creating virtual machine, according to virtual machine, memory device is selected to the height of IO speed requirement, then to the logical volume that the volume group of memory device should create corresponding virtual hard disk size;
#lvcreate-L 20G-n lv_kvm vg_name--creates logical volume size
Parameter interpretation:
The volumegroup name that vg_name--will create claims
The logical volume name that lv_kvm-will create
6, the mirror image of virtual machine is injected on the logical volume that step 5 creates, uses establishing logical volume virtual machine.
#dd?if＝/root/win2008-R2-64bit-20G-original.qcow2?of＝/dev/vg_name/lv_kvm?bs＝5M
--the mirror image of virtual machine is injected in the logical volume lv_kvm created.
Claims (7)
1. be applicable to the memory mechanism based on grading performance of cloud platform, it is characterized in that: comprise the steps:
Step 1: log in each special purpose memory devices by supervising the network, carries out LUN division in inside, and externally provides storage resources by LUN in SAN mode;
Step 2: need at cloud platform the physical server of use memory space finds and logs in LUN equipment, make its localization;
Step 3 a: physical server utilizes the memory device of localization to create logical volume group wherein, make this physical server and other physical servers share this volume group;
Step 4: the LUN equipment in all special purpose memory devices is all shared according to previous step, after completing, all multiple volume group of carry on every platform physical server;
Step 5: when creating virtual machine, selects memory device according to virtual machine to the height of IO speed requirement, then to the logical volume that the volume group of memory device should create corresponding virtual hard disk size;
Step 6: the mirror image of virtual machine is injected into corresponding volume and forms on the logical volume built, use establishing logical volume virtual machine.
2. the memory mechanism based on grading performance being applicable to cloud platform according to claim 1, it is characterized in that: described step a kind, LUN is LUN, for describing the logical volume divided by each special purpose memory devices; SAN is the storage area network of high speed private networks or subnet, in order to provide connection between data server and different types of data storage device.
3. the memory mechanism based on grading performance being applicable to cloud platform according to claim 1, it is characterized in that: the localization of described step 2 is bases that memory device creates logical volume group, after LUN is mounted to physical server by SAN mode, the LUN localization of first being come by carry, then does further operation to LUN.
4. the memory mechanism based on grading performance being applicable to cloud platform according to claim 2, it is characterized in that: the localization of described step 2 is bases that memory device creates logical volume group, after LUN is mounted to physical server by SAN mode, the LUN localization of first being come by carry, then does further operation to LUN.
5. the memory mechanism based on grading performance being applicable to cloud platform according to any one of Claims 1-4, it is characterized in that: in described step 3, the storage pool that volume group is made up of one or more physical volume, volume group can create one or more logical volume;
Described physical volume refers to fdisk, or DISK to Image or the software PLC that created, is the basic memory device of LVM;
Described logical volume is the block device of a standard, is based upon on volume group; File system can be set up on logical volume.
6. the memory mechanism based on grading performance being applicable to cloud platform according to any one of Claims 1-4, is characterized in that: the IO speed requirement of described step 5, mainly virtual machine is for the speed requirement of storage volume access data.
7. the memory mechanism based on grading performance being applicable to cloud platform according to claim 5, is characterized in that: the IO speed requirement of described step 5, mainly virtual machine is for the speed requirement of storage volume access data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410543045.3A CN104283959B (en) | 2014-10-14 | 2014-10-14 | A kind of memory mechanism based on grading performance suitable for cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410543045.3A CN104283959B (en) | 2014-10-14 | 2014-10-14 | A kind of memory mechanism based on grading performance suitable for cloud platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104283959A true CN104283959A (en) | 2015-01-14 |
| CN104283959B CN104283959B (en) | 2018-01-09 |
Family
ID=52258432
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410543045.3A Active CN104283959B (en) | 2014-10-14 | 2014-10-14 | A kind of memory mechanism based on grading performance suitable for cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104283959B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105159908A (en) * | 2015-07-02 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Database cloning method and apparatus |
| CN107357531A (en) * | 2017-07-12 | 2017-11-17 | 郑州云海信息技术有限公司 | A kind of virtual machine operations method, apparatus and system based on disk array |
| CN107621927A (en) * | 2017-09-29 | 2018-01-23 | 南京宏海科技有限公司 | A kind of Longitudinal Extension method and its device based on super emerging system |
| CN107797766A (en) * | 2017-09-27 | 2018-03-13 | 郑州云海信息技术有限公司 | A kind of method and apparatus for creating volume |
| CN108234551A (en) * | 2016-12-15 | 2018-06-29 | 腾讯科技（深圳）有限公司 | A kind of data processing method and device |
| CN109032521A (en) * | 2018-07-25 | 2018-12-18 | 星环信息科技（上海）有限公司 | Storage volume creation method, device, server and storage medium |
| CN109547537A (en) * | 2018-11-05 | 2019-03-29 | 中国电子科技集团公司第二十八研究所 | The method for realizing openstack High Availabitity based on SAN storage shared volume |
| CN111880738A (en) * | 2020-07-29 | 2020-11-03 | 浪潮云信息技术股份公司 | Method for automatically creating and mounting LVM (logical volume manager) volume in K8s environment |
| CN112148224A (en) * | 2020-09-23 | 2020-12-29 | 山东省计算中心（国家超级计算济南中心） | Method and system for improving virtualized storage performance of Shenwei platform |
| CN113504954A (en) * | 2021-07-08 | 2021-10-15 | 华云数据控股集团有限公司 | Method, system and medium for calling CSI LVM plug-in, dynamic persistent volume provisioning |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102147770A (en) * | 2011-03-28 | 2011-08-10 | 杭州电子科技大学 | Storage resource management system and method |
| CN102713825A (en) * | 2009-12-16 | 2012-10-03 | 赛门铁克公司 | Storage visibility in virtual environments |
| CN103399783A (en) * | 2013-08-07 | 2013-11-20 | 曙光信息产业(北京)有限公司 | Storage method and device of mirror image documents of virtual machines |
-
2014
- 2014-10-14 CN CN201410543045.3A patent/CN104283959B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102713825A (en) * | 2009-12-16 | 2012-10-03 | 赛门铁克公司 | Storage visibility in virtual environments |
| CN102147770A (en) * | 2011-03-28 | 2011-08-10 | 杭州电子科技大学 | Storage resource management system and method |
| CN103399783A (en) * | 2013-08-07 | 2013-11-20 | 曙光信息产业(北京)有限公司 | Storage method and device of mirror image documents of virtual machines |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105159908A (en) * | 2015-07-02 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Database cloning method and apparatus |
| CN108234551B (en) * | 2016-12-15 | 2021-06-25 | 腾讯科技（深圳）有限公司 | Data processing method and device |
| CN108234551A (en) * | 2016-12-15 | 2018-06-29 | 腾讯科技（深圳）有限公司 | A kind of data processing method and device |
| CN107357531A (en) * | 2017-07-12 | 2017-11-17 | 郑州云海信息技术有限公司 | A kind of virtual machine operations method, apparatus and system based on disk array |
| CN107797766A (en) * | 2017-09-27 | 2018-03-13 | 郑州云海信息技术有限公司 | A kind of method and apparatus for creating volume |
| CN107621927A (en) * | 2017-09-29 | 2018-01-23 | 南京宏海科技有限公司 | A kind of Longitudinal Extension method and its device based on super emerging system |
| CN107621927B (en) * | 2017-09-29 | 2020-08-14 | 南京宏海科技有限公司 | Longitudinal extension method and device based on super-fusion system |
| CN109032521A (en) * | 2018-07-25 | 2018-12-18 | 星环信息科技（上海）有限公司 | Storage volume creation method, device, server and storage medium |
| CN109547537A (en) * | 2018-11-05 | 2019-03-29 | 中国电子科技集团公司第二十八研究所 | The method for realizing openstack High Availabitity based on SAN storage shared volume |
| CN111880738A (en) * | 2020-07-29 | 2020-11-03 | 浪潮云信息技术股份公司 | Method for automatically creating and mounting LVM (logical volume manager) volume in K8s environment |
| CN112148224A (en) * | 2020-09-23 | 2020-12-29 | 山东省计算中心（国家超级计算济南中心） | Method and system for improving virtualized storage performance of Shenwei platform |
| CN113504954A (en) * | 2021-07-08 | 2021-10-15 | 华云数据控股集团有限公司 | Method, system and medium for calling CSI LVM plug-in, dynamic persistent volume provisioning |
| CN113504954B (en) * | 2021-07-08 | 2024-02-06 | 华云数据控股集团有限公司 | Method, system and medium for calling CSI LVM plug in and dynamic persistent volume supply |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104283959B (en) | 2018-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104283959A (en) | Performance-grading-based storage mechanism suitable for cloud platform | |
| US11042311B2 (en) | Cluster system with calculation and storage converged | |
| US10394611B2 (en) | Scaling computing clusters in a distributed computing system | |
| CN104156216A (en) | Heterogeneous storage management system and method oriented to cloud computing | |
| CN104270409B (en) | Centrally stored method is efficiently utilized in a kind of cloud platform | |
| CN103078965B (en) | The IP address management method of virtual machine | |
| CN103986786A (en) | Remote cloud desktop operation system | |
| CN103595799B (en) | A kind of method realizing distributed shared data storehouse | |
| CN103118073B (en) | Virtual machine data persistence storage system and method in cloud environment | |
| CN103685441B (en) | A kind of remote desktop control system based on Loongson terminal | |
| CN105391652A (en) | USB equipment network sharing system and method based on USB redirection | |
| CN102915255A (en) | Cloud computing service system and method for massive dataset parallel computation | |
| CN104484279A (en) | Centralized storage over-allotment using method suitable for cloud computing | |
| CN102833334A (en) | Logical volume management method | |
| CN103501295B (en) | A kind of remote access method based on virtual machine (vm) migration and equipment | |
| CN104283970A (en) | Cloud computing service device and system and cloud computing method | |
| CN103780591A (en) | Public security cloud computing center construction method | |
| CN203301532U (en) | Cloud desktop system | |
| CN105487946B (en) | A kind of faulty computer automatic switching method and device | |
| Abbasov | Cloud computing: State of the art reseach issues | |
| CN103309774A (en) | Construction method of virtual cluster double-layer redundancy framework | |
| CN103209218A (en) | Management system for disaster-tolerant all-in-one machine | |
| CN105227666A (en) | The whole machine cabinet management framework that a kind of facing cloud calculates | |
| CN203301534U (en) | Virtual machine management platform based on cloud architecture | |
| CN202652266U (en) | Enterprise cloud computing common information service platform core architecture and system application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 523808 19th Floor, Cloud Computing Center, Chinese Academy of Sciences, No. 1 Kehui Road, Songshan Lake Hi-tech Industrial Development Zone, Dongguan City, Guangdong Province Patentee after: G-Cloud Technology Co., Ltd. Address before: 523808 No. 14 Building, Songke Garden, Songshan Lake Science and Technology Industrial Park, Dongguan City, Guangdong Province Patentee before: G-Cloud Technology Co., Ltd. |