Nothing Special   »   [go: up one dir, main page]

Le et al., 2013 - Google Patents

Efficient gear-shifting for a power-proportional distributed data-placement method

Le et al., 2013

View PDF
Document ID
1154164291055640600
Author
Le H
Hikida S
Yokota H
Publication year
Publication venue
2013 IEEE International Conference on Big Data

External Links

Snippet

Energy-aware commodity-based distributed file systems for efficient Big Data processing are increasingly moving towards power-proportional designs. However, current data placement methods for such systems have not given careful consideration to the effect of gear-shifting …
Continue reading at www.academia.edu (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from or digital output to record carriers, e.g. RAID, emulated record carriers, networked record carriers
    • G06F3/0601—Dedicated interfaces to storage systems
    • G06F3/0628—Dedicated interfaces to storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from or digital output to record carriers, e.g. RAID, emulated record carriers, networked record carriers
    • G06F3/0601—Dedicated interfaces to storage systems
    • G06F3/0602—Dedicated interfaces to storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from or digital output to record carriers, e.g. RAID, emulated record carriers, networked record carriers
    • G06F3/0601—Dedicated interfaces to storage systems
    • G06F3/0668—Dedicated interfaces to storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30—Information retrieval; Database structures therefor; File system structures therefor
    • G06F17/30286—Information retrieval; Database structures therefor; File system structures therefor in structured data stores
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F1/00—Details of data-processing equipment not covered by groups G06F3/00 - G06F13/00, e.g. cooling, packaging or power supply specially adapted for computer application
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power Management, i.e. event-based initiation of power-saving mode
    • G06F1/3234—Action, measure or step performed to reduce power consumption
    • G06F1/3287—Power saving by switching off individual functional units in a computer system, i.e. selective power distribution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for programme control, e.g. control unit
    • G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network-specific arrangements or communication protocols supporting networked applications
    • H04L67/10—Network-specific arrangements or communication protocols supporting networked applications in which an application is distributed across nodes in the network
    • H04L67/1002—Network-specific arrangements or communication protocols supporting networked applications in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers, e.g. load balancing

Similar Documents

Publication Publication Date Title
JP5765416B2 (en) Distributed storage system and method
CN107710193B (en) Data placement control for distributed computing environments
US9798642B2 (en) Method for allocating a server amongst a network of hybrid storage devices
US8645730B2 (en) Systems and methods to improve power efficiency in hybrid storage clusters
CN102929787A (en) Allocation strategies for storage device sets
CN102855294A (en) Intelligent hash data layout method, cluster storage system and method thereof
Karakoyunlu et al. Exploiting user metadata for energy-aware node allocation in a cloud storage system
Le et al. Efficient gear-shifting for a power-proportional distributed data-placement method
Zhang et al. Data replication placement strategy based on bidding mode for cloud storage cluster
You et al. Ursa: Scalable load and power management in cloud storage systems
Le et al. Accordion: An efficient gear-shifting for a power-proportional distributed data-placement method
Lin et al. eStor: Energy efficient and resilient data center storage
Hikida et al. A power saving storage method that considers individual disk rotation
Le et al. Namenode and datanode coupling for a power-proportional hadoop distributed file system
Tena et al. Powercass: Energy efficient, consistent hashing based storage for micro clouds based infrastructure
Le et al. An evaluation of power-proportional data placement for Hadoop distributed file systems
Li et al. Distributed heterogeneous storage based on data value
Feng et al. HDStore: An SSD/HDD hybrid distributed storage scheme for large-scale data
Le et al. NDCouplingHDFS: A coupling architecture for a power-proportional Hadoop distributed file system
Kim et al. Systematic approach of using power save mode for cloud data processing services
Le et al. An Evaluation of Data Placement Methods for Multiple-gear Power-proportional Distributed File Systems
Le et al. An Efficient Gear-Shifting Power-Proportional Distributed File System
Rush et al. Exploiting replication for energy efficiency of heterogeneous storage systems
Gajarawala Investigating Techniques for Improving the Energy Proportionality of Distributed Storage Systems
Séguin et al. Towards elasticity in distributed file systems