Research of elastic management strategy for cloud storage

Page 1

The International Journal of Engineering And Science (IJES) ||Volume|| 1 ||Issue|| 1 ||Pages|| 13-17 ||2012|| ISSN: 2319 – 1813 ISBN: 2319 – 1805

Research of elastic management strategy for cloud storage 1

SHAO Bi-lin, 2BIAN Gen-qing, 3ZHU Xu-dong

1, First Author

School of Management, Xi’an University of Architecture and Technology, School of Information and Control Engineering, Xi’an University of Architecture and Technology, 3 Schools of Information and Control Engineering, Xi’an University of Architecture and Technology ,

*2, Corresponding Author

-------------------------------------------------------------Abstract------------------------------------------------------------In order to sol ve those issues including limited storage capacity, high cost of storage and fault recovery in traditional HDFS , cloud storage can effectively solve these problems by using virtual resources of the IaaS based on HDFS . But it cannot assure cloud storage to utilize virtual resources more effectively. In order to solve these problems, the paper proposes a elastic cloud storage framework based on HDFS , and introduces the thought of virtual resources management into the framework, and proposes a elastic management strategy of virtual resource allocation and scheduling based on this framework. The simulation experiment shows cloud storage can effectively improve the efficiency in the use of virtual resources.

Keywords: HDFS; Elastic Cloud Storage; Virtual Resource; Resource Allocation and Scheduling; feedback control theory.

------------------------------------------------------------------------------------------------------------------------Date of Submission: 19, October, 2012 Date of Publication: 10, November 2012 -----------------------------------------------------------------------------------------------------------------------I

Introduce

With the development of Web2.0 technology, especially the popularity of social network and popular, the traditional storage technologies (network Storage or distributed storage) are difficult to meet the demand of their vast amounts of unstructured data storage [1]. So more and more commercial websites began to use cloud storage architecture based on HDFS, such as Google, Amaze, Facebook, etc., the development is gathering mo mentu m. Design ideas of HDFS -based cloud storage derived fro m the virtual cluster computing, which is expanded fro m a single v irtual storage servers to a virtual storage server cluster (ie: Hadoop virtual cluster). Hadoop virtual cluster can be comb ined with mu ltiple virtual storage servers, just as a storage server which has a great computing power and high-throughput provides users with a transparent access interface [2]. However, the existing cloud storage has certain limitat ions in study and implementation, which concerned for high-throughput and high reliability excessively, and ignored the cloud storage’s actual use rate on virtual resource, thus it seriously affects the cloud storage application and popularization. Cloud storage for load-handling capability and disturbance switching capability is important, but www.thei jes.com

we should be even more concerned about the actual efficiency of cloud storage to the virtual resources. Therefore, through introducing the thought of virtual resource management, this article proposes a kind of elastic storage architecture and elastic management strategy of virtual resources. The simu lation results show that cloud storage can effectively improve the efficiency in the use of virtual resources. II HDFS on El astic Cloud Storage The paper makes the virtual resource scheduling units as Slot. Slot represents the characterizat ion of virtual resources calculation ability, wh ich is decided by the virtual resource CPU and memory size. Set CPU as the unit CPU capacity, taking 1GHz; mem on behalf of the unit memo ry capacity, taking 1GB; a virtual server Pi is able to provide a number of Slot

 cpui memi  Sloti  min  ,   cpu mem 

The IJES

(1)

Page 13


Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.