A method of two-tier storage management in virtualized data center

E.V. Zharikov

Abstract


Internet of things applications and data analysis services require a high performance and resilient data storage systems. In the era of servers, networks and storage virtualization, there is a need to develop new models and methods of managing storages for the purpose of improving their performance and reducing the capital and operating costs of the IT infrastructure as a whole. In this paper the two-tier storage model and management method are proposed. The proposed method allows to increase the performance of read/write operations of virtual machines in cloud data centers without significant increase in the storage cost. The research results show that the use of two-tier storage management method allows to reduce the cost of storage by reducing the size and number of storage devices at the fastest level. The analysis of the simulation results shows that the two-tier storage and the proposed management method allows to reduce the waiting time for file access, that leads to an increase in the performance of the two-tier storage while simultaneously serving virtual machine and container requests.

 Problems in programming 2018; 4: 003-014


Keywords


storage system; data migration; virtualization; cloud computing

References


Top 10 Digital Transformation Trends For 2019 Framework [Online] – Available from: https://www.forbes.com/sites/danielnewman/2018/09/11/top-10-digital-transformation-trends-for-2019/#17d55d1e3c30.

ZFS L2ARC [Online] – Available from: http://137.254.16.27/brendan/entry/test

Chen, F., Koufaty, D. A., & Zhang, X. (2011, May). Hystor: making the best use of solid state drives in high performance storage systems. In Proceedings of the international conference on Supercomputing (P. 22–32). ACM. CrossRef

Guerra J., Pucha H., Glider J.S., Belluomini W., & Rangaswami R. (2011, February). Cost Effective Storage using Extent Based Dynamic Tiering. In FAST (11). P. 1–14.

Arteaga D., & Zhao M. (2014, June). Client-side flash caching for cloud systems. In Proceedings of International Conference on Systems and Storage (P. 1–11). ACM. CrossRef

NVM Express [Online] – Available from: https://nvmexpress.org/

Ethernet Storage Fabric – Part 1 [Online] – Available from:http://www.mellanox.com/blog/2018/05/ethernet-storage-fabric-part-1/

Top 10 storage trends for 2018 and why you should care [Online] – Available from: https://community.hpe.com/t5/Around-the-Storage-Block/Top-10-storage-trends-for-2018-and-why-you-should-care/ba-p/6995176#.W7DrSXnWhmA

Yang Z., Hoseinzadeh M., Andrews A., Mayers C., Evans D.T., Bolt R.T., … & Swanson S. (2017, December). AutoTiering: automatic data placement manager in multi-tier all-flash datacenter. In Performance Computing and Communications Conference (IPCCC), 2017 IEEE 36th International (P. 1–8). IEEE. CrossRef

Bodanyuk M.E., Karnaukhov O.K., Rolik O.I., Telenyk S.F. (2013). Management of data storage systems Electronics and Communications. (5–76). P. 81–90. (in Ukrainian).

Ryu J., Lee D., Han C., Shin H., & Kang K. (2016). File-System-Level Storage Tiering for Faster Application Launches on Logical Hybrid Disks. IEEE Access, 4, 3688–3696. CrossRef

Kakoulli E., & Herodotou H. (2017, May). OctopusFS: A distributed file system with tiered storage management. In Proceedings of the 2017 ACM International Conference on Management of Data (P. 65–78). ACM. CrossRef

Intel IOMeter [Online] – Available from: http://www.iometer.org

FIO: Flexible I/O Tester [Online] – Available from: http://linux.die.net/man/1/fio

Borthakur D. (2007). The hadoop distributed file system: Architecture and design. Hadoop Project Website, 11(2007), 21.

White T. (2012). Hadoop: The definitive guide. " O'Reilly Media, Inc.".

Zaharia M., Chowdhury M., Das T., Dave A., Ma J., McCauley M., ... & Stoica I. (2012, April). Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation (P. 15–28). USENIX Association.

Process Monitor [Online] – Available from: https://docs.microsoft.com/en-us/sysinternals/downloads/procmon




DOI: https://doi.org/10.15407/pp2018.04.003

Refbacks

  • There are currently no refbacks.