-
I/O Workload Management for All-Flash Datacenter Storage Systems Based on Total Cost of Ownership
Authors:
Zhengyu Yang,
Manu Awasthi,
Mrinmoy Ghosh,
Janki Bhimani,
Ningfang Mi
Abstract:
Recently, the capital expenditure of flash-based Solid State Driver (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, all-flash storage systems have started to become more economically viable for large shared storage installations in datacenters, where metrics like Total Cost of Ownership (TCO) are of paramount importance. On the other hand, flash devices suffe…
▽ More
Recently, the capital expenditure of flash-based Solid State Driver (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, all-flash storage systems have started to become more economically viable for large shared storage installations in datacenters, where metrics like Total Cost of Ownership (TCO) are of paramount importance. On the other hand, flash devices suffer from write amplification, which, if unaccounted, can substantially increase the TCO of a storage system. In this paper, we first develop a TCO model for datacenter all-flash storage systems, and then plug a Write Amplification model (WAF) of NVMe SSDs we build based on empirical data into this TCO model. Our new WAF model accounts for workload characteristics like write rate and percentage of sequential writes. Furthermore, using both the TCO and WAF models as the optimization criterion, we design new flash resource management schemes (MINTCO) to guide datacenter managers to make workload allocation decisions under the consideration of TCO for SSDs. Based on that, we also develop MINTCO-RAID to support RAID SSDs and MINTCO-OFFLINE to optimize the offline workload-disk deployment problem during the initialization phase. Experimental results show that MINTCO can reduce the TCO and keep relatively high throughput and space utilization of the entire datacenter storage resources.
△ Less
Submitted 8 July, 2019; v1 submitted 16 September, 2018;
originally announced September 2018.
-
AutoTiering: Automatic Data Placement Manager in Multi-Tier All-Flash Datacenter
Authors:
Zhengyu Yang,
Morteza Hoseinzadeh,
Allen Andrews,
Clay Mayers,
David Evans,
Rory Bolt,
Janki Bhimani,
Ningfang Mi,
Steven Swanson
Abstract:
In the year of 2017, the capital expenditure of Flash-based Solid State Drivers (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, the "selling point" of traditional spinning Hard Disk Drives (HDDs) as a backend storage - low cost and large capacity - is no longer unique, and eventually they will be replaced by low-end SSDs which have large capacity but perform…
▽ More
In the year of 2017, the capital expenditure of Flash-based Solid State Drivers (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, the "selling point" of traditional spinning Hard Disk Drives (HDDs) as a backend storage - low cost and large capacity - is no longer unique, and eventually they will be replaced by low-end SSDs which have large capacity but perform orders of magnitude better than HDDs. Thus, it is widely believed that all-flash multi-tier storage systems will be adopted in the enterprise datacenters in the near future. However, existing caching or tiering solutions for SSD-HDD hybrid storage systems are not suitable for all-flash storage systems. This is because that all-flash storage systems do not have a large speed difference (e.g., 10x) among each tier. Instead, different specialties (such as high performance, high capacity, etc.) of each tier should be taken into consideration. Motivated by this, we develop an automatic data placement manager called "AutoTiering" to handle virtual machine disk files (VMDK) allocation and migration in an all-flash multi-tier datacenter to best utilize the storage resource, optimize the performance, and reduce the migration overhead. AutoTiering is based on an optimization framework, whose core technique is to predict VM's performance change on different tiers with different specialties without conducting real migration. As far as we know, AutoTiering is the first optimization solution designed for all-flash multi-tier datacenters. We implement AutoTiering on VMware ESXi, and experimental results show that it can significantly improve the I/O performance compared to existing solutions.
△ Less
Submitted 4 May, 2018;
originally announced May 2018.
-
Pelletization Characteristics of the Hydrothermal Pretreated Rice Straw with Added Binders
Authors:
Xianfei Xia,
Hongru Xiao,
Zhengyu Yang,
Xin Xie,
Janki Bhimani
Abstract:
Pelletization of the loose rice straw is an attractive option to produce renewable fuels. In this paper, we focus on the problem of how to improve this pelletization process, especially to reduce energy consumption and improve product quality. In detail, we first pretreat rice straw, and then investigate the densification characteristics of the pretreated materials. Pretreatment methods of the mat…
▽ More
Pelletization of the loose rice straw is an attractive option to produce renewable fuels. In this paper, we focus on the problem of how to improve this pelletization process, especially to reduce energy consumption and improve product quality. In detail, we first pretreat rice straw, and then investigate the densification characteristics of the pretreated materials. Pretreatment methods of the materials include hydrothermal treatment and adding a certain proportion of economic additives, such as rapeseed meal and waste engine oil respectively. In addition, the pretreated rice straw was pelletized by using a biomass densification platform, meanwhile energy consumption and pellet quality were tested. Experimental results indicate that the hydrothermal pretreatment played an important role in reducing energy consumption and improving the product quality, and waste engine oil has a better effect than the rapeseed meal. We also observe that the obtained pellet quality reaches the standard of middle-grade coal, and the proposed pretreatment method realizes the comprehensive utilization of waste agricultural resources.
△ Less
Submitted 19 December, 2017; v1 submitted 8 September, 2017;
originally announced October 2017.
