Tarazu: An Adaptive End-to-end I/O Load-balancing Framework for Large-scale Parallel File Systems

Journal Article

EUPEX partner Johannes Gutenberg University Mainz published this article in journal ACM Transactions on Storage.

Abstract

The imbalanced I/O load on large parallel file systems affects the parallel I/O performance of high-performance computing (HPC) applications. One of the main reasons for I/O imbalances is the lack of a global view of system-wide resource consumption. While approaches to address the problem already exist, the diversity of HPC workloads combined with different file striping patterns prevents widespread adoption of these approaches. In addition, load-balancing techniques should be transparent to client applications. To address these issues, we propose Tarazu, an end-to-end control plane where clients transparently and adaptively write to a set of selected I/O servers to achieve balanced data placement. Our control plane leverages real-time load statistics for global data placement on distributed storage servers, while our design model employs trace-based optimization techniques to minimize latency for I/O load requests between clients and servers and to handle multiple striping patterns in files. We evaluate our proposed system on an experimental cluster for two common use cases: the synthetic I/O benchmark IOR and the scientific application I/O kernel HACC-I/O. We also use a discrete-time simulator with real HPC application traces from emerging workloads running on the Summit supercomputer to validate the effectiveness and scalability of Tarazu in large-scale storage environments. The results show improvements in load balancing and read performance of up to 33% and 43%, respectively, compared to the state-of-the-art.

Authors: Arnab K. Paul (BITS Pilani), Sarah Neuwirth (Johannes Gutenberg University Mainz), Bharti Wadhwa (IBM Research), Feiyi Wang (ORNL), Sarp Oral (ORNL), Ali R. Butt (Virginia Tech)

DOI: 10.1145/3641885