Dynamic I/O-aware scheduling for batch-mode applications on chip multiprocessor systems of cluster platforms

Fang Lv, Hui Min Cui, Lei Wang, Lei Liu, Cheng Gang Wu, Xiao Bing Feng, Pen Chung Yew

Research output: Contribution to journalArticle

7 Scopus citations

Abstract

Efficiency of batch processing is becoming increasingly important for many modern commercial service centers, e.g., clusters and cloud computing datacenters. However, periodical resource contentions have become the major performance obstacles for concurrently running applications on mainstream CMP servers. I/O contention is such a kind of obstacle, which may impede both the co-running performance of batch jobs and the system throughput seriously. In this paper, a dynamic I/O-aware scheduling algorithm is proposed to lower the impacts of I/O contention and to enhance the co-running performance in batch processing. We set up our environment on an 8-socket, 64-core server in Dawning Linux Cluster. Fifteen workloads ranging from 8 jobs to 256 jobs are evaluated. Our experimental results show significant improvements on the throughputs of the workloads, which range from 7% to 431%. Meanwhile, noticeable improvements on the slowdown of workloads and the average runtime for each job can be achieved. These results show that a well-tuned dynamic I/O-aware scheduler is beneficial for batch-mode services. It can also enhance the resource utilization via throughput improvement on modern service platforms.

Original languageEnglish (US)
Pages (from-to)21-37
Number of pages17
JournalJournal of Computer Science and Technology
Volume29
Issue number1
DOIs
StatePublished - Jan 1 2014

Keywords

  • I/O contention
  • batch processing
  • chip multiprocessor
  • co-running
  • scheduling

Fingerprint Dive into the research topics of 'Dynamic I/O-aware scheduling for batch-mode applications on chip multiprocessor systems of cluster platforms'. Together they form a unique fingerprint.

  • Cite this