Towards shorter task completion time in datacenter networks

Yuchao Zhang, Ke Xu, Haiyang Wang, Meng Shen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Datacenters are now used as the underlying infrastructure of many modern commercial operations, powering both large Internet services and a growing number of data-intensive scientific applications. The tasks in these applications always consist of rich and complex flows which require different resources at different time slots. The existing data center scheduling frameworks are however base on either task or flow level metrics. This simplifies the design and deployment, but hardly unleashes the potentials of obtaining low task completion time for delay sensitive applications. In this paper, we show that the performance (e.g., tail and average task completion time) of existing flow-aware and task-aware network scheduling is far from being optimal. To address such a problem, we carefully examine the possibility to consider both task and flow level metrics together and present the design of TAFA (Task-Aware and Flow-Aware) in data center networks. This approach seamlessly combines the existing flow and task metrics together while successfully avoids their problems as flow-isolation and flow indiscrimination. The evaluation result shows that TAFA can obtain a near-optimal performance and reduce over 35% task completion time for the existing data center systems.

Original languageEnglish (US)
Title of host publication2015 IEEE 34th International Performance Computing and Communications Conference, IPCCC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781467385909
DOIs
StatePublished - Feb 17 2016
Event34th IEEE International Performance Computing and Communications Conference, IPCCC 2015 - Nanjing, China
Duration: Dec 14 2015Dec 16 2015

Publication series

Name2015 IEEE 34th International Performance Computing and Communications Conference, IPCCC 2015

Other

Other34th IEEE International Performance Computing and Communications Conference, IPCCC 2015
CountryChina
CityNanjing
Period12/14/1512/16/15

Fingerprint Dive into the research topics of 'Towards shorter task completion time in datacenter networks'. Together they form a unique fingerprint.

Cite this