Accelerating data shuffling in MapReduce framework with a scale-up NUMA computing architecture

Xiang Cao, Kewal Keshaorao Panchputre, David H Du

Research output: Contribution to journalConference articlepeer-review

1 Scopus citations


Nowadays, MapReduce has become very popular in many applications, such as high performance computing. It typically consists of map, shuffle and reduce phases. As an important one among these three phases, data shuffling usually accounts for a large portion of the entire running time of MapReduce jobs. MapReduce was originally designed in scale-out architecture with inexpensive commodity machines. However, in recent years, scale-up computing architecture for MapReduce jobs has been developed. Some studies indicate that in certain cases, a powerful scale-up machine can outperform a scaleout cluster with multiple machines. With multi-processor, multi-core design connected via NUMAlink and large shared memories, NUMA architecture provides a powerful scaleup computing capability. Compared with Ethernet connection and TCP/IP network, NUMAlink has a much faster data transfer speed which can greatly expedite the data shuffling of MapReduce jobs. The impact of NUMAlink on data shuffling in NUMA scaleup architecture has not been fully investigated in previous work. In this paper, we ignore the computing power (i.e., map and reduce phases) of MapReduce, but focus on the optimization of data shuffling phase in MapReduce framework in NUMA machine. We concentrate on the various bandwidth capacities of NUMAlink(s) among different memory locations to fully utilize the network. We investigate the NUMA-link topology using SGI UV 2000 as an example and propose a topology-aware reducer placement algorithm to speed up the data shuffling phase. In addition, we extend our approach to a larger computing environment with multiple NUMA machines, and design a reducer placement scheme to expedite the inter-NUMA machine data shuffling. Experiments results show that data shuffling time can be greatly reduced in NUMA architecture with our solution.

Original languageEnglish (US)
Pages (from-to)122-129
Number of pages8
JournalSimulation Series
Issue number4
StatePublished - Jan 1 2016
Event24th High Performance Computing Symposium, HPC 2016, Part of the 2016 Spring Simulation Multi-Conference, SpringSim 2016 - Pasadena, United States
Duration: Apr 3 2016Apr 6 2016


  • Data shuffling
  • MapReduce
  • NUMA
  • Scale-up architecture


Dive into the research topics of 'Accelerating data shuffling in MapReduce framework with a scale-up NUMA computing architecture'. Together they form a unique fingerprint.

Cite this