High performance wide area data transfers over high performance networks

P. Dickens, W. Gropp, Paul R Woodward

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

This paper introduces a new user-level communication protocol designed to provide high-performance data transfers across high-bandwidth, high-delay, networks. The protocol incorporates the most important enhancements defined by the networking community to improve the performance to TCP for this environment, and also defines enhancements unique to this protocol. In terms of the so-called "Large Window" extensions to TCP, this protocol implements a communication window that is essentially infinite, and provides a selective acknowledgement window that spans the entire data transfer. In terms of user-level extensions to TCP, it implements a user-defined acknowledgement frequency, a user-defined "batch sending" window, and a simple framework within which the user can define the algorithm that determines the next data packet to be sent out across all eligible packets. We present experimental results demonstrating data throughput on the order of 85%-92% of the maximum available bandwidth across both short haul and long haul high-performance networks.

Original languageEnglish (US)
Title of host publicationProceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages1
ISBN (Electronic)0769515738, 9780769515731
DOIs
StatePublished - Jan 1 2002
Event16th International Parallel and Distributed Processing Symposium, IPDPS 2002 - Ft. Lauderdale, United States
Duration: Apr 15 2002Apr 19 2002

Publication series

NameProceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002

Other

Other16th International Parallel and Distributed Processing Symposium, IPDPS 2002
CountryUnited States
CityFt. Lauderdale
Period4/15/024/19/02

Fingerprint

Data Transfer
Data transfer
Network performance
High Performance
Network protocols
Bandwidth
Enhancement
Communication Protocol
Networking
Throughput
Batch
Entire
Communication
Experimental Results

Cite this

Dickens, P., Gropp, W., & Woodward, P. R. (2002). High performance wide area data transfers over high performance networks. In Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002 [1016675] (Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IPDPS.2002.1016675

High performance wide area data transfers over high performance networks. / Dickens, P.; Gropp, W.; Woodward, Paul R.

Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002. Institute of Electrical and Electronics Engineers Inc., 2002. 1016675 (Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Dickens, P, Gropp, W & Woodward, PR 2002, High performance wide area data transfers over high performance networks. in Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002., 1016675, Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002, Institute of Electrical and Electronics Engineers Inc., 16th International Parallel and Distributed Processing Symposium, IPDPS 2002, Ft. Lauderdale, United States, 4/15/02. https://doi.org/10.1109/IPDPS.2002.1016675
Dickens P, Gropp W, Woodward PR. High performance wide area data transfers over high performance networks. In Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002. Institute of Electrical and Electronics Engineers Inc. 2002. 1016675. (Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002). https://doi.org/10.1109/IPDPS.2002.1016675
Dickens, P. ; Gropp, W. ; Woodward, Paul R. / High performance wide area data transfers over high performance networks. Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002. Institute of Electrical and Electronics Engineers Inc., 2002. (Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002).
@inproceedings{a693890dadf2435c8130157cc5671391,
title = "High performance wide area data transfers over high performance networks",
abstract = "This paper introduces a new user-level communication protocol designed to provide high-performance data transfers across high-bandwidth, high-delay, networks. The protocol incorporates the most important enhancements defined by the networking community to improve the performance to TCP for this environment, and also defines enhancements unique to this protocol. In terms of the so-called {"}Large Window{"} extensions to TCP, this protocol implements a communication window that is essentially infinite, and provides a selective acknowledgement window that spans the entire data transfer. In terms of user-level extensions to TCP, it implements a user-defined acknowledgement frequency, a user-defined {"}batch sending{"} window, and a simple framework within which the user can define the algorithm that determines the next data packet to be sent out across all eligible packets. We present experimental results demonstrating data throughput on the order of 85{\%}-92{\%} of the maximum available bandwidth across both short haul and long haul high-performance networks.",
author = "P. Dickens and W. Gropp and Woodward, {Paul R}",
year = "2002",
month = "1",
day = "1",
doi = "10.1109/IPDPS.2002.1016675",
language = "English (US)",
series = "Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002",

}

TY - GEN

T1 - High performance wide area data transfers over high performance networks

AU - Dickens, P.

AU - Gropp, W.

AU - Woodward, Paul R

PY - 2002/1/1

Y1 - 2002/1/1

N2 - This paper introduces a new user-level communication protocol designed to provide high-performance data transfers across high-bandwidth, high-delay, networks. The protocol incorporates the most important enhancements defined by the networking community to improve the performance to TCP for this environment, and also defines enhancements unique to this protocol. In terms of the so-called "Large Window" extensions to TCP, this protocol implements a communication window that is essentially infinite, and provides a selective acknowledgement window that spans the entire data transfer. In terms of user-level extensions to TCP, it implements a user-defined acknowledgement frequency, a user-defined "batch sending" window, and a simple framework within which the user can define the algorithm that determines the next data packet to be sent out across all eligible packets. We present experimental results demonstrating data throughput on the order of 85%-92% of the maximum available bandwidth across both short haul and long haul high-performance networks.

AB - This paper introduces a new user-level communication protocol designed to provide high-performance data transfers across high-bandwidth, high-delay, networks. The protocol incorporates the most important enhancements defined by the networking community to improve the performance to TCP for this environment, and also defines enhancements unique to this protocol. In terms of the so-called "Large Window" extensions to TCP, this protocol implements a communication window that is essentially infinite, and provides a selective acknowledgement window that spans the entire data transfer. In terms of user-level extensions to TCP, it implements a user-defined acknowledgement frequency, a user-defined "batch sending" window, and a simple framework within which the user can define the algorithm that determines the next data packet to be sent out across all eligible packets. We present experimental results demonstrating data throughput on the order of 85%-92% of the maximum available bandwidth across both short haul and long haul high-performance networks.

UR - http://www.scopus.com/inward/record.url?scp=84966586070&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84966586070&partnerID=8YFLogxK

U2 - 10.1109/IPDPS.2002.1016675

DO - 10.1109/IPDPS.2002.1016675

M3 - Conference contribution

T3 - Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002

BT - Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002

PB - Institute of Electrical and Electronics Engineers Inc.

ER -