Rethinking adaptability in wide-area stream processing systems

Albert Jonathan, Abhishek Chandra, Jon Weissman

Research output: Contribution to conferencePaper

3 Scopus citations

Abstract

Adaptability is an important property of stream processing systems since the systems need to maintain low latency and high throughput execution of long-running queries. In a wide-area environment, dynamics are common not only because of the workload variability but also the nature of wide-area network (WAN) bandwidth that frequently changes. In this work, we study the adaptability property of stream processing systems designed for a wide-area environment. Specifically, we (1) discuss the challenges of reconfiguring query executions in a wide-area environment, (2) propose ideas how to adapt existing reconfiguration techniques used in centralized Cloud to a wide-area environment, and (3) discuss the tradeoffs between them. A key finding is that the best adaptation technique to use depends on the network conditions, types of query, and optimization metrics.

Original languageEnglish (US)
StatePublished - Jan 1 2018
Event10th USENIX Workshop on Hot Topics in Cloud Computing, HotCloud 2018 - Boston, United States
Duration: Jul 9 2018 → …

Conference

Conference10th USENIX Workshop on Hot Topics in Cloud Computing, HotCloud 2018
CountryUnited States
CityBoston
Period7/9/18 → …

Fingerprint Dive into the research topics of 'Rethinking adaptability in wide-area stream processing systems'. Together they form a unique fingerprint.

  • Cite this

    Jonathan, A., Chandra, A., & Weissman, J. (2018). Rethinking adaptability in wide-area stream processing systems. Paper presented at 10th USENIX Workshop on Hot Topics in Cloud Computing, HotCloud 2018, Boston, United States.