The fluid database paradigm: A prototype

A. Weinstein, Lucy F Fortson, T. Brantseg, Cameron B Rulten, R. Lutz, Jarvis D Haupt, M. Kadkhodaie Elyaderani

Research output: Contribution to journalConference articlepeer-review


The process of event-building-i.e gathering and associating data from multiple sensors or subdetectors that arises from a common physical event-is used in many fields, including high-energy physics and gamma-ray astronomy. The problem of fault tolerance in event-building is a difficult one, and one that becomes increasingly difficult with higher data throughput rates and increasing numbers of sub-detectors. We draw on biological self-assembly models in the development of a novel event-building paradigm that treats each packet of data from an individual sensor or sub-detector as if it were a molecule in solution. Bonds (analogous to chemical bonds) are defined between data packets using metadata-based discriminants. A database, which plays the role of a beaker of solution, quasi-randomly and continually selects pairs of assemblies to test for bonds, allowing single tiles and small assemblies to aggregate into larger assemblies. During this process higher-quality associations supersede spurious ones. The database thereby becomes fluid, dynamic, and self-annealing rather than static. We will describe lessons learned from early prototypes of the fluid database as well as future directions.

Original languageEnglish (US)
JournalProceedings of Science
VolumePart F128556
StatePublished - 2016
Event38th International Conference on High Energy Physics, ICHEP 2016 - Chicago, United States
Duration: Aug 3 2016Aug 10 2016

Bibliographical note

Funding Information:
This research is supported by Award #NSF/PHY-1419259 and Award #NSF/PHY-1419250 from the US National Science Foundation. We gratefully acknowledge the use of test data from VERITAS, which is supported by grants from the US Department of Energy Office of Science, the National Science Foundation, and the Smithsonian Institution, and by NSERC in Canada. We acknowledge the excellent work of the technical support staff at the Fred Lawrence Whipple Observatory and at the collaborating institutions in the construction and operation of this instrument. The VERITAS Collaboration is grateful to Trevor Weekes for his seminal contributions and leadership in the field of VHE gamma-ray astrophysics.

Publisher Copyright:
© Copyright owned by the author(s) under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND 4.0).


Dive into the research topics of 'The fluid database paradigm: A prototype'. Together they form a unique fingerprint.

Cite this