Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis

Derik Barseghian; Ilkay Altintas; Matthew B. Jones; Daniel Crawl; Nathan Potter; James Gallagher; Peter Cornillon; Mark Schildhauer; Elizabeth T. Borer; Eric W. Seabloom; Parviez R. Hosseini

doi:10.1016/j.ecoinf.2009.08.008

Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis

Derik Barseghian, Ilkay Altintas, Matthew B. Jones, Daniel Crawl, Nathan Potter, James Gallagher, Peter Cornillon, Mark Schildhauer, Elizabeth T. Borer, Eric W. Seabloom, Parviez R. Hosseini

Ecology, Evolution and Behavior

Research output: Contribution to journal › Article › peer-review

89 Scopus citations

Abstract

Environmental sensor networks are now commonly being deployed within environmental observatories and as components of smaller-scale ecological and environmental experiments. Effectively using data from these sensor networks presents technical challenges that are difficult for scientists to overcome, severely limiting the adoption of automated sensing technologies in environmental science. The Realtime Environment for Analytical Processing (REAP) is an NSF-funded project to address the technical challenges related to accessing and using heterogeneous sensor data from within the Kepler scientific workflow system. Using distinct use cases in terrestrial ecology and oceanography as motivating examples, we describe workflows and extensions to Kepler to stream and analyze data from observatory networks and archives. We focus on the use of two newly integrated data sources in Kepler: DataTurbine and OPeNDAP. Integrated access to both near real-time data streams and data archives from within Kepler facilitates both simple data exploration and sophisticated analysis and modeling with these data sources.

Original language	English (US)
Pages (from-to)	42-50
Number of pages	9
Journal	Ecological Informatics
Volume	5
Issue number	1
DOIs	https://doi.org/10.1016/j.ecoinf.2009.08.008
State	Published - Jan 2010

Bibliographical note

Funding Information:
This material is based upon work supported by the National Science Foundation under award 0619060 for the REAP project, and by the National Center for Ecological Analysis and Synthesis , a Center funded by NSF (Grant # DEB-0553768 ), the University of California, Santa Barbara, and the State of California.

Keywords

Data analysis
Near real-time data access
Oceanography
Scientific workflows
Sensors
Terrestrial ecology

Publisher link

10.1016/j.ecoinf.2009.08.008

Find It

Find It at U of M Libraries

Cite this

Barseghian, D., Altintas, I., Jones, M. B., Crawl, D., Potter, N., Gallagher, J., Cornillon, P., Schildhauer, M., Borer, E. T., Seabloom, E. W., & Hosseini, P. R. (2010). Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis. Ecological Informatics, 5(1), 42-50. https://doi.org/10.1016/j.ecoinf.2009.08.008

@article{7a387bf942f24886a78e8dc20eb139e7,

title = "Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis",

abstract = "Environmental sensor networks are now commonly being deployed within environmental observatories and as components of smaller-scale ecological and environmental experiments. Effectively using data from these sensor networks presents technical challenges that are difficult for scientists to overcome, severely limiting the adoption of automated sensing technologies in environmental science. The Realtime Environment for Analytical Processing (REAP) is an NSF-funded project to address the technical challenges related to accessing and using heterogeneous sensor data from within the Kepler scientific workflow system. Using distinct use cases in terrestrial ecology and oceanography as motivating examples, we describe workflows and extensions to Kepler to stream and analyze data from observatory networks and archives. We focus on the use of two newly integrated data sources in Kepler: DataTurbine and OPeNDAP. Integrated access to both near real-time data streams and data archives from within Kepler facilitates both simple data exploration and sophisticated analysis and modeling with these data sources.",

keywords = "Data analysis, Near real-time data access, Oceanography, Scientific workflows, Sensors, Terrestrial ecology",

author = "Derik Barseghian and Ilkay Altintas and Jones, {Matthew B.} and Daniel Crawl and Nathan Potter and James Gallagher and Peter Cornillon and Mark Schildhauer and Borer, {Elizabeth T.} and Seabloom, {Eric W.} and Hosseini, {Parviez R.}",

note = "Funding Information: This material is based upon work supported by the National Science Foundation under award 0619060 for the REAP project, and by the National Center for Ecological Analysis and Synthesis , a Center funded by NSF (Grant # DEB-0553768 ), the University of California, Santa Barbara, and the State of California.",

year = "2010",

month = jan,

doi = "10.1016/j.ecoinf.2009.08.008",

language = "English (US)",

volume = "5",

pages = "42--50",

journal = "Ecological Informatics",

issn = "1574-9541",

publisher = "Elsevier B.V.",

number = "1",

}

TY - JOUR

T1 - Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis

AU - Barseghian, Derik

AU - Altintas, Ilkay

AU - Jones, Matthew B.

AU - Crawl, Daniel

AU - Potter, Nathan

AU - Gallagher, James

AU - Cornillon, Peter

AU - Schildhauer, Mark

AU - Borer, Elizabeth T.

AU - Seabloom, Eric W.

AU - Hosseini, Parviez R.

N1 - Funding Information: This material is based upon work supported by the National Science Foundation under award 0619060 for the REAP project, and by the National Center for Ecological Analysis and Synthesis , a Center funded by NSF (Grant # DEB-0553768 ), the University of California, Santa Barbara, and the State of California.

PY - 2010/1

Y1 - 2010/1

N2 - Environmental sensor networks are now commonly being deployed within environmental observatories and as components of smaller-scale ecological and environmental experiments. Effectively using data from these sensor networks presents technical challenges that are difficult for scientists to overcome, severely limiting the adoption of automated sensing technologies in environmental science. The Realtime Environment for Analytical Processing (REAP) is an NSF-funded project to address the technical challenges related to accessing and using heterogeneous sensor data from within the Kepler scientific workflow system. Using distinct use cases in terrestrial ecology and oceanography as motivating examples, we describe workflows and extensions to Kepler to stream and analyze data from observatory networks and archives. We focus on the use of two newly integrated data sources in Kepler: DataTurbine and OPeNDAP. Integrated access to both near real-time data streams and data archives from within Kepler facilitates both simple data exploration and sophisticated analysis and modeling with these data sources.

AB - Environmental sensor networks are now commonly being deployed within environmental observatories and as components of smaller-scale ecological and environmental experiments. Effectively using data from these sensor networks presents technical challenges that are difficult for scientists to overcome, severely limiting the adoption of automated sensing technologies in environmental science. The Realtime Environment for Analytical Processing (REAP) is an NSF-funded project to address the technical challenges related to accessing and using heterogeneous sensor data from within the Kepler scientific workflow system. Using distinct use cases in terrestrial ecology and oceanography as motivating examples, we describe workflows and extensions to Kepler to stream and analyze data from observatory networks and archives. We focus on the use of two newly integrated data sources in Kepler: DataTurbine and OPeNDAP. Integrated access to both near real-time data streams and data archives from within Kepler facilitates both simple data exploration and sophisticated analysis and modeling with these data sources.

KW - Data analysis

KW - Near real-time data access

KW - Oceanography

KW - Scientific workflows

KW - Sensors

KW - Terrestrial ecology

UR - http://www.scopus.com/inward/record.url?scp=75949121297&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=75949121297&partnerID=8YFLogxK

U2 - 10.1016/j.ecoinf.2009.08.008

DO - 10.1016/j.ecoinf.2009.08.008

M3 - Article

AN - SCOPUS:75949121297

SN - 1574-9541

VL - 5

SP - 42

EP - 50

JO - Ecological Informatics

JF - Ecological Informatics

IS - 1

ER -

Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis

Abstract

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this