Machine learning for the Zwicky transient facility

Ashish Mahabal, Umaa Rebbapragada, Richard Walters, Frank J. Masci, Nadejda Blagorodnova, Jan van Roestel, Quan Zhi Ye, Rahul Biswas, Kevin Burdge, Chan Kao Chang, Dmitry A. Duev, V. Zach Golkhou, Adam A. Miller, Jakob Nordin, Charlotte Ward, Scott Adams, Eric C. Bellm, Doug Branton, Brian Bue, Chris CannellaAndrew Connolly, Richard Dekany, Ulrich Feindt, Tiara Hung, Lucy F Fortson, Sara Frederick, C. Fremling, Suvi Gezari, Matthew Graham, Steven Groom, Mansi M. Kasliwal, Shrinivas Kulkarni, Thomas Kupfer, Hsing Wen Lin, Chris Lintott, Ragnhild Lunnan, John Parejko, Thomas A. Prince, Reed Riddle, Ben Rusholme, Nicholas Saunders, Nima Sedaghat, David L. Shupe, Leo P. Singer, Maayane T. Soumagnac, Paula Szkody, Yutaro Tachibana, Kushal Tirumala, Sjoert van Velzen, Darryl E Wright

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

Original languageEnglish (US)
Article number038002
JournalPublications of the Astronomical Society of the Pacific
Volume131
Issue number997
DOIs
StatePublished - Mar 1 2019

Fingerprint

machine learning
learning
asteroids
night
asteroid
light curve
education
platforms
galaxies
filter
filters
stars
method
plan

Keywords

  • Machine learning
  • Sky surveys
  • Time domain

Cite this

Mahabal, A., Rebbapragada, U., Walters, R., Masci, F. J., Blagorodnova, N., van Roestel, J., ... Wright, D. E. (2019). Machine learning for the Zwicky transient facility. Publications of the Astronomical Society of the Pacific, 131(997), [038002]. https://doi.org/10.1088/1538-3873/aaf3fa

Machine learning for the Zwicky transient facility. / Mahabal, Ashish; Rebbapragada, Umaa; Walters, Richard; Masci, Frank J.; Blagorodnova, Nadejda; van Roestel, Jan; Ye, Quan Zhi; Biswas, Rahul; Burdge, Kevin; Chang, Chan Kao; Duev, Dmitry A.; Zach Golkhou, V.; Miller, Adam A.; Nordin, Jakob; Ward, Charlotte; Adams, Scott; Bellm, Eric C.; Branton, Doug; Bue, Brian; Cannella, Chris; Connolly, Andrew; Dekany, Richard; Feindt, Ulrich; Hung, Tiara; Fortson, Lucy F; Frederick, Sara; Fremling, C.; Gezari, Suvi; Graham, Matthew; Groom, Steven; Kasliwal, Mansi M.; Kulkarni, Shrinivas; Kupfer, Thomas; Lin, Hsing Wen; Lintott, Chris; Lunnan, Ragnhild; Parejko, John; Prince, Thomas A.; Riddle, Reed; Rusholme, Ben; Saunders, Nicholas; Sedaghat, Nima; Shupe, David L.; Singer, Leo P.; Soumagnac, Maayane T.; Szkody, Paula; Tachibana, Yutaro; Tirumala, Kushal; van Velzen, Sjoert; Wright, Darryl E.

In: Publications of the Astronomical Society of the Pacific, Vol. 131, No. 997, 038002, 01.03.2019.

Research output: Contribution to journalArticle

Mahabal, A, Rebbapragada, U, Walters, R, Masci, FJ, Blagorodnova, N, van Roestel, J, Ye, QZ, Biswas, R, Burdge, K, Chang, CK, Duev, DA, Zach Golkhou, V, Miller, AA, Nordin, J, Ward, C, Adams, S, Bellm, EC, Branton, D, Bue, B, Cannella, C, Connolly, A, Dekany, R, Feindt, U, Hung, T, Fortson, LF, Frederick, S, Fremling, C, Gezari, S, Graham, M, Groom, S, Kasliwal, MM, Kulkarni, S, Kupfer, T, Lin, HW, Lintott, C, Lunnan, R, Parejko, J, Prince, TA, Riddle, R, Rusholme, B, Saunders, N, Sedaghat, N, Shupe, DL, Singer, LP, Soumagnac, MT, Szkody, P, Tachibana, Y, Tirumala, K, van Velzen, S & Wright, DE 2019, 'Machine learning for the Zwicky transient facility', Publications of the Astronomical Society of the Pacific, vol. 131, no. 997, 038002. https://doi.org/10.1088/1538-3873/aaf3fa
Mahabal A, Rebbapragada U, Walters R, Masci FJ, Blagorodnova N, van Roestel J et al. Machine learning for the Zwicky transient facility. Publications of the Astronomical Society of the Pacific. 2019 Mar 1;131(997). 038002. https://doi.org/10.1088/1538-3873/aaf3fa
Mahabal, Ashish ; Rebbapragada, Umaa ; Walters, Richard ; Masci, Frank J. ; Blagorodnova, Nadejda ; van Roestel, Jan ; Ye, Quan Zhi ; Biswas, Rahul ; Burdge, Kevin ; Chang, Chan Kao ; Duev, Dmitry A. ; Zach Golkhou, V. ; Miller, Adam A. ; Nordin, Jakob ; Ward, Charlotte ; Adams, Scott ; Bellm, Eric C. ; Branton, Doug ; Bue, Brian ; Cannella, Chris ; Connolly, Andrew ; Dekany, Richard ; Feindt, Ulrich ; Hung, Tiara ; Fortson, Lucy F ; Frederick, Sara ; Fremling, C. ; Gezari, Suvi ; Graham, Matthew ; Groom, Steven ; Kasliwal, Mansi M. ; Kulkarni, Shrinivas ; Kupfer, Thomas ; Lin, Hsing Wen ; Lintott, Chris ; Lunnan, Ragnhild ; Parejko, John ; Prince, Thomas A. ; Riddle, Reed ; Rusholme, Ben ; Saunders, Nicholas ; Sedaghat, Nima ; Shupe, David L. ; Singer, Leo P. ; Soumagnac, Maayane T. ; Szkody, Paula ; Tachibana, Yutaro ; Tirumala, Kushal ; van Velzen, Sjoert ; Wright, Darryl E. / Machine learning for the Zwicky transient facility. In: Publications of the Astronomical Society of the Pacific. 2019 ; Vol. 131, No. 997.
@article{b08f9694029d444aa1e6bb664e9de57a,
title = "Machine learning for the Zwicky transient facility",
abstract = "The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.",
keywords = "Machine learning, Sky surveys, Time domain",
author = "Ashish Mahabal and Umaa Rebbapragada and Richard Walters and Masci, {Frank J.} and Nadejda Blagorodnova and {van Roestel}, Jan and Ye, {Quan Zhi} and Rahul Biswas and Kevin Burdge and Chang, {Chan Kao} and Duev, {Dmitry A.} and {Zach Golkhou}, V. and Miller, {Adam A.} and Jakob Nordin and Charlotte Ward and Scott Adams and Bellm, {Eric C.} and Doug Branton and Brian Bue and Chris Cannella and Andrew Connolly and Richard Dekany and Ulrich Feindt and Tiara Hung and Fortson, {Lucy F} and Sara Frederick and C. Fremling and Suvi Gezari and Matthew Graham and Steven Groom and Kasliwal, {Mansi M.} and Shrinivas Kulkarni and Thomas Kupfer and Lin, {Hsing Wen} and Chris Lintott and Ragnhild Lunnan and John Parejko and Prince, {Thomas A.} and Reed Riddle and Ben Rusholme and Nicholas Saunders and Nima Sedaghat and Shupe, {David L.} and Singer, {Leo P.} and Soumagnac, {Maayane T.} and Paula Szkody and Yutaro Tachibana and Kushal Tirumala and {van Velzen}, Sjoert and Wright, {Darryl E}",
year = "2019",
month = "3",
day = "1",
doi = "10.1088/1538-3873/aaf3fa",
language = "English (US)",
volume = "131",
journal = "Publications of the Astronomical Society of the Pacific",
issn = "0004-6280",
publisher = "University of Chicago",
number = "997",

}

TY - JOUR

T1 - Machine learning for the Zwicky transient facility

AU - Mahabal, Ashish

AU - Rebbapragada, Umaa

AU - Walters, Richard

AU - Masci, Frank J.

AU - Blagorodnova, Nadejda

AU - van Roestel, Jan

AU - Ye, Quan Zhi

AU - Biswas, Rahul

AU - Burdge, Kevin

AU - Chang, Chan Kao

AU - Duev, Dmitry A.

AU - Zach Golkhou, V.

AU - Miller, Adam A.

AU - Nordin, Jakob

AU - Ward, Charlotte

AU - Adams, Scott

AU - Bellm, Eric C.

AU - Branton, Doug

AU - Bue, Brian

AU - Cannella, Chris

AU - Connolly, Andrew

AU - Dekany, Richard

AU - Feindt, Ulrich

AU - Hung, Tiara

AU - Fortson, Lucy F

AU - Frederick, Sara

AU - Fremling, C.

AU - Gezari, Suvi

AU - Graham, Matthew

AU - Groom, Steven

AU - Kasliwal, Mansi M.

AU - Kulkarni, Shrinivas

AU - Kupfer, Thomas

AU - Lin, Hsing Wen

AU - Lintott, Chris

AU - Lunnan, Ragnhild

AU - Parejko, John

AU - Prince, Thomas A.

AU - Riddle, Reed

AU - Rusholme, Ben

AU - Saunders, Nicholas

AU - Sedaghat, Nima

AU - Shupe, David L.

AU - Singer, Leo P.

AU - Soumagnac, Maayane T.

AU - Szkody, Paula

AU - Tachibana, Yutaro

AU - Tirumala, Kushal

AU - van Velzen, Sjoert

AU - Wright, Darryl E

PY - 2019/3/1

Y1 - 2019/3/1

N2 - The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

AB - The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

KW - Machine learning

KW - Sky surveys

KW - Time domain

UR - http://www.scopus.com/inward/record.url?scp=85063447442&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063447442&partnerID=8YFLogxK

U2 - 10.1088/1538-3873/aaf3fa

DO - 10.1088/1538-3873/aaf3fa

M3 - Article

AN - SCOPUS:85063447442

VL - 131

JO - Publications of the Astronomical Society of the Pacific

JF - Publications of the Astronomical Society of the Pacific

SN - 0004-6280

IS - 997

M1 - 038002

ER -