ctopliff / sdoml

Machine Learning Data Set for NASA's Solar Dynamics Observatory

SDOML

https://iopscience.iop.org/article/10.3847/1538-4365/ab1005/meta

Title: A Machine-learning Data Set Prepared from the NASA Solar Dynamics Observatory Mission

Authors: Galvez, Richard; Fouhey, David F.; Jin, Meng; Szenicer, Alexandre; Muñoz-Jaramillo, Andrés; Cheung, Mark C. M.; Wright, Paul J.; Bobra, Monica G.; Liu, Yang; Mason, James; Thomas, Rajat

Abstract: In this paper, we present a curated data set from the NASA Solar Dynamics Observatory (SDO) mission in a format suitable for machine-learning research. Beginning from level 1 scientific products we have processed various instrumental corrections, down-sampled to manageable spatial and temporal resolutions, and synchronized observations spatially and temporally. We illustrate the use of this data set with two example applications: forecasting future extreme ultraviolet (EUV) Variability Experiment (EVE) irradiance from present EVE irradiance and translating Helioseismic and Magnetic Imager observations into Atmospheric Imaging Assembly observations. For each application, we provide metrics and baselines for future model comparison. We anticipate this curated data set will facilitate machine-learning research in heliophysics and the physical sciences generally, increasing the scientific return of the SDO mission. This work is a direct result of the 2018 NASA Frontier Development Laboratory Program. Please see the Appendix for access to the data set, totaling 6.5TBs.

Affiliation: AA(Center for Data Science, New York University, New York, NY 10011, USA 0000-0002-4780-9566), AB(University of Michigan, Ann Arbor, MI 48109, USA 0000-0001-5028-5161), AC(Lockheed Martin Solar & Astrophysics Laboratory, Palo Alto, CA, USA ; SETI Institute, Mountain View, CA 94043, USA 0000-0002-9672-3873), AD(University of Oxford, Oxford OX1 2JD, UK 0000-0002-4829-5739), AE(Southwest Research Institute, San Antonio, TX 78238, USA 0000-0002-4716-0840), AF(Lockheed Martin Solar & Astrophysics Laboratory, Palo Alto, CA, USA ; Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA 94305, USA 0000-0003-2110-9753), AG(SUPA School of Physics & Astronomy, University of Glasgow, Glasgow G12 8QQ, UK 0000-0001-9021-611X), AH(Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA 94305, USA 0000-0002-5662-9604), AI(Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA 94305, USA 0000-0002-0671-689X), AJ(NASA Goddard Space Flight Center, Greenbelt, MD 20771, USA 0000-0002-3783-5509), AK(University of Amsterdam, 1012 WX Amsterdam, Netherlands 0000-0002-5362-4816)

Publication: The Astrophysical Journal Supplement Series, Volume 242, Issue 1, article id. 7, 11 pp. (2019). (ApJS Homepage)

Publication Date: 05/2019

Acknowledgements: AIA, EVE & HMI are instruments onboard the Solar Dynamics Observatory, a mission for NASA's Living With a Star program.

contact: Mark Cheung (@fluxtransport)