-
Automatic detection of large-scale flux ropes and their geoeffectiveness with a machine learning approach
Authors:
Sanchita Pal,
Luiz F. G. dos Santos,
Andreas J. Weiss,
Thomas Narock,
Ayris Narock,
Teresa Nieves-Chinchilla,
Lan K. Jian,
Simon W. Good
Abstract:
Detecting large-scale flux ropes (FRs) embedded in interplanetary coronal mass ejections (ICMEs) and assessing their geoeffectiveness are essential since they can drive severe space weather. At 1 au, these FRs have an average duration of 1 day. Their most common magnetic features are large, smoothly rotating magnetic fields. Their manual detection has become a relatively common practice over decad…
▽ More
Detecting large-scale flux ropes (FRs) embedded in interplanetary coronal mass ejections (ICMEs) and assessing their geoeffectiveness are essential since they can drive severe space weather. At 1 au, these FRs have an average duration of 1 day. Their most common magnetic features are large, smoothly rotating magnetic fields. Their manual detection has become a relatively common practice over decades, although visual detection can be time-consuming and subject to observer bias. Our study proposes a pipeline that utilizes two supervised binary-classification machine learning (ML) models trained with solar wind magnetic properties to automatically detect large-scale FRs and additionally determine their geoeffectiveness. The first model is used to generate a list of auto-detected FRs. Using the properties of southward magnetic field the second model determines the geoeffectiveness of FRs. Our method identifies 88.6\% and 80\% large-scale ICMEs (duration $\ge 1$ day) observed at 1 au by Wind and Sun Earth Connection Coronal and Heliospheric Investigation (STEREO) mission, respectively. While testing with a continuous solar wind data obtained from Wind, our pipeline detected 56 of the 64 large-scale ICMEs during 2008 - 2014 period (recall= 0.875) but many false positives (precision= 0.56) as we do not take into account any additional solar wind properties than the magnetic properties. We found an accuracy of 0.88 when estimating the geoeffectiveness of the auto-detected FRs using our method. Thus, in space weather now-casting and forecasting at L1 or any planetary missions, our pipeline can be utilized to offer a first-order detection of large-scale FRs and geoeffectiveness.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
Deep Learning for Space Weather Prediction: Bridging the Gap between Heliophysics Data and Theory
Authors:
John C. Dorelli,
Chris Bard,
Thomas Y. Chen,
Daniel Da Silva,
Luiz Fernando Guides dos Santos,
Jack Ireland,
Michael Kirk,
Ryan McGranaghan,
Ayris Narock,
Teresa Nieves-Chinchilla,
Marilia Samara,
Menelaos Sarantos,
Pete Schuck,
Barbara Thompson
Abstract:
Traditionally, data analysis and theory have been viewed as separate disciplines, each feeding into fundamentally different types of models. Modern deep learning technology is beginning to unify these two disciplines and will produce a new class of predictively powerful space weather models that combine the physical insights gained by data and theory. We call on NASA to invest in the research and…
▽ More
Traditionally, data analysis and theory have been viewed as separate disciplines, each feeding into fundamentally different types of models. Modern deep learning technology is beginning to unify these two disciplines and will produce a new class of predictively powerful space weather models that combine the physical insights gained by data and theory. We call on NASA to invest in the research and infrastructure necessary for the heliophysics' community to take advantage of these advances.
△ Less
Submitted 26 December, 2022;
originally announced December 2022.
-
CME Evolution in the Structured Heliosphere and Effects at Earth and Mars During Solar Minimum
Authors:
Erika Palmerio,
Christina O. Lee,
Ian G. Richardson,
Teresa Nieves-Chinchilla,
Luiz F. G. Dos Santos,
Jacob R. Gruesbeck,
Nariaki V. Nitta,
M. Leila Mays,
Jasper S. Halekas,
Cary Zeitlin,
Shaosui Xu,
Mats Holmström,
Yoshifumi Futaana,
Tamitha Mulligan,
Benjamin J. Lynch,
Janet G. Luhmann
Abstract:
The activity of the Sun alternates between a solar minimum and a solar maximum, the former corresponding to a period of "quieter" status of the heliosphere. During solar minimum, it is in principle more straightforward to follow eruptive events and solar wind structures from their birth at the Sun throughout their interplanetary journey. In this paper, we report analysis of the origin, evolution,…
▽ More
The activity of the Sun alternates between a solar minimum and a solar maximum, the former corresponding to a period of "quieter" status of the heliosphere. During solar minimum, it is in principle more straightforward to follow eruptive events and solar wind structures from their birth at the Sun throughout their interplanetary journey. In this paper, we report analysis of the origin, evolution, and heliospheric impact of a series of solar transient events that took place during the second half of August 2018, i.e. in the midst of the late declining phase of Solar Cycle 24. In particular, we focus on two successive coronal mass ejections (CMEs) and a following high-speed stream (HSS) on their way towards Earth and Mars. We find that the first CME impacted both planets, whilst the second caused a strong magnetic storm at Earth and went on to miss Mars, which nevertheless experienced space weather effects from the stream interacting region (SIR) preceding the HSS. Analysis of remote-sensing and in-situ data supported by heliospheric modelling suggests that CME--HSS interaction resulted in the second CME rotating and deflecting in interplanetary space, highlighting that accurately reproducing the ambient solar wind is crucial even during "simpler" solar minimum periods. Lastly, we discuss the upstream solar wind conditions and transient structures responsible for driving space weather effects at Earth and Mars.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
-
Exploring the Limits of Synthetic Creation of Solar EUV Images via Image-to-Image Translation
Authors:
Valentina Salvatelli,
Luiz F. G. dos Santos,
Souvik Bose,
Brad Neuberg,
Mark C. M. Cheung,
Miho Janvier,
Meng **,
Yarin Gal,
Atilim Gunes Baydin
Abstract:
The Solar Dynamics Observatory (SDO), a NASA multi-spectral decade-long mission that has been daily producing terabytes of observational data from the Sun, has been recently used as a use-case to demonstrate the potential of machine learning methodologies and to pave the way for future deep-space mission planning. In particular, the idea of using image-to-image translation to virtually produce ext…
▽ More
The Solar Dynamics Observatory (SDO), a NASA multi-spectral decade-long mission that has been daily producing terabytes of observational data from the Sun, has been recently used as a use-case to demonstrate the potential of machine learning methodologies and to pave the way for future deep-space mission planning. In particular, the idea of using image-to-image translation to virtually produce extreme ultra-violet channels has been proposed in several recent studies, as a way to both enhance missions with less available channels and to alleviate the challenges due to the low downlink rate in deep space. This paper investigates the potential and the limitations of such a deep learning approach by focusing on the permutation of four channels and an encoder--decoder based architecture, with particular attention to how morphological traits and brightness of the solar surface affect the neural network predictions. In this work we want to answer the question: can synthetic images of the solar corona produced via image-to-image translation be used for scientific studies of the Sun? The analysis highlights that the neural network produces high-quality images over three orders of magnitude in count rate (pixel intensity) and can generally reproduce the covariance across channels within a 1% error. However the model performance drastically diminishes in correspondence of extremely high energetic events like flares, and we argue that the reason is related to the rareness of such events posing a challenge to model training.
△ Less
Submitted 19 August, 2022;
originally announced August 2022.
-
Evidence of a complex structure within the 2013 August 19 coronal mass ejection. Radial and longitudinal evolution in the inner heliosphere
Authors:
L. Rodríguez-García,
T. Nieves-Chinchilla,
R. Gómez-Herrero,
I. Zouganelis,
A. Vourlidas,
L. Balmaceda,
M. Dumbovic,
L. K. Jian,
L. Mays,
F. Carcaboso,
L. F. G. dos Santos,
J. Rodríguez-Pacheco
Abstract:
Context: Late on 2013 August 19, a coronal mass ejection (CME) erupted from an active region located near the far-side central meridian from Earth's perspective. The event and its accompanying shock were remotely observed by the STEREO-A, STEREO-B and SOHO spacecraft. The interplanetary counterpart (ICME) was intercepted by MESSENGER near 0.3 au, and by both STEREO-A and STEREO-B, near 1 au, which…
▽ More
Context: Late on 2013 August 19, a coronal mass ejection (CME) erupted from an active region located near the far-side central meridian from Earth's perspective. The event and its accompanying shock were remotely observed by the STEREO-A, STEREO-B and SOHO spacecraft. The interplanetary counterpart (ICME) was intercepted by MESSENGER near 0.3 au, and by both STEREO-A and STEREO-B, near 1 au, which were separated by 78° in heliolongitude. The main objective of this study is to follow the radial and longitudinal evolution of the ICME throughout the inner heliosphere, and to examine possible scenarios for the different magnetic flux-rope configuration observed on the solar disk, and measured in situ at the locations of MESSENGER and STEREO-A, separated by 15° in heliolongitude, and at STEREO-B, which detected the ICME flank. Results: We find that the magnetic flux-rope structure detected at STEREO-B belongs to the same ICME detected at MESSENGER and STEREO-A. The opposite helicity deduced at STEREO-B, might be due to the spacecraft intercepting one of the legs of the structure far from the flux-rope axis, while STEREO-A and MESSENGER are crossing through the core of the magnetic flux rope. The different flux-rope orientations measured at MESSENGER and STEREO-A arise probably because the two spacecraft measure a curved, highly distorted and rather complex magnetic flux-rope topology. The ICME may have suffered additional distortion in its evolution in the inner heliosphere, such as the west flank is propagating faster than the east flank when arriving 1 au. Conclusions: This work illustrates how the ambient conditions can significantly affect the expansion and propagation of the CME/ICME, introducing additional irregularities to the already asymmetric eruption, and how these complex structures cannot be directly reconstructed with the current models available.
△ Less
Submitted 5 March, 2022;
originally announced March 2022.
-
Direct First PSP Observation of the Interaction of Two Successive Interplanetary Coronal Mass Ejections in November 2020
Authors:
Teresa Nieves-Chinchilla,
Nathalia Alzate,
Hebe Cremades,
Laura Rodriguez-Garcia,
Luiz F. G. Dos Santos,
Ayris Narock,
Hong Xie,
Adam Szabo Vratislav Krupar,
Marc Pulupa,
David Lario,
Michael L. Stevens,
Erika Palmerio,
Lynn B. Wilson III,
Katharine K. Reeves Ryun-Young Kwon,
M. Leila Mays,
O. Chris St. Cyr,
Phillip Hess,
Daniel B. Seaton,
Tatiana Niembro,
Stuart D. Bale,
Justin C. Kasper
Abstract:
We investigate the effects of the evolutionary processes in the internal magnetic structure of two interplanetary coronal mass ejections (ICMEs) detected in situ between 2020 November 29 and December 1 by Parker Solar Probe (PSP). The sources of the ICMEs were observed remotely at the Sun in EUV and subsequently tracked to their coronal counterparts in white light. This period is of particular int…
▽ More
We investigate the effects of the evolutionary processes in the internal magnetic structure of two interplanetary coronal mass ejections (ICMEs) detected in situ between 2020 November 29 and December 1 by Parker Solar Probe (PSP). The sources of the ICMEs were observed remotely at the Sun in EUV and subsequently tracked to their coronal counterparts in white light. This period is of particular interest to the community since it has been identified as the first widespread solar energetic particle event of Solar Cycle 25. The distribution of various solar and heliospheric-dedicated spacecraft throughout the inner heliosphere during PSP observations of these large-scale magnetic structures enables a comprehensive analysis of the internal evolution and topology of such structures. By assembling different models and techniques, we identify the signatures of interaction between the two consecutive ICMEs and the implications for their internal structure. We use multispacecraft observations in combination with a remote-sensing forward modeling technique, numerical propagation models, and in-situ reconstruction techniques. The outcome, from the full reconciliations, demonstrates that the two CMEs are interacting in the vicinity of PSP. Thus, we identify the in-situ observations based on the physical processes that are associated with the interaction and collision of both CMEs. We also expand the flux rope modeling and in-situ reconstruction technique to incorporate the aging and expansion effects in a distorted internal magnetic structure and explore the implications of both effects in the magnetic configuration of the ICMEs.
△ Less
Submitted 26 January, 2022;
originally announced January 2022.
-
The unusual widespread solar energetic particle event on 2013 August 19. Solar origin and particle longitudinal distribution
Authors:
L. Rodríguez-García,
R. Gómez-Herrero,
I. Zouganelis,
L. Balmaceda,
T. Nieves-Chinchilla,
N. Dresing,
M. Dumbovic,
N. V. Nitta,
F. Carcaboso,
L. F. G. dos Santos,
L. K. Jian,
L. Mays,
D. Williams,
J. Rodríguez-Pacheco
Abstract:
Context: Late on 2013 August 19, STEREO-A, STEREO-B, MESSENGER, Mars Odyssey, and the L1 spacecraft, spanning a longitudinal range of 222° in the ecliptic plane, observed an energetic particle flux increase. The widespread solar energetic particle (SEP) event was associated with a coronal mass ejection (CME) that came from a region located near the far-side central meridian from Earth's perspectiv…
▽ More
Context: Late on 2013 August 19, STEREO-A, STEREO-B, MESSENGER, Mars Odyssey, and the L1 spacecraft, spanning a longitudinal range of 222° in the ecliptic plane, observed an energetic particle flux increase. The widespread solar energetic particle (SEP) event was associated with a coronal mass ejection (CME) that came from a region located near the far-side central meridian from Earth's perspective. The CME erupted in two stages, and was accompanied by a late M-class flare observed as a post-eruptive arcade, persisting low-frequency (interplanetary) type II and groups of shock-accelerated type III radio bursts, all of them making this SEP event unusual. Aims: There are two main objectives of this study, disentangling the reasons for the different intensity-time profiles observed by the spacecraft, especially at MESSENGER and STEREO-A locations, longitudinally separated by only 15°, and unravelling the single solar source related with the widespread SEP event. Results: The solar source associated with the widespread SEP event is the shock driven by the CME, as the flare observed as a post-eruptive arcade is too late to explain the estimated particle onset. The different intensity-time profiles observed by STEREO-A, located at 0.97 au, and MESSENGER, at 0.33 au, can be interpreted as enhanced particle scattering beyond Mercury's orbit. The longitudinal extent of the shock does not explain by itself the wide spread of particles in the heliosphere. The particle increase observed at L1 may be attributed to cross-field diffusion transport, and this is also the case for STEREO-B, at least until the spacecraft is eventually magnetically connected to the shock when it reaches ~0.6 au.
△ Less
Submitted 21 July, 2021;
originally announced July 2021.
-
Multi-Channel Auto-Calibration for the Atmospheric Imaging Assembly using Machine Learning
Authors:
Luiz F. G. dos Santos,
Souvik Bose,
Valentina Salvatelli,
Brad Neuberg,
Mark C. M. Cheung,
Miho Janvier,
Meng **,
Yarin Gal,
Paul Boerner,
Atılım Güneş Baydin
Abstract:
Solar activity plays a quintessential role in influencing the interplanetary medium and space-weather around the Earth. Remote sensing instruments onboard heliophysics space missions provide a pool of information about the Sun's activity via the measurement of its magnetic field and the emission of light from the multi-layered, multi-thermal, and dynamic solar atmosphere. Extreme UV (EUV) waveleng…
▽ More
Solar activity plays a quintessential role in influencing the interplanetary medium and space-weather around the Earth. Remote sensing instruments onboard heliophysics space missions provide a pool of information about the Sun's activity via the measurement of its magnetic field and the emission of light from the multi-layered, multi-thermal, and dynamic solar atmosphere. Extreme UV (EUV) wavelength observations from space help in understanding the subtleties of the outer layers of the Sun, namely the chromosphere and the corona. Unfortunately, such instruments, like the Atmospheric Imaging Assembly (AIA) onboard NASA's Solar Dynamics Observatory (SDO), suffer from time-dependent degradation, reducing their sensitivity. Current state-of-the-art calibration techniques rely on periodic sounding rockets, which can be infrequent and rather unfeasible for deep-space missions. We present an alternative calibration approach based on convolutional neural networks (CNNs). We use SDO-AIA data for our analysis. Our results show that CNN-based models could comprehensively reproduce the sounding rocket experiments' outcomes within a reasonable degree of accuracy, indicating that it performs equally well compared with the current techniques. Furthermore, a comparison with a standard "astronomer's technique" baseline model reveals that the CNN approach significantly outperforms this baseline. Our approach establishes the framework for a novel technique to calibrate EUV instruments and advance our understanding of the cross-channel relation between different EUV channels.
△ Less
Submitted 1 February, 2021; v1 submitted 27 December, 2020;
originally announced December 2020.
-
Identifying Flux Rope Signatures Using a Deep Neural Network
Authors:
Luiz F. G. dos Santos,
Ayris Narock,
Teresa Nieves-Chinchilla,
Marlon Nuñez,
Michael Kirk
Abstract:
Among the current challenges in Space Weather, one of the main ones is to forecast the internal magnetic configuration within Interplanetary Coronal Mass Ejections (ICMEs). Currently, a monotonic and coherent magnetic configuration observed is associated with the result of a spacecraft crossing a large flux rope with helical magnetic field lines topology. The classification of such an arrangement…
▽ More
Among the current challenges in Space Weather, one of the main ones is to forecast the internal magnetic configuration within Interplanetary Coronal Mass Ejections (ICMEs). Currently, a monotonic and coherent magnetic configuration observed is associated with the result of a spacecraft crossing a large flux rope with helical magnetic field lines topology. The classification of such an arrangement is essential to predict geomagnetic disturbance. Thus, the classification relies on the assumption that the ICME's internal structure is a well organized magnetic flux rope. This paper applies machine learning and a current physical flux rope analytical model to identify and further understand the internal structures of ICMEs. We trained an image recognition artificial neural network with analytical flux rope data, generated from the range of many possible trajectories within a cylindrical (circular and elliptical cross-section) model. The trained network was then evaluated against the observed ICMEs from WIND during 1995-2015.
The methodology developed in this paper can classify 84% of simple real cases correctly and has a 76% success rate when extended to a broader set with 5% noise applied, although it does exhibit a bias in favor of positive flux rope classification. As a first step towards a generalizable classification and parameterization tool, these results show promise. With further tuning and refinement, our model presents a strong potential to evolve into a robust tool for identifying flux rope configurations from in situ data.
△ Less
Submitted 30 August, 2020;
originally announced August 2020.
-
Auto-Calibration of Remote Sensing Solar Telescopes with Deep Learning
Authors:
Brad Neuberg,
Souvik Bose,
Valentina Salvatelli,
Luiz F. G. dos Santos,
Mark Cheung,
Miho Janvier,
Atilim Gunes Baydin,
Yarin Gal,
Meng **
Abstract:
As a part of NASA's Heliophysics System Observatory (HSO) fleet of satellites,the Solar Dynamics Observatory (SDO) has continuously monitored the Sun since2010. Ultraviolet (UV) and Extreme UV (EUV) instruments in orbit, such asSDO's Atmospheric Imaging Assembly (AIA) instrument, suffer time-dependent degradation which reduces instrument sensitivity. Accurate calibration for (E)UV instruments curr…
▽ More
As a part of NASA's Heliophysics System Observatory (HSO) fleet of satellites,the Solar Dynamics Observatory (SDO) has continuously monitored the Sun since2010. Ultraviolet (UV) and Extreme UV (EUV) instruments in orbit, such asSDO's Atmospheric Imaging Assembly (AIA) instrument, suffer time-dependent degradation which reduces instrument sensitivity. Accurate calibration for (E)UV instruments currently depends on periodic sounding rockets, which are infrequent and not practical for heliophysics missions in deep space. In the present work, we develop a Convolutional Neural Network (CNN) that auto-calibrates SDO/AIA channels and corrects sensitivity degradation by exploiting spatial patterns in multi-wavelength observations to arrive at a self-calibration of (E)UV imaging instruments. Our results remove a major impediment to develo** future HSOmissions of the same scientific caliber as SDO but in deep space, able to observe the Sun from more vantage points than just SDO's current geosynchronous orbit.This approach can be adopted to perform autocalibration of other imaging systems exhibiting similar forms of degradation
△ Less
Submitted 10 November, 2019;
originally announced November 2019.
-
Using U-Nets to Create High-Fidelity Virtual Observations of the Solar Corona
Authors:
Valentina Salvatelli,
Souvik Bose,
Brad Neuberg,
Luiz F. G. dos Santos,
Mark Cheung,
Miho Janvier,
Atilim Gunes Baydin,
Yarin Gal,
Meng **
Abstract:
Understanding and monitoring the complex and dynamic processes of the Sun is important for a number of human activities on Earth and in space. For this reason, NASA's Solar Dynamics Observatory (SDO) has been continuously monitoring the multi-layered Sun's atmosphere in high-resolution since its launch in 2010, generating terabytes of observational data every day. The synergy between machine learn…
▽ More
Understanding and monitoring the complex and dynamic processes of the Sun is important for a number of human activities on Earth and in space. For this reason, NASA's Solar Dynamics Observatory (SDO) has been continuously monitoring the multi-layered Sun's atmosphere in high-resolution since its launch in 2010, generating terabytes of observational data every day. The synergy between machine learning and this enormous amount of data has the potential, still largely unexploited, to advance our understanding of the Sun and extend the capabilities of heliophysics missions. In the present work, we show that deep learning applied to SDO data can be successfully used to create a high-fidelity virtual telescope that generates synthetic observations of the solar corona by image translation. Towards this end we developed a deep neural network, structured as an encoder-decoder with skip connections (U-Net), that reconstructs the Sun's image of one instrument channel given temporally aligned images in three other channels. The approach we present has the potential to reduce the telemetry needs of SDO, enhance the capabilities of missions that have less observing channels, and transform the concept development of future missions.
△ Less
Submitted 10 November, 2019;
originally announced November 2019.
-
Constraining the Mass and the Non-Radial Drag Coefficient of a Solar Coronal Mass Ejection
Authors:
C. Kay,
L. F. G. dos Santos,
M. Opher
Abstract:
Decades of observations show that CMEs can deflect from a purely radial trajectory yet no consensus exists as to the cause of these deflections. Many of theories attribute the CME deflection to magnetic forces. We developed ForeCAT (Kay et al. 2013, Kay et al. 2015), a model for CME deflections based solely on magnetic forces, neglecting any reconnection effects. Here we compare ForeCAT prediction…
▽ More
Decades of observations show that CMEs can deflect from a purely radial trajectory yet no consensus exists as to the cause of these deflections. Many of theories attribute the CME deflection to magnetic forces. We developed ForeCAT (Kay et al. 2013, Kay et al. 2015), a model for CME deflections based solely on magnetic forces, neglecting any reconnection effects. Here we compare ForeCAT predictions to the observed deflection of the 2008 December 12 CME and find that ForeCAT can accurately reproduce the observations. Multiple observations show that this CME deflected nearly 30° in latitude (Byrne et al. 2010, Gui et al. 2011) and 4.4° in longitude (Gui et al. 2011). From the observations, we are able to constrain all of the ForeCAT input parameters (initial position, radial propagation speed, and expansion) except the CME mass and the drag coefficient that affects the CME motion. By minimizing the reduced chi-squared, $χ^2_ν$, between the ForeCAT results and the observations we determine an acceptable mass range between 4.5x10$^{14}$ and 1x10$^{15}$ g and the drag coefficient less than 1.4 with a best fit at 7.5x10$^{14}$ g and 0 for the mass and drag coefficient. ForeCAT is sensitive to the magnetic background and we are also able to constrain the rate at which the quiet sun magnetic field falls to be similar or to or fall slightly slower than the Potential Field Source Surface model.
△ Less
Submitted 2 March, 2015;
originally announced March 2015.
