-
Solar synthetic imaging: Introducing denoising diffusion probabilistic models on SDO/AIA data
Authors:
Francesco P. Ramunno,
S. Hackstein,
V. Kinakh,
M. Drozdova,
G. Quetant,
A. Csillaghy,
S. Voloshynovskiy
Abstract:
Given the rarity of significant solar flares compared to smaller ones, training effective machine learning models for solar activity forecasting is challenging due to insufficient data. This study proposes using generative deep learning models, specifically a Denoising Diffusion Probabilistic Model (DDPM), to create synthetic images of solar phenomena, including flares of varying intensities. By e…
▽ More
Given the rarity of significant solar flares compared to smaller ones, training effective machine learning models for solar activity forecasting is challenging due to insufficient data. This study proposes using generative deep learning models, specifically a Denoising Diffusion Probabilistic Model (DDPM), to create synthetic images of solar phenomena, including flares of varying intensities. By employing a dataset from the AIA instrument aboard the SDO spacecraft, focusing on the 171 Å band that captures various solar activities, and classifying images with GOES X-ray measurements based on flare intensity, we aim to address the data scarcity issue. The DDPM's performance is evaluated using cluster metrics, Frechet Inception Distance (FID), and F1-score, showcasing promising results in generating realistic solar imagery. We conduct two experiments: one to train a supervised classifier for event identification and another for basic flare prediction, demonstrating the value of synthetic data in managing imbalanced datasets. This research underscores the potential of DDPMs in solar data analysis and forecasting, suggesting further exploration into their capabilities for solar flare prediction and application in other deep learning and physical tasks.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
STIX X-ray microflare observations during the Solar Orbiter commissioning phase
Authors:
Andrea Francesco Battaglia,
Jonas Saqri,
Paolo Massa,
Emma Perracchione,
Ewan C. M. Dickson,
Hualin Xiao,
Astrid M. Veronig,
Alexander Warmuth,
Marina Battaglia,
Gordon J. Hurford,
Aline Meuris,
Olivier Limousin,
László Etesi,
Shane A. Maloney,
Richard A. Schwartz,
Matej Kuhar,
Frederic Schuller,
Valliappan Senthamizh Pavai,
Sophie Musset,
Daniel F. Ryan,
Lucia Kleint,
Michele Piana,
Anna Maria Massone,
Federico Benvenuto,
Janusz Sylwester
, et al. (12 additional authors not shown)
Abstract:
The Spectrometer/Telescope for Imaging X-rays (STIX) is the HXR instrument onboard Solar Orbiter designed to observe solar flares over a broad range of flare sizes, between 4-150 keV. We report the first STIX observations of microflares recorded during the instrument commissioning phase in order to investigate the STIX performance at its detection limit. This first result paper focuses on the temp…
▽ More
The Spectrometer/Telescope for Imaging X-rays (STIX) is the HXR instrument onboard Solar Orbiter designed to observe solar flares over a broad range of flare sizes, between 4-150 keV. We report the first STIX observations of microflares recorded during the instrument commissioning phase in order to investigate the STIX performance at its detection limit. This first result paper focuses on the temporal and spectral evolution of STIX microflares occuring in the AR12765 in June 2020, and compares the STIX measurements with GOES/XRS, SDO/AIA, and Hinode/XRT. For the observed microflares of the GOES A and B class, the STIX peak time at lowest energies is located in the impulsive phase of the flares, well before the GOES peak time. Such a behavior can either be explained by the higher sensitivity of STIX to higher temperatures compared to GOES, or due to the existence of a nonthermal component reaching down to low energies. The interpretation is inconclusive due to limited counting statistics for all but the largest flare in our sample. For this largest flare, the low-energy peak time is clearly due to thermal emission, and the nonthermal component seen at higher energies occurs even earlier. This suggests that the classic thermal explanation might also be favored for the majority of the smaller flares. In combination with EUV and SXR observations, STIX corroborates earlier findings that an isothermal assumption is of limited validity. Future diagnostic efforts should focus on multi-wavelength studies to derive differential emission measure distributions over a wide range of temperatures to accurately describe the energetics of solar flares. Commissioning observations confirm that STIX is working as designed. As a rule of thumb, STIX detects flares as small as the GOES A class. For flares above the GOES B class, detailed spectral and imaging analyses can be performed.
△ Less
Submitted 8 July, 2021; v1 submitted 18 June, 2021;
originally announced June 2021.
-
The Flare Likelihood and Region Eruption Forecasting (FLARECAST) Project: Flare forecasting in the big data & machine learning era
Authors:
M. K. Georgoulis,
D. S. Bloomfield,
M. Piana,
A. M. Massone,
M. Soldati,
P. T. Gallagher,
E. Pariat,
N. Vilmer,
E. Buchlin,
F. Baudin,
A. Csillaghy,
H. Sathiapal,
D. R. Jackson,
P. Alingery,
F. Benvenuto,
C. Campi,
K. Florios,
C. Gontikakis,
C. Guennou,
J. A. Guerra,
I. Kontogiannis,
V. Latorre,
S. A. Murray,
S. -H. Park,
S. von Stachelski
, et al. (3 additional authors not shown)
Abstract:
The EU funded the FLARECAST project, that ran from Jan 2015 until Feb 2018. FLARECAST had a R2O focus, and introduced several innovations into the discipline of solar flare forecasting. FLARECAST innovations were: first, the treatment of hundreds of physical properties viewed as promising flare predictors on equal footing, extending multiple previous works; second, the use of fourteen (14) differe…
▽ More
The EU funded the FLARECAST project, that ran from Jan 2015 until Feb 2018. FLARECAST had a R2O focus, and introduced several innovations into the discipline of solar flare forecasting. FLARECAST innovations were: first, the treatment of hundreds of physical properties viewed as promising flare predictors on equal footing, extending multiple previous works; second, the use of fourteen (14) different ML techniques, also on equal footing, to optimize the immense Big Data parameter space created by these many predictors; third, the establishment of a robust, three-pronged communication effort oriented toward policy makers, space-weather stakeholders and the wider public. FLARECAST pledged to make all its data, codes and infrastructure openly available worldwide. The combined use of 170+ properties (a total of 209 predictors are now available) in multiple ML algorithms, some of which were designed exclusively for the project, gave rise to changing sets of best-performing predictors for the forecasting of different flaring levels. At the same time, FLARECAST reaffirmed the importance of rigorous training and testing practices to avoid overly optimistic pre-operational prediction performance. In addition, the project has (a) tested new and revisited physically intuitive flare predictors and (b) provided meaningful clues toward the transition from flares to eruptive flares, namely, events associated with coronal mass ejections (CMEs). These leads, along with the FLARECAST data, algorithms and infrastructure, could help facilitate integrated space-weather forecasting efforts that take steps to avoid effort duplication. In spite of being one of the most intensive and systematic flare forecasting efforts to-date, FLARECAST has not managed to convincingly lift the barrier of stochasticity in solar flare occurrence and forecasting: solar flare prediction thus remains inherently probabilistic.
△ Less
Submitted 12 May, 2021;
originally announced May 2021.
-
JHelioviewer - Time-dependent 3D visualisation of solar and heliospheric data
Authors:
D. Mueller,
B. Nicula,
S. Felix,
F. Verstringe,
B. Bourgoignie,
A. Csillaghy,
D. Berghmans,
P. Jiggens,
J. P. Garcia-Ortiz,
J. Ireland,
S. Zahniy,
B. Fleck
Abstract:
Context. Solar observatories are providing the world-wide community with a wealth of data, covering large time ranges, multiple viewpoints, and returning large amounts of data. In particular, the large volume of SDO data presents challenges: it is available only from a few repositories, and full-disk, full-cadence data for reasonable durations of scientific interest are difficult to download pract…
▽ More
Context. Solar observatories are providing the world-wide community with a wealth of data, covering large time ranges, multiple viewpoints, and returning large amounts of data. In particular, the large volume of SDO data presents challenges: it is available only from a few repositories, and full-disk, full-cadence data for reasonable durations of scientific interest are difficult to download practically due to their size and download data rates available to most users. From a scientist's perspective this poses three problems: accessing, browsing and finding interesting data as efficiently as possible.
Aims. To address these challenges, we have developed JHelioviewer, a visualisation tool for solar data based on the JPEG2000 compression standard and part of the open source ESA/NASA Helioviewer Project. Since the first release of JHelioviewer, the scientific functionality of the software has been extended significantly, and the objective of this paper is to highlight these improvements.
Methods. The JPEG2000 standard offers useful new features that facilitate the dissemination and analysis of high-resolution image data and offers a solution to the challenge of efficiently browsing petabyte-scale image archives. The JHelioviewer software is open source, platform independent and extendable via a plug-in architecture.
Results. With JHelioviewer, users can visualise the Sun for any time period between September 1991 and today. They can perform basic image processing in real time, track features on the Sun and interactively overlay magnetic field extrapolations. The software integrates solar event data and a time line display. As a first step towards supporting science planning of the upcoming Solar Orbiter mission, JHelioviewer offers a virtual camera model that enables users to set the vantage point to the location of a spacecraft or celestial body at any given time.
△ Less
Submitted 1 June, 2017; v1 submitted 22 May, 2017;
originally announced May 2017.
-
CosmoHammer: Cosmological parameter estimation with the MCMC Hammer
Authors:
Joël Akeret,
Sebastian Seehars,
Adam Amara,
Alexandre Refregier,
André Csillaghy
Abstract:
We study the benefits and limits of parallelised Markov chain Monte Carlo (MCMC) sampling in cosmology. MCMC methods are widely used for the estimation of cosmological parameters from a given set of observations and are typically based on the Metropolis-Hastings algorithm. Some of the required calculations can however be computationally intensive, meaning that a single long chain can take several…
▽ More
We study the benefits and limits of parallelised Markov chain Monte Carlo (MCMC) sampling in cosmology. MCMC methods are widely used for the estimation of cosmological parameters from a given set of observations and are typically based on the Metropolis-Hastings algorithm. Some of the required calculations can however be computationally intensive, meaning that a single long chain can take several hours or days to calculate. In practice, this can be limiting, since the MCMC process needs to be performed many times to test the impact of possible systematics and to understand the robustness of the measurements being made. To achieve greater speed through parallelisation, MCMC algorithms need to have short auto-correlation times and minimal overheads caused by tuning and burn-in. The resulting scalability is hence influenced by two factors, the MCMC overheads and the parallelisation costs. In order to efficiently distribute the MCMC sampling over thousands of cores on modern cloud computing infrastructure, we developed a Python framework called CosmoHammer which embeds emcee, an implementation by Foreman-Mackey et al. (2012) of the affine invariant ensemble sampler by Goodman and Weare (2010). We test the performance of CosmoHammer for cosmological parameter estimation from cosmic microwave background data. While Metropolis-Hastings is dominated by overheads, CosmoHammer is able to accelerate the sampling process from a wall time of 30 hours on a dual core notebook to 16 minutes by scaling out to 2048 cores. Such short wall times for complex data sets opens possibilities for extensive model testing and control of systematics.
△ Less
Submitted 2 October, 2013; v1 submitted 7 December, 2012;
originally announced December 2012.
-
Automation of the filament tracking in the framework of the HELIO project
Authors:
Xavier Bonnin,
Jean Aboudarham,
Nicolas Fuller,
Andre Csillaghy,
Robert D. Bentley
Abstract:
We present a new method to automatically track filaments over the solar disk. The filaments are first detected on Meudon Spectroheliograph Hα images of the Sun, applying the technique developed by Fuller, Aboudarham, and Bentley (Solar phys. 227, 61, 2005). This technique combines cleaning processes, image segmentation based on region growing, and morphological parameter ex- traction, including th…
▽ More
We present a new method to automatically track filaments over the solar disk. The filaments are first detected on Meudon Spectroheliograph Hα images of the Sun, applying the technique developed by Fuller, Aboudarham, and Bentley (Solar phys. 227, 61, 2005). This technique combines cleaning processes, image segmentation based on region growing, and morphological parameter ex- traction, including the determination of filament skeletons. The coordinates of the skeleton pixels, given in a heliocentric system, are then converted to a more appropriate reference frame that follows the rotation of the Sun surface. In such a frame, a co-rotating filament is always located around the same position, and its skeletons (extracted from each image) are thus spatially close, forming a group of adjacent features. In a third step, the shape of each skeleton is compared with its neighbours using a curve-matching algorithm. This step will permit us to define the probability [P ] that two close filaments in the co-rotating frame are actually the same one observed on two different images. At the end, the pairs of features, for which the corresponding probability is greater than a threshold value, are associated using tracking identification indexes.On a representative sample of filaments, the good agreement between automated and manual tracking confirms the reliability of the technique to be applied on large data sets. Especially, this code is already used in the framework of the Heliophysics Integrated Observatory (HELIO) to populate a catalogue dedicated to solar and heliospheric features (HFC). An extension of this method to others filament observations, and possibly the sunspots, faculae, and coronal holes tracking can be also envisaged.
△ Less
Submitted 29 March, 2012; v1 submitted 9 February, 2012;
originally announced February 2012.
-
Herschel-HIFI detections of hydrides towards AFGL 2591 (Envelope emission versus tenuous cloud absorption)
Authors:
S. Bruderer,
A. O. Benz,
E. F. van Dishoeck,
M. Melchior,
S. D. Doty,
F. van der Tak,
P. Stäuber,
S. F. Wampfler,
C. Dedes,
U. A. Yıldız,
L. Pagani,
T. Giannini,
Th. de Graauw,
N. Whyborn,
D. Teyssier,
W. Jellema,
R. Shipman,
R. Schieder,
N. Honingh,
E. Caux,
W. Bächtold,
A. Csillaghy,
C. Monstein,
R. Bachiller,
A. Baudry
, et al. (44 additional authors not shown)
Abstract:
The Heterodyne Instrument for the Far Infrared (HIFI) onboard the Herschel Space Observatory allows the first observations of light diatomic molecules at high spectral resolution and in multiple transitions. Here, we report deep integrations using HIFI in different lines of hydrides towards the high-mass star forming region AFGL 2591. Detected are CH, CH+, NH, OH+, H2O+, while NH+ and SH+ have not…
▽ More
The Heterodyne Instrument for the Far Infrared (HIFI) onboard the Herschel Space Observatory allows the first observations of light diatomic molecules at high spectral resolution and in multiple transitions. Here, we report deep integrations using HIFI in different lines of hydrides towards the high-mass star forming region AFGL 2591. Detected are CH, CH+, NH, OH+, H2O+, while NH+ and SH+ have not been detected. All molecules except for CH and CH+ are seen in absorption with low excitation temperatures and at velocities different from the systemic velocity of the protostellar envelope. Surprisingly, the CH(JF,P = 3/2_2,- - 1/2_1,+) and CH+(J = 1 - 0, J = 2 - 1) lines are detected in emission at the systemic velocity. We can assign the absorption features to a foreground cloud and an outflow lobe, while the CH and CH+ emission stems from the envelope. The observed abundance and excitation of CH and CH+ can be explained in the scenario of FUV irradiated outflow walls, where a cavity etched out by the outflow allows protostellar FUV photons to irradiate and heat the envelope at larger distances driving the chemical reactions that produce these molecules.
△ Less
Submitted 20 July, 2010;
originally announced July 2010.