-
Magnetic Field-Constrained Ensemble Image Segmentation of Coronal Holes in Chromospheric Observations
Authors:
Jaime A. Landeros,
Michael S. Kirk,
C. Nick Arge,
Laura E. Boucheron,
Jie Zhang,
Vadim M. Uritsky,
Jeremy A. Grajeda,
Matthew Dupertuis
Abstract:
Coronal Holes (CHs) are large-scale, low-density regions in the solar atmosphere which may expel high-speed solar wind streams that incite hazardous, geomagnetic storms. Coronal and solar wind models can predict these high-speed streams and the performance of the coronal model can be validated against segmented CH boundaries. We present a novel method named Sub-Transition Region Identification of…
▽ More
Coronal Holes (CHs) are large-scale, low-density regions in the solar atmosphere which may expel high-speed solar wind streams that incite hazardous, geomagnetic storms. Coronal and solar wind models can predict these high-speed streams and the performance of the coronal model can be validated against segmented CH boundaries. We present a novel method named Sub-Transition Region Identification of Ensemble Coronal Holes (STRIDE-CH) to address prominent challenges in segmenting CHs with Extreme Ultraviolet (EUV) imagery. Ground-based, chromospheric He I 10830 Å line imagery and underlying Fe I photospheric magnetograms are revisited to disambiguate CHs from filaments and quiet Sun, overcome obscuration by coronal loops, and complement established methods in the community which use space-borne, coronal EUV observations. Classical computer vision techniques are applied to constrain the radiative and magnetic properties of detected CHs, produce an ensemble of boundaries, and compile these boundaries in a confidence map that quantifies the likelihood of CH presence throughout the solar disk. This method is science-enabling towards future studies of CH formation and variability from a mid-atmospheric perspective.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
Estimation of non-uniform blur using a patch-based regression convolutional neural network (CNN)
Authors:
Luis G. Varela,
Laura E. Boucheron,
Steven Sandoval,
David Voelz,
Abu Bucker Siddik
Abstract:
The non-uniform blur of atmospheric turbulence can be modeled as a superposition of linear motion blur kernels at a patch level. We propose a regression convolutional neural network (CNN) to predict angle and length of a linear motion blur kernel for varying sized patches. We analyze the robustness of the network for different patch sizes and the performance of the network in regions where the cha…
▽ More
The non-uniform blur of atmospheric turbulence can be modeled as a superposition of linear motion blur kernels at a patch level. We propose a regression convolutional neural network (CNN) to predict angle and length of a linear motion blur kernel for varying sized patches. We analyze the robustness of the network for different patch sizes and the performance of the network in regions where the characteristics of the blur are transitioning. Alternating patch sizes per epoch in training, we find coefficient of determination scores across a range of patch sizes of $R^2>0.78$ for length and $R^2>0.94$ for angle prediction. We find that blur predictions in regions overlap** two blur characteristics transition between the two characteristics as overlap changes. These results validate the use of such a network for prediction of non-uniform blur characteristics at a patch level.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Neural-based Compression Scheme for Solar Image Data
Authors:
Ali Zafari,
Atefeh Khoshkhahtinat,
Jeremy A. Grajeda,
Piyush M. Mehta,
Nasser M. Nasrabadi,
Laura E. Boucheron,
Barbara J. Thompson,
Michael S. F. Kirk,
Daniel da Silva
Abstract:
Studying the solar system and especially the Sun relies on the data gathered daily from space missions. These missions are data-intensive and compressing this data to make them efficiently transferable to the ground station is a twofold decision to make. Stronger compression methods, by distorting the data, can increase data throughput at the cost of accuracy which could affect scientific analysis…
▽ More
Studying the solar system and especially the Sun relies on the data gathered daily from space missions. These missions are data-intensive and compressing this data to make them efficiently transferable to the ground station is a twofold decision to make. Stronger compression methods, by distorting the data, can increase data throughput at the cost of accuracy which could affect scientific analysis of the data. On the other hand, preserving subtle details in the compressed data requires a high amount of data to be transferred, reducing the desired gains from compression. In this work, we propose a neural network-based lossy compression method to be used in NASA's data-intensive imagery missions. We chose NASA's SDO mission which transmits 1.4 terabytes of data each day as a proof of concept for the proposed algorithm. In this work, we propose an adversarially trained neural network, equipped with local and non-local attention modules to capture both the local and global structure of the image resulting in a better trade-off in rate-distortion (RD) compared to conventional hand-engineered codecs. The RD variational autoencoder used in this work is jointly trained with a channel-dependent entropy model as a shared prior between the analysis and synthesis transforms to make the entropy coding of the latent code more effective. Our neural image compression algorithm outperforms currently-in-use and state-of-the-art codecs such as JPEG and JPEG-2000 in terms of the RD performance when compressing extreme-ultraviolet (EUV) data. As a proof of concept for use of this algorithm in SDO data analysis, we have performed coronal hole (CH) detection using our compressed images, and generated consistent segmentations, even at a compression rate of $\sim0.1$ bits per pixel (compared to 8 bits per pixel on the original data) using EUV data from SDO.
△ Less
Submitted 5 November, 2023;
originally announced November 2023.
-
Quantifying the Consistency and Characterizing the Confidence of Coronal Holes Detected by Active Contours without Edges (ACWE)
Authors:
Jeremy A. Grajeda,
Laura E. Boucheron,
Michael S. Kirk,
Andrew Leisner,
C. Nick Arge
Abstract:
This paper presents an intramethod ensemble for coronal hole (CH) detection based on the Active Contours Without Edges (ACWE) segmentation algorithm. The purpose of this ensemble is to develop a confidence map that defines, for all on disk regions of a Solar extreme ultraviolet (EUV) image, the likelihood that each region belongs to a CH based on that region's proximity to, and homogeneity with, t…
▽ More
This paper presents an intramethod ensemble for coronal hole (CH) detection based on the Active Contours Without Edges (ACWE) segmentation algorithm. The purpose of this ensemble is to develop a confidence map that defines, for all on disk regions of a Solar extreme ultraviolet (EUV) image, the likelihood that each region belongs to a CH based on that region's proximity to, and homogeneity with, the core of identified CH regions. CHs are regions of open magnetic field lines, resulting in high speed solar wind. Accurate detection of CHs is vital for space weather prediction. By relying on region homogeneity, and not intensity (which can vary due to various factors including line of sight changes and stray light from nearby bright regions), to define the final confidence of any given region, this ensemble is able to provide robust, consistent delineations of the CH regions. Using the metrics of global consistency error (GCE), local consistency error (LCE), intersection over union (IOU), and the structural similarity index measure (SSIM), the method is shown to be robust to different spatial resolutions and different intensity resolutions. Furthermore, using the same metrics, the method is shown to be robust across short timescales, indicating self-consistent segmentations. Finally, the accuracy of the segmentations and confidence maps are validated by considering the skewness (i.e., unipolarity) of the underlying magnetic field.
△ Less
Submitted 10 August, 2023;
originally announced August 2023.
-
Estimation of motion blur kernel parameters using regression convolutional neural networks
Authors:
Luis G. Varela,
Laura E. Boucheron,
Steven Sandoval,
David Voelz,
Abu Bucker Siddik
Abstract:
Many deblurring and blur kernel estimation methods use a maximum a posteriori (MAP) approach or deep learning-based classification techniques to sharpen an image and/or predict the blur kernel. We propose a regression approach using convolutional neural networks (CNNs) to predict parameters of linear motion blur kernels, the length and orientation of the blur. We analyze the relationship between l…
▽ More
Many deblurring and blur kernel estimation methods use a maximum a posteriori (MAP) approach or deep learning-based classification techniques to sharpen an image and/or predict the blur kernel. We propose a regression approach using convolutional neural networks (CNNs) to predict parameters of linear motion blur kernels, the length and orientation of the blur. We analyze the relationship between length and angle of linear motion blur that can be represented as digital filter kernels. A large dataset of blurred images is generated using a suite of blur kernels and used to train a regression CNN for prediction of length and angle of the motion blur. The coefficients of determination for estimation of length and angle are found to be greater than or equal to 0.89, even under the presence of significant additive Gaussian noise, up to a variance of 10\% (SNR of 10 dB). Using our estimated kernel in a non-blind image deblurring method, the sum of squared differences error ratio demonstrates higher cumulative histogram values than comparison methods, with most test images yielding an error ratio of less than or equal to 1.25.
△ Less
Submitted 1 May, 2024; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Solar Active Region Magnetogram Image Dataset for Studies of Space Weather
Authors:
Laura E. Boucheron,
Ty Vincent,
Jeremy A. Grajeda,
Ellery Wuest
Abstract:
In this dataset we provide a comprehensive collection of magnetograms (images quantifying the strength of the magnetic field) from the National Aeronautics and Space Administration's (NASA's) Solar Dynamics Observatory (SDO). The dataset incorporates data from three sources and provides SDO Helioseismic and Magnetic Imager (HMI) magnetograms of solar active regions (regions of large magnetic flux,…
▽ More
In this dataset we provide a comprehensive collection of magnetograms (images quantifying the strength of the magnetic field) from the National Aeronautics and Space Administration's (NASA's) Solar Dynamics Observatory (SDO). The dataset incorporates data from three sources and provides SDO Helioseismic and Magnetic Imager (HMI) magnetograms of solar active regions (regions of large magnetic flux, generally the source of eruptive events) as well as labels of corresponding flaring activity. This dataset will be useful for image analysis or solar physics research related to magnetic structure, its evolution over time, and its relation to solar flares. The dataset will be of interest to those researchers investigating automated solar flare prediction methods, including supervised and unsupervised machine learning (classical and deep), binary and multi-class classification, and regression. This dataset is a minimally processed, user configurable dataset of consistently sized images of solar active regions that can serve as a benchmark dataset for solar flare prediction research.
△ Less
Submitted 12 February, 2024; v1 submitted 16 May, 2023;
originally announced May 2023.
-
Deep Learning Estimation of Modified Zernike Coefficients and Recovery of Point Spread Functions in Turbulence
Authors:
Abu Bucker Siddik,
Steven Sandoval,
David Voelz,
Laura E Boucheron,
Luis Varela
Abstract:
Recovering the turbulence-degraded point spread function from a single intensity image is important for a variety of imaging applications. Here, a deep learning model based on a convolutional neural network is applied to intensity images to predict a modified set of Zernike polynomial coefficients corresponding to wavefront aberrations in the pupil due to turbulence. The modified set assigns an ab…
▽ More
Recovering the turbulence-degraded point spread function from a single intensity image is important for a variety of imaging applications. Here, a deep learning model based on a convolutional neural network is applied to intensity images to predict a modified set of Zernike polynomial coefficients corresponding to wavefront aberrations in the pupil due to turbulence. The modified set assigns an absolute value to coefficients of even radial orders due to a sign ambiguity associated with this problem and is shown to be sufficient for specifying the intensity point spread function. Simulated image data of a point object and simple extended objects over a range of turbulence and detection noise levels are created for the learning model. The MSE results for the learning model show that the best prediction is found when observing a point object, but it is possible to recover a useful set of modified Zernike coefficients from an extended object image that is subject to detection noise and turbulence.
△ Less
Submitted 27 June, 2023; v1 submitted 5 April, 2023;
originally announced April 2023.
-
VTXO: The Virtual Telescope for X-ray Observations
Authors:
John F. Krizmanic,
Neerav Shah,
Philip C. Calhoun,
Alice K. Harding,
Lloyd R. Purves,
Cassandra M. Webster,
Michael F. Corcoran,
Chris R. Shrader,
Steven J. Stochaj,
Kyle A. Rankin,
Daniel T. Smith,
Hyeongjun Park,
Laura E. Boucheron,
Krishna Kota,
Asal Naseri
Abstract:
The Virtual Telescope for X-ray Observations (VTXO) will use lightweight Phase Fresnel Lenses (PFLs) in a virtual X-ray telescope with $\sim$1 km focal length and with $\sim$50 milli-arcsecond angular resolution. VTXO is formed by using precision formation flying of two SmallSats: a smaller OpticsSat that houses the PFLs and navigation beacons while a larger DetectorSat contains an X-ray camera, a…
▽ More
The Virtual Telescope for X-ray Observations (VTXO) will use lightweight Phase Fresnel Lenses (PFLs) in a virtual X-ray telescope with $\sim$1 km focal length and with $\sim$50 milli-arcsecond angular resolution. VTXO is formed by using precision formation flying of two SmallSats: a smaller OpticsSat that houses the PFLs and navigation beacons while a larger DetectorSat contains an X-ray camera, a precision start tracker, and the propulsion for the formation flying. The baseline flight dynamics uses a highly elliptical supersynchronous orbit allow the formation to hold in an inertial frame around the 90,000 km apogee for 10 hours of the 32.5 hour orbit with nearly a year mission lifetime. VTXO's fine angular resolution enables measuring the environments close to the central engines of bright compact X-ray sources. This X-ray imaging capability allows for the study of the effects of dust scattering near to the central objects such as Cyg X-3 and GX 5-1, for the search for jet structure near to the compact object in X-ray novae such as Cyg X-1 and GRS 1915+105, and for the search for structure in the termination shock of in the Crab pulsar wind nebula. The VTXO SmallSat and instrument designs, mission parameters, and science performance are described. VTXO development was supported as one of the selected 2018 NASA Astrophysics SmallSat Study (AS$^3$) missions.
△ Less
Submitted 30 December, 2020;
originally announced December 2020.
-
VTXO: the Virtual Telescope for X-ray Observations
Authors:
John Krizmanic,
Neerav Shah,
Alice Harding,
Phil Calhoun,
Lloyd Purves,
Cassandra Webster,
Steven Stochaj,
Kyle Rankin,
Daniel Smith,
Hyeongjun Park,
Laura Boucheron,
Krishna Kota,
Michael Corcoran,
Chris Shrader,
Asal Naseri
Abstract:
The Virtual Telescope for X-ray Observations (VTXO) will use lightweight Phase Frensel Lenses (PFLs) in a virtual X-ray telescope with 1 km focal length and with nearly 50 milli-arcsecond angular resolution. Laboratory characterization of PFLs have demonstrated near diffraction-limited angular resolution in the X-ray band, but they require long focal lengths to achieve this quality of imaging. VTX…
▽ More
The Virtual Telescope for X-ray Observations (VTXO) will use lightweight Phase Frensel Lenses (PFLs) in a virtual X-ray telescope with 1 km focal length and with nearly 50 milli-arcsecond angular resolution. Laboratory characterization of PFLs have demonstrated near diffraction-limited angular resolution in the X-ray band, but they require long focal lengths to achieve this quality of imaging. VTXO is formed by using precision formation flying of two SmallSats: a smaller, 6U OpticsSat that houses the PFLs and navigation beacons while a larger, ESPA-class DetectorSat contains an X-ray camera, a charged-particle radiation monitor, a precision star tracker, and the propulsion for the formation flying. The baseline flight dynamics uses a highly-elliptical supersynchronous geostationary transfer orbit to allow the inertial formation to form and hold around the 90,000 km apogee for 10 hours of the 32.5-hour orbit with nearly a year mission lifetime. The guidance, navigation, and control (GN&C) for the formation flying uses standard CubeSat avionics packages, a precision star tracker, imaging beacons on the OpticsSat, and a radio ranging system that also serves as an inter-satellite communication link. VTXO's fine angular resolution enables measuring the environments nearly an order of magnitude closer to the central engines of bright compact X-ray sources compared to the current state of the art. This X-ray imaging capability allows for the study of the effects of dust scattering nearer to the central objects such as Cyg X-3 and GX 5-1, for the search for jet structure nearer to the compact object in X-ray novae such as Cyg X-1 and GRS 1915+105, and for the search for structure in the termination shock of in the Crab pulsar wind nebula. The VTXO development was supported as one of the selected 2018 NASA Astrophysics SmallSat Study (AS3) missions.
△ Less
Submitted 22 June, 2020;
originally announced June 2020.
-
Roadmap for Reliable Ensemble Forecasting of the Sun-Earth System
Authors:
Gelu Nita,
Rafal Angryk,
Berkay Aydin,
Juan Banda,
Tim Bastian,
Tom Berger,
Veronica Bindi,
Laura Boucheron,
Wenda Cao,
Eric Christian,
Georgia de Nolfo,
Edward DeLuca,
Marc DeRosa,
Cooper Downs,
Gregory Fleishman,
Olac Fuentes,
Dale Gary,
Frank Hill,
Todd Hoeksema,
Qiang Hu,
Raluca Ilie,
Jack Ireland,
Farzad Kamalabadi,
Kelly Korreck,
Alexander Kosovichev
, et al. (22 additional authors not shown)
Abstract:
The authors of this report met on 28-30 March 2018 at the New Jersey Institute of Technology, Newark, New Jersey, for a 3-day workshop that brought together a group of data providers, expert modelers, and computer and data scientists, in the solar discipline. Their objective was to identify challenges in the path towards building an effective framework to achieve transformative advances in the und…
▽ More
The authors of this report met on 28-30 March 2018 at the New Jersey Institute of Technology, Newark, New Jersey, for a 3-day workshop that brought together a group of data providers, expert modelers, and computer and data scientists, in the solar discipline. Their objective was to identify challenges in the path towards building an effective framework to achieve transformative advances in the understanding and forecasting of the Sun-Earth system from the upper convection zone of the Sun to the Earth's magnetosphere. The workshop aimed to develop a research roadmap that targets the scientific challenge of coupling observations and modeling with emerging data-science research to extract knowledge from the large volumes of data (observed and simulated) while stimulating computer science with new research applications. The desire among the attendees was to promote future trans-disciplinary collaborations and identify areas of convergence across disciplines. The workshop combined a set of plenary sessions featuring invited introductory talks and workshop progress reports, interleaved with a set of breakout sessions focused on specific topics of interest. Each breakout group generated short documents, listing the challenges identified during their discussions in addition to possible ways of attacking them collectively. These documents were combined into this report-wherein a list of prioritized activities have been collated, shared and endorsed.
△ Less
Submitted 29 October, 2018; v1 submitted 19 October, 2018;
originally announced October 2018.
-
Segmentation of Coronal Holes Using Active Contours Without Edges
Authors:
L. E. Boucheron,
M. Valluri,
R. T. J. McAteer
Abstract:
An application of active contours without edges is presented as an efficient and effective means of extracting and characterizing coronal holes. Coronal holes are regions of low-density plasma on the Sun with open magnetic field lines. As the source of the fast solar wind, the detection and characterization of these regions is important for both testing theories of their formation and evolution an…
▽ More
An application of active contours without edges is presented as an efficient and effective means of extracting and characterizing coronal holes. Coronal holes are regions of low-density plasma on the Sun with open magnetic field lines. As the source of the fast solar wind, the detection and characterization of these regions is important for both testing theories of their formation and evolution and from a space weather perspective. Coronal holes are detected in full disk extreme ultraviolet (EUV) images of the corona obtained with the Solar Dynamics Observatory Atmospheric Imaging Assembly (SDO/AIA). The proposed method detects coronal boundaries without determining any fixed intensity value in the data. Instead, the active contour segmentation employs an energy-minimization in which coronal holes are assumed to have more homogeneous intensities than surrounding active regions and quiet Sun. The segmented coronal holes tend to correspond to unipolar magnetic regions, are consistent with concurrent solar wind observations, and qualitatively match the coronal holes segmented by other methods. The means to identify a coronal hole without specification of a final intensity threshold may allow this algorithm to be more robust across multiple datasets, regardless of data type, resolution, and quality.
△ Less
Submitted 4 October, 2016;
originally announced October 2016.
-
Prediction of Solar Flare Size and Time-to-Flare Using Support Vector Machine Regression
Authors:
Laura E. Boucheron,
Amani Al-Ghraibah,
R. T. James McAteer
Abstract:
We study the prediction of solar flare size and time-to-flare using 38 features describing magnetic complexity of the photospheric magnetic field. This work uses support vector regression to formulate a map** from the 38-dimensional feature space to a continuous-valued label vector representing flare size or time-to-flare. When we consider flaring regions only, we find an average error in estima…
▽ More
We study the prediction of solar flare size and time-to-flare using 38 features describing magnetic complexity of the photospheric magnetic field. This work uses support vector regression to formulate a map** from the 38-dimensional feature space to a continuous-valued label vector representing flare size or time-to-flare. When we consider flaring regions only, we find an average error in estimating flare size of approximately half a \emph{geostationary operational environmental satellite} (\emph{GOES}) class. When we additionally consider non-flaring regions, we find an increased average error of approximately 3/4 a \emph{GOES} class. We also consider thresholding the regressed flare size for the experiment containing both flaring and non-flaring regions and find a true positive rate of 0.69 and a true negative rate of 0.86 for flare prediction. The results for both of these size regression experiments are consistent across a wide range of predictive time windows, indicating that the magnetic complexity features may be persistent in appearance long before flare activity. This is supported by our larger error rates of some 40 hr in the time-to-flare regression problem. The 38 magnetic complexity features considered here appear to have discriminative potential for flare size, but their persistence in time makes them less discriminative for the time-to-flare problem.
△ Less
Submitted 5 November, 2015;
originally announced November 2015.
-
An automated classification approach to ranking photospheric proxies of magnetic energy build-up
Authors:
Amani Al-Ghraibah,
Laura. E. Boucheron,
R. T. James McAteer
Abstract:
We study the photospheric magnetic field of ~2000 active regions in solar cycle 23 to search for parameters indicative of energy build-up and subsequent release as a solar flare. We extract three sets of parameters: snapshots in space and time- total flux, magnetic gradients, and neutral lines; evolution in time- flux evolution; structures at multiple size scales- wavelet analysis. This combines p…
▽ More
We study the photospheric magnetic field of ~2000 active regions in solar cycle 23 to search for parameters indicative of energy build-up and subsequent release as a solar flare. We extract three sets of parameters: snapshots in space and time- total flux, magnetic gradients, and neutral lines; evolution in time- flux evolution; structures at multiple size scales- wavelet analysis. This combines pattern recognition and classification techniques via a relevance vector machine to determine whether a region will flare. We consider classification performance using all 38 extracted features and several feature subsets. Classification performance is quantified using both the true positive rate and the true negative rate. Additionally, we compute the true skill score which provides an equal weighting to true positive rate and true negative rate and the Heidke skill score to allow comparison to other flare forecasting work.
We obtain a true skill score of ~0.5 for any predictive time window in the range 2-24hr, with a TPR of ~0.8 and a TNR of ~0.7. These values do not appear to depend on the time window, although the Heidke skill score (<0.5) does. Features relating to snapshots of the distribution of magnetic gradients show the best predictive ability over all predictive time windows. Other gradient-related features and the instantaneous power at various wavelet scales also feature in the top five ranked features in predictive power. While the photospheric magnetic field governs the coronal non-potentiality (and likelihood of flaring), photospheric magnetic field alone is not sufficient to determine this uniquely. Furthermore we are only measuring proxies of the magnetic energy build up. We still lack observational details on why energy is released at any particular point in time. We may have discovered the natural limit of the accuracy of flare predictions from these large scale studies.
△ Less
Submitted 29 June, 2015;
originally announced June 2015.