-
A Survey of Computational Tools in Solar Physics
Authors:
Monica G. Bobra,
Stuart J. Mumford,
Russell J. Hewett,
Steven D. Christe,
Kevin Reardon,
Sabrina Savage,
Jack Ireland,
Tiago M. D. Pereira,
Bin Chen,
David Pérez-Suárez
Abstract:
The SunPy Project developed a 13-question survey to understand the software and hardware usage of the solar physics community. 364 members of the solar physics community, across 35 countries, responded to our survey. We found that 99$\pm$0.5% of respondents use software in their research and 66% use the Python scientific software stack. Students are twice as likely as faculty, staff scientists, an…
▽ More
The SunPy Project developed a 13-question survey to understand the software and hardware usage of the solar physics community. 364 members of the solar physics community, across 35 countries, responded to our survey. We found that 99$\pm$0.5% of respondents use software in their research and 66% use the Python scientific software stack. Students are twice as likely as faculty, staff scientists, and researchers to use Python rather than Interactive Data Language (IDL). In this respect, the astrophysics and solar physics communities differ widely: 78% of solar physics faculty, staff scientists, and researchers in our sample uses IDL, compared with 44% of astrophysics faculty and scientists sampled by Momcheva and Tollerud (2015). 63$\pm$4% of respondents have not taken any computer-science courses at an undergraduate or graduate level. We also found that most respondents utilize consumer hardware to run software for solar-physics research. Although 82% of respondents work with data from space-based or ground-based missions, some of which (e.g. the Solar Dynamics Observatory and Daniel K. Inouye Solar Telescope) produce terabytes of data a day, 14% use a regional or national cluster, 5% use a commercial cloud provider, and 29% use exclusively a laptop or desktop. Finally, we found that 73$\pm$4% of respondents cite scientific software in their research, although only 42$\pm$3% do so routinely.
△ Less
Submitted 27 March, 2020;
originally announced March 2020.
-
Distributed and parallel sparse convex optimization for radio interferometry with PURIFY
Authors:
Luke Pratley,
Jason D. McEwen,
Mayeul d'Avezac,
Xiaohao Cai,
David Perez-Suarez,
Ilektra Christidi,
Roland Guichard
Abstract:
Next generation radio interferometric telescopes are entering an era of big data with extremely large data sets. While these telescopes can observe the sky in higher sensitivity and resolution than before, computational challenges in image reconstruction need to be overcome to realize the potential of forthcoming telescopes. New methods in sparse image reconstruction and convex optimization techni…
▽ More
Next generation radio interferometric telescopes are entering an era of big data with extremely large data sets. While these telescopes can observe the sky in higher sensitivity and resolution than before, computational challenges in image reconstruction need to be overcome to realize the potential of forthcoming telescopes. New methods in sparse image reconstruction and convex optimization techniques (cf. compressive sensing) have shown to produce higher fidelity reconstructions of simulations and real observations than traditional methods. This article presents distributed and parallel algorithms and implementations to perform sparse image reconstruction, with significant practical considerations that are important for implementing these algorithms for Big Data. We benchmark the algorithms presented, showing that they are considerably faster than their serial equivalents. We then pre-sample gridding kernels to scale the distributed algorithms to larger data sizes, showing application times for 1 Gb to 2.4 Tb data sets over 25 to 100 nodes for up to 50 billion visibilities, and find that the run-times for the distributed algorithms range from 100 milliseconds to 3 minutes per iteration. This work presents an important step in working towards computationally scalable and efficient algorithms and implementations that are needed to image observations of both extended and compact sources from next generation radio interferometers such as the SKA. The algorithms are implemented in the latest versions of the SOPT (https://github.com/astro-informatics/sopt) and PURIFY (https://github.com/astro-informatics/purify) software packages {(Versions 3.1.0)}, which have been released alongside of this article.
△ Less
Submitted 13 December, 2019; v1 submitted 11 March, 2019;
originally announced March 2019.
-
The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
Authors:
The Astropy Collaboration,
A. M. Price-Whelan,
B. M. Sipőcz,
H. M. Günther,
P. L. Lim,
S. M. Crawford,
S. Conseil,
D. L. Shupe,
M. W. Craig,
N. Dencheva,
A. Ginsburg,
J. T. VanderPlas,
L. D. Bradley,
D. Pérez-Suárez,
M. de Val-Borro,
T. L. Aldcroft,
K. L. Cruz,
T. P. Robitaille,
E. J. Tollerud,
C. Ardelean,
T. Babej,
M. Bachetti,
A. V. Bakanov,
S. P. Bamford,
G. Barentsen
, et al. (112 additional authors not shown)
Abstract:
The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy p…
▽ More
The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy project and summarize key features in the core package as of the recent major release, version 2.0. We then describe the project infrastructure designed to facilitate and support development for a broader ecosystem of inter-operable packages. We conclude with a future outlook of planned new features and directions for the broader Astropy project.
△ Less
Submitted 16 January, 2018; v1 submitted 8 January, 2018;
originally announced January 2018.
-
A Statistical Analysis of the Solar Phenomena Associated with Global EUV Waves
Authors:
David M. Long,
Pearse Murphy,
Georgina Graham,
Eoin P. Carley,
David Pérez-Suárez
Abstract:
Solar eruptions are the most spectacular events in our solar system and are associated with many different signatures of energy release including solar flares, coronal mass ejections, global waves, radio emission and accelerated particles. Here, we apply the Coronal Pulse Identification and Tracking Algorithm (CorPITA) to the high cadence synoptic data provided by the Solar Dynamic Observatory (SD…
▽ More
Solar eruptions are the most spectacular events in our solar system and are associated with many different signatures of energy release including solar flares, coronal mass ejections, global waves, radio emission and accelerated particles. Here, we apply the Coronal Pulse Identification and Tracking Algorithm (CorPITA) to the high cadence synoptic data provided by the Solar Dynamic Observatory (SDO) to identify and track global waves observed by SDO. 164 of the 362 solar flare events studied (45%) are found to have associated global waves with no waves found for the remaining 198 (55%). A clear linear relationship was found between the median initial velocity and the acceleration of the waves, with faster waves exhibiting a stronger deceleration (consistent with previous results). No clear relationship was found between global waves and type II radio bursts, electrons or protons detected in-situ near Earth. While no relationship was found between the wave properties and the associated flare size (with waves produced by flares from B to X-class), more than a quarter of the active regions studied were found to produce more than one wave event. These results suggest that the presence of a global wave in a solar eruption is most likely determined by the structure and connectivity of the erupting active region and the surrounding quiet solar corona rather than by the amount of free energy available within the active region.
△ Less
Submitted 7 November, 2017;
originally announced November 2017.
-
Measuring the magnetic field of a trans-equatorial loop system using coronal seismology
Authors:
David M. Long,
Gherardo Valori,
David Pérez-Suárez,
Richard J. Morton,
Alberto Marcos Vásquez
Abstract:
"EIT waves" are freely-propagating global pulses in the low corona which are strongly associated with the initial evolution of coronal mass ejections (CMEs). They are thought to be large-amplitude, fast-mode magnetohydrodynamic waves initially driven by the rapid expansion of a CME in the low corona. An "EIT wave" was observed on 6 July 2012 to impact an adjacent trans-equatorial loop system which…
▽ More
"EIT waves" are freely-propagating global pulses in the low corona which are strongly associated with the initial evolution of coronal mass ejections (CMEs). They are thought to be large-amplitude, fast-mode magnetohydrodynamic waves initially driven by the rapid expansion of a CME in the low corona. An "EIT wave" was observed on 6 July 2012 to impact an adjacent trans-equatorial loop system which then exhibited a decaying oscillation as it returned to rest. Observations of the loop oscillations were used to estimate the magnetic field strength of the loop system by studying the decaying oscillation of the loop, measuring the propagation of ubiquitous transverse waves in the loop and extrapolating the magnetic field from observed magnetograms. Observations from the Atmospheric Imaging Assembly onboard the Solar Dynamics Observatory (SDO/AIA) and the Coronal Multi-channel Polarimeter (CoMP) were used to study the event. An Empirical Mode Decomposition analysis was used to characterise the oscillation of the loop system in CoMP Doppler velocity and line width and in AIA intensity. The loop system was shown to oscillate in the 2nd harmonic mode rather than at the fundamental frequency, with the seismological analysis returning an estimated magnetic field strength of ~5.5+/-1.5 G. This compares to the magnetic field strength estimates of ~1-9 G and ~3-9 G found using the measurements of transverse wave propagation and magnetic field extrapolation respectively.
△ Less
Submitted 29 March, 2017;
originally announced March 2017.
-
Evolution of the Magnetic Field Distribution of Active Regions
Authors:
Sally Dacie,
Pascal Démoulin,
Lidia van Driel-Gesztelyi,
David Long,
Deb Baker,
Miho Janvier,
Stephanie Yardley,
David Pérez-Suárez
Abstract:
Aims. Although the temporal evolution of active regions (ARs) is relatively well understood, the processes involved continue to be the subject of investigation. We study how the magnetic field of a series of ARs evolves with time to better characterise how ARs emerge and disperse. Methods. We examine the temporal variation in the magnetic field distribution of 37 emerging ARs. A kernel density est…
▽ More
Aims. Although the temporal evolution of active regions (ARs) is relatively well understood, the processes involved continue to be the subject of investigation. We study how the magnetic field of a series of ARs evolves with time to better characterise how ARs emerge and disperse. Methods. We examine the temporal variation in the magnetic field distribution of 37 emerging ARs. A kernel density estimation plot of the field distribution was created on a log-log scale for each AR at each time step. We found that the central portion of the distribution is typically linear and its slope was used to characterise the evolution of the magnetic field. Results. The slopes were seen to evolve with time, becoming less steep as the fragmented emerging flux coalesces. The slopes reached a maximum value of ~ -1.5 just before the time of maximum flux before becoming steeper during the decay phase towards the quiet Sun value of ~ -3. This behaviour differs significantly from a classical diffusion model, which produces a slope of -1. These results suggest that simple classical diffusion is not responsible for the observed changes in field distribution, but that other processes play a significant role in flux dispersion. Conclusions. We propose that the steep negative slope seen during the late decay phase is due to magnetic flux reprocessing by (super)granular convective cells.
△ Less
Submitted 13 September, 2016;
originally announced September 2016.
-
SunPy - Python for Solar Physics
Authors:
The SunPy Community,
Stuart J Mumford,
Steven Christe,
David Pérez-Suárez,
Jack Ireland,
Albert Y Shih,
Andrew R Inglis,
Simon Liedtke,
Russell J Hewett,
Florian Mayer,
Keith Hughitt,
Nabil Freij,
Tomas Meszaros,
Samuel M Bennett,
Michael Malocha,
John Evans,
Ankit Agrawal,
Andrew J Leonard,
Thomas P Robitaille,
Benjamin Mampaey,
Jose Iván Campos-Rozo,
Michael S Kirk
Abstract:
This paper presents SunPy (version 0.5), a community-developed Python package for solar physics. Python, a free, cross-platform, general-purpose, high-level programming language, has seen widespread adoption among the scientific community, resulting in the availability of a large number of software packages, from numerical computation (NumPy, SciPy) and machine learning (scikit-learn) to visualisa…
▽ More
This paper presents SunPy (version 0.5), a community-developed Python package for solar physics. Python, a free, cross-platform, general-purpose, high-level programming language, has seen widespread adoption among the scientific community, resulting in the availability of a large number of software packages, from numerical computation (NumPy, SciPy) and machine learning (scikit-learn) to visualisation and plotting (matplotlib). SunPy is a data-analysis environment specialising in providing the software necessary to analyse solar and heliospheric data in Python. SunPy is open-source software (BSD licence) and has an open and transparent development workflow that anyone can contribute to. SunPy provides access to solar data through integration with the Virtual Solar Observatory (VSO), the Heliophysics Event Knowledgebase (HEK), and the HELiophysics Integrated Observatory (HELIO) webservices. It currently supports image data from major solar missions (e.g., SDO, SOHO, STEREO, and IRIS), time-series data from missions such as GOES, SDO/EVE, and PROBA2/LYRA, and radio spectra from e-Callisto and STEREO/SWAVES. We describe SunPy's functionality, provide examples of solar data analysis in SunPy, and show how Python-based solar data-analysis can leverage the many existing tools already available in Python. We discuss the future goals of the project and encourage interested users to become involved in the planning and development of SunPy.
△ Less
Submitted 11 May, 2015;
originally announced May 2015.
-
CorPITA: An Automated Algorithm for the Identification and Analysis of Coronal "EIT Waves"
Authors:
David M. Long,
D. Shaun Bloomfield,
Peter T. Gallagher,
David Pérez-Suárez
Abstract:
The continuous stream of data available from the Atmospheric Imaging Assembly (AIA) telescopes onboard the Solar Dynamics Observatory (SDO) spacecraft has allowed a deeper understanding of the Sun. However, the sheer volume of data has necessitated the development of automated techniques to identify and analyse various phenomena. In this article, we describe the Coronal Pulse Identification and Tr…
▽ More
The continuous stream of data available from the Atmospheric Imaging Assembly (AIA) telescopes onboard the Solar Dynamics Observatory (SDO) spacecraft has allowed a deeper understanding of the Sun. However, the sheer volume of data has necessitated the development of automated techniques to identify and analyse various phenomena. In this article, we describe the Coronal Pulse Identification and Tracking Algorithm (CorPITA) for the identification and analysis of coronal "EIT waves". CorPITA uses an intensity-profile technique to identify the propagating pulse, tracking it throughout its evolution before returning estimates of its kinematics. The algorithm is applied here to a data-set from February 2011, allowing its capabilities to be examined and critiqued. This algorithm forms part of the SDO Feature Finding Team initiative and will be implemented as part of the Heliophysics Event Knowledgebase (HEK). This is the first fully automated algorithm to identify and track the propagating "EIT wave" rather than any associated phenomena and will allow a deeper understanding of this controversial phenomenon.
△ Less
Submitted 26 March, 2014;
originally announced March 2014.
-
Automated Solar Feature Detection for Space Weather Applications
Authors:
David Pérez-Suárez,
Paul A. Higgins,
D. Shaun Bloomfield,
R. T. James McAteer,
Larisza D. Krista,
Jason P. Byrne,
Peter. T. Gallagher
Abstract:
The solar surface and atmosphere are highly dynamic plasma environments, which evolve over a wide range of temporal and spatial scales. Large-scale eruptions, such as coronal mass ejections, can be accelerated to millions of kilometres per hour in a matter of minutes, making their automated detection and characterisation challenging. Additionally, there are numerous faint solar features, such as c…
▽ More
The solar surface and atmosphere are highly dynamic plasma environments, which evolve over a wide range of temporal and spatial scales. Large-scale eruptions, such as coronal mass ejections, can be accelerated to millions of kilometres per hour in a matter of minutes, making their automated detection and characterisation challenging. Additionally, there are numerous faint solar features, such as coronal holes and coronal dimmings, which are important for space weather monitoring and forecasting, but their low intensity and sometimes transient nature makes them problematic to detect using traditional image processing techniques. These difficulties are compounded by advances in ground- and space- based instrumentation, which have increased the volume of data that solar physicists are confronted with on a minute-by-minute basis; NASA's Solar Dynamics Observatory for example is returning many thousands of images per hour (~1.5 TB/day). This chapter reviews recent advances in the application of images processing techniques to the automated detection of active regions, coronal holes, filaments, CMEs, and coronal dimmings for the purposes of space weather monitoring and prediction.
△ Less
Submitted 3 October, 2011; v1 submitted 30 September, 2011;
originally announced September 2011.
-
Deriving the Coronal Hole Electron Temperature: Electron Density Dependent Ionization/Recombination Considerations
Authors:
J. G. Doyle,
S. Chapman,
P. Bryans,
D. Perez-Suarez,
A. Singh,
H. Summers,
D. W. Savin
Abstract:
Comparison of appropriate theoretical derived line ratios with observational data can yield estimates of a plasma's physical parameters, such as electron density or temperature. The usual practice in the calculation of the line ratio is the assumption of excitation by electrons/protons followed by radiative decay. Furthermore, it is normal to use the so-called coronal approximation, i.e. one onl…
▽ More
Comparison of appropriate theoretical derived line ratios with observational data can yield estimates of a plasma's physical parameters, such as electron density or temperature. The usual practice in the calculation of the line ratio is the assumption of excitation by electrons/protons followed by radiative decay. Furthermore, it is normal to use the so-called coronal approximation, i.e. one only considers ionization and recombination to and from the ground state. A more accurate treatment is to include the ionization/recombination to and from meta-stable levels. Here, we apply this to two lines from adjacent ionization stages; Mg IX 368A and Mg X 625A, which has been shown to be a very useful temperature diagnostic. At densities typical of coronal hole conditions, the difference between the electron temperature derived assuming the zero density limit compared with the electron density dependent ionization/recombination is small. This however is not the case for flares where the electron density is orders of magnitude larger. The derived temperature for the coronal hole at solar maximum is around 1.04 MK compared to just below 0.82 MK at solar minimum.
△ Less
Submitted 25 September, 2009; v1 submitted 17 September, 2009;
originally announced September 2009.
-
Signatures of Alfven waves in the polar coronal holes as seen by EIS/Hinode
Authors:
D. Banerjee,
D. Perez-Suarez,
J. G. Doyle
Abstract:
Context. We diagnose the properties of the plume and interplume regions in a polar coronal hole and the role of waves in the acceleration of the solar wind. Aims. We attempt to detect whether Alfven waves are present in the polar coronal holes through variations in EUV line widths. Methods. Using spectral observations performed over a polar coronal hole region with the EIS spectrometer on Hinode…
▽ More
Context. We diagnose the properties of the plume and interplume regions in a polar coronal hole and the role of waves in the acceleration of the solar wind. Aims. We attempt to detect whether Alfven waves are present in the polar coronal holes through variations in EUV line widths. Methods. Using spectral observations performed over a polar coronal hole region with the EIS spectrometer on Hinode, we study the variation in the line width and electron density as a function of height. We use the density sensitive line pairs of Fe xii 186.88 A & 195.119 A and Fe xiii 203.82 A & 202.04 A . Results. For the polar region, the line width data show that the nonthermal line-of-sight velocity increases from 26 km/s at 1000 above the limb to 42 km/s some 15000 (i.e. 110,000 km) above the limb. The electron density shows a decrease from 3:3 10^9 cm^-3 to 1:9 10^8 cm^-3 over the same distance. Conclusions. These results imply that the nonthermal velocity is inversely proportional to the quadratic root of the electron density, in excellent agreement with what is predicted for undamped radially propagating linear Alfven waves. Our data provide signatures of Alfven waves in the polar coronal hole regions, which could be important for the acceleration of the solar wind.
△ Less
Submitted 24 June, 2009;
originally announced June 2009.
-
The structure and dynamics of a bright point as seen with Hinode, SoHO and TRACE
Authors:
D. Pérez-Suárez,
R. C. Maclean,
J. G. Doyle,
M. S. Madjarska
Abstract:
Our aim is to determine the plasma properties of a coronal bright point and compare its magnetic topology extrapolated from magnetogram data with its appearance in X-ray images. We analyse spectroscopic data obtained with EIS/Hinode, Ca II H and G-band images from SOT/Hinode, UV images from TRACE, X-ray images from XRT/Hinode and high-resolution/high-cadence magnetogram data from MDI/SoHO. The B…
▽ More
Our aim is to determine the plasma properties of a coronal bright point and compare its magnetic topology extrapolated from magnetogram data with its appearance in X-ray images. We analyse spectroscopic data obtained with EIS/Hinode, Ca II H and G-band images from SOT/Hinode, UV images from TRACE, X-ray images from XRT/Hinode and high-resolution/high-cadence magnetogram data from MDI/SoHO. The BP comprises several coronal loops as seen in the X-ray images, while the chromospheric structure consists of tens of small bright points as seen in Ca II H. An excellent correlation exists between the Ca II BPs and increases in the magnetic field, implying that the Ca II H passband is a good indicator for the concentration of magnetic flux. Doppler velocities between 6 and 15 km/s are derived from the Fe XII and Fe XIII lines for the BP region, while for Fe XIV and Si VII they are in the range from -15 to +15 km/s. The coronal electron density is 3.7x10^9 cm^-3. An excellent correlation is found between the positive magnetic flux and the X-ray light-curves. The remarkable agreement between the extrapolated magnetic field configuration and some of the loops composing the BP as seen in the X-ray images suggests that a large fraction of the magnetic field in the bright point is close to potential. The close correlation between the positive magnetic flux and the X-ray emission suggests that energy released by magnetic reconnection is stimulated by flux emergence or cancellation.
△ Less
Submitted 6 October, 2008;
originally announced October 2008.
