-
A cast of thousands: How the IDEAS Productivity project has advanced software productivity and sustainability
Authors:
Lois Curfman McInnes,
Michael Heroux,
David E. Bernholdt,
Anshu Dubey,
Elsa Gonsiorowski,
Rinku Gupta,
Osni Marques,
J. David Moulton,
Hai Ah Nam,
Boyana Norris,
Elaine M. Raybourn,
Jim Willenbring,
Ann Almgren,
Ross Bartlett,
Kita Cranfill,
Stephen Fickas,
Don Frederick,
William Godoy,
Patricia Grubel,
Rebecca Hartman-Baker,
Axel Huebl,
Rose Lynch,
Addi Malviya Thakur,
Reed Milewicz,
Mark C. Miller
, et al. (9 additional authors not shown)
Abstract:
Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. DOE Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities-building an advanced software ecosystem that supports next-gene…
▽ More
Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. DOE Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities-building an advanced software ecosystem that supports next-generation applications and addresses disruptive changes in computer architectures. However, concerns are growing about the productivity of the developers of scientific software, its sustainability, and the trustworthiness of the results that it produces. Members of the IDEAS project serve as catalysts to address these challenges through fostering software communities, incubating and curating methodologies and resources, and disseminating knowledge to advance developer productivity and software sustainability. This paper discusses how these synergistic activities are advancing scientific discovery-mitigating technical risks by building a firmer foundation for reproducible, sustainable science at all scales of computing, from laptops to clusters to exascale and beyond.
△ Less
Submitted 16 February, 2024; v1 submitted 3 November, 2023;
originally announced November 2023.
-
Solar Sail Propulsion by 2050: An Enabling Capability for Heliophysics Missions
Authors:
Les Johnson,
Nathan Barnes,
Matteo Ceriotti,
Thomas Y. Chen,
Artur Davoyan,
Louis Friedman,
Darren Garber,
Roman Kezerashvili,
Ken Kobayashi,
Greg Matloff,
Colin McInnes,
Pat Mulligan,
Grover Swartzlander,
Slava G. Turyshev
Abstract:
Solar sails enable missions to observe the solar environment from unique vantage points, such as sustained observations away from the Sun-Earth line; sub-L1 station kee**; high inclination solar orbits; Earth polar-sitting and polar-viewing observatories; fast transit missions to study heliosphere to interstellar medium transition, as well as missions of interest across a broad user community. R…
▽ More
Solar sails enable missions to observe the solar environment from unique vantage points, such as sustained observations away from the Sun-Earth line; sub-L1 station kee**; high inclination solar orbits; Earth polar-sitting and polar-viewing observatories; fast transit missions to study heliosphere to interstellar medium transition, as well as missions of interest across a broad user community. Recent and planned demonstration missions make this technology ready for use on near-term science missions.
△ Less
Submitted 2 January, 2023;
originally announced January 2023.
-
The PETSc Community Is the Infrastructure
Authors:
Mark Adams,
Satish Balay,
Oana Marin,
Lois Curfman McInnes,
Richard Tran Mills,
Todd Munson,
Hong Zhang,
Junchao Zhang,
Jed Brown,
Victor Eijkhout,
Jacob Faibussowitsch,
Matthew Knepley,
Fande Kong,
Scott Kruger,
Patrick Sanan,
Barry F. Smith,
Hong Zhang
Abstract:
The communities who develop and support open source scientific software packages are crucial to the utility and success of such packages. Moreover, these communities form an important part of the human infrastructure that enables scientific progress. This paper discusses aspects of the PETSc (Portable Extensible Toolkit for Scientific Computation) community, its organization, and technical approac…
▽ More
The communities who develop and support open source scientific software packages are crucial to the utility and success of such packages. Moreover, these communities form an important part of the human infrastructure that enables scientific progress. This paper discusses aspects of the PETSc (Portable Extensible Toolkit for Scientific Computation) community, its organization, and technical approaches that enable community members to help each other efficiently.
△ Less
Submitted 3 January, 2022;
originally announced January 2022.
-
Community Organizations: Changing the Culture in Which Research Software Is Developed and Sustained
Authors:
Daniel S. Katz,
Lois Curfman McInnes,
David E. Bernholdt,
Abigail Cabunoc Mayes,
Neil P. Chue Hong,
Jonah Duckles,
Sandra Gesing,
Michael A. Heroux,
Simon Hettrick,
Rafael C. Jimenez,
Marlon Pierce,
Belinda Weaver,
Nancy Wilkins-Diehr
Abstract:
Software is the key crosscutting technology that enables advances in mathematics, computer science, and domain-specific science and engineering to achieve robust simulations and analysis for science, engineering, and other research fields. However, software itself has not traditionally received focused attention from research communities; rather, software has evolved organically and inconsistently…
▽ More
Software is the key crosscutting technology that enables advances in mathematics, computer science, and domain-specific science and engineering to achieve robust simulations and analysis for science, engineering, and other research fields. However, software itself has not traditionally received focused attention from research communities; rather, software has evolved organically and inconsistently, with its development largely as by-products of other initiatives. Moreover, challenges in scientific software are expanding due to disruptive changes in computer hardware, increasing scale and complexity of data, and demands for more complex simulations involving multiphysics, multiscale modeling and outer-loop analysis. In recent years, community members have established a range of grass-roots organizations and projects to address these growing technical and social challenges in software productivity, quality, reproducibility, and sustainability. This article provides an overview of such groups and discusses opportunities to leverage their synergistic activities while nurturing work toward emerging software ecosystems.
△ Less
Submitted 7 December, 2018; v1 submitted 20 November, 2018;
originally announced November 2018.
-
xSDK Foundations: Toward an Extreme-scale Scientific Software Development Kit
Authors:
Roscoe Bartlett,
Irina Demeshko,
Todd Gamblin,
Glenn Hammond,
Michael Heroux,
Jeffrey Johnson,
Alicia Klinvex,
Xiaoye Li,
Lois Curfman McInnes,
J. David Moulton,
Daniel Osei-Kuffuor,
Jason Sarich,
Barry Smith,
Jim Willenbring,
Ulrike Meier Yang
Abstract:
Extreme-scale computational science increasingly demands multiscale and multiphysics formulations. Combining software developed by independent groups is imperative: no single team has resources for all predictive science and decision support capabilities. Scientific libraries provide high-quality, reusable software components for constructing applications with improved robustness and portability.…
▽ More
Extreme-scale computational science increasingly demands multiscale and multiphysics formulations. Combining software developed by independent groups is imperative: no single team has resources for all predictive science and decision support capabilities. Scientific libraries provide high-quality, reusable software components for constructing applications with improved robustness and portability. However, without coordination, many libraries cannot be easily composed. Namespace collisions, inconsistent arguments, lack of third-party software versioning, and additional difficulties make composition costly.
The Extreme-scale Scientific Software Development Kit (xSDK) defines community policies to improve code quality and compatibility across independently developed packages (hypre, PETSc, SuperLU, Trilinos, and Alquimia) and provides a foundation for addressing broader issues in software interoperability, performance portability, and sustainability. The xSDK provides turnkey installation of member software and seamless combination of aggregate capabilities, and it marks first steps toward extreme-scale scientific software ecosystems from which future applications can be composed rapidly with assured quality and scalability.
△ Less
Submitted 27 February, 2017;
originally announced February 2017.
-
Research and Education in Computational Science and Engineering
Authors:
Ulrich Rüde,
Karen Willcox,
Lois Curfman McInnes,
Hans De Sterck,
George Biros,
Hans Bungartz,
James Corones,
Evin Cramer,
James Crowley,
Omar Ghattas,
Max Gunzburger,
Michael Hanke,
Robert Harrison,
Michael Heroux,
Jan Hesthaven,
Peter Jimack,
Chris Johnson,
Kirk E. Jordan,
David E. Keyes,
Rolf Krause,
Vipin Kumar,
Stefan Mayer,
Juan Meza,
Knut Martin Mørken,
J. Tinsley Oden
, et al. (8 additional authors not shown)
Abstract:
Over the past two decades the field of computational science and engineering (CSE) has penetrated both basic and applied research in academia, industry, and laboratories to advance discovery, optimize systems, support decision-makers, and educate the scientific and engineering workforce. Informed by centuries of theory and experiment, CSE performs computational experiments to answer questions that…
▽ More
Over the past two decades the field of computational science and engineering (CSE) has penetrated both basic and applied research in academia, industry, and laboratories to advance discovery, optimize systems, support decision-makers, and educate the scientific and engineering workforce. Informed by centuries of theory and experiment, CSE performs computational experiments to answer questions that neither theory nor experiment alone is equipped to answer. CSE provides scientists and engineers of all persuasions with algorithmic inventions and software systems that transcend disciplines and scales. Carried on a wave of digital technology, CSE brings the power of parallelism to bear on troves of data. Mathematics-based advanced computing has become a prevalent means of discovery and innovation in essentially all areas of science, engineering, technology, and society; and the CSE community is at the core of this transformation. However, a combination of disruptive developments---including the architectural complexity of extreme-scale computing, the data revolution that engulfs the planet, and the specialization required to follow the applications to new frontiers---is redefining the scope and reach of the CSE endeavor. This report describes the rapid expansion of CSE and the challenges to sustaining its bold advances. The report also presents strategies and directions for CSE research and education for the next decade.
△ Less
Submitted 31 December, 2017; v1 submitted 8 October, 2016;
originally announced October 2016.
-
On The Evolution Of User Support Topics in Computational Science and Engineering Software
Authors:
K. Rupp,
S. Balay,
J. Brown,
M. Knepley,
L. C. McInnes,
B. Smith
Abstract:
We investigate ten years of user support emails in the large-scale solver library PETSc in order to identify changes in user requests. For this purpose we assign each email thread to one or several categories describing the type of support request. We find that despite several changes in hardware architecture as well programming models, the relative share of emails for the individual categories do…
▽ More
We investigate ten years of user support emails in the large-scale solver library PETSc in order to identify changes in user requests. For this purpose we assign each email thread to one or several categories describing the type of support request. We find that despite several changes in hardware architecture as well programming models, the relative share of emails for the individual categories does not show a notable change over time. This is particularly remarkable as the total communication volume has increased four-fold in the considered time frame, indicating a considerable growth of the user base. Our data also demonstrates that user support cannot be substituted with what is often referred to as 'better documentation' and that the involvement of core developers in user support is essential.
△ Less
Submitted 5 October, 2015;
originally announced October 2015.
-
Low-energy capture of asteroids onto KAM tori
Authors:
Patricia E. Verrier,
Colin R. McInnes
Abstract:
We present a new method for engineering the artificial capture of asteroids. Based on theories of the chaos-assisted capture of natural satellites of the giant planets, we show how an unbound asteroid that passes close to a regular region of phase space can be easily moved onto the nearby KAM tori and essentially permanently captured with the Earth's Hill sphere without closing the zero velocity c…
▽ More
We present a new method for engineering the artificial capture of asteroids. Based on theories of the chaos-assisted capture of natural satellites of the giant planets, we show how an unbound asteroid that passes close to a regular region of phase space can be easily moved onto the nearby KAM tori and essentially permanently captured with the Earth's Hill sphere without closing the zero velocity curves. The method has the advantages of a relatively low delta-v requirement and no need for control strategies. An illustration of the method is given for an example asteroid trajectory, demonstrating that it is a viable strategy for the final capture stage of asteroids in the Earth's neighbourhood.
△ Less
Submitted 13 January, 2015;
originally announced January 2015.
-
Concept-of-Operations Disposal Analysis of Spacecraft by Gossamer Structure
Authors:
Malcolm Macdonald,
Colin McInnes,
Charlotte Lücking Bewick,
Lourens Visagie,
Vaios Lappas,
Sven Erb
Abstract:
A gossamer structure for end-of-life disposal of spacecraft to mitigate space debris is considered in comparison with other end-of-life disposal concepts to determine when it would be preferable. A needs analysis, potential use cases, and concept-of-operations are developed. A survey of disposal strategies is presented for comparison prior to a down-selection of viable competing techniques; solar…
▽ More
A gossamer structure for end-of-life disposal of spacecraft to mitigate space debris is considered in comparison with other end-of-life disposal concepts to determine when it would be preferable. A needs analysis, potential use cases, and concept-of-operations are developed. A survey of disposal strategies is presented for comparison prior to a down-selection of viable competing techniques; solar sailing, high and low-thrust propulsion, and electrodynamic tethers. A parametric comparison of the down-selection competing techniques is presented. Exploiting solar radiation pressure on the structure is of limited value. Atmospheric drag augmentation was found to be of most benefit for end-of-life disposal when an entirely passive means is required, allowing the gossamer device to act as a fail-safe. This is applicable to only low and medium mass spacecraft, or spacecraft that are unlikely to survive atmospheric re-entry, hence minimizing risk to human life. It does not significantly alter the operating ceiling altitude but does the maximum allowable end-of-life mass. Peak mass benefit occurs in the altitude range 550 - 650 km and is largely independent of de-orbit time.
△ Less
Submitted 24 October, 2014;
originally announced October 2014.
-
Periodic orbits for 3 and 4 co-orbital bodies
Authors:
Patricia Verrier,
Colin McInnes
Abstract:
We investigate the natural families of periodic orbits associated with the equilibrium configurations of the the planar restricted $1+n$ body problem for the case $2\leq n \leq 4$ equal mass satellites. Such periodic orbits can be used to model both trojan exoplanetary systems and parking orbits for captured asteroids within the solar system. For $n=2$ there are two families of periodic orbits ass…
▽ More
We investigate the natural families of periodic orbits associated with the equilibrium configurations of the the planar restricted $1+n$ body problem for the case $2\leq n \leq 4$ equal mass satellites. Such periodic orbits can be used to model both trojan exoplanetary systems and parking orbits for captured asteroids within the solar system. For $n=2$ there are two families of periodic orbits associated with the equilibria of the system: the well known horseshoe and tadpole orbits. For $n=3$ there are three families that emanate from the equilibrium configurations of the satellites, while for $n=4$ there are six such families as well as numerous additional connecting families. The families of periodic orbits are all of the horseshoe or tadpole type, and several have regions of neutral linear stability.
△ Less
Submitted 1 July, 2014; v1 submitted 29 May, 2014;
originally announced May 2014.
-
Passive Sorting of Asteroid Material Using Solar Radiation Pressure
Authors:
Daniel García Yárnoz,
Joan-Pau Sanchez,
Colin R. McInnes
Abstract:
Understanding dust dynamics in the vicinity of asteroids is key for future science missions and, in the long-term, for asteroid exploitation. This paper analyzes the feasibility of manipulating asteroid material by means of solar radiation pressure. A novel method is proposed for passively sorting material as a function of its grain size or density, where solar radiation pressure is used as a pass…
▽ More
Understanding dust dynamics in the vicinity of asteroids is key for future science missions and, in the long-term, for asteroid exploitation. This paper analyzes the feasibility of manipulating asteroid material by means of solar radiation pressure. A novel method is proposed for passively sorting material as a function of its grain size or density, where solar radiation pressure is used as a passive in-situ "mass spectrometer". A simplified analysis shows that in principle this method allows an effective sorting of regolith material. This could have immediate applications for a sample return mission, and for industrial scale in-situ resource utilization to separate and concentrate regolith according to particle size or composition.
△ Less
Submitted 22 January, 2014;
originally announced January 2014.
-
Easily Retrievable Objects among the NEO Population
Authors:
D. García Yárnoz,
J. P. Sánchez,
C. R. McInnes
Abstract:
Asteroids and comets are of strategic importance for science in an effort to understand the formation, evolution and composition of the Solar System. Near-Earth Objects (NEOs) are of particular interest because of their accessibility from Earth, but also because of their speculated wealth of material resources. The exploitation of these resources has long been discussed as a means to lower the cos…
▽ More
Asteroids and comets are of strategic importance for science in an effort to understand the formation, evolution and composition of the Solar System. Near-Earth Objects (NEOs) are of particular interest because of their accessibility from Earth, but also because of their speculated wealth of material resources. The exploitation of these resources has long been discussed as a means to lower the cost of future space endeavours. In this paper, we consider the currently known NEO population and define a family of so-called Easily Retrievable Objects (EROs), objects that can be transported from accessible heliocentric orbits into the Earth's neighbourhood at affordable costs. The asteroid retrieval transfers are sought from the continuum of low energy transfers enabled by the dynamics of invariant manifolds; specifically, the retrieval transfers target planar, vertical Lyapunov and halo orbit families associated with the collinear equilibrium points of the Sun-Earth Circular Restricted Three Body problem. The judicious use of these dynamical features provides the best opportunity to find extremely low energy Earth transfers for asteroid material. A catalogue of asteroid retrieval candidates is then presented. Despite the highly incomplete census of very small asteroids, the ERO catalogue can already be populated with 12 different objects retrievable with less than 500 m/s of Δv. Moreover, the approach proposed represents a robust search and ranking methodology for future retrieval candidates that can be automatically applied to the growing survey of NEOs.
△ Less
Submitted 8 August, 2013; v1 submitted 18 April, 2013;
originally announced April 2013.
-
Improved Nonlinear Solvers in BOUT++
Authors:
Ben Dudson,
Sean Farley,
Lois Curfman McInnes
Abstract:
Challenging aspects of large-scale turbulent edge simulations in plasma physics include robust nonlinear solvers and efficient preconditioners. This paper presents recent advances in the scalable solution of nonlinear partial differential equations in BOUT++, with emphasis on simulations of edge localized modes in tokamaks. A six-field, nonlinear, reduced magnetohydrodynamics model containing the…
▽ More
Challenging aspects of large-scale turbulent edge simulations in plasma physics include robust nonlinear solvers and efficient preconditioners. This paper presents recent advances in the scalable solution of nonlinear partial differential equations in BOUT++, with emphasis on simulations of edge localized modes in tokamaks. A six-field, nonlinear, reduced magnetohydrodynamics model containing the fast shear Alfven wave and electron and ion heat conduction along magnetic fields is solved by using Jacobian-free Newton-Krylov (JFNK) methods and nonlinear GMRES (NGMRES). Physics-based preconditioning based on analytic Schur factorization of a simplified Jacobian is found to result in an order of magnitude reduction in runtime over unpreconditioned JFNK, and NGMRES is shown to significantly reduce runtime while requiring only the nonlinear function evaluation. We describe in detail the preconditioning algorithm, and we discuss parallel performance of NGMRES and Newton-Krylov methods using the PETSc library.
△ Less
Submitted 10 September, 2012;
originally announced September 2012.
-
A volume-based description of gas flows with localised mass-density variations
Authors:
S. Kokou Dadzie,
Jason M. Reese,
Colin R. McInnes
Abstract:
We reconsider some fundamental aspects of the fluid mechanics model, and the derivation of continuum flow equations from gas kinetic theory. Two topologies for fluid representation are presented, and a set of macroscopic equations are derived through a modified version of the classical Boltzmann kinetic equation for monatomic gases. The free volumes around the gaseous molecules are introduced in…
▽ More
We reconsider some fundamental aspects of the fluid mechanics model, and the derivation of continuum flow equations from gas kinetic theory. Two topologies for fluid representation are presented, and a set of macroscopic equations are derived through a modified version of the classical Boltzmann kinetic equation for monatomic gases. The free volumes around the gaseous molecules are introduced into the set of kinetic microscopic parameters. Our new description comprises four, rather than three, conservation equations; the classical continuity equation, which conflates actual mass-density and number-density in a single equation, has been split into a conservation equation of mass (which involves only the classical number-density of the gaseous particles) and an evolution equation purely of the mass-density (mass divided by the actual volume of the fluid). We propose this model as a better description of gas flows displaying non-local-thermodynamic-equilibrium (rarefied flows), flows with relatively large variations of macroscopic properties, and/or highly compressible fluids/flows.
△ Less
Submitted 22 November, 2006;
originally announced November 2006.
-
GPCG: A Case Study in the Performance and Scalability of Optimization Algorithms
Authors:
Steven J. Benson,
Lois Curfman McInnes,
Jorge J. Moré
Abstract:
GPCG is an algorithm within the Toolkit for Advanced Optimization (TAO) for solving bound constrained, convex quadratic problems. Originally developed by More' and Toraldo, this algorithm was designed for large-scale problems but had been implemented only for a single processor. The TAO implementation is available for a wide range of high-performance architecture, and has been tested on up to 64…
▽ More
GPCG is an algorithm within the Toolkit for Advanced Optimization (TAO) for solving bound constrained, convex quadratic problems. Originally developed by More' and Toraldo, this algorithm was designed for large-scale problems but had been implemented only for a single processor. The TAO implementation is available for a wide range of high-performance architecture, and has been tested on up to 64 processors to solve problems with over 2.5 million variables.
△ Less
Submitted 19 January, 2001;
originally announced January 2001.
