-
What Sustained Multi-Disciplinary Research Can Achieve: The Space Weather Modeling Framework
Authors:
Tamas I. Gombosi,
Yuxi Chen,
Alex Glocer,
Zhenguang Huang,
Xianzhe Jia,
Michael W. Liemohn,
Ward B. Manchester,
Tuija Pulkkinen,
Nishtha Sachdeva,
Qusai Al Shidi,
Igor V. Sokolov,
Judit Szente,
Valeriy Tenishev,
Gabor Toth,
Bart van der Holst,
Daniel T. Welling,
Lulu Zhao,
Shasha Zou
Abstract:
MHD-based global space weather models have mostly been developed and maintained at academic institutions. While the "free spirit" approach of academia enables the rapid emergence and testing of new ideas and methods, the lack of long-term stability and support makes this arrangement very challenging. This paper describes a successful example of a university-based group, the Center of Space Environ…
▽ More
MHD-based global space weather models have mostly been developed and maintained at academic institutions. While the "free spirit" approach of academia enables the rapid emergence and testing of new ideas and methods, the lack of long-term stability and support makes this arrangement very challenging. This paper describes a successful example of a university-based group, the Center of Space Environment Modeling (CSEM) at the University of Michigan, that developed and maintained the Space Weather Modeling Framework (SWMF) and its core element, the BATS-R-US extended MHD code. It took a quarter of a century to develop this capability and reach its present level of maturity that makes it suitable for research use by the space physics community through the Community Coordinated Modeling Center (CCMC) as well as operational use by the NOAA Space Weather Prediction Center (SWPC).
△ Less
Submitted 27 May, 2021;
originally announced May 2021.
-
Conductance Model for Extreme Events : Impact of Auroral Conductance on Space Weather Forecasts
Authors:
Agnit Mukhopadhyay,
Daniel T Welling,
Michael W Liemohn,
Aaron J Ridley,
Shibaji Chakrabarty,
Brian J Anderson
Abstract:
Ionospheric conductance is a crucial factor in regulating the closure of magnetospheric field-aligned currents through the ionosphere as Hall and Pedersen currents. Despite its importance in predictive investigations of the magnetosphere - ionosphere coupling, the estimation of ionospheric conductance in the auroral region is precarious in most global first-principles based models. This imprecisen…
▽ More
Ionospheric conductance is a crucial factor in regulating the closure of magnetospheric field-aligned currents through the ionosphere as Hall and Pedersen currents. Despite its importance in predictive investigations of the magnetosphere - ionosphere coupling, the estimation of ionospheric conductance in the auroral region is precarious in most global first-principles based models. This impreciseness in estimating the auroral conductance impedes both our understanding and predictive capabilities of the magnetosphere-ionosphere system during extreme space weather events. In this article, we address this concern, with the development of an advanced Conductance Model for Extreme Events (CMEE) that estimates the auroral conductance from field aligned current values. CMEE has been developed using nonlinear regression over a year's worth of one-minute resolution output from assimilative maps, specifically including times of extreme driving of the solar wind-magnetosphere-ionosphere system. The model also includes provisions to enhance the conductance in the aurora using additional adjustments to refine the auroral oval. CMEE has been incorporated within the Ridley Ionosphere Model (RIM) of the Space Weather Modeling Framework (SWMF) for usage in space weather simulations. This paper compares performance of CMEE against the existing conductance model in RIM, through a validation process for six space weather events. The performance analysis indicates overall improvement in the ionospheric feedback to ground-based space weather forecasts. Specifically, the model is able to improve the prediction of ionospheric currents which impact the simulated dB/dt and ΔB, resulting in substantial improvements in dB/dt predictive skill.
△ Less
Submitted 27 August, 2020;
originally announced August 2020.
-
Incorporating Physical Knowledge into Machine Learning for Planetary Space Physics
Authors:
A. R. Azari,
J. W. Lockhart,
M. W. Liemohn,
X. Jia
Abstract:
Recent improvements in data collection volume from planetary and space physics missions have allowed the application of novel data science techniques. The Cassini mission for example collected over 600 gigabytes of scientific data from 2004 to 2017. This represents a surge of data on the Saturn system. Machine learning can help scientists work with data on this larger scale. Unlike many applicatio…
▽ More
Recent improvements in data collection volume from planetary and space physics missions have allowed the application of novel data science techniques. The Cassini mission for example collected over 600 gigabytes of scientific data from 2004 to 2017. This represents a surge of data on the Saturn system. Machine learning can help scientists work with data on this larger scale. Unlike many applications of machine learning, a primary use in planetary space physics applications is to infer behavior about the system itself. This raises three concerns: first, the performance of the machine learning model, second, the need for interpretable applications to answer scientific questions, and third, how characteristics of spacecraft data change these applications. In comparison to these concerns, uses of black box or un-interpretable machine learning methods tend toward evaluations of performance only either ignoring the underlying physical process or, less often, providing misleading explanations for it. We build off a previous effort applying a semi-supervised physics-based classification of plasma instabilities in Saturn's magnetosphere. We then use this previous effort in comparison to other machine learning classifiers with varying data size access, and physical information access. We show that incorporating knowledge of these orbiting spacecraft data characteristics improves the performance and interpretability of machine learning methods, which is essential for deriving scientific meaning. Building on these findings, we present a framework on incorporating physics knowledge into machine learning problems targeting semi-supervised classification for space physics data in planetary environments. These findings present a path forward for incorporating physical knowledge into space physics and planetary mission data analyses for scientific discovery.
△ Less
Submitted 2 June, 2020;
originally announced June 2020.
-
The STONE curve: A ROC-derived model performance assessment tool
Authors:
Michael W. Liemohn,
Abigail R. Azari,
Natalia Ganushkina,
Lutz Rastaetter
Abstract:
A new model validation and performance assessment tool is introduced, the sliding threshold of observation for numeric evaluation (STONE) curve. It is based on the relative operating characteristic (ROC) curve technique, but instead of sorting all observations in a categorical classification, the STONE tool uses the continuous nature of the observations. Rather than defining events in the observat…
▽ More
A new model validation and performance assessment tool is introduced, the sliding threshold of observation for numeric evaluation (STONE) curve. It is based on the relative operating characteristic (ROC) curve technique, but instead of sorting all observations in a categorical classification, the STONE tool uses the continuous nature of the observations. Rather than defining events in the observations and then sliding the threshold only in the classifier (model) data set, the threshold is changed simultaneously for both the observational and model values, with the same threshold value for both data and model. This is only possible if the observations are continuous and the model output is in the same units and scale as the observations, that is, the model is trying to exactly reproduce the data. The STONE curve has several similarities with the ROC curve, plotting probability of detection against probability of false detection, ranging from the (1,1) corner for low thresholds to the (0,0) corner for high thresholds, and values above the zero-intercept unity-slope line indicating better than random predictive ability. The main difference is that the STONE curve can be nonmonotonic, doubling back in both the x and y directions. These ripples reveal asymmetries in the data-model value pairs. This new technique is applied to modeling output of a common geomagnetic activity index as well as energetic electron fluxes in the Earth's inner magnetosphere. It is not limited to space physics applications but can be used for any scientific or engineering field where numerical models are used to reproduce observations.
△ Less
Submitted 22 April, 2020;
originally announced May 2020.
-
Application Usability Levels: A Framework for Tracking Project Product Progress
Authors:
Alexa J. Halford,
Adam C. Kellerman,
Katherine Garcia-Sage,
Jeffrey Klenzing,
Brett A. Carter,
Ryan M. McGranaghan,
Timothy Guild,
Consuelo Cid,
Carl J. Henney,
Natalia Y. Ganushkina,
Angeline G. Burrell,
Mike Terkildsen,
Daniel T. Welling,
Sophie A. Murray,
K. D. Leka,
James P. McCollough,
Barbara J. Thompson,
Antti Pulkkinen,
Shing F. Fung,
Suzy Bingham,
Mario M. Bisi,
Michael W. Liemohn,
Brian M. Walsh,
Steven K. Morley
Abstract:
The space physics community continues to grow and become both more interdisciplinary and more intertwined with commercial and government operations. This has created a need for a framework to easily identify what projects can be used for specific applications and how close the tool is to routine autonomous or on-demand implementation and operation. We propose the Application Usability Level (AUL)…
▽ More
The space physics community continues to grow and become both more interdisciplinary and more intertwined with commercial and government operations. This has created a need for a framework to easily identify what projects can be used for specific applications and how close the tool is to routine autonomous or on-demand implementation and operation. We propose the Application Usability Level (AUL) framework and publicizing AULs to help the community quantify the progress of successful applications, metrics, and validation efforts. This framework will also aid the scientific community by supplying the type of information needed to build off of previously published work and publicizing the applications and requirements needed by the user communities. In this paper, we define the AUL framework, outline the milestones required for progression to higher AULs, and provide example projects utilizing the AUL framework. This work has been completed as part of the activities of the Assessment of Understanding and Quantifying Progress working group which is part of the International Forum for Space Weather Capabilities Assessment.
△ Less
Submitted 19 July, 2019;
originally announced July 2019.
-
Solar wind interaction with the Martian upper atmosphere: Roles of the cold thermosphere and hot oxygen corona
Authors:
Chuanfei Dong,
Stephen W. Bougher,
Yingjuan Ma,
Yuni Lee,
Gabor Toth,
Andrew F. Nagy,
Xiaohua Fang,
Janet Luhmann,
Michael W. Liemohn,
Jasper S. Halekas,
Valeriy Tenishev,
David J. Pawlowski,
Michael R. Combi
Abstract:
We study roles of the thermosphere and exosphere on the Martian ionospheric structure and ion escape rates in the process of the solar wind-Mars interaction. We employ a four-species multifluid MHD (MF-MHD) model to simulate the Martian ionosphere and magnetosphere. The $cold$ thermosphere background is taken from the Mars Global Ionosphere Thermosphere Model (M-GITM) and the $hot$ oxygen exospher…
▽ More
We study roles of the thermosphere and exosphere on the Martian ionospheric structure and ion escape rates in the process of the solar wind-Mars interaction. We employ a four-species multifluid MHD (MF-MHD) model to simulate the Martian ionosphere and magnetosphere. The $cold$ thermosphere background is taken from the Mars Global Ionosphere Thermosphere Model (M-GITM) and the $hot$ oxygen exosphere is adopted from the Mars exosphere Monte Carlo model - Adaptive Mesh Particle Simulator (AMPS). A total of four cases with the combination of 1D (globally averaged) and 3D thermospheres and exospheres are studied.
The ion escape rates calculated by adopting 1D and 3D atmospheres are similar; however, the latter are required to adequately reproduce MAVEN ionospheric observations. In addition, our simulations show that the 3D hot oxygen corona plays an important role in preventing planetary molecular ions (O$_2^+$ and CO$_2^+$) esca** from Mars, mainly resulting from the mass loading of the high-altitude exospheric O$^+$ ions. The $cold$ thermospheric oxygen atom, however, is demonstrated to be the primary neutral source for O$^+$ ion escape during the relatively weak solar cycle 24.
△ Less
Submitted 22 June, 2018; v1 submitted 3 April, 2018;
originally announced April 2018.
-
Defining and resolving current systems in geospace
Authors:
N. Y. Ganushkina,
M. W. Liemohn,
S. Dubyagin,
I. A. Daglis,
I. Dandouras,
D. L. De Zeeuw,
Y. Ebihara,
R. Ilie,
R. Katus,
M. Kubyshkina,
S. E. Milan,
S. Ohtani,
N. Ostgaard,
J. P. Reistad,
P. Tenfjord,
F. Toffoletto,
S. Zaharia,
O. Amariutei
Abstract:
Electric currents flowing through near-Earth space ($\textit{R}$ $\leq$12 $\mathit{R}_{E}$) can support a highly distorted magnetic field topology, changing particle drift paths and therefore having a nonlinear feedback on the currents themselves. A number of current systems exist in the magnetosphere, most commonly defined as (1) the dayside magnetopause Chapman-Ferraro currents, (2) the Birkelan…
▽ More
Electric currents flowing through near-Earth space ($\textit{R}$ $\leq$12 $\mathit{R}_{E}$) can support a highly distorted magnetic field topology, changing particle drift paths and therefore having a nonlinear feedback on the currents themselves. A number of current systems exist in the magnetosphere, most commonly defined as (1) the dayside magnetopause Chapman-Ferraro currents, (2) the Birkeland field-aligned currents with high latitude "region 1" and lower-latitude "region 2" currents connected to the partial ring current, (3) the magnetotail currents, and (4) the symmetric ring current. In the near-Earth nightside region, however, several of these current systems flow in close proximity to each other. Moreover, the existence of other temporal current systems, such as the substorm current wedge or "banana" current, has been reported. It is very difficult to identify a local measurement as belonging to a specific system. Such identification is important, however, because how the current closes and how these loops change in space and time governs the magnetic topology of the magnetosphere and therefore controls the physical processes of geospace. Furthermore, many methods exist for identifying the regions of near-Earth space carrying each type of current. This study presents a robust collection of these definitions of current systems in geospace, particularly in the near-Earth nightside magnetosphere, as viewed from a variety of observational and computational analysis techniques. The influence of definitional choice on the resulting interpretation of physical processes governing geospace dynamics is presented and discussed.
△ Less
Submitted 17 January, 2017;
originally announced January 2017.