-
Automated Grading of Anatomical Objective Structured Practical Exams Using Decision Trees
Authors:
Jason Bernard,
Ranil Sonnadara,
Anthony N. Saraco,
Josh P. Mitchell,
Alex B. Bak,
Ilana Bayer,
Bruce C. Wainman
Abstract:
An Objective Structured Practical Examination (OSPE) is an effective and robust, but resource-intensive, means of evaluating anatomical knowledge. Since most OSPEs employ short answer or fill-in-the-blank style questions, the format requires many people familiar with the content to mark the exams. However, the increasing prevalence of online delivery for anatomy and physiology courses could result…
▽ More
An Objective Structured Practical Examination (OSPE) is an effective and robust, but resource-intensive, means of evaluating anatomical knowledge. Since most OSPEs employ short answer or fill-in-the-blank style questions, the format requires many people familiar with the content to mark the exams. However, the increasing prevalence of online delivery for anatomy and physiology courses could result in students losing the OSPE practice that they would receive in face-to-face learning sessions. The purpose of this study was to test the accuracy of Decision Trees (DTs) in marking OSPE questions as a potential first step to creating an intelligent, online OSPE tutoring system. The study used the results of the winter 2020 semester final OSPE from McMaster University's anatomy and physiology course in the Faculty of Health Sciences (HTHSCI 2FF3/2LL3/1D06) as the data set. Ninety percent of the data set was used in a 10-fold validation algorithm to train a DT for each of the 54 questions. Each DT was comprised of unique words that appeared in correct, student-written answers. The remaining 10% of the data set was marked by the generated DTs. When the answers marked by the DT were compared to the answers marked by staff and faculty, the DT achieved an average accuracy of 94.49% across all 54 questions. This suggests that machine learning algorithms such as DTs are a highly effective option for OSPE grading and are suitable for the development of an intelligent, online OSPE tutoring system.
△ Less
Submitted 1 June, 2021;
originally announced June 2021.
-
Hyperparameter Optimization in Binary Communication Networks for Neuromorphic Deployment
Authors:
Maryam Parsa,
Catherine D. Schuman,
Prasanna Date,
Derek C. Rose,
Bill Kay,
J. Parker Mitchell,
Steven R. Young,
Ryan Dellana,
William Severa,
Thomas E. Potok,
Kaushik Roy
Abstract:
Training neural networks for neuromorphic deployment is non-trivial. There have been a variety of approaches proposed to adapt back-propagation or back-propagation-like algorithms appropriate for training. Considering that these networks often have very different performance characteristics than traditional neural networks, it is often unclear how to set either the network topology or the hyperpar…
▽ More
Training neural networks for neuromorphic deployment is non-trivial. There have been a variety of approaches proposed to adapt back-propagation or back-propagation-like algorithms appropriate for training. Considering that these networks often have very different performance characteristics than traditional neural networks, it is often unclear how to set either the network topology or the hyperparameters to achieve optimal performance. In this work, we introduce a Bayesian approach for optimizing the hyperparameters of an algorithm for training binary communication networks that can be deployed to neuromorphic hardware. We show that by optimizing the hyperparameters on this algorithm for each dataset, we can achieve improvements in accuracy over the previous state-of-the-art for this algorithm on each dataset (by up to 15 percent). This jump in performance continues to emphasize the potential when converting traditional neural networks to binary communication applicable to neuromorphic hardware.
△ Less
Submitted 20 April, 2020;
originally announced May 2020.
-
Multi-Objective Optimization for Size and Resilience of Spiking Neural Networks
Authors:
Mihaela Dimovska,
Travis Johnston,
Catherine D. Schuman,
J. Parker Mitchell,
Thomas E. Potok
Abstract:
Inspired by the connectivity mechanisms in the brain, neuromorphic computing architectures model Spiking Neural Networks (SNNs) in silicon. As such, neuromorphic architectures are designed and developed with the goal of having small, low power chips that can perform control and machine learning tasks. However, the power consumption of the developed hardware can greatly depend on the size of the ne…
▽ More
Inspired by the connectivity mechanisms in the brain, neuromorphic computing architectures model Spiking Neural Networks (SNNs) in silicon. As such, neuromorphic architectures are designed and developed with the goal of having small, low power chips that can perform control and machine learning tasks. However, the power consumption of the developed hardware can greatly depend on the size of the network that is being evaluated on the chip. Furthermore, the accuracy of a trained SNN that is evaluated on chip can change due to voltage and current variations in the hardware that perturb the learned weights of the network. While efforts are made on the hardware side to minimize those perturbations, a software based strategy to make the deployed networks more resilient can help further alleviate that issue. In this work, we study Spiking Neural Networks in two neuromorphic architecture implementations with the goal of decreasing their size, while at the same time increasing their resiliency to hardware faults. We leverage an evolutionary algorithm to train the SNNs and propose a multiobjective fitness function to optimize the size and resiliency of the SNN. We demonstrate that this strategy leads to well-performing, small-sized networks that are more resilient to hardware faults.
△ Less
Submitted 4 February, 2020;
originally announced February 2020.
-
Instability of Magnetic Equilibria in Barotropic Stars
Authors:
J. P. Mitchell,
J. Braithwaite,
A. Reisenegger,
H. Spruit,
J. A. Valdivia,
N. Langer
Abstract:
In stably stratified stars, numerical magneto-hydrodynamics simulations have shown that arbitrary initial magnetic fields evolve into stable equilibrium configurations, usually containing nearly axisymmetric, linked poloidal and toroidal fields that stabilize each other. In this work, we test the hypothesis that stable stratification is a requirement for the existence of such stable equilibria. Fo…
▽ More
In stably stratified stars, numerical magneto-hydrodynamics simulations have shown that arbitrary initial magnetic fields evolve into stable equilibrium configurations, usually containing nearly axisymmetric, linked poloidal and toroidal fields that stabilize each other. In this work, we test the hypothesis that stable stratification is a requirement for the existence of such stable equilibria. For this purpose, we follow numerically the evolution of magnetic fields in barotropic (and thus neutrally stable) stars, starting from two different types of initial conditions, namely random disordered magnetic fields, as well as linked poloidal-toroidal configurations resembling the previously found equilibria. With many trials, we always find a decay of the magnetic field over a few Alfvén times, never a stable equilibrium. This strongly suggests that there are no stable equilibria in barotropic stars, thus clearly invalidating the assumption of barotropic equations of state often imposed on the search of magnetic equilibria. It also supports the hypothesis that, as dissipative processes erode the stable stratification, they might destabilize previously stable magnetic field configurations, leading to their decay.
△ Less
Submitted 26 November, 2014;
originally announced November 2014.
-
Search for Stable Magnetohydrodynamic Equilibria in Barotropic Stars
Authors:
J. P. Mitchell,
J. Braithwaite,
N. Langer,
A. Reisenegger,
H. Spruit
Abstract:
It is now believed that magnetohydrodynamic equilibria can exist in stably stratified stars due to the seminal works of Braithwaite & Spruit (2004) and Braithwaite & Nordlund (2006). What is still not known is whether magnetohydrodynamic equilibria can exist in a barotropic star, in which stable stratification is not present. It has been conjectured by Reisenegger (2009) that there will likely not…
▽ More
It is now believed that magnetohydrodynamic equilibria can exist in stably stratified stars due to the seminal works of Braithwaite & Spruit (2004) and Braithwaite & Nordlund (2006). What is still not known is whether magnetohydrodynamic equilibria can exist in a barotropic star, in which stable stratification is not present. It has been conjectured by Reisenegger (2009) that there will likely not exist any magnetohydrodynamical equilibria in barotropic stars. We aim to test this claim by presenting preliminary MHD simulations of barotropic stars using the three dimensional stagger code of Nordlund & Galsgaard (1995).
△ Less
Submitted 9 October, 2013;
originally announced October 2013.
-
Structure of 8B from elastic and inelastic 7Be+p scattering
Authors:
J. P. Mitchell,
G. V. Rogachev,
E. D. Johnson,
L. T. Baby,
K. W. Kemper,
A. M. Moro,
P. Peplowski,
A. S. Volya,
I. Wiedenhoever
Abstract:
Motivation: Detailed experimental knowledge of the level structure of light weakly bound nuclei is necessary to guide the development of new theoretical approaches that combine nuclear structure with reaction dynamics.
Purpose: The resonant structure of 8B is studied in this work.
Method: Excitation functions for elastic and inelastic 7Be+p scattering were measured using a 7Be rare isotope bea…
▽ More
Motivation: Detailed experimental knowledge of the level structure of light weakly bound nuclei is necessary to guide the development of new theoretical approaches that combine nuclear structure with reaction dynamics.
Purpose: The resonant structure of 8B is studied in this work.
Method: Excitation functions for elastic and inelastic 7Be+p scattering were measured using a 7Be rare isotope beam. Excitation energies ranging between 1.6 and 3.4 MeV were investigated. An R-matrix analysis of the excitation functions was performed.
Results: New low-lying resonances at 1.9, 2.5, and 3.3 MeV in 8B are reported with spin-parity assignment 0+, 2+, and 1+, respectively. Comparison to the Time Dependent Continuum Shell (TDCSM) model and ab initio no-core shell model/resonating-group method (NCSM/RGM) calculations is performed. This work is a more detailed analysis of the data first published as a Rapid Communication. [J.P. Mitchell, et al, Phys. Rev. C 82, 011601(R) (2010)]
Conclusions: Identification of the 0+, 2+, 1+ states that were predicted by some models at relatively low energy but never observed experimentally is an important step toward understanding the structure of 8B. Their identification was aided by having both elastic and inelastic scattering data. Direct comparison of the cross sections and phase shifts predicted by the TDCSM and ab initio No Core Shell Model coupled with the resonating group method is of particular interest and provides a good test for these theoretical approaches.
△ Less
Submitted 1 March, 2013;
originally announced March 2013.
-
Low-lying states in 8B
Authors:
J. P. Mitchell,
G. V. Rogachev,
E. D. Johnson,
L. T. Baby,
K. W. Kemper,
A. M. Moro,
P. N. Peplowski,
A. Volya,
I. Wiedenhoever
Abstract:
Excitation functions of elastic and inelastic 7Be+p scattering were measured in the energy range between 1.6 and 2.8 MeV in the c.m. An R-matrix analysis of the excitation functions provides strong evidence for new positive parity states in 8B. A new 2+ state at an excitation energy of 2.55 MeV was observed and a new 0+ state at 1.9 MeV is tentatively suggested. The R-matrix and Time Dependent Con…
▽ More
Excitation functions of elastic and inelastic 7Be+p scattering were measured in the energy range between 1.6 and 2.8 MeV in the c.m. An R-matrix analysis of the excitation functions provides strong evidence for new positive parity states in 8B. A new 2+ state at an excitation energy of 2.55 MeV was observed and a new 0+ state at 1.9 MeV is tentatively suggested. The R-matrix and Time Dependent Continuum Shell Model were used in the analysis of the excitation functions. The new results are compared to the calculations of contemporary theoretical models.
△ Less
Submitted 30 June, 2010;
originally announced July 2010.