Showing 1–44 of 44 results for author: Wilcox, B

Disparities in access to US quantum information education

Authors: Josephine C. Meyer, Gina Passante, Bethany R. Wilcox

Abstract: Driven in large part by the National Quantum Initiative Act of 2018, quantum information science (QIS) coursework and degree programs are rapidly spreading across US institutions. Yet prior work suggests that access to quantum workforce education is unequally distributed, disproportionately benefiting students at private research-focused institutions whose student bodies are unrepresentative of US… ▽ More Driven in large part by the National Quantum Initiative Act of 2018, quantum information science (QIS) coursework and degree programs are rapidly spreading across US institutions. Yet prior work suggests that access to quantum workforce education is unequally distributed, disproportionately benefiting students at private research-focused institutions whose student bodies are unrepresentative of US higher education as a whole. We use regression analysis to analyze the distribution of QIS coursework across 456 institutions of higher learning as of fall 2022, identifying statistically significant disparities across institutions in particular along the axes of institution classification, funding, and geographic distribution suggesting today's QIS education programs are largely failing to reach low-income and rural students. We also conduct a brief analysis of the distribution of emerging dedicated QIS degree programs, discovering much the same trends. We conclude with a discussion of implications for educators, policymakers, and education researchers including specific policy recommendations to direct investments in QIS education to schools serving low-income and rural students, leverage existing grassroots diversity and inclusion initiatives that have arisen within the quantum community, and update and modernize procedures for collecting QIS educational data to better track these trends. △ Less

Submitted 15 March, 2024; v1 submitted 12 September, 2023; originally announced September 2023.

Comments: Submitted to Phys Rev Phys Educ Res (revised, not copy-edited)

Journal ref: Phys Rev Phys Educ Res 20, 010131 (2024)

Introductory quantum information science coursework at US institutions: Content coverage

Authors: Josephine C. Meyer, Gina Passante, Steven J. Pollock, Bethany R. Wilcox

Abstract: Despite rapid growth of quantum information science and engineering (QIS/QISE) workforce development initiatives, perceived lack of agreement among faculty on core content has made prior research-based curriculum and assessment development initiatives difficult to scale. To identify areas if consensus on content coverage, we report findings from a survey of N=63 instructors teaching introductory Q… ▽ More Despite rapid growth of quantum information science and engineering (QIS/QISE) workforce development initiatives, perceived lack of agreement among faculty on core content has made prior research-based curriculum and assessment development initiatives difficult to scale. To identify areas if consensus on content coverage, we report findings from a survey of N=63 instructors teaching introductory QISE courses at US institutions of higher learning. We identify a subset of content items common across a large fraction (>=80%) of introductory QISE courses that are potentially amenable to research-based curriculum development, with an emphasis on foundational skills in mathematics, physics, and engineering. As a further guide for curriculum development, we also examine differences in content coverage by level (undergraduate/graduate) and discipline. Finally, we briefly discuss the implications of our findings for the development of a research-based QISE assessment at the postsecondary level. △ Less

Submitted 24 August, 2023; originally announced August 2023.

Comments: Submitted to EPJ Quantum Technology, special section on quantum education

Journal ref: EPJ Quantum Technol 16(11), 2024

How media hype affects our physics teaching: A case study on quantum computing

Authors: Josephine C. Meyer, Gina Passante, Steven J. Pollock, Bethany R. Wilcox

Abstract: Popular media is an unspoken yet ever-present element of the physics landscape and a tool we can utilize in our teaching. It is also well-understood that students enter the physics classroom with a host of conceptions learned from the world at large. It stands to reason, then, to suspect that media coverage may be a major contributing factor to students' views on physical phenomena and the nature… ▽ More Popular media is an unspoken yet ever-present element of the physics landscape and a tool we can utilize in our teaching. It is also well-understood that students enter the physics classroom with a host of conceptions learned from the world at large. It stands to reason, then, to suspect that media coverage may be a major contributing factor to students' views on physical phenomena and the nature of science - one whose influence will only grow amid the 21st century digital age. Yet the role of the media in sha** physics teaching and learning has remained largely unexplored in the physics education research (PER) literature so far. Here, we explore the phenomenon of media hype from a theoretical and practical perspective: how media rhetoric of current topics in science and technology evolves, and how it affects students and instructors. We argue that media hype of cutting-edge science can be a double-edged sword for educators, with the same amped-up rhetoric that motivates students to enter the classroom tending to result in inflated preconceptions of what the science and technology can actually do. We draw on examples related to teaching quantum computing as a case study, though the findings we present should generalize to other topics garnering significant media attention - from exoplanets to graphene to batteries for electric vehicles. We conclude with a set of practical recommendations for physics teachers at all levels who wish to be more cognizant of the role exposure to popular media has on students and to tailor our teaching accordingly. △ Less

Submitted 25 January, 2023; originally announced January 2023.

Comments: Accepted to The Physics Teacher. This copy has not yet been copy-edited

Journal ref: Phys Teach 61(5), 339 (2023)

Correlations between student connectivity and academic performance: a pandemic follow-up

Authors: Nathan Crossette, Lincoln D. Carr, Bethany R. Wilcox

Abstract: Social network analysis (SNA) has been gaining traction as a technique for quantitatively studying student collaboration. We analyze networks, constructed from student self-reports of collaboration on homework assignments, in two courses from the University of Colorado Boulder and one course from the Colorado School of Mines. All three courses occurred during the COVID-19 pandemic, which allows fo… ▽ More Social network analysis (SNA) has been gaining traction as a technique for quantitatively studying student collaboration. We analyze networks, constructed from student self-reports of collaboration on homework assignments, in two courses from the University of Colorado Boulder and one course from the Colorado School of Mines. All three courses occurred during the COVID-19 pandemic, which allows for a comparison between the course at the Colorado School of Mines (in a fully remote format) with results from a previous pre-pandemic study of student collaboration at the Colorado School of Mines (in a hybrid format). We compute nodal centrality measures and calculate the correlation between student centrality and performance. Results varied widely between each of the courses studied. The course at the Colorado School of Mines had strong correlations between many centrality measures and performance which matched the patterns seen in the pre-pandemic study. The courses at the University of Colorado Boulder showed weaker correlations, and one course showed nearly no correlations at all between students' connectivity to their classmates and their performance. Taken together, the results from the trio of courses indicate that the context and environment in which the course is situated play a more important role in fostering a correlation between student collaboration and course performance than the format (remote, hybrid, in-person) of the course. Additionally, we conducted a short study on the effect that missing nodes may have on the correlations calculated from the measured networks. This investigation showed that missing nodes tend to shift correlations towards zero, providing evidence that the statistically significant correlations measured in our networks are not spurious. △ Less

Submitted 3 October, 2022; originally announced October 2022.

Comments: Submitted to Phys. Rev. PER

Investigating student interpretations of the differences between classical and quantum computers: Are quantum computers just analog classical computers?

Authors: Josephine C. Meyer, Gina Passante, Steven J. Pollock, Bethany R. Wilcox

Abstract: Significant attention in the PER community has been paid to student cognition and reasoning processes in undergraduate quantum mechanics. Until recently, however, these same topics have remained largely unexplored in the context of emerging interdisciplinary quantum information science (QIS) courses. We conducted exploratory interviews with 22 students in an upper-division quantum computing course… ▽ More Significant attention in the PER community has been paid to student cognition and reasoning processes in undergraduate quantum mechanics. Until recently, however, these same topics have remained largely unexplored in the context of emerging interdisciplinary quantum information science (QIS) courses. We conducted exploratory interviews with 22 students in an upper-division quantum computing course at a large R1 university crosslisted in physics and computer science, as well as 6 graduate students in a similar graduate-level QIS course offered in physics. We classify and analyze students' responses to a pair of questions regarding the fundamental differences between classical and quantum computers. We specifically note two key themes of importance to educators: (1) when reasoning about computational power, students often struggled to distinguish between the relative effects of exponential and linear scaling, resulting in students frequently focusing on distinctions that are arguably better understood as analog-digital than classical-quantum, and (2) introducing the thought experiment of analog classical computers was a powerful tool for hel** students develop a more expertlike perspective on the differences between classical and quantum computers. △ Less

Submitted 29 August, 2022; originally announced August 2022.

Comments: Submitted to Proceedings of the 2022 Physics Education Research Conference, Grand Rapids, MI, US 7/13-7/14/22

Effectiveness of an online homework tutorial about changing basis in quantum mechanics

Authors: Giaco Corsiglia, Steven Pollock, Bethany Wilcox

Abstract: Changing basis is a common task when solving quantum mechanical problems. As part of a research project investigating student understanding of basis and change of basis in quantum mechanics, we developed a tutorial to support students in learning about basis in the context of spin-1/2 systems. We have since created an interactive online version of the basis tutorial as part of a freely available s… ▽ More Changing basis is a common task when solving quantum mechanical problems. As part of a research project investigating student understanding of basis and change of basis in quantum mechanics, we developed a tutorial to support students in learning about basis in the context of spin-1/2 systems. We have since created an interactive online version of the basis tutorial as part of a freely available suite of online quantum tutorials called ACE Physics (acephysics.net). The ACE Physics tutorials include dynamic guidance elements and, unlike other tutorials, are intended for use outside the classroom without instructor facilitation. After extensive study in an instructor-supported environment, we assigned the ACE Physics basis tutorial as homework in two semesters of upper-division quantum mechanics, and we report on the effectiveness of the activity based on pre-/post-testing and comparison of student exam performance with a similar semester that did not include the activity. We find that the tutorial produces sufficient learning gains to justify continued assignment as a homework problem in our classes. △ Less

Submitted 28 July, 2022; v1 submitted 9 June, 2022; originally announced June 2022.

The interdisciplinary quantum information classroom: Themes from a survey of quantum information science instructors

Authors: Josephine C. Meyer, Gina Passante, Steven J. Pollock, Bethany R. Wilcox

Abstract: Interdisciplinary introduction to quantum information science (QIS) courses are proliferating at universities across the US, but the experiences of instructors in these courses have remained largely unexplored in the discipline-based education research (DBER) communities. Here, we address this gap by reporting on the findings of a survey of instructors teaching introduction to QIS courses at insti… ▽ More Interdisciplinary introduction to quantum information science (QIS) courses are proliferating at universities across the US, but the experiences of instructors in these courses have remained largely unexplored in the discipline-based education research (DBER) communities. Here, we address this gap by reporting on the findings of a survey of instructors teaching introduction to QIS courses at institutions across the US, primarily at the undergraduate or hybrid undergraduate/graduate level, as well as follow-up focus interviews with six individual instructors. Key themes from this analysis include challenges and opportunities associated with the diversity of instructor and student backgrounds, student difficulties with the mathematical formalism (especially though not exclusively with linear algebra), and the need for better textbooks and curricular materials. We also find that while course topics are ostensibly similar, each course is crafted by its instructor to tell a different story about QIS and to uniquely balance goals such as accessibility and academic rigor, such that no canonical introduction to QIS course emerges from our dataset. We discuss the implications of this finding with regard to the benefits and risks associated with standardization of curricula as QIS coursework matures. △ Less

Submitted 5 May, 2022; v1 submitted 11 February, 2022; originally announced February 2022.

Comments: 15 pages, 5 figures. Submitted to Physical Review Physics Education Research

Journal ref: Phys Rev Phys Educ Res 18, 010150 (published 30 June 2022)

Ethics education in the quantum information science classroom: Exploring attitudes, barriers, and opportunities

Authors: Josephine Meyer, Noah Finkelstein, Bethany Wilcox

Abstract: Quantum information science (QIS) is an emerging interdisciplinary field at the intersection of physics, computer science, electrical engineering, and mathematics leveraging the laws of quantum mechanics to circumvent classical limitations on information processing. With QIS coursework proliferating across US institutions, including at the undergraduate level, we argue that it is imperative that e… ▽ More Quantum information science (QIS) is an emerging interdisciplinary field at the intersection of physics, computer science, electrical engineering, and mathematics leveraging the laws of quantum mechanics to circumvent classical limitations on information processing. With QIS coursework proliferating across US institutions, including at the undergraduate level, we argue that it is imperative that ethics and social responsibility be incorporated into QIS education from the beginning. We discuss ethical issues of particular relevance to QIS education that educators may wish to incorporate into their curricula. We then report on findings from focus interviews with six faculty who have taught introductory QIS courses, focusing on barriers to and opportunities for incorporation of ethics and social responsibility (ESR) into the QIS classroom. Few faculty had explicitly considered discussion of ethical issues in the classroom prior to the interview, yet instructor attitudes shifted markedly in support of incorporating ESR in the classroom as a result of the interview process itself. Taking into account faculty's perception of obstacles to discussing issues of ESR in coursework, we propose next steps toward making ESR education in the QIS classroom a reality. △ Less

Submitted 3 February, 2022; originally announced February 2022.

Comments: Submitted to the 2022 ASEE Annual Conference and Exposition, Minneapolis, MN, USA. Copyright (C) 2022, American Society for Engineering Education

Report number: 40456

Journal ref: Proceedings of the 2022 ASEE Annual Conference and Exposition, Minneapolis, MN

Investigating Unprompted and Prompted Diagrams Generated by Physics MajorsDuring Problem Solving

Authors: Michael Vignal, Bethany R. Wilcox

Abstract: Diagrams are ubiquitous in physics, especially in physics education and physics problem solving. Problem solvers may generate diagrams to orient to a scenario, to organize information, to directly extract an answer, or as a tool of communication. In this study, we interviewed 19 undergraduate and graduate physics majors, asking them to solve 18 multiple-choice physics problems -- with no prompting… ▽ More Diagrams are ubiquitous in physics, especially in physics education and physics problem solving. Problem solvers may generate diagrams to orient to a scenario, to organize information, to directly extract an answer, or as a tool of communication. In this study, we interviewed 19 undergraduate and graduate physics majors, asking them to solve 18 multiple-choice physics problems -- with no prompting regarding diagrams -- and then six diagramming tasks of situations similar to six of the multiple-choice problems. By comparing spontaneously generated and prompted diagrams, we identify different diagramming elements and features used by physics majors acting towards different ends (\textit{i.e.,} in different epistemic frames). We found that different physical contexts impact how critical it is to draw an accurate diagram, and that the differences in diagramming between cohorts (\textit{e.g.}, between lower-division undergraduate and graduate students) seem to be smaller than the differences within a cohort. We also explore implications for teaching and research. △ Less

Submitted 14 June, 2021; originally announced June 2021.

Comments: 16 pages, 11 figures

Investigating graduate student reasoning on a conceptual entropy questionnaire

Authors: Nathan Crossette, Michael Vignal, Bethany R. Wilcox

Abstract: Student learning in upper division thermal physics has not been studied to the same extent as in other courses like electromagnetism and quantum mechanics. Studies addressing reasoning and learning at the graduate level are even more limited. In this study, we conducted think-aloud interviews with eight graduate students involving questions centered around a set of entropy related conceptual tasks… ▽ More Student learning in upper division thermal physics has not been studied to the same extent as in other courses like electromagnetism and quantum mechanics. Studies addressing reasoning and learning at the graduate level are even more limited. In this study, we conducted think-aloud interviews with eight graduate students involving questions centered around a set of entropy related conceptual tasks, two of which are similar to tasks presented to undergraduates in other studies. We discuss patterns in student reasoning on each question then discuss themes that appeared across questions. We identify conceptual resources that students frequently used to reason about the interview tasks and compare them to prior work. We observed graduate students commonly thinking about entropy in relationship to a number of states, even in situations where such a connection was not directly relevant. Graduate students also frequently made direct associations between entropy and temperature, despite there being no general, explicit relationship between the two quantities. On the whole, graduate students demonstrated adaptability and metacognitive awareness in their approach to reasoning about entropy. △ Less

Submitted 27 May, 2021; originally announced May 2021.

Comments: 17 pages, 6 figures, 6 tables, 1 appendix

Journal ref: Phys. Rev. Phys. Educ. Res. 17, 020119 (2021)

Online Administration of Research-Based Assessments

Authors: Ben Van Dusen, Mollee Shultz, Jayson M. Nissen, Bethany R. Wilcox, N. G. Holmes, Manher Jariwala, Eleanor W. Close, Steven Pollock

Abstract: The number and use of research-based assessments (RBAs) has grown significantly over the last several decades. Data from RBAs can be compared against national datasets to provide instructors with empirical evidence on the efficacy of their teaching practices. Many physics instructors, however, opt not to use RBAs due to barriers such as having to use class time to administer them. In this article… ▽ More The number and use of research-based assessments (RBAs) has grown significantly over the last several decades. Data from RBAs can be compared against national datasets to provide instructors with empirical evidence on the efficacy of their teaching practices. Many physics instructors, however, opt not to use RBAs due to barriers such as having to use class time to administer them. In this article we examine how these barriers can be mitigated through online administrations of RBAs, particularly through the use of free online RBA platforms that automate administering, scoring, and analyzing RBAs (e.g., the Learning About STEM Student Outcomes [LASSO], Colorado Learning Attitudes About Science Survey for Experimental Physics [E-CLASS], Physics Lab Inventory of Critical thinking [PLIC], and PhysPort DataExplorer platforms). We also explore the research into common concerns of administering RBAs online and conclude with a practical how-to guide for instructors. △ Less

Submitted 7 August, 2020; originally announced August 2020.

Comments: 4 pages, 0 figures

Retention of conceptual learning after an interactive introductory physics course

Authors: Bethany R. Wilcox, Steven J. Pollock, Daniel R. Bolton

Abstract: The cyclic format of the undergraduate physics curriculum depends on students' ability to recall and utilize material covered in prior courses in order to reliably build on that knowledge in later courses. However, there is evidence to suggest that people often do not retain all, or even most, of what they learned previously. How much information is retained appears to be dependent both on the ind… ▽ More The cyclic format of the undergraduate physics curriculum depends on students' ability to recall and utilize material covered in prior courses in order to reliably build on that knowledge in later courses. However, there is evidence to suggest that people often do not retain all, or even most, of what they learned previously. How much information is retained appears to be dependent both on the individuals' approach to learning as well as the style of instruction. In particular, there is evidence to suggest that active engagement techniques in the classroom can improve students' retention of the material over time. Here, we report the findings of a longitudinal investigation of students' retention of conceptual understanding as measured by the Force and Motion Conceptual Evaluation (FMCE) following a first-semester, calculus-based introductory physics course, which features significant active engagement in both lecture and recitation. By administering the FMCE at the end of a first-semester physics course and again at the beginning of the subsequent second-semester physics course, we examine students' knowledge retention over time periods ranging from 1-15 months. We find that the shift in students' FMCE scores between these two courses is positive but corresponds to a small effect size, indicating that students retained effectively all of their conceptual learning (as measured by the FMCE). This finding largely persists even as the length of the gap between the two courses increases. We also find that, when breaking out students' performance on individual questions, the majority of students maintain their score on individual questions. Averaged over all questions, roughly a fifth of the students switched their answers from right to wrong or wrong to right on any given item. △ Less

Submitted 18 February, 2020; originally announced February 2020.

Comments: 7 pages, 3 figures, submitted to Phys. Rev. PER

Journal ref: Phys. Rev. Phys. Educ. Res. 16, 010140 (2020)

Student behavior and test security in online conceptual assessment

Authors: Bethany Wilcox, Steven Pollock

Abstract: Historically, the implementation of research-based assessments (RBAs) has been a driver of education change within physics and helped motivate adoption of interactive engagement pedagogies. Until recently, RBAs were given to students exclusively on paper and in-class; however, this approach has important drawbacks including decentralized data collection and the need to sacrifice class time. Recent… ▽ More Historically, the implementation of research-based assessments (RBAs) has been a driver of education change within physics and helped motivate adoption of interactive engagement pedagogies. Until recently, RBAs were given to students exclusively on paper and in-class; however, this approach has important drawbacks including decentralized data collection and the need to sacrifice class time. Recently, some RBAs have been moved to online platforms to address these limitations. Yet, online RBAs present new concerns such as student participation rates, test security, and students' use of outside resources. Here, we report on a pilot study addressing these concerns. We gave two upper-division RBAs to courses at five institutions; the RBAs were hosted online and featured embedded JavaScript code which collected information on students' behaviors (e.g., copying text, printing). With these data, we examine the prevalence of these behaviors, and their correlation with students' scores, to determine if online and paper-based RBAs are comparable. We find that browser loss of focus is the most common online behavior while copying and printing events were rarer.We found no statistically significant correlation between any of these online behaviors and students scores. We also found that participation rates for our upper-division population went up when the RBA was given online. These results indicates that, for our upper-division population, scores on online administrations of these RBAs were comparable to in-class versions. △ Less

Submitted 11 December, 2019; originally announced December 2019.

Comments: 6 pages, 0 figures, submitted to the 2019 Physics Education Research Conference

Faculty survey on upper-division thermal physics content coverage

Authors: Katherine D. Rainey, Bethany R. Wilcox

Abstract: Thermal physics is a core course requirement for most physics degrees and encompasses both thermodynamics and statistical mechanics content. However, the primary content foci of thermal physics courses vary across universities. This variation can make creation of materials or assessment tools for thermal physics difficult. To determine the scope and content variability of thermal physics courses a… ▽ More Thermal physics is a core course requirement for most physics degrees and encompasses both thermodynamics and statistical mechanics content. However, the primary content foci of thermal physics courses vary across universities. This variation can make creation of materials or assessment tools for thermal physics difficult. To determine the scope and content variability of thermal physics courses across institutions, we distributed a survey to over 140 institutions to determine content priorities from faculty and instructors who have taught upper-division thermodynamics and/or statistical mechanics. We present results from the survey, which highlight key similarities and differences in thermal physics content coverage across institutions. Though we see variations in content coverage, we found 9 key topical areas covered by all respondents in their upper-division thermal physics courses. We discuss implications of these findings for the development of instructional tools and assessments that are useful to the widest range of institutions and physics instructors. △ Less

Submitted 24 November, 2019; originally announced November 2019.

Comments: Physics Education Research Conference

Deep Active Lesion Segmentation

Authors: Ali Hatamizadeh, Assaf Hoogi, Debleena Sengupta, Wuyue Lu, Brian Wilcox, Daniel Rubin, Demetri Terzopoulos

Abstract: Lesion segmentation is an important problem in computer-assisted diagnosis that remains challenging due to the prevalence of low contrast, irregular boundaries that are unamenable to shape priors. We introduce Deep Active Lesion Segmentation (DALS), a fully automated segmentation framework for that leverages the powerful nonlinear feature extraction abilities of fully Convolutional Neural Networks… ▽ More Lesion segmentation is an important problem in computer-assisted diagnosis that remains challenging due to the prevalence of low contrast, irregular boundaries that are unamenable to shape priors. We introduce Deep Active Lesion Segmentation (DALS), a fully automated segmentation framework for that leverages the powerful nonlinear feature extraction abilities of fully Convolutional Neural Networks (CNNs) and the precise boundary delineation abilities of Active Contour Models (ACMs). Our DALS framework benefits from an improved level-set ACM formulation with a per-pixel-parameterized energy functional and a novel multiscale encoder-decoder CNN that learns an initialization probability map along with parameter maps for the ACM. We evaluate our lesion segmentation model on a new Multiorgan Lesion Segmentation (MLS) dataset that contains images of various organs, including brain, liver, and lung, across different imaging modalities---MR and CT. Our results demonstrate favorable performance compared to competing methods, especially for small training datasets. Source code : $\text{https://github.com/ahatamiz/dals}$ △ Less

Submitted 30 August, 2020; v1 submitted 19 August, 2019; originally announced August 2019.

Comments: Accepted to Machine Learning in Medical Imaging (MLMI 2019). Link to source code added

Journal ref: MLMI 2019

Investigating students' behavior and performance in online conceptual assessment

Authors: Bethany R. Wilcox, Steven J. Pollock

Abstract: Historically, the implementation of research-based assessments (RBAs) has been a driver of educational change within physics and helped motivate adoption of interactive engagement pedagogies. Until recently, RBAs were given to students exclusively on paper and in-class; however, this approach has important drawbacks including decentralized data collection and the need to sacrifice class time. Rece… ▽ More Historically, the implementation of research-based assessments (RBAs) has been a driver of educational change within physics and helped motivate adoption of interactive engagement pedagogies. Until recently, RBAs were given to students exclusively on paper and in-class; however, this approach has important drawbacks including decentralized data collection and the need to sacrifice class time. Recently, some RBAs have been moved to online platforms to address these limitations. Yet, online RBAs present new concerns such as student participation rates, test security, and students' use of outside resources. Here, we report on a study addressing these concerns in both upper-division and lower-division undergraduate physics courses. We gave RBAs to courses at five institutions; the RBAs were hosted online and featured embedded JavaScript code which collected information on students' behaviors (e.g., copying text, printing). With these data, we examine the prevalence of these behaviors, and their correlation with students' scores, to determine if online and paper-based RBAs are comparable. We find that browser loss of focus is the most common online behavior while copying and printing events were rarer. We found that correlations between these behaviors and student performance varied significantly between introductory and upper-division student populations, particularly with respect to the impact of students copying text in order to utilize internet resources. However, while the majority of students engaged in one or more of the targeted online behaviors, we found that, for our sample, none of these behaviors resulted in a significant change in the population's average performance that would threaten our ability to interpret this performance or compare it to paper-based implementations of the RBA. △ Less

Submitted 16 August, 2019; originally announced August 2019.

Comments: 9 pages, 0 figures, submitted to Phys. Rev. PER

Journal ref: Phys. Rev. Phys. Educ. Res. 15, 020145 (2019)

A cross-context look at upper-division student difficulties with integration

Authors: Bethany R. Wilcox, Giaco Corsiglia

Abstract: We investigate upper-division student difficulties with direct integration in multiple contexts involving the calculation of a potential from a continuous distribution (e.g., mass, charge, or current). Integration is a tool that has been historically studied at several different points in the curriculum including introductory and upper-division levels. We build off of these prior studies and contr… ▽ More We investigate upper-division student difficulties with direct integration in multiple contexts involving the calculation of a potential from a continuous distribution (e.g., mass, charge, or current). Integration is a tool that has been historically studied at several different points in the curriculum including introductory and upper-division levels. We build off of these prior studies and contribute additional data around student difficulties with multi-variable integration at two new points in the curriculum: middle-division classical mechanics, and upper-division magnetostatics. To facilitate comparisons across prior studies as well as the current work, we utilize an analytical framework that focuses on how students activate, construct, execute, and reflect on mathematical tools during physics problem solving (i.e., the ACER framework). Using a mixed-methods approach involving coded exam solutions and student problem-solving interviews, we identify and compare students' difficulties in these two different context and relate them to what has been found previously in other levels and contexts. We find that some of the observed student difficulties were persistent accross all three contexts (e.g., identifying integration as the appropriate tool, and expressing the difference vector), while other difficulties seemed to fade as students advanced through the curriculum (e.g., expressing differential line, area, and volume elements). We also identified new difficulties that appear in different contexts (e.g., interpreting and expressing the current density). △ Less

Submitted 1 August, 2019; originally announced August 2019.

Comments: 13 pages, 2 figures, submitted to Phys. Rev. PER

Self-Attention Capsule Networks for Object Classification

Authors: Assaf Hoogi, Brian Wilcox, Yachee Gupta, Daniel L. Rubin

Abstract: We propose a novel architecture for object classification, called Self-Attention Capsule Networks (SACN). SACN is the first model that incorporates the Self-Attention mechanism as an integral layer within the Capsule Network (CapsNet). While the Self-Attention mechanism supplies a long-range dependencies, results in selecting the more dominant image regions to focus on, the CapsNet analyzes the re… ▽ More We propose a novel architecture for object classification, called Self-Attention Capsule Networks (SACN). SACN is the first model that incorporates the Self-Attention mechanism as an integral layer within the Capsule Network (CapsNet). While the Self-Attention mechanism supplies a long-range dependencies, results in selecting the more dominant image regions to focus on, the CapsNet analyzes the relevant features and their spatial correlations inside these regions only. The features are extracted in the convolutional layer. Then, the Self-Attention layer learns to suppress irrelevant regions based on features analysis and highlights salient features useful for a specific task. The attention map is then fed into the CapsNet primary layer that is followed by a classification layer. The proposed SACN model was designed to solve two main limitations of the baseline CapsNet - analysis of complex data and significant computational load. In this work, we use a shallow CapsNet architecture and compensates for the absence of a deeper network by using the Self-Attention module to significantly improve the results. The proposed Self-Attention CapsNet architecture was extensively evaluated on six different datasets, mainly on three different medical sets, in addition to the natural MNIST, SVHN and CIFAR10. The model was able to classify images and their patches with diverse and complex backgrounds better than the baseline CapsNet. As a result, the proposed Self-Attention CapsNet significantly improved classification performance within and across different datasets and outperformed the baseline CapsNet, ResNet-18 and DenseNet-40 not only in classification accuracy but also in robustness. △ Less

Submitted 19 November, 2019; v1 submitted 29 April, 2019; originally announced April 2019.

Correlation Between Student Collaboration Network Centrality and Academic Performance

Authors: David L. Vargas, Ariel M. Bridgeman, David R. Schmidt, Patrick B. Kohl, Bethany R. Wilcox, Lincoln D. Carr

Abstract: We compute nodal centrality measures on the collaboration networks of students enrolled in three upper-division physics courses, usually taken sequentially, at the Colorado School of Mines. These are complex networks in which links between students indicate assistance with homework. The courses included in the study are intermediate Classical Mechanics, introductory Quantum Mechanics, and intermed… ▽ More We compute nodal centrality measures on the collaboration networks of students enrolled in three upper-division physics courses, usually taken sequentially, at the Colorado School of Mines. These are complex networks in which links between students indicate assistance with homework. The courses included in the study are intermediate Classical Mechanics, introductory Quantum Mechanics, and intermediate Electromagnetism. By correlating these nodal centrality measures with students' scores on homework and exams, we find four centrality measures that correlate significantly with students' homework scores in all three courses: in-strength, out-strength, closeness centrality, and harmonic centrality. These correlations suggest that students who not only collaborate often, but also collaborate significantly with many different people tend to achieve higher grades. Centrality measures between simultaneous collaboration networks (analytical vs. numerical homework collaboration) composed of the same students also correlate with each other, suggesting that students' collaboration strategies remain relatively stable when presented with homework assignments targeting different skills. Additionally, we correlate centrality measures between collaboration networks from different courses and find that the four centrality measures with the strongest relationship to students' homework scores are also the most stable measures across networks involving different courses. Correlations of centrality measures with exam scores were generally smaller than the correlations with homework scores, though this finding varied across courses. △ Less

Submitted 1 August, 2018; originally announced August 2018.

Comments: 10 pages, 4 figures, submitted to Phys. Rev. PER

Students' views about the nature of experimental physics

Authors: Bethany R. Wilcox, H. J. Lewandowski

Abstract: The physics community explores and explains the physical world through a blend of theoretical and experimental studies. The future of physics as a discipline depends on training of students in both the theoretical and experimental aspects of the field. However, while student learning within lecture courses has been the subject of extensive research, lab courses remain relatively under-studied. In… ▽ More The physics community explores and explains the physical world through a blend of theoretical and experimental studies. The future of physics as a discipline depends on training of students in both the theoretical and experimental aspects of the field. However, while student learning within lecture courses has been the subject of extensive research, lab courses remain relatively under-studied. In particular, there is little, if any, data available that addresses the effectiveness of physics lab courses at encouraging students to recognize the nature and importance of experimental physics within the discipline as a whole. To address this gap, we present the first large-scale, national study ($N_{institutions}=75$ and $N_{students}=7167$) of undergraduate physics lab courses through analysis of students' responses to a research-validated assessment designed to investigate students' beliefs about the nature of experimental physics. We find that students often enter and leave physics lab courses with ideas about experimental physics as practiced in their courses that are inconsistent with the views of practicing experimental physicists, and this trend holds at both the introductory and upper-division levels. Despite this inconsistency, we find that both introductory and upper-division students are able to accurately predict the expert-like response even in cases where their views about experimentation in their lab courses disagree. These finding have implications for the recruitment, retention, and adequate preparation of students in physics. △ Less

Submitted 14 August, 2017; originally announced August 2017.

Comments: 10 pages, 2 figures, Accepted to Phys. Rev. PER

Improvement or selection? A longitudinal analysis of students' views about experimental physics in their lab courses

Authors: Bethany R. Wilcox, H. J. Lewandowski

Abstract: Laboratory courses represent a unique and potentially important component of the undergraduate physics curriculum, which can be designed to allow students to authentically engage with the process of experimental physics. Among other possible benefits, participation in these courses throughout the undergraduate physics curriculum presents an opportunity to develop students' understanding of the nat… ▽ More Laboratory courses represent a unique and potentially important component of the undergraduate physics curriculum, which can be designed to allow students to authentically engage with the process of experimental physics. Among other possible benefits, participation in these courses throughout the undergraduate physics curriculum presents an opportunity to develop students' understanding of the nature and importance of experimental physics within the discipline as a whole. Here, we present and compare both a longitudinal and pseudo-longitudinal analysis of students' responses to a research-based assessment targeting students' views about experimental physics -- the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS) -- across multiple, required lab courses at a single institution. We find that, while pseudo-longitudinal averages showed increases in students' E-CLASS scores in each consecutive course, analysis of longitudinal data indicates that this increase was not driven by a cumulative impact of laboratory instruction. Rather, the increase was driven by a selection effect in which students who persisted into higher-level lab courses already had more expert-like beliefs, attitudes, and expectations than their peers when they started the lower-level courses. △ Less

Submitted 12 June, 2017; originally announced June 2017.

Comments: 6 pages, 1 figure, submitted as a short paper to Phys. Rev. PER

Student Difficulties with Boundary Conditions in Electrodynamics

Authors: Qing X. Ryan, Bethany R. Wilcox, Steven J. Pollock

Abstract: Identifying and understanding student difficulties with physics content in a wide variety of topical areas is an active research area within the PER community. In many cases, physics topics appear multiple times in different contexts across the undergraduate physics curriculum. As these common topics reappear, student difficulties can perpetuate from one context to the next, or new difficulties ca… ▽ More Identifying and understanding student difficulties with physics content in a wide variety of topical areas is an active research area within the PER community. In many cases, physics topics appear multiple times in different contexts across the undergraduate physics curriculum. As these common topics reappear, student difficulties can perpetuate from one context to the next, or new difficulties can emerge as students encounter new physical contexts. One example of such a topic is boundary conditions. It is broadly considered to be an important topic that advanced physics undergraduates are expected to understand and apply in multiple topical areas including classical mechanics, quantum mechanics, and throughout electricity and magnetism (EM). We report findings from an investigation of student difficulties using boundary conditions focusing on the context of electrodynamics. Our data sources include student responses to traditional exam questions, conceptual survey questions, and think aloud interviews. The analysis was guided by an analytical framework that characterizes how students activate, construct, execute, and reflect on boundary conditions. Common observed student difficulties include: activating boundary conditions in appropriate contexts; constructing a complex expression for the E&M waves; mathematically simplifying and manipulating complex exponential and, checking if the reflection and transmission coefficient are physical. We also present potential pedagogical implications based on our observations. △ Less

Submitted 17 March, 2017; originally announced March 2017.

Comments: arXiv admin note: text overlap with arXiv:1507.05604

Develo** skills vs reinforcing concepts in physics labs: Insight from E-CLASS

Authors: Bethany R. Wilcox, H. J. Lewandowski

Abstract: Physics laboratory courses have been generally acknowledged as an important component of the undergraduate curriculum, particularly with respect to develo** students' interest in, and understanding of, experimental physics. There are a number of possible learning goals for these courses including reinforcing physics concepts, develo** laboratory skills, and promoting expert-like beliefs about… ▽ More Physics laboratory courses have been generally acknowledged as an important component of the undergraduate curriculum, particularly with respect to develo** students' interest in, and understanding of, experimental physics. There are a number of possible learning goals for these courses including reinforcing physics concepts, develo** laboratory skills, and promoting expert-like beliefs about the nature of experimental physics. However, there is little consensus among instructors and researchers interested in the laboratory learning environment as to relative importance of these various learning goals. Here, we contribute data to this debate through the analysis of students' responses to the laboratory-focused assessment known as the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Using a large, national data set of students' responses, we compare students' E-CLASS performance in classes in which the instructor self-reported focusing on develo** skills, reinforcing concepts, or both. As the classification of courses was based on instructor self-report, we also provide additional description of these course with respect to how often students engage in particular activities in the lab. We find that courses that focus specifically on develo** lab skills have more expert-like postinstruction E-CLASS responses than courses that focus either on reinforcing physics concepts or on both goals. Within first-year courses, this effect is larger for women. Moreover, these findings hold when controlling for the variance in postinstruction scores that is associated with preinstruction E-CLASS score, student major, and student gender. △ Less

Submitted 7 November, 2016; originally announced November 2016.

Comments: 8 pages, 2 figures, submitted to Phys. Rev. - PER. arXiv admin note: text overlap with arXiv:1608.01621

Impact of instructional approach on students' epistemologies about experimental physics

Authors: Bethany R. Wilcox, H. J. Lewandowski

Abstract: Student learning in undergraduate physics laboratory courses has garnered increased attention within the PER community. Considerable work has been done to develop curricular materials and pedagogical techniques designed to enhance student learning within laboratory learning environments. Examples of these transformation efforts include the Investigative Science Learning Environment (ISLE), Modelin… ▽ More Student learning in undergraduate physics laboratory courses has garnered increased attention within the PER community. Considerable work has been done to develop curricular materials and pedagogical techniques designed to enhance student learning within laboratory learning environments. Examples of these transformation efforts include the Investigative Science Learning Environment (ISLE), Modeling Instruction, and integrated lab/lecture environments (e.g., studio physics). In addition to improving students' understanding of the physics content, lab courses often have an implicit or explicit goal of increasing students' understanding and appreciation of the nature of experimental physics. We examine students' responses to a laboratory-focused epistemological assessment -- the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS) -- to explore whether courses using transformed curricula or pedagogy show more expert-like student epistemologies relative to courses using traditional guided labs, as well as how this trend varies based on student major or gender. Data for this study are drawn from an existing data set of responses to the E-CLASS from multiple courses and institutions. △ Less

Submitted 19 September, 2016; originally announced September 2016.

Comments: 4 pages, 1 figure, submitted to 2016 Proceedings of the PERC

Open-ended versus guided laboratory activities: Impact on students' beliefs about experimental physics

Authors: Bethany R. Wilcox, H. J. Lewandowski

Abstract: Improving students' understanding of the nature of experimental physics is often an explicit or implicit goal of undergraduate laboratory physics courses. However, lab activities in traditional lab courses are typically characterized by highly structured, guided labs that often do not require or encourage students to engage authentically in the process of experimental physics. Alternatively, open-… ▽ More Improving students' understanding of the nature of experimental physics is often an explicit or implicit goal of undergraduate laboratory physics courses. However, lab activities in traditional lab courses are typically characterized by highly structured, guided labs that often do not require or encourage students to engage authentically in the process of experimental physics. Alternatively, open-ended laboratory activities can provide a more authentic learning environment by, for example, allowing students to exercise greater autonomy in what and how physical phenomena are investigated. Engaging in authentic practices may be a critical part of improving students' beliefs around the nature of experimental physics. Here, we investigate the impact of open-ended activities in undergraduate lab courses on students' epistemologies and expectations about the nature of experimental physics, as well as their confidence and affect, as measured by the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Using a national data set of student responses to the E-CLASS, we find that the inclusion of some open-ended lab activities in a lab course correlates with more expert-like postinstruction responses relative to courses that include only traditional guided lab activities. This finding holds when examining postinstruction E-CLASS scores while controlling for the variance associated with preinstruction scores, course level, student major, and student gender. △ Less

Submitted 4 August, 2016; originally announced August 2016.

Comments: 8 pages, 2 figures, submitted to Phys. Rev. - PER. arXiv admin note: text overlap with arXiv:1606.02629

SETI Observations of Exoplanets with the Allen Telescope Array

Authors: G. R. Harp, Jon Richards, Jill C. Tarter, John Dreher, Jane Jordan, Seth Shostak, Ken Smolek, Tom Kilsdonk, Bethany R. Wilcox, M. K. R. Wimberly, John Ross, W. C. Barott, R. F. Ackermann, Samantha Blair

Abstract: We report radio SETI observations on a large number of known exoplanets and other nearby star systems using the Allen Telescope Array (ATA). Observations were made over about 19000 hours from May 2009 to Dec 2015. This search focused on narrow-band radio signals from a set totaling 9293 stars, including 2015 exoplanet stars and Kepler objects of interest and an additional 65 whose planets may be c… ▽ More We report radio SETI observations on a large number of known exoplanets and other nearby star systems using the Allen Telescope Array (ATA). Observations were made over about 19000 hours from May 2009 to Dec 2015. This search focused on narrow-band radio signals from a set totaling 9293 stars, including 2015 exoplanet stars and Kepler objects of interest and an additional 65 whose planets may be close to their Habitable Zone. The ATA observations were made using multiple synthesized beams and an anticoincidence filter to help identify terrestrial radio interference. Stars were observed over frequencies from 1- 9 GHz in multiple bands that avoid strong terrestrial communication frequencies. Data were processed in near-real time for narrow-band (0.7- 100 Hz) continuous and pulsed signals, with transmitter/receiver relative accelerations from -0.3 to 0.3 m/s^2. A total of 1.9 x 10^8 unique signals requiring immediate follow-up were detected in observations covering more than 8 x 10^6 star-MHz. We detected no persistent signals from extraterrestrial technology exceeding our frequency-dependent sensitivity threshold of 180 - 310 x 10^-26 W / m^2. △ Less

Submitted 28 July, 2016; v1 submitted 14 July, 2016; originally announced July 2016.

Comments: 225 pages including very long table, 9 figures, 7 tables, resubmitted to Astrophysical Journal

Journal ref: The Astronomical Journal, 152(6), (2016) 181

Research-based assessment of students' beliefs about experimental physics: When is gender a factor?

Authors: Bethany R. Wilcox, H. J. Lewandowski

Abstract: The existence of gender differences in student performance on conceptual assessments and their responses to attitudinal assessments has been repeatedly demonstrated. This difference is often present in students' preinstruction responses and persists in their postinstruction responses. However, one area in which the presence of gender differences has not been extensively explored is undergraduate l… ▽ More The existence of gender differences in student performance on conceptual assessments and their responses to attitudinal assessments has been repeatedly demonstrated. This difference is often present in students' preinstruction responses and persists in their postinstruction responses. However, one area in which the presence of gender differences has not been extensively explored is undergraduate laboratory courses. For example, one of the few laboratory focused research-based assessments, the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS), has not been tested for the existence of gender differences in students' responses. Here, we utilize a national data set of responses to the E-CLASS to determine if they demonstrate significant gender differences. We also investigate how these differences vary along multiple student and course demographic slices, including course level (first-year vs.\ beyond-first-year) and major (physics vs.\ non-physics). We observe a gender gap in pre- and postinstruction E-CLASS scores in the aggregate data both for the overall score and for most items individually. However, for some subpopulations (e.g., beyond-first-year students) the size or even existence of the gender gap depends on another dimension (e.g., student major). We also find that for all groups the gap in postinstruction scores vanishes or is greatly reduced when controlling for preinstruction scores, course level, and student major. △ Less

Submitted 6 September, 2016; v1 submitted 8 June, 2016; originally announced June 2016.

Comments: 11 pages, 3 figures, accepted to Phys. Rev. - PER

Alternative model for the administration and analysis of research-based assessments

Authors: Bethany R. Wilcox, Benjamin M. Zwickl, Robert D. Hobbs, John M. Aiken, Nathan M. Welch, H. J. Lewandowski

Abstract: Research-based assessments represent a valuable tool for both instructors and researchers interested in improving undergraduate physics education. However, the historical model for disseminating and propagating conceptual and attitudinal assessments developed by the physics education research (PER) community has not resulted in widespread adoption of these assessments within the broader community… ▽ More Research-based assessments represent a valuable tool for both instructors and researchers interested in improving undergraduate physics education. However, the historical model for disseminating and propagating conceptual and attitudinal assessments developed by the physics education research (PER) community has not resulted in widespread adoption of these assessments within the broader community of physics instructors. Within this historical model, assessment developers create high quality, validated assessments, make them available for a wide range of instructors to use, and provide minimal (if any) support to assist with administration or analysis of the results. Here, we present and discuss an alternative model for assessment dissemination, which is characterized by centralized data collection and analysis. This model provides a greater degree of support for both researchers and instructors in order to more explicitly support adoption of research-based assessments. Specifically, we describe our experiences develo** a centralized, automated system for an attitudinal assessment we previously created to examine students' epistemologies and expectations about experimental physics. This system provides a proof-of-concept that we use to discuss the advantages associated with centralized administration and data collection for research-based assessments in PER. We also discuss the challenges that we encountered while develo**, maintaining, and automating this system. Ultimately, we argue that centralized administration and data collection for standardized assessments is a viable and potentially advantageous alternative to the default model characterized by decentralized administration and analysis. Moreover, with the help of online administration and automation, this model can support the long-term sustainability of centralized assessment systems. △ Less

Submitted 9 June, 2016; v1 submitted 28 January, 2016; originally announced January 2016.

Comments: 7 pages, 1 figure, accepted in Phys. Rev. PER

Students' epistemologies about experimental physics: Validating the Colorado Learning Attitudes about Science Survey for Experimental Physics

Authors: Bethany R. Wilcox, H. J. Lewandowski

Abstract: Student learning in instructional physics labs represents a growing area of research that includes investigations of students' beliefs and expectations about the nature of experimental physics. To directly probe students' epistemologies about experimental physics and support broader lab transformation efforts at the University of Colorado Boulder (CU) and elsewhere, we developed the Colorado Learn… ▽ More Student learning in instructional physics labs represents a growing area of research that includes investigations of students' beliefs and expectations about the nature of experimental physics. To directly probe students' epistemologies about experimental physics and support broader lab transformation efforts at the University of Colorado Boulder (CU) and elsewhere, we developed the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Previous work with this assessment has included establishing the accuracy and clarity of the instrument through student interviews and preliminary testing. Several years of data collection at multiple institutions has resulted in a growing national data set of student responses. Here, we report on results of the analysis of these data to investigate the statistical validity and reliability of the E-CLASS as a measure of students' epistemologies for a broad student population. We find that the E-CLASS demonstrates an acceptable level of both validity and reliability on measures of, item and test discrimination, test-retest reliability, partial-sample reliability, internal consistency, concurrent validity, and convergent validity. We also examine students' responses using Principal Component Analysis and find that, as expected, the E-CLASS does not exhibit strong factors. △ Less

Submitted 9 June, 2016; v1 submitted 21 December, 2015; originally announced December 2015.

Comments: 10 pages, 4 figures, 7 tables, submitted to Phys. Rev. ST - PER

Journal ref: Phys Rev Phys Educ Res.12, 010123, 2016

Student difficulties with Boundary Conditions in electrodynamics

Authors: Qing X. Ryan, Steven J. Pollock, Bethany R. Wilcox

Abstract: Boundary conditions (BCs) are considered as an important topic that advanced physics under- graduates are expected to understand and apply. We report findings from an investigation of student difficulties using boundary conditions (BCs) in electrodynamics. Our data sources include student responses to traditional exam questions, conceptual survey questions, and think-aloud interviews. The analysis… ▽ More Boundary conditions (BCs) are considered as an important topic that advanced physics under- graduates are expected to understand and apply. We report findings from an investigation of student difficulties using boundary conditions (BCs) in electrodynamics. Our data sources include student responses to traditional exam questions, conceptual survey questions, and think-aloud interviews. The analysis was guided by an analytical framework that characterizes how students activate, con- struct, execute, and reflect on boundary conditions. Common student difficulties include: activating boundary conditions in appropriate contexts; constructing a complex expression for the E&M waves; mathematically simplifying complex exponentials and checking if the reflection and transmission co- efficient are physical. We also present potential pedagogical implications based on our observations. △ Less

Submitted 20 July, 2015; originally announced July 2015.

Upper-division student difficulties with Separation of Variables

Authors: Bethany R. Wilcox, Steven J. Pollock

Abstract: Separation of variables can be a powerful technique for solving many of the partial differential equations that arise in physics contexts. Upper-division physics students encounter this technique in multiple topical areas including electrostatics and quantum mechanics. To better understand the difficulties students encounter when utilizing the separation of variables technique, we examined student… ▽ More Separation of variables can be a powerful technique for solving many of the partial differential equations that arise in physics contexts. Upper-division physics students encounter this technique in multiple topical areas including electrostatics and quantum mechanics. To better understand the difficulties students encounter when utilizing the separation of variables technique, we examined students' responses to midterm exam questions and a standardized conceptual assessment, and conducted think-aloud, problem-solving interviews. Our analysis was guided by an analytical framework that focuses on how students activate, construct, execute, and reflect on the separation of variables technique when solving physics problems. Here we focus on student difficulties with separation of variables as a technique to solve Laplace's equation in both Cartesian and spherical coordinates in the context of junior-level electrostatics. Challenges include: recognizing when separation of variables is the appropriate tool; recalling/justifying the separated form of the potential and the need for the infinite sum; identifying implicit boundary conditions; and spontaneously reflecting on their solutions. Moreover, the type and frequency of errors was often different for SoV problems in Cartesian and spherical geometries. We also briefly discuss implication of these our findings for instruction. △ Less

Submitted 14 July, 2015; originally announced July 2015.

Comments: 13 pages, 3 figures, submitted to Phys. Rev. ST-PER

Validation and analysis of the coupled multiple response Colorado upper-division electrostatics (CUE) diagnostic

Authors: Bethany R. Wilcox, Steven J. Pollock

Abstract: Standardized conceptual assessment represents a widely-used tool for educational researchers interested in student learning within the standard undergraduate physics curriculum. For example, these assessments are often used to measure student learning across educational contexts and instructional strategies. However, to support the large-scale implementation often required for cross-institutional… ▽ More Standardized conceptual assessment represents a widely-used tool for educational researchers interested in student learning within the standard undergraduate physics curriculum. For example, these assessments are often used to measure student learning across educational contexts and instructional strategies. However, to support the large-scale implementation often required for cross-institutional testing, it is necessary for these instruments to have question formats that facilitate easy grading. Previously, we created a multiple-response version of an existing, validated, upper-division electrostatics diagnostic with the goal of increasing the instrument's potential for large-scale implementation. Here, we report on the validity and reliability of this new version as an independent instrument. These findings establish the validity of the multiple-response version as measured by multiple test statistics including item difficulty, item discrimination, and internal consistency. Moreover, we demonstrate that the majority of student responses to the new version are internally consistent even when they are incorrect, and provide an example of how the new format can be used to gain insight into student difficulties with specific content in electrostatics. △ Less

Submitted 14 July, 2015; originally announced July 2015.

Comments: 8 pages, 6 figures, submitted to Phys. Rev. ST-PER

Correlating students' beliefs about experimental physics with lab course success

Authors: Bethany R. Wilcox, H. J. Lewandowski

Abstract: Student learning in instructional physics labs is a growing area of research that includes studies exploring students' beliefs and expectations about experimental physics. To directly probe students' epistemologies about experimental physics and support broader lab transformation efforts both at the University of Colorado Boulder (CU) and nationally, we developed the Colorado Learning Attitudes ab… ▽ More Student learning in instructional physics labs is a growing area of research that includes studies exploring students' beliefs and expectations about experimental physics. To directly probe students' epistemologies about experimental physics and support broader lab transformation efforts both at the University of Colorado Boulder (CU) and nationally, we developed the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Previous work focused on establishing the accuracy and clarity of the instrument through student interviews and preliminary testing. Ongoing validation efforts include establishing the extent to which student epistemologies as measured by E-CLASS align with other measures of student learning outcomes (e.g., course grades). Here, we report on correlations between final course grades and E-CLASS scores from two semesters of introductory and upper-division lab courses at CU and discuss implications of our findings for the validity of the E-CLASS instrument. △ Less

Submitted 14 July, 2015; originally announced July 2015.

Comments: 4 pages, 2 figures, submitted to the 2015 Physics Education Research Conference

Upper-division student difficulties with the Dirac delta function

Authors: Bethany R. Wilcox, Steven J. Pollock

Abstract: The Dirac delta function is a standard mathematical tool that appears repeatedly in the undergraduate physics curriculum in multiple topical areas including electrostatics, and quantum mechanics. While Dirac delta functions are often introduced in order to simplify a problem mathematically, students still struggle to manipulate and interpret them. To characterize student difficulties with the delt… ▽ More The Dirac delta function is a standard mathematical tool that appears repeatedly in the undergraduate physics curriculum in multiple topical areas including electrostatics, and quantum mechanics. While Dirac delta functions are often introduced in order to simplify a problem mathematically, students still struggle to manipulate and interpret them. To characterize student difficulties with the delta function at the upper-division level, we examined students' responses to traditional exam questions and a standardized conceptual assessment, and conducted think-aloud interviews. Our analysis was guided by an analytical framework that focuses on how students activate, construct, execute, and reflect on the Dirac delta function in the context of problem solving in physics. Here, we focus on student difficulties using the delta function to express charge distributions in the context of junior-level electrostatics. Common challenges included: invoking the delta function spontaneously, translating a description of a charge distribution into a mathematical expression using delta functions, integrating 3D or non-Cartesian delta function expressions, and recognizing that the delta function can have units. We also briefly discuss implications of these difficulties for instruction. △ Less

Submitted 29 January, 2015; originally announced January 2015.

Comments: 9 pages, 1 figure, submitted to Physical Review Special Topics - Physics Education Research

Development and Uses of Upper-division Conceptual Assessment

Authors: Bethany R. Wilcox, Marcos D. Caballero, Charles Baily, Homeyra Sadaghiani, Stephanie V. Chasteen, Qing X. Ryan, Steven J. Pollock

Abstract: The use of validated conceptual assessments alongside more standard course exams has become standard practice for the introductory courses in many physics departments. These assessments provide a more standard measure of certain learning goals, allowing for comparisons of student learning across instructors, semesters, and institutions. Researchers at the University of Colorado Boulder have develo… ▽ More The use of validated conceptual assessments alongside more standard course exams has become standard practice for the introductory courses in many physics departments. These assessments provide a more standard measure of certain learning goals, allowing for comparisons of student learning across instructors, semesters, and institutions. Researchers at the University of Colorado Boulder have developed several similar assessments designed to target the more advanced physics content of upper-division classical mechanics, electrostatics, quantum mechanics, and electrodynamics. Here, we synthesize the existing research on our upper-division assessments and discuss some of the barriers and challenges associated with develo**, validating, and implementing these assessments as well as some of the strategies we have used to overcome these barriers. △ Less

Submitted 14 October, 2014; originally announced October 2014.

Comments: 12 pages, 5 figures, submitted to the Phys. Rev. ST - PER Focused collection on Upper-division PER

Unpacking Students' Use of Mathematics in Upper-division Physics

Authors: Marcos D. Caballero, Bethany R. Wilcox, Leanne Doughty, Steven J. Pollock

Abstract: In their study of physics beyond the first year of University -- termed upper-division in the US, many of students' primary learning opportunities come from working long, complex back-of-the-book style problems, and from trying to develop an understanding of the underlying physics through solving such problems. Some of the research at the upper-division focuses on how students use mathematics in t… ▽ More In their study of physics beyond the first year of University -- termed upper-division in the US, many of students' primary learning opportunities come from working long, complex back-of-the-book style problems, and from trying to develop an understanding of the underlying physics through solving such problems. Some of the research at the upper-division focuses on how students use mathematics in these problems, and what challenges students encounter along the way. There are a number of different and diverse research studies on students' use of mathematics in the upper-division. These typically utilize one of two broad approaches, with some researchers primarily seeking out and addressing challenges students face, and others working chiefly to unpack students' in-the-moment reasoning. In this paper, we present and discuss both approaches, and then review research efforts that strive to connect these two approaches in order to make sense of students' use of mathematics as well as to uncover particular challenges that students encounter. These recent efforts represent a small step towards synthesizing the two approaches, which we argue is necessary to more meaningfully impact student learning at the upper-division. We close our review and discussion with suggested refinements for future research questions for the physics education research community to consider while it works to understand how students use math in upper-division courses. △ Less

Submitted 2 July, 2015; v1 submitted 26 September, 2014; originally announced September 2014.

Comments: 28 pages, 1 figure, accepted to Eur. J. Phys

Potential For Laser-Induced Microbunching Studies with the 3-MHZ-Rate Electron Beams at ASTA

Authors: A. H. Lumpkin, J. Ruan, J. M. Byrd, R. B. Wilcox

Abstract: Investigations of the laser-induced microbunching as it is related to time-sliced electron-beam diagnostics and high-gain-harmonic generation (HGHG) free-electron lasers using bright electron beams are proposed for the ASTA facility. Initial tests at 40-50 MeV with an amplified 800-nm seed laser beam co-propagating with the electron beam through a short undulator (or modulator) tuned for the reson… ▽ More Investigations of the laser-induced microbunching as it is related to time-sliced electron-beam diagnostics and high-gain-harmonic generation (HGHG) free-electron lasers using bright electron beams are proposed for the ASTA facility. Initial tests at 40-50 MeV with an amplified 800-nm seed laser beam co-propagating with the electron beam through a short undulator (or modulator) tuned for the resonance condition followed by transport through a subsequent chicane will result in energy modulation and z-density modulation (microbunching), respectively. The latter microbunching will result in generation of coherent optical or UV transition radiation (COTR, CUVTR) at a metal converter screen which can reveal slice beam size, centroid, and energy spread. Additionally, direct assessment of the microbunching factors related to HGHG by measurement of the COTR intensity and harmonic content after the chicane as a function of seed laser power and beam parameters will be done. These experiments will be performed using the ASTA 3-MHz-rate micropulse train for up to 1ms which is unique to test facilities in the USA. △ Less

Submitted 27 August, 2014; originally announced August 2014.

Comments: 4 p

Report number: FERMILAB-CONF-12-579-AD

Student Difficulties with the Dirac Delta Function

Authors: Bethany R. Wilcox, Steven J. Pollock

Abstract: The Dirac delta function is a standard mathematical tool used in multiple topical areas in the undergraduate physics curriculum. While Dirac delta functions are usually introduced in order to simplify a problem mathematically, students often struggle to manipulate and interpret them. To better understand student difficulties with the delta function at the upper-division level, we examined response… ▽ More The Dirac delta function is a standard mathematical tool used in multiple topical areas in the undergraduate physics curriculum. While Dirac delta functions are usually introduced in order to simplify a problem mathematically, students often struggle to manipulate and interpret them. To better understand student difficulties with the delta function at the upper-division level, we examined responses to traditional exam questions and conducted think-aloud interviews. Our analysis was guided by an analytical framework that focuses on how students activate, construct, execute, and reflect on the Dirac delta function in physics. Here, we focus on student difficulties using the delta function to express charge distributions in the context of junior-level electrostatics. Challenges included: invoking the delta function spontaneously, constructing two- and three-dimensional delta functions, integrating novel delta function expressions, and recognizing that the delta function can have units. △ Less

Submitted 14 October, 2014; v1 submitted 23 July, 2014; originally announced July 2014.

Comments: 4 pages, 2 figures, to be published in the proceedings of the 2014 Physics Education Research Conference

Coupled Multiple-response vs. Free-response Conceptual assessment: An Example from upper-division Physics

Authors: Bethany R. Wilcox, Steven J. Pollock

Abstract: Free-response research-based assessments, like the Colorado Upper-division Electrostatics Diagnostic (CUE), provide rich, fine-grained information about students' reasoning. However, because of the difficulties inherent in scoring these assessments, the majority of the large-scale conceptual assessments in physics are multiple-choice. To increase the scalability and usability of the CUE, we set ou… ▽ More Free-response research-based assessments, like the Colorado Upper-division Electrostatics Diagnostic (CUE), provide rich, fine-grained information about students' reasoning. However, because of the difficulties inherent in scoring these assessments, the majority of the large-scale conceptual assessments in physics are multiple-choice. To increase the scalability and usability of the CUE, we set out to create a new version of the assessment that preserves the insights afforded by a free-response format while exploiting the logistical advantages of a multiple-choice assessment. We used our extensive database of responses to the free-response CUE to construct distractors for a new version where students can select multiple responses and receive partial credit based on the accuracy and consistency of their selections. Here, we describe the development of this modified CUE format, which we call coupled multiple-response (CMR), and present data from direct comparisons of both versions. We find that the two formats have the same average score and perform similarly on multiple measures of validity and reliability, suggesting that the new version is a potentially viable alternative to the original CUE for the purpose of large-scale research-based assessment. We also compare the details of student responses on each of the two versions. While the CMR version does not capture the full scope of potential student responses, nearly three-quarters of our students' responses to the free-response version contained one or more elements that matched options provided on the CMR version. △ Less

Submitted 14 October, 2014; v1 submitted 23 July, 2014; originally announced July 2014.

Comments: 28 pages, 6 figures, in Physical Review Special Topics - Physics Education Research

Journal ref: Phys. Rev. ST Phys. Educ. Res 10, 020124, 2014

Multiple-choice Assessment for Upper-division Electricity and Magnetism

Authors: Bethany R. Wilcox, Steven J. Pollock

Abstract: The Colorado Upper-division Electrostatics (CUE) diagnostic was designed as an open-ended assessment in order to capture elements of student reasoning in upper-division electrostatics. The diagnostic has been given for many semesters at several universities resulting in an extensive database of CUE responses. To increase the utility and scalability of the assessment, we used this database along wi… ▽ More The Colorado Upper-division Electrostatics (CUE) diagnostic was designed as an open-ended assessment in order to capture elements of student reasoning in upper-division electrostatics. The diagnostic has been given for many semesters at several universities resulting in an extensive database of CUE responses. To increase the utility and scalability of the assessment, we used this database along with research on students' difficulties to create a multiple-choice version. The new version explores the viability of a novel test format where students select multiple responses and can receive partial credit based on the accuracy and consistency of their selections. This format was selected with the goal of preserving insights afforded by the open-ended format while exploiting the logistical advantages of a multiple-choice assessment. Here, we present examples of the questions and scoring of the multiple-choice CUE as well as initial analysis of the test's validity, item difficulty, discrimination, and overall consistency with the open-ended version. △ Less

Submitted 21 August, 2013; originally announced August 2013.

Comments: 4 pages, 3 figures, accepted 2013 Physics Education Research Conference proceedings

Analytic Framework for Students' Use of Mathematics in Upper-Division Physics

Authors: Bethany R. Wilcox, Marcos D. Caballero, Daniel A. Rehn, Steven J. Pollock

Abstract: Many students in upper-division physics courses struggle with the mathematically sophisticated tools and techniques that are required for advanced physics content. We have developed an analytical framework to assist instructors and researchers in characterizing students' difficulties with specific mathematical tools when solving the long and complex problems that are characteristic of upper-divisi… ▽ More Many students in upper-division physics courses struggle with the mathematically sophisticated tools and techniques that are required for advanced physics content. We have developed an analytical framework to assist instructors and researchers in characterizing students' difficulties with specific mathematical tools when solving the long and complex problems that are characteristic of upper-division. In this paper, we present this framework, including its motivation and development. We also describe an application of the framework to investigations of student difficulties with direct integration in electricity and magnetism (i.e., Coulomb's Law) and approximation methods in classical mechanics (i.e., Taylor series). These investigations provide examples of the types of difficulties encountered by advanced physics students, as well as the utility of the framework for both researchers and instructors. △ Less

Submitted 14 October, 2014; v1 submitted 2 July, 2013; originally announced July 2013.

Comments: 17 pages, 4 figures, 3 tables, in Phys. Rev. - PER

Journal ref: Phys. Rev. ST Phys. Educ. Res. 9, 020119, 2013

Milky Way Mass Models for Orbit Calculations

Authors: Andreas Irrgang, Benjamin Wilcox, Evan Tucker, Lucas Schiefelbein

Abstract: Studying the trajectories of objects like stars, globular clusters or satellite galaxies in the Milky Way allows to trace the dark matter halo but requires reliable models of its gravitational potential. Realistic, yet simple and fully analytical models have already been presented in the past. However, improved as well as new observational constraints have become available in the meantime calling… ▽ More Studying the trajectories of objects like stars, globular clusters or satellite galaxies in the Milky Way allows to trace the dark matter halo but requires reliable models of its gravitational potential. Realistic, yet simple and fully analytical models have already been presented in the past. However, improved as well as new observational constraints have become available in the meantime calling for a recalibration of the respective model parameters. Three widely used model potentials are revisited. By a simultaneous least-squared fit to the observed rotation curve, in-plane proper motion of Sgr A*, local mass/surface density and the velocity dispersion in Baade's window, parameters of the potentials are brought up-to-date. The mass at large radii - and thus in particular that of the dark matter halo - is hereby constrained by imposing that the most extreme halo blue horizontal-branch star known has to be bound to the Milky Way. The Galactic mass models are tuned to yield a very good match to recent observations. The mass of the dark matter halo is - within the limitations of the applied models - estimated in a fully consistent way. As a first application, the trajectory of the hypervelocity star HE 0437-5439 is re-investigated to check its suggested origin in the Large Magellanic Cloud (LMC). Despite their simplicity, the presented Milky Way mass models are well able to reproduce all observational constraints. Their analytical and simple form makes them ideally suited for fast and accurate orbit calculations. The LMC cannot be ruled out as HE 0437-5439's birthplace. △ Less

Submitted 22 August, 2016; v1 submitted 19 November, 2012; originally announced November 2012.

Comments: 13 pages, 8 figures, 5 tables

Journal ref: Astronomy & Astrophysics 549 (2013) A137

Upper-division Student Understanding of Coulomb's Law: Difficulties with Continuous Charge Distributions

Authors: Bethany R. Wilcox, Marcos D. Caballero, Rachel E. Pepper, Steven J. Pollock

Abstract: Utilizing the integral expression of Coulomb's Law to determine the electric potential from a continuous charge distribution is a canonical exercise in Electricity and Magnetism (E&M). In this study, we use both think-aloud interviews and responses to traditional exam questions to investigate student difficulties with this topic at the upper-division level. Leveraging a theoretical framework for t… ▽ More Utilizing the integral expression of Coulomb's Law to determine the electric potential from a continuous charge distribution is a canonical exercise in Electricity and Magnetism (E&M). In this study, we use both think-aloud interviews and responses to traditional exam questions to investigate student difficulties with this topic at the upper-division level. Leveraging a theoretical framework for the use of mathematics in physics, we discuss how students activate, construct, execute and reflect on the integral form of Coulomb's Law when solving problems with continuous charge distributions. We present evidence that junior-level E&M students have difficulty map** physical systems onto the mathematical expression for the Coulomb potential. Common challenges include difficulty expressing the difference vector in appropriate coordinates as well as determining expressions for the differential charge element and limits of integration for a specific charge distribution. We discuss possible implications of these findings for future research directions and instructional strategies. △ Less

Submitted 17 September, 2012; v1 submitted 5 July, 2012; originally announced July 2012.

Comments: 5 pages, 1 figure, 2 tables, accepted to 2012 PERC Proceedings

ACER: A Framework on the Use of Mathematics in Upper-division Physics

Authors: Marcos D. Caballero, Bethany R. Wilcox, Rachel E. Pepper, Steven J. Pollock

Abstract: At the University of Colorado Boulder, as part of our broader efforts to transform middle- and upper-division physics courses, we research students' difficulties with particular concepts, methods, and tools in classical mechanics, electromagnetism, and quantum mechanics. Unsurprisingly, a number of difficulties are related to students' use of mathematical tools (e.g., approximation methods). Previ… ▽ More At the University of Colorado Boulder, as part of our broader efforts to transform middle- and upper-division physics courses, we research students' difficulties with particular concepts, methods, and tools in classical mechanics, electromagnetism, and quantum mechanics. Unsurprisingly, a number of difficulties are related to students' use of mathematical tools (e.g., approximation methods). Previous work has documented a number of challenges that students must overcome to use mathematical tools fluently in introductory physics (e.g., map** meaning onto mathematical symbols). We have developed a theoretical framework to facilitate connecting students' difficulties to challenges with specific mathematical and physical concepts. In this paper, we motivate the need for this framework and demonstrate its utility for both researchers and course instructors by applying it to frame results from interview data on students' use of Taylor approximations. △ Less

Submitted 13 September, 2012; v1 submitted 4 July, 2012; originally announced July 2012.

Comments: 10 pages, 1 figures, 2 tables, accepted to the 2012 PERC Proceedings