-
Exploring University Students' Engagement with Online Video Lectures in a Blended Introductory Mechanics Course
Authors:
Shih-Yin Lin,
John M. Aiken,
Daniel T. Seaton,
Scott S. Douglas,
Edwin F. Greco,
Brian D. Thoms,
Michael F. Schatz
Abstract:
The advent of MOOCs has stimulated interest in using online videos to deliver content in university courses. We examined student engagement with 78 online videos that we created and were incorporated into a one-semester blended introductory mechanics course at the Georgia Institute of Technology. We found that students were more engaged with videos that supported laboratory activities than with vi…
▽ More
The advent of MOOCs has stimulated interest in using online videos to deliver content in university courses. We examined student engagement with 78 online videos that we created and were incorporated into a one-semester blended introductory mechanics course at the Georgia Institute of Technology. We found that students were more engaged with videos that supported laboratory activities than with videos that presented lecture content. In particular, the percentage of students accessing laboratory videos was consistently greater than 80 percent throughout the semester while the percentage of students accessing lecture videos dropped to less than 40 percent by the end of the term. Moreover, students were more likely to access the entirety of a laboratory video than a lecture video. Our results suggest that students may access videos based on perceived value: students appear to consider the laboratory videos as essential for successfully completing the laboratories while students appear to consider the lecture videos as something more akin to supplementary material. We found there was little correlation between student engagement with the videos and the performance in the course. In addition, an examination of the in-video content suggests that students focus more on concrete information that is explicitly required for assignment completion (e.g., actions required to complete laboratory work, or formulas/mathematical expressions needed to solve particular problems) and less on content that is considered more conceptual in nature. The results of the study suggest ways in which instructors may revise courses to better support student learning.
△ Less
Submitted 10 March, 2016;
originally announced March 2016.
-
Peer Evaluation of Video Lab Reports in an Introductory Physics MOOC
Authors:
Shih-Yin Lin,
Scott S. Douglas,
John M. Aiken,
Chien-Lin Liu,
Edwin F. Greco,
Brian D. Thoms,
Marcos D. Caballero,
Michael F. Schatz
Abstract:
Assessing student performance becomes challenging when course enrollment becomes very large (~10^4 students). As part of a Massive Open Online Course (MOOC) in introductory physics offered by Georgia Tech in 2013, students submitted video reports on mechanics labs. Peer evaluation of these reports provided the primary method for evaluating student laboratory work. This paper describes the methods…
▽ More
Assessing student performance becomes challenging when course enrollment becomes very large (~10^4 students). As part of a Massive Open Online Course (MOOC) in introductory physics offered by Georgia Tech in 2013, students submitted video reports on mechanics labs. Peer evaluation of these reports provided the primary method for evaluating student laboratory work. This paper describes the methods developed and used to guide students in evaluating each other's video lab reports. We also discuss how students' peer evaluation behavior changed with different interventions provided in the course.
△ Less
Submitted 15 October, 2014; v1 submitted 17 July, 2014;
originally announced July 2014.
-
Peer Evaluation of Video Lab Reports in a Blended Introductory Physics Course
Authors:
Scott S. Douglas,
Shih-Yin Lin,
John M. Aiken,
Brian D. Thoms,
Edwin F. Greco,
Marcos D. Caballero,
Michael F. Schatz
Abstract:
The Georgia Tech blended introductory calculus-based mechanics course emphasizes scientific communication as one of its learning goals, and to that end, we gave our students a series of four peer-evaluation assignments intended to develop their abilities to present and evaluate scientific arguments. Within these assignments, we also assessed students' evaluation abilities by comparing their evalua…
▽ More
The Georgia Tech blended introductory calculus-based mechanics course emphasizes scientific communication as one of its learning goals, and to that end, we gave our students a series of four peer-evaluation assignments intended to develop their abilities to present and evaluate scientific arguments. Within these assignments, we also assessed students' evaluation abilities by comparing their evaluations to a set of expert evaluations. We summarize our development efforts and describe the changes we observed in student evaluation behavior.
△ Less
Submitted 14 October, 2014; v1 submitted 11 July, 2014;
originally announced July 2014.
-
Student Use of a Single Lecture Video in a Flipped Introductory Mechanics Course
Authors:
John M. Aiken,
Shih-Yin Lin,
Scott S. Douglas,
Edwin F. Greco,
Brian D. Thoms,
Marcos D. Caballero,
Michael F. Schatz
Abstract:
In the Fall of 2013, Georgia Tech offered a 'flipped' calculus-based introductory mechanics class as an alternative to the traditional large-enrollment lecture class. This class flipped instruction by introducing new material outside of the classroom through pre-recorded, lecture videos. Video lectures constituted students' initial introduction to course material. We analyze how students engaged w…
▽ More
In the Fall of 2013, Georgia Tech offered a 'flipped' calculus-based introductory mechanics class as an alternative to the traditional large-enrollment lecture class. This class flipped instruction by introducing new material outside of the classroom through pre-recorded, lecture videos. Video lectures constituted students' initial introduction to course material. We analyze how students engaged with online lecture videos via 'clickstream' data, consisting of time-stamped interactions (plays, pauses, seeks, etc.) with the online video player. Analysis of these events has shown that students may be focusing on elements of the video that facilitate a 'correct' solution.
△ Less
Submitted 22 September, 2014; v1 submitted 9 July, 2014;
originally announced July 2014.
-
The Initial State of Students Taking an Introductory Physics MOOC
Authors:
John M. Aiken,
Shih-Yin Lin,
Scott S. Douglas,
Edwin F. Greco,
Brian D. Thoms,
Michael F. Schatz,
Marcos D. Caballero
Abstract:
As part of a larger research project into massively open online courses (MOOCs), we have investigated student background, as well as student participation in a physics MOOC with a laboratory component. Students completed a demographic survey and the Force and Motion Conceptual Evaluation at the beginning of the course. While the course is still actively running, we have tracked student participati…
▽ More
As part of a larger research project into massively open online courses (MOOCs), we have investigated student background, as well as student participation in a physics MOOC with a laboratory component. Students completed a demographic survey and the Force and Motion Conceptual Evaluation at the beginning of the course. While the course is still actively running, we have tracked student participation over the first five weeks of the eleven-week course.
△ Less
Submitted 13 September, 2013; v1 submitted 9 July, 2013;
originally announced July 2013.
-
Comparing large lecture mechanics curricula using the Force Concept Inventory: A five thousand student study
Authors:
Marcos D. Caballero,
Matthew A. Kohlmyer,
Edwin F. Greco,
Eric R. Murray,
Keith R. Bujak,
M. Jackson Marr,
Richard Catrambone,
Michael F. Schatz
Abstract:
The performance of over 5000 students in introductory calculus-based mechanics courses at the Georgia Institute of Technology was assessed using the Force Concept Inventory (FCI). Results from two different curricula were compared: a traditional mechanics curriculum and the Matter & Interactions (M&I) curriculum. Post-instruction FCI averages were significantly higher for the traditional curriculu…
▽ More
The performance of over 5000 students in introductory calculus-based mechanics courses at the Georgia Institute of Technology was assessed using the Force Concept Inventory (FCI). Results from two different curricula were compared: a traditional mechanics curriculum and the Matter & Interactions (M&I) curriculum. Post-instruction FCI averages were significantly higher for the traditional curriculum than for the M&I curriculum; the differences between curricula persist after accounting for factors such as pre-instruction FCI scores, grade point averages, and SAT scores. FCI performance on categories of items organized by concepts was also compared; traditional averages were significantly higher in each concept. We examined differences in student preparation between the curricula and found that the relative fraction of homework and lecture topics devoted to FCI force and motion concepts correlated with the observed performance differences. Limitations of concept inventories as instruments for evaluating curricular reforms are discussed.
△ Less
Submitted 3 July, 2012; v1 submitted 6 June, 2011;
originally announced June 2011.
