-
Mathematics and incentives in the slums
Authors:
Gunnar Stefansson,
Jamie Lentin,
Anna Helga Jonsdottir,
Eyþór Eiríksson,
Arnar Kristjánsson
Abstract:
In response to COVID-19, a new project was started to allow students to solve computerised math drills outside of school. In 9 months it has gone from zero to one thousand students, in co-operation with ten community libraries in various slums and low-income regions in Kenya. The program uses the tutor-web as a study environment and access is provided by donating tablet computers to participating…
▽ More
In response to COVID-19, a new project was started to allow students to solve computerised math drills outside of school. In 9 months it has gone from zero to one thousand students, in co-operation with ten community libraries in various slums and low-income regions in Kenya. The program uses the tutor-web as a study environment and access is provided by donating tablet computers to participating community libraries. Students are rewarded using the SmileyCoin cryptocurrency as they progress through the system and the libraries are free to sell for SMLY small food items, sanitary pads and the tablets themselves. The reward system is designed to put an emphasis on secondary school mathematics. Completion of the corresponding collection of drills gives SmileyCoin awards sufficient to purchase a tablet. Conclusions based on the first year indicate that the resulting effect on participation and performance is unprecedented: Eleven libraries with 1301 students opted for voluntary participation in 2021 causing the program to run at full financial capacity. In that year, 450 students earned enough SMLY to purchase the tablets, which involves completing a large collection of drills to a level of excellence. Status exam questions are dispersed within the drill collection. These independent measurements show learning which surpasses both rote learning and mechanical learning and demonstrate an increase in the general ability to address new mathematical problems not seen before.
△ Less
Submitted 6 November, 2022;
originally announced November 2022.
-
Learning and evaluation without access to schools during COVID-19
Authors:
Gunnar Stefansson,
Anna Helga Jonsdottir
Abstract:
The tutor-web drilling system is designed for learning so there are typically no limits on the number of attempts at improving performance. This system is used at multiple schools and universities in Iceland and Kenya, mostly for mathematics and statistics. Students earn SmileyCoin, a cryptocurrency, while studying. In Iceland the system has typically been used by students who use their own device…
▽ More
The tutor-web drilling system is designed for learning so there are typically no limits on the number of attempts at improving performance. This system is used at multiple schools and universities in Iceland and Kenya, mostly for mathematics and statistics. Students earn SmileyCoin, a cryptocurrency, while studying. In Iceland the system has typically been used by students who use their own devices to solve homework assignments during the semester, accessing the Internet-based tutor-web at http://tutor-web.net. These students typically take final exams on paper at the end of the semester. In Kenya the system is a part of a plan to enhance mathematics education using educational technology, organised by the Smiley Charity with the African Maths Initiative. This has been done by donating servers running the tutor-web to schools and tablets to students. Typically these schools do not have Internet access so the cryptocurrency can not be used. Innovative redesign was needed during COVID-19 in spring, 2020, since universities in Iceland were not able to host in-house finals and schools in Kenya were closed so tablets could not be donated directly to students. Remote finals were held in Iceland but the implementation was largely in the hands of the instructors. In Kenya, community libraries remained open and became a place for students to come in to study. Innovations included using the tutor-web as a remote drilling system in place of final exams in a large undergraduate course in statistics and donating tablets to libraries in Kenya. These libraries all have access to the Internet and the students have therefore been given the option to purchase the tablet using their SmileyCoin. This paper describes these implementations and how this unintended experiment will likely affect the future development and use of the tutor-web in both countries.
△ Less
Submitted 19 August, 2021;
originally announced September 2021.
-
Identifying rote learning and the supporting effects of hints in drills
Authors:
Gunnar Stefansson,
Anna Helga Jonsdottir,
Thorarinn Jonmundsson,
Gylfi Snaer Sigurdsson,
Ingunn Lilja Bergsdottir
Abstract:
Whenever students use any drilling system the question arises how much of their learning is meaningful learning vs memorisation through repetition or rote learning. Although both types of learning have their place in an educational system it is important to be able to distinguish between these two approaches to learning and identify options which can dislodge students from rote learning and motiva…
▽ More
Whenever students use any drilling system the question arises how much of their learning is meaningful learning vs memorisation through repetition or rote learning. Although both types of learning have their place in an educational system it is important to be able to distinguish between these two approaches to learning and identify options which can dislodge students from rote learning and motivate them towards meaningful learning. The tutor-web is an online drilling system. The design aim of the system is learning rather than evaluation. This is done by presenting students with multiple-choice questions which are selected randomly but linked to the students' performance. The questions themselves can be generated for a specific topic by drawing correct and incorrect answers from a collection associated with a general problem statement or heading. With this generating process students may see the same question heading twice but be presented with all new answer options or a mixture of new and old answer options. Data from a course on probability theory and statistics, taught during COVID-19, are analysed to separate rote learning from meaningful learning. The analyses show non-rote learning, but even with large question databases, students' performance is better when they are presented with an answer option they have seen before. An element of rote learning is thus exhibited but a deeper learning is also demonstrated. The item database has been seeded with hints such that some questions contain clues to cue the students towards the correct answer. This ties in with the issue of meaningful learning versus rote learning since the hope is that a new hint will work as a cue to coax the student to think harder about the question rather than continue to employ rote learning. Preliminary results indicate that hints are particularly useful for students with poor performance metrics.
△ Less
Submitted 19 August, 2021;
originally announced August 2021.
-
The effect of the number of distractors and the "None of the above" - "All of the above" options in multiple choice questions
Authors:
Anna Helga Jonsdottir,
Thorarinn Jonmundsson,
Inga Huld Armann,
Birna Borg Gunnarsdottir,
Gunnar Stefansson
Abstract:
Multiple choice questions (MCQs) are commonly used for assessment in higher education. With increased use of on-line examination it is likely that the usage of MCQs will be even more in years to come. It is therefore of interest to examine some characteristics of these type of questions such as the effect of the number of distractors used and the "None of the above" (NOTA) or "All of the above" (A…
▽ More
Multiple choice questions (MCQs) are commonly used for assessment in higher education. With increased use of on-line examination it is likely that the usage of MCQs will be even more in years to come. It is therefore of interest to examine some characteristics of these type of questions such as the effect of the number of distractors used and the "None of the above" (NOTA) or "All of the above" (AOTA) options.
The tutor-web is an open-source, on-line drilling system that is freely available to anyone having access to the Internet. The system was designed to be used for teaching mathematics and statistics but can in principle be used for other subjects as well. The system offers thousands of multiple choice questions at high school and university level. In addition to be a tool used by students for learning it has also been used as a testbed for research on web-assisted education.
The tutor-web system was used both as a learning tool and as a testing tool in a university course on mathematical statistics in the spring of 2020. Around 300 students were enrolled in the course providing tens of thousands of answers to MCQs designed to investigate the effect of the number of distractors and the use of NOTA and AOTA options in questions. The main findings of the study were that the probability of answering a question correctly was highest when a AOTA option was used as a distractor and when NOTA and AOTA were not used in questions. The probability of answering a question correctly decreased with the number of distractors.
△ Less
Submitted 19 August, 2021;
originally announced August 2021.
-
Using an Online Learning Environment to Teach an Undergraduate Statistics Course: the tutor-web
Authors:
Anna Helga Jonsdottir,
Gunnar Stefansson
Abstract:
A learning environment, the tutor-web (http://tutor-web.net), has been developed and used for educational research. The system is accessible and free to use for anyone having access to the Web. It is based on open source software and the teaching material is licensed under the Creative Commons Attribution-ShareAlike License. The system has been used for computer-assisted education in statistics an…
▽ More
A learning environment, the tutor-web (http://tutor-web.net), has been developed and used for educational research. The system is accessible and free to use for anyone having access to the Web. It is based on open source software and the teaching material is licensed under the Creative Commons Attribution-ShareAlike License. The system has been used for computer-assisted education in statistics and mathematics. It offers a unique way to structure and link together teaching material and includes interactive quizzes with the primary purpose of increasing learning rather than mere evaluation.
The system was used in a course on basic statistics in the University of Iceland, spring 2013. A randomized trial was conducted to investigate the difference in learning between students doing regular homework and students using the system. The difference between the groups was not found to be significant.
△ Less
Submitted 1 July, 2014;
originally announced July 2014.
-
A mobile web for enhancing statistics and mathematics education
Authors:
Jamie Lentin,
Anna H. Jonsdottir,
David Stern,
Victoria Mokua,
Gunnar Stefansson
Abstract:
A freely available educational application (a mobile website) is presented. This provides access to educational material and drilling on selected topics within mathematics and statistics with an emphasis on tablets and mobile phones. The application adapts to the student's performance, selecting from easy to difficult questions, or older material etc. These adaptations are based on statistical mod…
▽ More
A freely available educational application (a mobile website) is presented. This provides access to educational material and drilling on selected topics within mathematics and statistics with an emphasis on tablets and mobile phones. The application adapts to the student's performance, selecting from easy to difficult questions, or older material etc. These adaptations are based on statistical models and analyses of data from testing precursors of the system within several courses, from calculus and introductory statistics through multiple linear regression. The application can be used in both on-line and off-line modes. The behavior of the application is determined by parameters, the effects of which can be estimated statistically. Results presented include analyses of how the internal algorithms relate to passing a course and general incremental improvement in knowledge during a semester.
△ Less
Submitted 9 December, 2014; v1 submitted 19 June, 2014;
originally announced June 2014.
-
Design and analysis of experiments linking on-line drilling methods to improvements in knowledge
Authors:
Anna Helga Jonsdottir,
Gunnar Stefansson
Abstract:
An on-line drilling system, the tutor-web, has been developed and used for teaching mathematics and statistics. The system was used in a basic course in calculus including 182 students. The students were requested to answer quiz questions in the tutor-web and therefore monitored continuously during the semester. Data available are grades on a status exam conducted in the beginning of the course, a…
▽ More
An on-line drilling system, the tutor-web, has been developed and used for teaching mathematics and statistics. The system was used in a basic course in calculus including 182 students. The students were requested to answer quiz questions in the tutor-web and therefore monitored continuously during the semester. Data available are grades on a status exam conducted in the beginning of the course, a final grade and data gathered in the tutor-web system. A classification of the students is proposed using the data gathered in the system; a Good student should be able to solve a problem quickly and get it right, the "diligent" hard-working Learner may take longer to get the right answer, a guessing (Poor) student will not take long to get the wrong answer and the remaining (Unclassified) apparent non-learning students take long to get the wrong answer, resulting in a simple classification GLUP. The (Poor) students were found to show the least improvement, defined as the change in grade from the status to the final exams, while the Learners were found to improve the most. The results are used to demonstrate how further experiments are needed and can be designed as well as to indicate how a system needs to be further developed to accommodate such experiments.
△ Less
Submitted 30 October, 2013;
originally announced October 2013.
-
From evaluation to learning: Some aspects of designing a cyber-university
Authors:
Anna Helga Jonsdottir,
Gunnar Stefansson
Abstract:
Research is described on a system for web-assisted education and how it is used to deliver on-line drill questions, automatically suited to individual students. The system can store and display all of the various pieces of information used in a class-room (slides, examples, handouts, drill items) and give individualized drills to participating students. The system is built on the basic theme that…
▽ More
Research is described on a system for web-assisted education and how it is used to deliver on-line drill questions, automatically suited to individual students. The system can store and display all of the various pieces of information used in a class-room (slides, examples, handouts, drill items) and give individualized drills to participating students. The system is built on the basic theme that it is for learning rather than evaluation.
Experimental results shown here imply that both the item database and the item allocation methods are important and examples are given on how these need to be tuned for each course. Different item allocation methods are discussed and a method is proposed for comparing several such schemes. It is shown that students improve their knowledge while using the system. Classical statistical models which do not include learning, but are designed for mere evaluation, are therefore not applicable.
A corollary of the openness and emphasis on learning is that the student is permitted to continue requesting drill items until the system reports a grade which is satisfactory to the student. An obvious resulting challenge is how such a grade should be computed so as to reflect actual knowledge at the time of computation, entice the student to continue and simultaneously be a clear indication for the student. To name a few methods, a grade can in principle be computed based on all available answers on a topic, on the last few answers or on answers up to a given number of attempts, but all of these have obvious problems.
△ Less
Submitted 25 June, 2014; v1 submitted 4 October, 2013;
originally announced October 2013.
-
Enhanced Learning with Web-Assisted Education
Authors:
Anna Helga Jonsdottir,
Gunnar Stefansson
Abstract:
An educational system, the tutor-web (http://tutor-web.net), has been developed and used for educational research. The system is accessible and free to use for anyone having access to the Web. It is based on open source software and the teaching material is licensed under the Creative Commons Attribution-ShareAlike License. The system has been used for computer-assisted education in statistics and…
▽ More
An educational system, the tutor-web (http://tutor-web.net), has been developed and used for educational research. The system is accessible and free to use for anyone having access to the Web. It is based on open source software and the teaching material is licensed under the Creative Commons Attribution-ShareAlike License. The system has been used for computer-assisted education in statistics and mathematics. It offers a unique way to structure and link together teaching material and includes interactive quizzes with the primary purpose of increasing learning rather than mere evaluation.
The system was used in a course on basic statistics in 2011. Three types of data were gathered during the course. A randomized crossover experiment was conducted to assess the possible difference in learning (measured by repeated exams) between students using the system and students doing regular homework. The difference between the groups was not found to be significant. Responses to quiz questions were collected and analysed with item response theory type models. These analysis were used to improve the item banks. Finally, the students answered an in-class survey regarding their experience using the tutor-web. The responses of the students gave clear indications of student preferences.
△ Less
Submitted 17 October, 2013;
originally announced October 2013.
