-
Lessons Learned from Designing an Open-Source Automated Feedback System for STEM Education
Authors:
Steffen Steinert,
Lars Krupp,
Karina E. Avila,
Anke S. Janssen,
Verena Ruf,
David Dzsotjan,
Christian De Schryver,
Jakob Karolus,
Stefan Ruzika,
Karen Joisten,
Paul Lukowicz,
Jochen Kuhn,
Norbert Wehn,
Stefan Küchemann
Abstract:
As distance learning becomes increasingly important and artificial intelligence tools continue to advance, automated systems for individual learning have attracted significant attention. However, the scarcity of open-source online tools that are capable of providing personalized feedback has restricted the widespread implementation of research-based feedback systems. In this work, we present RATsA…
▽ More
As distance learning becomes increasingly important and artificial intelligence tools continue to advance, automated systems for individual learning have attracted significant attention. However, the scarcity of open-source online tools that are capable of providing personalized feedback has restricted the widespread implementation of research-based feedback systems. In this work, we present RATsApp, an open-source automated feedback system (AFS) that incorporates research-based features such as formative feedback. The system focuses on core STEM competencies such as mathematical competence, representational competence, and data literacy. It also allows lecturers to monitor students' progress. We conducted a survey based on the technology acceptance model (TAM2) among a set of students (N=64). Our findings confirm the applicability of the TAM2 framework, revealing that factors such as the relevance of the studies, output quality, and ease of use significantly influence the perceived usefulness. We also found a linear relation between the perceived usefulness and the intention to use, which in turn is a significant predictor of the frequency of use. Moreover, the formative feedback feature of RATsApp received positive feedback, indicating its potential as an educational tool. Furthermore, as an open-source platform, RATsApp encourages public contributions to its ongoing development, fostering a collaborative approach to improve educational tools.
△ Less
Submitted 19 January, 2024;
originally announced January 2024.
-
Unreflected Acceptance -- Investigating the Negative Consequences of ChatGPT-Assisted Problem Solving in Physics Education
Authors:
Lars Krupp,
Steffen Steinert,
Maximilian Kiefer-Emmanouilidis,
Karina E. Avila,
Paul Lukowicz,
Jochen Kuhn,
Stefan Küchemann,
Jakob Karolus
Abstract:
Large language models (LLMs) have recently gained popularity. However, the impact of their general availability through ChatGPT on sensitive areas of everyday life, such as education, remains unclear. Nevertheless, the societal impact on established educational methods is already being experienced by both students and educators. Our work focuses on higher physics education and examines problem sol…
▽ More
Large language models (LLMs) have recently gained popularity. However, the impact of their general availability through ChatGPT on sensitive areas of everyday life, such as education, remains unclear. Nevertheless, the societal impact on established educational methods is already being experienced by both students and educators. Our work focuses on higher physics education and examines problem solving strategies. In a study, students with a background in physics were assigned to solve physics exercises, with one group having access to an internet search engine (N=12) and the other group being allowed to use ChatGPT (N=27). We evaluated their performance, strategies, and interaction with the provided tools. Our results showed that nearly half of the solutions provided with the support of ChatGPT were mistakenly assumed to be correct by the students, indicating that they overly trusted ChatGPT even in their field of expertise. Likewise, in 42% of cases, students used copy & paste to query ChatGPT -- an approach only used in 4% of search engine queries -- highlighting the stark differences in interaction behavior between the groups and indicating limited reflection when using ChatGPT. In our work, we demonstrated a need to (1) guide students on how to interact with LLMs and (2) create awareness of potential shortcomings for users.
△ Less
Submitted 21 August, 2023;
originally announced September 2023.
-
Quantum inspired image augmentation applicable to waveguides and optical image transfer via Anderson Localization
Authors:
Nikolaos E. Palaiodimopoulos,
Vitor Fortes Rey,
Matthias Tschöpe,
Christina Jörg,
Paul Lukowicz,
Maximilian Kiefer-Emmanouilidis
Abstract:
We present a quantum inspired image augmentation protocol which is applicable to classical images and, in principle, due to its known quantum formulation applicable to quantum systems and quantum machine learning in the future. The augmentation technique relies on the phenomenon Anderson localization. As we will illustrate by numerical examples the technique changes classical wave properties by in…
▽ More
We present a quantum inspired image augmentation protocol which is applicable to classical images and, in principle, due to its known quantum formulation applicable to quantum systems and quantum machine learning in the future. The augmentation technique relies on the phenomenon Anderson localization. As we will illustrate by numerical examples the technique changes classical wave properties by interference effects resulting from scatterings at impurities in the material. We explain that the augmentation can be understood as multiplicative noise, which counter-intuitively averages out, by sampling over disorder realizations. Furthermore, we show how the augmentation can be implemented in arrays of disordered waveguides with direct implications for an efficient optical image transfer.
△ Less
Submitted 20 February, 2023;
originally announced February 2023.
-
Physics holo.lab learning experience: Using Smartglasses for Augmented Reality labwork to foster the concepts of heat conduction
Authors:
M. P. Strzys,
S. Kapp,
M. Thees,
P. Klein,
P. Lukowicz,
P. Knierim,
A. Schmidt,
J. Kuhn
Abstract:
Fundamental concepts of thermodynamics rely on abstract physical quantities such as energy, heat and entropy, which play an important role in the process of interpreting thermal phenomena and statistical mechanics. However, these quantities are not covered by human (visual) perception and thus, an intuitive understanding often is lacking. Today immersive technologies like head-mounted displays of…
▽ More
Fundamental concepts of thermodynamics rely on abstract physical quantities such as energy, heat and entropy, which play an important role in the process of interpreting thermal phenomena and statistical mechanics. However, these quantities are not covered by human (visual) perception and thus, an intuitive understanding often is lacking. Today immersive technologies like head-mounted displays of the newest generation, especially HoloLens, allow for high quality augmented reality learning experiences, which can overcome this perception gap and simultaneously avoid a split attention effect. In a mixed reality (MR) scenario as presented in this paper---which we call a holo.lab---human perception can be extended to the thermal regime by presenting false-color representations of the temperature of objects as a virtual augmentation directly on the real object itself in real-time. Direct feedback to experimental actions of the users in form of different representations allows for immediate comparison to theoretical principles and predictions and therefore is supposed to intensify the theory-experiment interactions and to increase the conceptual understanding. We tested this technology for an experiment on thermal conduction of metals in the framework of undergraduate laboratories. A pilot study with treatment and control groups (N = 59) showed a small positive effect of MR on students' performance measured with a standardized concept test for thermodynamics, indicating an improvement of the understanding of the underlying physical concepts.
△ Less
Submitted 12 April, 2018; v1 submitted 14 November, 2017;
originally announced November 2017.
-
Augmenting the thermal flux experiment: a mixed reality approach with the HoloLens
Authors:
M. P. Strzys,
S. Kapp,
M. Thees,
P. Lukowicz,
P. Knierim,
A. Schmidt,
J. Kuhn
Abstract:
In the field of Virtual Reality (VR) and Augmented Reality (AR) technologies have made huge progress during the last years and also reached the field of education. The virtuality continuum, ranging from pure virtuality on one side to the real world on the other has been successfully covered by the use of immersive technologies like head-mounted displays, which allow to embed virtual objects into t…
▽ More
In the field of Virtual Reality (VR) and Augmented Reality (AR) technologies have made huge progress during the last years and also reached the field of education. The virtuality continuum, ranging from pure virtuality on one side to the real world on the other has been successfully covered by the use of immersive technologies like head-mounted displays, which allow to embed virtual objects into the real surroundings, leading to a Mixed Reality (MR) experience. In such an environment digital and real objects do not only co-exist, but moreover are also able to interact with each other in real-time. These concepts can be used to merge human perception of reality with digitally visualized sensor data and thereby making the invisible visible. As a first example, in this paper we introduce alongside the basic idea of this column an MR-experiment in thermodynamics for a laboratory course for freshman students in physics or other science and engineering subjects which uses physical data from mobile devices for analyzing and displaying physical phenomena to students.
△ Less
Submitted 5 September, 2017;
originally announced September 2017.
-
A planetary nervous system for social mining and collective awareness
Authors:
Fosca Giannotti,
Dino Pedreschi,
Alex,
Pentland,
Paul Lukowicz,
Donald Kossmann,
James Crowley,
Dirk Helbing
Abstract:
We present a research roadmap of a Planetary Nervous System (PNS), capable of sensing and mining the digital breadcrumbs of human activities and unveiling the knowledge hidden in the big data for addressing the big questions about social complexity. We envision the PNS as a globally distributed, self-organizing, techno-social system for answering analytical questions about the status of world-wide…
▽ More
We present a research roadmap of a Planetary Nervous System (PNS), capable of sensing and mining the digital breadcrumbs of human activities and unveiling the knowledge hidden in the big data for addressing the big questions about social complexity. We envision the PNS as a globally distributed, self-organizing, techno-social system for answering analytical questions about the status of world-wide society, based on three pillars: social sensing, social mining, and the idea of trust networks and privacy-aware social mining. We discuss the ingredients of a science and a technology necessary to build the PNS upon the three mentioned pillars, beyond the limitations of their respective state-of-art. Social sensing is aimed at develo** better methods for harvesting the big data from the techno-social ecosystem and make them available for mining, learning and analysis at a properly high abstraction level.Social mining is the problem of discovering patterns and models of human behaviour from the sensed data across the various social dimensions by data mining, machine learning and social network analysis. Trusted networks and privacy-aware social mining is aimed at creating a new deal around the questions of privacy and data ownership empowering individual persons with full awareness and control on own personal data, so that users may allow access and use of their data for their own good and the common good. The PNS will provide a goal-oriented knowledge discovery framework, made of technology and people, able to configure itself to the aim of answering questions about the pulse of global society. Given an analytical request, the PNS activates a process composed by a variety of interconnected tasks exploiting the social sensing and mining methods within the transparent ecosystem provided by the trusted network.
△ Less
Submitted 2 April, 2013;
originally announced April 2013.
-
Towards a living earth simulator
Authors:
M. Paolucci,
D. Kossman,
R. Conte,
P. Lukowicz,
P. Argyrakis,
A. Blandford,
G. Bonelli,
S. Anderson,
S. de Freitas,
B. Edmonds,
N. Gilbert,
M. Gross,
J. Kohlhammer,
P. Koumoutsakos,
A. Krause,
B. -O. Linnér,
P. Slusallek,
O. Sorkine,
R. W. Sumner,
D. Helbing
Abstract:
The Living Earth Simulator (LES) is one of the core components of the FuturICT architecture. It will work as a federation of methods, tools, techniques and facilities supporting all of the FuturICT simulation-related activities to allow and encourage interactive exploration and understanding of societal issues. Society-relevant problems will be targeted by leaning on approaches based on complex sy…
▽ More
The Living Earth Simulator (LES) is one of the core components of the FuturICT architecture. It will work as a federation of methods, tools, techniques and facilities supporting all of the FuturICT simulation-related activities to allow and encourage interactive exploration and understanding of societal issues. Society-relevant problems will be targeted by leaning on approaches based on complex systems theories and data science in tight interaction with the other components of FuturICT. The LES will evaluate and provide answers to real-world questions by taking into account multiple scenarios. It will build on present approaches such as agent-based simulation and modeling, multiscale modelling, statistical inference, and data mining, moving beyond disciplinary borders to achieve a new perspective on complex social systems.
△ Less
Submitted 6 April, 2013;
originally announced April 2013.
-
Socio-inspired ICT - Towards a socially grounded society-ICT symbiosis
Authors:
A. Ferscha,
K. Farrahi,
J. van denHoven,
D. Hales,
A. Nowak,
P. Lukowicz,
D. Helbing
Abstract:
Modern ICT (Information and Communication Technology) has developed a vision where the "computer" is no longer associated with the concept of a single device or a network of devices, but rather the entirety of situated services originating in a digital world, which are perceived through the physical world. It is observed that services with explicit user input and output are becoming to be replaced…
▽ More
Modern ICT (Information and Communication Technology) has developed a vision where the "computer" is no longer associated with the concept of a single device or a network of devices, but rather the entirety of situated services originating in a digital world, which are perceived through the physical world. It is observed that services with explicit user input and output are becoming to be replaced by a computing landscape sensing the physical world via a huge variety of sensors, and controlling it via a plethora of actuators. The nature and appearance of computing devices is changing to be hidden in the fabric of everyday life, invisibly networked, and omnipresent, with applications greatly being based on the notions of context and knowledge. Interaction with such globe spanning, modern ICT systems will presumably be more implicit, at the periphery of human attention, rather than explicit, i.e. at the focus of human attention. Socio-inspired ICT assumes that future, globe scale ICT systems should be viewed as social systems. Such a view challenges research to identify and formalize the principles of interaction and adaptation in social systems, so as to be able to ground future ICT systems on those principles. This position paper therefore is concerned with the intersection of social behaviour and modern ICT, creating or recreating social conventions and social contexts through the use of pervasive, globe-spanning, omnipresent and participative ICT.
△ Less
Submitted 6 April, 2013;
originally announced April 2013.
-
FuturICT
Authors:
Dirk Helbing,
Steven Bishop,
Paul Lukowicz,
the FuturICT Consortium
Abstract:
FuturlCT is a FET Flagship project using collective, participatory research, integrated across ICT, the social sciences and complexity science, to design socio-inspired technology and develop a science of global, socially interactive systems. The project will bring together, on a global level, Big Data, new modelling techniques and new forms of interaction, leading to a new understanding of societ…
▽ More
FuturlCT is a FET Flagship project using collective, participatory research, integrated across ICT, the social sciences and complexity science, to design socio-inspired technology and develop a science of global, socially interactive systems. The project will bring together, on a global level, Big Data, new modelling techniques and new forms of interaction, leading to a new understanding of society and its coevolution with technology. It aims to understand, explore and manage our complex, connected world in a more sustainable and resilient way. FuturICT is motivated by the fact that ubiquitous communication and sensing blur the boundaries between the physical and digital worlds, creating unparalleled opportunities for understanding the socio-economic fabric of our world, and for empowering humanity to make informed, responsible decisions for its future. The intimate, complex and dynamic relationship between global, networked ICT systems and human society directly influences the complexity and manageability of both. This also opens up the possibility to fundamentally change the way ICT will be designed, built and operated, to reflect the need for socially interactive, ethically sensitive, trustworthy, self-organised and reliable systems. FuturICT will create a new public resource - value-oriented tools and models to aggregate, access, query and understand vast amounts of data. Information from open sources, real-time devices and mobile sensors will be integrated with multi-scale models of the behaviour of social, technological, environmental and economic systems, which can be interrogated by policy-makers, business people and citizens alike. Together, these will build an eco-system that will lead to new business models, scientific paradigm shifts and more rapid and effective ways to create and disseminate new knowledge and social benefits - thereby forming an innovation accelerator.
△ Less
Submitted 10 November, 2012;
originally announced November 2012.
