-
Have Learning Analytics Dashboards Lived Up to the Hype? A Systematic Review of Impact on Students' Achievement, Motivation, Participation and Attitude
Authors:
Rogers Kaliisa,
Kamila Misiejuk,
Sonsoles López-Pernas,
Mohammad Khalil,
Mohammed Saqr
Abstract:
While learning analytics dashboards (LADs) are the most common form of LA intervention, there is limited evidence regarding their impact on students learning outcomes. This systematic review synthesizes the findings of 38 research studies to investigate the impact of LADs on students' learning outcomes, encompassing achievement, participation, motivation, and attitudes. As we currently stand, ther…
▽ More
While learning analytics dashboards (LADs) are the most common form of LA intervention, there is limited evidence regarding their impact on students learning outcomes. This systematic review synthesizes the findings of 38 research studies to investigate the impact of LADs on students' learning outcomes, encompassing achievement, participation, motivation, and attitudes. As we currently stand, there is no evidence to support the conclusion that LADs have lived up to the promise of improving academic achievement. Most studies reported negligible or small effects, with limited evidence from well-powered controlled experiments. Many studies merely compared users and non-users of LADs, confounding the dashboard effect with student engagement levels. Similarly, the impact of LADs on motivation and attitudes appeared modest, with only a few exceptions demonstrating significant effects. Small sample sizes in these studies highlight the need for larger-scale investigations to validate these findings. Notably, LADs showed a relatively substantial impact on student participation. Several studies reported medium to large effect sizes, suggesting that LADs can promote engagement and interaction in online learning environments. However, methodological shortcomings, such as reliance on traditional evaluation methods, self-selection bias, the assumption that access equates to usage, and a lack of standardized assessment tools, emerged as recurring issues. To advance the research line for LADs, researchers should use rigorous assessment methods and establish clear standards for evaluating learning constructs. Such efforts will advance our understanding of the potential of LADs to enhance learning outcomes and provide valuable insights for educators and researchers alike.
△ Less
Submitted 22 December, 2023;
originally announced December 2023.
-
A modern approach to transition analysis and process mining with Markov models: A tutorial with R
Authors:
Jouni Helske,
Satu Helske,
Mohammed Saqr,
Sonsoles López-Pernas,
Keefe Murphy
Abstract:
This chapter presents an introduction to Markovian modeling for the analysis of sequence data. Contrary to the deterministic approach seen in the previous sequence analysis chapters, Markovian models are probabilistic models, focusing on the transitions between states instead of studying sequences as a whole. The chapter provides an introduction to this method and differentiates between its most c…
▽ More
This chapter presents an introduction to Markovian modeling for the analysis of sequence data. Contrary to the deterministic approach seen in the previous sequence analysis chapters, Markovian models are probabilistic models, focusing on the transitions between states instead of studying sequences as a whole. The chapter provides an introduction to this method and differentiates between its most common variations: first-order Markov models, hidden Markov models, mixture Markov models, and mixture hidden Markov models. In addition to a thorough explanation and contextualization within the existing literature, the chapter provides a step-by-step tutorial on how to implement each type of Markovian model using the R package seqHMM. The chaper also provides a complete guide to performing stochastic process mining with Markovian models as well as plotting, comparing and clustering different process models.
△ Less
Submitted 2 September, 2023;
originally announced September 2023.
-
Temporal network analysis: Introduction, methods and detailed tutorial with R
Authors:
Mohammed Saqr
Abstract:
Learning involves relations, interactions and connections between learners, teachers and the world at large. Such interactions are essentially temporal and unfold in time. Yet, researchers have rarely combined the two aspects (the temporal and relational aspects) in an analytics framework. Temporal networks allow modeling of the temporal learning processes i.e., the emergence and flow of activitie…
▽ More
Learning involves relations, interactions and connections between learners, teachers and the world at large. Such interactions are essentially temporal and unfold in time. Yet, researchers have rarely combined the two aspects (the temporal and relational aspects) in an analytics framework. Temporal networks allow modeling of the temporal learning processes i.e., the emergence and flow of activities, communities, and social processes through fine-grained dynamic analysis. This can provide insights into phenomena like knowledge co-construction, information flow, and relationship building. This chapter introduces the basic concepts of temporal networks, their types and techniques. A detailed guide of temporal network analysis is introduced in this chapter, that starts with building the network, visualization, mathematical analysis on the node and graph level. The analysis is performed with a real-world dataset. The discussion chapter offers some extra resources for interested users who want to expand their knowledge of the technique.
△ Less
Submitted 23 July, 2023;
originally announced July 2023.
-
An introduction and tutorial to model-based clustering in education via Gaussian mixture modelling
Authors:
Luca Scrucca,
Mohammed Saqr,
Sonsoles López-Pernas,
Keefe Murphy
Abstract:
Heterogeneity has been a hot topic in recent educational literature. Several calls have been voiced to adopt methods that capture different patterns or subgroups within students behavior or functioning. Assuming that there is an average pattern that represents the entirety of student populations requires the measured construct to have the same causal mechanism, same development pattern, and affect…
▽ More
Heterogeneity has been a hot topic in recent educational literature. Several calls have been voiced to adopt methods that capture different patterns or subgroups within students behavior or functioning. Assuming that there is an average pattern that represents the entirety of student populations requires the measured construct to have the same causal mechanism, same development pattern, and affect students in exactly the same way. Using a person-centered method (Finite Gaussian mixture model or latent profile analysis), the present tutorial shows how to uncover the heterogeneity within engagement data by identifying three latent or unobserved clusters. This chapter offers an introduction to the model-based clustering that includes the principles of the methods, a guide to choice of number of clusters, evaluation of clustering results and a detailed guide with code and a real-life dataset. The discussion elaborates on the interpretation of the results, the advantages of model-based clustering as well as how it compares with other methods.
△ Less
Submitted 9 June, 2023;
originally announced June 2023.
-
Amicus Plato, sed magis amica veritas: There is a reproducibility crisis in COVID-19 Computational Fluid Dynamics studies
Authors:
Khalid M. Saqr
Abstract:
There is overwhelming evidence on SARS-CoV-2 Airborne Transmission (AT) in the ongoing COVID-19 outbreak. It is extraordinarily difficult, however, to deduce a generalized framework to assess the relative airborne transmission risk with respect to other modes. This is due to the complex biophysics entailed in such phenomena. Since the SARS outbreak in 2002, Computational Fluid Dynamics (CFD) has b…
▽ More
There is overwhelming evidence on SARS-CoV-2 Airborne Transmission (AT) in the ongoing COVID-19 outbreak. It is extraordinarily difficult, however, to deduce a generalized framework to assess the relative airborne transmission risk with respect to other modes. This is due to the complex biophysics entailed in such phenomena. Since the SARS outbreak in 2002, Computational Fluid Dynamics (CFD) has been one of the main tools scientists used to investigate AT of respiratory viruses. Now, CFD simulations produce intuitive and physically plausible colour-coded results that help scientists understand SARS-CoV-2 airborne transmission patterns. In addition to validation requirements, for any CFD model to be of epistemic value to the scientific community; it must be reproducible. In 2020, more than 45 published studies investigated SARS-CoV-2 airborne transmission in different scenarios using CFD. Here, I systematically review the published CFD studies of COVID-19 and discuss their reproducibility criteria with respect to the CFD modeling process. Using a Weighted Scoring Model (WSM), I propose a novel reproducibility index for CFD simulations of SARS-CoV-2 AT. The proposed index $(0 \leq R^{CFD}_j \leq 1)$ relies on three reproducibility criteria comprising 10 elements that represent the possibility of a CFD study (j) to be reproduced. Frustratingly, only 3 of 23 studies (13%) achieved full reproducibility index $(R^{CFD}_j\geq 0.9)$ while the remaining 87% were found generally irreproducible $(R^{CFD}_j<0.9)$. Without reproducible models, the scientific benefit of CFD simulations will remain hindered, fragmented and limited. In conclusion, I call the scientific community to apply more rigorous measures on reporting and publishing CFD simulations in COVID-19 research.
△ Less
Submitted 12 January, 2021;
originally announced January 2021.
-
Physiologic Blood Flow is Turbulent: Revisiting the Principles of Vascular Hemodynamics
Authors:
Khalid M. Saqr,
Simon Tupin,
Sherif Rashad,
Toshiki Endo,
Kuniyasu Niizuma,
Teiji Tominaga,
Makoto Ohta
Abstract:
Contemporary paradigm of vascular hemodynamics considers normal blood flow to be pulsatile laminar flow. Transition to turbulence can cause diseases such as atherosclerosis or brain aneurysms. Recently, we demonstrated the existence of turbulence in experimental models of brain aneurysm; in the aneurysm sac as well as in the main artery. Thus, we were intrigued to explore if such a long-standing a…
▽ More
Contemporary paradigm of vascular hemodynamics considers normal blood flow to be pulsatile laminar flow. Transition to turbulence can cause diseases such as atherosclerosis or brain aneurysms. Recently, we demonstrated the existence of turbulence in experimental models of brain aneurysm; in the aneurysm sac as well as in the main artery. Thus, we were intrigued to explore if such a long-standing assumption of the laminarity of blood flow could be challenged. We have used methods and tools from chaos theory, hydrodynamic stability theory and turbulence physics to explore the existence of turbulence in normal vascular blood flow. We used Womersley exact solution of the Navier-Stokes equation with the HaeMed database of physiologic blood flow measurements, to offer reproducible evidence for our findings, as well as evidence from Doppler ultrasound measurements from healthy volunteers. The tools we used to investigate the properties of blood turbulence are well established in the fields of chaos theory, hydrodynamic stability and turbulence dynamics. We show, evidently, that blood flow is inherently chaotic and turbulent and not laminar. We propose a paradigm shift in the theory of vascular hemodynamics which requires rethinking the hemodynamic-biologic links governing physiologic and pathologic processes.
△ Less
Submitted 14 February, 2020; v1 submitted 10 February, 2020;
originally announced February 2020.
-
A Novel Kuhnian Ontology for Epistemic Classification of STM Scholarly Articles
Authors:
Khalid M. Saqr,
Abdelrahman Elsharawy
Abstract:
Thomas Kuhn proposed his paradigmatic view of scientific discovery five decades ago. The concept of paradigm has not only explained the progress of science, but has also become the central epistemic concept among STM scientists. Here, we adopt the principles of Kuhnian philosophy to construct a novel ontology aims at classifying and evaluating the impact of STM scholarly articles. First, we explai…
▽ More
Thomas Kuhn proposed his paradigmatic view of scientific discovery five decades ago. The concept of paradigm has not only explained the progress of science, but has also become the central epistemic concept among STM scientists. Here, we adopt the principles of Kuhnian philosophy to construct a novel ontology aims at classifying and evaluating the impact of STM scholarly articles. First, we explain how the Kuhnian cycle of science describes research at different epistemic stages. Second, we show how the Kuhnian cycle could be reconstructed into modular ontologies which classify scholarly articles according to their contribution to paradigm-centred knowledge. The proposed ontology and its scenarios are discussed. To the best of the authors knowledge, this is the first attempt for creating an ontology for describing scholarly articles based on the Kuhnian paradigmatic view of science.
△ Less
Submitted 9 February, 2020;
originally announced February 2020.
-
Non-Kolmogorov Turbulence and Inverse Energy Cascade in Intracranial Aneurysm: Near-Wall Scales Suggest Mechanobiological Relevance
Authors:
Simon Tupin,
Khalid M. Saqr,
Sherif Rashad,
Kuniyasu Niizuma,
Makoto Ohta,
Teiji Tominaga
Abstract:
The genesis, growth and rupture of intracranial aneurysm (IA) are open questions in neurovascular medicine until the present moment. The complexity of aneurysm mechanobiology and pathobiology staggeringly combine intertwining biological and physical processes that are tightly connected. Recently, transition to turbulence in IA blood flow is thought to play a central role in IA growth and rupture a…
▽ More
The genesis, growth and rupture of intracranial aneurysm (IA) are open questions in neurovascular medicine until the present moment. The complexity of aneurysm mechanobiology and pathobiology staggeringly combine intertwining biological and physical processes that are tightly connected. Recently, transition to turbulence in IA blood flow is thought to play a central role in IA growth and rupture as it can be directly linked to endothelial dysfunction. However, the problem of turbulence brings unprecedented complications to the topic. We found turbulence in IA to be of non-Kolmogorov type. For the first time, we detected inverse kinetic energy cascade in blood flow and in non-Kolmogorov turbulence. Here, we hypothesize that the near-wall turbulence undergoing inverse energy cascade have scales that could affect the mechano-signaling of endothelial cells. Our findings could be a paradigm shift in the contemporary theory of aneurysm hemodynamics.
△ Less
Submitted 22 January, 2020;
originally announced January 2020.
