-
Generative AI as a metacognitive agent: A comparative mixed-method study with human participants on ICF-mimicking exam performance
Authors:
Jelena Pavlovic,
Jugoslav Krstic,
Luka Mitrovic,
Djordje Babic,
Adrijana Milosavljevic,
Milena Nikolic,
Tijana Karaklic,
Tijana Mitrovic
Abstract:
This study investigates the metacognitive capabilities of Large Language Models relative to human metacognition in the context of the International Coaching Federation ICF mimicking exam, a situational judgment test related to coaching competencies. Using a mixed method approach, we assessed the metacognitive performance, including sensitivity, accuracy in probabilistic predictions, and bias, of h…
▽ More
This study investigates the metacognitive capabilities of Large Language Models relative to human metacognition in the context of the International Coaching Federation ICF mimicking exam, a situational judgment test related to coaching competencies. Using a mixed method approach, we assessed the metacognitive performance, including sensitivity, accuracy in probabilistic predictions, and bias, of human participants and five advanced LLMs (GPT-4, Claude-3-Opus 3, Mistral Large, Llama 3, and Gemini 1.5 Pro). The results indicate that LLMs outperformed humans across all metacognitive metrics, particularly in terms of reduced overconfidence, compared to humans. However, both LLMs and humans showed less adaptability in ambiguous scenarios, adhering closely to predefined decision frameworks. The study suggests that Generative AI can effectively engage in human-like metacognitive processing without conscious awareness. Implications of the study are discussed in relation to development of AI simulators that scaffold cognitive and metacognitive aspects of mastering coaching competencies. More broadly, implications of these results are discussed in relation to development of metacognitive modules that lead towards more autonomous and intuitive AI systems.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
A Learning-based Nonlinear Model Predictive Controller for a Real Go-Kart based on Black-box Dynamics Modeling through Gaussian Processes
Authors:
Enrico Picotti,
Enrico Mion,
Alberto Dalla Libera,
Josip Pavlovic,
Andrea Censi,
Emilio Frazzoli,
Alessandro Beghi,
Mattia Bruschetta
Abstract:
Lately, Nonlinear Model Predictive Control (NMPC)has been successfully applied to (semi-) autonomous driving problems and has proven to be a very promising technique. However, accurate control models for real vehicles could require costly and time-demanding specific measurements. To address this problem, the exploitation of system data to complement or derive the prediction model of the NMPC has b…
▽ More
Lately, Nonlinear Model Predictive Control (NMPC)has been successfully applied to (semi-) autonomous driving problems and has proven to be a very promising technique. However, accurate control models for real vehicles could require costly and time-demanding specific measurements. To address this problem, the exploitation of system data to complement or derive the prediction model of the NMPC has been explored, employing learning dynamics approaches within Learning-based NMPC (LbNMPC). Its application to the automotive field has focused on discrete grey-box modeling, in which a nominal dynamics model is enhanced by the data-driven component. In this manuscript, we present an LbNMPC controller for a real go-kart based on a continuous black-box model of the accelerations obtained by Gaussian Processes. We show the effectiveness of the proposed approach by testing the controller on a real go-kart vehicle, highlighting the approximation steps required to get an exploitable GP model on a real-time application.
△ Less
Submitted 29 May, 2023;
originally announced May 2023.
-
Classification model for microphone type recognition
Authors:
Miroslava Jordovic Pavlovic,
Aleksandar Kupusinac,
Marica Popovic
Abstract:
This paper presents a classification model for microphone type recognition in photoacoustic experiment. The classification model is obtained by applying a multilayer perceptron network on a large dataset of simulated experimental values. The model satisfies the basic requirements of a photoacoustic experiment: accuracy, reliability and real time operations.
This paper presents a classification model for microphone type recognition in photoacoustic experiment. The classification model is obtained by applying a multilayer perceptron network on a large dataset of simulated experimental values. The model satisfies the basic requirements of a photoacoustic experiment: accuracy, reliability and real time operations.
△ Less
Submitted 21 June, 2019;
originally announced June 2019.
