-
Pedestrian crossing decisions can be explained by bounded optimal decision-making under noisy visual perception
Authors:
Yueyang Wang,
Aravinda Ramakrishnan Srinivasan,
Jussi P. P. Jokinen,
Antti Oulasvirta,
Gustav Markkula
Abstract:
This paper presents a model of pedestrian crossing decisions, based on the theory of computational rationality. It is assumed that crossing decisions are boundedly optimal, with bounds on optimality arising from human cognitive limitations. While previous models of pedestrian behaviour have been either 'black-box' machine learning models or mechanistic models with explicit assumptions about cognit…
▽ More
This paper presents a model of pedestrian crossing decisions, based on the theory of computational rationality. It is assumed that crossing decisions are boundedly optimal, with bounds on optimality arising from human cognitive limitations. While previous models of pedestrian behaviour have been either 'black-box' machine learning models or mechanistic models with explicit assumptions about cognitive factors, we combine both approaches. Specifically, we model mechanistically noisy human visual perception and assumed rewards in crossing, but we use reinforcement learning to learn bounded optimal behaviour policy. The model reproduces a larger number of known empirical phenomena than previous models, in particular: (1) the effect of the time to arrival of an approaching vehicle on whether the pedestrian accepts the gap, the effect of the vehicle's speed on both (2) gap acceptance and (3) pedestrian timing of crossing in front of yielding vehicles, and (4) the effect on this crossing timing of the stop** distance of the yielding vehicle. Notably, our findings suggest that behaviours previously framed as 'biases' in decision-making, such as speed-dependent gap acceptance, might instead be a product of rational adaptation to the constraints of visual perception. Our approach also permits fitting the parameters of cognitive constraints and rewards per individual, to better account for individual differences. To conclude, by leveraging both RL and mechanistic modelling, our model offers novel insights about pedestrian behaviour, and may provide a useful foundation for more accurate and scalable pedestrian models.
△ Less
Submitted 6 February, 2024;
originally announced February 2024.
-
Modeling Cognitive-Affective Processes with Appraisal and Reinforcement Learning
Authors:
Jiayi Zhang,
Joost Broekens,
Jussi Jokinen
Abstract:
Computational models can advance affective science by shedding light onto the interplay between cognition and emotion from an information processing point of view. We propose a computational model of emotion that integrates reinforcement learning (RL) and appraisal theory, establishing a formal relationship between reward processing, goal-directed task learning, cognitive appraisal and emotional e…
▽ More
Computational models can advance affective science by shedding light onto the interplay between cognition and emotion from an information processing point of view. We propose a computational model of emotion that integrates reinforcement learning (RL) and appraisal theory, establishing a formal relationship between reward processing, goal-directed task learning, cognitive appraisal and emotional experiences. The model achieves this by formalizing evaluative checks from the component process model (CPM) in terms of temporal difference learning updates. We formalized novelty, goal relevance, goal conduciveness, and power. The formalization is task independent and can be applied to any task that can be represented as a Markov decision problem (MDP) and solved using RL. We investigated to what extent CPM-RL enables simulation of emotional responses cased by interactive task events. We evaluate the model by predicting a range of human emotions based on a series of vignette studies, highlighting its potential in improving our understanding of the role of reward processing in affective experiences.
△ Less
Submitted 26 October, 2023; v1 submitted 12 September, 2023;
originally announced September 2023.
-
Modeling human road crossing decisions as reward maximization with visual perception limitations
Authors:
Yueyang Wang,
Aravinda Ramakrishnan Srinivasan,
Jussi P. P. Jokinen,
Antti Oulasvirta,
Gustav Markkula
Abstract:
Understanding the interaction between different road users is critical for road safety and automated vehicles (AVs). Existing mathematical models on this topic have been proposed based mostly on either cognitive or machine learning (ML) approaches. However, current cognitive models are incapable of simulating road user trajectories in general scenarios, and ML models lack a focus on the mechanisms…
▽ More
Understanding the interaction between different road users is critical for road safety and automated vehicles (AVs). Existing mathematical models on this topic have been proposed based mostly on either cognitive or machine learning (ML) approaches. However, current cognitive models are incapable of simulating road user trajectories in general scenarios, and ML models lack a focus on the mechanisms generating the behavior and take a high-level perspective which can cause failures to capture important human-like behaviors. Here, we develop a model of human pedestrian crossing decisions based on computational rationality, an approach using deep reinforcement learning (RL) to learn boundedly optimal behavior policies given human constraints, in our case a model of the limited human visual system. We show that the proposed combined cognitive-RL model captures human-like patterns of gap acceptance and crossing initiation time. Interestingly, our model's decisions are sensitive to not only the time gap, but also the speed of the approaching vehicle, something which has been described as a "bias" in human gap acceptance behavior. However, our results suggest that this is instead a rational adaption to human perceptual limitations. Moreover, we demonstrate an approach to accounting for individual differences in computational rationality models, by conditioning the RL policy on the parameters of the human constraints. Our results demonstrate the feasibility of generating more human-like road user behavior by combining RL with cognitive models.
△ Less
Submitted 27 January, 2023;
originally announced January 2023.
-
Human Strategic Steering Improves Performance of Interactive Optimization
Authors:
Fabio Colella,
Pedram Daee,
Jussi Jokinen,
Antti Oulasvirta,
Samuel Kaski
Abstract:
A central concern in an interactive intelligent system is optimization of its actions, to be maximally helpful to its human user. In recommender systems for instance, the action is to choose what to recommend, and the optimization task is to recommend items the user prefers. The optimization is done based on earlier user's feedback (e.g. "likes" and "dislikes"), and the algorithms assume the feedb…
▽ More
A central concern in an interactive intelligent system is optimization of its actions, to be maximally helpful to its human user. In recommender systems for instance, the action is to choose what to recommend, and the optimization task is to recommend items the user prefers. The optimization is done based on earlier user's feedback (e.g. "likes" and "dislikes"), and the algorithms assume the feedback to be faithful. That is, when the user clicks "like," they actually prefer the item. We argue that this fundamental assumption can be extensively violated by human users, who are not passive feedback sources. Instead, they are in control, actively steering the system towards their goal. To verify this hypothesis, that humans steer and are able to improve performance by steering, we designed a function optimization task where a human and an optimization algorithm collaborate to find the maximum of a 1-dimensional function. At each iteration, the optimization algorithm queries the user for the value of a hidden function $f$ at a point $x$, and the user, who sees the hidden function, provides an answer about $f(x)$. Our study on 21 participants shows that users who understand how the optimization works, strategically provide biased answers (answers not equal to $f(x)$), which results in the algorithm finding the optimum significantly faster. Our work highlights that next-generation intelligent systems will need user models capable of hel** users who steer systems to pursue their goals.
△ Less
Submitted 4 May, 2020;
originally announced May 2020.
-
Probabilistic Formulation of the Take The Best Heuristic
Authors:
Tomi Peltola,
Jussi Jokinen,
Samuel Kaski
Abstract:
The framework of cognitively bounded rationality treats problem solving as fundamentally rational, but emphasises that it is constrained by cognitive architecture and the task environment. This paper investigates a simple decision making heuristic, Take The Best (TTB), within that framework. We formulate TTB as a likelihood-based probabilistic model, where the decision strategy arises by probabili…
▽ More
The framework of cognitively bounded rationality treats problem solving as fundamentally rational, but emphasises that it is constrained by cognitive architecture and the task environment. This paper investigates a simple decision making heuristic, Take The Best (TTB), within that framework. We formulate TTB as a likelihood-based probabilistic model, where the decision strategy arises by probabilistic inference based on the training data and the model constraints. The strengths of the probabilistic formulation, in addition to providing a bounded rational account of the learning of the heuristic, include natural extensibility with additional cognitively plausible constraints and prior information, and the possibility to embed the heuristic as a subpart of a larger probabilistic model. We extend the model to learn cue discrimination thresholds for continuous-valued cues and experiment with using the model to account for biased preference feedback from a boundedly rational agent in a simulated interactive machine learning task.
△ Less
Submitted 1 November, 2019;
originally announced November 2019.
-
Kinematics and Dynamic Modeling of a Planar Hydraulic Elastomer Actuator
Authors:
Mahdi Momeni Kelageri,
Mikko Heikkila,
Jarno Jokinen,
Matti Linjama,
Reza Ghabcheloo
Abstract:
This paper presents modeling of a compliant 2D manipulator, a so called soft hydraulic/fluidic elastomer actuator. Our focus is on fiber-Reinforced Fluidic Elastomer Actuators (RFEA) driven by a constant pressure hydraulic supply and modulated on/off valves. We present a model that not only provides the dynamics behavior of the system but also the kinematics of the actuator. In addition to that, t…
▽ More
This paper presents modeling of a compliant 2D manipulator, a so called soft hydraulic/fluidic elastomer actuator. Our focus is on fiber-Reinforced Fluidic Elastomer Actuators (RFEA) driven by a constant pressure hydraulic supply and modulated on/off valves. We present a model that not only provides the dynamics behavior of the system but also the kinematics of the actuator. In addition to that, the relation between the applied hydraulic pressure and the bending angle of the soft actuator and thus, its tip position is formulated in a systematic way. We also present a steady state model that calculates the bending angle given the fluid pressure which can be beneficial to find out the initial values of the parameters during the system identification process. Our experimental results verify and validate the performance of the proposed modeling approach both in transition and steady states. Due to its inherent simplicity, this model shall also be used in real-time control of the soft actuators.
△ Less
Submitted 13 June, 2018;
originally announced June 2018.
