-
Extrapolation Frameworks in Cognitive Psychology Suitable for Study of Image Classification Models
Authors:
Roozbeh Yousefzadeh,
Jessica A. Mollick
Abstract:
We study the functional task of deep learning image classification models and show that image classification requires extrapolation capabilities. This suggests that new theories have to be developed for the understanding of deep learning as the current theory assumes models are solely interpolating, leaving many questions about them unanswered. We investigate the pixel space and also the feature s…
▽ More
We study the functional task of deep learning image classification models and show that image classification requires extrapolation capabilities. This suggests that new theories have to be developed for the understanding of deep learning as the current theory assumes models are solely interpolating, leaving many questions about them unanswered. We investigate the pixel space and also the feature spaces extracted from images by trained models (in their hidden layers, including the 64-dimensional feature space in the last hidden layer of pre-trained residual neural networks), and also the feature space extracted by wavelets/shearlets. In all these domains, testing samples considerably fall outside the convex hull of training sets, and image classification requires extrapolation. In contrast to the deep learning literature, in cognitive science, psychology, and neuroscience, extrapolation and learning are often studied in tandem. Moreover, many aspects of human visual cognition and behavior are reported to involve extrapolation. We propose a novel extrapolation framework for the mathematical study of deep learning models. In our framework, we use the term extrapolation in this specific way of extrapolating outside the convex hull of training set (in the pixel space or feature space) but within the specific scope defined by the training data, the same way extrapolation is defined in many studies in cognitive science. We explain that our extrapolation framework can provide novel answers to open research problems about deep learning including their over-parameterization, their training regime, out-of-distribution detection, etc. We also see that the extent of extrapolation is negligible in learning tasks where deep learning is reported to have no advantage over simple models.
△ Less
Submitted 6 December, 2021;
originally announced December 2021.
-
Neural Mechanisms of Human Decision-Making
Authors:
Seth Herd,
Kai Krueger,
Ananta Nair,
Jessica Mollick,
Randall OReilly
Abstract:
We present a computational and theoretical model of the neural mechanisms underlying human decision-making. We propose a detailed model of the interaction between brain regions, under a proposer-predictor-actor-critic framework. Task-relevant areas of cortex propose a candidate plan using fast, model-free, parallel constraint-satisfaction computations. Other areas of cortex and medial temporal lob…
▽ More
We present a computational and theoretical model of the neural mechanisms underlying human decision-making. We propose a detailed model of the interaction between brain regions, under a proposer-predictor-actor-critic framework. Task-relevant areas of cortex propose a candidate plan using fast, model-free, parallel constraint-satisfaction computations. Other areas of cortex and medial temporal lobe can then predict likely outcomes of that plan in this situation. This step is optional. This prediction-(or model-) based computation produces better accuracy and generalization, at the expense of speed. Next, linked regions of basal ganglia act to accept or reject the proposed plan based on its reward history in similar contexts. Finally the reward-prediction system acts as a critic to determine the value of the outcome relative to expectations, and produce dopamine as a training signal for cortex and basal ganglia. This model gains many constraints from the hypothesis that the mechanisms of complex human decision-making are closely analogous to those that have been empirically studied in detail for animal action-selection. We argue that by operating sequentially and hierarchically, these same mechanisms are responsible for the most complex human plans and decisions. Finally, we use the computational model to generate novel hypotheses on causes of human risky decision-making, and compare this to other theories of human decision-making.
△ Less
Submitted 16 December, 2019;
originally announced December 2019.
-
Goal-Driven Cognition in the Brain: A Computational Framework
Authors:
Randall C. O'Reilly,
Thomas E. Hazy,
Jessica Mollick,
Prescott Mackie,
Seth Herd
Abstract:
Current theoretical and computational models of dopamine-based reinforcement learning are largely rooted in the classical behaviorist tradition, and envision the organism as a purely reactive recipient of rewards and punishments, with resulting behavior that essentially reflects the sum of this reinforcement history. This framework is missing some fundamental features of the affective nervous syst…
▽ More
Current theoretical and computational models of dopamine-based reinforcement learning are largely rooted in the classical behaviorist tradition, and envision the organism as a purely reactive recipient of rewards and punishments, with resulting behavior that essentially reflects the sum of this reinforcement history. This framework is missing some fundamental features of the affective nervous system, most importantly, the central role of goals in driving and organizing behavior in a teleological manner. Even when goal-directed behaviors are considered in current frameworks, they are typically conceived of as arising in reaction to the environment, rather than being in place from the start. We hypothesize that goal-driven cognition is primary, and organized into two discrete phases: goal selection and goal engaged, which each have a substantially different effective value function. This dichotomy can potentially explain a wide range of phenomena, playing a central role in many clinical disorders, such as depression, OCD, ADHD, and PTSD, and providing a sensible account of the detailed biology and function of the dopamine system and larger limbic system, including critical ventral and medial prefrontal cortex. Computationally, reasoning backward from active goals to action selection is more tractable than projecting alternative action choices forward to compute possible outcomes. An explicit computational model of these brain areas and their function in this goal-driven framework is described, as are numerous testable predictions from this framework.
△ Less
Submitted 30 April, 2014;
originally announced April 2014.
