-
Object permanence in newborn chicks is robust against opposing evidence
Authors:
Justin N. Wood,
Tomer D. Ullman,
Brian W. Wood,
Elizabeth S. Spelke,
Samantha M. W. Wood
Abstract:
Newborn animals have advanced perceptual skills at birth, but the nature of this initial knowledge is unknown. Is initial knowledge flexible, continuously adapting to the statistics of experience? Or can initial knowledge be rigid and robust to change, even in the face of opposing evidence? We address this question through controlled-rearing experiments on newborn chicks. First, we reared chicks i…
▽ More
Newborn animals have advanced perceptual skills at birth, but the nature of this initial knowledge is unknown. Is initial knowledge flexible, continuously adapting to the statistics of experience? Or can initial knowledge be rigid and robust to change, even in the face of opposing evidence? We address this question through controlled-rearing experiments on newborn chicks. First, we reared chicks in an impoverished virtual world, where objects never occluded one another, and found that chicks still succeed on object permanence tasks. Second, we reared chicks in a virtual world in which objects teleported from one location to another while out of view: an unnatural event that violates the continuity of object motion. Despite seeing thousands of these violations of object permanence, and not a single non-violation, the chicks behaved as if object permanence were true, exhibiting the same behavior as chicks reared with natural object permanence events. We conclude that object permanence develops prenatally and is robust to change from opposing evidence.
△ Less
Submitted 22 February, 2024;
originally announced February 2024.
-
Are Vision Transformers More Data Hungry Than Newborn Visual Systems?
Authors:
Lalit Pandey,
Samantha M. W. Wood,
Justin N. Wood
Abstract:
Vision transformers (ViTs) are top performing models on many computer vision benchmarks and can accurately predict human behavior on object recognition tasks. However, researchers question the value of using ViTs as models of biological learning because ViTs are thought to be more data hungry than brains, with ViTs requiring more training data to reach similar levels of performance. To test this a…
▽ More
Vision transformers (ViTs) are top performing models on many computer vision benchmarks and can accurately predict human behavior on object recognition tasks. However, researchers question the value of using ViTs as models of biological learning because ViTs are thought to be more data hungry than brains, with ViTs requiring more training data to reach similar levels of performance. To test this assumption, we directly compared the learning abilities of ViTs and animals, by performing parallel controlled rearing experiments on ViTs and newborn chicks. We first raised chicks in impoverished visual environments containing a single object, then simulated the training data available in those environments by building virtual animal chambers in a video game engine. We recorded the first-person images acquired by agents moving through the virtual chambers and used those images to train self supervised ViTs that leverage time as a teaching signal, akin to biological visual systems. When ViTs were trained through the eyes of newborn chicks, the ViTs solved the same view invariant object recognition tasks as the chicks. Thus, ViTs were not more data hungry than newborn visual systems: both learned view invariant object representations in impoverished visual environments. The flexible and generic attention based learning mechanism in ViTs combined with the embodied data streams available to newborn animals appears sufficient to drive the development of animal-like object recognition.
△ Less
Submitted 5 December, 2023;
originally announced December 2023.
-
A newborn embodied Turing test for view-invariant object recognition
Authors:
Denizhan Pak,
Donsuk Lee,
Samantha M. W. Wood,
Justin N. Wood
Abstract:
Recent progress in artificial intelligence has renewed interest in building machines that learn like animals. Almost all of the work comparing learning across biological and artificial systems comes from studies where animals and machines received different training data, obscuring whether differences between animals and machines emerged from differences in learning mechanisms versus training data…
▽ More
Recent progress in artificial intelligence has renewed interest in building machines that learn like animals. Almost all of the work comparing learning across biological and artificial systems comes from studies where animals and machines received different training data, obscuring whether differences between animals and machines emerged from differences in learning mechanisms versus training data. We present an experimental approach-a "newborn embodied Turing Test"-that allows newborn animals and machines to be raised in the same environments and tested with the same tasks, permitting direct comparison of their learning abilities. To make this platform, we first collected controlled-rearing data from newborn chicks, then performed "digital twin" experiments in which machines were raised in virtual environments that mimicked the rearing conditions of the chicks. We found that (1) machines (deep reinforcement learning agents with intrinsic motivation) can spontaneously develop visually guided preference behavior, akin to imprinting in newborn chicks, and (2) machines are still far from newborn-level performance on object recognition tasks. Almost all of the chicks developed view-invariant object recognition, whereas the machines tended to develop view-dependent recognition. The learning outcomes were also far more constrained in the chicks versus machines. Ultimately, we anticipate that this approach will help researchers develop embodied AI systems that learn like newborn animals.
△ Less
Submitted 8 June, 2023;
originally announced June 2023.
-
Controlled-rearing studies of newborn chicks and deep neural networks
Authors:
Donsuk Lee,
Pranav Gujarathi,
Justin N. Wood
Abstract:
Convolutional neural networks (CNNs) can now achieve human-level performance on challenging object recognition tasks. CNNs are also the leading quantitative models in terms of predicting neural and behavioral responses in visual recognition tasks. However, there is a widely accepted critique of CNN models: unlike newborn animals, which learn rapidly and efficiently, CNNs are thought to be "data hu…
▽ More
Convolutional neural networks (CNNs) can now achieve human-level performance on challenging object recognition tasks. CNNs are also the leading quantitative models in terms of predicting neural and behavioral responses in visual recognition tasks. However, there is a widely accepted critique of CNN models: unlike newborn animals, which learn rapidly and efficiently, CNNs are thought to be "data hungry," requiring massive amounts of training data to develop accurate models for object recognition. This critique challenges the promise of using CNNs as models of visual development. Here, we directly examined whether CNNs are more data hungry than newborn animals by performing parallel controlled-rearing experiments on newborn chicks and CNNs. We raised newborn chicks in strictly controlled visual environments, then simulated the training data available in that environment by constructing a virtual animal chamber in a video game engine. We recorded the visual images acquired by an agent moving through the virtual chamber and used those images to train CNNs. When CNNs received similar visual training data as chicks, the CNNs successfully solved the same challenging view-invariant object recognition tasks as the chicks. Thus, the CNNs were not more data hungry than animals: both CNNs and chicks successfully developed robust object models from training data of a single object.
△ Less
Submitted 11 December, 2021;
originally announced December 2021.
-
Development of collective behavior in newborn artificial agents
Authors:
Donsuk Lee,
Samantha M. W. Wood,
Justin N. Wood
Abstract:
Collective behavior is widespread across the animal kingdom. To date, however, the developmental and mechanistic foundations of collective behavior have not been formally established. What learning mechanisms drive the development of collective behavior in newborn animals? Here, we used deep reinforcement learning and curiosity-driven learning -- two learning mechanisms deeply rooted in psychologi…
▽ More
Collective behavior is widespread across the animal kingdom. To date, however, the developmental and mechanistic foundations of collective behavior have not been formally established. What learning mechanisms drive the development of collective behavior in newborn animals? Here, we used deep reinforcement learning and curiosity-driven learning -- two learning mechanisms deeply rooted in psychological and neuroscientific research -- to build newborn artificial agents that develop collective behavior. Like newborn animals, our agents learn collective behavior from raw sensory inputs in naturalistic environments. Our agents also learn collective behavior without external rewards, using only intrinsic motivation (curiosity) to drive learning. Specifically, when we raise our artificial agents in natural visual environments with groupmates, the agents spontaneously develop ego-motion, object recognition, and a preference for groupmates, rapidly learning all of the core skills required for collective behavior. This work bridges the divide between high-dimensional sensory inputs and collective action, resulting in a pixels-to-actions model of collective animal behavior. More generally, we show that two generic learning mechanisms -- deep reinforcement learning and curiosity-driven learning -- are sufficient to learn collective behavior from unsupervised natural experience.
△ Less
Submitted 5 November, 2021;
originally announced November 2021.
-
Modeling Object Recognition in Newborn Chicks using Deep Neural Networks
Authors:
Donsuk Lee,
Denizhan Pak,
Justin N. Wood
Abstract:
In recent years, the brain and cognitive sciences have made great strides develo** a mechanistic understanding of object recognition in mature brains. Despite this progress, fundamental questions remain about the origins and computational foundations of object recognition. What learning algorithms underlie object recognition in newborn brains? Since newborn animals learn largely through unsuperv…
▽ More
In recent years, the brain and cognitive sciences have made great strides develo** a mechanistic understanding of object recognition in mature brains. Despite this progress, fundamental questions remain about the origins and computational foundations of object recognition. What learning algorithms underlie object recognition in newborn brains? Since newborn animals learn largely through unsupervised learning, we explored whether unsupervised learning algorithms can be used to predict the view-invariant object recognition behavior of newborn chicks. Specifically, we used feature representations derived from unsupervised deep neural networks (DNNs) as inputs to cognitive models of categorization. We show that features derived from unsupervised DNNs make competitive predictions about chick behavior compared to supervised features. More generally, we argue that linking controlled-rearing studies to image-computable DNN models opens new experimental avenues for studying the origins and computational basis of object recognition in newborn animals.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
-
OGLE-2005-BLG-153: Microlensing Discovery and Characterization of A Very Low Mass Binary
Authors:
K. -H. Hwang,
A. Udalski,
C. Han,
Y. -H. Ryu,
I. A. Bond,
J. -P. Beaulieu,
M. Dominik,
K. Horne,
A. Gould,
B. S. Gaudi,
M. Kubiak,
M. K. Szymanski,
G. Pietrzynski,
I. Soszynski,
O. Szewczyk,
K. Ulaczyk,
L. Wyrzykowski,
F. Abe,
C. S. Botzler,
J. B. Hearnshaw,
Y. Itow,
K. Kamiya,
P. M. Kilmartin,
K. Masuda,
Y. Matsubara
, et al. (55 additional authors not shown)
Abstract:
The mass function and statistics of binaries provide important diagnostics of the star formation process. Despite this importance, the mass function at low masses remains poorly known due to observational difficulties caused by the faintness of the objects. Here we report the microlensing discovery and characterization of a binary lens composed of very low-mass stars just above the hydrogen-burnin…
▽ More
The mass function and statistics of binaries provide important diagnostics of the star formation process. Despite this importance, the mass function at low masses remains poorly known due to observational difficulties caused by the faintness of the objects. Here we report the microlensing discovery and characterization of a binary lens composed of very low-mass stars just above the hydrogen-burning limit. From the combined measurements of the Einstein radius and microlens parallax, we measure the masses of the binary components of $0.10\pm 0.01\ M_\odot$ and $0.09\pm 0.01\ M_\odot$. This discovery demonstrates that microlensing will provide a method to measure the mass function of all Galactic populations of very low mass binaries that is independent of the biases caused by the luminosity of the population.
△ Less
Submitted 25 April, 2012; v1 submitted 2 September, 2010;
originally announced September 2010.
