-
Inferring solid-state diffusivity in lithium-ion battery active materials: improving upon the classical GITT method
Authors:
A. Emir Gumrukcuoglu,
James Burridge,
Kieran O'Regan,
Jamie M. Foster
Abstract:
The Galvanostatic Intermittent Titration Technique (GITT) is a ubiquitous method for determining the solid-state diffusivity in lithium-ion battery materials. However, it is notoriously time-consuming and relies upon assumptions whose applicability is questionable. We propose a novel methodology that allows inference of the diffusivity for a more general class of data that is simpler and faster to…
▽ More
The Galvanostatic Intermittent Titration Technique (GITT) is a ubiquitous method for determining the solid-state diffusivity in lithium-ion battery materials. However, it is notoriously time-consuming and relies upon assumptions whose applicability is questionable. We propose a novel methodology that allows inference of the diffusivity for a more general class of data that is simpler and faster to harvest. We infer the diffusivity (as a function of stoichiometry) by minimising the residual sum of squares between data and solutions to a spherically-symmetric diffusion model in a single representative active material particle. Using data harvested from the NMC cathode of a commercial LG M50 cell we first demonstrate that our method is able to reproduce the diffusivities inferred by the GITT, which requires ten days of galvanostatic intermittent titration data. We then demonstrate that our method reliably reconstructs diffusivity using significantly less data. Despite arising from quick-to-measure data, our method more accurately infers diffusivities. This work is a contribution towards develo** faster and more reliable techniques in parameter inference for lithium-ion batteries.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
Parameterising continuum level Li-ion battery models & the LiionDB database
Authors:
A. A. Wang,
S. E. J. O'Kane,
F. Brosa Planella,
J. Le Houx,
K. O'Regan,
M. Zyskin,
J. Edge,
C. W. Monroe,
S. J. Cooper,
D. A. Howey,
E. Kendrick,
J. M. Foster
Abstract:
The Doyle-Fuller-Newman framework is the most popular physics-based continuum-level description of the chemical and dynamical internal processes within operating lithium-ion-battery cells. With sufficient flexibility to model a wide range of battery designs and chemistries, the framework provides an effective balance between detail, needed to capture key microscopic mechanisms, and simplicity, nee…
▽ More
The Doyle-Fuller-Newman framework is the most popular physics-based continuum-level description of the chemical and dynamical internal processes within operating lithium-ion-battery cells. With sufficient flexibility to model a wide range of battery designs and chemistries, the framework provides an effective balance between detail, needed to capture key microscopic mechanisms, and simplicity, needed to solve the governing equations at a relatively modest computational expense. Nevertheless, implementation requires values of numerous model parameters, whose ranges of applicability, estimation, and validation pose challenges. This article provides a critical review of the methods to measure or infer parameters for use within the isothermal DFN framework, discusses their advantages or disadvantages, and clarifies limitations attached to their practical application. Accompanying this discussion we provide a searchable database, available at www.liiondb.com, which aggregates many parameters and state functions for the standard Doyle-Fuller-Newman model that have been reported in the literature.
△ Less
Submitted 19 October, 2021;
originally announced October 2021.
-
Knowledge transfer in deep block-modular neural networks
Authors:
Alexander V. Terekhov,
Guglielmo Montone,
J. Kevin O'Regan
Abstract:
Although deep neural networks (DNNs) have demonstrated impressive results during the last decade, they remain highly specialized tools, which are trained -- often from scratch -- to solve each particular task. The human brain, in contrast, significantly re-uses existing capacities when learning to solve new tasks. In the current study we explore a block-modular architecture for DNNs, which allows…
▽ More
Although deep neural networks (DNNs) have demonstrated impressive results during the last decade, they remain highly specialized tools, which are trained -- often from scratch -- to solve each particular task. The human brain, in contrast, significantly re-uses existing capacities when learning to solve new tasks. In the current study we explore a block-modular architecture for DNNs, which allows parts of the existing network to be re-used to solve a new task without a decrease in performance when solving the original task. We show that networks with such architectures can outperform networks trained from scratch, or perform comparably, while having to learn nearly 10 times fewer weights than the networks trained from scratch.
△ Less
Submitted 24 July, 2019;
originally announced August 2019.
-
Learning abstract perceptual notions: the example of space
Authors:
Alexander V. Terekhov,
J. Kevin O'Regan
Abstract:
Humans are extremely swift learners. We are able to grasp highly abstract notions, whether they come from art perception or pure mathematics. Current machine learning techniques demonstrate astonishing results in extracting patterns in information. Yet the abstract notions we possess are more than just statistical patterns in the incoming information. Sensorimotor theory suggests that they represe…
▽ More
Humans are extremely swift learners. We are able to grasp highly abstract notions, whether they come from art perception or pure mathematics. Current machine learning techniques demonstrate astonishing results in extracting patterns in information. Yet the abstract notions we possess are more than just statistical patterns in the incoming information. Sensorimotor theory suggests that they represent functions, laws, describing how the information can be transformed, or, in other words, they represent the statistics of sensorimotor changes rather than sensory inputs themselves. The aim of our work is to suggest a way for machine learning and sensorimotor theory to benefit from each other so as to pave the way toward new horizons in learning. We show in this study that a highly abstract notion, that of space, can be seen as a collection of laws of transformations of sensory information and that these laws could in theory be learned by a naive agent. As an illustration we do a one-dimensional simulation in which an agent extracts spatial knowledge in the form of internalized ("sensible") rigid displacements. The agent uses them to encode its own displacements in a way which is isometrically related to external space. Though the algorithm allowing acquisition of rigid displacements is designed \emph{ad hoc}, we believe it can stimulate the development of unsupervised learning techniques leading to similar results.
△ Less
Submitted 24 July, 2019;
originally announced July 2019.
-
Learning agent's spatial configuration from sensorimotor invariants
Authors:
Alban Laflaquière,
J. Kevin O'Regan,
Sylvain Argentieri,
Bruno Gas,
Alexander V. Terekhov
Abstract:
The design of robotic systems is largely dictated by our purely human intuition about how we perceive the world. This intuition has been proven incorrect with regard to a number of critical issues, such as visual change blindness. In order to develop truly autonomous robots, we must step away from this intuition and let robotic agents develop their own way of perceiving. The robot should start fro…
▽ More
The design of robotic systems is largely dictated by our purely human intuition about how we perceive the world. This intuition has been proven incorrect with regard to a number of critical issues, such as visual change blindness. In order to develop truly autonomous robots, we must step away from this intuition and let robotic agents develop their own way of perceiving. The robot should start from scratch and gradually develop perceptual notions, under no prior assumptions, exclusively by looking into its sensorimotor experience and identifying repetitive patterns and invariants. One of the most fundamental perceptual notions, space, cannot be an exception to this requirement. In this paper we look into the prerequisites for the emergence of simplified spatial notions on the basis of a robot's sensorimotor flow. We show that the notion of space as environment-independent cannot be deduced solely from exteroceptive information, which is highly variable and is mainly determined by the contents of the environment. The environment-independent definition of space can be approached by looking into the functions that link the motor commands to changes in exteroceptive inputs. In a sufficiently rich environment, the kernels of these functions correspond uniquely to the spatial configuration of the agent's exteroceptors. We simulate a redundant robotic arm with a retina installed at its end-point and show how this agent can learn the configuration space of its retina. The resulting manifold has the topology of the Cartesian product of a plane and a circle, and corresponds to the planar position and orientation of the retina.
△ Less
Submitted 3 October, 2018;
originally announced October 2018.
-
Learning an internal representation of the end-effector configuration space
Authors:
Alban Laflaquière,
Alexander V. Terekhov,
Bruno Gas,
J. Kevin O'Regan
Abstract:
Current machine learning techniques proposed to automatically discover a robot kinematics usually rely on a priori information about the robot's structure, sensors properties or end-effector position. This paper proposes a method to estimate a certain aspect of the forward kinematics model with no such information. An internal representation of the end-effector configuration is generated from unst…
▽ More
Current machine learning techniques proposed to automatically discover a robot kinematics usually rely on a priori information about the robot's structure, sensors properties or end-effector position. This paper proposes a method to estimate a certain aspect of the forward kinematics model with no such information. An internal representation of the end-effector configuration is generated from unstructured proprioceptive and exteroceptive data flow under very limited assumptions. A map** from the proprioceptive space to this representational space can then be used to control the robot.
△ Less
Submitted 3 October, 2018;
originally announced October 2018.
-
Discovering space - Grounding spatial topology and metric regularity in a naive agent's sensorimotor experience
Authors:
Alban Laflaquière,
J. Kevin O'Regan,
Bruno Gas,
Alexander Terekhov
Abstract:
In line with the sensorimotor contingency theory, we investigate the problem of the perception of space from a fundamental sensorimotor perspective. Despite its pervasive nature in our perception of the world, the origin of the concept of space remains largely mysterious. For example in the context of artificial perception, this issue is usually circumvented by having engineers pre-define the spat…
▽ More
In line with the sensorimotor contingency theory, we investigate the problem of the perception of space from a fundamental sensorimotor perspective. Despite its pervasive nature in our perception of the world, the origin of the concept of space remains largely mysterious. For example in the context of artificial perception, this issue is usually circumvented by having engineers pre-define the spatial structure of the problem the agent has to face. We here show that the structure of space can be autonomously discovered by a naive agent in the form of sensorimotor regularities, that correspond to so called compensable sensory experiences: these are experiences that can be generated either by the agent or its environment. By detecting such compensable experiences the agent can infer the topological and metric structure of the external space in which its body is moving. We propose a theoretical description of the nature of these regularities and illustrate the approach on a simulated robotic arm equipped with an eye-like sensor, and which interacts with an object. Finally we show how these regularities can be used to build an internal representation of the sensor's external spatial configuration.
△ Less
Submitted 3 October, 2018; v1 submitted 7 June, 2018;
originally announced June 2018.
-
Why early tactile speech aids may have failed: no perceptual integration of tactile and auditory signals
Authors:
Aurora Rizza,
Alexander V. Terekhov,
Guglielmo Montone,
Marta Olivetti Belardinelli,
J. Kevin O'Regan
Abstract:
Tactile speech aids, though extensively studied in the 1980s and 90s, never became a commercial success. A hypothesis to explain this failure might be that it is difficult to obtain true perceptual integration of a tactile signal with information from auditory speech: exploitation of tactile cues from a tactile aid might require cognitive effort and so prevent speech understanding at the high rate…
▽ More
Tactile speech aids, though extensively studied in the 1980s and 90s, never became a commercial success. A hypothesis to explain this failure might be that it is difficult to obtain true perceptual integration of a tactile signal with information from auditory speech: exploitation of tactile cues from a tactile aid might require cognitive effort and so prevent speech understanding at the high rates typical of everyday speech. To test this hypothesis, we attempted to create true perceptual integration of tactile with auditory information in what might be considered the simplest situation encountered by a hearing-impaired listener. We created an auditory continuum between the syllables BA and VA, and trained participants to associate BA to one tactile stimulus VA to another tactile stimulus. After training, we tested if auditory discrimination along the continuum between the two syllables could be biased by incongruent tactile stimulation. We found that such a bias occurred only when the tactile stimulus was above its previously measured tactile discrimination threshold. Such a pattern is compatible with the idea that the effect is due to a cognitive or decisional strategy, rather than to truly perceptual integration. We therefore ran a further study, where we created a tactile version of the McGurk effect. We extensively trained two Subjects over six days to associate four recorded auditory syllables with four corresponding apparent motion tactile patterns. In a subsequent test, we presented stimulation that was either congruent or incongruent with the learnt association, and asked Subjects to report the syllable they perceived. We found no analog to the McGurk effect. These findings strengthen our hypothesis according to which tactile aids failed because integration of tactile cues with auditory speech occurred at a cognitive or decisional level, rather than truly at a perceptual level
△ Less
Submitted 28 November, 2017;
originally announced December 2017.
-
Block Neural Network Avoids Catastrophic Forgetting When Learning Multiple Task
Authors:
Guglielmo Montone,
J. Kevin O'Regan,
Alexander V. Terekhov
Abstract:
In the present work we propose a Deep Feed Forward network architecture which can be trained according to a sequential learning paradigm, where tasks of increasing difficulty are learned sequentially, yet avoiding catastrophic forgetting. The proposed architecture can re-use the features learned on previous tasks in a new task when the old tasks and the new one are related. The architecture needs…
▽ More
In the present work we propose a Deep Feed Forward network architecture which can be trained according to a sequential learning paradigm, where tasks of increasing difficulty are learned sequentially, yet avoiding catastrophic forgetting. The proposed architecture can re-use the features learned on previous tasks in a new task when the old tasks and the new one are related. The architecture needs fewer computational resources (neurons and connections) and less data for learning the new task than a network trained from scratch
△ Less
Submitted 28 November, 2017;
originally announced November 2017.
-
Hyper-dimensional computing for a visual question-answering system that is trainable end-to-end
Authors:
Guglielmo Montone,
J. Kevin O'Regan,
Alexander V. Terekhov
Abstract:
In this work we propose a system for visual question answering. Our architecture is composed of two parts, the first part creates the logical knowledge base given the image. The second part evaluates questions against the knowledge base. Differently from previous work, the knowledge base is represented using hyper-dimensional computing. This choice has the advantage that all the operations in the…
▽ More
In this work we propose a system for visual question answering. Our architecture is composed of two parts, the first part creates the logical knowledge base given the image. The second part evaluates questions against the knowledge base. Differently from previous work, the knowledge base is represented using hyper-dimensional computing. This choice has the advantage that all the operations in the system, namely creating the knowledge base and evaluating the questions against it, are differentiable, thereby making the system easily trainable in an end-to-end fashion.
△ Less
Submitted 28 November, 2017;
originally announced November 2017.
-
Gradual Tuning: a better way of Fine Tuning the parameters of a Deep Neural Network
Authors:
Guglielmo Montone,
J. Kevin O'Regan,
Alexander V. Terekhov
Abstract:
In this paper we present an alternative strategy for fine-tuning the parameters of a network. We named the technique Gradual Tuning. Once trained on a first task, the network is fine-tuned on a second task by modifying a progressively larger set of the network's parameters. We test Gradual Tuning on different transfer learning tasks, using networks of different sizes trained with different regular…
▽ More
In this paper we present an alternative strategy for fine-tuning the parameters of a network. We named the technique Gradual Tuning. Once trained on a first task, the network is fine-tuned on a second task by modifying a progressively larger set of the network's parameters. We test Gradual Tuning on different transfer learning tasks, using networks of different sizes trained with different regularization techniques. The result shows that compared to the usual fine tuning, our approach significantly reduces catastrophic forgetting of the initial task, while still retaining comparable if not better performance on the new task.
△ Less
Submitted 28 November, 2017;
originally announced November 2017.
-
Space as an invention of biological organisms
Authors:
Alexander V. Terekhov,
J. Kevin O'Regan
Abstract:
The question of the nature of space around us has occupied thinkers since the dawn of humanity, with scientists and philosophers today implicitly assuming that space is something that exists objectively. Here we show that this does not have to be the case: the notion of space could emerge when biological organisms seek an economic representation of their sensorimotor flow. The emergence of spatial…
▽ More
The question of the nature of space around us has occupied thinkers since the dawn of humanity, with scientists and philosophers today implicitly assuming that space is something that exists objectively. Here we show that this does not have to be the case: the notion of space could emerge when biological organisms seek an economic representation of their sensorimotor flow. The emergence of spatial notions does not necessitate the existence of real physical space, but only requires the presence of sensorimotor invariants called `compensable' sensory changes. We show mathematically and then in simulations that naïve agents making no assumptions about the existence of space are able to learn these invariants and to build the abstract notion that physicists call rigid displacement, which is independent of what is being displaced. Rigid displacements may underly perception of space as an unchanging medium within which objects are described by their relative positions. Our findings suggest that the question of the nature of space, currently exclusive to philosophy and physics, should also be addressed from the standpoint of neuroscience and artificial intelligence.
△ Less
Submitted 9 August, 2013;
originally announced August 2013.
