-
Model-Based Imitation Learning for Urban Driving
Authors:
Anthony Hu,
Gianluca Corrado,
Nicolas Griffiths,
Zak Murez,
Corina Gurau,
Hudson Yeo,
Alex Kendall,
Roberto Cipolla,
Jamie Shotton
Abstract:
An accurate model of the environment and the dynamic agents acting in it offers great potential for improving motion planning. We present MILE: a Model-based Imitation LEarning approach to jointly learn a model of the world and a policy for autonomous driving. Our method leverages 3D geometry as an inductive bias and learns a highly compact latent space directly from high-resolution videos of expe…
▽ More
An accurate model of the environment and the dynamic agents acting in it offers great potential for improving motion planning. We present MILE: a Model-based Imitation LEarning approach to jointly learn a model of the world and a policy for autonomous driving. Our method leverages 3D geometry as an inductive bias and learns a highly compact latent space directly from high-resolution videos of expert demonstrations. Our model is trained on an offline corpus of urban driving data, without any online interaction with the environment. MILE improves upon prior state-of-the-art by 31% in driving score on the CARLA simulator when deployed in a completely new town and new weather conditions. Our model can predict diverse and plausible states and actions, that can be interpretably decoded to bird's-eye view semantic segmentation. Further, we demonstrate that it can execute complex driving manoeuvres from plans entirely predicted in imagination. Our approach is the first camera-only method that models static scene, dynamic scene, and ego-behaviour in an urban driving environment. The code and model weights are available at https://github.com/wayveai/mile.
△ Less
Submitted 3 November, 2022; v1 submitted 14 October, 2022;
originally announced October 2022.
-
Conceptually Diverse Base Model Selection for Meta-Learners in Concept Drifting Data Streams
Authors:
Helen McKay,
Nathan Griffiths,
Phillip Taylor
Abstract:
Meta-learners and ensembles aim to combine a set of relevant yet diverse base models to improve predictive performance. However, determining an appropriate set of base models is challenging, especially in online environments where the underlying distribution of data can change over time. In this paper, we present a novel approach for estimating the conceptual similarity of base models, which is ca…
▽ More
Meta-learners and ensembles aim to combine a set of relevant yet diverse base models to improve predictive performance. However, determining an appropriate set of base models is challenging, especially in online environments where the underlying distribution of data can change over time. In this paper, we present a novel approach for estimating the conceptual similarity of base models, which is calculated using the Principal Angles (PAs) between their underlying subspaces. We propose two methods that use conceptual similarity as a metric to obtain a relevant yet diverse subset of base models: (i) parameterised threshold culling and (ii) parameterless conceptual clustering. We evaluate these methods against thresholding using common ensemble pruning metrics, namely predictive performance and Mutual Information (MI), in the context of online Transfer Learning (TL), using both synthetic and real-world data. Our results show that conceptual similarity thresholding has a reduced computational overhead, and yet yields comparable predictive performance to thresholding using predictive performance and MI. Furthermore, conceptual clustering achieves similar predictive performances without requiring parameterisation, and achieves this with lower computational overhead than thresholding using predictive performance and MI when the number of base models becomes large.
△ Less
Submitted 29 November, 2021;
originally announced November 2021.
-
Explaining reputation assessments
Authors:
Ingrid Nunes,
Phillip Taylor,
Lina Barakat,
Nathan Griffiths,
Simon Miles
Abstract:
Reputation is crucial to enabling human or software agents to select among alternative providers. Although several effective reputation assessment methods exist, they typically distil reputation into a numerical representation, with no accompanying explanation of the rationale behind the assessment. Such explanations would allow users or clients to make a richer assessment of providers, and tailor…
▽ More
Reputation is crucial to enabling human or software agents to select among alternative providers. Although several effective reputation assessment methods exist, they typically distil reputation into a numerical representation, with no accompanying explanation of the rationale behind the assessment. Such explanations would allow users or clients to make a richer assessment of providers, and tailor selection according to their preferences and current context. In this paper, we propose an approach to explain the rationale behind assessments from quantitative reputation models, by generating arguments that are combined to form explanations. Our approach adapts, extends and combines existing approaches for explaining decisions made using multi-attribute decision models in the context of reputation. We present example argument templates, and describe how to select their parameters using explanation algorithms. Our proposal was evaluated by means of a user study, which followed an existing protocol. Our results give evidence that although explanations present a subset of the information of trust scores, they are sufficient to equally evaluate providers recommended based on their trust score. Moreover, when explanation arguments reveal implicit model information, they are less persuasive than scores.
△ Less
Submitted 15 June, 2020;
originally announced June 2020.
-
kD-STR: A Method for Spatio-Temporal Data Reduction and Modelling
Authors:
Liam Steadman,
Nathan Griffiths,
Stephen Jarvis,
Mark Bell,
Shaun Helman,
Caroline Wallbank
Abstract:
Analysing and learning from spatio-temporal datasets is an important process in many domains, including transportation, healthcare and meteorology. In particular, data collected by sensors in the environment allows us to understand and model the processes acting within the environment. Recently, the volume of spatio-temporal data collected has increased significantly, presenting several challenges…
▽ More
Analysing and learning from spatio-temporal datasets is an important process in many domains, including transportation, healthcare and meteorology. In particular, data collected by sensors in the environment allows us to understand and model the processes acting within the environment. Recently, the volume of spatio-temporal data collected has increased significantly, presenting several challenges for data scientists. Methods are therefore needed to reduce the quantity of data that needs to be processed in order to analyse and learn from spatio-temporal datasets. In this paper, we present the k-Dimensional Spatio-Temporal Reduction method (kD-STR) for reducing the quantity of data used to store a dataset whilst enabling multiple types of analysis on the reduced dataset. kD-STR uses hierarchical partitioning to find spatio-temporal regions of similar instances and models the instances within each region to summarise the dataset. We demonstrate the generality of kD-STR with 3 datasets exhibiting different spatio-temporal characteristics and present results for a range of data modelling techniques. Finally, we compare kD-STR with other techniques for reducing the volume of spatio-temporal data. Our results demonstrate that kD-STR is effective in reducing spatio-temporal data and generalises to datasets that exhibit different properties.
△ Less
Submitted 16 May, 2020;
originally announced May 2020.
-
Urban Driving with Conditional Imitation Learning
Authors:
Jeffrey Hawke,
Richard Shen,
Corina Gurau,
Siddharth Sharma,
Daniele Reda,
Nikolay Nikolov,
Przemyslaw Mazur,
Sean Micklethwaite,
Nicolas Griffiths,
Amar Shah,
Alex Kendall
Abstract:
Hand-crafting generalised decision-making rules for real-world urban autonomous driving is hard. Alternatively, learning behaviour from easy-to-collect human driving demonstrations is appealing. Prior work has studied imitation learning (IL) for autonomous driving with a number of limitations. Examples include only performing lane-following rather than following a user-defined route, only using a…
▽ More
Hand-crafting generalised decision-making rules for real-world urban autonomous driving is hard. Alternatively, learning behaviour from easy-to-collect human driving demonstrations is appealing. Prior work has studied imitation learning (IL) for autonomous driving with a number of limitations. Examples include only performing lane-following rather than following a user-defined route, only using a single camera view or heavily cropped frames lacking state observability, only lateral (steering) control, but not longitudinal (speed) control and a lack of interaction with traffic. Importantly, the majority of such systems have been primarily evaluated in simulation - a simple domain, which lacks real-world complexities. Motivated by these challenges, we focus on learning representations of semantics, geometry and motion with computer vision for IL from human driving demonstrations. As our main contribution, we present an end-to-end conditional imitation learning approach, combining both lateral and longitudinal control on a real vehicle for following urban routes with simple traffic. We address inherent dataset bias by data balancing, training our final policy on approximately 30 hours of demonstrations gathered over six months. We evaluate our method on an autonomous vehicle by driving 35km of novel routes in European urban streets.
△ Less
Submitted 5 December, 2019; v1 submitted 30 November, 2019;
originally announced December 2019.
-
The Predictive Context Tree: Predicting Contexts and Interactions
Authors:
Alasdair Thomason,
Nathan Griffiths,
Victor Sanchez
Abstract:
With a large proportion of people carrying location-aware smartphones, we have an unprecedented platform from which to understand individuals and predict their future actions. This work builds upon the Context Tree data structure that summarises the historical contexts of individuals from augmented geospatial trajectories, and constructs a predictive model for their likely future contexts. The Pre…
▽ More
With a large proportion of people carrying location-aware smartphones, we have an unprecedented platform from which to understand individuals and predict their future actions. This work builds upon the Context Tree data structure that summarises the historical contexts of individuals from augmented geospatial trajectories, and constructs a predictive model for their likely future contexts. The Predictive Context Tree (PCT) is constructed as a hierarchical classifier, capable of predicting both the future locations that a user will visit and the contexts that a user will be immersed within. The PCT is evaluated over real-world geospatial trajectories, and compared against existing location extraction and prediction techniques, as well as a proposed hybrid approach that uses identified land usage elements in combination with machine learning to predict future interactions. Our results demonstrate that higher predictive accuracies can be achieved using this hybrid approach over traditional extracted location datasets, and the PCT itself matches the performance of the hybrid approach at predicting future interactions, while adding utility in the form of context predictions. Such a prediction system is capable of understanding not only where a user will visit, but also their context, in terms of what they are likely to be doing.
△ Less
Submitted 5 October, 2016;
originally announced October 2016.
-
Context Trees: Augmenting Geospatial Trajectories with Context
Authors:
Alasdair Thomason,
Nathan Griffiths,
Victor Sanchez
Abstract:
Exposing latent knowledge in geospatial trajectories has the potential to provide a better understanding of the movements of individuals and groups. Motivated by such a desire, this work presents the context tree, a new hierarchical data structure that summarises the context behind user actions in a single model. We propose a method for context tree construction that augments geospatial trajectori…
▽ More
Exposing latent knowledge in geospatial trajectories has the potential to provide a better understanding of the movements of individuals and groups. Motivated by such a desire, this work presents the context tree, a new hierarchical data structure that summarises the context behind user actions in a single model. We propose a method for context tree construction that augments geospatial trajectories with land usage data to identify such contexts. Through evaluation of the construction method and analysis of the properties of generated context trees, we demonstrate the foundation for understanding and modelling behaviour afforded. Summarising user contexts into a single data structure gives easy access to information that would otherwise remain latent, providing the basis for better understanding and predicting the actions and behaviours of individuals and groups. Finally, we also present a method for pruning context trees, for use in applications where it is desirable to reduce the size of the tree while retaining useful information.
△ Less
Submitted 14 June, 2016;
originally announced June 2016.
-
Deeper Into the Folksonomy Graph: FolkRank Adaptations and Extensions for Improved Tag Recommendations
Authors:
Nikolas Landia,
Stephan Doerfel,
Robert Jäschke,
Sarabjot Singh Anand,
Andreas Hotho,
Nathan Griffiths
Abstract:
The information contained in social tagging systems is often modelled as a graph of connections between users, items and tags. Recommendation algorithms such as FolkRank, have the potential to leverage complex relationships in the data, corresponding to multiple hops in the graph. We present an in-depth analysis and evaluation of graph models for social tagging data and propose novel adaptations a…
▽ More
The information contained in social tagging systems is often modelled as a graph of connections between users, items and tags. Recommendation algorithms such as FolkRank, have the potential to leverage complex relationships in the data, corresponding to multiple hops in the graph. We present an in-depth analysis and evaluation of graph models for social tagging data and propose novel adaptations and extensions of FolkRank to improve tag recommendations. We highlight implicit assumptions made by the widely used folksonomy model, and propose an alternative and more accurate graph-representation of the data. Our extensions of FolkRank address the new item problem by incorporating content data into the algorithm, and significantly improve prediction results on unpruned datasets. Our adaptations address issues in the iterative weight spreading calculation that potentially hinder FolkRank's ability to leverage the deep graph as an information source. Moreover, we evaluate the benefit of considering each deeper level of the graph, and present important insights regarding the characteristics of social tagging data in general. Our results suggest that the base assumption made by conventional weight propagation methods, that closeness in the graph always implies a positive relationship, does not hold for the social tagging domain.
△ Less
Submitted 5 October, 2013;
originally announced October 2013.
-
FUSE Observations of the Active Cool Star AB Doradus
Authors:
T. B. Ake,
A. K. Dupree,
P. R. Young,
J. L. Linsky,
R. F. Malina,
N. W. Griffiths,
O. H. W. Siegmund,
B. E. Woodgate
Abstract:
Far ultraviolet spectra were obtained of the active cool star AB Doradus (HD 36705) during the calibration and checkout period of the FUSE satellite. Observations in this early phase of the mission were taken at a resolving power of 12000-15000 (~20-25 km/s) and covered the spectral range 905-1187 A. The integrated spectrum exhibits strong, rotationally broadened stellar emission from C III (977…
▽ More
Far ultraviolet spectra were obtained of the active cool star AB Doradus (HD 36705) during the calibration and checkout period of the FUSE satellite. Observations in this early phase of the mission were taken at a resolving power of 12000-15000 (~20-25 km/s) and covered the spectral range 905-1187 A. The integrated spectrum exhibits strong, rotationally broadened stellar emission from C III (977, 1175) and O VI (1032, 1037), and many weaker lines. Strong emission lines of C III and O VI exhibit broad wings. The C III 977 profile shows blue-shifted absorption at ~30 km/s and C II 1036 absorption appears superposed on emission in the wing of O VI 1037. Rotational modulation of C III and O VI is present, in harmony with its photometric variability. Flares were detected in the brightest lines and subexposures were analyzed to examine flux and profile variations. Downflows that extend to 600 km/s during a flare are found in the O VI profiles. These early observations demonstrate that FUSE will be an exceptional instrument for studying chromospheres in cool stars.
△ Less
Submitted 8 June, 2000;
originally announced June 2000.
