What type of inference is planning?
Authors:
Miguel Lázaro-Gredilla,
Li Yang Ku,
Kevin P. Murphy,
Dileep George
Abstract:
Multiple types of inference are available for probabilistic graphical models, e.g., marginal, maximum-a-posteriori, and even marginal maximum-a-posteriori. Which one do researchers mean when they talk about "planning as inference"? There is no consistency in the literature, different types are used, and their ability to do planning is further entangled with specific approximations or additional co…
▽ More
Multiple types of inference are available for probabilistic graphical models, e.g., marginal, maximum-a-posteriori, and even marginal maximum-a-posteriori. Which one do researchers mean when they talk about "planning as inference"? There is no consistency in the literature, different types are used, and their ability to do planning is further entangled with specific approximations or additional constraints. In this work we use the variational framework to show that all commonly used types of inference correspond to different weightings of the entropy terms in the variational problem, and that planning corresponds _exactly_ to a _different_ set of weights. This means that all the tricks of variational inference are readily applicable to planning. We develop an analogue of loopy belief propagation that allows us to perform approximate planning in factored state Markov decisions processes without incurring intractability due to the exponentially large state space. The variational perspective shows that the previous types of inference for planning are only adequate in environments with low stochasticity, and allows us to characterize each type by its own merits, disentangling the type of inference from the additional approximations that its practical use requires. We validate these results empirically on synthetic MDPs and tasks posed in the International Planning Competition.
△ Less
Submitted 25 June, 2024;
originally announced June 2024.
Associating Grasp Configurations with Hierarchical Features in Convolutional Neural Networks
Authors:
Li Yang Ku,
Erik Learned-Miller,
Rod Grupen
Abstract:
In this work, we provide a solution for posturing the anthropomorphic Robonaut-2 hand and arm for gras** based on visual information. A map** from visual features extracted from a convolutional neural network (CNN) to grasp points is learned. We demonstrate that a CNN pre-trained for image classification can be applied to a gras** task based on a small set of gras** examples. Our approach…
▽ More
In this work, we provide a solution for posturing the anthropomorphic Robonaut-2 hand and arm for gras** based on visual information. A map** from visual features extracted from a convolutional neural network (CNN) to grasp points is learned. We demonstrate that a CNN pre-trained for image classification can be applied to a gras** task based on a small set of gras** examples. Our approach takes advantage of the hierarchical nature of the CNN by identifying features that capture the hierarchical support relations between filters in different CNN layers and locating their 3D positions by tracing activations backwards in the CNN. When this backward trace terminates in the RGB-D image, important manipulable structures are thereby localized. These features that reside in different layers of the CNN are then associated with controllers that engage different kinematic subchains in the hand/arm system for gras**. A gras** dataset is collected using demonstrated hand/object relationships for Robonaut-2 to evaluate the proposed approach in terms of the precision of the resulting preshape postures. We demonstrate that this approach outperforms baseline approaches in cluttered scenarios on the gras** dataset and a point cloud based approach on a gras** task using Robonaut-2.
△ Less
Submitted 25 July, 2017; v1 submitted 13 September, 2016;
originally announced September 2016.
