-
Waiting Tables as a Robot Planning Problem
Authors:
Anahita Mohseni-Kabir,
Manuela Veloso,
Maxim Likhachev
Abstract:
We present how we formalize the waiting tables task in a restaurant as a robot planning problem. This formalization was used to test our recently developed algorithms that allow for optimal planning for achieving multiple independent tasks that are partially observable and evolve over time [1], [2].
We present how we formalize the waiting tables task in a restaurant as a robot planning problem. This formalization was used to test our recently developed algorithms that allow for optimal planning for achieving multiple independent tasks that are partially observable and evolve over time [1], [2].
△ Less
Submitted 21 May, 2021;
originally announced May 2021.
-
Theory and Analysis of Optimal Planning over Long and Infinite Horizons for Achieving Independent Partially-Observable Tasks that Evolve over Time
Authors:
Anahita Mohseni-Kabir,
Manuela Veloso,
Maxim Likhachev
Abstract:
We present the theoretical analysis and proofs of a recently developed algorithm that allows for optimal planning over long and infinite horizons for achieving multiple independent tasks that are partially observable and evolve over time.
We present the theoretical analysis and proofs of a recently developed algorithm that allows for optimal planning over long and infinite horizons for achieving multiple independent tasks that are partially observable and evolve over time.
△ Less
Submitted 24 February, 2021;
originally announced February 2021.
-
Percolation Thresholds for Robust Network Connectivity
Authors:
Arman Mohseni-Kabir,
Mihir Pant,
Don Towsley,
Saikat Guha,
Ananthram Swami
Abstract:
Communication networks, power grids, and transportation networks are all examples of networks whose performance depends on reliable connectivity of their underlying network components even in the presence of usual network dynamics due to mobility, node or edge failures, and varying traffic loads. Percolation theory quantifies the threshold value of a local control parameter such as a node occupati…
▽ More
Communication networks, power grids, and transportation networks are all examples of networks whose performance depends on reliable connectivity of their underlying network components even in the presence of usual network dynamics due to mobility, node or edge failures, and varying traffic loads. Percolation theory quantifies the threshold value of a local control parameter such as a node occupation (resp., deletion) probability or an edge activation (resp., removal) probability above (resp., below) which there exists a giant connected component (GCC), a connected component comprising of a number of occupied nodes and active edges whose size is proportional to the size of the network itself. Any pair of occupied nodes in the GCC is connected via at least one path comprised of active edges and occupied nodes. The mere existence of the GCC itself does not guarantee that the long-range connectivity would be robust, e.g., to random link or node failures due to network dynamics. In this paper, we explore new percolation thresholds that guarantee not only spanning network connectivity, but also robustness. We define and analyze four measures of robust network connectivity, explore their interrelationships, and numerically evaluate the respective robust percolation thresholds for the 2D square lattice.
△ Less
Submitted 25 June, 2020;
originally announced June 2020.
-
On the Performance Analysis of Epidemic Routing in Non-Sparse Delay Tolerant Networks
Authors:
Leila Rashidi,
Don Towsley,
Arman Mohseni-Kabir,
Ali Movaghar
Abstract:
We study the behavior of epidemic routing in a delay tolerant network as a function of node density. Focusing on the probability of successful delivery to a destination within a deadline (PS), we show that PS experiences a phase transition as node density increases. Specifically, we prove that PS exhibits a phase transition when nodes are placed according to a Poisson process and allowed to move a…
▽ More
We study the behavior of epidemic routing in a delay tolerant network as a function of node density. Focusing on the probability of successful delivery to a destination within a deadline (PS), we show that PS experiences a phase transition as node density increases. Specifically, we prove that PS exhibits a phase transition when nodes are placed according to a Poisson process and allowed to move according to independent and identical processes with limited speed. We then propose four fluid models to evaluate the performance of epidemic routing in non-sparse networks. A model is proposed for supercritical networks based on approximation of the infection rate as a function of time. Other models are based on the approximation of the pairwise infection rate. Two of them, one for subcritical networks and another for supercritical networks, use the pairwise infection rate as a function of the number of infected nodes. The other model uses pairwise infection rate as a function of time, and can be applied for both subcritical and supercritical networks achieving good accuracy. The model for subcritical networks is accurate when density is not close to the percolation critical density. Moreover, the models that target only supercritical regime are accurate.
△ Less
Submitted 12 February, 2020;
originally announced February 2020.
-
Interaction-Aware Multi-Agent Reinforcement Learning for Mobile Agents with Individual Goals
Authors:
Anahita Mohseni-Kabir,
David Isele,
Kikuo Fujimura
Abstract:
In a multi-agent setting, the optimal policy of a single agent is largely dependent on the behavior of other agents. We investigate the problem of multi-agent reinforcement learning, focusing on decentralized learning in non-stationary domains for mobile robot navigation. We identify a cause for the difficulty in training non-stationary policies: mutual adaptation to sub-optimal behaviors, and we…
▽ More
In a multi-agent setting, the optimal policy of a single agent is largely dependent on the behavior of other agents. We investigate the problem of multi-agent reinforcement learning, focusing on decentralized learning in non-stationary domains for mobile robot navigation. We identify a cause for the difficulty in training non-stationary policies: mutual adaptation to sub-optimal behaviors, and we use this to motivate a curriculum-based strategy for learning interactive policies. The curriculum has two stages. First, the agent leverages policy gradient algorithms to learn a policy that is capable of achieving multiple goals. Second, the agent learns a modifier policy to learn how to interact with other agents in a multi-agent setting. We evaluated our approach on both an autonomous driving lane-change domain and a robot navigation domain.
△ Less
Submitted 27 September, 2019;
originally announced September 2019.
-
Quantum Walk Inspired Neural Networks for Graph-Structured Data
Authors:
Stefan Dernbach,
Arman Mohseni-Kabir,
Siddharth Pal,
Don Towsley,
Miles Gepner
Abstract:
In recent years, new neural network architectures designed to operate on graph-structured data have pushed the state-of-the-art in the field. A large set of these architectures utilize a form of classical random walks to diffuse information. We propose quantum walk neural networks (QWNN), a novel graph neural network architecture based on quantum random walks, the quantum parallel to classical ran…
▽ More
In recent years, new neural network architectures designed to operate on graph-structured data have pushed the state-of-the-art in the field. A large set of these architectures utilize a form of classical random walks to diffuse information. We propose quantum walk neural networks (QWNN), a novel graph neural network architecture based on quantum random walks, the quantum parallel to classical random walks. A QWNN learns a quantum walk on a graph to construct a diffusion operator which can then be applied to graph-structured data. We demonstrate the use of QWNNs on a variety of prediction tasks on graphs involving temperature, biological, and molecular datasets.
△ Less
Submitted 15 June, 2018; v1 submitted 16 January, 2018;
originally announced January 2018.
