Skip to main content

Showing 1–22 of 22 results for author: Talak, R

.
  1. arXiv:2402.09382  [pdf, other

    cs.RO

    Safe Distributed Control of Multi-Robot Systems with Communication Delays

    Authors: Luca Ballotta, Rajat Talak

    Abstract: Safe operation of multi-robot systems is critical, especially in communication-degraded environments such as underwater for seabed map**, underground caves for navigation, and in extraterrestrial missions for assembly and construction. We address safety of networked autonomous systems where the information exchanged between robots incurs communication delays. We formalize a notion of distributed… ▽ More

    Submitted 25 May, 2024; v1 submitted 14 February, 2024; originally announced February 2024.

    Comments: This work has been submitted to IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

    MSC Class: 68T40 (Primary); 68M14; 68T07; 68W15 (Secondary) ACM Class: C.2.4; I.2.6; I.2.9; I.2.11; J.2

  2. arXiv:2305.07154  [pdf, other

    cs.RO

    Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systems

    Authors: Nathan Hughes, Yun Chang, Siyi Hu, Rajat Talak, Rumaisa Abdulhai, Jared Strader, Luca Carlone

    Abstract: 3D spatial perception is the problem of building and maintaining an actionable and persistent representation of the environment in real-time using sensor data and prior knowledge. Despite the fast-paced progress in robot perception, most existing methods either build purely geometric maps (as in traditional SLAM) or flat metric-semantic maps that do not scale to large environments or large diction… ▽ More

    Submitted 11 May, 2023; originally announced May 2023.

    Comments: 38 pages, 19 figures; submitted to International Journal of Robotics Research

  3. arXiv:2302.06019  [pdf, other

    cs.CV cs.LG cs.RO

    A Correct-and-Certify Approach to Self-Supervise Object Pose Estimators via Ensemble Self-Training

    Authors: **gnan Shi, Rajat Talak, Dominic Maggio, Luca Carlone

    Abstract: Real-world robotics applications demand object pose estimation methods that work reliably across a variety of scenarios. Modern learning-based approaches require large labeled datasets and tend to perform poorly outside the training domain. Our first contribution is to develop a robust corrector module that corrects pose estimates using depth information, thus enabling existing methods to better g… ▽ More

    Submitted 11 May, 2023; v1 submitted 12 February, 2023; originally announced February 2023.

  4. arXiv:2209.15428  [pdf, other

    cs.RO

    PyPose: A Library for Robot Learning with Physics-based Optimization

    Authors: Chen Wang, Dasong Gao, Kuan Xu, Junyi Geng, Yaoyu Hu, Yuheng Qiu, Bowen Li, Fan Yang, Brady Moon, Abhinav Pandey, Aryan, Jiahe Xu, Tianhao Wu, Haonan He, Daning Huang, Zhongqiang Ren, Shibo Zhao, Taimeng Fu, Pranay Reddy, Xiao Lin, Wenshan Wang, **gnan Shi, Rajat Talak, Kun Cao, Yi Du , et al. (12 additional authors not shown)

    Abstract: Deep learning has had remarkable success in robotic perception, but its data-centric nature suffers when it comes to generalizing to ever-changing environments. By contrast, physics-based optimization generalizes better, but it does not perform as well in complicated tasks due to the lack of high-level semantic information and reliance on manual parametric tuning. To take advantage of these two co… ▽ More

    Submitted 24 March, 2023; v1 submitted 30 September, 2022; originally announced September 2022.

    Comments: Project Website: https://pypose.org Documentation: https://pypose.org/docs/ Tutorial: https://pypose.org/tutorials/ Source code: https://github.com/pypose/pypose

    Journal ref: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023

  5. arXiv:2209.05629  [pdf, other

    cs.RO cs.CL cs.CV cs.LG

    Leveraging Large (Visual) Language Models for Robot 3D Scene Understanding

    Authors: William Chen, Siyi Hu, Rajat Talak, Luca Carlone

    Abstract: Abstract semantic 3D scene understanding is a problem of critical importance in robotics. As robots still lack the common-sense knowledge about household objects and locations of an average human, we investigate the use of pre-trained language models to impart common sense for scene understanding. We introduce and compare a wide range of scene classification paradigms that leverage language only (… ▽ More

    Submitted 8 November, 2023; v1 submitted 12 September, 2022; originally announced September 2022.

    Comments: arXiv admin note: text overlap with arXiv:2206.04585

  6. arXiv:2206.11215  [pdf, other

    cs.CV cs.LG cs.RO

    Certifiable 3D Object Pose Estimation: Foundations, Learning Models, and Self-Training

    Authors: Rajat Talak, Lisa Peng, Luca Carlone

    Abstract: We consider a certifiable object pose estimation problem, where -- given a partial point cloud of an object -- the goal is to not only estimate the object pose, but also to provide a certificate of correctness for the resulting estimate. Our first contribution is a general theory of certification for end-to-end perception models. In particular, we introduce the notion of $ζ$-correctness, which bou… ▽ More

    Submitted 28 April, 2023; v1 submitted 22 June, 2022; originally announced June 2022.

  7. arXiv:2206.04585  [pdf, other

    cs.RO cs.CL

    Extracting Zero-shot Common Sense from Large Language Models for Robot 3D Scene Understanding

    Authors: William Chen, Siyi Hu, Rajat Talak, Luca Carlone

    Abstract: Semantic 3D scene understanding is a problem of critical importance in robotics. While significant advances have been made in simultaneous localization and map** algorithms, robots are still far from having the common sense knowledge about household objects and their locations of an average human. We introduce a novel method for leveraging common sense embedded within large language models for l… ▽ More

    Submitted 18 June, 2022; v1 submitted 9 June, 2022; originally announced June 2022.

    Comments: 4 pages (excluding references and appendix), 2 figures, 2 tables. Submitted to Robotics: Science and Systems 2022 2nd Workshop on Scaling Robot Learning. Corrected typos and notation

  8. arXiv:2206.00777  [pdf

    cs.RO

    Visual Navigation for Autonomous Vehicles: An Open-source Hands-on Robotics Course at MIT

    Authors: Luca Carlone, Kasra Khosoussi, Vasileios Tzoumas, Golnaz Habibi, Markus Ryll, Rajat Talak, **gnan Shi, Pasquale Antonante

    Abstract: This paper reports on the development, execution, and open-sourcing of a new robotics course at MIT. The course is a modern take on "Visual Navigation for Autonomous Vehicles" (VNAV) and targets first-year graduate students and senior undergraduates with prior exposure to robotics. VNAV has the goal of preparing the students to perform research in robotics and vision-based navigation, with emphasi… ▽ More

    Submitted 1 June, 2022; originally announced June 2022.

    Comments: This paper has been accepted for publication at the IEEE Integrated STEM Education Conference

  9. arXiv:2111.09217  [pdf, other

    cs.NI

    Information Freshness in Multi-Hop Wireless Networks

    Authors: Vishrant Tripathi, Rajat Talak, Eytan Modiano

    Abstract: We consider the problem of minimizing age of information in multihop wireless networks and propose three classes of policies to solve the problem - stationary randomized, age difference, and age debt. For the unicast setting with fixed routes between each source-destination pair, we first develop a procedure to find age optimal Stationary Randomized policies. These policies are easy to implement a… ▽ More

    Submitted 17 November, 2021; originally announced November 2021.

    Comments: submitted to Transactions on Networking, conference versions published in Allerton 2017 and Infocom AoI workshop 2021. arXiv admin note: substantial text overlap with arXiv:2101.10225

  10. arXiv:2105.07264  [pdf, other

    cs.LG cs.CV cs.RO

    Neural Trees for Learning on Graphs

    Authors: Rajat Talak, Siyi Hu, Lisa Peng, Luca Carlone

    Abstract: Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their expressive power. In this work, we propose a new GNN architecture -- the Neural Tree. The neural tree architecture does not perform message passing on the input graph… ▽ More

    Submitted 27 October, 2021; v1 submitted 15 May, 2021; originally announced May 2021.

  11. arXiv:1911.05601  [pdf, other

    cs.NI cs.IT

    Age-Delay Tradeoffs in Queueing Systems

    Authors: Rajat Talak, Eytan Modiano

    Abstract: We consider an M server system in which each server can service at most one update packet at a time. The system designer controls (1) scheduling - the order in which the packets get serviced, (2) routing - the server that an arriving update packet joins for service, and (3) the service time distribution with fixed service rate. Given a fixed update generation process, we prove a strong age-delay a… ▽ More

    Submitted 11 November, 2019; originally announced November 2019.

    Comments: arXiv admin note: text overlap with arXiv:1810.04371

  12. arXiv:1909.10673  [pdf, other

    stat.ML cs.LG math.ST

    A Theory of Uncertainty Variables for State Estimation and Inference

    Authors: Rajat Talak, Sertac Karaman, Eytan Modiano

    Abstract: We develop a new framework of uncertainty variables to model uncertainty. An uncertainty variable is characterized by an uncertainty set, in which its realization is bound to lie, while the conditional uncertainty is characterized by a set map, from a given realization of a variable to a set of possible realizations of another variable. We prove Bayes' law and the law of total probability equivale… ▽ More

    Submitted 9 December, 2019; v1 submitted 23 September, 2019; originally announced September 2019.

  13. arXiv:1901.10463  [pdf, other

    cs.IT

    Age of Information for Discrete Time Queues

    Authors: Vishrant Tripathi, Rajat Talak, Eytan Modiano

    Abstract: Age of information (AoI) is a time-evolving measure of information freshness, that tracks the time since the last received fresh update was generated. Analyzing peak and average AoI, two time average metrics of AoI, for various continuous time queueing systems has received considerable attention. We analyze peak and average age for various discrete time queueing systems. We first consider first co… ▽ More

    Submitted 28 January, 2019; originally announced January 2019.

    Comments: arXiv admin note: text overlap with arXiv:1810.04371

  14. arXiv:1901.04167  [pdf, other

    cs.IT cs.NI

    Age-Delay Tradeoffs in Single Server Systems

    Authors: Rajat Talak, Eytan Modiano

    Abstract: Information freshness and low latency communication is important to many emerging applications. While Age of Information (AoI) serves as a metric of information freshness, packet delay is a traditional metric of communication latency. We prove that there is a natural tradeoff between the AoI and packet delay. We consider a single server system, in which at most one update packet can be serviced at… ▽ More

    Submitted 14 January, 2019; originally announced January 2019.

  15. arXiv:1901.02178  [pdf, other

    cs.IT cs.NI

    Age Optimal Information Gathering and Dissemination on Graphs

    Authors: Vishrant Tripathi, Rajat Talak, Eytan Modiano

    Abstract: We consider the problem of timely exchange of updates between a central station and a set of ground terminals $V$, via a mobile agent that traverses across the ground terminals along a mobility graph $G = (V, E)$. We design the trajectory of the mobile agent to minimize peak and average age of information (AoI), two newly proposed metrics for measuring timeliness of information. We consider random… ▽ More

    Submitted 8 January, 2019; originally announced January 2019.

  16. arXiv:1810.04371  [pdf, other

    cs.NI

    Can Determinacy Minimize Age of Information?

    Authors: Rajat Talak, Sertac Karaman, Eytan Modiano

    Abstract: Age-of-information (AoI) is a newly proposed performance metric of information freshness. It differs from the traditional delay metric, because it is destination centric and measures the time that elapsed since the last received fresh information update was generated at the source. AoI has been analyzed for several queueing models, and the problem of optimizing AoI over arrival and service rates h… ▽ More

    Submitted 14 January, 2019; v1 submitted 10 October, 2018; originally announced October 2018.

  17. arXiv:1805.06752  [pdf, other

    cs.NI

    Scheduling Policies for Age Minimization in Wireless Networks with Unknown Channel State

    Authors: Rajat Talak, Igor Kadota, Sertac Karaman, Eytan Modiano

    Abstract: Age of information (AoI) is a recently proposed metric that measures the time elapsed since the generation of the last received information update. We consider the problem of AoI minimization for a network under general interference constraints, and time varying channel. We study the case where the channel statistics are known, but the current channel state is unknown. We propose two scheduling po… ▽ More

    Submitted 15 May, 2018; originally announced May 2018.

    Comments: arXiv admin note: substantial text overlap with arXiv:1803.06471

  18. arXiv:1803.06471  [pdf, other

    cs.IT cs.NI

    Optimizing Age of Information in Wireless Networks with Perfect Channel State Information

    Authors: Rajat Talak, Sertac Karaman, Eytan Modiano

    Abstract: Age of information (AoI), defined as the time elapsed since the last received update was generated, is a newly proposed metric to measure the timeliness of information updates in a network. We consider AoI minimization problem for a network with general interference constraints, and time varying channels. We propose two policies, namely, virtual-queue based policy and age-based policy when the cha… ▽ More

    Submitted 17 March, 2018; originally announced March 2018.

  19. arXiv:1803.06469  [pdf, other

    cs.IT cs.NI

    Distributed Scheduling Algorithms for Optimizing Information Freshness in Wireless Networks

    Authors: Rajat Talak, Sertac Karaman, Eytan Modiano

    Abstract: Age of Information (AoI), measures the time elapsed since the last received information packet was generated at the source. We consider the problem of AoI minimization for single-hop flows in a wireless network, under pairwise interference constraints and time varying channel. We consider simple, yet broad, class of distributed scheduling policies, in which a transmission is attempted over each li… ▽ More

    Submitted 17 March, 2018; originally announced March 2018.

  20. arXiv:1803.06467  [pdf, other

    cs.IT cs.NI

    Optimizing Information Freshness in Wireless Networks under General Interference Constraints

    Authors: Rajat Talak, Sertac Karaman, Eytan Modiano

    Abstract: Age of information (AoI) is a recently proposed metric for measuring information freshness. AoI measures the time that elapsed since the last received update was generated. We consider the problem of minimizing average and peak AoI in a wireless networks, consisting of a set of source-destination links, under general interference constraints. When fresh information is always available for transmis… ▽ More

    Submitted 9 December, 2019; v1 submitted 17 March, 2018; originally announced March 2018.

  21. arXiv:1704.05986  [pdf, ps, other

    cs.GT

    Strategic Arrivals to Queues Offering Priority Service

    Authors: Rajat Talak, D. Manjunath, Alexandre Proutiere

    Abstract: We consider strategic arrivals to a FCFS service system that starts service at a fixed time and has to serve a fixed number of customers, e.g., an airplane boarding system. Arriving early induces a higher waiting cost (waiting before service begins) while arriving late induces a cost because earlier arrivals take the better seats. We first consider arrivals of heterogeneous customers that choose a… ▽ More

    Submitted 11 August, 2018; v1 submitted 19 April, 2017; originally announced April 2017.

  22. arXiv:1701.04130  [pdf, other

    cs.IT

    Capacity and Delay Scaling for Broadcast Transmission in Highly Mobile Wireless Networks

    Authors: Rajat Talak, Sertac Karaman, Eytan Modiano

    Abstract: We study broadcast capacity and minimum delay scaling laws for highly mobile wireless networks, in which each node has to disseminate or broadcast packets to all other nodes in the network. In particular, we consider a cell partitioned network under the simplified independent and identically distributed (IID) mobility model, in which each node chooses a new cell at random every time slot. We deriv… ▽ More

    Submitted 11 August, 2018; v1 submitted 15 January, 2017; originally announced January 2017.