Showing 1–42 of 42 results for author: Lee, T E

Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphs

Authors: Hao-Tien Lewis Chiang, Zhuo Xu, Zipeng Fu, Mithun George Jacob, Tingnan Zhang, Tsang-Wei Edward Lee, Wenhao Yu, Connor Schenck, David Rendleman, Dhruv Shah, Fei Xia, Jasmine Hsu, Jonathan Hoech, Pete Florence, Sean Kirmani, Sumeet Singh, Vikas Sindhwani, Carolina Parada, Chelsea Finn, Peng Xu, Sergey Levine, Jie Tan

Abstract: An elusive goal in navigation research is to build an intelligent agent that can understand multimodal instructions including natural language and image, and perform useful navigation. To achieve this, we study a widely useful category of navigation tasks we call Multimodal Instruction Navigation with demonstration Tours (MINT), in which the environment prior is provided through a previously recor… ▽ More An elusive goal in navigation research is to build an intelligent agent that can understand multimodal instructions including natural language and image, and perform useful navigation. To achieve this, we study a widely useful category of navigation tasks we call Multimodal Instruction Navigation with demonstration Tours (MINT), in which the environment prior is provided through a previously recorded demonstration video. Recent advances in Vision Language Models (VLMs) have shown a promising path in achieving this goal as it demonstrates capabilities in perceiving and reasoning about multimodal inputs. However, VLMs are typically trained to predict textual output and it is an open research question about how to best utilize them in navigation. To solve MINT, we present Mobility VLA, a hierarchical Vision-Language-Action (VLA) navigation policy that combines the environment understanding and common sense reasoning power of long-context VLMs and a robust low-level navigation policy based on topological graphs. The high-level policy consists of a long-context VLM that takes the demonstration tour video and the multimodal user instruction as input to find the goal frame in the tour video. Next, a low-level policy uses the goal frame and an offline constructed topological graph to generate robot actions at every timestep. We evaluated Mobility VLA in a 836m^2 real world environment and show that Mobility VLA has a high end-to-end success rates on previously unsolved multimodal instructions such as "Where should I return this?" while holding a plastic bin. A video demonstrating Mobility VLA can be found here: https://youtu.be/-Tof__Q8_5s △ Less

Submitted 12 July, 2024; v1 submitted 10 July, 2024; originally announced July 2024.

VADER: Visual Affordance Detection and Error Recovery for Multi Robot Human Collaboration

Authors: Michael Ahn, Montserrat Gonzalez Arenas, Matthew Bennice, Noah Brown, Christine Chan, Byron David, Anthony Francis, Gavin Gonzalez, Rainer Hessmer, Tomas Jackson, Nikhil J Joshi, Daniel Lam, Tsang-Wei Edward Lee, Alex Luong, Sharath Maddineni, Harsh Patel, Jodilyn Peralta, Jornell Quiambao, Diego Reyes, Rosario M Jauregui Ruano, Dorsa Sadigh, Pannag Sanketi, Leila Takayama, Pavel Vodenski, Fei Xia

Abstract: Robots today can exploit the rich world knowledge of large language models to chain simple behavioral skills into long-horizon tasks. However, robots often get interrupted during long-horizon tasks due to primitive skill failures and dynamic environments. We propose VADER, a plan, execute, detect framework with seeking help as a new skill that enables robots to recover and complete long-horizon ta… ▽ More Robots today can exploit the rich world knowledge of large language models to chain simple behavioral skills into long-horizon tasks. However, robots often get interrupted during long-horizon tasks due to primitive skill failures and dynamic environments. We propose VADER, a plan, execute, detect framework with seeking help as a new skill that enables robots to recover and complete long-horizon tasks with the help of humans or other robots. VADER leverages visual question answering (VQA) modules to detect visual affordances and recognize execution errors. It then generates prompts for a language model planner (LMP) which decides when to seek help from another robot or human to recover from errors in long-horizon task execution. We show the effectiveness of VADER with two long-horizon robotic tasks. Our pilot study showed that VADER is capable of performing complex long-horizon tasks by asking for help from another robot to clear a table. Our user study showed that VADER is capable of performing complex long-horizon tasks by asking for help from a human to clear a path. We gathered feedback from people (N=19) about the performance of the VADER performance vs. a robot that did not ask for help. https://google-vader.github.io/ △ Less

Submitted 30 May, 2024; v1 submitted 24 May, 2024; originally announced May 2024.

Comments: 9 pages, 4 figures

Learning to Learn Faster from Human Feedback with Language Model Predictive Control

Authors: Jacky Liang, Fei Xia, Wenhao Yu, Andy Zeng, Montserrat Gonzalez Arenas, Maria Attarian, Maria Bauza, Matthew Bennice, Alex Bewley, Adil Dostmohamed, Chuyuan Kelly Fu, Nimrod Gileadi, Marissa Giustina, Keerthana Gopalakrishnan, Leonard Hasenclever, Jan Humplik, Jasmine Hsu, Nikhil Joshi, Ben Jyenis, Chase Kew, Sean Kirmani, Tsang-Wei Edward Lee, Kuang-Huei Lee, Assaf Hurwitz Michaely, Joss Moore , et al. (25 additional authors not shown)

Abstract: Large language models (LLMs) have been shown to exhibit a wide range of capabilities, such as writing robot code from language commands -- enabling non-experts to direct robot behaviors, modify them based on feedback, or compose them to perform new tasks. However, these capabilities (driven by in-context learning) are limited to short-term interactions, where users' feedback remains relevant for o… ▽ More Large language models (LLMs) have been shown to exhibit a wide range of capabilities, such as writing robot code from language commands -- enabling non-experts to direct robot behaviors, modify them based on feedback, or compose them to perform new tasks. However, these capabilities (driven by in-context learning) are limited to short-term interactions, where users' feedback remains relevant for only as long as it fits within the context size of the LLM, and can be forgotten over longer interactions. In this work, we investigate fine-tuning the robot code-writing LLMs, to remember their in-context interactions and improve their teachability i.e., how efficiently they adapt to human inputs (measured by average number of corrections before the user considers the task successful). Our key observation is that when human-robot interactions are viewed as a partially observable Markov decision process (in which human language inputs are observations, and robot code outputs are actions), then training an LLM to complete previous interactions is training a transition dynamics model -- that can be combined with classic robotics techniques such as model predictive control (MPC) to discover shorter paths to success. This gives rise to Language Model Predictive Control (LMPC), a framework that fine-tunes PaLM 2 to improve its teachability on 78 tasks across 5 robot embodiments -- improving non-expert teaching success rates of unseen tasks by 26.9% while reducing the average number of human corrections from 2.4 to 1.9. Experiments show that LMPC also produces strong meta-learners, improving the success rate of in-context learning new tasks on unseen robot embodiments and APIs by 31.5%. See videos, code, and demos at: https://robot-teaching.github.io/. △ Less

Submitted 31 May, 2024; v1 submitted 17 February, 2024; originally announced February 2024.

PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs

Authors: Soroush Nasiriany, Fei Xia, Wenhao Yu, Ted Xiao, Jacky Liang, Ishita Dasgupta, Annie Xie, Danny Driess, Ayzaan Wahid, Zhuo Xu, Quan Vuong, Tingnan Zhang, Tsang-Wei Edward Lee, Kuang-Huei Lee, Peng Xu, Sean Kirmani, Yuke Zhu, Andy Zeng, Karol Hausman, Nicolas Heess, Chelsea Finn, Sergey Levine, Brian Ichter

Abstract: Vision language models (VLMs) have shown impressive capabilities across a variety of tasks, from logical reasoning to visual understanding. This opens the door to richer interaction with the world, for example robotic control. However, VLMs produce only textual outputs, while robotic control and other spatial tasks require outputting continuous coordinates, actions, or trajectories. How can we ena… ▽ More Vision language models (VLMs) have shown impressive capabilities across a variety of tasks, from logical reasoning to visual understanding. This opens the door to richer interaction with the world, for example robotic control. However, VLMs produce only textual outputs, while robotic control and other spatial tasks require outputting continuous coordinates, actions, or trajectories. How can we enable VLMs to handle such settings without fine-tuning on task-specific data? In this paper, we propose a novel visual prompting approach for VLMs that we call Prompting with Iterative Visual Optimization (PIVOT), which casts tasks as iterative visual question answering. In each iteration, the image is annotated with a visual representation of proposals that the VLM can refer to (e.g., candidate robot actions, localizations, or trajectories). The VLM then selects the best ones for the task. These proposals are iteratively refined, allowing the VLM to eventually zero in on the best available answer. We investigate PIVOT on real-world robotic navigation, real-world manipulation from images, instruction following in simulation, and additional spatial inference tasks such as localization. We find, perhaps surprisingly, that our approach enables zero-shot control of robotic systems without any robot training data, navigation in a variety of environments, and other capabilities. Although current performance is far from perfect, our work highlights potentials and limitations of this new regime and shows a promising approach for Internet-Scale VLMs in robotic and spatial reasoning domains. Website: pivot-prompt.github.io and HuggingFace: https://huggingface.co/spaces/pivot-prompt/pivot-prompt-demo. △ Less

Submitted 12 February, 2024; originally announced February 2024.

RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control

Authors: Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Xi Chen, Krzysztof Choromanski, Tianli Ding, Danny Driess, Avinava Dubey, Chelsea Finn, Pete Florence, Chuyuan Fu, Montse Gonzalez Arenas, Keerthana Gopalakrishnan, Kehang Han, Karol Hausman, Alexander Herzog, Jasmine Hsu, Brian Ichter, Alex Irpan, Nikhil Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Isabel Leal , et al. (29 additional authors not shown)

Abstract: We study how vision-language models trained on Internet-scale data can be incorporated directly into end-to-end robotic control to boost generalization and enable emergent semantic reasoning. Our goal is to enable a single end-to-end trained model to both learn to map robot observations to actions and enjoy the benefits of large-scale pretraining on language and vision-language data from the web.… ▽ More We study how vision-language models trained on Internet-scale data can be incorporated directly into end-to-end robotic control to boost generalization and enable emergent semantic reasoning. Our goal is to enable a single end-to-end trained model to both learn to map robot observations to actions and enjoy the benefits of large-scale pretraining on language and vision-language data from the web. To this end, we propose to co-fine-tune state-of-the-art vision-language models on both robotic trajectory data and Internet-scale vision-language tasks, such as visual question answering. In contrast to other approaches, we propose a simple, general recipe to achieve this goal: in order to fit both natural language responses and robotic actions into the same format, we express the actions as text tokens and incorporate them directly into the training set of the model in the same way as natural language tokens. We refer to such category of models as vision-language-action models (VLA) and instantiate an example of such a model, which we call RT-2. Our extensive evaluation (6k evaluation trials) shows that our approach leads to performant robotic policies and enables RT-2 to obtain a range of emergent capabilities from Internet-scale training. This includes significantly improved generalization to novel objects, the ability to interpret commands not present in the robot training data (such as placing an object onto a particular number or icon), and the ability to perform rudimentary reasoning in response to user commands (such as picking up the smallest or largest object, or the one closest to another object). We further show that incorporating chain of thought reasoning allows RT-2 to perform multi-stage semantic reasoning, for example figuring out which object to pick up for use as an improvised hammer (a rock), or which type of drink is best suited for someone who is tired (an energy drink). △ Less

Submitted 28 July, 2023; originally announced July 2023.

Comments: Website: https://robotics-transformer.github.io/

Principles and Guidelines for Evaluating Social Robot Navigation Algorithms

Authors: Anthony Francis, Claudia Pérez-D'Arpino, Chengshu Li, Fei Xia, Alexandre Alahi, Rachid Alami, Aniket Bera, Abhijat Biswas, Joydeep Biswas, Rohan Chandra, Hao-Tien Lewis Chiang, Michael Everett, Sehoon Ha, Justin Hart, Jonathan P. How, Haresh Karnan, Tsang-Wei Edward Lee, Luis J. Manso, Reuth Mirksy, Sören Pirk, Phani Teja Singamaneni, Peter Stone, Ada V. Taylor, Peter Trautman, Nathan Tsoi , et al. (6 additional authors not shown)

Abstract: A major challenge to deploying robots widely is navigation in human-populated environments, commonly referred to as social robot navigation. While the field of social navigation has advanced tremendously in recent years, the fair evaluation of algorithms that tackle social navigation remains hard because it involves not just robotic agents moving in static environments but also dynamic human agent… ▽ More A major challenge to deploying robots widely is navigation in human-populated environments, commonly referred to as social robot navigation. While the field of social navigation has advanced tremendously in recent years, the fair evaluation of algorithms that tackle social navigation remains hard because it involves not just robotic agents moving in static environments but also dynamic human agents and their perceptions of the appropriateness of robot behavior. In contrast, clear, repeatable, and accessible benchmarks have accelerated progress in fields like computer vision, natural language processing and traditional robot navigation by enabling researchers to fairly compare algorithms, revealing limitations of existing solutions and illuminating promising new directions. We believe the same approach can benefit social navigation. In this paper, we pave the road towards common, widely accessible, and repeatable benchmarking criteria to evaluate social robot navigation. Our contributions include (a) a definition of a socially navigating robot as one that respects the principles of safety, comfort, legibility, politeness, social competency, agent understanding, proactivity, and responsiveness to context, (b) guidelines for the use of metrics, development of scenarios, benchmarks, datasets, and simulators to evaluate social navigation, and (c) a design of a social navigation metrics framework to make it easier to compare results from different simulators, robots and datasets. △ Less

Submitted 19 September, 2023; v1 submitted 29 June, 2023; originally announced June 2023.

Comments: 42 pages, 11 figures, 6 tables

ACM Class: I.2.9

Learning by Doing: Controlling a Dynamical System using Causality, Control, and Reinforcement Learning

Authors: Sebastian Weichwald, Søren Wengel Mogensen, Tabitha Edith Lee, Dominik Baumann, Oliver Kroemer, Isabelle Guyon, Sebastian Trimpe, Jonas Peters, Niklas Pfister

Abstract: Questions in causality, control, and reinforcement learning go beyond the classical machine learning task of prediction under i.i.d. observations. Instead, these fields consider the problem of learning how to actively perturb a system to achieve a certain effect on a response variable. Arguably, they have complementary views on the problem: In control, one usually aims to first identify the system… ▽ More Questions in causality, control, and reinforcement learning go beyond the classical machine learning task of prediction under i.i.d. observations. Instead, these fields consider the problem of learning how to actively perturb a system to achieve a certain effect on a response variable. Arguably, they have complementary views on the problem: In control, one usually aims to first identify the system by excitation strategies to then apply model-based design techniques to control the system. In (non-model-based) reinforcement learning, one directly optimizes a reward. In causality, one focus is on identifiability of causal structure. We believe that combining the different views might create synergies and this competition is meant as a first step toward such synergies. The participants had access to observational and (offline) interventional data generated by dynamical systems. Track CHEM considers an open-loop problem in which a single impulse at the beginning of the dynamics can be set, while Track ROBO considers a closed-loop problem in which control variables can be set at each time step. The goal in both tracks is to infer controls that drive the system to a desired state. Code is open-sourced ( https://github.com/LearningByDoingCompetition/learningbydoing-comp ) to reproduce the winning solutions of the competition and to facilitate trying out new methods on the competition tasks. △ Less

Submitted 12 February, 2022; originally announced February 2022.

Comments: https://learningbydoingcompetition.github.io/

Causal Reasoning in Simulation for Structure and Transfer Learning of Robot Manipulation Policies

Authors: Tabitha Edith Lee, Jialiang Zhao, Amrita S. Sawhney, Siddharth Girdhar, Oliver Kroemer

Abstract: We present CREST, an approach for causal reasoning in simulation to learn the relevant state space for a robot manipulation policy. Our approach conducts interventions using internal models, which are simulations with approximate dynamics and simplified assumptions. These interventions elicit the structure between the state and action spaces, enabling construction of neural network policies with o… ▽ More We present CREST, an approach for causal reasoning in simulation to learn the relevant state space for a robot manipulation policy. Our approach conducts interventions using internal models, which are simulations with approximate dynamics and simplified assumptions. These interventions elicit the structure between the state and action spaces, enabling construction of neural network policies with only relevant states as input. These policies are pretrained using the internal model with domain randomization over the relevant states. The policy network weights are then transferred to the target domain (e.g., the real world) for fine tuning. We perform extensive policy transfer experiments in simulation for two representative manipulation tasks: block stacking and crate opening. Our policies are shown to be more robust to domain shifts, more sample efficient to learn, and scale to more complex settings with larger state spaces. We also show improved zero-shot sim-to-real transfer of our policies for the block stacking task. △ Less

Submitted 13 March, 2022; v1 submitted 30 March, 2021; originally announced March 2021.

Comments: Presented at the 2021 IEEE International Conference on Robotics and Automation (ICRA 2021). This version contains the camera-ready paper with supplementary materials and minor typo fixes. Project page: https://sites.google.com/view/crest-causal-struct-xfer-manip

Visual Identification of Articulated Object Parts

Authors: Vicky Zeng, Tabitha Edith Lee, Jacky Liang, Oliver Kroemer

Abstract: As autonomous robots interact and navigate around real-world environments such as homes, it is useful to reliably identify and manipulate articulated objects, such as doors and cabinets. Many prior works in object articulation identification require manipulation of the object, either by the robot or a human. While recent works have addressed predicting articulation types from visual observations… ▽ More As autonomous robots interact and navigate around real-world environments such as homes, it is useful to reliably identify and manipulate articulated objects, such as doors and cabinets. Many prior works in object articulation identification require manipulation of the object, either by the robot or a human. While recent works have addressed predicting articulation types from visual observations alone, they often assume prior knowledge of category-level kinematic motion models or sequence of observations where the articulated parts are moving according to their kinematic constraints. In this work, we propose FormNet, a neural network that identifies the articulation mechanisms between pairs of object parts from a single frame of an RGB-D image and segmentation masks. The network is trained on 100k synthetic images of 149 articulated objects from 6 categories. Synthetic images are rendered via a photorealistic simulator with domain randomization. Our proposed model predicts motion residual flows of object parts, and these flows are used to determine the articulation type and parameters. The network achieves an articulation type classification accuracy of 82.5% on novel object instances in trained categories. Experiments also show how this method enables generalization to novel categories and be applied to real-world images without fine-tuning. △ Less

Submitted 9 December, 2021; v1 submitted 1 December, 2020; originally announced December 2020.

Comments: Presented at the 2021 IEEE International Conference on Intelligent Robots and Systems (IROS 2021). This version contains the camera-ready paper with an appendix. Project page: https://sites.google.com/view/articulated-objects/home

Model-based Reinforcement Learning for Decentralized Multiagent Rendezvous

Authors: Rose E. Wang, J. Chase Kew, Dennis Lee, Tsang-Wei Edward Lee, Tingnan Zhang, Brian Ichter, Jie Tan, Aleksandra Faust

Abstract: Collaboration requires agents to align their goals on the fly. Underlying the human ability to align goals with other agents is their ability to predict the intentions of others and actively update their own plans. We propose hierarchical predictive planning (HPP), a model-based reinforcement learning method for decentralized multiagent rendezvous. Starting with pretrained, single-agent point to p… ▽ More Collaboration requires agents to align their goals on the fly. Underlying the human ability to align goals with other agents is their ability to predict the intentions of others and actively update their own plans. We propose hierarchical predictive planning (HPP), a model-based reinforcement learning method for decentralized multiagent rendezvous. Starting with pretrained, single-agent point to point navigation policies and using noisy, high-dimensional sensor inputs like lidar, we first learn via self-supervision motion predictions of all agents on the team. Next, HPP uses the prediction models to propose and evaluate navigation subgoals for completing the rendezvous task without explicit communication among agents. We evaluate HPP in a suite of unseen environments, with increasing complexity and numbers of obstacles. We show that HPP outperforms alternative reinforcement learning, path planning, and heuristic-based baselines on challenging, unseen environments. Experiments in the real world demonstrate successful transfer of the prediction models from sim to real world without any additional fine-tuning. Altogether, HPP removes the need for a centralized operator in multiagent systems by combining model-based RL and inference methods, enabling agents to dynamically align plans. △ Less

Submitted 9 November, 2020; v1 submitted 15 March, 2020; originally announced March 2020.

Comments: CoRL 2020. The video is available at: https://youtu.be/-ydXHUtPzWE

Camera-to-Robot Pose Estimation from a Single Image

Authors: Timothy E. Lee, Jonathan Tremblay, Thang To, Jia Cheng, Terry Mosier, Oliver Kroemer, Dieter Fox, Stan Birchfield

Abstract: We present an approach for estimating the pose of an external camera with respect to a robot using a single RGB image of the robot. The image is processed by a deep neural network to detect 2D projections of keypoints (such as joints) associated with the robot. The network is trained entirely on simulated data using domain randomization to bridge the reality gap. Perspective-n-point (PnP) is then… ▽ More We present an approach for estimating the pose of an external camera with respect to a robot using a single RGB image of the robot. The image is processed by a deep neural network to detect 2D projections of keypoints (such as joints) associated with the robot. The network is trained entirely on simulated data using domain randomization to bridge the reality gap. Perspective-n-point (PnP) is then used to recover the camera extrinsics, assuming that the camera intrinsics and joint configuration of the robot manipulator are known. Unlike classic hand-eye calibration systems, our method does not require an off-line calibration step. Rather, it is capable of computing the camera extrinsics from a single frame, thus opening the possibility of on-line calibration. We show experimental results for three different robots and camera sensors, demonstrating that our approach is able to achieve accuracy with a single frame that is comparable to that of classic off-line hand-eye calibration using multiple frames. With additional frames from a static pose, accuracy improves even further. Code, datasets, and pretrained models for three widely-used robot manipulators are made available. △ Less

Submitted 23 April, 2020; v1 submitted 20 November, 2019; originally announced November 2019.

Comments: ICRA 2020. Project page is at https://research.nvidia.com/publication/2020-03_DREAM

Neural Collision Clearance Estimator for Batched Motion Planning

Authors: J. Chase Kew, Brian Ichter, Maryam Bandari, Tsang-Wei Edward Lee, Aleksandra Faust

Abstract: We present a neural network collision checking heuristic, ClearanceNet, and a planning algorithm, CN-RRT. ClearanceNet learns to predict separation distance (minimum distance between robot and workspace) with respect to a workspace. CN-RRT then efficiently computes a motion plan by leveraging three key features of ClearanceNet. First, CN-RRT explores the space by expanding multiple nodes at the sa… ▽ More We present a neural network collision checking heuristic, ClearanceNet, and a planning algorithm, CN-RRT. ClearanceNet learns to predict separation distance (minimum distance between robot and workspace) with respect to a workspace. CN-RRT then efficiently computes a motion plan by leveraging three key features of ClearanceNet. First, CN-RRT explores the space by expanding multiple nodes at the same time, processing batches of thousands of collision checks. Second, CN-RRT adaptively relaxes its clearance requirements for more difficult problems. Third, to repair errors, CN-RRT shifts its nodes in the direction of ClearanceNet's gradient and repairs any residual errors with a traditional RRT, thus maintaining theoretical probabilistic completeness guarantees. In configuration spaces with up to 30 degrees of freedom, ClearanceNet achieves 845x speedup over traditional collision detection methods, while CN-RRT accelerates motion planning by up to 42% over a baseline and finds paths up to 36% more efficient. Experiments on an 11 degree of freedom robot in a cluttered environment confirm the method's feasibility on real robots. △ Less

Submitted 14 July, 2020; v1 submitted 14 October, 2019; originally announced October 2019.

Learned Critical Probabilistic Roadmaps for Robotic Motion Planning

Authors: Brian Ichter, Edward Schmerling, Tsang-Wei Edward Lee, Aleksandra Faust

Abstract: Sampling-based motion planning techniques have emerged as an efficient algorithmic paradigm for solving complex motion planning problems. These approaches use a set of probing samples to construct an implicit graph representation of the robot's state space, allowing arbitrarily accurate representations as the number of samples increases to infinity. In practice, however, solution trajectories only… ▽ More Sampling-based motion planning techniques have emerged as an efficient algorithmic paradigm for solving complex motion planning problems. These approaches use a set of probing samples to construct an implicit graph representation of the robot's state space, allowing arbitrarily accurate representations as the number of samples increases to infinity. In practice, however, solution trajectories only rely on a few critical states, often defined by structure in the state space (e.g., doorways). In this work we propose a general method to identify these critical states via graph-theoretic techniques (betweenness centrality) and learn to predict criticality from only local environment features. These states are then leveraged more heavily via global connections within a hierarchical graph, termed Critical Probabilistic Roadmaps. Critical PRMs are demonstrated to achieve up to three orders of magnitude improvement over uniform sampling, while preserving the guarantees and complexity of sampling-based motion planning. A video is available at https://youtu.be/AYoD-pGd9ms. △ Less

Submitted 8 October, 2019; originally announced October 2019.

Long Range Neural Navigation Policies for the Real World

Authors: Ayzaan Wahid, Alexander Toshev, Marek Fiser, Tsang-Wei Edward Lee

Abstract: Learned Neural Network based policies have shown promising results for robot navigation. However, most of these approaches fall short of being used on a real robot due to the extensive simulated training they require. These simulations lack the visuals and dynamics of the real world, which makes it infeasible to deploy on a real robot. We present a novel Neural Net based policy, NavNet, which allo… ▽ More Learned Neural Network based policies have shown promising results for robot navigation. However, most of these approaches fall short of being used on a real robot due to the extensive simulated training they require. These simulations lack the visuals and dynamics of the real world, which makes it infeasible to deploy on a real robot. We present a novel Neural Net based policy, NavNet, which allows for easy deployment on a real robot. It consists of two sub policies -- a high level policy which can understand real images and perform long range planning expressed in high level commands; a low level policy that can translate the long range plan into low level commands on a specific platform in a safe and robust manner. For every new deployment, the high level policy is trained on an easily obtainable scan of the environment modeling its visuals and layout. We detail the design of such an environment and how one can use it for training a final navigation policy. Further, we demonstrate a learned low-level policy. We deploy the model in a large office building and test it extensively, achieving $0.80$ success rate over long navigation runs and outperforming SLAM-based models in the same settings. △ Less

Submitted 28 August, 2019; v1 submitted 23 March, 2019; originally announced March 2019.

Long-Range Indoor Navigation with PRM-RL

Authors: Anthony Francis, Aleksandra Faust, Hao-Tien Lewis Chiang, Jasmine Hsu, J. Chase Kew, Marek Fiser, Tsang-Wei Edward Lee

Abstract: Long-range indoor navigation requires guiding robots with noisy sensors and controls through cluttered environments along paths that span a variety of buildings. We achieve this with PRM-RL, a hierarchical robot navigation method in which reinforcement learning agents that map noisy sensors to robot controls learn to solve short-range obstacle avoidance tasks, and then sampling-based planners map… ▽ More Long-range indoor navigation requires guiding robots with noisy sensors and controls through cluttered environments along paths that span a variety of buildings. We achieve this with PRM-RL, a hierarchical robot navigation method in which reinforcement learning agents that map noisy sensors to robot controls learn to solve short-range obstacle avoidance tasks, and then sampling-based planners map where these agents can reliably navigate in simulation; these roadmaps and agents are then deployed on robots, guiding them along the shortest path where the agents are likely to succeed. Here we use Probabilistic Roadmaps (PRMs) as the sampling-based planner, and AutoRL as the reinforcement learning method in the indoor navigation context. We evaluate the method in simulation for kinematic differential drive and kinodynamic car-like robots in several environments, and on differential-drive robots at three physical sites. Our results show PRM-RL with AutoRL is more successful than several baselines, is robust to noise, and can guide robots over hundreds of meters in the face of noise and obstacles in both simulation and on robots, including over 5.8 kilometers of physical robot navigation. Video: https://youtu.be/xN-OWX5gKvQ △ Less

Submitted 22 February, 2020; v1 submitted 25 February, 2019; originally announced February 2019.

Comments: Accepted to T-RO

An Evolutionary Game Theoretic Model of Rhino Horn Devaluation

Authors: Nikoleta E. Glynatsi, Vincent Knight, Tamsin E. Lee

Abstract: Rhino populations are at a critical level due to the demand for rhino horn and the subsequent poaching. Wildlife managers attempt to secure rhinos with approaches to devalue the horn, the most common of which is dehorning. Game theory has been used to examine the interaction of poachers and wildlife managers where a manager can either `dehorn' their rhinos or leave the horn attached and poachers m… ▽ More Rhino populations are at a critical level due to the demand for rhino horn and the subsequent poaching. Wildlife managers attempt to secure rhinos with approaches to devalue the horn, the most common of which is dehorning. Game theory has been used to examine the interaction of poachers and wildlife managers where a manager can either `dehorn' their rhinos or leave the horn attached and poachers may behave `selectively' or `indiscriminately'. The approach described in this paper builds on this previous work and investigates the interactions between the poachers. We build an evolutionary game theoretic model and determine which strategy is preferred by a poacher in various different populations of poachers. The purpose of this work is to discover whether conditions which encourage the poachers to behave selectively exist, that is, they only kill those rhinos with full horns. The analytical results show that full devaluation of all rhinos will likely lead to indiscriminate poaching. In turn it shows that devaluing of rhinos can only be effective when implemented along with a strong disincentive framework. This paper aims to contribute to the necessary research required for informed discussion about the lively debate on legalising rhino horn trade. △ Less

Submitted 12 October, 2018; v1 submitted 20 December, 2017; originally announced December 2017.

MSC Class: 91A22; 91A40; 91A80

Reply to Comment on "Anomalous Edge State in a Non-Hermitian Lattice"

Authors: Tony E. Lee

Abstract: The Comment by Xiong et al. (arXiv:1610.06275) criticizing my Letter [Phys. Rev. Lett. 116, 133903 (2016)] was rejected by Physical Review Letters. In this Reply, I show that all their claims are wrong. The Comment by Xiong et al. (arXiv:1610.06275) criticizing my Letter [Phys. Rev. Lett. 116, 133903 (2016)] was rejected by Physical Review Letters. In this Reply, I show that all their claims are wrong. △ Less

Submitted 1 November, 2016; originally announced November 2016.

Comments: 2 pages, 1 figure

Ion crystals in anharmonic traps

Authors: S. R. Bastin, Tony E. Lee

Abstract: There is currently intensive research into creating a large-scale quantum computer with trapped ions. It is well known that for a linear ion crystal in a harmonic potential, the ions near the center are more closely spaced compared to the ions near the ends. This is problematic as the number of ions increases. Here, we consider a linear ion crystal in an anharmonic potential that is purely quartic… ▽ More There is currently intensive research into creating a large-scale quantum computer with trapped ions. It is well known that for a linear ion crystal in a harmonic potential, the ions near the center are more closely spaced compared to the ions near the ends. This is problematic as the number of ions increases. Here, we consider a linear ion crystal in an anharmonic potential that is purely quartic in position. We find that the ions are more evenly spaced compared to the harmonic case. We develop a variational approach to calculate the properties of the ground state. We also characterize the zigzag transition in an anharmonic potential. △ Less

Submitted 11 January, 2017; v1 submitted 4 October, 2016; originally announced October 2016.

Comments: 5 pages, 5 figures

Journal ref: J. Appl. Phys. 121, 014312 (2017)

Floquet engineering from long-range to short-range interactions

Authors: Tony E. Lee

Abstract: Quantum simulators based on atoms or molecules often have long-range interactions due to dipolar or Coulomb interactions. We present a method based on Floquet engineering to turn a long-range interaction into a short-range one. By modulating a magnetic-field gradient with one or a few frequencies, one reshapes the interaction profile, such that the system behaves as if it only had nearest-neighbor… ▽ More Quantum simulators based on atoms or molecules often have long-range interactions due to dipolar or Coulomb interactions. We present a method based on Floquet engineering to turn a long-range interaction into a short-range one. By modulating a magnetic-field gradient with one or a few frequencies, one reshapes the interaction profile, such that the system behaves as if it only had nearest-neighbor interactions. Our approach works in both one and two dimensions and for both spin-1/2 and spin-1 systems. It does not require individual addressing, and is applicable to all experimental systems with long-range interactions: trapped ions, polar molecules, Rydberg atoms, nitrogen-vacancy centers, and cavity QED. Our approach allows one achieve a short-range interaction without relying on Hubbard superexchange. △ Less

Submitted 10 October, 2016; v1 submitted 3 August, 2016; originally announced August 2016.

Comments: 6 pages, 5 figures

Journal ref: Phys. Rev. A 94, 040701 (2016)

String order via Floquet interactions in atomic systems

Authors: Tony E. Lee, Yogesh N. Joglekar, Philip Richerme

Abstract: We study the transverse-field Ising model with interactions that are modulated in time. In a rotating frame, the system is described by a time-independent Hamiltonian with many-body interactions, similar to the cluster Hamiltonians of measurement-based quantum computing. In one dimension, there is a three-body interaction, which leads to string order instead of conventional magnetic order. We show… ▽ More We study the transverse-field Ising model with interactions that are modulated in time. In a rotating frame, the system is described by a time-independent Hamiltonian with many-body interactions, similar to the cluster Hamiltonians of measurement-based quantum computing. In one dimension, there is a three-body interaction, which leads to string order instead of conventional magnetic order. We show that the string order is robust to power-law interactions that decay with the cube of distance. In two and three dimensions, there are five- and seven-body interactions. We discuss adiabatic preparation of the ground state as well as experimental implementation with trapped ions, Rydberg atoms, and polar molecules. △ Less

Submitted 9 August, 2016; v1 submitted 18 May, 2016; originally announced May 2016.

Comments: 8 pages, 6 figures

Journal ref: Phys. Rev. A 94, 023610 (2016)

Anomalous edge state in a non-Hermitian lattice

Authors: Tony E. Lee

Abstract: We show that the bulk-boundary correspondence for topological insulators can be modified in the presence of non-Hermiticity. We consider a one-dimensional tight-binding model with gain and loss as well as long-range hop**. The system is described by a non-Hermitian Hamiltonian that encircles an exceptional point in momentum space. The winding number has a fractional value of 1/2. There is only o… ▽ More We show that the bulk-boundary correspondence for topological insulators can be modified in the presence of non-Hermiticity. We consider a one-dimensional tight-binding model with gain and loss as well as long-range hop**. The system is described by a non-Hermitian Hamiltonian that encircles an exceptional point in momentum space. The winding number has a fractional value of 1/2. There is only one dynamically stable zero-energy edge state due to the defectiveness of the Hamiltonian. This edge state is robust to disorder due to protection by a chiral symmetry. We also discuss experimental realization with arrays of coupled resonator optical waveguides. △ Less

Submitted 1 April, 2016; v1 submitted 16 March, 2016; originally announced March 2016.

Comments: 5 pages + appendix

Journal ref: Phys. Rev. Lett. 116, 133903 (2016)

PT-symmetric Rabi model: Perturbation theory

Authors: Tony E. Lee, Yogesh N. Joglekar

Abstract: We study a non-Hermitian version of the Rabi model, where a two-level system is periodically driven with an imaginary-valued drive strength, leading to alternating gain and loss. In the Floquet picture, the model exhibits PT symmetry, which can be broken when the drive is sufficiently strong. We derive the boundaries of the PT phase diagram for the different resonances by doing perturbation theory… ▽ More We study a non-Hermitian version of the Rabi model, where a two-level system is periodically driven with an imaginary-valued drive strength, leading to alternating gain and loss. In the Floquet picture, the model exhibits PT symmetry, which can be broken when the drive is sufficiently strong. We derive the boundaries of the PT phase diagram for the different resonances by doing perturbation theory beyond the rotating-wave approximation. For the main resonance, we show that the non-Hermitian analog of the Bloch-Siegert shift corresponds to maximal PT-breaking. For the higher-order resonances, we capture the boundaries to lowest order. We also solve the regime of high frequency by map** to the Wannier-Stark ladder. Our model can be experimentally realized in waveguides with spatially-modulated loss or in atoms with time-modulated spontaneous decay. △ Less

Submitted 8 October, 2015; v1 submitted 27 August, 2015; originally announced August 2015.

Comments: 8 pages, 6 figures

Journal ref: Phys. Rev. A 92, 042103 (2015)

$\mathcal{PT}$-breaking threshold in spatially asymmetric Aubry-Andre Harper models: hidden symmetry and topological states

Authors: Andrew K. Harter, Tony E. Lee, Yogesh N. Joglekar

Abstract: Aubry-Andre Harper (AAH) lattice models, characterized by reflection-asymmetric, sinusoidally varying nearest-neighbor tunneling profile, are well-known for their topological properties. We consider the fate of such models in the presence of balanced gain and loss potentials $\pm iγ$ located at reflection-symmetric sites. We predict that these models have a finite $\mathcal{PT}$ breaking threshold… ▽ More Aubry-Andre Harper (AAH) lattice models, characterized by reflection-asymmetric, sinusoidally varying nearest-neighbor tunneling profile, are well-known for their topological properties. We consider the fate of such models in the presence of balanced gain and loss potentials $\pm iγ$ located at reflection-symmetric sites. We predict that these models have a finite $\mathcal{PT}$ breaking threshold only for {\it specific locations} of the gain-loss potential, and uncover a hidden symmetry that is instrumental to the finite threshold strength. We also show that the topological edge-states remain robust in the $\mathcal{PT}$-symmetry broken phase. Our predictions substantially broaden the possible realizations of a $\mathcal{PT}$-symmetric system. △ Less

Submitted 4 May, 2016; v1 submitted 14 April, 2015; originally announced April 2015.

Comments: 8 pages, 5 figures

Journal ref: Phys. Rev. A 93, 062101 (2016)

Tachyon physics with trapped ions

Authors: Tony E. Lee, Unai Alvarez-Rodriguez, Xiao-Hang Cheng, Lucas Lamata, Enrique Solano

Abstract: It has been predicted that particles with imaginary mass, called tachyons, would be able to travel faster than the speed of light. There has not been any experimental evidence for tachyons occurring naturally. Here, we propose how to experimentally simulate Dirac tachyons with trapped ions. Quantum measurement on a Dirac particle simulated by a trapped ion causes it to have an imaginary mass so th… ▽ More It has been predicted that particles with imaginary mass, called tachyons, would be able to travel faster than the speed of light. There has not been any experimental evidence for tachyons occurring naturally. Here, we propose how to experimentally simulate Dirac tachyons with trapped ions. Quantum measurement on a Dirac particle simulated by a trapped ion causes it to have an imaginary mass so that it may travel faster than the effective speed of light. We show that a Dirac tachyon must have spinor-motion correlation in order to be superluminal. We also show that it exhibits significantly more Klein tunneling than a normal Dirac particle. We provide numerical simulations of realistic ion systems and show that our scheme is feasible with current technology. △ Less

Submitted 28 September, 2015; v1 submitted 23 March, 2015; originally announced March 2015.

Comments: 6 pages, 5 figures

Journal ref: Phys. Rev. A 92, 032129 (2015)

Transport of quantum excitations via local and nonlocal fluctuations

Authors: M. Zhang, Tony E. Lee, H. R. Sadeghpour

Abstract: In quantum systems, one usually seeks to minimize dephasing noise and disorder. The efficiency of transport in a quantum system is usually degraded by the presence of noise and disorder. However, it has been shown that the combination of the two can lead to significantly more efficiency than each by itself. Here, we consider how the addition of nonlocal noise, in the form of incoherent hop**, af… ▽ More In quantum systems, one usually seeks to minimize dephasing noise and disorder. The efficiency of transport in a quantum system is usually degraded by the presence of noise and disorder. However, it has been shown that the combination of the two can lead to significantly more efficiency than each by itself. Here, we consider how the addition of nonlocal noise, in the form of incoherent hop**, affects the transport efficiency. We show that incoherent hop** introduces additional local extrema in the efficiency function and investigate the crossover from a quantum random walk to a classical random walk. △ Less

Submitted 11 February, 2015; originally announced February 2015.

Limit cycle phase in driven-dissipative spin systems

Authors: Ching-Kit Chan, Tony E. Lee, Sarang Gopalakrishnan

Abstract: We explore the phase diagram of interacting spin-$1/2$ systems in the presence of anisotropic interactions, spontaneous decay and driving. We find a rich phase diagram featuring a limit cycle phase in which the magnetization oscillates in time. We analyze the spatio-temporal fluctuations of this limit cycle phase at the Gaussian level, and show that spatial fluctuations lead to quasi-long-range li… ▽ More We explore the phase diagram of interacting spin-$1/2$ systems in the presence of anisotropic interactions, spontaneous decay and driving. We find a rich phase diagram featuring a limit cycle phase in which the magnetization oscillates in time. We analyze the spatio-temporal fluctuations of this limit cycle phase at the Gaussian level, and show that spatial fluctuations lead to quasi-long-range limit cycle ordering for dimension $d = 2$. This result can be interpreted in terms of a spatio-temporal Goldstone mode corresponding to phase fluctuations of the limit cycle. We also demonstrate that the limit-cycle phase exhibits an asymmetric power spectrum measurable in fluorescence experiments. △ Less

Submitted 5 January, 2015; originally announced January 2015.

Comments: 9 pages, 6 figures

Journal ref: Phys. Rev. A 91, 051601 (2015)

Entanglement and spin squeezing in non-Hermitian phase transitions

Authors: Tony E. Lee, Florentin Reiter, Nimrod Moiseyev

Abstract: We show that non-Hermitian dynamics generate substantial entanglement in many-body systems. We consider the non-Hermitian Lipkin-Meshkov-Glick model and show that its phase transition occurs with maximum multiparticle entanglement: there is full N-particle entanglement at the transition, in contrast to the Hermitian case. The non-Hermitian model also exhibits more spin squeezing than the Hermitian… ▽ More We show that non-Hermitian dynamics generate substantial entanglement in many-body systems. We consider the non-Hermitian Lipkin-Meshkov-Glick model and show that its phase transition occurs with maximum multiparticle entanglement: there is full N-particle entanglement at the transition, in contrast to the Hermitian case. The non-Hermitian model also exhibits more spin squeezing than the Hermitian model, showing that non-Hermitian dynamics are useful for quantum metrology. Experimental implementations with trapped ions and cavity QED are discussed. △ Less

Submitted 17 December, 2014; v1 submitted 24 September, 2014; originally announced September 2014.

Comments: 5 pages + appendix

Journal ref: Phys. Rev. Lett. 113, 250401 (2014)

Dissipative phase transitions: Independent versus collective decay and spin squeezing

Authors: Tony E. Lee, Ching-Kit Chan, Susanne F. Yelin

Abstract: We study the XY model with infinite-range interactions (Lipkin-Meshkov-Glick model) in the presence of dissipation from spontaneous decay. We show that independent and collective decay lead to qualitatively different phase transitions of the steady state, even though the phase boundary is the same. Independent decay leads to a second-order phase transition to a ferromagnet, while collective decay… ▽ More We study the XY model with infinite-range interactions (Lipkin-Meshkov-Glick model) in the presence of dissipation from spontaneous decay. We show that independent and collective decay lead to qualitatively different phase transitions of the steady state, even though the phase boundary is the same. Independent decay leads to a second-order phase transition to a ferromagnet, while collective decay leads to a first-order transition to a time-dependent oscillatory phase. Then we show that the addition of a drive leads to infinite spin squeezing for collective decay in the thermodynamic limit. Our results can be experimentally seen in trapped-ion and cavity-QED experiments. △ Less

Submitted 13 November, 2014; v1 submitted 28 August, 2014; originally announced August 2014.

Comments: 9 pages, 6 figures

Journal ref: Phys. Rev. A 90, 052109 (2014)

Heralded magnetism in non-Hermitian atomic systems

Authors: Tony E. Lee, Ching-Kit Chan

Abstract: Quantum phase transitions are usually studied in terms of Hermitian Hamiltonians. However, cold-atom experiments are intrinsically non-Hermitian due to spontaneous decay. Here, we show that non-Hermitian systems exhibit quantum phase transitions that are beyond the paradigm of Hermitian physics. We consider the non-Hermitian XY model, which can be implemented using three-level atoms with spontaneo… ▽ More Quantum phase transitions are usually studied in terms of Hermitian Hamiltonians. However, cold-atom experiments are intrinsically non-Hermitian due to spontaneous decay. Here, we show that non-Hermitian systems exhibit quantum phase transitions that are beyond the paradigm of Hermitian physics. We consider the non-Hermitian XY model, which can be implemented using three-level atoms with spontaneous decay. We exactly solve the model in one dimension and show that there is a quantum phase transition from short-range order to quasi-long-range order despite the absence of a continuous symmetry in the Hamiltonian. The ordered phase has a frustrated spin pattern. The critical exponent $ν$ can be 1 or 1/2. Our results can be seen experimentally with trapped ions, cavity QED, and atoms in optical lattices. △ Less

Submitted 6 October, 2014; v1 submitted 26 February, 2014; originally announced February 2014.

Comments: 7 pages + appendix

Journal ref: Phys. Rev. X 4, 041001 (2014)

Entanglement tongue and quantum synchronization of disordered oscillators

Authors: Tony E. Lee, Ching-Kit Chan, Shenshen Wang

Abstract: We study the synchronization of dissipatively-coupled van der Pol oscillators in the quantum limit, when each oscillator is near its quantum ground state. Two quantum oscillators with different frequencies exhibit an entanglement tongue, which is the quantum analogue of an Arnold tongue. It means that the oscillators are entangled in steady state when the coupling strength is greater than a critic… ▽ More We study the synchronization of dissipatively-coupled van der Pol oscillators in the quantum limit, when each oscillator is near its quantum ground state. Two quantum oscillators with different frequencies exhibit an entanglement tongue, which is the quantum analogue of an Arnold tongue. It means that the oscillators are entangled in steady state when the coupling strength is greater than a critical value, and the critical coupling increases with detuning. An ensemble of many oscillators with random frequencies still exhibits a synchronization phase transition in the quantum limit, and we analytically calculate how the critical coupling depends on the frequency disorder. Our results can be experimentally observed with trapped ions or neutral atoms. △ Less

Submitted 31 January, 2014; v1 submitted 12 December, 2013; originally announced December 2013.

Comments: 11 pages, 5 figures

Journal ref: Phys. Rev. E 89, 022913 (2014)

Dissipative transverse-field Ising model: steady-state correlations and spin squeezing

Authors: Tony E. Lee, Ching-Kit Chan

Abstract: We study the transverse-field Ising model with infinite-range coupling and spontaneous emission on every site. We find that there is spin squeezing in steady state due to the presence of the transverse field. This means that there is still entanglement, despite the decoherence from spontaneous emission. We analytically calculate fluctuations beyond mean-field theory using a phase-space approach, w… ▽ More We study the transverse-field Ising model with infinite-range coupling and spontaneous emission on every site. We find that there is spin squeezing in steady state due to the presence of the transverse field. This means that there is still entanglement, despite the decoherence from spontaneous emission. We analytically calculate fluctuations beyond mean-field theory using a phase-space approach, which involves converting the master equation into a Fokker-Planck equation for the Wigner function. Our calculations are relevant to current experiments with trapped ions. △ Less

Submitted 30 October, 2013; v1 submitted 12 September, 2013; originally announced September 2013.

Comments: 9 pages, 3 figures

Journal ref: Phys. Rev. A 88, 063811 (2013)

Quantum synchronization of quantum van der Pol oscillators with trapped ions

Authors: Tony E. Lee, H. R. Sadeghpour

Abstract: Van der Pol oscillators are prototypical self-sustaining oscillators which have been used to model nonlinear processes in biological and other classical processes. In this work, we investigate how quantum fluctuations affect phase-locking in one or many van der Pol oscillators. We find that phase-locking is much more robust in the quantum model than in the equivalent classical model. Trapped-ion e… ▽ More Van der Pol oscillators are prototypical self-sustaining oscillators which have been used to model nonlinear processes in biological and other classical processes. In this work, we investigate how quantum fluctuations affect phase-locking in one or many van der Pol oscillators. We find that phase-locking is much more robust in the quantum model than in the equivalent classical model. Trapped-ion experiments are ideally suited to simulate van der Pol oscillators in the quantum regime via sideband heating and cooling of motional modes. We provide realistic experimental parameters for ${}^{171}\text{Yb}^+$ achievable with current technology. △ Less

Submitted 12 November, 2013; v1 submitted 26 June, 2013; originally announced June 2013.

Comments: 5 pages + appendix

Journal ref: Phys. Rev. Lett. 111, 234101 (2013)

Spatial correlations of one dimensional driven-dissipative systems of Rydberg atoms

Authors: Anzi Hu, Tony E. Lee, Charles W. Clark

Abstract: We consider a one-dimensional lattice of atoms with laser excitation to a Rydberg state and spontaneous emission. The atoms are coupled due to the dipole-dipole interaction of the Rydberg states. This driven-dissipative system has a broad range of non-equilibrium phases, such as antiferromagnetic ordering and bistability. Using the quantum trajectory method, we calculate the spatial correlation fu… ▽ More We consider a one-dimensional lattice of atoms with laser excitation to a Rydberg state and spontaneous emission. The atoms are coupled due to the dipole-dipole interaction of the Rydberg states. This driven-dissipative system has a broad range of non-equilibrium phases, such as antiferromagnetic ordering and bistability. Using the quantum trajectory method, we calculate the spatial correlation function throughout the parameter space for up to 20 lattice sites. We show that bistability significantly strengthens the spatial correlations and entanglement. △ Less

Submitted 16 September, 2013; v1 submitted 9 May, 2013; originally announced May 2013.

Comments: 6 pages,8 figures

Journal ref: Phys. Rev. A 88, 053627 (2013)

Unconventional magnetism via optical pum** of interacting spin systems

Authors: Tony E. Lee, Sarang Gopalakrishnan, Mikhail D. Lukin

Abstract: We consider strongly interacting systems of effective spins, subject to dissipative spin-flip processes associated with optical pum**. We predict the existence of novel magnetic phases in the steady-state of this system, which emerge due to the competition between coherent and dissipative processes. Specifically, for strongly anisotropic spin-spin interactions, we find ferromagnetic, antiferroma… ▽ More We consider strongly interacting systems of effective spins, subject to dissipative spin-flip processes associated with optical pum**. We predict the existence of novel magnetic phases in the steady-state of this system, which emerge due to the competition between coherent and dissipative processes. Specifically, for strongly anisotropic spin-spin interactions, we find ferromagnetic, antiferromagnetic, spin-density-wave, and staggered-XY steady states, which are separated by nonequilibrium phase transitions meeting at a Lifshitz point. These transitions are accompanied by quantum correlations, resulting in spin squeezing. Experimental implementations in ultracold atoms and trapped ions are discussed. △ Less

Submitted 19 June, 2013; v1 submitted 17 April, 2013; originally announced April 2013.

Comments: 5 pages + appendix

Journal ref: Phys. Rev. Lett. 110, 257204 (2013)

Quantum-classical transition of correlations of two coupled cavities

Authors: Tony E. Lee, M. C. Cross

Abstract: We study the difference between quantum and classical behavior in a pair of nonidentical cavities with second-harmonic generation. In the classical limit, each cavity has a limit-cycle solution, in which the photon number oscillates periodically in time. Coupling between the cavities leads to synchronization of the oscillations and classical correlations between the cavities. In the quantum limit,… ▽ More We study the difference between quantum and classical behavior in a pair of nonidentical cavities with second-harmonic generation. In the classical limit, each cavity has a limit-cycle solution, in which the photon number oscillates periodically in time. Coupling between the cavities leads to synchronization of the oscillations and classical correlations between the cavities. In the quantum limit, there are quantum correlations due to entanglement. The quantum correlations persist even when the cavities are far off resonance with each other, in stark contrast with the classical case. We also find that the quantum and classical limits are connected by an intermediate regime of almost no correlations. Our results can be extended to a wide variety of quantum models. △ Less

Submitted 3 September, 2013; v1 submitted 4 September, 2012; originally announced September 2012.

Comments: 6 pages, 7 figures

Journal ref: Phys. Rev. A 88, 013834 (2013)

Spatiotemporal dynamics of quantum jumps with Rydberg atoms

Authors: Tony E. Lee, M. C. Cross

Abstract: We study the nonequilibrium dynamics of quantum jumps in a one-dimensional chain of atoms. Each atom is driven on a strong transition to a short-lived state and on a weak transition to a metastable state. We choose the metastable state to be a Rydberg state so that when an atom jumps to the Rydberg state, it inhibits or enhances jumps in the neighboring atoms. This leads to rich spatiotemporal dyn… ▽ More We study the nonequilibrium dynamics of quantum jumps in a one-dimensional chain of atoms. Each atom is driven on a strong transition to a short-lived state and on a weak transition to a metastable state. We choose the metastable state to be a Rydberg state so that when an atom jumps to the Rydberg state, it inhibits or enhances jumps in the neighboring atoms. This leads to rich spatiotemporal dynamics that are visible in the fluorescence of the strong transition. △ Less

Submitted 24 May, 2012; v1 submitted 7 February, 2012; originally announced February 2012.

Comments: 10 pages

Journal ref: Phys. Rev. A 85, 063822 (2012)

Collective quantum jumps of Rydberg atoms

Authors: Tony E. Lee, H. Häffner, M. C. Cross

Abstract: We study an open quantum system of atoms with long-range Rydberg interaction, laser driving, and spontaneous emission. Over time, the system occasionally jumps between a state of low Rydberg population and a state of high Rydberg population. The jumps are inherently collective and in fact exist only for a large number of atoms. We explain how entanglement and quantum measurement enable the jumps,… ▽ More We study an open quantum system of atoms with long-range Rydberg interaction, laser driving, and spontaneous emission. Over time, the system occasionally jumps between a state of low Rydberg population and a state of high Rydberg population. The jumps are inherently collective and in fact exist only for a large number of atoms. We explain how entanglement and quantum measurement enable the jumps, which are otherwise classically forbidden. △ Less

Submitted 29 September, 2011; originally announced September 2011.

Comments: 4 pages

Journal ref: Phys. Rev. Lett. 108, 023602 (2012)

Antiferromagnetic phase transition in a nonequilibrium lattice of Rydberg atoms

Authors: Tony E. Lee, H. Häffner, M. C. Cross

Abstract: We study a driven-dissipative system of atoms in the presence of laser excitation to a Rydberg state and spontaneous emission. The atoms interact via the blockade effect, whereby an atom in the Rydberg state shifts the Rydberg level of neighboring atoms. We use mean-field theory to study how the Rydberg population varies in space. As the laser frequency changes, there is a continuous transition be… ▽ More We study a driven-dissipative system of atoms in the presence of laser excitation to a Rydberg state and spontaneous emission. The atoms interact via the blockade effect, whereby an atom in the Rydberg state shifts the Rydberg level of neighboring atoms. We use mean-field theory to study how the Rydberg population varies in space. As the laser frequency changes, there is a continuous transition between the uniform and antiferromagnetic phases. The nonequilibrium nature also leads to a novel oscillatory phase and bistability between the uniform and antiferromagnetic phases. △ Less

Submitted 10 August, 2011; v1 submitted 5 April, 2011; originally announced April 2011.

Comments: 4 pages + appendix

Journal ref: Phys. Rev. A 84, 031402(R) (2011)

Pattern formation with trapped ions

Authors: Tony E. Lee, M. C. Cross

Abstract: Ion traps are a versatile tool to study nonequilibrium statistical physics, due to the tunability of dissipation and nonlinearity. We propose an experiment with a chain of trapped ions, where dissipation is provided by laser heating and cooling, while nonlinearity is provided by trap anharmonicity and beam sha**. The collective dynamics are governed by an equation similar to the complex Ginzburg… ▽ More Ion traps are a versatile tool to study nonequilibrium statistical physics, due to the tunability of dissipation and nonlinearity. We propose an experiment with a chain of trapped ions, where dissipation is provided by laser heating and cooling, while nonlinearity is provided by trap anharmonicity and beam sha**. The collective dynamics are governed by an equation similar to the complex Ginzburg-Landau equation, except that the reactive nature of the coupling leads to qualitatively different behavior. The system has the unusual feature of being both oscillatory and excitable at the same time. We account for noise from spontaneous emission and find that the patterns are observable for realistic experimental parameters. Our scheme also allows controllable experiments with noise and quenched disorder. △ Less

Submitted 26 January, 2011; v1 submitted 15 November, 2010; originally announced November 2010.

Comments: 4 pages + appendix

Journal ref: Phys. Rev. Lett. 106, 143001 (2011)

Fabrication and heating rate study of microscopic surface electrode ion traps

Authors: N. Daniilidis, S. Narayanan, S. A. Möller, R. Clark, T. E. Lee, P. J. Leek, A. Wallraff, St. Schulz, F. Schmidt-Kaler, H. Häffner

Abstract: We report heating rate measurements in a microfabricated gold-on-sapphire surface electrode ion trap with trap** height of approximately 240 micron. Using the Doppler recooling method, we characterize the trap heating rates over an extended region of the trap. The noise spectral density of the trap falls in the range of noise spectra reported in ion traps at room temperature. We find that during… ▽ More We report heating rate measurements in a microfabricated gold-on-sapphire surface electrode ion trap with trap** height of approximately 240 micron. Using the Doppler recooling method, we characterize the trap heating rates over an extended region of the trap. The noise spectral density of the trap falls in the range of noise spectra reported in ion traps at room temperature. We find that during the first months of operation the heating rates increase by approximately one order of magnitude. The increase in heating rates is largest in the ion loading region of the trap, providing a strong hint that surface contamination plays a major role for excessive heating rates. We discuss data found in the literature and possible relation of anomalous heating to sources of noise and dissipation in other systems, namely impurity atoms adsorbed on metal surfaces and amorphous dielectrics. △ Less

Submitted 15 September, 2010; originally announced September 2010.

Comments: 17 pages, 5 figures

Vortices and the entrainment transition in the 2D Kuramoto model

Authors: Tony E. Lee, Heywood Tam, G. Refael, Jeffrey L. Rogers, M. C. Cross

Abstract: We study synchronization in the two-dimensional lattice of coupled phase oscillators with random intrinsic frequencies. When the coupling $K$ is larger than a threshold $K_E$, there is a macroscopic cluster of frequency-synchronized oscillators. We explain why the macroscopic cluster disappears at $K_E$. We view the system in terms of vortices, since cluster boundaries are delineated by the motion… ▽ More We study synchronization in the two-dimensional lattice of coupled phase oscillators with random intrinsic frequencies. When the coupling $K$ is larger than a threshold $K_E$, there is a macroscopic cluster of frequency-synchronized oscillators. We explain why the macroscopic cluster disappears at $K_E$. We view the system in terms of vortices, since cluster boundaries are delineated by the motion of these topological defects. In the entrained phase ($K>K_E$), vortices move in fixed paths around clusters, while in the unentrained phase ($K<K_E$), vortices sometimes wander off. These deviant vortices are responsible for the disappearance of the macroscopic cluster. The regularity of vortex motion is determined by whether clusters behave as single effective oscillators. The unentrained phase is also characterized by time-dependent cluster structure and the presence of chaos. Thus, the entrainment transition is actually an order-chaos transition. We present an analytical argument for the scaling $K_E\sim K_L$ for small lattices, where $K_L$ is the threshold for phase-locking. By also deriving the scaling $K_L\sim\log N$, we thus show that $K_E\sim\log N$ for small $N$, in agreement with numerics. In addition, we show how to use the linearized model to predict where vortices are generated. △ Less

Submitted 24 June, 2010; v1 submitted 17 June, 2010; originally announced June 2010.

Comments: 11 pages, 8 figures

Journal ref: Phys. Rev. E 82, 036202 (2010)

Universality in the one-dimensional chain of phase-coupled oscillators

Authors: Tony E. Lee, G. Refael, M. C. Cross, Oleg Kogan, Jeffrey L. Rogers

Abstract: We apply a recently developed renormalization group (RG) method to study synchronization in a one-dimensional chain of phase-coupled oscillators in the regime of weak randomness. The RG predicts how oscillators with randomly distributed frequencies and couplings form frequency-synchronized clusters. Although the RG was originally intended for strong randomness, i.e. for distributions with long t… ▽ More We apply a recently developed renormalization group (RG) method to study synchronization in a one-dimensional chain of phase-coupled oscillators in the regime of weak randomness. The RG predicts how oscillators with randomly distributed frequencies and couplings form frequency-synchronized clusters. Although the RG was originally intended for strong randomness, i.e. for distributions with long tails, we find good agreement with numerical simulations even in the regime of weak randomness. We use the RG flow to derive how the correlation length scales with the width of the coupling distribution in the limit of large coupling. This leads to the identification of a universality class of distributions with the same critical exponent $ν$. We also find universal scaling for small coupling. Finally, we show that the RG flow is characterized by a universal approach to the unsynchronized fixed point, which provides physical insight into low-frequency clusters. △ Less

Submitted 16 September, 2009; v1 submitted 3 July, 2009; originally announced July 2009.

Comments: 14 pages, 10 figures

Journal ref: Phys. Rev. E 80, 046210 (2009)