-
Interactive Multi-Robot Flocking with Gesture Responsiveness and Musical Accompaniment
Authors:
Catie Cuan,
Kyle Jeffrey,
Kim Kleiven,
Adrian Li,
Emre Fisher,
Matt Harrison,
Benjie Holson,
Allison Okamura,
Matt Bennice
Abstract:
For decades, robotics researchers have pursued various tasks for multi-robot systems, from cooperative manipulation to search and rescue. These tasks are multi-robot extensions of classical robotic tasks and often optimized on dimensions such as speed or efficiency. As robots transition from commercial and research settings into everyday environments, social task aims such as engagement or enterta…
▽ More
For decades, robotics researchers have pursued various tasks for multi-robot systems, from cooperative manipulation to search and rescue. These tasks are multi-robot extensions of classical robotic tasks and often optimized on dimensions such as speed or efficiency. As robots transition from commercial and research settings into everyday environments, social task aims such as engagement or entertainment become increasingly relevant. This work presents a compelling multi-robot task, in which the main aim is to enthrall and interest. In this task, the goal is for a human to be drawn to move alongside and participate in a dynamic, expressive robot flock. Towards this aim, the research team created algorithms for robot movements and engaging interaction modes such as gestures and sound. The contributions are as follows: (1) a novel group navigation algorithm involving human and robot agents, (2) a gesture responsive algorithm for real-time, human-robot flocking interaction, (3) a weight mode characterization system for modifying flocking behavior, and (4) a method of encoding a choreographer's preferences inside a dynamic, adaptive, learned system. An experiment was performed to understand individual human behavior while interacting with the flock under three conditions: weight modes selected by a human choreographer, a learned model, or subset list. Results from the experiment showed that the perception of the experience was not influenced by the weight mode selection. This work elucidates how differing task aims such as engagement manifest in multi-robot system design and execution, and broadens the domain of multi-robot tasks.
△ Less
Submitted 30 March, 2024;
originally announced April 2024.
-
Responsive Operations for Key Services (ROKS): A Modular, Low SWaP Quantum Communications Payload
Authors:
Craig D. Colquhoun,
Hazel Jeffrey,
Steve Greenland,
Sonali Mohapatra,
Colin Aitken,
Mikulas Cebecauer,
Charlotte Crawshaw,
Kenny Jeffrey,
Toby Jeffreys,
Philippos Karagiannakis,
Ahren McTaggart,
Caitlin Stark,
Jack Wood,
Siddarth K. Joshi,
Jaya Sagar,
Elliott Hastings,
Peide Zhang,
Milan Stefko,
David Lowndes,
John G. Rarity,
Jasminder S. Sidhu,
Thomas Brougham,
Duncan McArthur,
Robert G. Pousa,
Daniel K. L. Oi
, et al. (3 additional authors not shown)
Abstract:
Quantum key distribution (QKD) is a theoretically proven future-proof secure encryption method that inherits its security from fundamental physical principles. Craft Prospect, working with a number of UK organisations, has been focused on miniaturising the technologies that enable QKD so that they may be used in smaller platforms including nanosatellites. The significant reduction of size, and the…
▽ More
Quantum key distribution (QKD) is a theoretically proven future-proof secure encryption method that inherits its security from fundamental physical principles. Craft Prospect, working with a number of UK organisations, has been focused on miniaturising the technologies that enable QKD so that they may be used in smaller platforms including nanosatellites. The significant reduction of size, and therefore the cost of launching quantum communication technologies either on a dedicated platform or hosted as part of a larger optical communications will improve potential access to quantum encryption on a relatively quick timescale. The ROKS mission seeks to be among the first to send a QKD payload on a CubeSat into low Earth orbit, demonstrating the capabilities of newly developed modular quantum technologies. The ROKS payload comprises a quantum source module that supplies photons randomly in any of four linear polarisation states fed from a quantum random number generator; an acquisition, pointing, and tracking system to fine-tune alignment of the quantum source beam with an optical ground station; an imager that will detect cloud cover autonomously; and an onboard computer that controls and monitors the other modules, which manages the payload and assures the overall performance and security of the system. Each of these modules have been developed with low SWaP for CubeSats, but with interoperability in mind for other satellite form factors. We present each of the listed components, together with the initial test results from our test bench and the performance of our protoflight models prior to initial integration with the 6U CubeSat platform systems. The completed ROKS payload will be ready for flight at the end of 2022, with various modular components already being baselined for flight and integrated into third party communication missions.
△ Less
Submitted 20 October, 2022;
originally announced October 2022.
-
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Authors:
Michael Ahn,
Anthony Brohan,
Noah Brown,
Yevgen Chebotar,
Omar Cortes,
Byron David,
Chelsea Finn,
Chuyuan Fu,
Keerthana Gopalakrishnan,
Karol Hausman,
Alex Herzog,
Daniel Ho,
Jasmine Hsu,
Julian Ibarz,
Brian Ichter,
Alex Irpan,
Eric Jang,
Rosario Jauregui Ruano,
Kyle Jeffrey,
Sally Jesmonth,
Nikhil J Joshi,
Ryan Julian,
Dmitry Kalashnikov,
Yuheng Kuang,
Kuang-Huei Lee
, et al. (20 additional authors not shown)
Abstract:
Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack real-world experience, which makes it difficult to leverage them for decision making within a given embo…
▽ More
Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack real-world experience, which makes it difficult to leverage them for decision making within a given embodiment. For example, asking a language model to describe how to clean a spill might result in a reasonable narrative, but it may not be applicable to a particular agent, such as a robot, that needs to perform this task in a particular environment. We propose to provide real-world grounding by means of pretrained skills, which are used to constrain the model to propose natural language actions that are both feasible and contextually appropriate. The robot can act as the language model's "hands and eyes," while the language model supplies high-level semantic knowledge about the task. We show how low-level skills can be combined with large language models so that the language model provides high-level knowledge about the procedures for performing complex and temporally-extended instructions, while value functions associated with these skills provide the grounding necessary to connect this knowledge to a particular physical environment. We evaluate our method on a number of real-world robotic tasks, where we show the need for real-world grounding and that this approach is capable of completing long-horizon, abstract, natural language instructions on a mobile manipulator. The project's website and the video can be found at https://say-can.github.io/.
△ Less
Submitted 16 August, 2022; v1 submitted 4 April, 2022;
originally announced April 2022.
