-
Online Context Learning for Socially-compliant Navigation
Authors:
Iaroslav Okunevich,
Alexandre Lombard,
Tomas Krajnik,
Yassine Ruichek,
Zhi Yan
Abstract:
Robot social navigation needs to adapt to different human factors and environmental contexts. However, since these factors and contexts are difficult to predict and cannot be exhaustively enumerated, traditional learning-based methods have difficulty in ensuring the social attributes of robots in long-term and cross-environment deployments. This letter introduces an online context learning method…
▽ More
Robot social navigation needs to adapt to different human factors and environmental contexts. However, since these factors and contexts are difficult to predict and cannot be exhaustively enumerated, traditional learning-based methods have difficulty in ensuring the social attributes of robots in long-term and cross-environment deployments. This letter introduces an online context learning method that aims to empower robots to adapt to new social environments online. The proposed method adopts a two-layer structure. The bottom layer is built using a deep reinforcement learning-based method to ensure the output of basic robot navigation commands. The upper layer is implemented using an online robot learning-based method to socialize the control commands suggested by the bottom layer. Experiments using a community-wide simulator show that our method outperforms the state-of-the-art ones. Experimental results in the most challenging scenarios show that our method improves the performance of the state-of-the-art by 8%. The source code of the proposed method, the data used, and the tools for the per-training step will be publicly available at https://github.com/Nedzhaken/SOCSARL-OL.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
Benchmarks Underestimate the Readiness of Multi-lingual Dialogue Agents
Authors:
Andrew H. Lee,
Sina J. Semnani,
Galo Castillo-López,
Gäel de Chalendar,
Monojit Choudhury,
Ashna Dua,
Kapil Rajesh Kavitha,
Sungkyun Kim,
Prashant Kodali,
Ponnurangam Kumaraguru,
Alexis Lombard,
Mehrad Moradshahi,
Gihyun Park,
Nasredine Semmar,
Jiwon Seo,
Tianhao Shen,
Manish Shrivastava,
Deyi Xiong,
Monica S. Lam
Abstract:
Creating multilingual task-oriented dialogue (TOD) agents is challenging due to the high cost of training data acquisition. Following the research trend of improving training data efficiency, we show for the first time, that in-context learning is sufficient to tackle multilingual TOD.
To handle the challenging dialogue state tracking (DST) subtask, we break it down to simpler steps that are mor…
▽ More
Creating multilingual task-oriented dialogue (TOD) agents is challenging due to the high cost of training data acquisition. Following the research trend of improving training data efficiency, we show for the first time, that in-context learning is sufficient to tackle multilingual TOD.
To handle the challenging dialogue state tracking (DST) subtask, we break it down to simpler steps that are more compatible with in-context learning where only a handful of few-shot examples are used. We test our approach on the multilingual TOD dataset X-RiSAWOZ, which has 12 domains in Chinese, English, French, Korean, Hindi, and code-mixed Hindi-English. Our turn-by-turn DST accuracy on the 6 languages range from 55.6% to 80.3%, seemingly worse than the SOTA results from fine-tuned models that achieve from 60.7% to 82.8%; our BLEU scores in the response generation (RG) subtask are also significantly lower than SOTA.
However, after manual evaluation of the validation set, we find that by correcting gold label errors and improving dataset annotation schema, GPT-4 with our prompts can achieve (1) 89.6%-96.8% accuracy in DST, and (2) more than 99% correct response generation across different languages. This leads us to conclude that current automatic metrics heavily underestimate the effectiveness of in-context learning.
△ Less
Submitted 16 June, 2024; v1 submitted 28 May, 2024;
originally announced May 2024.
-
Very High Resolution Land Cover Map** of Urban Areas at Global Scale with Convolutional Neural Networks
Authors:
Thomas Tilak,
Arnaud Braun,
David Chandler,
Nicolas David,
Sylvain Galopin,
Amélie Lombard,
Michaël Michaud,
Camille Parisel,
Matthieu Porte,
Marjorie Robert
Abstract:
This paper describes a methodology to produce a 7-classes land cover map of urban areas from very high resolution images and limited noisy labeled data. The objective is to make a segmentation map of a large area (a french department) with the following classes: asphalt, bare soil, building, grassland, mineral material (permeable artificialized areas), forest and water from 20cm aerial images and…
▽ More
This paper describes a methodology to produce a 7-classes land cover map of urban areas from very high resolution images and limited noisy labeled data. The objective is to make a segmentation map of a large area (a french department) with the following classes: asphalt, bare soil, building, grassland, mineral material (permeable artificialized areas), forest and water from 20cm aerial images and Digital Height Model. We created a training dataset on a few areas of interest aggregating databases, semi-automatic classification, and manual annotation to get a complete ground truth in each class. A comparative study of different encoder-decoder architectures (U-Net, U-Net with Resnet encoders, Deeplab v3+) is presented with different loss functions. The final product is a highly valuable land cover map computed from model predictions stitched together, binarized, and refined before vectorization.
△ Less
Submitted 12 May, 2020;
originally announced May 2020.
-
AI-Driven CT-based quantification, staging and short-term outcome prediction of COVID-19 pneumonia
Authors:
Guillaume Chassagnon,
Maria Vakalopoulou,
Enzo Battistella,
Stergios Christodoulidis,
Trieu-Nghi Hoang-Thi,
Severine Dangeard,
Eric Deutsch,
Fabrice Andre,
Enora Guillo,
Nara Halm,
Stefany El Hajj,
Florian Bompard,
Sophie Neveu,
Chahinez Hani,
Ines Saab,
Alienor Campredon,
Hasmik Koulakian,
Souhail Bennani,
Gael Freche,
Aurelien Lombard,
Laure Fournier,
Hippolyte Monnier,
Teodor Grand,
Jules Gregory,
Antoine Khalil
, et al. (6 additional authors not shown)
Abstract:
Chest computed tomography (CT) is widely used for the management of Coronavirus disease 2019 (COVID-19) pneumonia because of its availability and rapidity. The standard of reference for confirming COVID-19 relies on microbiological tests but these tests might not be available in an emergency setting and their results are not immediately available, contrary to CT. In addition to its role for early…
▽ More
Chest computed tomography (CT) is widely used for the management of Coronavirus disease 2019 (COVID-19) pneumonia because of its availability and rapidity. The standard of reference for confirming COVID-19 relies on microbiological tests but these tests might not be available in an emergency setting and their results are not immediately available, contrary to CT. In addition to its role for early diagnosis, CT has a prognostic role by allowing visually evaluating the extent of COVID-19 lung abnormalities. The objective of this study is to address prediction of short-term outcomes, especially need for mechanical ventilation. In this multi-centric study, we propose an end-to-end artificial intelligence solution for automatic quantification and prognosis assessment by combining automatic CT delineation of lung disease meeting performance of experts and data-driven identification of biomarkers for its prognosis. AI-driven combination of variables with CT-based biomarkers offers perspectives for optimal patient management given the shortage of intensive care beds and ventilators.
△ Less
Submitted 20 April, 2020;
originally announced April 2020.
-
Non-neurotoxic Nanodiamond Probes for Intraneuronal Temperature Map**
Authors:
David A. Simpson,
Emma Morrisroe,
Julia M. McCoey,
Alain H. Lombard,
Dulini C. Mendis,
Francois Treussart,
Liam T. Hall,
Steven Petrou,
Lloyd C. L. Hollenberg
Abstract:
Optical bio-markers have been used extensively for intracellular imaging with high spatial and temporal resolution. Extending the modality of these probes is a key driver in cell biology. In recent years, the NV centre in nanodiamond has emerged as a promising candidate for bio-imaging and bio-sensing with low cytotoxicity and stable photoluminescence. Here we study the electrophysiological effect…
▽ More
Optical bio-markers have been used extensively for intracellular imaging with high spatial and temporal resolution. Extending the modality of these probes is a key driver in cell biology. In recent years, the NV centre in nanodiamond has emerged as a promising candidate for bio-imaging and bio-sensing with low cytotoxicity and stable photoluminescence. Here we study the electrophysiological effects of this quantum probe in primary cortical neurons. Multi-electrode array (MEA) recordings across five replicate studies showed no statistically significant difference in 25 network parameters when nanodiamonds are added at varying concentrations over various time periods 12-36 hr. The physiological validation motivates the second part of the study which demonstrates how the quantum properties of these biomarkers can be used to report intracellular information beyond their location and movement. Using the optically detected magnetic resonance from the nitrogen vacancy defects within the nanodiamonds we demonstrate enhanced signal-to-noise imaging and temperature map** from thousands of nanodiamond probes simultaneously. This work establishes nanodiamonds as viable multi-functional intraneuronal sensors with nanoscale resolution, that may ultimately be used to detect magnetic and electrical activity at the membrane level in excitable cellular systems.
△ Less
Submitted 22 April, 2018;
originally announced April 2018.
-
Modelling the Time-dependent VRP through Open Data
Authors:
Augustin Lombard,
Simon Tamayo,
Frédéric Fontane
Abstract:
This paper presents an open data approach to model and solve the vehicle routing problem with time-dependent travel times (TDVRP). The proposed model is based on a multi-layer matrix composed of travel times, replacing the traditional distance matrix. Online cartography services are queried in order to build this matrix. Travel times are obtained for every step in the time discretization. Thus, th…
▽ More
This paper presents an open data approach to model and solve the vehicle routing problem with time-dependent travel times (TDVRP). The proposed model is based on a multi-layer matrix composed of travel times, replacing the traditional distance matrix. Online cartography services are queried in order to build this matrix. Travel times are obtained for every step in the time discretization. Thus, the model integrates the fact that the travel time between two points is modified during the time horizon. This model is applied to a medium-sized problem in the urban area of Paris using an enhanced Greedy Randomized Adaptive Search Procedure (GRASP). This work intends to build on the current state of the art by proposing a straightforward and open-access method to model and solve the VRP with traffic variability.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
Scanning nano-spin ensemble microscope for nanoscale magnetic and thermal imaging
Authors:
Jean-Philippe Tetienne,
Alain Lombard,
David A. Simpson,
Cameron Ritchie,
Jianing Lu,
Paul Mulvaney,
Lloyd C. L. Hollenberg
Abstract:
Quantum sensors based on solid-state spins provide tremendous opportunities in a wide range of fields from basic physics and chemistry to biomedical imaging. However, integrating them into a scanning probe microscope to enable practical, nanoscale quantum imaging is a highly challenging task. Recently, the use of single spins in diamond in conjunction with atomic force microscopy techniques has al…
▽ More
Quantum sensors based on solid-state spins provide tremendous opportunities in a wide range of fields from basic physics and chemistry to biomedical imaging. However, integrating them into a scanning probe microscope to enable practical, nanoscale quantum imaging is a highly challenging task. Recently, the use of single spins in diamond in conjunction with atomic force microscopy techniques has allowed significant progress towards this goal, but generalisation of this approach has so far been impeded by long acquisition times or by the absence of simultaneous topographic information. Here we report on a scanning quantum probe microscope which solves both issues, by employing a nano-spin ensemble hosted in a nanodiamond. This approach provides up to an order of magnitude gain in acquisition time, whilst preserving sub-100 nm spatial resolution both for the quantum sensor and topographic images. We demonstrate two applications of this microscope. We first image nanoscale clusters of maghemite particles through both spin resonance spectroscopy and spin relaxometry, under ambient conditions. Our images reveal fast magnetic field fluctuations in addition to a static component, indicating the presence of both superparamagnetic and ferromagnetic particles. We next demonstrate a new imaging modality where the nano-spin ensemble is used as a thermometer. We use this technique to map the photo-induced heating generated by laser irradiation of a single gold nanoparticle in a fluid environment. This work paves the way towards new applications of quantum probe microscopy such as thermal/magnetic imaging of operating microelectronic devices and magnetic detection of ion channels in cell membranes.
△ Less
Submitted 30 December, 2015; v1 submitted 2 September, 2015;
originally announced September 2015.
