-
Optical wavefront sha** in deep tissue using photoacoustic feedback
Authors:
Fei Xia,
Ivo Leite,
Robert Prevedel,
Thomas Chaigne
Abstract:
Over the past decade, optical wavefront sha** has been developed to focus light through highly opaque scattering layers, opening new possibilities for biomedical applications. To probe light intensity deep inside soft scattering media such as biological tissues, internal guide-stars are required. Here, we give an overview of the main principles and describe in depth the use of a photoacoustic fe…
▽ More
Over the past decade, optical wavefront sha** has been developed to focus light through highly opaque scattering layers, opening new possibilities for biomedical applications. To probe light intensity deep inside soft scattering media such as biological tissues, internal guide-stars are required. Here, we give an overview of the main principles and describe in depth the use of a photoacoustic feedback signal for this purpose. We further present first principles calculations and simulations to estimate important experimental parameters, and detailed instructions on designing and conducting these experiments. Finally, we provide guidance towards selecting suitable equipment for building a typical experimental setup, paving the way for further innovative biomedical imaging and therapy applications.
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
-
PREDILECT: Preferences Delineated with Zero-Shot Language-based Reasoning in Reinforcement Learning
Authors:
Simon Holk,
Daniel Marta,
Iolanda Leite
Abstract:
Preference-based reinforcement learning (RL) has emerged as a new field in robot learning, where humans play a pivotal role in sha** robot behavior by expressing preferences on different sequences of state-action pairs. However, formulating realistic policies for robots demands responses from humans to an extensive array of queries. In this work, we approach the sample-efficiency challenge by ex…
▽ More
Preference-based reinforcement learning (RL) has emerged as a new field in robot learning, where humans play a pivotal role in sha** robot behavior by expressing preferences on different sequences of state-action pairs. However, formulating realistic policies for robots demands responses from humans to an extensive array of queries. In this work, we approach the sample-efficiency challenge by expanding the information collected per query to contain both preferences and optional text prompting. To accomplish this, we leverage the zero-shot capabilities of a large language model (LLM) to reason from the text provided by humans. To accommodate the additional query information, we reformulate the reward learning objectives to contain flexible highlights -- state-action pairs that contain relatively high information and are related to the features processed in a zero-shot fashion from a pretrained LLM. In both a simulated scenario and a user study, we reveal the effectiveness of our work by analyzing the feedback and its implications. Additionally, the collective feedback collected serves to train a robot on socially compliant trajectories in a simulated social navigation landscape. We provide video examples of the trained policies at https://sites.google.com/view/rl-predilect
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Effects of Explanation Strategies to Resolve Failures in Human-Robot Collaboration
Authors:
Parag Khanna,
Elmira Yadollahi,
Mårten Björkman,
Iolanda Leite,
Christian Smith
Abstract:
Despite significant improvements in robot capabilities, they are likely to fail in human-robot collaborative tasks due to high unpredictability in human environments and varying human expectations. In this work, we explore the role of explanation of failures by a robot in a human-robot collaborative task. We present a user study incorporating common failures in collaborative tasks with human assis…
▽ More
Despite significant improvements in robot capabilities, they are likely to fail in human-robot collaborative tasks due to high unpredictability in human environments and varying human expectations. In this work, we explore the role of explanation of failures by a robot in a human-robot collaborative task. We present a user study incorporating common failures in collaborative tasks with human assistance to resolve the failure. In the study, a robot and a human work together to fill a shelf with objects. Upon encountering a failure, the robot explains the failure and the resolution to overcome the failure, either through handovers or humans completing the task. The study is conducted using different levels of robotic explanation based on the failure action, failure cause, and action history, and different strategies in providing the explanation over the course of repeated interaction. Our results show that the success in resolving the failures is not only a function of the level of explanation but also the type of failures. Furthermore, while novice users rate the robot higher overall in terms of their satisfaction with the explanation, their satisfaction is not only a function of the robot's explanation level at a certain round but also the prior information they received from the robot.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
A Systematic Review on Reproducibility in Child-Robot Interaction
Authors:
Micol Spitale,
Rebecca Stower,
Elmira Yadollahi,
Maria Teresa Parreira,
Nida Itrat Abbasi,
Iolanda Leite,
Hatice Gunes
Abstract:
Research reproducibility - i.e., rerunning analyses on original data to replicate the results - is paramount for guaranteeing scientific validity. However, reproducibility is often very challenging, especially in research fields where multi-disciplinary teams are involved, such as child-robot interaction (CRI). This paper presents a systematic review of the last three years (2020-2022) of research…
▽ More
Research reproducibility - i.e., rerunning analyses on original data to replicate the results - is paramount for guaranteeing scientific validity. However, reproducibility is often very challenging, especially in research fields where multi-disciplinary teams are involved, such as child-robot interaction (CRI). This paper presents a systematic review of the last three years (2020-2022) of research in CRI under the lens of reproducibility, by analysing the field for transparency in reporting. Across a total of 325 studies, we found deficiencies in reporting demographics (e.g. age of participants), study design and implementation (e.g. length of interactions), and open data (e.g. maintaining an active code repository). From this analysis, we distill a set of guidelines and provide a checklist to systematically report CRI studies to help and guide research to improve reproducibility in CRI and beyond.
△ Less
Submitted 4 September, 2023;
originally announced September 2023.
-
User Study Exploring the Role of Explanation of Failures by Robots in Human Robot Collaboration Tasks
Authors:
Parag Khanna,
Elmira Yadollahi,
Mårten Björkman,
Iolanda Leite,
Christian Smith
Abstract:
Despite great advances in what robots can do, they still experience failures in human-robot collaborative tasks due to high randomness in unstructured human environments. Moreover, a human's unfamiliarity with a robot and its abilities can cause such failures to repeat. This makes the ability to failure explanation very important for a robot. In this work, we describe a user study that incorporate…
▽ More
Despite great advances in what robots can do, they still experience failures in human-robot collaborative tasks due to high randomness in unstructured human environments. Moreover, a human's unfamiliarity with a robot and its abilities can cause such failures to repeat. This makes the ability to failure explanation very important for a robot. In this work, we describe a user study that incorporated different robotic failures in a human-robot collaboration (HRC) task aimed at filling a shelf. We included different types of failures and repeated occurrences of such failures in a prolonged interaction between humans and robots. The failure resolution involved human intervention in form of human-robot bidirectional handovers. Through such studies, we aim to test different explanation types and explanation progression in the interaction and record humans.
△ Less
Submitted 28 March, 2023;
originally announced March 2023.
-
Robot Duck Debugging: Can Attentive Listening Improve Problem Solving?
Authors:
Maria Teresa Parreira,
Sarah Gillet,
Iolanda Leite
Abstract:
While thinking aloud has been reported to positively affect problem-solving, the effects of the presence of an embodied entity (e.g., a social robot) to whom words can be directed remain mostly unexplored. In this work, we investigated the role of a robot in a "rubber duck debugging" setting, by analyzing how a robot's listening behaviors could support a thinking-aloud problem-solving session. Par…
▽ More
While thinking aloud has been reported to positively affect problem-solving, the effects of the presence of an embodied entity (e.g., a social robot) to whom words can be directed remain mostly unexplored. In this work, we investigated the role of a robot in a "rubber duck debugging" setting, by analyzing how a robot's listening behaviors could support a thinking-aloud problem-solving session. Participants completed two different tasks while speaking their thoughts aloud to either a robot or an inanimate object (a giant rubber duck). We implemented and tested two types of listener behavior in the robot: a rule-based heuristic and a deep-learning-based model. In a between-subject user study with 101 participants, we evaluated how the presence of a robot affected users' engagement in thinking aloud, behavior during the task, and self-reported user experience. In addition, we explored the impact of the two robot listening behaviors on those measures. In contrast to prior work, our results indicate that neither the rule-based heuristic nor the deep learning robot conditions improved performance or perception of the task, compared to an inanimate object. We discuss potential explanations and shed light on the feasibility of designing social robots as assistive tools in thinking-aloud problem-solving tasks.
△ Less
Submitted 18 January, 2023; v1 submitted 16 January, 2023;
originally announced January 2023.
-
Multi-messenger Emission from Tidal Waves in Neutron Star Oceans
Authors:
Andrew G. Sullivan,
Lucas M. B. Alves,
Georgina O. Spence,
Isabella P. Leite,
Doğa Veske,
Imre Bartos,
Zsuzsa Márka,
Szabolcs Márka
Abstract:
Neutron stars in astrophysical binary systems represent exciting sources for multi-messenger astrophysics. A potential source of electromagnetic transients from compact binary systems is the neutron star ocean, the external fluid layer encasing a neutron star. We present a groundwork study into tidal waves in neutron star oceans and their consequences. Specifically, we investigate how oscillation…
▽ More
Neutron stars in astrophysical binary systems represent exciting sources for multi-messenger astrophysics. A potential source of electromagnetic transients from compact binary systems is the neutron star ocean, the external fluid layer encasing a neutron star. We present a groundwork study into tidal waves in neutron star oceans and their consequences. Specifically, we investigate how oscillation modes in neutron star oceans can be tidally excited during compact binary inspirals and parabolic encounters. We find that neutron star oceans can sustain tidal waves with frequencies between $0.01-20$ Hz. Our results suggest that tidally resonant neutron star ocean waves may serve as a never-before studied source of precursor electromagnetic emission prior to neutron star-black hole and binary neutron star mergers. If accompanied by electromagnetic flares, tidally resonant neutron star ocean waves, whose energy budget can reach $10^{46}$ erg, may serve as early warning signs ($\gtrsim 1$ minute before merger) for compact binary mergers. Similarly, excited ocean tidal waves will coincide with neutron star parabolic encounters. Depending on the neutron star ocean model and a flare emission scenario, tidally resonant ocean flares may be detectable by Fermi and NuSTAR out to $\gtrsim 100$ Mpc with detection rates as high as $\sim 7$ yr$^{-1}$ for binary neutron stars and $\sim0.6$ yr$^{-1}$ for neutron star-black hole binaries. Observations of emission from neutron star ocean tidal waves along with gravitational waves will provide insight into the equation of state at the neutron star surface, the composition of neutron star oceans and crusts, and neutron star geophysics.
△ Less
Submitted 2 February, 2023; v1 submitted 26 May, 2022;
originally announced May 2022.
-
Interactive Disambiguation for Behavior Tree Execution
Authors:
Matteo Iovino,
Fethiye Irmak Doğan,
Iolanda Leite,
Christian Smith
Abstract:
In recent years, robots are used in an increasing variety of tasks, especially by small- and medium- sized enterprises. These tasks are usually fast-changing, they have a collaborative scenario and happen in unpredictable environments with possible ambiguities. It is important to have methods capable of generating robot programs easily, that are made as general as possible by handling uncertaintie…
▽ More
In recent years, robots are used in an increasing variety of tasks, especially by small- and medium- sized enterprises. These tasks are usually fast-changing, they have a collaborative scenario and happen in unpredictable environments with possible ambiguities. It is important to have methods capable of generating robot programs easily, that are made as general as possible by handling uncertainties. We present a system that integrates a method to learn Behavior Trees (BTs) from demonstration for pick and place tasks, with a framework that uses verbal interaction to ask follow-up clarification questions to resolve ambiguities. During the execution of a task, the system asks for user input when there is need to disambiguate an object in the scene, when the targets of the task are objects of a same type that are present in multiple instances. The integrated system is demonstrated on different scenarios of a pick and place task, with increasing level of ambiguities. The code used for this paper is made publicly available.
△ Less
Submitted 10 March, 2022; v1 submitted 6 March, 2022;
originally announced March 2022.
-
The potential of artificial intelligence for achieving healthy and sustainable societies
Authors:
B. Sirmacek,
S. Gupta,
F. Mallor,
H. Azizpour,
Y. Ban,
H. Eivazi,
H. Fang,
F. Golzar,
I. Leite,
G. I. Melsion,
K. Smith,
F. Fuso Nerini,
R. Vinuesa
Abstract:
In this chapter we extend earlier work (Vinuesa et al., Nature Communications 11, 2020) on the potential of artificial intelligence (AI) to achieve the 17 Sustainable Development Goals (SDGs) proposed by the United Nations (UN) for the 2030 Agenda. The present contribution focuses on three SDGs related to healthy and sustainable societies, i.e. SDG 3 (on good health), SDG 11 (on sustainable cities…
▽ More
In this chapter we extend earlier work (Vinuesa et al., Nature Communications 11, 2020) on the potential of artificial intelligence (AI) to achieve the 17 Sustainable Development Goals (SDGs) proposed by the United Nations (UN) for the 2030 Agenda. The present contribution focuses on three SDGs related to healthy and sustainable societies, i.e. SDG 3 (on good health), SDG 11 (on sustainable cities) and SDG 13 (on climate action). This chapter extends the previous study within those three goals, and goes beyond the 2030 targets. These SDGs are selected because they are closely related to the coronavirus disease 19 (COVID-19) pandemic, and also to crises like climate change, which constitute important challenges to our society.
△ Less
Submitted 11 February, 2022;
originally announced February 2022.
-
Mechanical Chameleons: Evaluating the effects of a social robot's non-verbal behavior on social influence
Authors:
Patrik Jonell,
Anna Deichler,
Ilaria Torre,
Iolanda Leite,
Jonas Beskow
Abstract:
In this paper we present a pilot study which investigates how non-verbal behavior affects social influence in social robots. We also present a modular system which is capable of controlling the non-verbal behavior based on the interlocutor's facial gestures (head movements and facial expressions) in real time, and a study investigating whether three different strategies for facial gestures ("still…
▽ More
In this paper we present a pilot study which investigates how non-verbal behavior affects social influence in social robots. We also present a modular system which is capable of controlling the non-verbal behavior based on the interlocutor's facial gestures (head movements and facial expressions) in real time, and a study investigating whether three different strategies for facial gestures ("still", "natural movement", i.e. movements recorded from another conversation, and "copy", i.e. mimicking the user with a four second delay) has any affect on social influence and decision making in a "survival task". Our preliminary results show there was no significant difference between the three conditions, but this might be due to among other things a low number of study participants (12).
△ Less
Submitted 2 September, 2021;
originally announced September 2021.
-
Leveraging Explainability for Comprehending Referring Expressions in the Real World
Authors:
Fethiye Irmak Dogan,
Gaspar I. Melsion,
Iolanda Leite
Abstract:
For effective human-robot collaboration, it is crucial for robots to understand requests from users and ask reasonable follow-up questions when there are ambiguities. While comprehending the users' object descriptions in the requests, existing studies have focused on this challenge for limited object categories that can be detected or localized with existing object detection and localization modul…
▽ More
For effective human-robot collaboration, it is crucial for robots to understand requests from users and ask reasonable follow-up questions when there are ambiguities. While comprehending the users' object descriptions in the requests, existing studies have focused on this challenge for limited object categories that can be detected or localized with existing object detection and localization modules. On the other hand, in the wild, it is impossible to limit the object categories that can be encountered during the interaction. To understand described objects and resolve ambiguities in the wild, for the first time, we suggest a method by leveraging explainability. Our method focuses on the active regions of a scene to find the described objects without putting the previous constraints on object categories and natural language instructions. We evaluate our method in varied real-world images and observe that the regions suggested by our method can help resolve ambiguities. When we compare our method with a state-of-the-art baseline, we show that our method performs better in scenes with ambiguous objects which cannot be recognized by existing object detectors.
△ Less
Submitted 12 July, 2021;
originally announced July 2021.
-
Using Depth for Improving Referring Expression Comprehension in Real-World Environments
Authors:
Fethiye Irmak Dogan,
Iolanda Leite
Abstract:
In a human-robot collaborative task where a robot helps its partner by finding described objects, the depth dimension plays a critical role in successful task completion. Existing studies have mostly focused on comprehending the object descriptions using RGB images. However, 3-dimensional space perception that includes depth information is fundamental in real-world environments. In this work, we p…
▽ More
In a human-robot collaborative task where a robot helps its partner by finding described objects, the depth dimension plays a critical role in successful task completion. Existing studies have mostly focused on comprehending the object descriptions using RGB images. However, 3-dimensional space perception that includes depth information is fundamental in real-world environments. In this work, we propose a method to identify the described objects considering depth dimension data. Using depth features significantly improves performance in scenes where depth data is critical to disambiguate the objects and across our whole evaluation dataset that contains objects that can be specified with and without the depth dimension.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
Open Challenges on Generating Referring Expressions for Human-Robot Interaction
Authors:
Fethiye Irmak Doğan,
Iolanda Leite
Abstract:
Effective verbal communication is crucial in human-robot collaboration. When a robot helps its human partner to complete a task with verbal instructions, referring expressions are commonly employed during the interaction. Despite many studies on generating referring expressions, crucial open challenges still remain for effective interaction. In this work, we discuss some of these challenges (i.e.,…
▽ More
Effective verbal communication is crucial in human-robot collaboration. When a robot helps its human partner to complete a task with verbal instructions, referring expressions are commonly employed during the interaction. Despite many studies on generating referring expressions, crucial open challenges still remain for effective interaction. In this work, we discuss some of these challenges (i.e., using contextual information, taking users' perspectives, and handling misinterpretations in an autonomous manner).
△ Less
Submitted 19 April, 2021;
originally announced April 2021.
-
Observing distant objects with a multimode fibre-based holographic endoscope
Authors:
Ivo T. Leite,
Sergey Turtaev,
Dirk E. Boonzajer Flaes,
Tomáš Čižmár
Abstract:
Holographic wavefront manipulation enables converting hair-thin multimode optical fibres into minimally invasive lensless imaging instruments conveying much higher information densities than conventional endoscopes. Their most prominent applications focus on accessing delicate environments, including deep brain compartments, and recording micrometre-scale resolution images of structures in close p…
▽ More
Holographic wavefront manipulation enables converting hair-thin multimode optical fibres into minimally invasive lensless imaging instruments conveying much higher information densities than conventional endoscopes. Their most prominent applications focus on accessing delicate environments, including deep brain compartments, and recording micrometre-scale resolution images of structures in close proximity to the distal end of the instrument. Here, we introduce an alternative 'farfield' endoscope, capable of imaging macroscopic objects across a large depth of field. The endoscope shaft with dimensions of 0.2$\times$0.4 mm$^2$ consists of two parallel optical fibres, one for illumination and the second for signal collection. The system is optimized for speed, power efficiency and signal quality, taking into account specific features of light transport through step-index multimode fibres. The characteristics of imaging quality are studied at distances between 20 and 400 mm. As a proof-of-concept, we provide imaging inside the cavities of a sweet pepper commonly used as a phantom for biomedically relevant conditions. Further, we test the performance on a functioning mechanical clock, thus verifying its applicability in dynamically changing environments. With performance reaching the standard definition of video endoscopes, this work paves the way towards the exploitation of minimally-invasive holographic micro-endoscopes in clinical and diagnostics applications.
△ Less
Submitted 6 November, 2020;
originally announced November 2020.
-
Gesticulator: A framework for semantically-aware speech-driven gesture generation
Authors:
Taras Kucherenko,
Patrik Jonell,
Sanne van Waveren,
Gustav Eje Henter,
Simon Alexanderson,
Iolanda Leite,
Hedvig Kjellström
Abstract:
During speech, people spontaneously gesticulate, which plays a key role in conveying information. Similarly, realistic co-speech gestures are crucial to enable natural and smooth interactions with social agents. Current end-to-end co-speech gesture generation systems use a single modality for representing speech: either audio or text. These systems are therefore confined to producing either acoust…
▽ More
During speech, people spontaneously gesticulate, which plays a key role in conveying information. Similarly, realistic co-speech gestures are crucial to enable natural and smooth interactions with social agents. Current end-to-end co-speech gesture generation systems use a single modality for representing speech: either audio or text. These systems are therefore confined to producing either acoustically-linked beat gestures or semantically-linked gesticulation (e.g., raising a hand when saying "high"): they cannot appropriately learn to generate both gesture types. We present a model designed to produce arbitrary beat and semantic gestures together. Our deep-learning based model takes both acoustic and semantic representations of speech as input, and generates gestures as a sequence of joint angle rotations as output. The resulting gestures can be applied to both virtual agents and humanoid robots. Subjective and objective evaluations confirm the success of our approach. The code and video are available at the project page https://svito-zar.github.io/gesticulator .
△ Less
Submitted 14 January, 2021; v1 submitted 25 January, 2020;
originally announced January 2020.
-
The role of artificial intelligence in achieving the Sustainable Development Goals
Authors:
Ricardo Vinuesa,
Hossein Azizpour,
Iolanda Leite,
Madeline Balaam,
Virginia Dignum,
Sami Domisch,
Anna Felländer,
Simone Langhans,
Max Tegmark,
Francesco Fuso Nerini
Abstract:
The emergence of artificial intelligence (AI) and its progressively wider impact on many sectors across the society requires an assessment of its effect on sustainable development. Here we analyze published evidence of positive or negative impacts of AI on the achievement of each of the 17 goals and 169 targets of the 2030 Agenda for Sustainable Development. We find that AI can support the achieve…
▽ More
The emergence of artificial intelligence (AI) and its progressively wider impact on many sectors across the society requires an assessment of its effect on sustainable development. Here we analyze published evidence of positive or negative impacts of AI on the achievement of each of the 17 goals and 169 targets of the 2030 Agenda for Sustainable Development. We find that AI can support the achievement of 128 targets across all SDGs, but it may also inhibit 58 targets. Notably, AI enables new technologies that improve efficiency and productivity, but it may also lead to increased inequalities among and within countries, thus hindering the achievement of the 2030 Agenda. The fast development of AI needs to be supported by appropriate policy and regulation. Otherwise, it would lead to gaps in transparency, accountability, safety and ethical standards of AI-based technology, which could be detrimental towards the development and sustainable use of AI. Finally, there is a lack of research assessing the medium- and long-term impacts of AI. It is therefore essential to reinforce the global debate regarding the use of AI and to develop the necessary regulatory insight and oversight for AI-based technologies.
△ Less
Submitted 30 April, 2019;
originally announced May 2019.
-
Learning to Generate Unambiguous Spatial Referring Expressions for Real-World Environments
Authors:
Fethiye Irmak Doğan,
Sinan Kalkan,
Iolanda Leite
Abstract:
Referring to objects in a natural and unambiguous manner is crucial for effective human-robot interaction. Previous research on learning-based referring expressions has focused primarily on comprehension tasks, while generating referring expressions is still mostly limited to rule-based methods. In this work, we propose a two-stage approach that relies on deep learning for estimating spatial relat…
▽ More
Referring to objects in a natural and unambiguous manner is crucial for effective human-robot interaction. Previous research on learning-based referring expressions has focused primarily on comprehension tasks, while generating referring expressions is still mostly limited to rule-based methods. In this work, we propose a two-stage approach that relies on deep learning for estimating spatial relations to describe an object naturally and unambiguously with a referring expression. We compare our method to the state of the art algorithm in ambiguous environments (e.g., environments that include very similar objects with similar relationships). We show that our method generates referring expressions that people find to be more accurate ($\sim$30% better) and would prefer to use ($\sim$32% more often).
△ Less
Submitted 5 August, 2019; v1 submitted 15 April, 2019;
originally announced April 2019.
-
Exploring Temporal Dependencies in Multimodal Referring Expressions with Mixed Reality
Authors:
Elena Sibirtseva,
Ali Ghadirzadeh,
Iolanda Leite,
Mårten Björkman,
Danica Kragic
Abstract:
In collaborative tasks, people rely both on verbal and non-verbal cues simultaneously to communicate with each other. For human-robot interaction to run smoothly and naturally, a robot should be equipped with the ability to robustly disambiguate referring expressions. In this work, we propose a model that can disambiguate multimodal fetching requests using modalities such as head movements, hand g…
▽ More
In collaborative tasks, people rely both on verbal and non-verbal cues simultaneously to communicate with each other. For human-robot interaction to run smoothly and naturally, a robot should be equipped with the ability to robustly disambiguate referring expressions. In this work, we propose a model that can disambiguate multimodal fetching requests using modalities such as head movements, hand gestures, and speech. We analysed the acquired data from mixed reality experiments and formulated a hypothesis that modelling temporal dependencies of events in these three modalities increases the model's predictive power. We evaluated our model on a Bayesian framework to interpret referring expressions with and without exploiting a temporal prior.
△ Less
Submitted 4 February, 2019;
originally announced February 2019.
-
High-fidelity multimode fibre-based endoscopy for deep-brain in vivo imaging
Authors:
Sergey Turtaev,
Ivo T. Leite,
Tristan Altwegg-Boussac,
Janelle M. P. Pakan,
Nathalie L. Rochefort,
Tomáš Čižmár
Abstract:
Progress in neuroscience constantly relies on the development of new techniques to investigate the complex dynamics of neuronal networks. An ongoing challenge is to achieve minimally-invasive and high-resolution observations of neuronal activity in vivo inside deep brain areas. A perspective strategy is to utilise holographic control of light propagation in complex media, which allows converting a…
▽ More
Progress in neuroscience constantly relies on the development of new techniques to investigate the complex dynamics of neuronal networks. An ongoing challenge is to achieve minimally-invasive and high-resolution observations of neuronal activity in vivo inside deep brain areas. A perspective strategy is to utilise holographic control of light propagation in complex media, which allows converting a hair-thin multimode optical fibre into an ultra-narrow imaging tool. Compared to current endoscopes based on GRIN lenses or fibre bundles, this concept offers a footprint reduction exceeding an order of magnitude, together with a significant enhancement in resolution. We designed a compact and high-speed system for fluorescent imaging at the tip of a fibre, achieving micron-scale resolution across a 50 um field of view, and yielding 7-kilopixel images at a rate of 3.5 frames/s. Furthermore, we demonstrate in vivo observations of cell bodies and processes of inhibitory neurons within deep layers of the visual cortex and hippocampus of anesthetised mice. This study forms the basis for several perspective techniques of modern microscopy to be delivered deep inside the tissue of living animal models while causing minimal impact on its structural and functional properties.
△ Less
Submitted 4 June, 2018;
originally announced June 2018.
-
Effects of biases in domain wall network evolution. II. Quantitative analysis
Authors:
J. R. C. C. C. Correia,
I. S. C. R. Leite,
C. J. A. P. Martins
Abstract:
Domain walls form at phase transitions which break discrete symmetries. In a cosmological context they often overclose the universe (contrary to observational evidence), although one may prevent this by introducing biases or forcing anisotropic evolution of the walls. In a previous work [Correia {\it et al.}, Phys.Rev.D90, 023521 (2014)] we numerically studied the evolution of various types of bia…
▽ More
Domain walls form at phase transitions which break discrete symmetries. In a cosmological context they often overclose the universe (contrary to observational evidence), although one may prevent this by introducing biases or forcing anisotropic evolution of the walls. In a previous work [Correia {\it et al.}, Phys.Rev.D90, 023521 (2014)] we numerically studied the evolution of various types of biased domain wall networks in the early universe, confirming that anisotropic networks ultimately reach scaling while those with a biased potential or biased initial conditions decay. We also found that the analytic decay law obtained by Hindmarsh was in good agreement with simulations of biased potentials, but not of biased initial conditions, and suggested that the difference was related to the Gaussian approximation underlying the analytic law. Here we extend our previous work in several ways. For the cases of biased potential and biased initial conditions we study in detail the field distributions in the simulations, confirming that the validity (or not) of the Gaussian approximation is the key difference between the two cases. For anisotropic walls we carry out a more extensive set of numerical simulations and compare them to the canonical velocity-dependent one-scale model for domain walls, finding that the model accurately predicts the linear scaling regime after isotropization. Overall, our analysis provides a quantitative description of the cosmological evolution of these networks.
△ Less
Submitted 24 May, 2018; v1 submitted 28 April, 2018;
originally announced April 2018.
-
A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction
Authors:
Elena Sibirtseva,
Dimosthenis Kontogiorgos,
Olov Nykvist,
Hakan Karaoguz,
Iolanda Leite,
Joakim Gustafson,
Danica Kragic
Abstract:
Picking up objects requested by a human user is a common task in human-robot interaction. When multiple objects match the user's verbal description, the robot needs to clarify which object the user is referring to before executing the action. Previous research has focused on perceiving user's multimodal behaviour to complement verbal commands or minimising the number of follow up questions to redu…
▽ More
Picking up objects requested by a human user is a common task in human-robot interaction. When multiple objects match the user's verbal description, the robot needs to clarify which object the user is referring to before executing the action. Previous research has focused on perceiving user's multimodal behaviour to complement verbal commands or minimising the number of follow up questions to reduce task time. In this paper, we propose a system for reference disambiguation based on visualisation and compare three methods to disambiguate natural language instructions. In a controlled experiment with a YuMi robot, we investigated real-time augmentations of the workspace in three conditions -- mixed reality, augmented reality, and a monitor as the baseline -- using objective measures such as time and accuracy, and subjective measures like engagement, immersion, and display interference. Significant differences were found in accuracy and engagement between the conditions, but no differences were found in task time. Despite the higher error rates in the mixed reality condition, participants found that modality more engaging than the other two, but overall showed preference for the augmented reality condition over the monitor and mixed reality conditions.
△ Less
Submitted 26 January, 2018;
originally announced January 2018.
-
Machine Learning and Social Robotics for Detecting Early Signs of Dementia
Authors:
Patrik Jonell,
Joseph Mendelson,
Thomas Storskog,
Goran Hagman,
Per Ostberg,
Iolanda Leite,
Taras Kucherenko,
Olga Mikheeva,
Ulrika Akenine,
Vesna Jelic,
Alina Solomon,
Jonas Beskow,
Joakim Gustafson,
Miia Kivipelto,
Hedvig Kjellstrom
Abstract:
This paper presents the EACare project, an ambitious multi-disciplinary collaboration with the aim to develop an embodied system, capable of carrying out neuropsychological tests to detect early signs of dementia, e.g., due to Alzheimer's disease. The system will use methods from Machine Learning and Social Robotics, and be trained with examples of recorded clinician-patient interactions. The inte…
▽ More
This paper presents the EACare project, an ambitious multi-disciplinary collaboration with the aim to develop an embodied system, capable of carrying out neuropsychological tests to detect early signs of dementia, e.g., due to Alzheimer's disease. The system will use methods from Machine Learning and Social Robotics, and be trained with examples of recorded clinician-patient interactions. The interaction will be developed using a participatory design approach. We describe the scope and method of the project, and report on a first Wizard of Oz prototype.
△ Less
Submitted 5 September, 2017;
originally announced September 2017.
-
Effects of Biases in Domain Wall Network Evolution
Authors:
J. R. C. C. C. Correia,
I. S. C. R. Leite,
C. J. A. P. Martins
Abstract:
We study the evolution of various types of biased domain wall networks in the early universe. We carry out larger numerical simulations than currently available in the literature and provide a more detailed study of the decay of these networks, in particular by explicitly measuring velocities in the simulations. We also use the larger dynamic range of our simulations to test previously suggested d…
▽ More
We study the evolution of various types of biased domain wall networks in the early universe. We carry out larger numerical simulations than currently available in the literature and provide a more detailed study of the decay of these networks, in particular by explicitly measuring velocities in the simulations. We also use the larger dynamic range of our simulations to test previously suggested decay laws for these networks, including an ad-hoc phenomenological fit to earlier simulations and a decay law obtained by Hindmarsh through analytic arguments. We find the latter to be in good agreement with simulations in the case of a biased potential, but not in the case of biased initial conditions.
△ Less
Submitted 15 July, 2014;
originally announced July 2014.
-
The role of local field modes in calculating the effective optical properties of metamaterials
Authors:
Anderson O. Silva,
Ivo T. Leite,
José M. Teixeira,
João C. W. A. Costa,
Maria T. M. R. Giraldi,
Ariel Guerreiro
Abstract:
This letter discusses the importance of the nature of local fields inside a unit cell of optical metamaterials in develo** a valid effective medium theory. In particular, we apply the Meier-Wokaun procedure to derive a corrected version of the Maxwell-Garnett formula for the refractive index of a medium composed by metallic rods with subwavelength cross-section. We compare this result with the v…
▽ More
This letter discusses the importance of the nature of local fields inside a unit cell of optical metamaterials in develo** a valid effective medium theory. In particular, we apply the Meier-Wokaun procedure to derive a corrected version of the Maxwell-Garnett formula for the refractive index of a medium composed by metallic rods with subwavelength cross-section. We compare this result with the values obtained using the full mode analysis calculated via numerical simulations and analyze the impact of surface plasmon polaritons in adequately determining the effective refractive index of the medium.
△ Less
Submitted 18 June, 2013;
originally announced June 2013.
