-
Visuo-Tactile based Predictive Cross Modal Perception for Object Exploration in Robotics
Authors:
Anirvan Dutta,
Etienne Burdet,
Mohsen Kaboli
Abstract:
Autonomously exploring the unknown physical properties of novel objects such as stiffness, mass, center of mass, friction coefficient, and shape is crucial for autonomous robotic systems operating continuously in unstructured environments. We introduce a novel visuo-tactile based predictive cross-modal perception framework where initial visual observations (shape) aid in obtaining an initial prior…
▽ More
Autonomously exploring the unknown physical properties of novel objects such as stiffness, mass, center of mass, friction coefficient, and shape is crucial for autonomous robotic systems operating continuously in unstructured environments. We introduce a novel visuo-tactile based predictive cross-modal perception framework where initial visual observations (shape) aid in obtaining an initial prior over the object properties (mass). The initial prior improves the efficiency of the object property estimation, which is autonomously inferred via interactive non-prehensile pushing and using a dual filtering approach. The inferred properties are then used to enhance the predictive capability of the cross-modal function efficiently by using a human-inspired `surprise' formulation. We evaluated our proposed framework in the real-robotic scenario, demonstrating superior performance.
△ Less
Submitted 23 May, 2024; v1 submitted 21 May, 2024;
originally announced May 2024.
-
Space Physiology and Technology: Musculoskeletal Adaptations, Countermeasures, and the Opportunity for Wearable Robotics
Authors:
Shamas Ul Ebad Khan,
Re** John Varghese,
Panagiotis Kassanos,
Dario Farina,
Etienne Burdet
Abstract:
Space poses significant challenges for human physiology, leading to physiological adaptations in response to an environment vastly different from Earth. While these adaptations can be beneficial, they may not fully counteract the adverse impact of space-related stressors. A comprehensive understanding of these physiological adaptations is needed to devise effective countermeasures to support human…
▽ More
Space poses significant challenges for human physiology, leading to physiological adaptations in response to an environment vastly different from Earth. While these adaptations can be beneficial, they may not fully counteract the adverse impact of space-related stressors. A comprehensive understanding of these physiological adaptations is needed to devise effective countermeasures to support human life in space. This review focuses on the impact of the environment in space on the musculoskeletal system. It highlights the complex interplay between bone and muscle adaptation, the underlying physiological mechanisms, and their implications on astronaut health. Furthermore, the review delves into the deployed and current advances in countermeasures and proposes, as a perspective for future developments, wearable sensing and robotic technologies, such as exoskeletons, as a fitting alternative.
△ Less
Submitted 4 April, 2024;
originally announced April 2024.
-
Design, Fabrication and Evaluation of a Stretchable High-Density Electromyography Array
Authors:
Re** John Varghese,
Matteo Pizzi,
Aritra Kundu,
Agnese Grison,
Etienne Burdet,
Dario Farina
Abstract:
The adoption of high-density electrode systems for human-machine interfaces in real-life applications has been impeded by practical and technical challenges, including noise interference, motion artifacts and the lack of compact electrode interfaces. To overcome some of these challenges, we introduce a wearable and stretchable electromyography (EMG) array, and present its design, fabrication metho…
▽ More
The adoption of high-density electrode systems for human-machine interfaces in real-life applications has been impeded by practical and technical challenges, including noise interference, motion artifacts and the lack of compact electrode interfaces. To overcome some of these challenges, we introduce a wearable and stretchable electromyography (EMG) array, and present its design, fabrication methodology, characterisation, and comprehensive evaluation. Our proposed solution comprises dry-electrodes on flexible printed circuit board (PCB) substrates, eliminating the need for time-consuming skin preparation. The proposed fabrication method allows the manufacturing of stretchable sleeves, with consistent and standardised coverage across subjects. We thoroughly tested our developed prototype, evaluating its potential for application in both research and real-world environments. The results of our study showed that the developed stretchable array matches or outperforms traditional EMG grids and holds promise in furthering the real-world translation of high-density EMG for human-machine interfaces.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
Design and Preliminary Evaluation of a Torso Stabiliser for Individuals with Spinal Cord Injury
Authors:
Re** John Varghese,
Man-Yan Tong,
Isabella Szczech,
Peter Bryan,
Dario Farina,
Etienne Burdet
Abstract:
Spinal cord injuries (SCIs) generally result in sensory and mobility impairments, with torso instability being particularly debilitating. Existing torso stabilisers are often rigid and restrictive. This paper presents an early investigation into a non-restrictive 1 degree-of-freedom (DoF) mechanical torso stabiliser inspired by devices such as centrifugal clutches and seat-belt mechanisms. Firstly…
▽ More
Spinal cord injuries (SCIs) generally result in sensory and mobility impairments, with torso instability being particularly debilitating. Existing torso stabilisers are often rigid and restrictive. This paper presents an early investigation into a non-restrictive 1 degree-of-freedom (DoF) mechanical torso stabiliser inspired by devices such as centrifugal clutches and seat-belt mechanisms. Firstly, the paper presents a motion-capture (MoCap) and OpenSim-based kinematic analysis of the cable-based system to understand requisite device characteristics. The simulated evaluation resulted in the cable-based device to require 55-60cm of unrestricted travel, and to lock at a threshold cable velocity of 80-100cm/sec. Next, the developed 1-DoF device is introduced. The proposed mechanical device is transparent during activities of daily living, and transitions to compliant blocking when incipient fall is detected. Prototype behaviour was then validated using a MoCap-based kinematic analysis to verify non-restrictive movement, reliable transition to blocking, and compliance of the blocking.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
Open-Set Object Recognition Using Mechanical Properties During Interaction
Authors:
Pakorn Uttayopas,
Xiaoxiao Cheng,
Etienne Burdet
Abstract:
while most of the tactile robots are operated in close-set conditions, it is challenging for them to operate in open-set conditions where test objects are beyond the robots' knowledge. We proposed an open-set recognition framework using mechanical properties to recongise known objects and incrementally label novel objects. The main contribution is a clustering algorithm that exploits knowledge of…
▽ More
while most of the tactile robots are operated in close-set conditions, it is challenging for them to operate in open-set conditions where test objects are beyond the robots' knowledge. We proposed an open-set recognition framework using mechanical properties to recongise known objects and incrementally label novel objects. The main contribution is a clustering algorithm that exploits knowledge of known objects to estimate cluster centre and sizes, unlike a typical algorithm that randomly selects them. The framework is validated with the mechanical properties estimated from a real object during interaction. The results show that the framework could recognise objects better than alternative methods contributed by the novelty detector. Importantly, our clustering algorithm yields better clustering performance than other methods. Furthermore, the hyperparameters studies show that cluster size is important to clustering results and needed to be tuned properly.
△ Less
Submitted 2 November, 2023;
originally announced November 2023.
-
Concurrent Haptic, Audio, and Visual Data Set During Bare Finger Interaction with Textured Surfaces
Authors:
Alexis W. M. Devillard,
Aruna Ramasamy,
Damien Faux,
Vincent Hayward,
Etienne Burdet
Abstract:
Perceptual processes are frequently multi-modal. This is the case of haptic perception. Data sets of visual and haptic sensory signals have been compiled in the past, especially when it comes to the exploration of textured surfaces. These data sets were intended to be used in natural and artificial perception studies and to provide training data sets for machine learning research. These data sets…
▽ More
Perceptual processes are frequently multi-modal. This is the case of haptic perception. Data sets of visual and haptic sensory signals have been compiled in the past, especially when it comes to the exploration of textured surfaces. These data sets were intended to be used in natural and artificial perception studies and to provide training data sets for machine learning research. These data sets were typically acquired with rigid probes or artificial robotic fingers. Here, we collected visual, auditory, and haptic signals acquired when a human finger explored textured surfaces. We assessed the data set via machine learning classification techniques. Interestingly, multi-modal classification performance could reach 97% when haptic classification was around 80%.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
Push to know! -- Visuo-Tactile based Active Object Parameter Inference with Dual Differentiable Filtering
Authors:
Anirvan Dutta,
Etienne Burdet,
Mohsen Kaboli
Abstract:
For robotic systems to interact with objects in dynamic environments, it is essential to perceive the physical properties of the objects such as shape, friction coefficient, mass, center of mass, and inertia. This not only eases selecting manipulation action but also ensures the task is performed as desired. However, estimating the physical properties of especially novel objects is a challenging p…
▽ More
For robotic systems to interact with objects in dynamic environments, it is essential to perceive the physical properties of the objects such as shape, friction coefficient, mass, center of mass, and inertia. This not only eases selecting manipulation action but also ensures the task is performed as desired. However, estimating the physical properties of especially novel objects is a challenging problem, using either vision or tactile sensing. In this work, we propose a novel framework to estimate key object parameters using non-prehensile manipulation using vision and tactile sensing. Our proposed active dual differentiable filtering (ADDF) approach as part of our framework learns the object-robot interaction during non-prehensile object push to infer the object's parameters. Our proposed method enables the robotic system to employ vision and tactile information to interactively explore a novel object via non-prehensile object push. The novel proposed N-step active formulation within the differentiable filtering facilitates efficient learning of the object-robot interaction model and during inference by selecting the next best exploratory push actions (where to push? and how to push?). We extensively evaluated our framework in simulation and real-robotic scenarios, yielding superior performance to the state-of-the-art baseline.
△ Less
Submitted 2 August, 2023;
originally announced August 2023.
-
Physically interacting humans regulate muscle coactivation to improve visuo-haptic perception
Authors:
Hendrik Borner,
Gerolamo Carboni,
Xiaoxiao Cheng,
Atsushi Takagi,
Sandra Hirche,
Satoshi Endo,
Etienne Burdet
Abstract:
When moving a piano or dancing tango with a partner, how should I control my arm muscles to best feel their movements and follow or guide them smoothly? Here we observe how physically connected pairs tracking a moving target with the arm modify muscle coactivation with their visual acuity and the partners performance. They coactivate muscles to stiffen the arm when the partners performance is wors…
▽ More
When moving a piano or dancing tango with a partner, how should I control my arm muscles to best feel their movements and follow or guide them smoothly? Here we observe how physically connected pairs tracking a moving target with the arm modify muscle coactivation with their visual acuity and the partners performance. They coactivate muscles to stiffen the arm when the partners performance is worse, and relax with blurry visual feedback. Computational modelling show that this adaptive sensing property cannot be explained by movement error minimization proposed in earlier models. Instead, individuals skilfully control the arms stiffness to guide it on the planned motion while minimizing effort and extracting useful haptic information from the partners movement. The central nervous system regulates muscles' activation to guide motion with accurate task information from vision and haptics while minimizing the metabolic cost.
△ Less
Submitted 18 October, 2022;
originally announced October 2022.
-
Mechanical features based object recognition
Authors:
Pakorn Uttayopas,
Xiaoxiao Cheng,
Jonathan Eden,
Etienne Burdet
Abstract:
Current robotic haptic object recognition relies on statistical measures derived from movement dependent interaction signals such as force, vibration or position. Mechanical properties that can be identified from these signals are intrinsic object properties that may yield a more robust object representation. Therefore, this paper proposes an object recognition framework using multiple representat…
▽ More
Current robotic haptic object recognition relies on statistical measures derived from movement dependent interaction signals such as force, vibration or position. Mechanical properties that can be identified from these signals are intrinsic object properties that may yield a more robust object representation. Therefore, this paper proposes an object recognition framework using multiple representative mechanical properties: the coefficient of restitution, stiffness, viscosity and friction coefficient. These mechanical properties are identified in real-time using a dual Kalman filter, then used to classify objects. The proposed framework was tested with a robot identifying 20 objects through haptic exploration. The results demonstrate the technique's effectiveness and efficiency, and that all four mechanical properties are required for best recognition yielding a rate of 98.18 $\pm$ 0.424 %. Clustering with Gaussian mixture models further shows that using these mechanical properties results in superior recognition as compared to using statistical parameters of the interaction signals.
△ Less
Submitted 14 October, 2022;
originally announced October 2022.
-
Dynamic neuronal networks efficiently achieve classification in robotic interactions with real-world objects
Authors:
Pakorn Uttayopas,
Xiaoxiao Cheng,
Udaya Bhaskar Rongala,
Henrik Jörntell,
Etienne Burdet
Abstract:
Biological cortical networks are potentially fully recurrent networks without any distinct output layer, where recognition may instead rely on the distribution of activity across its neurons. Because such biological networks can have rich dynamics, they are well-designed to cope with dynamical interactions of the types that occur in nature, while traditional machine learning networks may struggle…
▽ More
Biological cortical networks are potentially fully recurrent networks without any distinct output layer, where recognition may instead rely on the distribution of activity across its neurons. Because such biological networks can have rich dynamics, they are well-designed to cope with dynamical interactions of the types that occur in nature, while traditional machine learning networks may struggle to make sense of such data. Here we connected a simple model neuronal network (based on the 'linear summation neuron model' featuring biologically realistic dynamics (LSM), consisting of 10 of excitatory and 10 inhibitory neurons, randomly connected) to a robot finger with multiple types of force sensors when interacting with materials of different levels of compliance. Scope: to explore the performance of the network on classification accuracy. Therefore, we compared the performance of the network output with principal component analysis of statistical features of the sensory data as well as its mechanical properties. Remarkably, even though the LSM was a very small and untrained network, and merely designed to provide rich internal network dynamics while the neuron model itself was highly simplified, we found that the LSM outperformed these other statistical approaches in terms of accuracy.
△ Less
Submitted 11 November, 2022; v1 submitted 12 October, 2022;
originally announced October 2022.
-
Active Visuo-Tactile Interactive Robotic Perception for Accurate Object Pose Estimation in Dense Clutter
Authors:
Prajval Kumar Murali,
Anirvan Dutta,
Michael Gentner,
Etienne Burdet,
Ravinder Dahiya,
Mohsen Kaboli
Abstract:
This work presents a novel active visuo-tactile based framework for robotic systems to accurately estimate pose of objects in dense cluttered environments. The scene representation is derived using a novel declutter graph (DG) which describes the relationship among objects in the scene for decluttering by leveraging semantic segmentation and grasp affordances networks. The graph formulation allows…
▽ More
This work presents a novel active visuo-tactile based framework for robotic systems to accurately estimate pose of objects in dense cluttered environments. The scene representation is derived using a novel declutter graph (DG) which describes the relationship among objects in the scene for decluttering by leveraging semantic segmentation and grasp affordances networks. The graph formulation allows robots to efficiently declutter the workspace by autonomously selecting the next best object to remove and the optimal action (prehensile or non-prehensile) to perform. Furthermore, we propose a novel translation-invariant Quaternion filter (TIQF) for active vision and active tactile based pose estimation. Both active visual and active tactile points are selected by maximizing the expected information gain. We evaluate our proposed framework on a system with two robots coordinating on randomized scenes of dense cluttered objects and perform ablation studies with static vision and active vision based estimation prior and post decluttering as baselines. Our proposed active visuo-tactile interactive perception framework shows upto 36% improvement in pose accuracy compared to the active vision baseline.
△ Less
Submitted 4 February, 2022;
originally announced February 2022.
-
Shared Control for Bimanual Telesurgery with Optimized Robotic Partner
Authors:
Ziwei Wang,
Yanpei Huang,
Xiaoxiao Cheng,
Pakorn Uttayopas,
Etienne Burdet
Abstract:
Traditional telesurgery relies on the surgeon's full control of the robot on the patient's side, which tends to increase surgeon fatigue and may reduce the efficiency of the operation. This paper introduces a Robotic Partner (RP) to facilitate intuitive bimanual telesurgery, aiming at reducing the surgeon workload and enhancing surgeon-assisted capability. An interval type-2 polynomial fuzzy-model…
▽ More
Traditional telesurgery relies on the surgeon's full control of the robot on the patient's side, which tends to increase surgeon fatigue and may reduce the efficiency of the operation. This paper introduces a Robotic Partner (RP) to facilitate intuitive bimanual telesurgery, aiming at reducing the surgeon workload and enhancing surgeon-assisted capability. An interval type-2 polynomial fuzzy-model-based learning algorithm is employed to extract expert domain knowledge from surgeons and reflect environmental interaction information. Based on this, a bimanual shared control is developed to interact with the other robot teleoperated by the surgeon, understanding their control and providing assistance. As prior information of the environment model is not required, it reduces reliance on force sensors in control design. Experimental results on the DaVinci Surgical System show that the RP could assist peg-transfer tasks and reduce the surgeon's workload by 51\% in force-sensor-free scenarios.
△ Less
Submitted 12 July, 2021;
originally announced July 2021.
-
Human movement augmentation and how to make it a reality
Authors:
Jonathan Eden,
Mario Bräcklein,
Jaime Ibáñez Pereda,
Deren Yusuf Barsakcioglu,
Giovanni Di Pino,
Dario Farina,
Etienne Burdet,
Carsten Mehring
Abstract:
Augmenting the body with artificial limbs controlled concurrently to the natural limbs has long appeared in science fiction, but recent technological and neuroscientific advances have begun to make this vision possible. By allowing individuals to achieve otherwise impossible actions, this movement augmentation could revolutionize medical and industrial applications and profoundly change the way hu…
▽ More
Augmenting the body with artificial limbs controlled concurrently to the natural limbs has long appeared in science fiction, but recent technological and neuroscientific advances have begun to make this vision possible. By allowing individuals to achieve otherwise impossible actions, this movement augmentation could revolutionize medical and industrial applications and profoundly change the way humans interact with their environment. Here, we construct a movement augmentation taxonomy through what is augmented and how it is achieved. With this framework, we analyze augmentation that extends the number of degrees-of-freedom, discuss critical features of effective augmentation such as physiological control signals, sensory feedback and learning, and propose a vision for the field.
△ Less
Submitted 15 June, 2021;
originally announced June 2021.
-
Trimanipulation: Evaluation of human performance in a 3-handed coordination task
Authors:
Yanpei Huang,
Jonathan Eden,
Ekaterina Ivanova,
Soo Jay Phee,
Etienne Burdet
Abstract:
Many teleoperation tasks require three or more tools working together, which need the cooperation of multiple operators. The effectiveness of such schemes may be limited by communication. Trimanipulation by a single operator using an artificial third arm controlled together with their natural arms is a promising solution to this issue. Foot-controlled interfaces have previously shown the capabilit…
▽ More
Many teleoperation tasks require three or more tools working together, which need the cooperation of multiple operators. The effectiveness of such schemes may be limited by communication. Trimanipulation by a single operator using an artificial third arm controlled together with their natural arms is a promising solution to this issue. Foot-controlled interfaces have previously shown the capability to be used for the continuous control of robot arms. However, the use of such interfaces for controlling a supernumerary robotic limb (SRLs) in coordination with the natural limbs, is not well understood. In this paper, a teleoperation task imitating physically coupled hands in a virtual reality scene was conducted with 14 subjects to evaluate human performance during tri-manipulation. The participants were required to move three limbs together in a coordinated way mimicking three arms holding a shared physical object. It was found that after a short practice session, the three-hand tri-manipulation using a single subject's hands and foot was still slower than dyad operation, however, they displayed similar performance in success rate and higher motion efficiency than two person's cooperation.
△ Less
Submitted 13 April, 2021;
originally announced April 2021.
-
A Three-limb Teleoperated Robotic System with Foot Control for Flexible Endoscopic Surgery
Authors:
Yanpei Huang,
Wenjie Lai,
Lin Cao,
Jiajun Liu,
Xiaoguo Li,
Etienne Burdet,
Soo Jay Phee
Abstract:
Flexible endoscopy requires high skills to manipulate both the endoscope and associated instruments. In most robotic flexible endoscopic systems, the endoscope and instruments are controlled separately by two operators, which may result in communication errors and inefficient operation. We present a novel teleoperation robotic endoscopic system that can be commanded by a surgeon alone. This 13 deg…
▽ More
Flexible endoscopy requires high skills to manipulate both the endoscope and associated instruments. In most robotic flexible endoscopic systems, the endoscope and instruments are controlled separately by two operators, which may result in communication errors and inefficient operation. We present a novel teleoperation robotic endoscopic system that can be commanded by a surgeon alone. This 13 degrees-of-freedom (DoF) system integrates a foot-controlled robotic flexible endoscope and two hand-controlled robotic endoscopic instruments (a robotic grasper and a robotic cauterizing hook). A foot-controlled human-machine interface maps the natural foot gestures to the 4-DoF movements of the endoscope, and two hand-controlled interfaces map the movements of the two hands to the two instruments individually. The proposed robotic system was validated in an ex-vivo experiment carried out by six subjects, where foot control was also compared with a sequential clutch-based hand control scheme. The participants could successfully teleoperate the endoscope and the two instruments to cut the tissues at scattered target areas in a porcine stomach. Foot control yielded 43.7% faster task completion and required less mental effort as compared to the clutch-based hand control scheme. The system introduced in this paper is intuitive for three-limb manipulation even for operators without experience of handling the endoscope and robotic instruments. This three-limb teleoperated robotic system enables one surgeon to intuitively control three endoscopic tools which normally require two operators, leading to reduced manpower, less communication errors, and improved efficiency.
△ Less
Submitted 12 July, 2020;
originally announced July 2020.
-
Nonlinearity Compensation in a Multi-DoF Shoulder Sensing Exosuit for Real-Time Teleoperation
Authors:
Re** John Varghese,
Anh Nguyen,
Etienne Burdet,
Guang-Zhong Yang,
Benny P L Lo
Abstract:
The compliant nature of soft wearable robots makes them ideal for complex multiple degrees of freedom (DoF) joints, but also introduce additional structural nonlinearities. Intuitive control of these wearable robots requires robust sensing to overcome the inherent nonlinearities. This paper presents a joint kinematics estimator for a bio-inspired multi-DoF shoulder exosuit capable of compensating…
▽ More
The compliant nature of soft wearable robots makes them ideal for complex multiple degrees of freedom (DoF) joints, but also introduce additional structural nonlinearities. Intuitive control of these wearable robots requires robust sensing to overcome the inherent nonlinearities. This paper presents a joint kinematics estimator for a bio-inspired multi-DoF shoulder exosuit capable of compensating the encountered nonlinearities. To overcome the nonlinearities and hysteresis inherent to the soft and compliant nature of the suit, we developed a deep learning-based method to map the sensor data to the joint space. The experimental results show that the new learning-based framework outperforms recent state-of-the-art methods by a large margin while achieving 12ms inference time using only a GPU-based edge-computing device. The effectiveness of our combined exosuit and learning framework is demonstrated through real-time teleoperation with a simulated NAO humanoid robot.
△ Less
Submitted 21 February, 2020;
originally announced February 2020.
-
Improving Tracking through Human-Robot Sensory Augmentation
Authors:
Yanan Li,
Jonathan Eden,
Gerolamo Carboni,
Etienne Burdet
Abstract:
This paper introduces human-robot sensory augmentation and illustrates it on a tracking task, where performance can be improved by the exchange of sensory information between the robot and its human user. It was recently found that during interaction between humans, the partners use each other's sensory information to improve their own sensing, thus also their performance and learning. In this pap…
▽ More
This paper introduces human-robot sensory augmentation and illustrates it on a tracking task, where performance can be improved by the exchange of sensory information between the robot and its human user. It was recently found that during interaction between humans, the partners use each other's sensory information to improve their own sensing, thus also their performance and learning. In this paper, we develop a computational model of this unique human ability, and use it to build a novel control framework for human-robot interaction. The human partner's control is formulated as a feedback control with unknown control gains and desired trajectory. A Kalman filter is used to estimate first the control gains and then the desired trajectory. The estimated human partner's desired trajectory is used as augmented sensory information about the system and combined with the robot's measurement to estimate an uncertain target trajectory. Simulations and an implementation of the presented framework on a robotic interface validate the proposed observer-predictor pair for a tracking task. The results obtained using this robot demonstrate how the human user's control can be identified, and exhibit similar benefits of this sensory augmentation as was observed between interacting humans.
△ Less
Submitted 17 February, 2020;
originally announced February 2020.
-
The influence of posture, applied force and perturbation direction on hip joint viscoelasticity
Authors:
Hsien-Yung Huang,
Arash Arami,
Ildar Farkhatdinov,
Domenico Formica,
Etienne Burdet
Abstract:
Limb viscoelasticity is a critical factor used to regulate the interaction with the environment. It plays a key role in modelling human sensorimotor control, and can be used to assess the condition of healthy and neurologically affected individuals. This paper reports the estimation of hip joint viscoelasticity during voluntary force control using a novel device that applies a leg displacement wit…
▽ More
Limb viscoelasticity is a critical factor used to regulate the interaction with the environment. It plays a key role in modelling human sensorimotor control, and can be used to assess the condition of healthy and neurologically affected individuals. This paper reports the estimation of hip joint viscoelasticity during voluntary force control using a novel device that applies a leg displacement without constraining the hip joint. The influence of hip angle, applied limb force and perturbation direction on the stiffness values was studied in ten subjects. No difference was detected in the hip joint stiffness between the dominant and non-dominant legs, but a small dependency was observed on the perturbation direction. Both hip stiffness and viscosity increased monotonically with the applied force magnitude, with posture to being observed to have a slight influence. These results are in line with previous measurements carried out on upper limbs, and can be used as a baseline for lower limb movement simulation and further neuromechanical investigations.
△ Less
Submitted 23 March, 2020; v1 submitted 21 August, 2019;
originally announced August 2019.
-
Cable-driven robotic interface for lower limb neuromechanics identification
Authors:
Hsien-Yung Huang,
Ildar Farkhatdinov,
Arash Arami,
Mohamed Bouri,
Etienne Burdet
Abstract:
This paper presents a versatile cable-driven robotic interface to investigate the single-joint joint neuromechanics of the hip, knee and ankle. This endpoint-based interface offers highly dynamic interaction and accurate position control, as is typically required for neuromechanics identification. It can be used with the subject upright, corresponding to natural posture during walking or standing,…
▽ More
This paper presents a versatile cable-driven robotic interface to investigate the single-joint joint neuromechanics of the hip, knee and ankle. This endpoint-based interface offers highly dynamic interaction and accurate position control, as is typically required for neuromechanics identification. It can be used with the subject upright, corresponding to natural posture during walking or standing, and does not impose kinematic constraints on a joint, in contrast to existing interfaces. Mechanical evaluations demonstrated that the interface yields a rigidity above 500N/m with low viscosity. Tests with a rigid dummy leg and linear springs show that it can identify the mechanical impedance of a limb accurately. A smooth perturbation is developed and tested with a human subject, which can be used to estimate the hip neuromechanics.
△ Less
Submitted 21 June, 2020; v1 submitted 7 August, 2019;
originally announced August 2019.
-
Performance evaluation of a foot-controlled human-robot interface
Authors:
Yanpei Huang,
Etienne Burdet,
Lin Cao,
Phuoc Thien Phan,
Anthony Meng Huat Tiong,
Pai Zheng,
Soo Jay Phee
Abstract:
Robotic minimally invasive interventions typically require using more than two instruments. We thus developed a foot pedal interface which allows the user to control a robotic arm (simultaneously to working with the hands) with four degrees of freedom in continuous directions and speeds. This paper evaluates and compares the performances of ten naive operators in using this new pedal interface and…
▽ More
Robotic minimally invasive interventions typically require using more than two instruments. We thus developed a foot pedal interface which allows the user to control a robotic arm (simultaneously to working with the hands) with four degrees of freedom in continuous directions and speeds. This paper evaluates and compares the performances of ten naive operators in using this new pedal interface and a traditional button interface in completing tasks. These tasks are geometrically complex path-following tasks similar to those in laparoscopic training, and the traditional button interface allows axis-by-axis control with constant speeds. Precision, time, and smoothness of the subjects' control movements for these tasks are analysed. The results demonstrate that the pedal interface can be used to control a robot for complex motion tasks. The subjects kept the average error rate at a low level of around 2.6% with both interfaces, but the pedal interface resulted in about 30% faster operation speed and 60% smoother movement, which indicates improved efficiency and user experience as compared with the button interface. The results of a questionnaire show that the operators found that controlling the robot with the pedal interface was more intuitive, comfortable, and less tiring than using the button interface.
△ Less
Submitted 7 March, 2019;
originally announced March 2019.
-
A Subject-Specific Four-Degree-of-Freedom Foot Interface to Control a Robot Arm
Authors:
Yanpei Huang,
Etienne Burdet,
Lin Cao,
Phuoc Thien Phan,
Anthony Meng Huat Tiong,
Soo Jay Phee
Abstract:
In robotic surgery, the surgeon controls robotic instruments using dedicated interfaces. One critical limitation of current interfaces is that they are designed to be operated by only the hands. This means that the surgeon can only control at most two robotic instruments at one time while many interventions require three instruments. This paper introduces a novel four-degree-of-freedom foot-machin…
▽ More
In robotic surgery, the surgeon controls robotic instruments using dedicated interfaces. One critical limitation of current interfaces is that they are designed to be operated by only the hands. This means that the surgeon can only control at most two robotic instruments at one time while many interventions require three instruments. This paper introduces a novel four-degree-of-freedom foot-machine interface which allows the surgeon to control a third robotic instrument using the foot, giving the surgeon a "third hand". This interface is essentially a parallel-serial hybrid mechanism with springs and force sensors. Unlike existing switch-based interfaces that can only un-intuitively generate motion in discrete directions, this interface allows intuitive control of a slave robotic arm in continuous directions and speeds, naturally matching the foot movements with dynamic force & position feedbacks. An experiment with ten naive subjects was conducted to test the system. In view of the significant variance of motion patterns between subjects, a subject-specific map** from foot movements to command outputs was developed using Independent Component Analysis (ICA). Results showed that the ICA method could accurately identify subjects' foot motion patterns and significantly improve the prediction accuracy of motion directions from 68% to 88% as compared with the forward kinematics-based approach. This foot-machine interface can be applied for the teleoperation of industrial/surgical robots independently or in coordination with hands in the future.
△ Less
Submitted 13 February, 2019;
originally announced February 2019.
-
Indirect Shared Control of Highly Automated Vehicles for Cooperative Driving between Driver and Automation
Authors:
Renjie Li,
Yanan Li,
Shengbo Eben Li,
Etienne Burdet,
Bo Cheng
Abstract:
It is widely acknowledged that drivers should remain in the control loop of automated vehicles before they completely meet real-world operational conditions. This paper introduces an `indirect shared control' scheme for steer-by-wire vehicles, which allows the vehicle control authority to be continuously shared between the driver and automation through unphysical cooperation. This paper first bala…
▽ More
It is widely acknowledged that drivers should remain in the control loop of automated vehicles before they completely meet real-world operational conditions. This paper introduces an `indirect shared control' scheme for steer-by-wire vehicles, which allows the vehicle control authority to be continuously shared between the driver and automation through unphysical cooperation. This paper first balances the control objectives of the driver and automation in a weighted summation, and then models the driver's adaptive control behavior using a predictive control approach. The driver adaptation modeling enables off-line evaluations of indirect shared control systems and thus facilitates the design of the assistant controller. Unlike any conventional driver model for manual driving, this model assumes that the driver can learn and incorporate the controller strategy into his internal model for more accurate path following. To satisfy the driving demands in different scenarios, a sliding-window detector is designed to continuously monitor the driver intention and automatically switch the authority weights between the driver and automation. The simulation results illustrate the advantages of considering the driver adaptation in path-following and obstacle-avoidance tasks, and show the effectiveness of indirect shared control for cooperative driving.
△ Less
Submitted 3 April, 2017;
originally announced April 2017.
-
Dynamic analysis of simultaneous adaptation of force, impedance and trajectory
Authors:
Yanan Li,
Etienne Burdet
Abstract:
When carrying out tasks in contact with the environment, humans are found to concurrently adapt force, impedance and trajectory. Here we develop a robotic model of this mechanism in humans and analyse the underlying dynamics. We derive a general adaptive controller for the interaction of a robot with an environment solely characterised by its stiffness and dam**, using Lyapunov theory.
When carrying out tasks in contact with the environment, humans are found to concurrently adapt force, impedance and trajectory. Here we develop a robotic model of this mechanism in humans and analyse the underlying dynamics. We derive a general adaptive controller for the interaction of a robot with an environment solely characterised by its stiffness and dam**, using Lyapunov theory.
△ Less
Submitted 25 May, 2016;
originally announced May 2016.
-
Integrated canopy, building energy and radiosity model for 3D urban design
Authors:
Etienne Burdet,
Morgane Colombert,
Denis Morand,
Youssef Diab
Abstract:
We present an integrated, three dimensional, model of urban canopy, building energy and radiosity, for early stage urban designs and test it on four urban morphologies. All sub-models share a common descriptions of the urban morphology, similar to 3D urban design master plans and have simple parameters. The canopy model is a multilayer model, with a new discrete layer approach that does not rely o…
▽ More
We present an integrated, three dimensional, model of urban canopy, building energy and radiosity, for early stage urban designs and test it on four urban morphologies. All sub-models share a common descriptions of the urban morphology, similar to 3D urban design master plans and have simple parameters. The canopy model is a multilayer model, with a new discrete layer approach that does not rely on simplified geometry such as canyon or regular arrays. The building energy model is a simplified RC equivalent model, with no hypotheses on internal zoning or wall composition. We use the CitySim software for the radiosity model. We study the effects of convexity, the number of buildings and building height, at constant density and thermal characteristics. Our results suggest that careful three dimensional morphology design can reduce heat demand by a factor of 2, especially by improving insolation of lower levels. The most energy efficient morphology in our simulations has both the highest surface/volume ratio and the biggest impact on the urban climate.
△ Less
Submitted 17 November, 2014;
originally announced November 2014.
