Showing 1–26 of 26 results for author: Taylor, Z

Deep-Motion-Net: GNN-based volumetric organ shape reconstruction from single-view 2D projections

Authors: Isuru Wijesinghe, Michael Nix, Arezoo Zakeri, Alireza Hokmabadi, Bashar Al-Qaisieh, Ali Gooya, Zeike A. Taylor

Abstract: We propose Deep-Motion-Net: an end-to-end graph neural network (GNN) architecture that enables 3D (volumetric) organ shape reconstruction from a single in-treatment kV planar X-ray image acquired at any arbitrary projection angle. Estimating and compensating for true anatomical motion during radiotherapy is essential for improving the delivery of planned radiation dose to target volumes while spar… ▽ More We propose Deep-Motion-Net: an end-to-end graph neural network (GNN) architecture that enables 3D (volumetric) organ shape reconstruction from a single in-treatment kV planar X-ray image acquired at any arbitrary projection angle. Estimating and compensating for true anatomical motion during radiotherapy is essential for improving the delivery of planned radiation dose to target volumes while sparing organs-at-risk, and thereby improving the therapeutic ratio. Achieving this using only limited imaging available during irradiation and without the use of surrogate signals or invasive fiducial markers is attractive. The proposed model learns the mesh regression from a patient-specific template and deep features extracted from kV images at arbitrary projection angles. A 2D-CNN encoder extracts image features, and four feature pooling networks fuse these features to the 3D template organ mesh. A ResNet-based graph attention network then deforms the feature-encoded mesh. The model is trained using synthetically generated organ motion instances and corresponding kV images. The latter is generated by deforming a reference CT volume aligned with the template mesh, creating digitally reconstructed radiographs (DRRs) at required projection angles, and DRR-to-kV style transferring with a conditional CycleGAN model. The overall framework was tested quantitatively on synthetic respiratory motion scenarios and qualitatively on in-treatment images acquired over full scan series for liver cancer patients. Overall mean prediction errors for synthetic motion test datasets were 0.16$\pm$0.13 mm, 0.18$\pm$0.19 mm, 0.22$\pm$0.34 mm, and 0.12$\pm$0.11 mm. Mean peak prediction errors were 1.39 mm, 1.99 mm, 3.29 mm, and 1.16 mm. △ Less

Submitted 9 July, 2024; originally announced July 2024.

Biomechanics-informed Non-rigid Medical Image Registration and its Inverse Material Property Estimation with Linear and Nonlinear Elasticity

Authors: Zhe Min, Zachary M. C. Baum, Shaheer U. Saeed, Mark Emberton, Dean C. Barratt, Zeike A. Taylor, Yipeng Hu

Abstract: This paper investigates both biomechanical-constrained non-rigid medical image registrations and accurate identifications of material properties for soft tissues, using physics-informed neural networks (PINNs). The complex nonlinear elasticity theory is leveraged to formally establish the partial differential equations (PDEs) representing physics laws of biomechanical constraints that need to be s… ▽ More This paper investigates both biomechanical-constrained non-rigid medical image registrations and accurate identifications of material properties for soft tissues, using physics-informed neural networks (PINNs). The complex nonlinear elasticity theory is leveraged to formally establish the partial differential equations (PDEs) representing physics laws of biomechanical constraints that need to be satisfied, with which registration and identification tasks are treated as forward (i.e., data-driven solutions of PDEs) and inverse (i.e., parameter estimation) problems under PINNs respectively. Two net configurations (i.e., Cfg1 and Cfg2) have also been compared for both linear and nonlinear physics model. Two sets of experiments have been conducted, using pairs of undeformed and deformed MR images from clinical cases of prostate cancer biopsy. Our contributions are summarised as follows. 1) We developed a learning-based biomechanical-constrained non-rigid registration algorithm using PINNs, where linear elasticity is generalised to the nonlinear version. 2) We demonstrated extensively that nonlinear elasticity shows no statistical significance against linear models in computing point-wise displacement vectors but their respective benefits may depend on specific patients, with finite-element (FE) computed ground-truth. 3) We formulated and solved the inverse parameter estimation problem, under the joint optimisation scheme of registration and parameter identification using PINNs, whose solutions can be accurately found by locating saddle points. △ Less

Submitted 9 July, 2024; v1 submitted 3 July, 2024; originally announced July 2024.

Comments: Accepted at MICCAI 2024

Multi-view Hybrid Graph Convolutional Network for Volume-to-mesh Reconstruction in Cardiovascular MRI

Authors: Nicolás Gaggion, Benjamin A. Matheson, Yan Xia, Rodrigo Bonazzola, Nishant Ravikumar, Zeike A. Taylor, Diego H. Milone, Alejandro F. Frangi, Enzo Ferrante

Abstract: Cardiovascular magnetic resonance imaging is emerging as a crucial tool to examine cardiac morphology and function. Essential to this endeavour are anatomical 3D surface and volumetric meshes derived from CMR images, which facilitate computational anatomy studies, biomarker discovery, and in-silico simulations. However, conventional surface mesh generation methods, such as active shape models and… ▽ More Cardiovascular magnetic resonance imaging is emerging as a crucial tool to examine cardiac morphology and function. Essential to this endeavour are anatomical 3D surface and volumetric meshes derived from CMR images, which facilitate computational anatomy studies, biomarker discovery, and in-silico simulations. However, conventional surface mesh generation methods, such as active shape models and multi-atlas segmentation, are highly time-consuming and require complex processing pipelines to generate simulation-ready 3D meshes. In response, we introduce HybridVNet, a novel architecture for direct image-to-mesh extraction seamlessly integrating standard convolutional neural networks with graph convolutions, which we prove can efficiently handle surface and volumetric meshes by encoding them as graph structures. To further enhance accuracy, we propose a multiview HybridVNet architecture which processes both long axis and short axis CMR, showing that it can increase the performance of cardiac MR mesh generation. Our model combines traditional convolutional networks with variational graph generative models, deep supervision and mesh-specific regularisation. Experiments on a comprehensive dataset from the UK Biobank confirm the potential of HybridVNet to significantly advance cardiac imaging and computational cardiology by efficiently generating high-fidelity and simulation ready meshes from CMR images. △ Less

Submitted 22 November, 2023; originally announced November 2023.

Non-rigid Medical Image Registration using Physics-informed Neural Networks

Authors: Zhe Min, Zachary M. C. Baum, Shaheer U. Saeed, Mark Emberton, Dean C. Barratt, Zeike A. Taylor, Yipeng Hu

Abstract: Biomechanical modelling of soft tissue provides a non-data-driven method for constraining medical image registration, such that the estimated spatial transformation is considered biophysically plausible. This has not only been adopted in real-world clinical applications, such as the MR-to-ultrasound registration for prostate intervention of interest in this work, but also provides an explainable m… ▽ More Biomechanical modelling of soft tissue provides a non-data-driven method for constraining medical image registration, such that the estimated spatial transformation is considered biophysically plausible. This has not only been adopted in real-world clinical applications, such as the MR-to-ultrasound registration for prostate intervention of interest in this work, but also provides an explainable means of understanding the organ motion and spatial correspondence establishment. This work instantiates the recently-proposed physics-informed neural networks (PINNs) to a 3D linear elastic model for modelling prostate motion commonly encountered during transrectal ultrasound guided procedures. To overcome a widely-recognised challenge in generalising PINNs to different subjects, we propose to use PointNet as the nodal-permutation-invariant feature extractor, together with a registration algorithm that aligns point sets and simultaneously takes into account the PINN-imposed biomechanics. The proposed method has been both developed and validated in both patient-specific and multi-patient manner. △ Less

Submitted 20 February, 2023; originally announced February 2023.

Comments: IPMI 2023

A BERT-based Deep Learning Approach for Reputation Analysis in Social Media

Authors: Mohammad Wali Ur Rahman, Sicong Shao, Pratik Satam, Salim Hariri, Chris Padilla, Zoe Taylor, Carlos Nevarez

Abstract: Social media has become an essential part of the modern lifestyle, with its usage being highly prevalent. This has resulted in unprecedented amounts of data generated from users in social media, such as users' attitudes, opinions, interests, purchases, and activities across various aspects of their lives. Therefore, in a world of social media, where its power has shifted to users, actions taken by… ▽ More Social media has become an essential part of the modern lifestyle, with its usage being highly prevalent. This has resulted in unprecedented amounts of data generated from users in social media, such as users' attitudes, opinions, interests, purchases, and activities across various aspects of their lives. Therefore, in a world of social media, where its power has shifted to users, actions taken by companies and public figures are subject to constantly being under scrutiny by influential global audiences. As a result, reputation management in social media has become essential as companies and public figures need to maintain their reputation to preserve their reputation capital. However, domain experts still face the challenge of lacking appropriate solutions to automate reliable online reputation analysis. To tackle this challenge, we proposed a novel reputation analysis approach based on the popular language model BERT (Bidirectional Encoder Representations from Transformers). The proposed approach was evaluated on the reputational polarity task using RepLab 2013 dataset. Compared to previous works, we achieved 5.8% improvement in accuracy, 26.9% improvement in balanced accuracy, and 21.8% improvement in terms of F-score. △ Less

Submitted 22 October, 2022; originally announced November 2022.

Comments: Accepted to the 19th IEEE/ACS International Conference on Computer Systems and Applications

Text Simplification of College Admissions Instructions: A Professionally Simplified and Verified Corpus

Authors: Zachary W. Taylor, Maximus H. Chu, Junyi Jessy Li

Abstract: Access to higher education is critical for minority populations and emergent bilingual students. However, the language used by higher education institutions to communicate with prospective students is often too complex; concretely, many institutions in the US publish admissions application instructions far above the average reading level of a typical high school graduate, often near the 13th or 14… ▽ More Access to higher education is critical for minority populations and emergent bilingual students. However, the language used by higher education institutions to communicate with prospective students is often too complex; concretely, many institutions in the US publish admissions application instructions far above the average reading level of a typical high school graduate, often near the 13th or 14th grade level. This leads to an unnecessary barrier between students and access to higher education. This work aims to tackle this challenge via text simplification. We present PSAT (Professionally Simplified Admissions Texts), a dataset with 112 admissions instructions randomly selected from higher education institutions across the US. These texts are then professionally simplified, and verified and accepted by subject-matter experts who are full-time employees in admissions offices at various institutions. Additionally, PSAT comes with manual alignments of 1,883 original-simplified sentence pairs. The result is a first-of-its-kind corpus for the evaluation and fine-tuning of text simplification systems in a high-stakes genre distinct from existing simplification resources. △ Less

Submitted 9 September, 2022; originally announced September 2022.

Comments: International Conference on Computational Linguistics (COLING) 2022

Mie Scattering with 3D Angular Spectrum Method

Authors: Joel Lamberg, Faezeh Zarrinkhat, Aleksi Tamminen, Mariangela Baggio, Juha Ala-Laurinaho, Juan Rius, Jordi Romeu, Elsayed E. M. Khaled, Zachary Taylor

Abstract: Mie theory is a powerful method to model electromagnetic scattering from a multilayered sphere. Usually, the incident beam is expanded to its vector spherical harmonic representation defined by beam shape coefficients, and the multilayer sphere scattering is obtained by the T-matrix method. However, obtaining the beam shape coefficients for arbitrarily shaped incident beams has limitations on sour… ▽ More Mie theory is a powerful method to model electromagnetic scattering from a multilayered sphere. Usually, the incident beam is expanded to its vector spherical harmonic representation defined by beam shape coefficients, and the multilayer sphere scattering is obtained by the T-matrix method. However, obtaining the beam shape coefficients for arbitrarily shaped incident beams has limitations on source locations and requires different methods when the incident beam is defined inside or outside the computational domain or at the scatterer surface. We propose a 3D angular spectrum method for defining beam shape coefficients from arbitrary source field distributions. This method enables the placement of the sources freely within the computational domain without singularities, allowing flexibility in beam design. We demonstrate incident field synthesis and spherical scattering by comparing morphology-dependent resonances to known values, achieving excellent matching and high accuracy. Additionally, we present mathematical proof to support our proposal. The proposed method has significant benefits for optical systems and inverse beam design. It allows for the analysis of electromagnetic forward/backward propagation between optical elements and spherical targets using a single method. It is also valuable for optical force beam design and analysis. △ Less

Submitted 25 April, 2023; v1 submitted 7 September, 2022; originally announced September 2022.

Submillimeter-wave cornea phantom sensing over an extended depth of field with an axicon-generated Bessel beam

Authors: Mariangela Baggio, Aleksi Tamminen, Joel Lamberg, Roman Grigorev, Samu-Ville Pälli, Juha Ala-Laurinaho, Irina Nefedova, Jean-Louis Bourges, Sophie X. Deng, Elliott R. Brown, Vincent P. Wallace, Zachary D. Taylor

Abstract: The feasibility of a 220 - 330 GHz zero order axicon generated Bessel beam for corneal water content was explored. Simulation and experimental data from the 25-degree cone angle hyperbolic-axicon lens illuminating metallic spherical targets demonstrate a monotonically decreasing, band integrated, backscatter intensity for increasing radius of curvature from 7 - 11 mm, when lens reflector and optic… ▽ More The feasibility of a 220 - 330 GHz zero order axicon generated Bessel beam for corneal water content was explored. Simulation and experimental data from the 25-degree cone angle hyperbolic-axicon lens illuminating metallic spherical targets demonstrate a monotonically decreasing, band integrated, backscatter intensity for increasing radius of curvature from 7 - 11 mm, when lens reflector and optical axis are aligned. Further, for radii >= 9.5 mm, maximum signal was obtained with a 1 mm transverse displacement between lens and reflector optical axes arising from spatial correlation between main lobe and out of phase side lobes. Thickness and permittivity parameter estimation experiments were performed on an 8 mm radius of curvature, 1 mm thick fused quartz dome over a 10 mm axial span. Extracted thickness and permittivity varied by less than ~ 25 $μ$m and 0.2 respectively after correction for superluminal velocity. Estimated water permittivity and thickness of water backed gelatin phantoms showed significantly more variation due to a time varying radius of curvature. △ Less

Submitted 26 February, 2023; v1 submitted 25 June, 2022; originally announced June 2022.

Comments: 11 pages; submitted to IEEE Transactions on Terahertz Science and Technology

Coupling to longitudinal modes in spherical thin shells illuminated by submillimeter wave Gaussian beam: applications to corneal sensing

Authors: Faezeh Zarrinkhat, Joel Lamberg, Aleksi Tamminen, Mariangela Baggio, Juha Ala-Laurinaho, Elsayed E. M. Khaled, Juan Rius, Jordi Romeu, Zachary Taylor

Abstract: Coupling to longitudinal modes of thin spherical shells, under Gaussian-beam illumination, was explored with a theoretical method based on Fourier-optics analysis and vector spherical harmonics. The illumination frequency band was fixed between 100-600 GHz and the outer spherical shell radius of curvature and thickness are 7.5 mm and 0.5 mm, respectively. The shell material was either the lossless… ▽ More Coupling to longitudinal modes of thin spherical shells, under Gaussian-beam illumination, was explored with a theoretical method based on Fourier-optics analysis and vector spherical harmonics. The illumination frequency band was fixed between 100-600 GHz and the outer spherical shell radius of curvature and thickness are 7.5 mm and 0.5 mm, respectively. The shell material was either the lossless cornea or an aqueous effective media representing the cornea. Six different beam-target strategies were introduced being potential candidates for maximum coupling. Two dispersion-tuned beam ensembles with strongly frequency-dependent phase center location have been created with a fixed incident beam 1/e radius and radius of curvature called forward strategies. These computations of different alignments were continued with four beam ensembles of frequency-invariant phase center, constructed from fits to experimental data, oriented at four different axial locations with respect to the spherical shell center of curvature, they are called reverse strategies. Coupling efficiency for all strategies was calculated for different targets including PEC sphere, air-core, and PEC core covered by a cornea loss-free layer and cornea. All scattering strategies contrasted to scattering from equivalent planar targets as a reference with maximum coupling. The results show that, under an ideal calibration, forward strategies are a closer approximation to the plane-wave condition. However, target properties influence the coupling efficiency remarkably for instance the observed difference in cornea scattering is vanishingly small as dielectric loss limits walk-off loss. Furthermore, under perturbed calibration, the forward strategies showed less sensitivity. △ Less

Submitted 30 November, 2021; originally announced December 2021.

Comments: 21 pages, 12 figures

Prostate motion modelling using biomechanically-trained deep neural networks on unstructured nodes

Authors: Shaheer U. Saeed, Zeike A. Taylor, Mark A. Pinnock, Mark Emberton, Dean C. Barratt, Yipeng Hu

Abstract: In this paper, we propose to train deep neural networks with biomechanical simulations, to predict the prostate motion encountered during ultrasound-guided interventions. In this application, unstructured points are sampled from segmented pre-operative MR images to represent the anatomical regions of interest. The point sets are then assigned with point-specific material properties and displacemen… ▽ More In this paper, we propose to train deep neural networks with biomechanical simulations, to predict the prostate motion encountered during ultrasound-guided interventions. In this application, unstructured points are sampled from segmented pre-operative MR images to represent the anatomical regions of interest. The point sets are then assigned with point-specific material properties and displacement loads, forming the un-ordered input feature vectors. An adapted PointNet can be trained to predict the nodal displacements, using finite element (FE) simulations as ground-truth data. Furthermore, a versatile bootstrap aggregating mechanism is validated to accommodate the variable number of feature vectors due to different patient geometries, comprised of a training-time bootstrap sampling and a model averaging inference. This results in a fast and accurate approximation to the FE solutions without requiring subject-specific solid meshing. Based on 160,000 nonlinear FE simulations on clinical imaging data from 320 patients, we demonstrate that the trained networks generalise to unstructured point sets sampled directly from holdout patient segmentation, yielding a near real-time inference and an expected error of 0.017 mm in predicted nodal displacement. △ Less

Submitted 9 July, 2020; originally announced July 2020.

Comments: Accepted to MICCAI 2020

Design and optimal control of a tiltrotor micro aerial vehicle for efficient omnidirectional flight

Authors: Mike Allenspach, Karen Bodie, Maximilian Brunner, Luca Rinsoz, Zachary Taylor, Mina Kamel, Roland Siegwart, Juan Nieto

Abstract: Omnidirectional micro aerial vehicles are a growing field of research, with demonstrated advantages for aerial interaction and uninhibited observation. While systems with complete pose omnidirectionality and high hover efficiency have been developed independently, a robust system that combines the two has not been demonstrated to date. This paper presents the design and optimal control of a novel… ▽ More Omnidirectional micro aerial vehicles are a growing field of research, with demonstrated advantages for aerial interaction and uninhibited observation. While systems with complete pose omnidirectionality and high hover efficiency have been developed independently, a robust system that combines the two has not been demonstrated to date. This paper presents the design and optimal control of a novel omnidirectional vehicle that can exert a wrench in any orientation while maintaining efficient flight configurations. The system design is motivated by the result of a morphology design optimization. A six degrees of freedom optimal controller is derived, with an actuator allocation approach that implements task prioritization, and is robust to singularities. Flight experiments demonstrate and verify the system's capabilities. △ Less

Submitted 20 March, 2020; originally announced March 2020.

Comments: 16 pages, 24 figures, 3 page appendix, video available at https://youtu.be/mBi9mOQaZzQ

Physics webpages create barriers to participation for people with disabilities: Five steps to increase digital accessibility

Authors: Erin Scanlon, Zachary W. Taylor, Jacquelyn J. Chini

Abstract: While there have been numerous calls to increase the participation of people with disabilities in STEM, many postsecondary institutions are not equipped to support students with disabilities. We examined the digital accessibility of 139 webpages from 73 postsecondary institutions that contained information about the undergraduate physics curriculum and graduate research programs. We selected these… ▽ More While there have been numerous calls to increase the participation of people with disabilities in STEM, many postsecondary institutions are not equipped to support students with disabilities. We examined the digital accessibility of 139 webpages from 73 postsecondary institutions that contained information about the undergraduate physics curriculum and graduate research programs. We selected these webpages as they are common entry points for students interested in pursuing a physics degree. We used Tenon and Mac OS X's Voiceover software to assess the accessibility of these webpages as measured by alignment with the Web Content Accessibility Guidelines (WCAG) 2.0. We found only one webpage was accessible for students with disabilities. We present five common accessibility errors we identified in the webpages in our sample, suggested solutions for these errors, and implications for students with disabilities, instructors and staff, institutional administration, and the broader physics community. △ Less

Submitted 13 November, 2019; v1 submitted 5 July, 2019; originally announced July 2019.

An Open-Source System for Vision-Based Micro-Aerial Vehicle Map**, Planning, and Flight in Cluttered Environments

Authors: Helen Oleynikova, Christian Lanegger, Zachary Taylor, Michael Pantic, Alexander Millane, Roland Siegwart, Juan Nieto

Abstract: We present an open-source system for Micro-Aerial Vehicle autonomous navigation from vision-based sensing. Our system focuses on dense map**, safe local planning, and global trajectory generation, especially when using narrow field of view sensors in very cluttered environments. In addition, details about other necessary parts of the system and special considerations for applications in real-wor… ▽ More We present an open-source system for Micro-Aerial Vehicle autonomous navigation from vision-based sensing. Our system focuses on dense map**, safe local planning, and global trajectory generation, especially when using narrow field of view sensors in very cluttered environments. In addition, details about other necessary parts of the system and special considerations for applications in real-world scenarios are presented. We focus our experiments on evaluating global planning, path smoothing, and local planning methods on real maps made on MAVs in realistic search and rescue and industrial inspection scenarios. We also perform thousands of simulations in cluttered synthetic environments, and finally validate the complete system in real-world experiments. △ Less

Submitted 14 July, 2020; v1 submitted 10 December, 2018; originally announced December 2018.

Journal ref: An open-source system for vision-based micro-aerial vehicle map**, planning, and flight in cluttered environments. J. Field Robotics 37(4): 642-666 (2020)

Machine Learning Methods for Track Classification in the AT-TPC

Authors: Michelle P. Kuchera, Raghuram Ramanujan, Jack Z. Taylor, Ryan R. Strauss, Daniel Bazin, Joshua Bradt, Ruiming Chen

Abstract: We evaluate machine learning methods for event classification in the Active-Target Time Projection Chamber detector at the National Superconducting Cyclotron Laboratory (NSCL) at Michigan State University. An automated method to single out the desired reaction product would result in more accurate physics results as well as a faster analysis process. Binary and multi-class classification methods w… ▽ More We evaluate machine learning methods for event classification in the Active-Target Time Projection Chamber detector at the National Superconducting Cyclotron Laboratory (NSCL) at Michigan State University. An automated method to single out the desired reaction product would result in more accurate physics results as well as a faster analysis process. Binary and multi-class classification methods were tested on data produced by the $^{46}$Ar(p,p) experiment run at the NSCL in September 2015. We found a Convolutional Neural Network to be the most successful classifier of proton scattering events for transfer learning. Results from this investigation and recommendations for event classification in future experiments are presented. △ Less

Submitted 29 April, 2019; v1 submitted 21 October, 2018; originally announced October 2018.

Report number: NIMA-D-18-01137

Journal ref: NIMA 940 (2019) 56-167, ISSN 0168-9002

Towards Efficient Full Pose Omnidirectionality with Overactuated MAVs

Authors: Karen Bodie, Zachary Taylor, Mina Kamel, Roland Siegwart

Abstract: Omnidirectional MAVs are a growing field, with demonstrated advantages for aerial interaction and uninhibited observation. While systems with complete pose omnidirectionality and high hover efficiency have been developed independently, a robust system that combines the two has not been demonstrated to date. This paper presents VoliroX: a novel omnidirectional vehicle that can exert a wrench in any… ▽ More Omnidirectional MAVs are a growing field, with demonstrated advantages for aerial interaction and uninhibited observation. While systems with complete pose omnidirectionality and high hover efficiency have been developed independently, a robust system that combines the two has not been demonstrated to date. This paper presents VoliroX: a novel omnidirectional vehicle that can exert a wrench in any orientation while maintaining efficient flight configurations. The system design is presented, and a 6 DOF geometric control that is robust to singularities. Flight experiments further demonstrate and verify its capabilities. △ Less

Submitted 6 April, 2020; v1 submitted 15 October, 2018; originally announced October 2018.

Comments: 10 pages, 6 figures, ISER 2018 conference submission

Journal ref: ISER 2018: Proceedings of the 2018 International Symposium on Experimental Robotics, pp 85-95

Sparse 3D Topological Graphs for Micro-Aerial Vehicle Planning

Authors: Helen Oleynikova, Zachary Taylor, Roland Siegwart, Juan Nieto

Abstract: Micro-Aerial Vehicles (MAVs) have the advantage of moving freely in 3D space. However, creating compact and sparse map representations that can be efficiently used for planning for such robots is still an open problem. In this paper, we take maps built from noisy sensor data and construct a sparse graph containing topological information that can be used for 3D planning. We use a Euclidean Signed… ▽ More Micro-Aerial Vehicles (MAVs) have the advantage of moving freely in 3D space. However, creating compact and sparse map representations that can be efficiently used for planning for such robots is still an open problem. In this paper, we take maps built from noisy sensor data and construct a sparse graph containing topological information that can be used for 3D planning. We use a Euclidean Signed Distance Field, extract a 3D Generalized Voronoi Diagram (GVD), and obtain a thin skeleton diagram representing the topological structure of the environment. We then convert this skeleton diagram into a sparse graph, which we show is resistant to noise and changes in resolution. We demonstrate global planning over this graph, and the orders of magnitude speed-up it offers over other common planning methods. We validate our planning algorithm in real maps built onboard an MAV, using RGB-D sensing. △ Less

Submitted 24 July, 2018; v1 submitted 12 March, 2018; originally announced March 2018.

Comments: Accepted for publication in IEEE IROS 2018

Voliro: An Omnidirectional Hexacopter With Tiltable Rotors

Authors: Mina Kamel, Sebastian Verling, Omar Elkhatib, Christian Sprecher, Paula Wulkop, Zachary Taylor, Roland Siegwart, Igor Gilitschenski

Abstract: Extending the maneuverability of unmanned areal vehicles promises to yield a considerable increase in the areas in which these systems can be used. Some such applications are the performance of more complicated inspection tasks and the generation of complex uninterrupted movements of an attached camera. In this paper we address this challenge by presenting Voliro, a novel aerial platform that comb… ▽ More Extending the maneuverability of unmanned areal vehicles promises to yield a considerable increase in the areas in which these systems can be used. Some such applications are the performance of more complicated inspection tasks and the generation of complex uninterrupted movements of an attached camera. In this paper we address this challenge by presenting Voliro, a novel aerial platform that combines the advantages of existing multi-rotor systems with the agility of omnidirectionally controllable platforms. We propose the use of a hexacopter with tiltable rotors allowing the system to decouple the control of position and orientation. The contributions of this work involve the mechanical design as well as a controller with the corresponding allocation scheme. This work also discusses the design challenges involved when turning the concept of a hexacopter with tiltable rotors into an actual prototype. The agility of the system is demonstrated and evaluated in real- world experiments. △ Less

Submitted 14 January, 2018; originally announced January 2018.

Comments: Submitted to Robotics and Automation Magazine

C-blox: A Scalable and Consistent TSDF-based Dense Map** Approach

Authors: Alexander Millane, Zachary Taylor, Helen Oleynikova, Juan Nieto, Roland Siegwart, César Cadena

Abstract: In many applications, maintaining a consistent dense map of the environment is key to enabling robotic platforms to perform higher level decision making. Several works have addressed the challenge of creating precise dense 3D maps from visual sensors providing depth information. However, during operation over longer missions, reconstructions can easily become inconsistent due to accumulated camera… ▽ More In many applications, maintaining a consistent dense map of the environment is key to enabling robotic platforms to perform higher level decision making. Several works have addressed the challenge of creating precise dense 3D maps from visual sensors providing depth information. However, during operation over longer missions, reconstructions can easily become inconsistent due to accumulated camera tracking error and delayed loop closure. Without explicitly addressing the problem of map consistency, recovery from such distortions tends to be difficult. We present a novel system for dense 3D map** which addresses the challenge of building consistent maps while dealing with scalability. Central to our approach is the representation of the environment as a collection of overlap** TSDF subvolumes. These subvolumes are localized through feature-based camera tracking and bundle adjustment. Our main contribution is a pipeline for identifying stable regions in the map, and to fuse the contributing subvolumes. This approach allows us to reduce map growth while still maintaining consistency. We demonstrate the proposed system on a publicly available dataset and simulation engine, and demonstrate the efficacy of the proposed approach for building consistent and scalable maps. Finally we demonstrate our approach running in real-time on-board a lightweight MAV. △ Less

Submitted 25 September, 2018; v1 submitted 19 October, 2017; originally announced October 2017.

Comments: 8 pages, 5 figures, conference

Safe Local Exploration for Replanning in Cluttered Unknown Environments for Micro-Aerial Vehicles

Authors: Helen Oleynikova, Zachary Taylor, Roland Siegwart, Juan Nieto

Abstract: In order to enable Micro-Aerial Vehicles (MAVs) to assist in complex, unknown, unstructured environments, they must be able to navigate with guaranteed safety, even when faced with a cluttered environment they have no prior knowledge of. While trajectory optimization-based local planners have been shown to perform well in these cases, prior work either does not address how to deal with local minim… ▽ More In order to enable Micro-Aerial Vehicles (MAVs) to assist in complex, unknown, unstructured environments, they must be able to navigate with guaranteed safety, even when faced with a cluttered environment they have no prior knowledge of. While trajectory optimization-based local planners have been shown to perform well in these cases, prior work either does not address how to deal with local minima in the optimization problem, or solves it by using an optimistic global planner. We present a conservative trajectory optimization-based local planner, coupled with a local exploration strategy that selects intermediate goals. We perform extensive simulations to show that this system performs better than the standard approach of using an optimistic global planner, and also outperforms doing a single exploration step when the local planner is stuck. The method is validated through experiments in a variety of highly cluttered environments including a dense forest. These experiments show the complete system running in real time fully onboard an MAV, map** and replanning at 4 Hz. △ Less

Submitted 12 March, 2018; v1 submitted 2 October, 2017; originally announced October 2017.

Comments: Accepted to ICRA 2018 and RA-L 2018

Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning

Authors: Helen Oleynikova, Zachary Taylor, Marius Fehr, Juan Nieto, Roland Siegwart

Abstract: Micro Aerial Vehicles (MAVs) that operate in unstructured, unexplored environments require fast and flexible local planning, which can replan when new parts of the map are explored. Trajectory optimization methods fulfill these needs, but require obstacle distance information, which can be given by Euclidean Signed Distance Fields (ESDFs). We propose a method to incrementally build ESDFs from Tr… ▽ More Micro Aerial Vehicles (MAVs) that operate in unstructured, unexplored environments require fast and flexible local planning, which can replan when new parts of the map are explored. Trajectory optimization methods fulfill these needs, but require obstacle distance information, which can be given by Euclidean Signed Distance Fields (ESDFs). We propose a method to incrementally build ESDFs from Truncated Signed Distance Fields (TSDFs), a common implicit surface representation used in computer graphics and vision. TSDFs are fast to build and smooth out sensor noise over many observations, and are designed to produce surface meshes. Meshes allow human operators to get a better assessment of the robot's environment, and set high-level mission goals. We show that we can build TSDFs faster than Octomaps, and that it is more accurate to build ESDFs out of TSDFs than occupancy maps. Our complete system, called voxblox, will be available as open source and runs in real-time on a single CPU core. We validate our approach on-board an MAV, by using our system with a trajectory optimization local planner, entirely on-board and in real-time. △ Less

Submitted 21 April, 2017; v1 submitted 11 November, 2016; originally announced November 2016.

Comments: Submitted to IROS 2017. Videos available at https://www.youtube.com/watch?v=PlqT5zNsvwM and https://www.youtube.com/watch?v=lrGSwAPzMOQ

Experimental study of the initial growth of a localized turbulent patch in a stably stratified fluid

Authors: Lilly Verso, Maarten van Reeuwijk, Roi Gurka, Peter J. Diamessis, Zachary J. Taylor, Alex Liberzon

Abstract: We present a laboratory experiment of the growth of a turbulent patch in a stably stratified fluid, due to a localized source of turbulence, generated by an oscillating grid. Synchronized and overlap** particle image velocimetry and planar laser induced fluorescence measurements have been conducted capturing the evolution of the patch through its initial growth until it reached a maximum size, f… ▽ More We present a laboratory experiment of the growth of a turbulent patch in a stably stratified fluid, due to a localized source of turbulence, generated by an oscillating grid. Synchronized and overlap** particle image velocimetry and planar laser induced fluorescence measurements have been conducted capturing the evolution of the patch through its initial growth until it reached a maximum size, followed by its collapse. The simultaneous measurements of density and velocity fields allow for a direct quantification of the degree of mixing within the patch, the propagation speed of the turbulent/non-turbulent interface and its thickness. The velocity measurements indicate significant non-equilibrium effects inside the patch which are not consistent with the classical used grid-action model. A local analysis of the turbulent/non-turbulent interface provides direct measurements of the entrainment velocity $w_{e}$ as compared to the local vertical velocity and turbulent intensity at the proximity of the interface. It is found that the entrainment rate $E$ is constrained in the range of $0÷0.1$ and that the local, gradient Richardson number at the interface is $\mathcal{O} (100)$. Finally, we show that the mean flow is responsible for the patch collapse. △ Less

Submitted 24 March, 2016; v1 submitted 21 March, 2016; originally announced March 2016.

Comments: 25 pages, 13 figures

Estimation of unsteady aerodynamics in the wake of a freely flying European starling

Authors: Hadar Ben-Gida, Adam Kirchhefer, Zachary J. Taylor, Wayne Bezner-Kerr, Christopher G. Guglielmo, Gregory A. Kopp, Roi Gurka

Abstract: Wing flap** is one of the most widespread propulsion methods found in nature; however, the current understanding of the aerodynamics in bird wakes is incomplete. The role of the unsteady motion in the flow and its contribution to the aerodynamics is still an open question. In the current study, the wake of a freely flying European starling has been investigated using long-duration high-speed Par… ▽ More Wing flap** is one of the most widespread propulsion methods found in nature; however, the current understanding of the aerodynamics in bird wakes is incomplete. The role of the unsteady motion in the flow and its contribution to the aerodynamics is still an open question. In the current study, the wake of a freely flying European starling has been investigated using long-duration high-speed Particle Image Velocimetry (PIV) in the near wake. Kinematic analysis of the wings and body of the bird has been performed using additional high-speed cameras that recorded the bird movement simultaneously with the PIV measurements. The wake evolution of four complete wingbeats has been characterized through reconstruction of the time resolved data, and the aerodynamics in the wake have been analyzed in terms of the streamwise forces acting on the bird. The profile drag from classical aerodynamics was found to be positive during most of the wingbeat cycle, yet kinematic images show that the bird does not decelerate. It is shown that unsteady aerodynamics are necessary to satisfy the drag/thrust balance by approximating the unsteady drag term. These findings may shed light on the flight efficiency of birds by providing a partial answer to how they minimize drag during flap** flight. △ Less

Submitted 1 June, 2013; originally announced June 2013.

Experiments on the vortex wake of a swimming knifefish

Authors: Zachary J. Taylor, Alexander Liberzon, Roi Gurka, Roi Holzman, Thomas Reesbeck, F. Javier Diez

Abstract: The knifefish species propels itself by generating a reverse Karman street from an anal fin and without significantly moving its body. This unique feature makes this species' propulsion method highly efficient (Blake, 1983). It has been suggested that there is an optimal swimming range for fish based on the amplitude and frequency of the reverse Kármán street. Experiments have been performed to me… ▽ More The knifefish species propels itself by generating a reverse Karman street from an anal fin and without significantly moving its body. This unique feature makes this species' propulsion method highly efficient (Blake, 1983). It has been suggested that there is an optimal swimming range for fish based on the amplitude and frequency of the reverse Kármán street. Experiments have been performed to measure the ratio between the amplitude and wavelength of vortices in the wake of a knifefish. It is suggested that by optimizing the thrust created by the reverse Karman street the wave efficiency can be estimated for a given spacing ratio, and present observations have an average value of 0.89. The relationship established between spacing ratio and wave efficiency, in addition to the measured parameters, will be invaluable for bio-inspired designs based on the knifefish. △ Less

Submitted 30 October, 2012; originally announced October 2012.

Comments: Submitted for consideration to Experiments in Fluids, October 2012

Turbulent flow over a house in a simulated hurricane boundary layer

Authors: Zachary Taylor, Murray Morrison, Roi Gurka, Gregory Kopp

Abstract: Every year hurricanes and other extreme wind storms cause billions of dollars in damage worldwide. For residential construction, such failures are usually associated with roofs, which see the largest aerodynamic loading. However, determining aerodynamic loads on different portions of North American houses is complicated by the lack of clear load paths and non-linear load sharing in wood frame ro… ▽ More Every year hurricanes and other extreme wind storms cause billions of dollars in damage worldwide. For residential construction, such failures are usually associated with roofs, which see the largest aerodynamic loading. However, determining aerodynamic loads on different portions of North American houses is complicated by the lack of clear load paths and non-linear load sharing in wood frame roofs. This problem of fluid-structure interaction requires both wind tunnel testing and full-scale structural testing. A series of wind tunnel tests have been performed on a house in a simulated atmospheric boundary layer (ABL), with the resulting wind-induced pressures applied to the full-scale structure. The ABL was simulated for flow over open country terrain where both velocity and turbulence intensity profiles, as well as spectra, were matched with available full scale measurements for this type of terrain. The first set of measurements was 600 simultaneous surface pressure measurements over the entire house. A key feature of the surface pressure field is the occurrence of large, highly non-Gaussian, peak uplift (suctions) on the roof. In order to better understand which flow features cause this, PIV experiments were performed on the wind tunnel model. These experiments were performed with time-resolved PIV (sampling rate of 500 Hz) for a duration of 30 seconds. From the fluid dynamics videos (low- and high-resolution) generated from the PIV data it is clear that strong circulation is generated at the windward edge of the roof. These vortices are eventually shed and convect along the roof. It is the presence of this concentrated circulation which is responsible for the peak loading observed. △ Less

Submitted 16 October, 2009; originally announced October 2009.

Comments: Abstract for Gallery of Fluid Motion 2009 in Minneapolis

Turbulent Diamagnetism in Flowing Liquid Sodium

Authors: E. J. Spence, M. D. Nornberg, C. M. Jacobson, C. A. Parada, N. Z. Taylor, R. D. Kendrick, C. B. Forest

Abstract: The nature of Ohm's law is examined in a turbulent flow of liquid sodium. A magnetic field is applied to the flowing sodium, and the resulting magnetic field is measured. The mean velocity field of the sodium is also measured in an identical-scale water model of the experiment. These two fields are used to determine the terms in Ohm's law, indicating the presence of currents driven by a turbulen… ▽ More The nature of Ohm's law is examined in a turbulent flow of liquid sodium. A magnetic field is applied to the flowing sodium, and the resulting magnetic field is measured. The mean velocity field of the sodium is also measured in an identical-scale water model of the experiment. These two fields are used to determine the terms in Ohm's law, indicating the presence of currents driven by a turbulent electromotive force. These currents result in a diamagnetic effect, generating magnetic field in opposition to the dominant fields of the experiment. The magnitude of the fluctuation-driven magnetic field is comparable to that of the field induced by the sodium's mean flow. △ Less

Submitted 8 February, 2007; originally announced February 2007.

Parallel Computing Environments and Methods for Power Distribution System Simulation

Authors: Ning Lu, Z. Todd Taylor, David P. Chassin, Ross T. Guttromson, R. Scott Studham

Abstract: The development of cost-effective highperformance parallel computing on multi-processor supercomputers makes it attractive to port excessively time consuming simulation software from personal computers (PC) to super computes. The power distribution system simulator (PDSS) takes a bottom-up approach and simulates load at the appliance level, where detailed thermal models for appliances are used.… ▽ More The development of cost-effective highperformance parallel computing on multi-processor supercomputers makes it attractive to port excessively time consuming simulation software from personal computers (PC) to super computes. The power distribution system simulator (PDSS) takes a bottom-up approach and simulates load at the appliance level, where detailed thermal models for appliances are used. This approach works well for a small power distribution system consisting of a few thousand appliances. When the number of appliances increases, the simulation uses up the PC memory and its runtime increases to a point where the approach is no longer feasible to model a practical large power distribution system. This paper presents an effort made to port a PC-based power distribution system simulator to a 128-processor shared-memory supercomputer. The paper offers an overview of the parallel computing environment and a description of the modification made to the PDSS model. The performance of the PDSS running on a standalone PC and on the supercomputer is compared. Future research direction of utilizing parallel computing in the power distribution system simulation is also addressed. △ Less

Submitted 18 September, 2004; originally announced September 2004.

Comments: 7 pages, 4 figures, 6 tables, submitted to HICSS-38