Showing 1–14 of 14 results for author: Byrnes, J

Whole-Body Dynamic Telelocomotion: A Step-to-Step Dynamics Approach to Human Walking Reference Generation

Authors: Guillermo Colin, Joseph Byrnes, Youngwoo Sim, Patrick Wensing, Joao Ramos

Abstract: Teleoperated humanoid robots hold significant potential as physical avatars for humans in hazardous and inaccessible environments, with the goal of channeling human intelligence and sensorimotor skills through these robotic counterparts. Precise coordination between humans and robots is crucial for accomplishing whole-body behaviors involving locomotion and manipulation. To progress successfully,… ▽ More Teleoperated humanoid robots hold significant potential as physical avatars for humans in hazardous and inaccessible environments, with the goal of channeling human intelligence and sensorimotor skills through these robotic counterparts. Precise coordination between humans and robots is crucial for accomplishing whole-body behaviors involving locomotion and manipulation. To progress successfully, dynamic synchronization between humans and humanoid robots must be achieved. This work enhances advancements in whole-body dynamic telelocomotion, addressing challenges in robustness. By embedding the hybrid and underactuated nature of bipedal walking into a virtual human walking interface, we achieve dynamically consistent walking gait generation. Additionally, we integrate a reactive robot controller into a whole-body dynamic telelocomotion framework. Thus, allowing the realization of telelocomotion behaviors on the full-body dynamics of a bipedal robot. Real-time telelocomotion simulation experiments validate the effectiveness of our methods, demonstrating that a trained human pilot can dynamically synchronize with a simulated bipedal robot, achieving sustained locomotion, controlling walking speeds within the range of 0.0 m/s to 0.3 m/s, and enabling backward walking for distances of up to 2.0 m. This research contributes to advancing teleoperated humanoid robots and paves the way for future developments in synchronized locomotion between humans and bipedal robots. △ Less

Submitted 21 July, 2023; v1 submitted 19 July, 2023; originally announced July 2023.

Comments: 8 pages, 8 figures

From fat droplets to floating forests: cross-domain transfer learning using a PatchGAN-based segmentation model

Authors: Kameswara Bharadwaj Mantha, Ramanakumar Sankar, Yu** Zheng, Lucy Fortson, Thomas Pengo, Douglas Mashek, Mark Sanders, Trace Christensen, Jeffrey Salisbury, Laura Trouille, Jarrett E. K. Byrnes, Isaac Rosenthal, Henry Houskeeper, Kyle Cavanaugh

Abstract: Many scientific domains gather sufficient labels to train machine algorithms through human-in-the-loop techniques provided by the Zooniverse.org citizen science platform. As the range of projects, task types and data rates increase, acceleration of model training is of paramount concern to focus volunteer effort where most needed. The application of Transfer Learning (TL) between Zooniverse projec… ▽ More Many scientific domains gather sufficient labels to train machine algorithms through human-in-the-loop techniques provided by the Zooniverse.org citizen science platform. As the range of projects, task types and data rates increase, acceleration of model training is of paramount concern to focus volunteer effort where most needed. The application of Transfer Learning (TL) between Zooniverse projects holds promise as a solution. However, understanding the effectiveness of TL approaches that pretrain on large-scale generic image sets vs. images with similar characteristics possibly from similar tasks is an open challenge. We apply a generative segmentation model on two Zooniverse project-based data sets: (1) to identify fat droplets in liver cells (FatChecker; FC) and (2) the identification of kelp beds in satellite images (Floating Forests; FF) through transfer learning from the first project. We compare and contrast its performance with a TL model based on the COCO image set, and subsequently with baseline counterparts. We find that both the FC and COCO TL models perform better than the baseline cases when using >75% of the original training sample size. The COCO-based TL model generally performs better than the FC-based one, likely due to its generalized features. Our investigations provide important insights into usage of TL approaches on multi-domain data hosted across different Zooniverse projects, enabling future projects to accelerate task completion. △ Less

Submitted 7 November, 2022; originally announced November 2022.

Comments: 5 pages, 4 figures, accepted for publication at the Proceedings of the ACM/CIKM 2022 (Human-in-the-loop Data Curation Workshop)

Zero-Shot Learning with Knowledge Enhanced Visual Semantic Embeddings

Authors: Karan Sikka, Jihua Huang, Andrew Silberfarb, Prateeth Nayak, Luke Rohrer, Pritish Sahu, John Byrnes, Ajay Divakaran, Richard Rohwer

Abstract: We improve zero-shot learning (ZSL) by incorporating common-sense knowledge in DNNs. We propose Common-Sense based Neuro-Symbolic Loss (CSNL) that formulates prior knowledge as novel neuro-symbolic loss functions that regularize visual-semantic embedding. CSNL forces visual features in the VSE to obey common-sense rules relating to hypernyms and attributes. We introduce two key novelties for impro… ▽ More We improve zero-shot learning (ZSL) by incorporating common-sense knowledge in DNNs. We propose Common-Sense based Neuro-Symbolic Loss (CSNL) that formulates prior knowledge as novel neuro-symbolic loss functions that regularize visual-semantic embedding. CSNL forces visual features in the VSE to obey common-sense rules relating to hypernyms and attributes. We introduce two key novelties for improved learning: (1) enforcement of rules for a group instead of a single concept to take into account class-wise relationships, and (2) confidence margins inside logical operators that enable implicit curriculum learning and prevent premature overfitting. We evaluate the advantages of incorporating each knowledge source and show consistent gains over prior state-of-art methods in both conventional and generalized ZSL e.g. 11.5%, 5.5%, and 11.6% improvements on AWA2, CUB, and Kinetics respectively. △ Less

Submitted 21 November, 2020; originally announced November 2020.

Transformer Based Molecule Encoding for Property Prediction

Authors: Prateeth Nayak, Andrew Silberfarb, Ran Chen, Tulay Muezzinoglu, John Byrnes

Abstract: Neural methods of molecule property prediction require efficient encoding of structure and property relationship to be accurate. Recent work using graph algorithms shows limited generalization in the latent molecule encoding space. We build a Transformer-based molecule encoder and property predictor network with novel input featurization that performs significantly better than existing methods. We… ▽ More Neural methods of molecule property prediction require efficient encoding of structure and property relationship to be accurate. Recent work using graph algorithms shows limited generalization in the latent molecule encoding space. We build a Transformer-based molecule encoder and property predictor network with novel input featurization that performs significantly better than existing methods. We adapt our model to semi-supervised learning to further perform well on the limited experimental data usually available in practice. △ Less

Submitted 25 November, 2020; v1 submitted 4 November, 2020; originally announced November 2020.

Comments: Machine Learning for Molecules Workshop, NeurIPs2020

Zero-shot Multi-Domain Dialog State Tracking Using Descriptive Rules

Authors: Edgar Altszyler, Pablo Brusco, Nikoletta Basiou, John Byrnes, Dimitra Vergyri

Abstract: In this work, we present a framework for incorporating descriptive logical rules in state-of-the-art neural networks, enabling them to learn how to handle unseen labels without the introduction of any new training data. The rules are integrated into existing networks without modifying their architecture, through an additional term in the network's loss function that penalizes states of the network… ▽ More In this work, we present a framework for incorporating descriptive logical rules in state-of-the-art neural networks, enabling them to learn how to handle unseen labels without the introduction of any new training data. The rules are integrated into existing networks without modifying their architecture, through an additional term in the network's loss function that penalizes states of the network that do not obey the designed rules. As a case of study, the framework is applied to an existing neural-based Dialog State Tracker. Our experiments demonstrate that the inclusion of logical rules allows the prediction of unseen labels, without deteriorating the predictive capacity of the original system. △ Less

Submitted 17 September, 2020; originally announced September 2020.

Deep Adaptive Semantic Logic (DASL): Compiling Declarative Knowledge into Deep Neural Networks

Authors: Karan Sikka, Andrew Silberfarb, John Byrnes, Indranil Sur, Ed Chow, Ajay Divakaran, Richard Rohwer

Abstract: We introduce Deep Adaptive Semantic Logic (DASL), a novel framework for automating the generation of deep neural networks that incorporates user-provided formal knowledge to improve learning from data. We provide formal semantics that demonstrate that our knowledge representation captures all of first order logic and that finite sampling from infinite domains converges to correct truth values. DAS… ▽ More We introduce Deep Adaptive Semantic Logic (DASL), a novel framework for automating the generation of deep neural networks that incorporates user-provided formal knowledge to improve learning from data. We provide formal semantics that demonstrate that our knowledge representation captures all of first order logic and that finite sampling from infinite domains converges to correct truth values. DASL's representation improves on prior neural-symbolic work by avoiding vanishing gradients, allowing deeper logical structure, and enabling richer interactions between the knowledge and learning components. We illustrate DASL through a toy problem in which we add structure to an image classification problem and demonstrate that knowledge of that structure reduces data requirements by a factor of $1000$. We then evaluate DASL on a visual relationship detection task and demonstrate that the addition of commonsense knowledge improves performance by $10.7\%$ in a data scarce setting. △ Less

Submitted 16 March, 2020; originally announced March 2020.

Surface-emitting electroholographic SAW modulator

Authors: Joy C. Perkinson, Michael G. Moebius, Elizabeth J. Brundage, William A. Teynor, Steven J. Byrnes, James C. Hsiao, William D. Sawyer, Dennis M. Callahan, Ian W. Frank, John J. LeBlanc, Gregg E. Favalora

Abstract: We report the design and operation of a surface-emitting surface acoustic wave (SAW) acousto-optical modulator which behaves as a cm-scale linear hologram in response to an applied electronic waveform. The modulator is formed by an optical waveguide, transducer, and out-coupling surface grating on a 1 mm-thick lithium niobate substrate. We demonstrate the ability to load and illuminate a 9-region… ▽ More We report the design and operation of a surface-emitting surface acoustic wave (SAW) acousto-optical modulator which behaves as a cm-scale linear hologram in response to an applied electronic waveform. The modulator is formed by an optical waveguide, transducer, and out-coupling surface grating on a 1 mm-thick lithium niobate substrate. We demonstrate the ability to load and illuminate a 9-region linear hologram into the modulator's 8 mm-long interaction region using applied waveforms of 280-320 MHz. To the best of the authors' knowledge, this is the first demonstration of a monolithically-integrated, surface-emitting SAW modulator fabricated using lithographic techniques. Applications include practical implementations of a holographic display. △ Less

Submitted 17 June, 2019; originally announced June 2019.

Comments: 6 pages plus 1 page of long-form references; 6 figures

ACM Class: B.4.2; H.5.1

Photorefractive second-harmonic detection for ultrasound-modulated optical tomography

Authors: Steven J. Byrnes

Abstract: Ultrasound-modulated optical tomography enables sharp 3D optical imaging of tissues and other turbid media, but the light modulation signals are hard to sensitively measure. A common solution, involving photorefractive crystals, enables the measurement of a relatively slow and low-spatial-resolution signal tracking the envelope of the ultrasound wave. We reexamine the photorefractive detection pri… ▽ More Ultrasound-modulated optical tomography enables sharp 3D optical imaging of tissues and other turbid media, but the light modulation signals are hard to sensitively measure. A common solution, involving photorefractive crystals, enables the measurement of a relatively slow and low-spatial-resolution signal tracking the envelope of the ultrasound wave. We reexamine the photorefractive detection principle both intuitively and quantitatively, and from this analysis we predict that the photodetector should additionally see a fast response at twice the ultrasound frequency, and correspondingly high spatial frequency. The fast and slow response usually have similar amplitudes and reveal complementary information, thus allowing ultrasound-modulated optical tomography to create dramatically sharper tomographic images under the same measurement conditions, integration time, and experimental complexity. △ Less

Submitted 17 April, 2018; originally announced April 2018.

Floating Forests: Quantitative Validation of Citizen Science Data Generated From Consensus Classifications

Authors: Isaac S. Rosenthal, Jarrett E. K. Byrnes, Kyle C. Cavanaugh, Tom W. Bell, Briana Harder, Alison J. Haupt, Andrew T. W. Rassweiler, Alejandro Pérez-Matus, Jorge Assis, Ali Swanson, Amy Boyer, Adam McMaster, Laura Trouille

Abstract: Large-scale research endeavors can be hindered by logistical constraints limiting the amount of available data. For example, global ecological questions require a global dataset, and traditional sampling protocols are often too inefficient for a small research team to collect an adequate amount of data. Citizen science offers an alternative by crowdsourcing data collection. Despite growing popular… ▽ More Large-scale research endeavors can be hindered by logistical constraints limiting the amount of available data. For example, global ecological questions require a global dataset, and traditional sampling protocols are often too inefficient for a small research team to collect an adequate amount of data. Citizen science offers an alternative by crowdsourcing data collection. Despite growing popularity, the community has been slow to embrace it largely due to concerns about quality of data collected by citizen scientists. Using the citizen science project Floating Forests (http://floatingforests.org), we show that consensus classifications made by citizen scientists produce data that is of comparable quality to expert generated classifications. Floating Forests is a web-based project in which citizen scientists view satellite photographs of coastlines and trace the borders of kelp patches. Since launch in 2014, over 7,000 citizen scientists have classified over 750,000 images of kelp forests largely in California and Tasmania. Images are classified by 15 users. We generated consensus classifications by overlaying all citizen classifications and assessed accuracy by comparing to expert classifications. Matthews correlation coefficient (MCC) was calculated for each threshold (1-15), and the threshold with the highest MCC was considered optimal. We showed that optimal user threshold was 4.2 with an MCC of 0.400 (0.023 SE) for Landsats 5 and 7, and a MCC of 0.639 (0.246 SE) for Landsat 8. These results suggest that citizen science data derived from consensus classifications are of comparable accuracy to expert classifications. Citizen science projects should implement methods such as consensus classification in conjunction with a quantitative comparison to expert generated classifications to avoid concerns about data quality. △ Less

Submitted 25 January, 2018; originally announced January 2018.

Comments: 14 pages, 5 figures, 2 tables, 1 supplemental figure

Multilayer optical calculations

Authors: Steven J. Byrnes

Abstract: When light hits a multilayer planar stack, it is reflected, refracted, and absorbed in a way that can be derived from the Fresnel equations. The analysis is treated in many textbooks, and implemented in many software programs, but certain aspects of it are difficult to find explicitly and consistently worked out in the literature. Here, we derive the formulas underlying the transfer-matrix method… ▽ More When light hits a multilayer planar stack, it is reflected, refracted, and absorbed in a way that can be derived from the Fresnel equations. The analysis is treated in many textbooks, and implemented in many software programs, but certain aspects of it are difficult to find explicitly and consistently worked out in the literature. Here, we derive the formulas underlying the transfer-matrix method of calculating the optical properties of these stacks, including oblique-angle incidence, absorption-vs-position profiles, and ellipsometry parameters. We discuss and explain some strange consequences of the formulas in the situation where the incident and/or final (semi-infinite) medium are absorptive, such as calculating $T>1$ in the absence of gain. We also discuss some implementation details like complex-plane branch cuts. Finally, we derive modified formulas for including one or more "incoherent" layers, i.e. very thick layers in which interference can be neglected. This document was written in conjunction with the "tmm" Python software package, which implements these calculations. △ Less

Submitted 30 December, 2020; v1 submitted 5 March, 2016; originally announced March 2016.

Comments: 20 pages including appendices. Changed in version 5: Fixed one minor typo - "Layer 5" --> "Layer 6" in Figure 3

Designing large, high-efficiency, high-numerical-aperture, transmissive meta-lenses for visible light

Authors: Steven J. Byrnes, Alan Lenef, Francesco Aieta, Federico Capasso

Abstract: A metasurface lens (meta-lens) bends light using nanostructures on a flat surface. Macroscopic meta-lenses (mm- to cm-scale diameter) have been quite difficult to simulate and optimize, due to the large area, the lack of periodicity, and the billions of adjustable parameters. We describe a method for designing a large-area meta-lens that allows not only prediction of the efficiency and far-field,… ▽ More A metasurface lens (meta-lens) bends light using nanostructures on a flat surface. Macroscopic meta-lenses (mm- to cm-scale diameter) have been quite difficult to simulate and optimize, due to the large area, the lack of periodicity, and the billions of adjustable parameters. We describe a method for designing a large-area meta-lens that allows not only prediction of the efficiency and far-field, but also optimization of the shape and position of each individual nanostructure, with a computational cost that is almost independent of the lens size. As examples, we design three large NA=0.94 meta-lenses: One with 79% predicted efficiency for yellow light, one with dichroic properties, and one broadband lens. All have a minimum feature size of 100nm. △ Less

Submitted 2 March, 2016; v1 submitted 15 November, 2015; originally announced November 2015.

Comments: 15 pages. v2: Minor revisions

Journal ref: Optics Express Vol. 24, Issue 5, pp. 5110-5124 (2016)

Reconstructing Native American Migrations from Whole-genome and Whole-exome Data

Authors: Simon Gravel, Fouad Zakharia, Andres Moreno-Estrada, Jake K Byrnes, Marina Muzzio, Juan L. Rodriguez-Flores, Eimear E. Kenny, Christopher R. Gignoux, Brian K. Maples, Wilfried Guiblet, Julie Dutil, Marc Via, Karla Sandoval, Gabriel Bedoya, Taras K Oleksyk, Andres Ruiz-Linares, Esteban G Burchard, Juan Carlos Martinez-Cruzado, Carlos D. Bustamante, The 1000 Genomes Project

Abstract: There is great scientific and popular interest in understanding the genetic history of populations in the Americas. We wish to understand when different regions of the continent were inhabited, where settlers came from, and how current inhabitants relate genetically to earlier populations. Recent studies unraveled parts of the genetic history of the continent using genoty** arrays and uniparenta… ▽ More There is great scientific and popular interest in understanding the genetic history of populations in the Americas. We wish to understand when different regions of the continent were inhabited, where settlers came from, and how current inhabitants relate genetically to earlier populations. Recent studies unraveled parts of the genetic history of the continent using genoty** arrays and uniparental markers. The 1000 Genomes Project provides a unique opportunity for improving our understanding of population genetic history by providing over a hundred sequenced low coverage genomes and exomes from Colombian (CLM), Mexican-American (MXL), and Puerto Rican (PUR) populations. Here, we explore the genomic contributions of African, European, and Native American ancestry to these populations. Estimated Native American ancestry is 48% in MXL, 25% in CLM, and 13% in PUR. Native American ancestry in PUR is most closely related to populations surrounding the Orinoco River basin, confirming the Southern America ancestry of the Taíno people of the Caribbean. We present new methods to estimate the allele frequencies in the Native American fraction of the populations, and model their distribution using a demographic model for three ancestral Native American populations. These ancestral populations likely split in close succession: the most likely scenario, based on a peopling of the Americas 16 thousand years ago (kya), supports that the MXL Ancestors split 12.2kya, with a subsequent split of the ancestors to CLM and PUR 11.7kya. The model also features effective populations of 62,000 in Mexico, 8,700 in Colombia, and 1,900 in Puerto Rico. Modeling Identity-by-descent and ancestry tract length, we show that post-contact populations differ markedly in their effective sizes and migration patterns, with Puerto Rico showing the smallest effective size and the earlier migration from Europe. △ Less

Submitted 15 November, 2013; v1 submitted 17 June, 2013; originally announced June 2013.

Comments: 30 pages, inludes supplement. v2 contains clarifications, extra analyses, and a change in the language classification scheme used

MSC Class: 92D25

Reconstructing the Population Genetic History of the Caribbean

Authors: Andres Moreno-Estrada, Simon Gravel, Fouad Zakharia, Jacob L. McCauley, Jake K. Byrnes, Christopher R. Gignoux, Patricia A. Ortiz-Tello, Ricardo J. Martinez, Dale J. Hedges, Richard W. Morris, Celeste Eng, Karla Sandoval, Suehelay Acevedo-Acevedo, Juan Carlos Martinez-Cruzado, Paul J. Norman, Zulay Layrisse, Peter Parham, Esteban Gonzalez Burchard, Michael L. Cuccaro, Eden R. Martin, Carlos D. Bustamante

Abstract: The Caribbean basin is home to some of the most complex interactions in recent history among previously diverged human populations. Here, by making use of genome-wide SNP array data, we characterize ancestral components of Caribbean populations on a sub-continental level and unveil fine-scale patterns of population structure distinguishing insular from mainland Caribbean populations as well as fro… ▽ More The Caribbean basin is home to some of the most complex interactions in recent history among previously diverged human populations. Here, by making use of genome-wide SNP array data, we characterize ancestral components of Caribbean populations on a sub-continental level and unveil fine-scale patterns of population structure distinguishing insular from mainland Caribbean populations as well as from other Hispanic/Latino groups. We provide genetic evidence for an inland South American origin of the Native American component in island populations and for extensive pre-Columbian gene flow across the Caribbean basin. The Caribbean-derived European component shows significant differentiation from parental Iberian populations, presumably as a result of founder effects during the colonization of the New World. Based on demographic models, we reconstruct the complex population history of the Caribbean since the onset of continental admixture. We find that insular populations are best modeled as mixtures absorbing two pulses of African migrants, coinciding with early and maximum activity stages of the transatlantic slave trade. These two pulses appear to have originated in different regions within West Africa, imprinting two distinguishable signatures in present day Afro-Caribbean genomes and shedding light on the genetic impact of the dynamics occurring during the slave trade in the Caribbean. △ Less

Submitted 3 June, 2013; originally announced June 2013.

Comments: 26 pages, 6 figures, and supporting information

Investigating the relationship between biodiversity and ecosystem multifunctionality: Challenges and solutions

Authors: Jarrett E. K. Byrnes, Lars Gamfeldt, Forest Isbell, Jonathan S. Lefcheck, John N. Griffin, Andrew Hector, Bradley J. Cardinale, David U. Hooper, Laura E. Dee, J. Emmett Duffy

Abstract: Extensive research shows that more species-rich assemblages are generally more productive and efficient in resource use than comparable assemblages with fewer species. But the question of how diversity simultaneously affects the wide variety of ecological functions that ecosystems perform remains relatively understudied, and it presents several analytical and empirical challenges that remain unres… ▽ More Extensive research shows that more species-rich assemblages are generally more productive and efficient in resource use than comparable assemblages with fewer species. But the question of how diversity simultaneously affects the wide variety of ecological functions that ecosystems perform remains relatively understudied, and it presents several analytical and empirical challenges that remain unresolved. In particular, researchers have developed several disparate metrics to quantify multifunctionality, each characterizing different aspects of the concept, and each with pros and cons. We compare four approaches to characterizing multifunctionality and its dependence on biodiversity, quantifying 1) magnitudes of multiple individual functions separately, 2) the extent to which different species promote different functions, 3) the average level of a suite of functions, and 4) the number of functions that simultaneously exceed a critical threshold. We illustrate each approach using data from the pan-European BIODEPTH experiment and the R multifunc package developed for this purpose, evaluate the strengths and weaknesses of each approach, and implement several methodological improvements. We conclude that a extension of the fourth approach that systematically explores all possible threshold values provides the most comprehensive description of multifunctionality to date. We outline this method and recommend its use in future research. △ Less

Submitted 8 May, 2013; originally announced May 2013.

Comments: This article has been submitted to Methods in Ecology & Evolution for review