Showing 1–13 of 13 results for author: Wild, B

Entropy bounds for Glass networks

Authors: Benjamin W. Wild, Roderick Edwards

Abstract: We propose that chaotic Glass networks (a class of piecewise-linear Ordinary Differential Equations) are good candidates for the design of true random number generators. A Glass network design has the advantage of involving only standard Boolean logic gates. Furthermore, an already chaotic (deterministic) system combined with random ``jitter'' due to thermal noise can be used to generate random bi… ▽ More We propose that chaotic Glass networks (a class of piecewise-linear Ordinary Differential Equations) are good candidates for the design of true random number generators. A Glass network design has the advantage of involving only standard Boolean logic gates. Furthermore, an already chaotic (deterministic) system combined with random ``jitter'' due to thermal noise can be used to generate random bit sequences in a more robust way than noisy limit-cycle oscillators. Since the goal is to generate bit sequences with as large a positive entropy as possible, it is desirable to have a theoretical method to assess the irregularity of a large class of networks. We develop a procedure here to calculate good upper bounds on the entropy of a Glass network, by means of symbolic representations of the continuous dynamics. Our method improves on a result by Farcot (2006), and allows in principle for an arbitrary level of precision by refinements of the estimate, and we show that in the limiting case, these estimates converge to the true entropy of the symbolic system corresponding to the continuous dynamics. As a check on the method, we demonstrate for an example network that our upper bound after only a few refinement steps is very close to the entropy estimated from a long numerical simulation. △ Less

Submitted 6 June, 2024; originally announced June 2024.

Comments: 40 pages, 19 figures

MSC Class: 34A36; 34C28; 37B10; 37B40; 94C99

Diffsurv: Differentiable sorting for censored time-to-event data

Authors: Andre Vauvelle, Benjamin Wild, Aylin Cakiroglu, Roland Eils, Spiros Denaxas

Abstract: Survival analysis is a crucial semi-supervised task in machine learning with numerous real-world applications, particularly in healthcare. Currently, the most common approach to survival analysis is based on Cox's partial likelihood, which can be interpreted as a ranking model optimized on a lower bound of the concordance index. This relation between ranking models and Cox's partial likelihood con… ▽ More Survival analysis is a crucial semi-supervised task in machine learning with numerous real-world applications, particularly in healthcare. Currently, the most common approach to survival analysis is based on Cox's partial likelihood, which can be interpreted as a ranking model optimized on a lower bound of the concordance index. This relation between ranking models and Cox's partial likelihood considers only pairwise comparisons. Recent work has developed differentiable sorting methods which relax this pairwise independence assumption, enabling the ranking of sets of samples. However, current differentiable sorting methods cannot account for censoring, a key factor in many real-world datasets. To address this limitation, we propose a novel method called Diffsurv. We extend differentiable sorting methods to handle censored tasks by predicting matrices of possible permutations that take into account the label uncertainty introduced by censored samples. We contrast this approach with methods derived from partial likelihood and ranking losses. Our experiments show that Diffsurv outperforms established baselines in various simulated and real-world risk prediction scenarios. Additionally, we demonstrate the benefits of the algorithmic supervision enabled by Diffsurv by presenting a novel method for top-k risk prediction that outperforms current methods. △ Less

Submitted 26 April, 2023; originally announced April 2023.

The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions

Authors: Jennifer J. Sun, Tomomi Karigo, Dipam Chakraborty, Sharada P. Mohanty, Benjamin Wild, Quan Sun, Chen Chen, David J. Anderson, Pietro Perona, Yisong Yue, Ann Kennedy

Abstract: Multi-agent behavior modeling aims to understand the interactions that occur between agents. We present a multi-agent dataset from behavioral neuroscience, the Caltech Mouse Social Interactions (CalMS21) Dataset. Our dataset consists of trajectory data of social interactions, recorded from videos of freely behaving mice in a standard resident-intruder assay. To help accelerate behavioral studies,… ▽ More Multi-agent behavior modeling aims to understand the interactions that occur between agents. We present a multi-agent dataset from behavioral neuroscience, the Caltech Mouse Social Interactions (CalMS21) Dataset. Our dataset consists of trajectory data of social interactions, recorded from videos of freely behaving mice in a standard resident-intruder assay. To help accelerate behavioral studies, the CalMS21 dataset provides benchmarks to evaluate the performance of automated behavior classification methods in three settings: (1) for training on large behavioral datasets all annotated by a single annotator, (2) for style transfer to learn inter-annotator differences in behavior definitions, and (3) for learning of new behaviors of interest given limited training data. The dataset consists of 6 million frames of unlabeled tracked poses of interacting mice, as well as over 1 million frames with tracked poses and corresponding frame-level behavior annotations. The challenge of our dataset is to be able to classify behaviors accurately using both labeled and unlabeled tracking data, as well as being able to generalize to new settings. △ Less

Submitted 18 November, 2021; v1 submitted 6 April, 2021; originally announced April 2021.

Comments: NeurIPS2021 Datasets & Benchmarks. Dataset: https://data.caltech.edu/records/1991, Website: https://sites.google.com/view/computational-behavior/our-datasets/calms21-dataset

BioTracker: An Open-Source Computer Vision Framework for Visual Animal Tracking

Authors: Hauke Jürgen Mönck, Andreas Jörg, Tobias von Falkenhausen, Julian Tanke, Benjamin Wild, David Dormagen, Jonas Piotrowski, Claudia Winklmayr, David Bierbach, Tim Landgraf

Abstract: The study of animal behavior increasingly relies on (semi-) automatic methods for the extraction of relevant behavioral features from video or picture data. To date, several specialized software products exist to detect and track animals' positions in simple (laboratory) environments. Tracking animals in their natural environments, however, often requires substantial customization of the image pro… ▽ More The study of animal behavior increasingly relies on (semi-) automatic methods for the extraction of relevant behavioral features from video or picture data. To date, several specialized software products exist to detect and track animals' positions in simple (laboratory) environments. Tracking animals in their natural environments, however, often requires substantial customization of the image processing algorithms to the problem-specific image characteristics. Here we introduce BioTracker, an open-source computer vision framework, that provides programmers with core functionalities that are essential parts of a tracking software, such as video I/O, graphics overlays and mouse and keyboard interfaces. BioTracker additionally provides a number of different tracking algorithms suitable for a variety of image recording conditions. The main feature of BioTracker is however the straightforward implementation of new problem-specific tracking modules and vision algorithms that can build upon BioTracker's core functionalities. With this open-source framework the scientific community can accelerate their research and focus on the development of new vision algorithms. △ Less

Submitted 21 March, 2018; originally announced March 2018.

Comments: 4 pages, 2 figures

Automatic localization and decoding of honeybee markers using deep convolutional neural networks

Authors: Benjamin Wild, Leon Sixt, Tim Landgraf

Abstract: The honeybee is a fascinating model animal to investigate how collective behavior emerges from (inter-)actions of thousands of individuals. Bees may acquire unique memories throughout their lives. These experiences affect social interactions even over large time frames. Tracking and identifying all bees in the colony over their lifetimes therefore may likely shed light on the interplay of individu… ▽ More The honeybee is a fascinating model animal to investigate how collective behavior emerges from (inter-)actions of thousands of individuals. Bees may acquire unique memories throughout their lives. These experiences affect social interactions even over large time frames. Tracking and identifying all bees in the colony over their lifetimes therefore may likely shed light on the interplay of individual differences and colony behavior. This paper proposes a software pipeline based on two deep convolutional neural networks for the localization and decoding of custom binary markers that honeybees carry from their first to the last day in their life. We show that this approach outperforms similar systems proposed in recent literature. By opening this software for the public, we hope that the resulting datasets will help advancing the understanding of honeybee collective intelligence. △ Less

Submitted 14 February, 2018; v1 submitted 13 February, 2018; originally announced February 2018.

Tracking all members of a honey bee colony over their lifetime

Authors: Franziska Boenisch, Benjamin Rosemann, Benjamin Wild, Fernando Wario, David Dormagen, Tim Landgraf

Abstract: Computational approaches to the analysis of collective behavior in social insects increasingly rely on motion paths as an intermediate data layer from which one can infer individual behaviors or social interactions. Honey bees are a popular model for learning and memory. Previous experience has been shown to affect and modulate future social interactions. So far, no lifetime history observations h… ▽ More Computational approaches to the analysis of collective behavior in social insects increasingly rely on motion paths as an intermediate data layer from which one can infer individual behaviors or social interactions. Honey bees are a popular model for learning and memory. Previous experience has been shown to affect and modulate future social interactions. So far, no lifetime history observations have been reported for all bees of a colony. In a previous work we introduced a tracking system customized to track up to $4000$ bees over several weeks. In this contribution we present an in-depth description of the underlying multi-step algorithm which both produces the motion paths, and also improves the marker decoding accuracy significantly. We automatically tracked ${\sim}2000$ marked honey bees over 10 weeks with inexpensive recording hardware using markers without any error correction bits. We found that the proposed two-step tracking reduced incorrect ID decodings from initially ${\sim}13\%$ to around $2\%$ post-tracking. Alongside this paper, we publish the first trajectory dataset for all bees in a colony, extracted from ${\sim} 4$ million images. We invite researchers to join the collective scientific effort to investigate this intriguing animal system. All components of our system are open-source. △ Less

Submitted 15 March, 2018; v1 submitted 9 February, 2018; originally announced February 2018.

Optimizing Long Short-Term Memory Recurrent Neural Networks Using Ant Colony Optimization to Predict Turbine Engine Vibration

Authors: AbdElRahman ElSaid, Travis Desell, Fatima El Jamiy, James Higgins, Brandon Wild

Abstract: This article expands on research that has been done to develop a recurrent neural network (RNN) capable of predicting aircraft engine vibrations using long short-term memory (LSTM) neurons. LSTM RNNs can provide a more generalizable and robust method for prediction over analytical calculations of engine vibration, as analytical calculations must be solved iteratively based on specific empirical en… ▽ More This article expands on research that has been done to develop a recurrent neural network (RNN) capable of predicting aircraft engine vibrations using long short-term memory (LSTM) neurons. LSTM RNNs can provide a more generalizable and robust method for prediction over analytical calculations of engine vibration, as analytical calculations must be solved iteratively based on specific empirical engine parameters, making this approach ungeneralizable across multiple engines. In initial work, multiple LSTM RNN architectures were proposed, evaluated and compared. This research improves the performance of the most effective LSTM network design proposed in the previous work by using a promising neuroevolution method based on ant colony optimization (ACO) to develop and enhance the LSTM cell structure of the network. A parallelized version of the ACO neuroevolution algorithm has been developed and the evolved LSTM RNNs were compared to the previously used fixed topology. The evolved networks were trained on a large database of flight data records obtained from an airline containing flights that suffered from excessive vibration. Results were obtained using MPI (Message Passing Interface) on a high performance computing (HPC) cluster, evolving 1000 different LSTM cell structures using 168 cores over 4 days. The new evolved LSTM cells showed an improvement of 1.35%, reducing prediction error from 5.51% to 4.17% when predicting excessive engine vibrations 10 seconds in the future, while at the same time dramatically reducing the number of weights from 21,170 to 11,810. △ Less

Submitted 10 October, 2017; originally announced October 2017.

Automatic detection and decoding of honey bee waggle dances

Authors: Fernando Wario, Benjamin Wild, Raúl Rojas, Tim Landgraf

Abstract: The waggle dance is one of the most popular examples of animal communication. Forager bees direct their nestmates to profitable resources via a complex motor display. Essentially, the dance encodes the polar coordinates to the resource in the field. Unemployed foragers follow the dancer's movements and then search for the advertised spots in the field. Throughout the last decades, biologists have… ▽ More The waggle dance is one of the most popular examples of animal communication. Forager bees direct their nestmates to profitable resources via a complex motor display. Essentially, the dance encodes the polar coordinates to the resource in the field. Unemployed foragers follow the dancer's movements and then search for the advertised spots in the field. Throughout the last decades, biologists have employed different techniques to measure key characteristics of the waggle dance and decode the information it conveys. Early techniques involved the use of protractors and stopwatches to measure the dance orientation and duration directly from the observation hive. Recent approaches employ digital video recordings and manual measurements on screen. However, manual approaches are very time-consuming. Most studies, therefore, regard only small numbers of animals in short periods of time. We have developed a system capable of automatically detecting, decoding and map** communication dances in real-time. In this paper, we describe our recording setup, the image processing steps performed for dance detection and decoding and an algorithm to map dances to the field. The proposed system performs with a detection accuracy of 90.07\%. The decoded waggle orientation has an average error of -2.92° ($\pm$ 7.37° ), well within the range of human error. To evaluate and exemplify the system's performance, a group of bees was trained to an artificial feeder, and all dances in the colony were automatically detected, decoded and mapped. The system presented here is the first of this kind made publicly available, including source code and hardware specifications. We hope this will foster quantitative analyses of the honey bee waggle dance. △ Less

Submitted 4 December, 2017; v1 submitted 22 August, 2017; originally announced August 2017.

Comments: 16 pages, LaTeX; a new value for the ratio distance-waggle run duration was computed. Figure 2 has been updated and discussion section was improved

A comparison of C-shaped and brush armature performance

Authors: Barbara Wild, Farid Alouahabi, Dejan Simicic, Markus Schneider, Ryan Hoffman

Abstract: The most important part of a railgun launch package is the armature where the electromagnetic force is generated leading to the acceleration of the launch package. In case of metal armatures, the most commonly used armature types are the C-shape and the multi-fiber brush technology. However, rarely both armature types were systematically compared under similar experimental conditions. That is why… ▽ More The most important part of a railgun launch package is the armature where the electromagnetic force is generated leading to the acceleration of the launch package. In case of metal armatures, the most commonly used armature types are the C-shape and the multi-fiber brush technology. However, rarely both armature types were systematically compared under similar experimental conditions. That is why we constructed launch packages based on the C-shaped and brush armature technology with comparable armature and payload mass. With these launch packages a series of experiments were performed in an energy range between 0.8 MJ and 1.13 MJ corresponding to a speed range between 950 m/s and 1400 m/s. The results of the experiments were then analyzed qualitatively and quantitatively. On the one hand our results show that the total losses are higher for the C-shaped armature technology than for the brush aramture technology. On the other hand our results show that launch packages based on the C-shaped technology convert better electrical energy into kinetic energy. △ Less

Submitted 14 February, 2017; originally announced February 2017.

Comments: Presented at the 18th Electromagnetic Launch Technology Symposium October 24-28, 2016, at Wuhan University, Wuhan, China. Submitted to the IEEE Transactions on Plasma Physics Special Issue Electromagnetic Launch 2016

RenderGAN: Generating Realistic Labeled Data

Authors: Leon Sixt, Benjamin Wild, Tim Landgraf

Abstract: Deep Convolutional Neuronal Networks (DCNNs) are showing remarkable performance on many computer vision tasks. Due to their large parameter space, they require many labeled samples when trained in a supervised setting. The costs of annotating data manually can render the use of DCNNs infeasible. We present a novel framework called RenderGAN that can generate large amounts of realistic, labeled ima… ▽ More Deep Convolutional Neuronal Networks (DCNNs) are showing remarkable performance on many computer vision tasks. Due to their large parameter space, they require many labeled samples when trained in a supervised setting. The costs of annotating data manually can render the use of DCNNs infeasible. We present a novel framework called RenderGAN that can generate large amounts of realistic, labeled images by combining a 3D model and the Generative Adversarial Network framework. In our approach, image augmentations (e.g. lighting, background, and detail) are learned from unlabeled data such that the generated images are strikingly realistic while preserving the labels known from the 3D model. We apply the RenderGAN framework to generate images of barcode-like markers that are attached to honeybees. Training a DCNN on data generated by the RenderGAN yields considerably better performance than training it on various baselines. △ Less

Submitted 12 January, 2017; v1 submitted 4 November, 2016; originally announced November 2016.

Dynamical Hartree-Fock-Bogoliubov Theory of Vortices in Bose-Einstein Condensates at Finite Temperature

Authors: B. G. Wild, D. A. W. Hutchinson

Abstract: We present a method utilizing the continuity equation for the condensate density to make predictions of the precessional frequency of single off-axis vortices and of vortex arrays in Bose-Einstein condensates at finite temperature. We also present an orthogonalized Hartree-Fock-Bogoliubov (HFB) formalism. We solve the continuity equation for the condensate density self-consistently with the orthog… ▽ More We present a method utilizing the continuity equation for the condensate density to make predictions of the precessional frequency of single off-axis vortices and of vortex arrays in Bose-Einstein condensates at finite temperature. We also present an orthogonalized Hartree-Fock-Bogoliubov (HFB) formalism. We solve the continuity equation for the condensate density self-consistently with the orthogonalized HFB equations, and find stationary solutions in the frame rotating at this frequency. As an example of the utility of this formalism we obtain time-independent solutions for quasi-two-dimensional rotating systems in the co-rotating frame. We compare these results with time-dependent predictions where we simulate stirring of the condensate. △ Less

Submitted 22 September, 2011; v1 submitted 7 December, 2010; originally announced December 2010.

Comments: 13 pages, 11 figures, 1 table

Precession of Vortices in Dilute Bose-Einstein Condensates at Finite Temperature

Authors: B. G. Wild, D. A. W. Hutchinson

Abstract: We demonstrate that the precessional frequencies of vortices in Bose Einstein condensates (BECs) are determined by a conservation law, and not by the lowest lying excitation energy mode. We determine the precessional frequency for a single off-axis vortex and vortex lattices in BECs using the continuity equation, and solve this self-consistently with the time-independent Hartree-Fock-Bogoliubov… ▽ More We demonstrate that the precessional frequencies of vortices in Bose Einstein condensates (BECs) are determined by a conservation law, and not by the lowest lying excitation energy mode. We determine the precessional frequency for a single off-axis vortex and vortex lattices in BECs using the continuity equation, and solve this self-consistently with the time-independent Hartree-Fock-Bogoliubov (HFB) equations in the rotating frame. We find agreement with zero temperature calculations (Bogoliubov approximation), and a smooth variation in the precession frequency as the temperature is increased. Time-dependent solutions confirm the validity of these predictions. △ Less

Submitted 11 October, 2009; originally announced October 2009.

Comments: 5 pages, 2 figures

Journal ref: Phys. Rev. A 80, 035603 (2009)

A Finite Temperature Treatment of Ultracold Atoms in a 1-D Optical Lattice

Authors: B. G. Wild, P. B. Blakie, D. A. W. Hutchinson

Abstract: We consider the effects of temperature upon the superfluid phase of ultracold, weakly interacting bosons in a one dimensional optical lattice. We use a finite temperature treatment of the Bose-Hubbard model based upon the Hartree-Fock-Bogoliubov formalism, considering both a translationally invariant lattice and one with additional harmonic confinement. In both cases we observe an upward shift i… ▽ More We consider the effects of temperature upon the superfluid phase of ultracold, weakly interacting bosons in a one dimensional optical lattice. We use a finite temperature treatment of the Bose-Hubbard model based upon the Hartree-Fock-Bogoliubov formalism, considering both a translationally invariant lattice and one with additional harmonic confinement. In both cases we observe an upward shift in the critical temperature for Bose condensation. For the case with additional harmonic confinement, this is in contrast with results for the uniform gas. △ Less

Submitted 24 June, 2005; originally announced June 2005.

Comments: Contains four eps figures

Journal ref: Phys. Rev. A vol 73, 023604 (2006)