Showing 1–50 of 59 results for author: Lucas, T

The Simons Observatory: Studies of Detector Yield and Readout Noise From the First Large-Scale Deployment of Microwave Multiplexing at the Large Aperture Telescope

Authors: Thomas P. Satterthwaite, Zeeshan Ahmed, Kyuyoung Bae, Mark Devlin, Simon Dicker, Shannon M. Duff, Daniel Dutcher, Saianeesh K. Haridas, Shawn W. Henderson, Johannes Hubmayr, Bradley R. Johnson, Anna Kofman, Jack Lashner, Michael J. Link, Tammy J. Lucas, Alex Manduca, Michael D. Niemack, John Orlowski-Scherer, Tristan Pinsonneault-Marotte, Max Silva-Feaver, Suzanne Staggs, Eve M. Vavagiakis, Yuhan Wang, Kaiwen Zheng

Abstract: The Simons Observatory is a new ground-based cosmic microwave background experiment, which is currently being commissioned in Chile's Atacama Desert. During its survey, the observatory's small aperture telescopes will map 10% of the sky in bands centered at frequencies ranging from 27 to 280 GHz to constrain cosmic inflation models, and its large aperture telescope will map 40% of the sky in the s… ▽ More The Simons Observatory is a new ground-based cosmic microwave background experiment, which is currently being commissioned in Chile's Atacama Desert. During its survey, the observatory's small aperture telescopes will map 10% of the sky in bands centered at frequencies ranging from 27 to 280 GHz to constrain cosmic inflation models, and its large aperture telescope will map 40% of the sky in the same bands to constrain cosmological parameters and use weak lensing to study large-scale structure. To achieve these science goals, the Simons Observatory is deploying these telescopes' receivers with 60,000 state-of-the-art superconducting transition-edge sensor bolometers for its first five year survey. Reading out this unprecedented number of cryogenic sensors, however, required the development of a novel readout system. The SMuRF electronics were developed to enable high-density readout of superconducting sensors using cryogenic microwave SQUID multiplexing technology. The commissioning of the SMuRF systems at the Simons Observatory is the largest deployment to date of microwave multiplexing technology for transition-edge sensors. In this paper, we show that a significant fraction of the systems deployed so far to the Simons Observatory's large aperture telescope meet baseline specifications for detector yield and readout noise in this early phase of commissioning. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 10 pages, 5 figures, 1 table. To be presented at SPIE Astronomical Telescopes + Instrumentation 2024

T2LM: Long-Term 3D Human Motion Generation from Multiple Sentences

Authors: Taeryung Lee, Fabien Baradel, Thomas Lucas, Kyoung Mu Lee, Gregory Rogez

Abstract: In this paper, we address the challenging problem of long-term 3D human motion generation. Specifically, we aim to generate a long sequence of smoothly connected actions from a stream of multiple sentences (i.e., paragraph). Previous long-term motion generating approaches were mostly based on recurrent methods, using previously generated motion chunks as input for the next step. However, this appr… ▽ More In this paper, we address the challenging problem of long-term 3D human motion generation. Specifically, we aim to generate a long sequence of smoothly connected actions from a stream of multiple sentences (i.e., paragraph). Previous long-term motion generating approaches were mostly based on recurrent methods, using previously generated motion chunks as input for the next step. However, this approach has two drawbacks: 1) it relies on sequential datasets, which are expensive; 2) these methods yield unrealistic gaps between motions generated at each step. To address these issues, we introduce simple yet effective T2LM, a continuous long-term generation framework that can be trained without sequential data. T2LM comprises two components: a 1D-convolutional VQVAE, trained to compress motion to sequences of latent vectors, and a Transformer-based Text Encoder that predicts a latent sequence given an input text. At inference, a sequence of sentences is translated into a continuous stream of latent vectors. This is then decoded into a motion by the VQVAE decoder; the use of 1D convolutions with a local temporal receptive field avoids temporal inconsistencies between training and generated sequences. This simple constraint on the VQ-VAE allows it to be trained with short sequences only and produces smoother transitions. T2LM outperforms prior long-term generation models while overcoming the constraint of requiring sequential data; it is also competitive with SOTA single-action generation models. △ Less

Submitted 2 June, 2024; originally announced June 2024.

Comments: CVPR 2024 HuMoGen Workshop

Simons Observatory: Pre-deployment Performance of a Large Aperture Telescope Optics Tube in the 90 and 150 GHz Spectral Bands

Authors: Carlos E. Sierra, Kathleen Harrington, Shreya Sutariya, Thomas Alford, Anna M. Kofman, Grace E. Chesmore, Jason E. Austermann, Andrew Bazarko, James A. Beall, Tanay Bhandarkar, Mark J. Devlin, Simon R. Dicker, Peter N. Dow, Shannon M. Duff, Daniel Dutcher, Nicholas Galitzki, Joseph E. Golec, John C. Groh, Jon E. Gudmundsson, Saianeesh K. Haridas, Erin Healy, Johannes Hubmayr, Jeffrey Iuliano, Bradley R. Johnson, Claire S. Lessler , et al. (20 additional authors not shown)

Abstract: The Simons Observatory will map the temperature and polarization over half of the sky, at millimeter wavelengths in six spectral bands from the Atacama Desert in Chile. These data will provide new insights into the genesis, content, and history of our Universe; the astrophysics of galaxies and galaxy clusters; objects in our solar system; and time-varying astrophysical phenomena. This ambitious ne… ▽ More The Simons Observatory will map the temperature and polarization over half of the sky, at millimeter wavelengths in six spectral bands from the Atacama Desert in Chile. These data will provide new insights into the genesis, content, and history of our Universe; the astrophysics of galaxies and galaxy clusters; objects in our solar system; and time-varying astrophysical phenomena. This ambitious new instrument suite, initially comprising three 0.5 m small-aperture telescopes and one 6 m large aperture telescope, is designed using a common combination of new technologies and new implementations to realize an observatory significantly more capable than the previous generation. In this paper, we present the pre-deployment performance of the first mid-frequency "optics tube" which will be fielded on the large aperture telescope with sensitivity to the 90 and 150 GHz spectral bands. This optics tube contains lenses, filters, detectors, and readout components, all of which operate at cryogenic temperatures. It is one of seven that form the core of the large aperture telescope receiver in its initial deployment. We describe this optics tube, including details of comprehensive testing methods, new techniques for beam and passband characterization, and its measured performance. The performance metrics include beams, optical efficiency, passbands, and forecasts for the on-sky performance of the system. We forecast a sensitivity that exceeds the requirements of the large aperture telescope with greater than 30% margin in each spectral band, and predict that the instrument will realize diffraction-limited performance and the expected detector passbands. △ Less

Submitted 10 May, 2024; originally announced May 2024.

The Simons Observatory: Design, integration, and testing of the small aperture telescopes

Authors: Nicholas Galitzki, Tran Tsan, Jake Spisak, Michael Randall, Max Silva-Feaver, Joseph Seibert, Jacob Lashner, Shunsuke Adachi, Sean M. Adkins, Thomas Alford, Kam Arnold, Peter C. Ashton, Jason E. Austermann, Carlo Baccigalupi, Andrew Bazarko, James A. Beall, Sanah Bhimani, Bryce Bixler, Gabriele Coppi, Lance Corbett, Kevin D. Crowley, Kevin T. Crowley, Samuel Day-Weiss, Simon Dicker, Peter N. Dow , et al. (55 additional authors not shown)

Abstract: The Simons Observatory (SO) is a cosmic microwave background (CMB) survey experiment that includes small-aperture telescopes (SATs) observing from an altitude of 5,200 m in the Atacama Desert in Chile. The SO SATs will cover six spectral bands between 27 and 280 GHz to search for primordial B-modes to a sensitivity of $σ(r)=0.002$, with quantified systematic errors well below this value. Each SAT… ▽ More The Simons Observatory (SO) is a cosmic microwave background (CMB) survey experiment that includes small-aperture telescopes (SATs) observing from an altitude of 5,200 m in the Atacama Desert in Chile. The SO SATs will cover six spectral bands between 27 and 280 GHz to search for primordial B-modes to a sensitivity of $σ(r)=0.002$, with quantified systematic errors well below this value. Each SAT is a self-contained cryogenic telescope with a 35$^\circ$ field of view, 42 cm diameter optical aperture, 40 K half-wave plate, 1 K refractive optics, and $<0.1$ K focal plane that holds $>12,000$ TES detectors. We describe the nominal design of the SATs and present details about the integration and testing for one operating at 93 and 145 GHz. △ Less

Submitted 10 May, 2024; v1 submitted 9 May, 2024; originally announced May 2024.

Mineral Detection of Neutrinos and Dark Matter 2024. Proceedings

Authors: Sebastian Baum, Patrick Huber, Patrick Stengel, Natsue Abe, Daniel G. Ang, Lorenzo Apollonio, Gabriela R. Araujo, Levente Balogh, Pranshu Bhaumik Yilda Boukhtouchen, Joseph Bramante, Lorenzo Caccianiga, Andrew Calabrese-Day, Qing Chang, Juan I. Collar, Reza Ebadi, Alexey Elykov, Katherine Freese, Audrey Fung, Claudio Galelli, Arianna E. Gleason, Mariano Guerrero Perez, Janina Hakenmüller, Takeshi Hanyu, Noriko Hasebe, Shigenobu Hirose , et al. (35 additional authors not shown)

Abstract: The second "Mineral Detection of Neutrinos and Dark Matter" (MDvDM'24) meeting was held January 8-11, 2024 in Arlington, VA, USA, hosted by Virginia Tech's Center for Neutrino Physics. This document collects contributions from this workshop, providing an overview of activities in the field. MDvDM'24 was the second topical workshop dedicated to the emerging field of mineral detection of neutrinos a… ▽ More The second "Mineral Detection of Neutrinos and Dark Matter" (MDvDM'24) meeting was held January 8-11, 2024 in Arlington, VA, USA, hosted by Virginia Tech's Center for Neutrino Physics. This document collects contributions from this workshop, providing an overview of activities in the field. MDvDM'24 was the second topical workshop dedicated to the emerging field of mineral detection of neutrinos and dark matter, following a meeting hosted by IFPU in Trieste, Italy in October 2022. Mineral detectors have been proposed for a wide variety of applications, including searching for dark matter, measuring various fluxes of astrophysical neutrinos over gigayear timescales, monitoring nuclear reactors, and nuclear disarmament protocols; both as paleo-detectors using natural minerals that could have recorded the traces of nuclear recoils for timescales as long as a billion years and as detectors recording nuclear recoil events on laboratory timescales using natural or artificial minerals. Contributions to this proceedings discuss the vast physics potential, the progress in experimental studies, and the numerous challenges lying ahead on the path towards mineral detection. These include a better understanding of the formation and annealing of recoil defects in crystals; identifying the best classes of minerals and, for paleo-detectors, understanding their geology; modeling and control of the relevant backgrounds; develo**, combining, and scaling up imaging and data analysis techniques; and many others. During the last years, MDvDM has grown rapidly and gained attention. Small-scale experimental efforts focused on establishing various microscopic readout techniques are underway at institutions in North America, Europe and Asia. We are looking ahead to an exciting future full of challenges to overcome, surprises to be encountered, and discoveries lying ahead of us. △ Less

Submitted 2 May, 2024; originally announced May 2024.

Comments: Summary and proceedings of the MDvDM'24 conference, Jan 8-11 2024

Purposer: Putting Human Motion Generation in Context

Authors: Nicolas Ugrinovic, Thomas Lucas, Fabien Baradel, Philippe Weinzaepfel, Gregory Rogez, Francesc Moreno-Noguer

Abstract: We present a novel method to generate human motion to populate 3D indoor scenes. It can be controlled with various combinations of conditioning signals such as a path in a scene, target poses, past motions, and scenes represented as 3D point clouds. State-of-the-art methods are either models specialized to one single setting, require vast amounts of high-quality and diverse training data, or are u… ▽ More We present a novel method to generate human motion to populate 3D indoor scenes. It can be controlled with various combinations of conditioning signals such as a path in a scene, target poses, past motions, and scenes represented as 3D point clouds. State-of-the-art methods are either models specialized to one single setting, require vast amounts of high-quality and diverse training data, or are unconditional models that do not integrate scene or other contextual information. As a consequence, they have limited applicability and rely on costly training data. To address these limitations, we propose a new method ,dubbed Purposer, based on neural discrete representation learning. Our model is capable of exploiting, in a flexible manner, different types of information already present in open access large-scale datasets such as AMASS. First, we encode unconditional human motion into a discrete latent space. Second, an autoregressive generative model, conditioned with key contextual information, either with prompting or additive tokens, and trained for next-step prediction in this space, synthesizes sequences of latent indices. We further design a novel conditioning block to handle future conditioning information in such a causal model by using a network with two branches to compute separate stacks of features. In this manner, Purposer can generate realistic motion sequences in diverse test scenes. Through exhaustive evaluation, we demonstrate that our multi-contextual solution outperforms existing specialized approaches for specific contextual information, both in terms of quality and diversity. Our model is trained with short sequences, but a byproduct of being able to use various conditioning signals is that at test time different combinations can be used to chain short sequences together and generate long motions within a context scene. △ Less

Submitted 19 April, 2024; originally announced April 2024.

The Simons Observatory: Production-level Fabrication of the Mid- and Ultra-High-Frequency Wafers

Authors: Shannon M. Duff, Jason Austermann, James A. Beall, David P. Daniel, Johannes Hubmayr, Greg C. Jaehnig, Bradley R. Johnson, Dante Jones, Michael J. Link, Tammy J. Lucas, Rita F. Sonka, Suzanne T. Staggs, Joel Ullom, Yuhan Wang

Abstract: The Simons Observatory (SO) is a cosmic microwave background instrumentation suite in the Atacama Desert of Chile. More than 65,000 polarization-sensitive transition-edge sensor (TES) bolometers will be fielded in the frequency range spanning 27 to 280 GHz, with three separate dichroic designs. The mid-frequency 90/150 GHz and ultra-high-frequency 220/280 GHz detector arrays, fabricated at NIST, a… ▽ More The Simons Observatory (SO) is a cosmic microwave background instrumentation suite in the Atacama Desert of Chile. More than 65,000 polarization-sensitive transition-edge sensor (TES) bolometers will be fielded in the frequency range spanning 27 to 280 GHz, with three separate dichroic designs. The mid-frequency 90/150 GHz and ultra-high-frequency 220/280 GHz detector arrays, fabricated at NIST, account for 39 of 49 total detector modules and implement the feedhorn-fed orthomode transducer (OMT)-coupled TES bolometer architecture. A robust production-level fabrication framework for these detector arrays and the monolithic DC/RF routing wafers has been developed, which includes single device prototy**, process monitoring techniques, in-process metrology, and cryogenic measurements of critical film properties. Application of this framework has resulted in timely delivery of nearly 100 total superconducting focal plane components to SO with 88% of detector wafers meeting nominal criteria for integration into a detector module: a channel yield > 95% and Tc in the targeted range. △ Less

Submitted 26 March, 2024; originally announced March 2024.

Comments: 10 pages, 6 figures. Proceedings of the 20th International Conference on Low Temperature Detectors (LTD20). Submitted to JLTP

Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shot

Authors: Fabien Baradel, Matthieu Armando, Salma Galaaoui, Romain Brégier, Philippe Weinzaepfel, Grégory Rogez, Thomas Lucas

Abstract: We present Multi-HMR, a strong single-shot model for multi-person 3D human mesh recovery from a single RGB image. Predictions encompass the whole body, i.e, including hands and facial expressions, using the SMPL-X parametric model and spatial location in the camera coordinate system. Our model detects people by predicting coarse 2D heatmaps of person centers, using features produced by a standard… ▽ More We present Multi-HMR, a strong single-shot model for multi-person 3D human mesh recovery from a single RGB image. Predictions encompass the whole body, i.e, including hands and facial expressions, using the SMPL-X parametric model and spatial location in the camera coordinate system. Our model detects people by predicting coarse 2D heatmaps of person centers, using features produced by a standard Vision Transformer (ViT) backbone. It then predicts their whole-body pose, shape and spatial location using a new cross-attention module called the Human Prediction Head (HPH), with one query per detected center token, attending to the entire set of features. As direct prediction of SMPL-X parameters yields suboptimal results, we introduce CUFFS; the Close-Up Frames of Full-Body Subjects dataset, containing humans close to the camera with diverse hand poses. We show that incorporating this dataset into training further enhances predictions, particularly for hands, enabling us to achieve state-of-the-art performance. Multi-HMR also optionally accounts for camera intrinsics, if available, by encoding camera ray directions for each image token. This simple design achieves strong performance on whole-body and body-only benchmarks simultaneously. We train models with various backbone sizes and input resolutions. In particular, using a ViT-S backbone and $448\times448$ input images already yields a fast and competitive model with respect to state-of-the-art methods, while considering larger models and higher resolutions further improve performance. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Comments: https://github.com/naver/multi-hmr

Cross-view and Cross-pose Completion for 3D Human Understanding

Authors: Matthieu Armando, Salma Galaaoui, Fabien Baradel, Thomas Lucas, Vincent Leroy, Romain Brégier, Philippe Weinzaepfel, Grégory Rogez

Abstract: Human perception and understanding is a major domain of computer vision which, like many other vision subdomains recently, stands to gain from the use of large models pre-trained on large datasets. We hypothesize that the most common pre-training strategy of relying on general purpose, object-centric image datasets such as ImageNet, is limited by an important domain shift. On the other hand, colle… ▽ More Human perception and understanding is a major domain of computer vision which, like many other vision subdomains recently, stands to gain from the use of large models pre-trained on large datasets. We hypothesize that the most common pre-training strategy of relying on general purpose, object-centric image datasets such as ImageNet, is limited by an important domain shift. On the other hand, collecting domain-specific ground truth such as 2D or 3D labels does not scale well. Therefore, we propose a pre-training approach based on self-supervised learning that works on human-centric data using only images. Our method uses pairs of images of humans: the first is partially masked and the model is trained to reconstruct the masked parts given the visible ones and a second image. It relies on both stereoscopic (cross-view) pairs, and temporal (cross-pose) pairs taken from videos, in order to learn priors about 3D as well as human motion. We pre-train a model for body-centric tasks and one for hand-centric tasks. With a generic transformer architecture, these models outperform existing self-supervised pre-training methods on a wide set of human-centric downstream tasks, and obtain state-of-the-art performance for instance when fine-tuning for model-based and model-free human mesh recovery. △ Less

Submitted 18 April, 2024; v1 submitted 15 November, 2023; originally announced November 2023.

Comments: CVPR 2024

The Simons Observatory: Large-Scale Characterization of 90/150 GHz TES Detector Modules

Authors: Daniel Dutcher, Shannon M. Duff, John C. Groh, Erin Healy, Johannes Hubmayr, Bradley R. Johnson, Dante Jones, Ben Keller, Lawrence T. Lin, Michael J. Link, Tammy J. Lucas, Samuel Morgan, Yudai Seino, Rita F. Sonka, Suzanne T. Staggs, Yuhan Wang, Kaiwen Zheng

Abstract: The Simons Observatory (SO) is a cosmic microwave background instrumentation suite being deployed in the Atacama Desert in northern Chile. The telescopes within SO use three types of dichroic transition-edge sensor (TES) detector arrays, with the 90 and 150 GHz Mid-Frequency (MF) arrays containing 65% of the approximately 68,000 detectors in the first phase of SO. All of the 26 required MF detecto… ▽ More The Simons Observatory (SO) is a cosmic microwave background instrumentation suite being deployed in the Atacama Desert in northern Chile. The telescopes within SO use three types of dichroic transition-edge sensor (TES) detector arrays, with the 90 and 150 GHz Mid-Frequency (MF) arrays containing 65% of the approximately 68,000 detectors in the first phase of SO. All of the 26 required MF detector arrays have now been fabricated, packaged into detector modules, and tested in laboratory cryostats. Across all modules, we find an average operable detector yield of 84% and median saturation powers of (2.8, 8.0) pW with interquartile ranges of (1, 2) pW at (90, 150) GHz, respectively, falling within their targeted ranges. We measure TES normal resistances and superconducting transition temperatures on each detector wafer to be uniform within 3%, with overall central values of 7.5 mohm and 165 mK, respectively. Results on time constants, optical efficiency, and noise performance are also presented and are consistent with achieving instrument sensitivity forecasts. △ Less

Submitted 29 January, 2024; v1 submitted 9 November, 2023; originally announced November 2023.

Comments: 8 pages, 3 figures. Proceedings of the 20th International Conference on Low Temperature Detectors (LTD20). Accepted to JLTP

Veech fibrations

Authors: Sam Freedman, Trent Lucas

Abstract: We investigate complex surfaces that fiber over Teichmüller curves where the generic fiber is a Veech surface. When the fiber has genus one, these surfaces are elliptic fibrations; for higher genus fibers, they are typically minimal surfaces of general type. We compute the topological and complex-geometric invariants of these surfaces via the monodromy action on the mod-$m$ homology of the fiber.… ▽ More We investigate complex surfaces that fiber over Teichmüller curves where the generic fiber is a Veech surface. When the fiber has genus one, these surfaces are elliptic fibrations; for higher genus fibers, they are typically minimal surfaces of general type. We compute the topological and complex-geometric invariants of these surfaces via the monodromy action on the mod-$m$ homology of the fiber. We get exact values of the invariants for all known algebraically primitive Teichmüller curves. △ Less

Submitted 11 October, 2023; v1 submitted 3 October, 2023; originally announced October 2023.

Comments: 39 pages, 8 figures. Added argument that the level 3 congruence fibration for the double pentagon is minimal

MSC Class: 32G15

Win-Win: Training High-Resolution Vision Transformers from Two Windows

Authors: Vincent Leroy, Jerome Revaud, Thomas Lucas, Philippe Weinzaepfel

Abstract: Transformers have become the standard in state-of-the-art vision architectures, achieving impressive performance on both image-level and dense pixelwise tasks. However, training vision transformers for high-resolution pixelwise tasks has a prohibitive cost. Typical solutions boil down to hierarchical architectures, fast and approximate attention, or training on low-resolution crops. This latter so… ▽ More Transformers have become the standard in state-of-the-art vision architectures, achieving impressive performance on both image-level and dense pixelwise tasks. However, training vision transformers for high-resolution pixelwise tasks has a prohibitive cost. Typical solutions boil down to hierarchical architectures, fast and approximate attention, or training on low-resolution crops. This latter solution does not constrain architectural choices, but it leads to a clear performance drop when testing at resolutions significantly higher than that used for training, thus requiring ad-hoc and slow post-processing schemes. In this paper, we propose a novel strategy for efficient training and inference of high-resolution vision transformers. The key principle is to mask out most of the high-resolution inputs during training, kee** only N random windows. This allows the model to learn local interactions between tokens inside each window, and global interactions between tokens from different windows. As a result, the model can directly process the high-resolution input at test time without any special trick. We show that this strategy is effective when using relative positional embedding such as rotary embeddings. It is 4 times faster to train than a full-resolution network, and it is straightforward to use at test time compared to existing approaches. We apply this strategy to three dense prediction tasks with high-resolution data. First, we show on the task of semantic segmentation that a simple setting with 2 windows performs best, hence the name of our method: Win-Win. Second, we confirm this result on the task of monocular depth prediction. Third, we further extend it to the binocular task of optical flow, reaching state-of-the-art performance on the Spring benchmark that contains Full-HD images with an order of magnitude faster inference than the best competitor. △ Less

Submitted 22 March, 2024; v1 submitted 1 October, 2023; originally announced October 2023.

Comments: ICLR 2024

Predicting Malaria Incidence Using Artifical Neural Networks and Disaggregation Regression

Authors: Jack A. Hall, Tim C. D. Lucas

Abstract: Disaggregation modelling is a method of predicting disease risk at high resolution using aggregated response data. High resolution disease map** is an important public health tool to aid the optimisation of resources, and is commonly used in assisting responses to diseases such as malaria. Current disaggregation regression methods are slow, inflexible, and do not easily allow non-linear terms.… ▽ More Disaggregation modelling is a method of predicting disease risk at high resolution using aggregated response data. High resolution disease map** is an important public health tool to aid the optimisation of resources, and is commonly used in assisting responses to diseases such as malaria. Current disaggregation regression methods are slow, inflexible, and do not easily allow non-linear terms. Neural networks may offer a solution to the limitations of current disaggregation methods. This project aimed to design a neural network which mimics the behaviour of disaggregation, then benchmark it against current methods for accuracy, flexibility and speed. Cross-validation and nested cross-validation tested neural networks against traditional disaggregation for accuracy and execution speed was measured. Neural networks did not improve on the accuracy of current disaggregation methods, although did see an improvement in execution time. The neural network models are more flexible and offer potential for further improvements on all metrics. The R package 'Kedis' (Keras-Disaggregation) is introduced as a user-friendly method of implementing neural network disaggregation models. △ Less

Submitted 17 April, 2023; originally announced April 2023.

Homological representations of low genus map** class groups

Authors: Trent Lucas

Abstract: Given a finite group $G$ acting on a surface $S$, the centralizer of G in the map** class group $\textrm{Mod}(S)$ has a natural representation given by its action on the homology $H_1(S; \mathbb{Q})$. We consider the question of whether this representation has arithmetic image. Several authors have given positive and negative answers to this question. We give a complete answer when S has genus a… ▽ More Given a finite group $G$ acting on a surface $S$, the centralizer of G in the map** class group $\textrm{Mod}(S)$ has a natural representation given by its action on the homology $H_1(S; \mathbb{Q})$. We consider the question of whether this representation has arithmetic image. Several authors have given positive and negative answers to this question. We give a complete answer when S has genus at most 3. △ Less

Submitted 13 March, 2024; v1 submitted 6 March, 2023; originally announced March 2023.

Comments: 31 pages, 8 figures. Minor edits, final version

Mineral Detection of Neutrinos and Dark Matter. A Whitepaper

Authors: Sebastian Baum, Patrick Stengel, Natsue Abe, Javier F. Acevedo, Gabriela R. Araujo, Yoshihiro Asahara, Frank Avignone, Levente Balogh, Laura Baudis, Yilda Boukhtouchen, Joseph Bramante, Pieter Alexander Breur, Lorenzo Caccianiga, Francesco Capozzi, Juan I. Collar, Reza Ebadi, Thomas Edwards, Klaus Eitel, Alexey Elykov, Rodney C. Ewing, Katherine Freese, Audrey Fung, Claudio Galelli, Ulrich A. Glasmacher, Arianna Gleason , et al. (44 additional authors not shown)

Abstract: Minerals are solid state nuclear track detectors - nuclear recoils in a mineral leave latent damage to the crystal structure. Depending on the mineral and its temperature, the damage features are retained in the material from minutes (in low-melting point materials such as salts at a few hundred degrees C) to timescales much larger than the 4.5 Gyr-age of the Solar System (in refractory materials… ▽ More Minerals are solid state nuclear track detectors - nuclear recoils in a mineral leave latent damage to the crystal structure. Depending on the mineral and its temperature, the damage features are retained in the material from minutes (in low-melting point materials such as salts at a few hundred degrees C) to timescales much larger than the 4.5 Gyr-age of the Solar System (in refractory materials at room temperature). The damage features from the $O(50)$ MeV fission fragments left by spontaneous fission of $^{238}$U and other heavy unstable isotopes have long been used for fission track dating of geological samples. Laboratory studies have demonstrated the readout of defects caused by nuclear recoils with energies as small as $O(1)$ keV. This whitepaper discusses a wide range of possible applications of minerals as detectors for $E_R \gtrsim O(1)$ keV nuclear recoils: Using natural minerals, one could use the damage features accumulated over $O(10)$ Myr$-O(1)$ Gyr to measure astrophysical neutrino fluxes (from the Sun, supernovae, or cosmic rays interacting with the atmosphere) as well as search for Dark Matter. Using signals accumulated over months to few-years timescales in laboratory-manufactured minerals, one could measure reactor neutrinos or use them as Dark Matter detectors, potentially with directional sensitivity. Research groups in Europe, Asia, and America have started develo** microscopy techniques to read out the $O(1) - O(100)$ nm damage features in crystals left by $O(0.1) - O(100)$ keV nuclear recoils. We report on the status and plans of these programs. The research program towards the realization of such detectors is highly interdisciplinary, combining geoscience, material science, applied and fundamental physics with techniques from quantum information and Artificial Intelligence. △ Less

Submitted 16 May, 2023; v1 submitted 17 January, 2023; originally announced January 2023.

Comments: 115 pages, many pictures of tracks. Please see the source file for higher resolution versions of some plots. v2: matches the published version

Journal ref: Phys.Dark Univ. 41 (2023) 101245

Single Flux Quantum-Based Digital Control of Superconducting Qubits in a Multi-Chip Module

Authors: Chuan-Hong Liu, Andrew Ballard, David Olaya, Daniel R. Schmidt, John Biesecker, Tammy Lucas, Joel Ullom, Shravan Patel, Owen Rafferty, Alexander Opremcak, Kenneth Dodge, Vito Iaia, Tianna McBroom, Jonathan L. Dubois, Pete F. Hopkins, Samuel P. Benz, Britton L. T. Plourde, Robert McDermott

Abstract: The single flux quantum (SFQ) digital superconducting logic family has been proposed for the scalable control of next-generation superconducting qubit arrays. In the initial implementation, SFQ-based gate fidelity was limited by quasiparticle (QP) poisoning induced by the dissipative on-chip SFQ driver circuit. In this work, we introduce a multi-chip module architecture to suppress phonon-mediated… ▽ More The single flux quantum (SFQ) digital superconducting logic family has been proposed for the scalable control of next-generation superconducting qubit arrays. In the initial implementation, SFQ-based gate fidelity was limited by quasiparticle (QP) poisoning induced by the dissipative on-chip SFQ driver circuit. In this work, we introduce a multi-chip module architecture to suppress phonon-mediated QP poisoning. Here, the SFQ elements and qubits are fabricated on separate chips that are joined with In bump bonds. We use interleaved randomized benchmarking to characterize the fidelity of SFQ-based gates, and we demonstrate an error per Clifford gate of 1.2(1)%, an order-of-magnitude reduction over the gate error achieved in the initial realization of SFQ-based qubit control. We use purity benchmarking to quantify the contribution of incoherent error at 0.96(2)%; we attribute this error to photon-mediated QP poisoning mediated by the resonant mm-wave antenna modes of the qubit and SFQ-qubit coupler. We anticipate that a straightforward redesign of the SFQ driver circuit to limit the bandwidth of the SFQ pulses will eliminate this source of infidelity, allowing SFQ-based gates with fidelity approaching theoretical limits, namely 99.9% for resonant sequences and 99.99% for more complex pulse sequences involving variable pulse-to-pulse separation. △ Less

Submitted 13 January, 2023; originally announced January 2023.

Comments: 15 pages, 8+4 figures, 1 table

Journal ref: PRX Quantum 4, 030310 (2023)

Volumetric and Simultaneous Photoacoustic and Ultrasound Imaging with a Conventional Linear Array in a Multiview Scanning Scheme

Authors: Clément Linger, Yoann Atlas, Remy Winter, Marine Vandebrouck, Maxime Faure, Théotim Lucas, S. Lori Bridal, Jérôme Gateau

Abstract: Volumetric, multimodal imaging with precise spatial and temporal co-registration can provide valuable and complementary information for diagnosis and monitoring. Considerable research has sought to combine 3D photoacoustic (PA) and ultrasound (US) imaging in clinically translatable configurations. However, technical compromises currently result in poor image quality either for photoacoustic or ult… ▽ More Volumetric, multimodal imaging with precise spatial and temporal co-registration can provide valuable and complementary information for diagnosis and monitoring. Considerable research has sought to combine 3D photoacoustic (PA) and ultrasound (US) imaging in clinically translatable configurations. However, technical compromises currently result in poor image quality either for photoacoustic or ultrasonic modes. This work aims to provide translatable, high quality, simultaneously co-registered dual-mode PA/US 3D tomography. Volumetric imaging based on a synthetic aperture approach was implemented by interlacing PA and US acquisitions during a rotate-translate scan with a 5-MHz linear array (12 angles and 30-mm translation to image a 21-mm diameter, 19 mm long cylindrical volume within 21 seconds). For co-registration, an original calibration method using a specifically designed thread phantom was developed to estimate 6 geometrical parameters and 1 temporal off-set through global optimization of the reconstructed sharpness and superposition of calibration phantom structures. Phantom design and cost function metrics were selected based on analysis of a numerical phantom, and resulted in a high estimation accuracy for the 7 parameters. Experimental estimations validated the calibration repeatability. The estimated parameters were used for bimodal reconstruction of additional phantoms with either identical or distinct spatial distributions of US and PA contrasts. Superposition distance of the two modes was within < 10% of the acoustic wavelength and a wavelength-order uniform spatial resolution was obtained. This dual-mode PA/US tomography should contribute to more sensitive and robust detection and follow-up of biological changes or the monitoring slower-kinetic phenomena in living systems such as the accumulation of nanoagents. △ Less

Submitted 21 April, 2023; v1 submitted 2 January, 2023; originally announced January 2023.

Comments: 13 pages, 5 figures

Journal ref: IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2023

CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flow

Authors: Philippe Weinzaepfel, Thomas Lucas, Vincent Leroy, Yohann Cabon, Vaibhav Arora, Romain Brégier, Gabriela Csurka, Leonid Antsfeld, Boris Chidlovskii, Jérôme Revaud

Abstract: Despite impressive performance for high-level downstream tasks, self-supervised pre-training methods have not yet fully delivered on dense geometric vision tasks such as stereo matching or optical flow. The application of self-supervised concepts, such as instance discrimination or masked image modeling, to geometric tasks is an active area of research. In this work, we build on the recent cross-v… ▽ More Despite impressive performance for high-level downstream tasks, self-supervised pre-training methods have not yet fully delivered on dense geometric vision tasks such as stereo matching or optical flow. The application of self-supervised concepts, such as instance discrimination or masked image modeling, to geometric tasks is an active area of research. In this work, we build on the recent cross-view completion framework, a variation of masked image modeling that leverages a second view from the same scene which makes it well suited for binocular downstream tasks. The applicability of this concept has so far been limited in at least two ways: (a) by the difficulty of collecting real-world image pairs -- in practice only synthetic data have been used -- and (b) by the lack of generalization of vanilla transformers to dense downstream tasks for which relative position is more meaningful than absolute position. We explore three avenues of improvement. First, we introduce a method to collect suitable real-world image pairs at large scale. Second, we experiment with relative positional embeddings and show that they enable vision transformers to perform substantially better. Third, we scale up vision transformer based cross-completion architectures, which is made possible by the use of large amounts of data. With these improvements, we show for the first time that state-of-the-art results on stereo matching and optical flow can be reached without using any classical task-specific techniques like correlation volume, iterative estimation, image war** or multi-scale reasoning, thus paving the way towards universal vision models. △ Less

Submitted 18 August, 2023; v1 submitted 18 November, 2022; originally announced November 2022.

Comments: ICCV 2023

PoseScript: Linking 3D Human Poses and Natural Language

Authors: Ginger Delmas, Philippe Weinzaepfel, Thomas Lucas, Francesc Moreno-Noguer, Grégory Rogez

Abstract: Natural language plays a critical role in many computer vision applications, such as image captioning, visual question answering, and cross-modal retrieval, to provide fine-grained semantic information. Unfortunately, while human pose is key to human understanding, current 3D human pose datasets lack detailed language descriptions. To address this issue, we have introduced the PoseScript dataset.… ▽ More Natural language plays a critical role in many computer vision applications, such as image captioning, visual question answering, and cross-modal retrieval, to provide fine-grained semantic information. Unfortunately, while human pose is key to human understanding, current 3D human pose datasets lack detailed language descriptions. To address this issue, we have introduced the PoseScript dataset. This dataset pairs more than six thousand 3D human poses from AMASS with rich human-annotated descriptions of the body parts and their spatial relationships. Additionally, to increase the size of the dataset to a scale that is compatible with data-hungry learning algorithms, we have proposed an elaborate captioning process that generates automatic synthetic descriptions in natural language from given 3D keypoints. This process extracts low-level pose information, known as "posecodes", using a set of simple but generic rules on the 3D keypoints. These posecodes are then combined into higher level textual descriptions using syntactic rules. With automatic annotations, the amount of available data significantly scales up (100k), making it possible to effectively pretrain deep models for finetuning on human captions. To showcase the potential of annotated poses, we present three multi-modal learning tasks that utilize the PoseScript dataset. Firstly, we develop a pipeline that maps 3D poses and textual descriptions into a joint embedding space, allowing for cross-modal retrieval of relevant poses from large-scale datasets. Secondly, we establish a baseline for a text-conditioned model generating 3D poses. Thirdly, we present a learned process for generating pose descriptions. These applications demonstrate the versatility and usefulness of annotated poses in various tasks and pave the way for future research in the field. △ Less

Submitted 19 January, 2024; v1 submitted 21 October, 2022; originally announced October 2022.

Comments: Extended version of the ECCV 2022 paper

CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completion

Authors: Philippe Weinzaepfel, Vincent Leroy, Thomas Lucas, Romain Brégier, Yohann Cabon, Vaibhav Arora, Leonid Antsfeld, Boris Chidlovskii, Gabriela Csurka, Jérôme Revaud

Abstract: Masked Image Modeling (MIM) has recently been established as a potent pre-training paradigm. A pretext task is constructed by masking patches in an input image, and this masked content is then predicted by a neural network using visible patches as sole input. This pre-training leads to state-of-the-art performance when finetuned for high-level semantic tasks, e.g. image classification and object d… ▽ More Masked Image Modeling (MIM) has recently been established as a potent pre-training paradigm. A pretext task is constructed by masking patches in an input image, and this masked content is then predicted by a neural network using visible patches as sole input. This pre-training leads to state-of-the-art performance when finetuned for high-level semantic tasks, e.g. image classification and object detection. In this paper we instead seek to learn representations that transfer well to a wide variety of 3D vision and lower-level geometric downstream tasks, such as depth prediction or optical flow estimation. Inspired by MIM, we propose an unsupervised representation learning task trained from pairs of images showing the same scene from different viewpoints. More precisely, we propose the pretext task of cross-view completion where the first input image is partially masked, and this masked content has to be reconstructed from the visible content and the second image. In single-view MIM, the masked content often cannot be inferred precisely from the visible portion only, so the model learns to act as a prior influenced by high-level semantics. In contrast, this ambiguity can be resolved with cross-view completion from the second unmasked image, on the condition that the model is able to understand the spatial relationship between the two images. Our experiments show that our pretext task leads to significantly improved performance for monocular 3D vision downstream tasks such as depth estimation. In addition, our model can be directly applied to binocular downstream tasks like optical flow or relative camera pose estimation, for which we obtain competitive results without bells and whistles, i.e., using a generic architecture without any task-specific design. △ Less

Submitted 12 January, 2023; v1 submitted 19 October, 2022; originally announced October 2022.

Comments: NeurIPS 2022

PoseGPT: Quantization-based 3D Human Motion Generation and Forecasting

Authors: Thomas Lucas, Fabien Baradel, Philippe Weinzaepfel, Grégory Rogez

Abstract: We address the problem of action-conditioned generation of human motion sequences. Existing work falls into two categories: forecast models conditioned on observed past motions, or generative models conditioned on action labels and duration only. In contrast, we generate motion conditioned on observations of arbitrary length, including none. To solve this generalized problem, we propose PoseGPT, a… ▽ More We address the problem of action-conditioned generation of human motion sequences. Existing work falls into two categories: forecast models conditioned on observed past motions, or generative models conditioned on action labels and duration only. In contrast, we generate motion conditioned on observations of arbitrary length, including none. To solve this generalized problem, we propose PoseGPT, an auto-regressive transformer-based approach which internally compresses human motion into quantized latent sequences. An auto-encoder first maps human motion to latent index sequences in a discrete space, and vice-versa. Inspired by the Generative Pretrained Transformer (GPT), we propose to train a GPT-like model for next-index prediction in that space; this allows PoseGPT to output distributions on possible futures, with or without conditioning on past motion. The discrete and compressed nature of the latent space allows the GPT-like model to focus on long-range signal, as it removes low-level redundancy in the input signal. Predicting discrete indices also alleviates the common pitfall of predicting averaged poses, a typical failure case when regressing continuous values, as the average of discrete targets is not a target itself. Our experimental results show that our proposed approach achieves state-of-the-art results on HumanAct12, a standard but small scale dataset, as well as on BABEL, a recent large scale MoCap dataset, and on GRAB, a human-object interactions dataset. △ Less

Submitted 19 October, 2022; originally announced October 2022.

Comments: ECCV'22 Conference paper

Assembly development for the Simons Observatory focal plane readout module

Authors: Erin Healy, Aamir M. Ali, Kam Arnold, Jason E. Austermann, James A. Beall, Sarah Marie Bruno, Steve K. Choi, Jake Connors, Nicholas F. Cothar, Bradley Dober, Shannon M. Duff, Nicholas Galitzki, Gene Hilton, Shuay-Pwu Patty Ho, Johannes Hubmayr, Bradley R. Johnson, Yaqiong Li, Michael J. Link, Tammy J. Lucas, Heather McCarrick, Michael D. Niemack, Maximiliano Silva-Feaver, Rita F. Sonka, Suzanne Staggs, Eve M. Vavagiakis , et al. (6 additional authors not shown)

Abstract: The Simons Observatory (SO) is a suite of instruments sensitive to temperature and polarization of the cosmic microwave background (CMB) to be located at Cerro Toco in the Atacama Desert in Chile. Five telescopes, one large aperture telescope and four small aperture telescopes, will host roughly 70,000 highly multiplexed transition edge sensor (TES) detectors operated at 100 mK. Each SO focal plan… ▽ More The Simons Observatory (SO) is a suite of instruments sensitive to temperature and polarization of the cosmic microwave background (CMB) to be located at Cerro Toco in the Atacama Desert in Chile. Five telescopes, one large aperture telescope and four small aperture telescopes, will host roughly 70,000 highly multiplexed transition edge sensor (TES) detectors operated at 100 mK. Each SO focal plane module (UFM) couples 1,764 TESes to microwave resonators in a microwave multiplexing (uMux) readout circuit. Before detector integration, the 100 mK uMux components are packaged into multiplexing modules (UMMs), which are independently validated to ensure they meet SO performance specifications. Here we present the assembly developments of these UMM readout packages for mid frequency (90/150 GHz) and ultra high frequency (220/280 GHz) UFMs. △ Less

Submitted 25 July, 2022; v1 submitted 12 April, 2022; originally announced April 2022.

Journal ref: Proc. SPIE 11453, Millimeter, Submillimeter, and Far-Infrared Detectors and Instrumentation for Astronomy X, 1145317 (2020)

Learning Super-Features for Image Retrieval

Authors: Philippe Weinzaepfel, Thomas Lucas, Diane Larlus, Yannis Kalantidis

Abstract: Methods that combine local and global features have recently shown excellent performance on multiple challenging deep image retrieval benchmarks, but their use of local features raises at least two issues. First, these local features simply boil down to the localized map activations of a neural network, and hence can be extremely redundant. Second, they are typically trained with a global loss tha… ▽ More Methods that combine local and global features have recently shown excellent performance on multiple challenging deep image retrieval benchmarks, but their use of local features raises at least two issues. First, these local features simply boil down to the localized map activations of a neural network, and hence can be extremely redundant. Second, they are typically trained with a global loss that only acts on top of an aggregation of local features; by contrast, testing is based on local feature matching, which creates a discrepancy between training and testing. In this paper, we propose a novel architecture for deep image retrieval, based solely on mid-level features that we call Super-features. These Super-features are constructed by an iterative attention module and constitute an ordered set in which each element focuses on a localized and discriminant image pattern. For training, they require only image labels. A contrastive loss operates directly at the level of Super-features and focuses on those that match across images. A second complementary loss encourages diversity. Experiments on common landmark retrieval benchmarks validate that Super-features substantially outperform state-of-the-art methods when using the same number of features, and only require a significantly smaller memory footprint to match their performance. Code and models are available at: https://github.com/naver/FIRe. △ Less

Submitted 31 January, 2022; originally announced January 2022.

Comments: ICLR 2022

Barely-Supervised Learning: Semi-Supervised Learning with very few labeled images

Authors: Thomas Lucas, Philippe Weinzaepfel, Gregory Rogez

Abstract: This paper tackles the problem of semi-supervised learning when the set of labeled samples is limited to a small number of images per class, typically less than 10, problem that we refer to as barely-supervised learning. We analyze in depth the behavior of a state-of-the-art semi-supervised method, FixMatch, which relies on a weakly-augmented version of an image to obtain supervision signal for a… ▽ More This paper tackles the problem of semi-supervised learning when the set of labeled samples is limited to a small number of images per class, typically less than 10, problem that we refer to as barely-supervised learning. We analyze in depth the behavior of a state-of-the-art semi-supervised method, FixMatch, which relies on a weakly-augmented version of an image to obtain supervision signal for a more strongly-augmented version. We show that it frequently fails in barely-supervised scenarios, due to a lack of training signal when no pseudo-label can be predicted with high confidence. We propose a method to leverage self-supervised methods that provides training signal in the absence of confident pseudo-labels. We then propose two methods to refine the pseudo-label selection process which lead to further improvements. The first one relies on a per-sample history of the model predictions, akin to a voting scheme. The second iteratively updates class-dependent confidence thresholds to better explore classes that are under-represented in the pseudo-labels. Our experiments show that our approach performs significantly better on STL-10 in the barely-supervised regime, e.g. with 4 or 8 labeled images per class. △ Less

Submitted 22 December, 2021; originally announced December 2021.

Meta-aprendizado para otimizacao de parametros de redes neurais

Authors: Tarsicio Lucas, Teresa Ludermir, Ricardo Prudencio, Carlos Soares

Abstract: The optimization of Artificial Neural Networks (ANNs) is an important task to the success of using these models in real-world applications. The solutions adopted to this task are expensive in general, involving trial-and-error procedures or expert knowledge which are not always available. In this work, we investigated the use of meta-learning to the optimization of ANNs. Meta-learning is a researc… ▽ More The optimization of Artificial Neural Networks (ANNs) is an important task to the success of using these models in real-world applications. The solutions adopted to this task are expensive in general, involving trial-and-error procedures or expert knowledge which are not always available. In this work, we investigated the use of meta-learning to the optimization of ANNs. Meta-learning is a research field aiming to automatically acquiring knowledge which relates features of the learning problems to the performance of the learning algorithms. The meta-learning techniques were originally proposed and evaluated to the algorithm selection problem and after to the optimization of parameters for Support Vector Machines. However, meta-learning can be adopted as a more general strategy to optimize ANN parameters, which motivates new efforts in this research direction. In the current work, we performed a case study using meta-learning to choose the number of hidden nodes for MLP networks, which is an important parameter to be defined aiming a good networks performance. In our work, we generated a base of meta-examples associated to 93 regression problems. Each meta-example was generated from a regression problem and stored: 16 features describing the problem (e.g., number of attributes and correlation among the problem attributes) and the best number of nodes for this problem, empirically chosen from a range of possible values. This set of meta-examples was given as input to a meta-learner which was able to predict the best number of nodes for new problems based on their features. The experiments performed in this case study revealed satisfactory results. △ Less

Submitted 10 July, 2021; originally announced September 2021.

Comments: 12 pages, in Portuguese, 2 figures, 2 tables

The Simons Observatory microwave SQUID multiplexing detector module design

Authors: Heather McCarrick, Erin Healy, Zeeshan Ahmed, Kam Arnold, Zachary Atkins, Jason E. Austermann, Tanay Bhandarkar, Jim A. Beall, Sarah Marie Bruno, Steve K. Choi, Jake Connors, Nicholas F. Cothard, Kevin D. Crowley, Simon Dicker, Bradley Dober, Cody J. Duell, Shannon M. Duff, Daniel Dutcher, Josef C. Frisch, Nicholas Galitzki, Megan B. Gralla, Jon E. Gudmundsson, Shawn W. Henderson, Gene C. Hilton, Shuay-Pwu Patty Ho , et al. (34 additional authors not shown)

Abstract: Advances in cosmic microwave background (CMB) science depend on increasing the number of sensitive detectors observing the sky. New instruments deploy large arrays of superconducting transition-edge sensor (TES) bolometers tiled densely into ever larger focal planes. High multiplexing factors reduce the thermal loading on the cryogenic receivers and simplify their design. We present the design of… ▽ More Advances in cosmic microwave background (CMB) science depend on increasing the number of sensitive detectors observing the sky. New instruments deploy large arrays of superconducting transition-edge sensor (TES) bolometers tiled densely into ever larger focal planes. High multiplexing factors reduce the thermal loading on the cryogenic receivers and simplify their design. We present the design of focal-plane modules with an order of magnitude higher multiplexing factor than has previously been achieved with TES bolometers. We focus on the novel cold readout component, which employs microwave SQUID multiplexing ($μ$mux). Simons Observatory will use 49 modules containing 60,000 bolometers to make exquisitely sensitive measurements of the CMB. We validate the focal-plane module design, presenting measurements of the readout component with and without a prototype detector array of 1728 polarization-sensitive bolometers coupled to feedhorns. The readout component achieves a $95\%$ yield and a 910 multiplexing factor. The median white noise of each readout channel is 65 $\mathrm{pA/\sqrt{Hz}}$. This impacts the projected SO map** speed by $< 8\%$, which is less than is assumed in the sensitivity projections. The results validate the full functionality of the module. We discuss the measured performance in the context of SO science requirements, which are exceeded. △ Less

Submitted 16 September, 2021; v1 submitted 28 June, 2021; originally announced June 2021.

Comments: Accepted to The Astrophysical Journal

Journal ref: 2021 ApJ 922 38

The Simons Observatory: the Large Aperture Telescope (LAT)

Authors: Zhilei Xu, Shunsuke Adachi, Peter Ade, J. A. Beall, Tanay Bhandarkar, J. Richard Bond, Grace E. Chesmore, Yuji Chinone, Steve K. Choi, Jake A. Connors, Gabriele Coppi, Nicholas F. Cothard, Kevin D. Crowley, Mark Devlin, Simon Dicker, Bradley Dober, Shannon M. Duff, Nicholas Galitzki, Patricio A. Gallardo, Joseph E. Golec, Jon E. Gudmundsson, Saianeesh K. Haridas, Kathleen Harrington, Carlos Hervias-Caimapo, Shuay-Pwu Patty Ho , et al. (35 additional authors not shown)

Abstract: The Simons Observatory (SO) is a Cosmic Microwave Background (CMB) experiment to observe the microwave sky in six frequency bands from 30GHz to 290GHz. The Observatory -- at $\sim$5200m altitude -- comprises three Small Aperture Telescopes (SATs) and one Large Aperture Telescope (LAT) at the Atacama Desert, Chile. This research note describes the design and current status of the LAT along with its… ▽ More The Simons Observatory (SO) is a Cosmic Microwave Background (CMB) experiment to observe the microwave sky in six frequency bands from 30GHz to 290GHz. The Observatory -- at $\sim$5200m altitude -- comprises three Small Aperture Telescopes (SATs) and one Large Aperture Telescope (LAT) at the Atacama Desert, Chile. This research note describes the design and current status of the LAT along with its future timeline. △ Less

Submitted 29 April, 2021; v1 submitted 19 April, 2021; originally announced April 2021.

Comments: 4 pages, 1 figure

Journal ref: Research Notes AAS, 5, 100 (2021)

The Simons Observatory Large Aperture Telescope Receiver

Authors: Ningfeng Zhu, Tanay Bhandarkar, Gabriele Coppi, Anna M. Kofman, John L. Orlowski-Scherer, Zhilei Xu, Shunsuke Adachi, Peter Ade, Simone Aiola, Jason Austermann, Andrew O. Bazarko, James A. Beall, Sanah Bhimani, J. Richard Bond, Grace E. Chesmore, Steve K. Choi, Jake Connors, Nicholas F. Cothard, Mark Devlin, Simon Dicker, Bradley Dober, Cody J. Duell, Shannon M. Duff, Rolando Dünner, Giulio Fabbian , et al. (46 additional authors not shown)

Abstract: The Simons Observatory (SO) Large Aperture Telescope Receiver (LATR) will be coupled to the Large Aperture Telescope located at an elevation of 5,200 m on Cerro Toco in Chile. The resulting instrument will produce arcminute-resolution millimeter-wave maps of half the sky with unprecedented precision. The LATR is the largest cryogenic millimeter-wave camera built to date with a diameter of 2.4 m an… ▽ More The Simons Observatory (SO) Large Aperture Telescope Receiver (LATR) will be coupled to the Large Aperture Telescope located at an elevation of 5,200 m on Cerro Toco in Chile. The resulting instrument will produce arcminute-resolution millimeter-wave maps of half the sky with unprecedented precision. The LATR is the largest cryogenic millimeter-wave camera built to date with a diameter of 2.4 m and a length of 2.6 m. It cools 1200 kg of material to 4 K and 200 kg to 100 mk, the operating temperature of the bolometric detectors with bands centered around 27, 39, 93, 145, 225, and 280 GHz. Ultimately, the LATR will accommodate 13 40 cm diameter optics tubes, each with three detector wafers and a total of 62,000 detectors. The LATR design must simultaneously maintain the optical alignment of the system, control stray light, provide cryogenic isolation, limit thermal gradients, and minimize the time to cool the system from room temperature to 100 mK. The interplay between these competing factors poses unique challenges. We discuss the trade studies involved with the design, the final optimization, the construction, and ultimate performance of the system. △ Less

Submitted 3 March, 2021; originally announced March 2021.

High contrast and resolution 3-D ultrasonography with a clinical linear transducer array scanned in a rotate-translate geometry

Authors: Théotim Lucas, Isabelle Quidu, S. Lori Bridal, Jerome Gateau

Abstract: We propose a novel solution for volumetric ultrasound imaging using single-side access 3-D synthetic-aperture scanning of a clinical linear array. This solution is based on an advanced scanning geometry and a software-based ultrasound platform. The rotate-translate scanning scheme increases the elevation angular aperture by pivoting the array [-45{\textdegree} to 45{\textdegree}] around its array… ▽ More We propose a novel solution for volumetric ultrasound imaging using single-side access 3-D synthetic-aperture scanning of a clinical linear array. This solution is based on an advanced scanning geometry and a software-based ultrasound platform. The rotate-translate scanning scheme increases the elevation angular aperture by pivoting the array [-45{\textdegree} to 45{\textdegree}] around its array axis (axis along the row of its elements) and then, scans the imaged object for each pivoted angle by translating the array perpendicularly to the rotation axis. A theoretical basis is presented so that the angular and translational scan sampling periods can be best adjusted for any linear transducer array. We experimentally implemented scanning with a 5-MHz array. In vitro characterization was performed with phantoms designed to test resolution and contrast. Spatial resolution assessed based on the full-width half-maximum of images from isolated microspheres was increased by a factor 3 along the translational direction from a simple translation scan of the array. Moreover, the resolution is uniform over a cross-sectional area of 4.5 cm 2. Angular sampling periods were optimized and tapered to decrease the scan duration while maintaining image contrast (contrast at the center of a 5 mm cyst on the order of-26 dB for 4{\textdegree} angular period and a scan duration of 10 s for a 9cm 3 volume). We demonstrate that superior 3-D US imaging can be obtained with a clinical array using our scanning strategy. This technique offers a promising and flexible alternative to development of costly matrix arrays toward the development of sensitive volumetric ultrasonography. △ Less

Submitted 26 January, 2021; v1 submitted 19 November, 2020; originally announced November 2020.

Journal ref: Applied Sciences, MDPI, 2021, 11 (2), pp.493

A Fully Integrated Sensor-Brain-Machine Interface System for Restoring Somatosensation

Authors: Xilin Liu, Hongjie Zhu, Tian Qiu, Srihari Y. Sritharan, Dengteng Ge, Shu Yang, Milin Zhang, Andrew G. Richardson, Timothy H. Lucas, Nader Engheta, Jan Van der Spiegel

Abstract: Sensory feedback is critical to the performance of neural prostheses that restore movement control after neurological injury. Recent advances in direct neural control of paralyzed arms present new requirements for miniaturized, low-power sensor systems. To address this challenge, we developed a fully-integrated wireless sensor-brain-machine interface (SBMI) system for communicating key somatosenso… ▽ More Sensory feedback is critical to the performance of neural prostheses that restore movement control after neurological injury. Recent advances in direct neural control of paralyzed arms present new requirements for miniaturized, low-power sensor systems. To address this challenge, we developed a fully-integrated wireless sensor-brain-machine interface (SBMI) system for communicating key somatosensory signals, fingertip forces and limb joint angles, to the brain. The system consists of a tactile force sensor, an electrogoniometer, and a neural interface. The tactile force sensor features a novel optical waveguide on CMOS design for sensing. The electrogoniometer integrates an ultra low-power digital signal processor (DSP) for real-time joint angle measurement. The neural interface enables bidirectional neural stimulation and recording. Innovative designs of sensors and sensing interfaces, analog-to-digital converters (ADC) and ultra wide-band (UWB) wireless transceivers have been developed. The prototypes have been fabricated in 180nm standard CMOS technology and tested on the bench and in vivo. The developed system provides a novel solution for providing somatosensory feedback to next-generation neural prostheses. △ Less

Submitted 17 October, 2020; originally announced October 2020.

Comments: 12 pages, 17 figures

Journal ref: IEEE Sensors Journal, 2020

Concept Study of a Compact, High Gradient X-band Travelling Wave RF Photogun with Novel Laser Coupling Scheme

Authors: Thomas Geoffrey Lucas, Peter Mutsaers, Jom Luiten

Abstract: This paper presents the design of a travelling wave RF photogun operating at the European X-band frequency of 11.994 GHz. The design is based on a CLIC prototype structure milled from copper halves and uses the unique gap introduced in the geometry to couple in the laser without obstructing the outgoing electron beam. With a modest peak input power of 19 MW and a fill time of 48 ns, the gun has th… ▽ More This paper presents the design of a travelling wave RF photogun operating at the European X-band frequency of 11.994 GHz. The design is based on a CLIC prototype structure milled from copper halves and uses the unique gap introduced in the geometry to couple in the laser without obstructing the outgoing electron beam. With a modest peak input power of 19 MW and a fill time of 48 ns, the gun has the ability to operate at very high RF pulse repetition rates in comparison to standing wave RF photoguns. For its nominal input power, the cathode has a peak gradient of 91 MV/m and the entire gun has a gradient of 65 MV/m. The gun is illustrated to provide an 80 pC bunch at a 14.15 MeV with a 0.14 $\%$ RMS energy spread and an emittance of 0.6 mm mrad at a repetition rate of at least 450 Hz. △ Less

Submitted 1 September, 2020; originally announced September 2020.

A simulation study of disaggregation regression for spatial disease map**

Authors: Rohan Arambepola, Tim C D Lucas, Anita K Nandi, Peter W Gething, Ewan Cameron

Abstract: Disaggregation regression has become an important tool in spatial disease map** for making fine-scale predictions of disease risk from aggregated response data. By including high resolution covariate information and modelling the data generating process on a fine scale, it is hoped that these models can accurately learn the relationships between covariates and response at a fine spatial scale. H… ▽ More Disaggregation regression has become an important tool in spatial disease map** for making fine-scale predictions of disease risk from aggregated response data. By including high resolution covariate information and modelling the data generating process on a fine scale, it is hoped that these models can accurately learn the relationships between covariates and response at a fine spatial scale. However, validating these high resolution predictions can be a challenge, as often there is no data observed at this spatial scale. In this study, disaggregation regression was performed on simulated data in various settings and the resulting fine-scale predictions are compared to the simulated ground truth. Performance was investigated with varying numbers of data points, sizes of aggregated areas and levels of model misspecification. The effectiveness of cross validation on the aggregate level as a measure of fine-scale predictive performance was also investigated. Predictive performance improved as the number of observations increased and as the size of the aggregated areas decreased. When the model was well-specified, fine-scale predictions were accurate even with small numbers of observations and large aggregated areas. Under model misspecification predictive performance was significantly worse for large aggregated areas but remained high when response data was aggregated over smaller regions. Cross-validation correlation on the aggregate level was a moderately good predictor of fine-scale predictive performance. While the simulations are unlikely to capture the nuances of real-life response data, this study gives insight into the effectiveness of disaggregation regression in different contexts. △ Less

Submitted 7 May, 2020; originally announced May 2020.

Graphical outputs and Spatial Cross-validation for the R-INLA package using INLAutils

Authors: Tim Lucas, Andre Python, David Redding

Abstract: Statistical analyses proceed by an iterative process of model fitting and checking. The R-INLA package facilitates this iteration by fitting many Bayesian models much faster than alternative MCMC approaches. As the interpretation of results and model objects from Bayesian analyses can be complex, the R package INLAutils provides users with easily accessible, clear and customisable graphical summar… ▽ More Statistical analyses proceed by an iterative process of model fitting and checking. The R-INLA package facilitates this iteration by fitting many Bayesian models much faster than alternative MCMC approaches. As the interpretation of results and model objects from Bayesian analyses can be complex, the R package INLAutils provides users with easily accessible, clear and customisable graphical summaries of model outputs from R- INLA. Furthermore, it offers a function for performing and visualizing the results of a spatial leave-one-out cross-validation (SLOOCV) approach that can be applied to compare the predictive performance of multiple spatial models. In this paper, we describe and illustrate the use of (1) graphical summary plotting functions and (2) the SLOOCV approach. We conclude the paper by identifying the limits of our approach and discuss future potential improvements. △ Less

Submitted 5 April, 2020; originally announced April 2020.

Comments: 13 pages

Calibrated photoacoustic spectrometer based on a conventional imaging system for in vitro characterization of contrast agents

Authors: Théotim Lucas, Mitradeep Sarkar, Yoann Atlas, Clément Linger, Gilles Renault, Florence Gazeau, Jérôme Gateau

Abstract: Photoacoustic (PA) imaging systems are spreading in the biomedical community, and the de-velopment of new PA contrast agents is an active area of research. However, PA contrast agents are usually characterized with spectrophotometry or uncalibrated PA imaging systems, leading to partial assessment of their PA efficiency. To enable quantitative PA spectroscopy of contrast agents in vitro with conve… ▽ More Photoacoustic (PA) imaging systems are spreading in the biomedical community, and the de-velopment of new PA contrast agents is an active area of research. However, PA contrast agents are usually characterized with spectrophotometry or uncalibrated PA imaging systems, leading to partial assessment of their PA efficiency. To enable quantitative PA spectroscopy of contrast agents in vitro with conventional PA imaging systems, we have developed an adapted calibration method. Contrast agents in solution are injected in a dedicated non-scattering tube phantom imaged at different optical wavelengths. The calibration method uses a reference solu-tion of cupric sulfate to simultaneously correct for the spectral energy distribution of excitation light at the tube location and perform a conversion of the tube amplitude in the image from ar-bitrary to spectroscopic units. The method does not require any precise alignment and provides quantitative PA spectra, even with non-uniform illumination and ultrasound sensitivity. It was implemented on a conventional imaging setup based on a tunable laser operating between 680 nm and 980 nm and a 5 MHz clinical ultrasound array. We demonstrated robust calibrated PA spectroscopy with sample volumes as low as 15 μL of known chromophores and commonly used contrast agents. The validated method will be an essential and accessible tool for the de-velopment of new and efficient PA contrast agents by improving their quantitative characterization. △ Less

Submitted 5 September, 2022; v1 submitted 16 March, 2020; originally announced March 2020.

Comments: 20 pages, 10 figures

Journal ref: Sensors. 2022; 22(17):6543

disaggregation: An R Package for Bayesian Spatial Disaggregation Modelling

Authors: Anita K. Nandi, Tim C. D. Lucas, Rohan Arambepola, Peter Gething, Daniel J. Weiss

Abstract: Disaggregation modelling, or downscaling, has become an important discipline in epidemiology. Surveillance data, aggregated over large regions, is becoming more common, leading to an increasing demand for modelling frameworks that can deal with this data to understand spatial patterns. Disaggregation regression models use response data aggregated over large heterogenous regions to make predictions… ▽ More Disaggregation modelling, or downscaling, has become an important discipline in epidemiology. Surveillance data, aggregated over large regions, is becoming more common, leading to an increasing demand for modelling frameworks that can deal with this data to understand spatial patterns. Disaggregation regression models use response data aggregated over large heterogenous regions to make predictions at fine-scale over the region by using fine-scale covariates to inform the heterogeneity. This paper presents the R package disaggregation, which provides functionality to streamline the process of running a disaggregation model for fine-scale predictions. △ Less

Submitted 9 January, 2020; originally announced January 2020.

Comments: 16 pages, 5 figures, submitted to Journal of Statistical Software

Learning in brain-computer interface control evidenced by joint decomposition of brain and behavior

Authors: Jennifer Stiso, Marie-Constance Corsi, Jean M. Vettel, Javier O. Garcia, Fabio Pasqualetti, Fabrizio De Vico Fallani, Timothy H. Lucas, Danielle S. Bassett

Abstract: Motor imagery-based brain-computer interfaces (BCIs) use an individuals ability to volitionally modulate localized brain activity as a therapy for motor dysfunction or to probe causal relations between brain activity and behavior. However, many individuals cannot learn to successfully modulate their brain activity, greatly limiting the efficacy of BCI for therapy and for basic scientific inquiry.… ▽ More Motor imagery-based brain-computer interfaces (BCIs) use an individuals ability to volitionally modulate localized brain activity as a therapy for motor dysfunction or to probe causal relations between brain activity and behavior. However, many individuals cannot learn to successfully modulate their brain activity, greatly limiting the efficacy of BCI for therapy and for basic scientific inquiry. Previous research suggests that coherent activity across diverse cognitive systems is a hallmark of individuals who can successfully learn to control the BCI. However, little is known about how these distributed networks interact through time to support learning. Here, we address this gap in knowledge by constructing and applying a multimodal network approach to decipher brain-behavior relations in motor imagery-based brain-computer interface learning using MEG. Specifically, we employ a minimally constrained matrix decomposition method (non-negative matrix factorization) to simultaneously identify regularized, covarying subgraphs of functional connectivity, to assess their similarity to task performance, and to detect their time-varying expression. Individuals also displayed marked variation in the spatial properties of subgraphs such as the connectivity between the frontal lobe and the rest of the brain, and in the temporal properties of subgraphs such as the stage of learning at which they reached maximum expression. From these observations, we posit a conceptual model in which certain subgraphs support learning by modulating brain activity in regions important for sustaining attention. To test this model, we use tools that stipulate regional dynamics on a networked system (network control theory), and find that good learners display a single subgraph whose temporal expression tracked performance and whose architecture supports easy modulation of brain regions important for attention. △ Less

Submitted 2 August, 2019; v1 submitted 31 July, 2019; originally announced August 2019.

Map** malaria seasonality: a case study from Madagascar

Authors: Michele Nguyen, Rosalind E. Howes, Tim C. D. Lucas, Katherine E. Battle, Ewan Cameron, Harry S. Gibson, Jennifer Rozier, Suzanne Keddie, Emma Collins, Rohan Arambepola, Su Yun Kang, Chantal Hendriks, Anita Nandi, Susan F. Rumisha, Samir Bhatt, Sedera A. Mioramalala, Mauricette Andriamananjara Nambinisoa, Fanjasoa Rakotomanana, Peter W. Gething, Daniel J. Weiss

Abstract: Many malaria-endemic areas experience seasonal fluctuations in case incidence as Anopheles mosquito and Plasmodium parasite life cycles respond to changing environmental conditions. While most existing maps of malaria seasonality use fixed thresholds of rainfall, temperature, and/or vegetation indices to identify suitable transmission months, we develop a statistical modelling framework for charac… ▽ More Many malaria-endemic areas experience seasonal fluctuations in case incidence as Anopheles mosquito and Plasmodium parasite life cycles respond to changing environmental conditions. While most existing maps of malaria seasonality use fixed thresholds of rainfall, temperature, and/or vegetation indices to identify suitable transmission months, we develop a statistical modelling framework for characterising the seasonal patterns derived directly from case data. The procedure involves a spatiotemporal regression model for estimating the monthly proportions of total annual cases and an algorithm to identify operationally relevant characteristics such as the transmission start and peak months. A seasonality index combines the monthly proportion estimates and existing estimates of annual case incidence to provide a summary of "how seasonal" locations are relative to their surroundings. An advancement upon past seasonality map** endeavours is the presentation of the uncertainty associated with each map, which will enable policymakers to make more statistically sound decisions. The methodology is illustrated using health facility data from Madagascar. △ Less

Submitted 17 May, 2019; v1 submitted 30 January, 2019; originally announced January 2019.

Journal ref: BMC Med 18, 26 (2020)

Adaptive Density Estimation for Generative Models

Authors: Thomas Lucas, Konstantin Shmelkov, Karteek Alahari, Cordelia Schmid, Jakob Verbeek

Abstract: Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample quality, but suffer from two drawbacks: (i) they mode-drop, i.e., do not cover the full support of the train data, and (ii) they do not allow for likelihood eva… ▽ More Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample quality, but suffer from two drawbacks: (i) they mode-drop, i.e., do not cover the full support of the train data, and (ii) they do not allow for likelihood evaluations on held-out data. In contrast, likelihood-based training encourages models to cover the full support of the train data, but yields poorer samples. These mutual shortcomings can in principle be addressed by training generative latent variable models in a hybrid adversarial-likelihood manner. However, we show that commonly made parametric assumptions create a conflict between them, making successful hybrid models non trivial. As a solution, we propose to use deep invertible transformations in the latent variable decoder. This approach allows for likelihood computations in image space, is more efficient than fully invertible models, and can take full advantage of adversarial training. We show that our model significantly improves over existing hybrid models: offering GAN-like samples, IS and FID scores that are competitive with fully adversarial models, and improved likelihood scores. △ Less

Submitted 3 January, 2020; v1 submitted 4 January, 2019; originally announced January 2019.

The Compact Linear Collider (CLIC) - 2018 Summary Report

Authors: The CLIC, CLICdp collaborations, :, T. K. Charles, P. J. Giansiracusa, T. G. Lucas, R. P. Rassool, M. Volpi, C. Balazs, K. Afanaciev, V. Makarenko, A. Patapenka, I. Zhuk, C. Collette, M. J. Boland, A. C. Abusleme Hoffman, M. A. Diaz, F. Garay, Y. Chi, X. He, G. Pei, S. Pei, G. Shu, X. Wang, J. Zhang , et al. (671 additional authors not shown)

Abstract: The Compact Linear Collider (CLIC) is a TeV-scale high-luminosity linear $e^+e^-$ collider under development at CERN. Following the CLIC conceptual design published in 2012, this report provides an overview of the CLIC project, its current status, and future developments. It presents the CLIC physics potential and reports on design, technology, and implementation aspects of the accelerator and the… ▽ More The Compact Linear Collider (CLIC) is a TeV-scale high-luminosity linear $e^+e^-$ collider under development at CERN. Following the CLIC conceptual design published in 2012, this report provides an overview of the CLIC project, its current status, and future developments. It presents the CLIC physics potential and reports on design, technology, and implementation aspects of the accelerator and the detector. CLIC is foreseen to be built and operated in stages, at centre-of-mass energies of 380 GeV, 1.5 TeV and 3 TeV, respectively. CLIC uses a two-beam acceleration scheme, in which 12 GHz accelerating structures are powered via a high-current drive beam. For the first stage, an alternative with X-band klystron powering is also considered. CLIC accelerator optimisation, technical developments and system tests have resulted in an increased energy efficiency (power around 170 MW) for the 380 GeV stage, together with a reduced cost estimate at the level of 6 billion CHF. The detector concept has been refined using improved software tools. Significant progress has been made on detector technology developments for the tracking and calorimetry systems. A wide range of CLIC physics studies has been conducted, both through full detector simulations and parametric studies, together providing a broad overview of the CLIC physics potential. Each of the three energy stages adds cornerstones of the full CLIC physics programme, such as Higgs width and couplings, top-quark properties, Higgs self-coupling, direct searches, and many precision electroweak measurements. The interpretation of the combined results gives crucial and accurate insight into new physics, largely complementary to LHC and HL-LHC. The construction of the first CLIC energy stage could start by 2026. First beams would be available by 2035, marking the beginning of a broad CLIC physics programme spanning 25-30 years. △ Less

Submitted 6 May, 2019; v1 submitted 14 December, 2018; originally announced December 2018.

Comments: 112 pages, 59 figures; published as CERN Yellow Report Monograph Vol. 2/2018; corresponding editors: Philip N. Burrows, Nuria Catalan Lasheras, Lucie Linssen, Marko Petrič, Aidan Robson, Daniel Schulte, Eva Sicking, Steinar Stapnes

Report number: CERN-2018-005-M

Genetic and Neuroanatomical Support for Functional Brain Network Dynamics in Epilepsy

Authors: Pranav G. Reddy, Richard F. Betzel, Ankit N. Khambhati, Preya Shah, Lohith Kini, Brian Litt, Thomas H. Lucas, Kathryn A. Davis, Danielle S. Bassett

Abstract: Focal epilepsy is a devastating neurological disorder that affects an overwhelming number of patients worldwide, many of whom prove resistant to medication. The efficacy of current innovative technologies for the treatment of these patients has been stalled by the lack of accurate and effective methods to fuse multimodal neuroimaging data to map anatomical targets driving seizure dynamics. Here we… ▽ More Focal epilepsy is a devastating neurological disorder that affects an overwhelming number of patients worldwide, many of whom prove resistant to medication. The efficacy of current innovative technologies for the treatment of these patients has been stalled by the lack of accurate and effective methods to fuse multimodal neuroimaging data to map anatomical targets driving seizure dynamics. Here we propose a parsimonious model that explains how large-scale anatomical networks and shared genetic constraints shape inter-regional communication in focal epilepsy. In extensive ECoG recordings acquired from a group of patients with medically refractory focal-onset epilepsy, we find that ictal and preictal functional brain network dynamics can be accurately predicted from features of brain anatomy and geometry, patterns of white matter connectivity, and constraints complicit in patterns of gene coexpression, all of which are conserved across healthy adult populations. Moreover, we uncover evidence that markers of non-conserved architecture, potentially driven by idiosyncratic pathology of single subjects, are most prevalent in high frequency ictal dynamics and low frequency preictal dynamics. Finally, we find that ictal dynamics are better predicted by white matter features and more poorly predicted by geometry and genetic constraints than preictal dynamics, suggesting that the functional brain network dynamics manifest in seizures rely on - and may directly propagate along - underlying white matter structure that is largely conserved across humans. Broadly, our work offers insights into the generic architectural principles of the human brain that impact seizure dynamics, and could be extended to further our understanding, models, and predictions of subject-level pathology and response to intervention. △ Less

Submitted 11 September, 2018; originally announced September 2018.

Mixed batches and symmetric discriminators for GAN training

Authors: Thomas Lucas, Corentin Tallec, Jakob Verbeek, Yann Ollivier

Abstract: Generative adversarial networks (GANs) are pow- erful generative models based on providing feed- back to a generative network via a discriminator network. However, the discriminator usually as- sesses individual samples. This prevents the dis- criminator from accessing global distributional statistics of generated samples, and often leads to mode drop**: the generator models only part of the tar… ▽ More Generative adversarial networks (GANs) are pow- erful generative models based on providing feed- back to a generative network via a discriminator network. However, the discriminator usually as- sesses individual samples. This prevents the dis- criminator from accessing global distributional statistics of generated samples, and often leads to mode drop**: the generator models only part of the target distribution. We propose to feed the discriminator with mixed batches of true and fake samples, and train it to predict the ratio of true samples in the batch. The latter score does not depend on the order of samples in a batch. Rather than learning this invariance, we introduce a generic permutation-invariant discriminator ar- chitecture. This architecture is provably a uni- versal approximator of all symmetric functions. Experimentally, our approach reduces mode col- lapse in GANs on two synthetic datasets, and obtains good results on the CIFAR10 and CelebA datasets, both qualitatively and quantitatively. △ Less

Submitted 19 June, 2018; originally announced June 2018.

Comments: Accepted at ICML 2018 (long oral)

Variational Learning on Aggregate Outputs with Gaussian Processes

Authors: Ho Chung Leon Law, Dino Sejdinovic, Ewan Cameron, Tim CD Lucas, Seth Flaxman, Katherine Battle, Kenji Fukumizu

Abstract: While a typical supervised learning framework assumes that the inputs and the outputs are measured at the same levels of granularity, many applications, including global map** of disease, only have access to outputs at a much coarser level than that of the inputs. Aggregation of outputs makes generalization to new inputs much more difficult. We consider an approach to this problem based on varia… ▽ More While a typical supervised learning framework assumes that the inputs and the outputs are measured at the same levels of granularity, many applications, including global map** of disease, only have access to outputs at a much coarser level than that of the inputs. Aggregation of outputs makes generalization to new inputs much more difficult. We consider an approach to this problem based on variational learning with a model of output aggregation and Gaussian processes, where aggregation leads to intractability of the standard evidence lower bounds. We propose new bounds and tractable approximations, leading to improved prediction accuracy and scalability to large datasets, while explicitly taking uncertainty into account. We develop a framework which extends to several types of likelihoods, including the Poisson model for aggregated count data. We apply our framework to a challenging and important problem, the fine-scale spatial modelling of malaria incidence, with over 1 million observations. △ Less

Submitted 22 May, 2018; originally announced May 2018.

White Matter Network Architecture Guides Direct Electrical Stimulation Through Optimal State Transitions

Authors: Jennifer Stiso, Ankit N. Khambhati, Tommaso Menara, Ari E. Kahn, Joel M. Stein, Sandihitsu R. Das, Richard Gorniak, Joseph Tracy, Brian Litt, Kathryn A. Davis, Fabio Pasqualetti, Timothy Lucas, Danielle S. Bassett

Abstract: Electrical brain stimulation is currently being investigated as a therapy for neurological disease. However, opportunities to optimize such therapies are challenged by the fact that the beneficial impact of focal stimulation on both neighboring and distant regions is not well understood. Here, we use network control theory to build a model of brain network function that makes predictions about how… ▽ More Electrical brain stimulation is currently being investigated as a therapy for neurological disease. However, opportunities to optimize such therapies are challenged by the fact that the beneficial impact of focal stimulation on both neighboring and distant regions is not well understood. Here, we use network control theory to build a model of brain network function that makes predictions about how stimulation spreads through the brain's white matter network and influences large-scale dynamics. We test these predictions using combined electrocorticography (ECoG) and diffusion weighted imaging (DWI) data who volunteered to participate in an extensive stimulation regimen. We posit a specific model-based manner in which white matter tracts constrain stimulation, defining its capacity to drive the brain to new states, including states associated with successful memory encoding. In a first validation of our model, we find that the true pattern of white matter tracts can be used to more accurately predict the state transitions induced by direct electrical stimulation than the artificial patterns of null models. We then use a targeted optimal control framework to solve for the optimal energy required to drive the brain to a given state. We show that, intuitively, our model predicts larger energy requirements when starting from states that are farther away from a target memory state. We then suggest testable hypotheses about which structural properties will lead to efficient stimulation for improving memory based on energy requirements. Our work demonstrates that individual white matter architecture plays a vital role in guiding the dynamics of direct electrical stimulation, more generally offering empirical support for the utility of network control theoretic models of brain response to stimulation. △ Less

Submitted 3 May, 2018; originally announced May 2018.

Auxiliary Guided Autoregressive Variational Autoencoders

Authors: Thomas Lucas, Jakob Verbeek

Abstract: Generative modeling of high-dimensional data is a key problem in machine learning. Successful approaches include latent variable models and autoregressive models. The complementary strengths of these approaches, to model global and local image statistics respectively, suggest hybrid models that encode global image structure into latent variables while autoregressively modeling low level detail. Pr… ▽ More Generative modeling of high-dimensional data is a key problem in machine learning. Successful approaches include latent variable models and autoregressive models. The complementary strengths of these approaches, to model global and local image statistics respectively, suggest hybrid models that encode global image structure into latent variables while autoregressively modeling low level detail. Previous approaches to such hybrid models restrict the capacity of the autoregressive decoder to prevent degenerate models that ignore the latent variables and only rely on autoregressive modeling. Our contribution is a training procedure relying on an auxiliary loss function that controls which information is captured by the latent variables and what is left to the autoregressive decoder. Our approach can leverage arbitrarily powerful autoregressive decoders, achieves state-of-the art quantitative performance among models with latent variables, and generates qualitatively convincing samples. △ Less

Submitted 18 April, 2019; v1 submitted 30 November, 2017; originally announced November 2017.

Comments: Published as a conference paper at ECML-PKDD 2018

Parsing spatiotemporal dynamical stability in ECoG during seizure onset, propagation, and termination

Authors: Arian Ashourvan, Sérgio Pequito, Ankit N. Khambhati, Steven N. Baldassano, Kathryn A. Davis, Timothy Lucas, Jean M. Vettel, Brian Litt, George J. Pappas, Danielle S. Bassett

Abstract: Understanding brain dynamics in epilepsy is critical for establishing rigorous control objectives that enable new therapeutic methods to mitigate seizure occurrence. In multichannel electrocorticography (ECoG) recordings acquired in 21 subjects during a total of 94 seizures, we apply dynamical systems stability analysis to assess the balance versus imbalance of seizure dynamics across different ti… ▽ More Understanding brain dynamics in epilepsy is critical for establishing rigorous control objectives that enable new therapeutic methods to mitigate seizure occurrence. In multichannel electrocorticography (ECoG) recordings acquired in 21 subjects during a total of 94 seizures, we apply dynamical systems stability analysis to assess the balance versus imbalance of seizure dynamics across different timescales and brain regions. Specifically, we consider a sliding time window multivariate autoregressive linear approximation of the data captured by the ECoG channels, where eigendecomposition of the estimated matrix of coefficients describes the contribution of different regions to the spatiotemporal process (eigenvectors) associated with a particular timescale (eigenvalues). Interestingly, we observe a pattern of eigenvalue evolution and slowly changing (or approximately time-invariant) eigenvectors across both seizures and subjects. The seizure-onset is marked by an increase in high frequency spatial information to which a few regions contribute for a long period. By contrast, the seizure termination is characterized by a sudden, small time period change in dynamics to which many regions contribute. As the seizure terminates, the relatively stable ictal dynamics rapidly transition into the post-ictal regime, marked by relatively fast-dam** oscillations. Our methodology offers a subject-specific characterization of the spatiotemporal behavior of the seizure, providing new insights into the dynamic patterns and functional interactions between brain regions that occur over different timescales. More generally, our approach informs the development of engineering objectives that can be used to deploy new control strategies to prevent seizure evolution or to hasten seizure termination. △ Less

Submitted 25 June, 2017; originally announced June 2017.

Areas of Attention for Image Captioning

Authors: Marco Pedersoli, Thomas Lucas, Cordelia Schmid, Jakob Verbeek

Abstract: We propose "Areas of Attention", a novel attention-based model for automatic image captioning. Our approach models the dependencies between image regions, caption words, and the state of an RNN language model, using three pairwise interactions. In contrast to previous attention-based approaches that associate image regions only to the RNN state, our method allows a direct association between capti… ▽ More We propose "Areas of Attention", a novel attention-based model for automatic image captioning. Our approach models the dependencies between image regions, caption words, and the state of an RNN language model, using three pairwise interactions. In contrast to previous attention-based approaches that associate image regions only to the RNN state, our method allows a direct association between caption words and image regions. During training these associations are inferred from image-level captions, akin to weakly-supervised object detector training. These associations help to improve captioning by localizing the corresponding regions during testing. We also propose and compare different ways of generating attention areas: CNN activation grids, object proposals, and spatial transformers nets applied in a convolutional fashion. Spatial transformers give the best results. They allow for image specific attention areas, and can be trained jointly with the rest of the network. Our attention mechanism and spatial transformer attention areas together yield state-of-the-art results on the MSCOCO dataset.o meaningful latent semantic structure in the generated captions. △ Less

Submitted 25 August, 2017; v1 submitted 3 December, 2016; originally announced December 2016.

Comments: Accepted in ICCV 2017

Updated baseline for a staged Compact Linear Collider

Authors: The CLIC, CLICdp collaborations, :, M. J. Boland, U. Felzmann, P. J. Giansiracusa, T. G. Lucas, R. P. Rassool, C. Balazs, T. K. Charles, K. Afanaciev, I. Emeliantchik, A. Ignatenko, V. Makarenko, N. Shumeiko, A. Patapenka, I. Zhuk, A. C. Abusleme Hoffman, M. A. Diaz Gutierrez, M. Vogel Gonzalez, Y. Chi, X. He, G. Pei, S. Pei, G. Shu , et al. (493 additional authors not shown)

Abstract: The Compact Linear Collider (CLIC) is a multi-TeV high-luminosity linear e+e- collider under development. For an optimal exploitation of its physics potential, CLIC is foreseen to be built and operated in a staged approach with three centre-of-mass energy stages ranging from a few hundred GeV up to 3 TeV. The first stage will focus on precision Standard Model physics, in particular Higgs and top-q… ▽ More The Compact Linear Collider (CLIC) is a multi-TeV high-luminosity linear e+e- collider under development. For an optimal exploitation of its physics potential, CLIC is foreseen to be built and operated in a staged approach with three centre-of-mass energy stages ranging from a few hundred GeV up to 3 TeV. The first stage will focus on precision Standard Model physics, in particular Higgs and top-quark measurements. Subsequent stages will focus on measurements of rare Higgs processes, as well as searches for new physics processes and precision measurements of new states, e.g. states previously discovered at LHC or at CLIC itself. In the 2012 CLIC Conceptual Design Report, a fully optimised 3 TeV collider was presented, while the proposed lower energy stages were not studied to the same level of detail. This report presents an updated baseline staging scenario for CLIC. The scenario is the result of a comprehensive study addressing the performance, cost and power of the CLIC accelerator complex as a function of centre-of-mass energy and it targets optimal physics output based on the current physics landscape. The optimised staging scenario foresees three main centre-of-mass energy stages at 380 GeV, 1.5 TeV and 3 TeV for a full CLIC programme spanning 22 years. For the first stage, an alternative to the CLIC drive beam scheme is presented in which the main linac power is produced using X-band klystrons. △ Less

Submitted 27 March, 2017; v1 submitted 26 August, 2016; originally announced August 2016.

Comments: 57 pages, 27 figures, 12 tables, published as CERN Yellow Report. Updated version: Minor layout changes for print version

Report number: CERN-2016-004

Precision of readout at the hunchback gene: analyzing short transcription time traces in living fly embryos

Authors: Jonathan Desponds, Huy Tran, Teresa Ferraro, Tanguy Lucas, Carmina Perez Romero, Aurelien Guillou, Cecile Fradin, Mathieu Coppey, Nathalie Dostatni, Aleksandra M. Walczak

Abstract: The simultaneous expression of the hunchback gene in the numerous nuclei of the develo** fly embryo gives us a unique opportunity to study how transcription is regulated in living organisms. A recently developed MS2-MCP technique for imaging nascent messenger RNA in living Drosophila embryos allows us to quantify the dynamics of the developmental transcription process. The initial measurement of… ▽ More The simultaneous expression of the hunchback gene in the numerous nuclei of the develo** fly embryo gives us a unique opportunity to study how transcription is regulated in living organisms. A recently developed MS2-MCP technique for imaging nascent messenger RNA in living Drosophila embryos allows us to quantify the dynamics of the developmental transcription process. The initial measurement of the morphogens by the hunchback promoter takes place during very short cell cycles, not only giving each nucleus little time for a precise readout, but also resulting in short time traces of transcription. Additionally, the relationship between the measured signal and the promoter state depends on the molecular design of the reporting probe. We develop an analysis approach based on tailor made autocorrelation functions that overcomes the short trace problems and quantifies the dynamics of transcription initiation. Based on live imaging data, we identify signatures of bursty transcription initiation from the hunchback promoter. We show that the precision of the expression of the hunchback gene to measure its position along the anterior-posterior axis is low both at the boundary and in the anterior even at cycle 13, suggesting additional post-transcriptional averaging mechanisms to provide the precision observed in fixed embryos. △ Less

Submitted 20 November, 2016; v1 submitted 13 July, 2016; originally announced July 2016.

Emergence of long-range order in BaTiO3 from local symmetry-breaking distortions

Authors: M. S. Senn, D. A. Keen, T. C. A. Lucas, J. A. Hriljac, A. L. Goodwin

Abstract: By using a symmetry motivated basis to evaluate local distortions against pair distribution function data (PDF), we show without prior bias, that the off-centre Ti displacements in the archetypal ferroelectric BaTiO3 are zone centred and rhombohedral-like in nature across its known ferroelectric and paraelectric phases. With our newly-gained insight we construct a simple Monte Carlo (MC) model whi… ▽ More By using a symmetry motivated basis to evaluate local distortions against pair distribution function data (PDF), we show without prior bias, that the off-centre Ti displacements in the archetypal ferroelectric BaTiO3 are zone centred and rhombohedral-like in nature across its known ferroelectric and paraelectric phases. With our newly-gained insight we construct a simple Monte Carlo (MC) model which captures our main experimental findings and demonstrate how the rich crystallographic phase diagram of BaTiO3 emerges from correlations of local symmetry-breaking distortions alone. Our results strongly support the order-disorder picture for these phase transitions, but can also be reconciled with the soft-mode theory of BaTiO3 that is supported by some spectroscopic techniques. △ Less

Submitted 11 December, 2015; originally announced December 2015.

Comments: 5 pages, 3 figures

Journal ref: Phys. Rev. Lett. 116, 207602 (2016)

Competing Hydrostatic Compression Mechanisms in Nickel Cyanide

Authors: Jasper Adamson, Timothy C. Lucas, Andrew B. Cairns, Nicholas P. Funnell, Matthew G. Tucker, Annette K. Kleppe, Joseph A. Hriljac, Andrew L. Goodwin

Abstract: We use variable-pressure neutron and X-ray diffraction measurements to determine the uniaxial and bulk compressibilities of nickel(II) cyanide, Ni(CN)$_2$. Whereas other layered molecular framework materials are known to exhibit negative area compressibility, we find that Ni(CN)$_2$ does not. We attribute this difference to the existence of low-energy in-plane tilt modes that provide a pressure-ac… ▽ More We use variable-pressure neutron and X-ray diffraction measurements to determine the uniaxial and bulk compressibilities of nickel(II) cyanide, Ni(CN)$_2$. Whereas other layered molecular framework materials are known to exhibit negative area compressibility, we find that Ni(CN)$_2$ does not. We attribute this difference to the existence of low-energy in-plane tilt modes that provide a pressure-activated mechanism for layer contraction. The experimental bulk modulus we measure is about four times lower than that reported elsewhere on the basis of density functional theory methods [{\it Phys. Rev. B} {\bf 83}, 024301 (2011)]. △ Less

Submitted 9 July, 2015; originally announced July 2015.

Comments: 6 pages, 5 figures, 1 table

Journal ref: Physica B 479, 35-40 (2015)