Showing 1–50 of 95 results for author: Crowley, J

einspace: Searching for Neural Architectures from Fundamental Operations

Authors: Linus Ericsson, Miguel Espinosa, Chenhongyi Yang, Antreas Antoniou, Amos Storkey, Shay B. Cohen, Steven McDonagh, Elliot J. Crowley

Abstract: Neural architecture search (NAS) finds high performing networks for a given task. Yet the results of NAS are fairly prosaic; they did not e.g. create a shift from convolutional structures to transformers. This is not least because the search spaces in NAS often aren't diverse enough to include such transformations a priori. Instead, for NAS to provide greater potential for fundamental design shift… ▽ More Neural architecture search (NAS) finds high performing networks for a given task. Yet the results of NAS are fairly prosaic; they did not e.g. create a shift from convolutional structures to transformers. This is not least because the search spaces in NAS often aren't diverse enough to include such transformations a priori. Instead, for NAS to provide greater potential for fundamental design shifts, we need a novel expressive search space design which is built from more fundamental operations. To this end, we introduce einspace, a search space based on a parameterised probabilistic context-free grammar. Our space is versatile, supporting architectures of various sizes and complexities, while also containing diverse network operations which allow it to model convolutions, attention components and more. It contains many existing competitive architectures, and provides flexibility for discovering new ones. Using this search space, we perform experiments to find novel architectures as well as improvements on existing ones on the diverse Unseen NAS datasets. We show that competitive architectures can be obtained by searching from scratch, and we consistently find large improvements when initialising the search with strong baselines. We believe that this work is an important advancement towards a transformative NAS paradigm where search space expressivity and strategic search initialisation play key roles. △ Less

Submitted 31 May, 2024; originally announced May 2024.

Comments: Project page at https://linusericsson.github.io/einspace/

Band structure engineering using a moiré polar substrate

Authors: Xirui Wang, Cheng Xu, Samuel Aronson, Daniel Bennett, Nisarga Paul, Philip J. D. Crowley, Clément Collignon, Kenji Watanabe, Takashi Taniguchi, Raymond Ashoori, Efthimios Kaxiras, Yang Zhang, Pablo Jarillo-Herrero, Kenji Yasuda

Abstract: Applying long wavelength periodic potentials on quantum materials has recently been demonstrated to be a promising pathway for engineering novel quantum phases of matter. Here, we utilize twisted bilayer boron nitride (BN) as a moiré substrate for band structure engineering. Small-angle-twisted bilayer BN is endowed with periodically arranged up and down polar domains, which imprints a periodic el… ▽ More Applying long wavelength periodic potentials on quantum materials has recently been demonstrated to be a promising pathway for engineering novel quantum phases of matter. Here, we utilize twisted bilayer boron nitride (BN) as a moiré substrate for band structure engineering. Small-angle-twisted bilayer BN is endowed with periodically arranged up and down polar domains, which imprints a periodic electrostatic potential on a target two-dimensional (2D) material placed on top. As a proof of concept, we use Bernal bilayer graphene as the target material. The resulting modulation of the band structure appears as superlattice resistance peaks, tunable by varying the twist angle, and Hofstadter butterfly physics under a magnetic field. Additionally, we demonstrate the tunability of the moiré potential by altering the dielectric thickness underneath the twisted BN. Finally, we find that near-60°-twisted bilayer BN provides a unique platform for studying the moiré structural effect without the contribution from electrostatic moiré potentials. Tunable moiré polar substrates may serve as versatile platforms to engineer the electronic, optical, and mechanical properties of 2D materials and van der Waals heterostructures. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Comments: 21 pages, 11 figures

Hyperparameter Selection in Continual Learning

Authors: Thomas L. Lee, Sigrid Passano Hellan, Linus Ericsson, Elliot J. Crowley, Amos Storkey

Abstract: In continual learning (CL) -- where a learner trains on a stream of data -- standard hyperparameter optimisation (HPO) cannot be applied, as a learner does not have access to all of the data at the same time. This has prompted the development of CL-specific HPO frameworks. The most popular way to tune hyperparameters in CL is to repeatedly train over the whole data stream with different hyperparam… ▽ More In continual learning (CL) -- where a learner trains on a stream of data -- standard hyperparameter optimisation (HPO) cannot be applied, as a learner does not have access to all of the data at the same time. This has prompted the development of CL-specific HPO frameworks. The most popular way to tune hyperparameters in CL is to repeatedly train over the whole data stream with different hyperparameter settings. However, this end-of-training HPO is unrealistic as in practice a learner can only see the stream once. Hence, there is an open question: what HPO framework should a practitioner use for a CL problem in reality? This paper answers this question by evaluating several realistic HPO frameworks. We find that all the HPO frameworks considered, including end-of-training HPO, perform similarly. We therefore advocate using the realistic and most computationally efficient method: fitting the hyperparameters on the first task and then fixing them throughout training. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Comments: Preprint, 9 pages

EgoPoseFormer: A Simple Baseline for Egocentric 3D Human Pose Estimation

Authors: Chenhongyi Yang, Anastasia Tkach, Shreyas Hampali, Linguang Zhang, Elliot J. Crowley, Cem Keskin

Abstract: We present EgoPoseFormer, a simple yet effective transformer-based model for stereo egocentric human pose estimation. The main challenge in egocentric pose estimation is overcoming joint invisibility, which is caused by self-occlusion or a limited field of view (FOV) of head-mounted cameras. Our approach overcomes this challenge by incorporating a two-stage pose estimation paradigm: in the first s… ▽ More We present EgoPoseFormer, a simple yet effective transformer-based model for stereo egocentric human pose estimation. The main challenge in egocentric pose estimation is overcoming joint invisibility, which is caused by self-occlusion or a limited field of view (FOV) of head-mounted cameras. Our approach overcomes this challenge by incorporating a two-stage pose estimation paradigm: in the first stage, our model leverages the global information to estimate each joint's coarse location, then in the second stage, it employs a DETR style transformer to refine the coarse locations by exploiting fine-grained stereo visual features. In addition, we present a deformable stereo operation to enable our transformer to effectively process multi-view features, which enables it to accurately localize each joint in the 3D world. We evaluate our method on the stereo UnrealEgo dataset and show it significantly outperforms previous approaches while being computationally efficient: it improves MPJPE by 27.4mm (45% improvement) with only 7.9% model parameters and 13.1% FLOPs compared to the state-of-the-art. Surprisingly, with proper training techniques, we find that even our first-stage pose proposal network can achieve superior performance compared to previous arts. We also show that our method can be seamlessly extended to monocular settings, which achieves state-of-the-art performance on the SceneEgo dataset, improving MPJPE by 25.5mm (21% improvement) compared to the best existing method with only 60.7% model parameters and 36.4% FLOPs. △ Less

Submitted 26 March, 2024; originally announced March 2024.

Comments: Tech Report

PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition

Authors: Chenhongyi Yang, Zehui Chen, Miguel Espinosa, Linus Ericsson, Zhenyu Wang, Jiaming Liu, Elliot J. Crowley

Abstract: We present PlainMamba: a simple non-hierarchical state space model (SSM) designed for general visual recognition. The recent Mamba model has shown how SSMs can be highly competitive with other architectures on sequential data and initial attempts have been made to apply it to images. In this paper, we further adapt the selective scanning process of Mamba to the visual domain, enhancing its ability… ▽ More We present PlainMamba: a simple non-hierarchical state space model (SSM) designed for general visual recognition. The recent Mamba model has shown how SSMs can be highly competitive with other architectures on sequential data and initial attempts have been made to apply it to images. In this paper, we further adapt the selective scanning process of Mamba to the visual domain, enhancing its ability to learn features from two-dimensional images by (i) a continuous 2D scanning process that improves spatial continuity by ensuring adjacency of tokens in the scanning sequence, and (ii) direction-aware updating which enables the model to discern the spatial relations of tokens by encoding directional information. Our architecture is designed to be easy to use and easy to scale, formed by stacking identical PlainMamba blocks, resulting in a model with constant width throughout all layers. The architecture is further simplified by removing the need for special tokens. We evaluate PlainMamba on a variety of visual recognition tasks including image classification, semantic segmentation, object detection, and instance segmentation. Our method achieves performance gains over previous non-hierarchical models and is competitive with hierarchical alternatives. For tasks requiring high-resolution inputs, in particular, PlainMamba requires much less computing while maintaining high performance. Code and models are available at https://github.com/ChenhongyiYang/PlainMamba △ Less

Submitted 26 March, 2024; originally announced March 2024.

Absence of disordered Thouless pumps at finite frequency

Authors: Dominik Vuina, David M. Long, Philip J. D. Crowley, Anushya Chandran

Abstract: A Thouless pump is a slowly driven one-dimensional band insulator which pumps charge at a quantised rate. Previous work showed that pum** persists in weakly disordered chains, and separately in clean chains at finite drive frequency. We study the interplay of disorder and finite frequency, and show that the pump rate always decays to zero due to non-adiabatic transitions between the instantaneou… ▽ More A Thouless pump is a slowly driven one-dimensional band insulator which pumps charge at a quantised rate. Previous work showed that pum** persists in weakly disordered chains, and separately in clean chains at finite drive frequency. We study the interplay of disorder and finite frequency, and show that the pump rate always decays to zero due to non-adiabatic transitions between the instantaneous eigenstates. However, the decay is slow, occurring on a time-scale that is exponentially large in the period of the drive. In the adiabatic limit, the band gap in the instantaneous spectrum closes at a critical disorder strength above which pum** ceases. We predict the scaling of the pump rate around this transition from a model of scattering between rare states near the band edges. Our predictions can be experimentally tested in ultracold atomic and photonic platforms. △ Less

Submitted 12 February, 2024; v1 submitted 30 January, 2024; originally announced January 2024.

Comments: 11 pages, 7 figures

WidthFormer: Toward Efficient Transformer-based BEV View Transformation

Authors: Chenhongyi Yang, Tianwei Lin, Lichao Huang, Elliot J. Crowley

Abstract: In this work, we present WidthFormer, a novel transformer-based Bird's-Eye-View (BEV) 3D detection method tailored for real-time autonomous-driving applications. WidthFormer is computationally efficient, robust and does not require any special engineering effort to deploy. In this work, we propose a novel 3D positional encoding mechanism capable of accurately encapsulating 3D geometric information… ▽ More In this work, we present WidthFormer, a novel transformer-based Bird's-Eye-View (BEV) 3D detection method tailored for real-time autonomous-driving applications. WidthFormer is computationally efficient, robust and does not require any special engineering effort to deploy. In this work, we propose a novel 3D positional encoding mechanism capable of accurately encapsulating 3D geometric information, which enables our model to generate high-quality BEV representations with only a single transformer decoder layer. This mechanism is also beneficial for existing sparse 3D object detectors. Inspired by the recently-proposed works, we further improve our model's efficiency by vertically compressing the image features when serving as attention keys and values. We also introduce two modules to compensate for potential information loss due to feature compression. Experimental evaluation on the widely-used nuScenes 3D object detection benchmark demonstrates that our method outperforms previous approaches across different 3D detection architectures. More importantly, our model is highly efficient. For example, when using $256\times 704$ input images, it achieves 1.5 ms and 2.8 ms latency on NVIDIA 3090 GPU and Horizon Journey-5 computation solutions, respectively. Furthermore, WidthFormer also exhibits strong robustness to different degrees of camera perturbations. Our study offers valuable insights into the deployment of BEV transformation methods in real-world, complex road environments. Code is available at https://github.com/ChenhongyiYang/WidthFormer . △ Less

Submitted 15 January, 2024; v1 submitted 8 January, 2024; originally announced January 2024.

Accommodating Missing Modalities in Time-Continuous Multimodal Emotion Recognition

Authors: Juan Vazquez-Rodriguez, Grégoire Lefebvre, Julien Cumin, James L. Crowley

Abstract: Decades of research indicate that emotion recognition is more effective when drawing information from multiple modalities. But what if some modalities are sometimes missing? To address this problem, we propose a novel Transformer-based architecture for recognizing valence and arousal in a time-continuous manner even with missing input modalities. We use a coupling of cross-attention and self-atten… ▽ More Decades of research indicate that emotion recognition is more effective when drawing information from multiple modalities. But what if some modalities are sometimes missing? To address this problem, we propose a novel Transformer-based architecture for recognizing valence and arousal in a time-continuous manner even with missing input modalities. We use a coupling of cross-attention and self-attention mechanisms to emphasize relationships between modalities during time and enhance the learning process on weak salient inputs. Experimental results on the Ulm-TSST dataset show that our model exhibits an improvement of the concordance correlation coefficient evaluation of 37% when predicting arousal values and 30% when predicting valence values, compared to a late-fusion baseline approach. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Journal ref: Affective Computing and Intelligent Interaction (ACII), Sep 2023, Cambridge (MA), United States

Dimensional reduction from magnetic field in moiré superlattices

Authors: Nisarga Paul, Philip J. D. Crowley, Liang Fu

Abstract: Moiré materials provide a highly tunable platform in which novel electronic phenomena can emerge. We study strained moiré materials in a uniform magnetic field and predict highly anisotropic electrical conductivity which switches easy-axis as magnetic field or strain is varied. The dramatic anisotropy reflects one-dimensional localization (dimensional reduction) of the electron wavefunctions along… ▽ More Moiré materials provide a highly tunable platform in which novel electronic phenomena can emerge. We study strained moiré materials in a uniform magnetic field and predict highly anisotropic electrical conductivity which switches easy-axis as magnetic field or strain is varied. The dramatic anisotropy reflects one-dimensional localization (dimensional reduction) of the electron wavefunctions along a crystal axis due to quantum interference effects. This can be understood in an effective one-dimensional quasiperiodic Aubry-André-like models, or in a complementary semiclassical picture. This phenomenon should be observable in strained moiré materials at realistic fields and low strain disorder, as well as unstrained systems with anisotropic Fermi surfaces. △ Less

Submitted 15 November, 2023; originally announced November 2023.

Comments: 6+6 pages, 4 figures

Journal ref: Phys. Rev. Lett. 132, 246402 (2024)

DLAS: An Exploration and Assessment of the Deep Learning Acceleration Stack

Authors: Perry Gibson, José Cano, Elliot J. Crowley, Amos Storkey, Michael O'Boyle

Abstract: Deep Neural Networks (DNNs) are extremely computationally demanding, which presents a large barrier to their deployment on resource-constrained devices. Since such devices are where many emerging deep learning applications lie (e.g., drones, vision-based medical technology), significant bodies of work from both the machine learning and systems communities have attempted to provide optimizations to… ▽ More Deep Neural Networks (DNNs) are extremely computationally demanding, which presents a large barrier to their deployment on resource-constrained devices. Since such devices are where many emerging deep learning applications lie (e.g., drones, vision-based medical technology), significant bodies of work from both the machine learning and systems communities have attempted to provide optimizations to accelerate DNNs. To help unify these two perspectives, in this paper we combine machine learning and systems techniques within the Deep Learning Acceleration Stack (DLAS), and demonstrate how these layers can be tightly dependent on each other with an across-stack perturbation study. We evaluate the impact on accuracy and inference time when varying different parameters of DLAS across two datasets, seven popular DNN architectures, four DNN compression techniques, three algorithmic primitives with sparse and dense variants, untuned and auto-scheduled code generation, and four hardware platforms. Our evaluation highlights how perturbations across DLAS parameters can cause significant variation and across-stack interactions. The highest level observation from our evaluation is that the model size, accuracy, and inference time are not guaranteed to be correlated. Overall we make 13 key observations, including that speedups provided by compression techniques are very hardware dependent, and that compiler auto-tuning can significantly alter what the best algorithm to use for a given configuration is. With DLAS, we aim to provide a reference framework to aid machine learning and systems practitioners in reasoning about the context in which their respective DNN acceleration solutions exist in. With our evaluation strongly motivating the need for co-design, we believe that DLAS can be a valuable concept for exploring the next generation of co-designed accelerated deep learning solutions. △ Less

Submitted 15 November, 2023; originally announced November 2023.

Generate Your Own Scotland: Satellite Image Generation Conditioned on Maps

Authors: Miguel Espinosa, Elliot J. Crowley

Abstract: Despite recent advancements in image generation, diffusion models still remain largely underexplored in Earth Observation. In this paper we show that state-of-the-art pretrained diffusion models can be conditioned on cartographic data to generate realistic satellite images. We provide two large datasets of paired OpenStreetMap images and satellite views over the region of Mainland Scotland and the… ▽ More Despite recent advancements in image generation, diffusion models still remain largely underexplored in Earth Observation. In this paper we show that state-of-the-art pretrained diffusion models can be conditioned on cartographic data to generate realistic satellite images. We provide two large datasets of paired OpenStreetMap images and satellite views over the region of Mainland Scotland and the Central Belt. We train a ControlNet model and qualitatively evaluate the results, demonstrating that both image quality and map fidelity are possible. Finally, we provide some insights on the opportunities and challenges of applying these models for remote sensing. Our model weights and code for creating the dataset are publicly available at https://github.com/miquel-espinosa/map-sat. △ Less

Submitted 31 August, 2023; originally announced August 2023.

Comments: 13 pages, 6 figures. preprint

Ultra-miniature dual-wavelength spatial frequency domain imaging for micro-endoscopy

Authors: Jane Crowley, George S. D. Gordon

Abstract: There is a need for a cost-effective, quantitative imaging tool that can be deployed endoscopically to better detect early stage gastrointestinal cancers. Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that produces near-real time, quantitative maps of absorption and reduced scattering coefficients, but most implementations are bulky and suitable only for use outside the b… ▽ More There is a need for a cost-effective, quantitative imaging tool that can be deployed endoscopically to better detect early stage gastrointestinal cancers. Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that produces near-real time, quantitative maps of absorption and reduced scattering coefficients, but most implementations are bulky and suitable only for use outside the body. We present an ultra-miniature SFDI system comprised of an optical fiber array (diameter $0.125$ mm) and a micro camera ($1\times1$ mm package) displacing conventionally bulky components, in particular the projector. The prototype has outer diameter $3$ mm, but the individual components dimensions could permit future packaging to $<1.5$ mm diameter. We develop a phase-tracking algorithm to rapidly extract images with fringe projections at $3$ equispaced phase shifts in order to perform SFDI demodulation. To validate performance, we first demonstrate comparable recovery of quantitative optical properties between our ultra-miniature system and a conventional bench-top SFDI system with agreement of $15$\% and $6$\% for absorption and reduced scattering respectively. Next, we demonstrate imaging of absorption and reduced scattering of tissue-mimicking phantoms providing enhanced contrast between simulated tissue types (healthy and tumour), done simultaneously at wavelengths of $515$ nm and $660$ nm. This device shows promise as a cost-effective, quantitative imaging tool to detect variations in optical absorption and scattering as indicators of cancer. △ Less

Submitted 3 October, 2023; v1 submitted 6 June, 2023; originally announced June 2023.

Comments: 33 pages, 10 figures

Ergodicity breaking in rapidly rotating C60 fullerenes

Authors: Lee R. Liu, Dina Rosenberg, P. Bryan Changala, Philip J. D. Crowley, David J. Nesbitt, Norman Y. Yao, Timur Tscherbul, Jun Ye

Abstract: Ergodicity, the central tenet of statistical mechanics, requires that an isolated system will explore all of its available phase space permitted by energetic and symmetry constraints. Mechanisms for violating ergodicity are of great interest for probing non-equilibrium matter and for protecting quantum coherence in complex systems. For decades, polyatomic molecules have served as an intriguing and… ▽ More Ergodicity, the central tenet of statistical mechanics, requires that an isolated system will explore all of its available phase space permitted by energetic and symmetry constraints. Mechanisms for violating ergodicity are of great interest for probing non-equilibrium matter and for protecting quantum coherence in complex systems. For decades, polyatomic molecules have served as an intriguing and challenging platform for probing ergodicity breaking in vibrational energy transport, particularly in the context of controlling chemical reactions. Here, we report the observation of rotational ergodicity breaking in an unprecedentedly large and symmetric molecule, 12C60. This is facilitated by the first ever observation of icosahedral ro-vibrational fine structure in any physical system, first predicted for 12C60 in 1986. The ergodicity breaking exhibits several surprising features: first, there are multiple transitions between ergodic and non-ergodic regimes as the total angular momentum is increased, and second, they occur well below the traditional vibrational ergodicity threshold. These peculiar dynamics result from the molecules' unique combination of symmetry, size, and rigidity, highlighting the potential of fullerenes to uncover emergent phenomena in mesoscopic quantum systems. △ Less

Submitted 9 May, 2023; originally announced May 2023.

Giant energy oscillations mediated by a quasiperiodically driven qubit

Authors: Dominik Vuina, David M. Long, Phillip J. D. Crowley, Anushya Chandran

Abstract: A qubit driven by two incommensurate frequencies can mediate a quantised average energy current in the adiabatic limit. We show that non-adiabatic processes result in reversals of the energy current and corresponding oscillations in the net energy transferred between the drives. The oscillations are bounded but giant -- much larger than the qubit energy splitting. A Landau-Zener analysis predicts… ▽ More A qubit driven by two incommensurate frequencies can mediate a quantised average energy current in the adiabatic limit. We show that non-adiabatic processes result in reversals of the energy current and corresponding oscillations in the net energy transferred between the drives. The oscillations are bounded but giant -- much larger than the qubit energy splitting. A Landau-Zener analysis predicts that the timescale of the oscillations is exponentially large in the period of the drives. However, numerical analysis reveals that this timescale is not a monotonic function of the period, and has increasing sub-structure as the adiabatic limit is approached. We show that this non-monotonicity arises from interference effects between subsequent Landau-Zener transitions. Giant energy oscillations should be observable in near-term experiments with nitrogen-vacancy centers. △ Less

Submitted 3 April, 2023; originally announced April 2023.

Comments: 10 pages, 8 figures

Designing and simulating realistic spatial frequency domain imaging systems using open-source 3D rendering software

Authors: Jane Crowley, George S. D. Gordon

Abstract: Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that can deliver real-time maps of absorption and reduced scattering coefficients. However, there are a wide range of imaging geometries that practical SFDI systems must cope with including imaging flat samples ex vivo, imaging inside tubular lumen in vivo such as in an endoscopy, and measuring tumours or polyps of varying sha… ▽ More Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that can deliver real-time maps of absorption and reduced scattering coefficients. However, there are a wide range of imaging geometries that practical SFDI systems must cope with including imaging flat samples ex vivo, imaging inside tubular lumen in vivo such as in an endoscopy, and measuring tumours or polyps of varying shapes, sizes and optical properties. There is a need for a design and simulation tool to accelerate design and fabrication of new SFDI systems. We present such a system implemented using open-source 3D design and ray-tracing software Blender that is capable of simulating media with realistic optical properties (mimicking healthy and cancerous tissue), a wide variety of shapes and size, and in both planar and tubular imaging geometries. We first demonstrate quantitative agreement between Monte-Carlo simulated scattering and absorption coefficients and those measured from our Blender system. Next, we show the ability of the system to simulate absorption, scattering and shape for flat samples with small simulated tumours and show that the improved contrast associated with SFDI is reproduced. Finally, to demonstrate the versatility of the system as a design tool we show that it can be used to generate a custom look-up-table for map** from modulation amplitude values to absorption and scattering values in a tubular geometry, simulating a lumen. As a demonstrative example we show that longitudinal sectioning of the tube, with separate look-up tables for each section, significantly improves accuracy of SFDI, representing an important design insight for future systems. We therefore anticipate our simulation system will significantly aid in the design and development of novel SFDI systems, especially as such systems are miniaturised for deployment in endoscopic and laparoscopic systems. △ Less

Submitted 24 February, 2023; originally announced February 2023.

Comments: 16 pages, 8 figures

Superconductivity and strong interactions in a tunable moiré quasiperiodic crystal

Authors: Aviram Uri, Sergio C. de la Barrera, Mallika T. Randeria, Daniel Rodan-Legrain, Trithep Devakul, Philip J. D. Crowley, Nisarga Paul, Kenji Watanabe, Takashi Taniguchi, Ron Lifshitz, Liang Fu, Raymond C. Ashoori, Pablo Jarillo-Herrero

Abstract: Electronic states in quasiperiodic crystals generally preclude a Bloch description, rendering them simultaneously fascinating and enigmatic. Owing to their complexity and relative scarcity, quasiperiodic crystals are underexplored relative to periodic and amorphous structures. Here, we introduce a new type of highly tunable quasiperiodic crystal easily assembled from periodic components. By twisti… ▽ More Electronic states in quasiperiodic crystals generally preclude a Bloch description, rendering them simultaneously fascinating and enigmatic. Owing to their complexity and relative scarcity, quasiperiodic crystals are underexplored relative to periodic and amorphous structures. Here, we introduce a new type of highly tunable quasiperiodic crystal easily assembled from periodic components. By twisting three layers of graphene with two different twist angles, we form two moiré patterns with incommensurate moiré unit cells. In contrast to many common quasiperiodic structures that are defined on the atomic scale, the quasiperiodicity in our system is defined on moiré length scales of several nanometers. This novel "moiré quasiperiodic crystal" allows us to tune the chemical potential and thus the electronic system between a periodic-like regime at low energies and a strongly quasiperiodic regime at higher energies, the latter hosting a large density of weakly dispersing states. Interestingly, in the quasiperiodic regime we observe superconductivity near a flavor-symmetry-breaking phase transition, the latter indicative of the important role electronic interactions play in that regime. The prevalence of interacting phenomena in future systems with in situ tunability is not only useful for the study of quasiperiodic systems, but it may also provide insights into electronic ordering in related periodic moiré crystals. We anticipate that extending this new platform to engineer quasiperiodic crystals by varying the number of layers and twist angles, and by using different two-dimensional components, will lead to a new family of quantum materials to investigate the properties of strongly interacting quasiperiodic crystals. △ Less

Submitted 1 February, 2023; originally announced February 2023.

Emotion Recognition with Pre-Trained Transformers Using Multimodal Signals

Authors: Juan Vazquez-Rodriguez, Grégoire Lefebvre, Julien Cumin, James L Crowley

Abstract: In this paper, we address the problem of multimodal emotion recognition from multiple physiological signals. We demonstrate that a Transformer-based approach is suitable for this task. In addition, we present how such models may be pretrained in a multimodal scenario to improve emotion recognition performances. We evaluate the benefits of using multimodal inputs and pre-training with our approach… ▽ More In this paper, we address the problem of multimodal emotion recognition from multiple physiological signals. We demonstrate that a Transformer-based approach is suitable for this task. In addition, we present how such models may be pretrained in a multimodal scenario to improve emotion recognition performances. We evaluate the benefits of using multimodal inputs and pre-training with our approach on a state-ofthe-art dataset. △ Less

Submitted 22 December, 2022; originally announced December 2022.

Journal ref: ACII 2022 - 10th International Conference on Affective Computing and Intelligent Interaction, Oct 2022, Nara, Japan

A Hierarchical Framework for Collaborative Artificial Intelligence

Authors: James L. Crowley, Joëlle L Coutaz, Jasmin Grosinger, Javier Vázquez-Salceda, Cecilio Angulo, Alberto Sanfeliu, Luca Iocchi, Anthony G. Cohn

Abstract: We propose a hierarchical framework for collaborative intelligent systems. This framework organizes research challenges based on the nature of the collaborative activity and the information that must be shared, with each level building on capabilities provided by lower levels. We review research paradigms at each level, with a description of classical engineering-based approaches and modern altern… ▽ More We propose a hierarchical framework for collaborative intelligent systems. This framework organizes research challenges based on the nature of the collaborative activity and the information that must be shared, with each level building on capabilities provided by lower levels. We review research paradigms at each level, with a description of classical engineering-based approaches and modern alternatives based on machine learning, illustrated with a running example using a hypothetical personal service robot. We discuss cross-cutting issues that occur at all levels, focusing on the problem of communicating and sharing comprehension, the role of explanation and the social nature of collaboration. We conclude with a summary of research challenges and a discussion of the potential for economic and societal impact provided by technologies that enhance human abilities and empower people and society through collaboration with Intelligent Systems. △ Less

Submitted 14 December, 2022; originally announced December 2022.

Journal ref: IEEE Pervasive Computing, 2022

GPViT: A High Resolution Non-Hierarchical Vision Transformer with Group Propagation

Authors: Chenhongyi Yang, Jiarui Xu, Shalini De Mello, Elliot J. Crowley, Xiaolong Wang

Abstract: We present the Group Propagation Vision Transformer (GPViT): a novel nonhierarchical (i.e. non-pyramidal) transformer model designed for general visual recognition with high-resolution features. High-resolution features (or tokens) are a natural fit for tasks that involve perceiving fine-grained details such as detection and segmentation, but exchanging global information between these features is… ▽ More We present the Group Propagation Vision Transformer (GPViT): a novel nonhierarchical (i.e. non-pyramidal) transformer model designed for general visual recognition with high-resolution features. High-resolution features (or tokens) are a natural fit for tasks that involve perceiving fine-grained details such as detection and segmentation, but exchanging global information between these features is expensive in memory and computation because of the way self-attention scales. We provide a highly efficient alternative Group Propagation Block (GP Block) to exchange global information. In each GP Block, features are first grouped together by a fixed number of learnable group tokens; we then perform Group Propagation where global information is exchanged between the grouped features; finally, global information in the updated grouped features is returned back to the image features through a transformer decoder. We evaluate GPViT on a variety of visual recognition tasks including image classification, semantic segmentation, object detection, and instance segmentation. Our method achieves significant performance gains over previous works across all tasks, especially on tasks that require highresolution outputs, for example, our GPViT-L3 outperforms Swin Transformer-B by 2.0 mIoU on ADE20K semantic segmentation with only half as many parameters. Project page: chenhongyiyang.com/projects/GPViT/GPViT △ Less

Submitted 25 April, 2023; v1 submitted 13 December, 2022; originally announced December 2022.

Comments: Accepted by ICLR 2023. Project Page: chenhongyiyang.com/projects/GPViT/GPViT. Code: https://github.com/ChenhongyiYang/GPViT

Observed Rate Variation in Superflaring G-type Stars

Authors: James Crowley, Michael S. Wheatland, Kai Yang

Abstract: Flare occurrence on the Sun is highly variable, exhibiting both short term variation due to the emergence and evolution of active regions, and long-term variation from the solar cycle. On solar-like stars, much larger stellar flares (superflares) have been observed, and it is of interest to determine whether observed rates of superflare occurrence exhibit similar variability to solar flares. We an… ▽ More Flare occurrence on the Sun is highly variable, exhibiting both short term variation due to the emergence and evolution of active regions, and long-term variation from the solar cycle. On solar-like stars, much larger stellar flares (superflares) have been observed, and it is of interest to determine whether observed rates of superflare occurrence exhibit similar variability to solar flares. We analyse 274 G-type stars using data from the Transiting Exoplanet Survey Satellite (TESS) and identify seven stars which exhibit statistically significant changes in the rate of superflare occurrence by fitting a piecewise constant-rate model with the Bayesian Blocks algorithm (Scargle et al 2012; arXiv:1207.5578). We investigate the properties of these stars and their flaring rates, and discuss the possible reasons for the low number of stars with detectable rate variation. △ Less

Submitted 2 December, 2022; originally announced December 2022.

Comments: 18 pages, 13 figures, ApJ Accepted 2022-11-21

Plug and Play Active Learning for Object Detection

Authors: Chenhongyi Yang, Lichao Huang, Elliot J. Crowley

Abstract: Annotating datasets for object detection is an expensive and time-consuming endeavor. To minimize this burden, active learning (AL) techniques are employed to select the most informative samples for annotation within a constrained "annotation budget". Traditional AL strategies typically rely on model uncertainty or sample diversity for query sampling, while more advanced methods have focused on de… ▽ More Annotating datasets for object detection is an expensive and time-consuming endeavor. To minimize this burden, active learning (AL) techniques are employed to select the most informative samples for annotation within a constrained "annotation budget". Traditional AL strategies typically rely on model uncertainty or sample diversity for query sampling, while more advanced methods have focused on develo** AL-specific object detector architectures to enhance performance. However, these specialized approaches are not readily adaptable to different object detectors due to the significant engineering effort required for integration. To overcome this challenge, we introduce Plug and Play Active Learning (PPAL), a simple and effective AL strategy for object detection. PPAL is a two-stage method comprising uncertainty-based and diversity-based sampling phases. In the first stage, our Difficulty Calibrated Uncertainty Sampling leverage a category-wise difficulty coefficient that combines both classification and localisation difficulties to re-weight instance uncertainties, from which we sample a candidate pool for the subsequent diversity-based sampling. In the second stage, we propose Category Conditioned Matching Similarity to better compute the similarities of multi-instance images as ensembles of their instance similarities, which is used by the k-Means++ algorithm to sample the final AL queries. PPAL makes no change to model architectures or detector training pipelines; hence it can be easily generalized to different object detectors. We benchmark PPAL on the MS-COCO and Pascal VOC datasets using different detector architectures and show that our method outperforms prior work by a large margin. Code is available at https://github.com/ChenhongyiYang/PPAL △ Less

Submitted 14 March, 2024; v1 submitted 21 November, 2022; originally announced November 2022.

Comments: CVPR 2024

TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut

Authors: Yangtao Wang, Xi Shen, Yuan Yuan, Yuming Du, Maomao Li, Shell Xu Hu, James L Crowley, Dominique Vaufreydaz

Abstract: In this paper, we describe a graph-based algorithm that uses the features obtained by a self-supervised transformer to detect and segment salient objects in images and videos. With this approach, the image patches that compose an image or video are organised into a fully connected graph, where the edge between each pair of patches is labeled with a similarity score between patches using features l… ▽ More In this paper, we describe a graph-based algorithm that uses the features obtained by a self-supervised transformer to detect and segment salient objects in images and videos. With this approach, the image patches that compose an image or video are organised into a fully connected graph, where the edge between each pair of patches is labeled with a similarity score between patches using features learned by the transformer. Detection and segmentation of salient objects is then formulated as a graph-cut problem and solved using the classical Normalized Cut algorithm. Despite the simplicity of this approach, it achieves state-of-the-art results on several common image and video detection and segmentation tasks. For unsupervised object discovery, this approach outperforms the competing approaches by a margin of 6.1%, 5.7%, and 2.6%, respectively, when tested with the VOC07, VOC12, and COCO20K datasets. For the unsupervised saliency detection task in images, this method improves the score for Intersection over Union (IoU) by 4.4%, 5.6% and 5.2%. When tested with the ECSSD, DUTS, and DUT-OMRON datasets, respectively, compared to current state-of-the-art techniques. This method also achieves competitive results for unsupervised video object segmentation tasks with the DAVIS, SegTV2, and FBMS datasets. △ Less

Submitted 5 December, 2023; v1 submitted 1 September, 2022; originally announced September 2022.

Comments: arXiv admin note: text overlap with arXiv:2202.11539

Observing a Dynamical Skeleton of Turbulence in Taylor-Couette Flow Experiments

Authors: Christopher J. Crowley, Joshua L. Pughe-Sanford, Wesley Toler, Roman O. Grigoriev, Michael F. Schatz

Abstract: Recent work suggests unstable recurrent solutions of the equations governing fluid flow can play an important role in structuring the dynamics of turbulence. Here we present a method for detecting intervals of time where turbulence "shadows" (spatially and temporally mimics) recurrent solutions. We find that shadowing occurs frequently and repeatedly in both numerical and experimental observations… ▽ More Recent work suggests unstable recurrent solutions of the equations governing fluid flow can play an important role in structuring the dynamics of turbulence. Here we present a method for detecting intervals of time where turbulence "shadows" (spatially and temporally mimics) recurrent solutions. We find that shadowing occurs frequently and repeatedly in both numerical and experimental observations of counter-rotating Taylor-Couette flow, despite the relatively small number of known recurrent solutions in this system. Our results set the stage for experimentally-grounded dynamical descriptions of turbulence in a variety of wall-bounded shear flows, enabling applications to forecasting and control. △ Less

Submitted 24 August, 2022; v1 submitted 21 August, 2022; originally announced August 2022.

Coupled Layer Construction for Synthetic Hall Effects in Driven Systems

Authors: David M. Long, Philip J. D. Crowley, Anushya Chandran

Abstract: Quasiperiodically driven fermionic systems can support topological phases not realized in equilibrium. The fermions are localized in the bulk, but support quantized energy currents at the edge. These phases were discovered through an abstract classification, and few microscopic models exist. We develop a coupled layer construction for tight-binding models of these phases in $d\in\{1,2\}$ spatial d… ▽ More Quasiperiodically driven fermionic systems can support topological phases not realized in equilibrium. The fermions are localized in the bulk, but support quantized energy currents at the edge. These phases were discovered through an abstract classification, and few microscopic models exist. We develop a coupled layer construction for tight-binding models of these phases in $d\in\{1,2\}$ spatial dimensions, with any number of incommensurate drive frequencies $D$. The models exhibit quantized responses associated with synthetic two- and four-dimensional quantum Hall effects in the steady state. A numerical study of the phase diagram for $(d+D) = (1+2)$ shows: (i) robust topological and trivial phases separated by a sharp phase transition; (ii) charge diffusion and a half-integer energy current between the drives at the transition; and (iii) a long-lived topological energy current which remains present when weak interactions are introduced. △ Less

Submitted 17 October, 2022; v1 submitted 12 August, 2022; originally announced August 2022.

Comments: 15 pages, 11 figures; (v2) published version

Journal ref: Phys. Rev. B 106, 144203 (2022)

Phenomenology of the Prethermal Many-Body Localized Regime

Authors: David M. Long, Philip J. D. Crowley, Vedika Khemani, Anushya Chandran

Abstract: The dynamical phase diagram of interacting disordered systems has seen substantial revision over the past few years. Theory must now account for a large prethermal many-body localized (MBL) regime in which thermalization is extremely slow, but not completely arrested. We derive a quantitative description of these dynamics in short-ranged one-dimensional systems using a model of successive many-bod… ▽ More The dynamical phase diagram of interacting disordered systems has seen substantial revision over the past few years. Theory must now account for a large prethermal many-body localized (MBL) regime in which thermalization is extremely slow, but not completely arrested. We derive a quantitative description of these dynamics in short-ranged one-dimensional systems using a model of successive many-body resonances. The model explains the decay timescale of mean autocorrelators, the functional form of the decay - a stretched exponential - and relates the value of the stretch exponent to the broad distribution of resonance timescales. The Jacobi method of matrix diagonalization provides numerical access to this distribution, as well as a conceptual framework for our analysis. The resonance model correctly predicts the stretch exponents for several models in the literature. Successive resonances may also underlie slow thermalization in strongly disordered systems in higher dimensions, or with long-range interactions. △ Less

Submitted 1 August, 2023; v1 submitted 12 July, 2022; originally announced July 2022.

Comments: 7 pages, 3 figures + 9 pages, 9 figures; (v2) additional appendix on the absence of rare region effects, new numerical data for Heisenberg model autocorrelation functions and Floquet model decimated element distributions, other clarifications and corrections

Journal ref: Phys. Rev. Lett. 131, 106301 (2023)

Non-power-law universal scaling in incommensurate systems

Authors: Luke Yeo, Philip J. D. Crowley

Abstract: Previous studies of incommensurate systems concluded that critical scaling in such systems is sensitively dependent on the irrational, $α$, which determines the incommensuration. Contrary to this belief, in the canonical Harper-Hofstadter model, we show there is universal $α$-independent scaling for almost all $α$. This critical scaling is characterized by non-power law time-length scaling… ▽ More Previous studies of incommensurate systems concluded that critical scaling in such systems is sensitively dependent on the irrational, $α$, which determines the incommensuration. Contrary to this belief, in the canonical Harper-Hofstadter model, we show there is universal $α$-independent scaling for almost all $α$. This critical scaling is characterized by non-power law time-length scaling $t \sim r^{ζ\log \log r}$. We demonstrate this in the superfluid fraction of a Bose gas, and the heat capacity of a Fermi gas. We argue that this scaling is generic of a broad class of incommensurate models. △ Less

Submitted 6 June, 2022; originally announced June 2022.

Comments: 11 pages, 4 figures

Mean field theory of failed thermalizing avalanches

Authors: Philip J. D. Crowley, Anushya Chandran

Abstract: We show that localization in quasiperiodically modulated, two-dimensional systems is stable to the presence of a finite density of ergodic grains. This contrasts with the case of randomly modulated systems, where such grains seed thermalizing avalanches. These results are obtained within a quantitatively accurate, self-consistent entanglement mean field theory which analytically describes two leve… ▽ More We show that localization in quasiperiodically modulated, two-dimensional systems is stable to the presence of a finite density of ergodic grains. This contrasts with the case of randomly modulated systems, where such grains seed thermalizing avalanches. These results are obtained within a quantitatively accurate, self-consistent entanglement mean field theory which analytically describes two level systems connected to a central ergodic grain. The theory predicts the distribution of entanglement entropies of each two level system across eigenstates, and the late time values of dynamical observables. In addition to recovering the known phenomenology of avalanches, the theory reproduces exact diagonalization data, and predicts the spatial profile of the thermalized region when the avalanche fails. △ Less

Submitted 20 April, 2022; originally announced April 2022.

Comments: 13 pages, 5 figures

Transformer-Based Self-Supervised Learning for Emotion Recognition

Authors: Juan Vazquez-Rodriguez, Grégoire Lefebvre, Julien Cumin, James L. Crowley

Abstract: In order to exploit representations of time-series signals, such as physiological signals, it is essential that these representations capture relevant information from the whole signal. In this work, we propose to use a Transformer-based model to process electrocardiograms (ECG) for emotion recognition. Attention mechanisms of the Transformer can be used to build contextualized representations for… ▽ More In order to exploit representations of time-series signals, such as physiological signals, it is essential that these representations capture relevant information from the whole signal. In this work, we propose to use a Transformer-based model to process electrocardiograms (ECG) for emotion recognition. Attention mechanisms of the Transformer can be used to build contextualized representations for a signal, giving more importance to relevant parts. These representations may then be processed with a fully-connected network to predict emotions. To overcome the relatively small size of datasets with emotional labels, we employ self-supervised learning. We gathered several ECG datasets with no labels of emotion to pre-train our model, which we then fine-tuned for emotion recognition on the AMIGOS dataset. We show that our approach reaches state-of-the-art performances for emotion recognition using ECG signals on AMIGOS. More generally, our experiments show that transformers and pre-training are promising strategies for emotion recognition with physiological signals. △ Less

Submitted 3 June, 2022; v1 submitted 8 April, 2022; originally announced April 2022.

Journal ref: 26th International Conference on Pattern Recognition (ICPR 2022), Aug 2022, Montreal, Canada

Training Generative Adversarial Networks for Optical Property Map** using Synthetic Image Data

Authors: Ahmed Osman, Jane Crowley, George Gordon

Abstract: We demonstrate training of a Generative Adversarial Network (GAN) for prediction of optical property maps (scattering and absorption) using spatial frequency domain imaging (SFDI) image data sets generated synthetically with free open-source 3D modelling and rendering software, Blender. The flexibility of Blender is exploited to simulate 3 models with real-life relevance to clinical SFDI of diseas… ▽ More We demonstrate training of a Generative Adversarial Network (GAN) for prediction of optical property maps (scattering and absorption) using spatial frequency domain imaging (SFDI) image data sets generated synthetically with free open-source 3D modelling and rendering software, Blender. The flexibility of Blender is exploited to simulate 3 models with real-life relevance to clinical SFDI of diseased tissue: flat samples, flat samples with spheroidal tumours and cylindrical samples with spheroidal tumours representing imaging inside a tubular organ e.g. the gastro-intestinal tract. In all 3 scenarios we show the GAN provides accurate reconstruction of optical properties from single SFDI images with mean normalised error ranging from 1-1.2% for absorption and 0.7-1.2% for scattering, resulting in visually improved contrast for tumour spheroid structures. This compares favourably with 25% absorption error and 10% scattering error achieved using GANs on experimental SFDI data. However, some of this improvement is due to lower noise and availability of perfect ground truths so we therefore cross-validate our synthetically-trained GAN with a GAN trained on experimental data and observe visually accurate results with error of <40% for absorption and <25% for scattering, due largely to the presence of spatial frequency mismatch artefacts. Our synthetically trained GAN is therefore highly relevant to real experimental samples, but provides significant added benefits of large training datasets, perfect ground-truths and the ability to test realistic imaging geometries, e.g. inside cylinders, for which no conventional single-shot demodulation algorithms exist. In future we expect that application of techniques such as domain adaptation or training on hybrid real-synthetic datasets will create a powerful tool for fast, accurate production of optical property maps from real clinical imaging systems. △ Less

Submitted 3 October, 2022; v1 submitted 15 March, 2022; originally announced March 2022.

Comments: 17 pages

Journal ref: Biomedical Optics Express 2022

Supercurrent induced resonant optical response

Authors: Philip J. D. Crowley, Liang Fu

Abstract: The optical conductivity encodes the current response to a time dependent electric field. We develop a theory of the optical conductivity $σ(ω)$ in presence of a dc supercurrent. Current induced optical response is prohibited by Galilean invariance from occurring in systems with a single parabolic band. However, we show that lattice effects give rise to a pronounced current dependent peak in… ▽ More The optical conductivity encodes the current response to a time dependent electric field. We develop a theory of the optical conductivity $σ(ω)$ in presence of a dc supercurrent. Current induced optical response is prohibited by Galilean invariance from occurring in systems with a single parabolic band. However, we show that lattice effects give rise to a pronounced current dependent peak in $σ(ω)$ at the gap edge $ω= 2 Δ$, which diverges in the clean limit. We demonstrate this in a model of a multi-band superconductor. Our theory explains the recent observation of a current induced peak in the optical conductivity in NbN by Nakamura et al. (2019), and provides a new mechanism for direct activation of the Higgs mode with light. △ Less

Submitted 11 March, 2022; originally announced March 2022.

Comments: 12 pages, 5 figures

Prediction-Guided Distillation for Dense Object Detection

Authors: Chenhongyi Yang, Mateusz Ochal, Amos Storkey, Elliot J. Crowley

Abstract: Real-world object detection models should be cheap and accurate. Knowledge distillation (KD) can boost the accuracy of a small, cheap detection model by leveraging useful information from a larger teacher model. However, a key challenge is identifying the most informative features produced by the teacher for distillation. In this work, we show that only a very small fraction of features within a g… ▽ More Real-world object detection models should be cheap and accurate. Knowledge distillation (KD) can boost the accuracy of a small, cheap detection model by leveraging useful information from a larger teacher model. However, a key challenge is identifying the most informative features produced by the teacher for distillation. In this work, we show that only a very small fraction of features within a ground-truth bounding box are responsible for a teacher's high detection performance. Based on this, we propose Prediction-Guided Distillation (PGD), which focuses distillation on these key predictive regions of the teacher and yields considerable gains in performance over many existing KD baselines. In addition, we propose an adaptive weighting scheme over the key regions to smooth out their influence and achieve even better performance. Our proposed approach outperforms current state-of-the-art KD baselines on a variety of advanced one-stage detection architectures. Specifically, on the COCO dataset, our method achieves between +3.1% and +4.6% AP improvement using ResNet-101 and ResNet-50 as the teacher and student backbones, respectively. On the CrowdHuman dataset, we achieve +3.2% and +2.0% improvements in MR and AP, also using these backbones. Our code is available at https://github.com/ChenhongyiYang/PGD. △ Less

Submitted 18 July, 2022; v1 submitted 10 March, 2022; originally announced March 2022.

Comments: ECCV 2022

Composing Complex and Hybrid AI Solutions

Authors: Peter Schüller, João Paolo Costeira, James Crowley, Jasmin Grosinger, Félix Ingrand, Uwe Köckemann, Alessandro Saffiotti, Martin Welss

Abstract: Progress in several areas of computer science has been enabled by comfortable and efficient means of experimentation, clear interfaces, and interchangable components, for example using OpenCV for computer vision or ROS for robotics. We describe an extension of the Acumos system towards enabling the above features for general AI applications. Originally, Acumos was created for telecommunication pur… ▽ More Progress in several areas of computer science has been enabled by comfortable and efficient means of experimentation, clear interfaces, and interchangable components, for example using OpenCV for computer vision or ROS for robotics. We describe an extension of the Acumos system towards enabling the above features for general AI applications. Originally, Acumos was created for telecommunication purposes, mainly for creating linear pipelines of machine learning components. Our extensions include support for more generic components with gRPC/Protobuf interfaces, automatic orchestration of graphically assembled solutions including control loops, sub-component topologies, and event-based communication,and provisions for assembling solutions which contain user interfaces and shared storage areas. We provide examples of deployable solutions and their interfaces. The framework is deployed at http://aiexp.ai4europe.eu/ and its source code is managed as an open source Eclipse project. △ Less

Submitted 25 February, 2022; originally announced February 2022.

Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cut

Authors: Yangtao Wang, Xi Shen, Shell Hu, Yuan Yuan, James Crowley, Dominique Vaufreydaz

Abstract: Transformers trained with self-supervised learning using self-distillation loss (DINO) have been shown to produce attention maps that highlight salient foreground objects. In this paper, we demonstrate a graph-based approach that uses the self-supervised transformer features to discover an object from an image. Visual tokens are viewed as nodes in a weighted graph with edges representing a connect… ▽ More Transformers trained with self-supervised learning using self-distillation loss (DINO) have been shown to produce attention maps that highlight salient foreground objects. In this paper, we demonstrate a graph-based approach that uses the self-supervised transformer features to discover an object from an image. Visual tokens are viewed as nodes in a weighted graph with edges representing a connectivity score based on the similarity of tokens. Foreground objects can then be segmented using a normalized graph-cut to group self-similar regions. We solve the graph-cut problem using spectral clustering with generalized eigen-decomposition and show that the second smallest eigenvector provides a cutting solution since its absolute value indicates the likelihood that a token belongs to a foreground object. Despite its simplicity, this approach significantly boosts the performance of unsupervised object discovery: we improve over the recent state of the art LOST by a margin of 6.9%, 8.1%, and 8.1% respectively on the VOC07, VOC12, and COCO20K. The performance can be further improved by adding a second stage class-agnostic detector (CAD). Our proposed method can be easily extended to unsupervised saliency detection and weakly supervised object detection. For unsupervised saliency detection, we improve IoU for 4.9%, 5.2%, 12.9% on ECSSD, DUTS, DUT-OMRON respectively compared to previous state of the art. For weakly supervised object detection, we achieve competitive performance on CUB and ImageNet. △ Less

Submitted 24 March, 2022; v1 submitted 23 February, 2022; originally announced February 2022.

Journal ref: CVPR 2022 - Conference on Computer Vision and Pattern Recognition, Jun 2022, New Orleans, United States

Moiré Landau fans and magic zeros

Authors: Nisarga Paul, Philip J. D. Crowley, Trithep Devakul, Liang Fu

Abstract: We study the energy spectrum of moiré systems under a uniform magnetic field. The superlattice potential generally broadens Landau levels into Chern bands with finite bandwidth. However, we find that these Chern bands become flat at a discrete set of magnetic fields which we dub "magic zeros". The flat band subspace is generally different from the Landau level subspace in the absence of the moiré… ▽ More We study the energy spectrum of moiré systems under a uniform magnetic field. The superlattice potential generally broadens Landau levels into Chern bands with finite bandwidth. However, we find that these Chern bands become flat at a discrete set of magnetic fields which we dub "magic zeros". The flat band subspace is generally different from the Landau level subspace in the absence of the moiré superlattice. By develo** a semiclassical quantization method and taking account of superlattice induced Bragg reflection, we prove that magic zeros arise from the simultaneous quantization of two distinct $k$-space orbits. The flat bands at magic zeros provide a new setting for exploring crystalline fractional quantum Hall physics. △ Less

Submitted 30 August, 2022; v1 submitted 11 February, 2022; originally announced February 2022.

Comments: 5+4 pages; version to appear in PRL

Characteristic properties of Planacon MCP-PMTs

Authors: Yu. A. Melikyan, M. Slupecki, I. G. Bearden, J. R. Crowley, D. A. Finogeev, E. J. Garcia-Solis, A. E. Guard, A. V. Harton, V. A. Kaplin, T. L. Karavicheva, J. L. Klay, I. Morgan, I. V. Morozov, D. V. Serebryakov, R. Stempek, W. H. Trzaska, N. O. Vozniuk

Abstract: A systematic investigation of Planacon MCP-PMTs was performed using 64 XP85002/FIT-Q photosensors. These devices are equipped with microchannel plates of reduced resistance. Results of a study of their gain stability over time and saturation level in terms of the average anode current are presented. This information allows one to determine the lower limit of the MCP resistance for stable Planacon… ▽ More A systematic investigation of Planacon MCP-PMTs was performed using 64 XP85002/FIT-Q photosensors. These devices are equipped with microchannel plates of reduced resistance. Results of a study of their gain stability over time and saturation level in terms of the average anode current are presented. This information allows one to determine the lower limit of the MCP resistance for stable Planacon operation. The spread of the electron multiplication characteristics for the entire production batch is also presented, indicating the remarkably low voltage requirements of these MCP-PMTs. Detection efficiency and noise characteristics, such as dark count rate and afterpulsing level, are also reviewed. △ Less

Submitted 30 November, 2021; v1 submitted 29 November, 2021; originally announced November 2021.

Comments: To be published in JINST

Contrastive Object-level Pre-training with Spatial Noise Curriculum Learning

Authors: Chenhongyi Yang, Lichao Huang, Elliot J. Crowley

Abstract: The goal of contrastive learning based pre-training is to leverage large quantities of unlabeled data to produce a model that can be readily adapted downstream. Current approaches revolve around solving an image discrimination task: given an anchor image, an augmented counterpart of that image, and some other images, the model must produce representations such that the distance between the anchor… ▽ More The goal of contrastive learning based pre-training is to leverage large quantities of unlabeled data to produce a model that can be readily adapted downstream. Current approaches revolve around solving an image discrimination task: given an anchor image, an augmented counterpart of that image, and some other images, the model must produce representations such that the distance between the anchor and its counterpart is small, and the distances between the anchor and the other images are large. There are two significant problems with this approach: (i) by contrasting representations at the image-level, it is hard to generate detailed object-sensitive features that are beneficial to downstream object-level tasks such as instance segmentation; (ii) the augmentation strategy of producing an augmented counterpart is fixed, making learning less effective at the later stages of pre-training. In this work, we introduce Curricular Contrastive Object-level Pre-training (CCOP) to tackle these problems: (i) we use selective search to find rough object regions and use them to build an inter-image object-level contrastive loss and an intra-image object-level discrimination loss into our pre-training objective; (ii) we present a curriculum learning mechanism that adaptively augments the generated regions, which allows the model to consistently acquire a useful learning signal, even in the later stages of pre-training. Our experiments show that our approach improves on the MoCo v2 baseline by a large margin on multiple object-level tasks when pre-training on multi-object scene image datasets. Code is available at https://github.com/ChenhongyiYang/CCOP. △ Less

Submitted 29 November, 2021; v1 submitted 26 November, 2021; originally announced November 2021.

Boosting the Quantum State of a Cavity with Floquet Driving

Authors: David M. Long, Philip J. D. Crowley, Alicia J. Kollár, Anushya Chandran

Abstract: The striking nonlinear effects exhibited by cavity QED systems make them a powerful tool in modern condensed matter and atomic physics. A recently discovered example is the quantized pum** of energy into a cavity by a strongly-coupled, periodically-driven spin. We uncover a remarkable feature of these energy pumps: they coherently translate, or boost, a quantum state of the cavity in the Fock ba… ▽ More The striking nonlinear effects exhibited by cavity QED systems make them a powerful tool in modern condensed matter and atomic physics. A recently discovered example is the quantized pum** of energy into a cavity by a strongly-coupled, periodically-driven spin. We uncover a remarkable feature of these energy pumps: they coherently translate, or boost, a quantum state of the cavity in the Fock basis. Current optical cavity and circuit QED experiments can realize the required Hamiltonian in a rotating frame. Boosting thus enables the preparation of highly-excited non-classical cavity states in near-term experiments. △ Less

Submitted 5 March, 2022; v1 submitted 23 September, 2021; originally announced September 2021.

Comments: 6 pages, 4 figures + 6 pages, 6 figures; (v2) Clarifications on experimental considerations, including an additional appendix on the lab frame evolution

Journal ref: Phys. Rev. Lett. 128, 183602 (2022)

Many-Body Localization with Quasiperiodic Driving

Authors: David M. Long, Philip J. D. Crowley, Anushya Chandran

Abstract: Sufficient disorder is believed to localize static and periodically-driven interacting chains. With quasiperiodic driving by $D$ incommensurate tones, the fate of this many-body localization (MBL) is unknown. We argue that randomly disordered MBL exists for $D=2$, but not for $D\geq 3$. Specifically, a putative two-tone driven MBL chain is neither destabilized by thermal avalanches seeded by rare… ▽ More Sufficient disorder is believed to localize static and periodically-driven interacting chains. With quasiperiodic driving by $D$ incommensurate tones, the fate of this many-body localization (MBL) is unknown. We argue that randomly disordered MBL exists for $D=2$, but not for $D\geq 3$. Specifically, a putative two-tone driven MBL chain is neither destabilized by thermal avalanches seeded by rare thermal regions, nor by the proliferation of long-range many-body resonances. For $D\geq 3$, however, sufficiently large thermal regions have continuous local spectra and slowly thermalize the entire chain. En route, we generalize the eigenstate thermalization hypothesis to the quasiperiodically-driven setting, and verify its predictions numerically. Two-tone driving enables new topological orders with edge signatures; our results suggest that localization protects these orders indefinitely. △ Less

Submitted 19 April, 2022; v1 submitted 10 August, 2021; originally announced August 2021.

Comments: 15 pages, 4 figures + 6 pages, 4 figures; (v2) Clarifications on synthetic localization

Journal ref: Phys. Rev. B 105, 144204 (2022)

Partial thermalisation of a two-state system coupled to a finite quantum bath

Authors: Philip JD Crowley, Anushya Chandran

Abstract: The eigenstate thermalisation hypothesis (ETH) is a statistical characterisation of eigen-energies, eigenstates and matrix elements of local operators in thermalising quantum systems. We develop an ETH-like ansatz of a partially thermalising system composed of a spin-1/2 coupled to a finite quantum bath. The spin-bath coupling is sufficiently weak that ETH does not apply, but sufficiently strong t… ▽ More The eigenstate thermalisation hypothesis (ETH) is a statistical characterisation of eigen-energies, eigenstates and matrix elements of local operators in thermalising quantum systems. We develop an ETH-like ansatz of a partially thermalising system composed of a spin-1/2 coupled to a finite quantum bath. The spin-bath coupling is sufficiently weak that ETH does not apply, but sufficiently strong that perturbation theory fails. We calculate (i) the distribution of fidelity susceptibilities, which takes a broadly distributed form, (ii) the distribution of spin eigenstate entropies, which takes a bi-modal form, (iii) infinite time memory of spin observables, (iv) the distribution of matrix elements of local operators on the bath, which is non-Gaussian, and (v) the intermediate entropic enhancement of the bath, which interpolates smoothly between zero and the ETH value of $\log 2$. The enhancement is a consequence of rare many-body resonances, and is asymptotically larger than the typical eigenstate entanglement entropy. We verify these results numerically and discuss their connections to the many-body localisation transition. △ Less

Submitted 7 April, 2021; originally announced April 2021.

Comments: 31 pages, 12 figures

Journal ref: SciPost Phys. 12, 103 (2022)

Neural Architecture Search as Program Transformation Exploration

Authors: Jack Turner, Elliot J. Crowley, Michael O'Boyle

Abstract: Improving the performance of deep neural networks (DNNs) is important to both the compiler and neural architecture search (NAS) communities. Compilers apply program transformations in order to exploit hardware parallelism and memory hierarchy. However, legality concerns mean they fail to exploit the natural robustness of neural networks. In contrast, NAS techniques mutate networks by operations su… ▽ More Improving the performance of deep neural networks (DNNs) is important to both the compiler and neural architecture search (NAS) communities. Compilers apply program transformations in order to exploit hardware parallelism and memory hierarchy. However, legality concerns mean they fail to exploit the natural robustness of neural networks. In contrast, NAS techniques mutate networks by operations such as the grou** or bottlenecking of convolutions, exploiting the resilience of DNNs. In this work, we express such neural architecture operations as program transformations whose legality depends on a notion of representational capacity. This allows them to be combined with existing transformations into a unified optimization framework. This unification allows us to express existing NAS operations as combinations of simpler transformations. Crucially, it allows us to generate and explore new tensor convolutions. We prototyped the combined framework in TVM and were able to find optimizations across different DNNs, that significantly reduce inference time - over 3$\times$ in the majority of cases. Furthermore, our scheme dramatically reduces NAS search time. Code is available at~\href{https://github.com/jack-willturner/nas-as-program-transformation-exploration}{this https url}. △ Less

Submitted 12 February, 2021; originally announced February 2021.

Dissipative failure of adiabatic quantum transport as a dynamical phase transition

Authors: Fergus Barratt, Aleix Bou Comas, Philip J. D. Crowley, Vadim Oganesyan, Peter Sollich, Andrew G. Green

Abstract: Entanglement is the central resource in adiabatic quantum transport. Dephasing affects the availability of that resource by biasing trajectories, driving transitions between success and failure. This depletion of entanglement is important for the practical implementation of quantum technologies. We present a new perspective on the failure of adiabatic computation by understanding the failure of ad… ▽ More Entanglement is the central resource in adiabatic quantum transport. Dephasing affects the availability of that resource by biasing trajectories, driving transitions between success and failure. This depletion of entanglement is important for the practical implementation of quantum technologies. We present a new perspective on the failure of adiabatic computation by understanding the failure of adiabatic transport as a dynamical phase transition. These ideas are demonstrated in a toy model of adiabatic quantum transport in a two spin system. △ Less

Submitted 30 December, 2020; originally announced December 2020.

Journal ref: Phys. Rev. A 103, 052427 (2021)

A constructive theory of the numerically accessible many-body localized to thermal crossover

Authors: Philip J. D. Crowley, Anushya Chandran

Abstract: The many-body localised (MBL) to thermal crossover observed in exact diagonalisation studies remains poorly understood as the accessible system sizes are too small to be in an asymptotic scaling regime. We develop a model of the crossover in short 1D chains in which the MBL phase is destabilised by the formation of many-body resonances. The model reproduces several properties of the numerically ob… ▽ More The many-body localised (MBL) to thermal crossover observed in exact diagonalisation studies remains poorly understood as the accessible system sizes are too small to be in an asymptotic scaling regime. We develop a model of the crossover in short 1D chains in which the MBL phase is destabilised by the formation of many-body resonances. The model reproduces several properties of the numerically observed crossover, including an apparent correlation length exponent $ν=1$, exponential growth of the Thouless time with disorder strength, linear drift of the critical disorder strength with system size, scale-free resonances, apparent $1/ω$ dependence of disorder-averaged spectral functions, and sub-thermal entanglement entropy of small subsystems. In the crossover, resonances induced by a local perturbation are rare at numerically accessible system sizes $L$ which are smaller than a \emph{resonance length} $λ$. For $L \gg \sqrtλ$, resonances typically overlap, and this model does not describe the asymptotic transition. The model further reproduces controversial numerical observations which Refs. [Šuntajs et al, 2019] and [Sels & Polkovnikov, 2020] claimed to be inconsistent with MBL. We thus argue that the numerics to date is consistent with a MBL phase in the thermodynamic limit. △ Less

Submitted 7 February, 2021; v1 submitted 28 December, 2020; originally announced December 2020.

Comments: 27 pages, 12 figures

Journal ref: SciPost Phys. 12, 201 (2022)

Nonadiabatic Topological Energy Pumps with Quasiperiodic Driving

Authors: David M. Long, Philip J. D. Crowley, Anushya Chandran

Abstract: We derive a topological classification of the steady states of $d$-dimensional lattice models driven by $D$ incommensurate tones. Map** to a unifying $(d+D)$-dimensional localized model in frequency space reveals anomalous localized topological phases (ALTPs) with no static analog. While the formal classification is determined by $d+D$, the observable signatures of each ALTP depend on the spatia… ▽ More We derive a topological classification of the steady states of $d$-dimensional lattice models driven by $D$ incommensurate tones. Map** to a unifying $(d+D)$-dimensional localized model in frequency space reveals anomalous localized topological phases (ALTPs) with no static analog. While the formal classification is determined by $d+D$, the observable signatures of each ALTP depend on the spatial dimension $d$. For each $d$, with $d+D=3$, we identify a quantized circulating current, and corresponding topological edge states. The edge states for a driven wire ($d=1$) function as a quantized, nonadiabatic energy pump between the drives. We design concrete models of quasiperiodically driven qubits and wires that achieve ALTPs of several topological classes. Our results provide a route to experimentally access higher dimensional ALTPs in driven low-dimensional systems. △ Less

Submitted 16 March, 2021; v1 submitted 5 October, 2020; originally announced October 2020.

Comments: 6 pages, 3 figures + 13 pages, 5 figures

Journal ref: Phys. Rev. Lett. 126, 106805 (2021)

Optimizing Grouped Convolutions on Edge Devices

Authors: Perry Gibson, José Cano, Jack Turner, Elliot J. Crowley, Michael O'Boyle, Amos Storkey

Abstract: When deploying a deep neural network on constrained hardware, it is possible to replace the network's standard convolutions with grouped convolutions. This allows for substantial memory savings with minimal loss of accuracy. However, current implementations of grouped convolutions in modern deep learning frameworks are far from performing optimally in terms of speed. In this paper we propose Group… ▽ More When deploying a deep neural network on constrained hardware, it is possible to replace the network's standard convolutions with grouped convolutions. This allows for substantial memory savings with minimal loss of accuracy. However, current implementations of grouped convolutions in modern deep learning frameworks are far from performing optimally in terms of speed. In this paper we propose Grouped Spatial Pack Convolutions (GSPC), a new implementation of grouped convolutions that outperforms existing solutions. We implement GSPC in TVM, which provides state-of-the-art performance on edge devices. We analyze a set of networks utilizing different types of grouped convolutions and evaluate their performance in terms of inference time on several edge devices. We observe that our new implementation scales well with the number of groups and provides the best inference times in all settings, improving the existing implementations of grouped convolutions in TVM, PyTorch and TensorFlow Lite by 3.4x, 8x and 4x on average respectively. Code is available at https://github.com/gecLAB/tvm-GSPC/ △ Less

Submitted 17 June, 2020; originally announced June 2020.

Comments: Camera ready version to be published at ASAP 2020 - The 31st IEEE International Conference on Application-specific Systems, Architectures and Processors. 8 pages, 6 figures

ACM Class: I.2.6; D.3.4; C.1.4

Error measurements for a quantum annealer using the one-dimensional Ising model with twisted boundaries

Authors: Nicholas Chancellor, Philip J. D. Crowley, Tanja Đurić, Walter Vinci, Mohammad H. Amin, Andrew G. Green, Paul A. Warburton, Gabriel Aeppli

Abstract: A finite length ferromagnetic chain with opposite spin polarisation imposed at its two ends is one of the simplest frustrated spin models. In the clean classical limit the domain wall inserted on account of the boundary conditions resides with equal probability on any one of the bonds, and the degeneracy is precisely equal to the number of bonds. If quantum mechanics is introduced via a transverse… ▽ More A finite length ferromagnetic chain with opposite spin polarisation imposed at its two ends is one of the simplest frustrated spin models. In the clean classical limit the domain wall inserted on account of the boundary conditions resides with equal probability on any one of the bonds, and the degeneracy is precisely equal to the number of bonds. If quantum mechanics is introduced via a transverse field, the domain wall will behave as a particle in a box, and prefer to be nearer the middle of the chain rather than the ends. A simple characteristic of a real quantum annealer is therefore which of these limits obtains in practice. Here we have used the ferromagnetic chain with antiparallel boundary spins to test a real flux qubit quantum annealer and discover that contrary to both expectations, the domain walls found are non-uniformly distributed on account of effective random longitudinal fields present notwithstanding tuning carried out to zero out such fields when the couplings between qubits are nominally zero. We present a simple derivation of the form of the distribution function for the domain walls, and show also how the effect we have discovered can be used to determine the strength of the effective random fields (noise) characterising the annealer. The noise measured in this fashion is smaller than what is seen during the single qubit tuning process, but nonetheless qualitatively affects the outcome of the simulation performed by the annealer. △ Less

Submitted 11 April, 2022; v1 submitted 13 June, 2020; originally announced June 2020.

Comments: 14 pages, 9 figures plus supplemental material, title change in v2 and v3, accepted in npj Quantum Information, arXiv matches accepted version

Journal ref: npj Quantum Information volume 8, Article number: 73 (2022)

Neural Architecture Search without Training

Authors: Joseph Mellor, Jack Turner, Amos Storkey, Elliot J. Crowley

Abstract: The time and effort involved in hand-designing deep neural networks is immense. This has prompted the development of Neural Architecture Search (NAS) techniques to automate this design. However, NAS algorithms tend to be slow and expensive; they need to train vast numbers of candidate networks to inform the search process. This could be alleviated if we could partially predict a network's trained… ▽ More The time and effort involved in hand-designing deep neural networks is immense. This has prompted the development of Neural Architecture Search (NAS) techniques to automate this design. However, NAS algorithms tend to be slow and expensive; they need to train vast numbers of candidate networks to inform the search process. This could be alleviated if we could partially predict a network's trained accuracy from its initial state. In this work, we examine the overlap of activations between datapoints in untrained networks and motivate how this can give a measure which is usefully indicative of a network's trained performance. We incorporate this measure into a simple algorithm that allows us to search for powerful networks without any training in a matter of seconds on a single GPU, and verify its effectiveness on NAS-Bench-101, NAS-Bench-201, NATS-Bench, and Network Design Spaces. Our approach can be readily combined with more expensive search methods; we examine a simple adaptation of regularised evolutionary search. Code for reproducing our experiments is available at https://github.com/BayesWatch/nas-without-training. △ Less

Submitted 11 June, 2021; v1 submitted 8 June, 2020; originally announced June 2020.

Comments: Accepted at ICML 2021 for a long presentation

Exploring 2D synthetic quantum Hall physics with a quasi-periodically driven qubit

Authors: Eric Boyers, Philip J. D. Crowley, Anushya Chandran, Alexander O. Sushkov

Abstract: Quasi-periodically driven quantum systems are predicted to exhibit quantized topological properties, in analogy with the quantized transport properties of topological insulators. We use a single nitrogen-vacancy center in diamond to experimentally study a synthetic quantum Hall effect with a two-tone drive. We measure the evolution of trajectories of two quantum states, initially prepared at nearb… ▽ More Quasi-periodically driven quantum systems are predicted to exhibit quantized topological properties, in analogy with the quantized transport properties of topological insulators. We use a single nitrogen-vacancy center in diamond to experimentally study a synthetic quantum Hall effect with a two-tone drive. We measure the evolution of trajectories of two quantum states, initially prepared at nearby points in synthetic phase space. We detect the synthetic Hall effect through the predicted overlap oscillations at a quantized fundamental frequency proportional to the Chern number, which characterizes the topological phases of the system. We further observe half-quantization of the Chern number at the transition between the synthetic Hall regime and the trivial regime, and the associated concentration of local Berry curvature in synthetic phase space. Our work opens up the possibility of using driven qubits to design and study higher-dimensional topological insulators and semi-metals in synthetic dimensions. △ Less

Submitted 7 April, 2020; originally announced April 2020.

Journal ref: Phys. Rev. Lett. 125, 160505 (2020)

Performance Aware Convolutional Neural Network Channel Pruning for Embedded GPUs

Authors: Valentin Radu, Kuba Kaszyk, Yuan Wen, Jack Turner, Jose Cano, Elliot J. Crowley, Bjorn Franke, Amos Storkey, Michael O'Boyle

Abstract: Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models designed for server space, although several model compression techniques have been considered. One model compression technique intended to reduce computations is… ▽ More Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models designed for server space, although several model compression techniques have been considered. One model compression technique intended to reduce computations is channel pruning. Mobile and embedded systems now have GPUs which are ideal for the parallel computations of neural networks and for their lower energy cost per operation. Specialized libraries perform these neural network computations through highly optimized routines. As we find in our experiments, these libraries are optimized for the most common network shapes, making uninstructed channel pruning inefficient. We evaluate higher level libraries, which analyze the input characteristics of a convolutional layer, based on which they produce optimized OpenCL (Arm Compute Library and TVM) and CUDA (cuDNN) code. However, in reality, these characteristics and subsequent choices intended for optimization can have the opposite effect. We show that a reduction in the number of convolutional channels, pruning 12% of the initial size, is in some cases detrimental to performance, leading to 2x slowdown. On the other hand, we also find examples where performance-aware pruning achieves the intended results, with performance speedups of 3x with cuDNN and above 10x with Arm Compute Library and TVM. Our findings expose the need for hardware-instructed neural network pruning. △ Less

Submitted 20 February, 2020; originally announced February 2020.

Comments: A copy of this was published in IISWC'19

Avalanche induced co-existing localised and thermal regions in disordered chains

Authors: Philip J. D. Crowley, Anushya Chandran

Abstract: We investigate the stability of an Anderson localized chain to the inclusion of a single finite interacting thermal seed. This system models the effects of rare low-disorder regions on many-body localized chains. Above a threshold value of the mean localization length, the seed causes runaway thermalization in which a finite fraction of the orbitals are absorbed into a thermal bubble. This `partia… ▽ More We investigate the stability of an Anderson localized chain to the inclusion of a single finite interacting thermal seed. This system models the effects of rare low-disorder regions on many-body localized chains. Above a threshold value of the mean localization length, the seed causes runaway thermalization in which a finite fraction of the orbitals are absorbed into a thermal bubble. This `partially avalanched' regime provides a simple example of a delocalized, non-ergodic dynamical phase. We derive the hierarchy of length scales necessary for typical samples to exhibit the avalanche instability, and show that the required seed size diverges at the avalanche threshold. We introduce a new dimensionless statistic that measures the effective size of the thermal bubble, and use it to numerically confirm the predictions of avalanche theory in the Anderson chain at infinite temperature. △ Less

Submitted 7 February, 2021; v1 submitted 23 October, 2019; originally announced October 2019.

Comments: 26 pages, 18 figures

Journal ref: Phys. Rev. Research 2, 033262 (2020)

Bayesian Meta-Learning for the Few-Shot Setting via Deep Kernels

Authors: Massimiliano Patacchiola, Jack Turner, Elliot J. Crowley, Michael O'Boyle, Amos Storkey

Abstract: Recently, different machine learning methods have been introduced to tackle the challenging few-shot learning scenario that is, learning from a small labeled dataset related to a specific task. Common approaches have taken the form of meta-learning: learning to learn on the new problem given the old. Following the recognition that meta-learning is implementing learning in a multi-level model, we p… ▽ More Recently, different machine learning methods have been introduced to tackle the challenging few-shot learning scenario that is, learning from a small labeled dataset related to a specific task. Common approaches have taken the form of meta-learning: learning to learn on the new problem given the old. Following the recognition that meta-learning is implementing learning in a multi-level model, we present a Bayesian treatment for the meta-learning inner loop through the use of deep kernels. As a result we can learn a kernel that transfers to new tasks; we call this Deep Kernel Transfer (DKT). This approach has many advantages: is straightforward to implement as a single optimizer, provides uncertainty quantification, and does not require estimation of task-specific parameters. We empirically demonstrate that DKT outperforms several state-of-the-art algorithms in few-shot classification, and is the state of the art for cross-domain adaptation and regression. We conclude that complex meta-learning routines can be replaced by a simpler Bayesian model without loss of accuracy. △ Less

Submitted 13 October, 2020; v1 submitted 11 October, 2019; originally announced October 2019.

Comments: Advances in Neural Information Processing Systems (NeurIPS 2020, Spotlight)