Showing 1–50 of 76 results for author: Sinclair, M

Thermal Weibel instability induced magnetic fields co-exist with linear wakes in laser-ionized plasmas

Authors: Yipeng Wu, Audrey Farrell, Mitchell Sinclair, Chaojie Zhang, Irina Petrushina, Navid Vafaei-Najafabadi, Marcus Babzien, William Li, Igor Pogorelsky, Mikhail Polyanskiy, Mikhail Fedurin, Karl Kusche, Mark Palmer, Ken Marsh, Chan Joshi

Abstract: When a moderately intense, few-picoseconds long laser pulse ionizes gas to produce an underdense plasma column, a linear relativistic plasma wave or wake can be excited by the self-modulation instability that may prove useful for multi-bunch acceleration of externally injected electrons or positrons to high energies in a short distance. At the same time, due to the anisotropic temperature distribu… ▽ More When a moderately intense, few-picoseconds long laser pulse ionizes gas to produce an underdense plasma column, a linear relativistic plasma wave or wake can be excited by the self-modulation instability that may prove useful for multi-bunch acceleration of externally injected electrons or positrons to high energies in a short distance. At the same time, due to the anisotropic temperature distributions of the ionized plasma electrons, the Weibel instability can self-generate magnetic fields throughout such a plasma on a few picosecond timescale. In the present paper we first show using simulations that both these effects do indeed co-exist in space and time in the plasma. Using our simulations, we make preliminary estimates of the transverse emittance growth of an externally injected beam due to the Weibel magnetic fields. We then present results of an experiment that has allowed us to measure the spatiotemporal evolution of the magnetic fields using an ultrashort relativistic electron probe beam. Both the topology and the lifetime of the Weibel instability induced magnetic fields are in reasonable agreement with the simulations. △ Less

Submitted 20 February, 2024; originally announced February 2024.

T3: Transparent Tracking & Triggering for Fine-grained Overlap of Compute & Collectives

Authors: Suchita Pati, Shaizeen Aga, Mahzabeen Islam, Nuwan Jayasena, Matthew D. Sinclair

Abstract: Large Language Models increasingly rely on distributed techniques for their training and inference. These techniques require communication across devices which can reduce scaling efficiency as the number of devices increases. While some distributed techniques can overlap, and thus, hide this communication with independent computations, techniques such as Tensor Parallelism (TP) inherently serializ… ▽ More Large Language Models increasingly rely on distributed techniques for their training and inference. These techniques require communication across devices which can reduce scaling efficiency as the number of devices increases. While some distributed techniques can overlap, and thus, hide this communication with independent computations, techniques such as Tensor Parallelism (TP) inherently serialize communication with model execution. One approach to hide this serialized communication is to interleave it with the producer operation (of the communicated data) in a fine-grained manner. However, this fine-grained interleaving of communication and computation in software can be difficult. Furthermore, as with any concurrent execution, it requires compute and memory resources to be shared between computation and communication, causing resource contention that reduces overlap** efficacy. To overcome these challenges, we propose T3 which applies hardware-software co-design to transparently overlap serialized communication while minimizing resource contention with compute. T3 transparently fuses producer operations with the subsequent communication via a simple configuration of the producer's output address space and requires minor software changes. At the hardware level, T3 adds a lightweight track and trigger mechanism to orchestrate the producer's compute, and communication. It further uses compute-enhanced memories for communication's attendant compute. As a result, T3 reduces resource contention, and efficiently overlaps serialized communication with computation. For important Transformer models like T-NLG, T3 speeds up communication-heavy sublayers by 30% geomean (max 47%) and reduces data movement by 22% geomean (max 36%). Furthermore, T3's benefits persist as models scale: geomean 29% for sublayers in $\sim$500-billion parameter models, PALM and MT-NLG. △ Less

Submitted 29 January, 2024; originally announced January 2024.

Comments: To appear at the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) 2024

ACM Class: C.2.4; C.1.2

Efficient generation and amplification of intense vortex and vector laser pulses via strongly coupled stimulated Brillouin scattering in plasmas

Authors: Yipeng Wu, Chaojie Zhang, Zan Nie, Mitchell Sinclair, Audrey Farrell, Kenneth A Marsh, E. Paulo Alves, Frank Tsung, Warren B. Mori, Chan Joshi

Abstract: The past decade has seen tremendous progress in the production and utilization of vortex and vector laser pulses. Although both are considered as structured light beams, the vortex lasers have helical phase fronts and phase singularities, while the vector lasers have spatially variable polarization states and polarization singularities. In contrast to the vortex pulses that carry orbital angular m… ▽ More The past decade has seen tremendous progress in the production and utilization of vortex and vector laser pulses. Although both are considered as structured light beams, the vortex lasers have helical phase fronts and phase singularities, while the vector lasers have spatially variable polarization states and polarization singularities. In contrast to the vortex pulses that carry orbital angular momentum (OAM), the vector laser pulses have a complex spin angular momentum (SAM) and OAM coupling. Despite many potential applications enabled by such pulses, the generation of high-power/-intensity vortex and vector beams remains challenging. Here, we demonstrate using theory and three-dimensional simulations that the strongly-coupled stimulated Brillouin scattering (SC-SBS) process in plasmas can be used as a promising amplification technique with up to 65% energy transfer efficiency from the pump beam to the seed beam for both vortex and vector pulses. We also show that SC-SBS is strongly polarization-dependent in plasmas, enabling an all-optical polarization control of the amplified seed beam. Additionally, the interaction of such structured lasers with plasmas leads to various angular momentum couplings and decouplings that produce intense new light structures with controllable OAM and SAM. This scheme paves the way for novel optical devices such as plasma-based amplifiers and light field manipulators. △ Less

Submitted 23 November, 2023; originally announced November 2023.

Pay Attention to the Atlas: Atlas-Guided Test-Time Adaptation Method for Robust 3D Medical Image Segmentation

Authors: **gjie Guo, Weitong Zhang, Matthew Sinclair, Daniel Rueckert, Chen Chen

Abstract: Convolutional neural networks (CNNs) often suffer from poor performance when tested on target data that differs from the training (source) data distribution, particularly in medical imaging applications where variations in imaging protocols across different clinical sites and scanners lead to different imaging appearances. However, re-accessing source training data for unsupervised domain adaptati… ▽ More Convolutional neural networks (CNNs) often suffer from poor performance when tested on target data that differs from the training (source) data distribution, particularly in medical imaging applications where variations in imaging protocols across different clinical sites and scanners lead to different imaging appearances. However, re-accessing source training data for unsupervised domain adaptation or labeling additional test data for model fine-tuning can be difficult due to privacy issues and high labeling costs, respectively. To solve this problem, we propose a novel atlas-guided test-time adaptation (TTA) method for robust 3D medical image segmentation, called AdaAtlas. AdaAtlas only takes one single unlabeled test sample as input and adapts the segmentation network by minimizing an atlas-based loss. Specifically, the network is adapted so that its prediction after registration is aligned with the learned atlas in the atlas space, which helps to reduce anatomical segmentation errors at test time. In addition, different from most existing TTA methods which restrict the adaptation to batch normalization blocks in the segmentation network only, we further exploit the use of channel and spatial attention blocks for improved adaptability at test time. Extensive experiments on multiple datasets from different sites show that AdaAtlas with attention blocks adapted (AdaAtlas-Attention) achieves superior performance improvements, greatly outperforming other competitive TTA methods. △ Less

Submitted 27 February, 2024; v1 submitted 2 July, 2023; originally announced July 2023.

Comments: Accepted by MICCAI BTSD-1001AI workshop. (Oral presentation).https://btsdmiccai.github.io/

Fifty Years of ISCA: A data-driven retrospective on key trends

Authors: Gaurang Upasani, Matthew D. Sinclair, Adrian Sampson, Parthasarathy Ranganathan, David Patterson, Shaan Shah, Nidhi Parthasarathy, Rutwik Jain

Abstract: Computer Architecture, broadly, involves optimizing hardware and software for current and future processing systems. Although there are several other top venues to publish Computer Architecture research, including ASPLOS, HPCA, and MICRO, ISCA (the International Symposium on Computer Architecture) is one of the oldest, longest running, and most prestigious venues for publishing Computer Architectu… ▽ More Computer Architecture, broadly, involves optimizing hardware and software for current and future processing systems. Although there are several other top venues to publish Computer Architecture research, including ASPLOS, HPCA, and MICRO, ISCA (the International Symposium on Computer Architecture) is one of the oldest, longest running, and most prestigious venues for publishing Computer Architecture research. Since 1973, except for 1975, ISCA has been organized annually. Accordingly, this year will be the 50th year of ISCA. Thus, we set out to analyze the past 50 years of ISCA to understand who and what has been driving and innovating computing systems thus far. Our analysis identifies several interesting trends that reflect how ISCA, and Computer Architecture in general, has grown and evolved in the past 50 years, including minicomputers, general-purpose uniprocessor CPUs, multiprocessor and multi-core CPUs, general-purpose GPUs, and accelerators. △ Less

Submitted 18 November, 2023; v1 submitted 6 June, 2023; originally announced June 2023.

Comments: 34 pages, 16 figures

Integrating Per-Stream Stat Tracking into Accel-Sim

Authors: Shichen Qiao, Xin Su, Matthew D. Sinclair

Abstract: Accel-Sim is a widely used computer architecture simulator that models the behavior of modern NVIDIA GPUs in great detail. However, although Accel-Sim and the underlying GPGPU-Sim model many of the features of real GPUs, thus far it has not been able to track statistics separately per stream. Instead, Accel-Sim combines statistics (e.g., cycles and cache hits/misses) across all simultaneously runn… ▽ More Accel-Sim is a widely used computer architecture simulator that models the behavior of modern NVIDIA GPUs in great detail. However, although Accel-Sim and the underlying GPGPU-Sim model many of the features of real GPUs, thus far it has not been able to track statistics separately per stream. Instead, Accel-Sim combines statistics (e.g., cycles and cache hits/misses) across all simultaneously running streams. This can prevent users from properly identifying the behavior of specific kernels and streams and potentially lead to incorrect conclusions. Thus, in this work we extend Accel-Sim's and GPGPU-Sim's statistic tracking support to track per-stream statistics. To validate this support, we designed a series of multi-stream microbenchmarks and checked their reported per-kernel, per-stream counts. △ Less

Submitted 4 September, 2023; v1 submitted 21 April, 2023; originally announced April 2023.

Comments: 13 pages

Near-field Imaging of Optical Resonances in Silicon Metasurfaces Using Photoelectron Microscopy

Authors: Alex Boehm, Sylvain D. Gennaro, Chloe F. Doiron, Thomas E. Beechem, Michael B. Sinclair, Igal Brener, Raktim Sarma, Taisuke Ohta

Abstract: Precise control of light-matter interactions at the nanoscale lies at the heart of nanophotonics. Experimental examination at this length scale is challenging, however, since the corresponding electromagnetic near-field is often confined within volumes below the resolution of conventional optical microscopy. In semiconductor nanophotonics electromagnetic fields are further restricted within the co… ▽ More Precise control of light-matter interactions at the nanoscale lies at the heart of nanophotonics. Experimental examination at this length scale is challenging, however, since the corresponding electromagnetic near-field is often confined within volumes below the resolution of conventional optical microscopy. In semiconductor nanophotonics electromagnetic fields are further restricted within the confines of individual subwavelength resonators, limiting access to critical light-matter interactions in these structures. In this work, we demonstrate that photoelectron emission microscopy (PEEM) can be used for polarization resolved near-field spectroscopy and imaging of electromagnetic resonances supported by broken-symmetry silicon metasurfaces. We find that the photoemission results, enabled through an in-situ potassium surface layer, are consistent with full-wave simulations and far-field reflectance measurements across visible and near-infrared wavelengths. In addition, we uncover a polarization dependent evolution of collective resonances near the metasurface array edge taking advantage of the far-field excitation and full-field imaging of PEEM. Here, we deduce that coupling between eight resonators or more establishes the collective excitations of this metasurface. All told, we demonstrate that the high-spatial resolution hyperspectral imaging and far-field illumination of PEEM can be leveraged for the metrology of collective, non-local, optical resonances in semiconductor nanophotonic structures. △ Less

Submitted 12 June, 2024; v1 submitted 24 February, 2023; originally announced February 2023.

Comments: 17 pages, 5 Figures, Supporting Information: 14 pages, 10 figures

Journal ref: APL Photonics, 2024, 9(6), 066103

Computation vs. Communication Scaling for Future Transformers on Future Hardware

Authors: Suchita Pati, Shaizeen Aga, Mahzabeen Islam, Nuwan Jayasena, Matthew D. Sinclair

Abstract: Scaling neural network models has delivered dramatic quality gains across ML problems. However, this scaling has increased the reliance on efficient distributed training techniques. Accordingly, as with other distributed computing scenarios, it is important to understand how will compute and communication scale relative to one another as models scale and hardware evolves? A careful study which ans… ▽ More Scaling neural network models has delivered dramatic quality gains across ML problems. However, this scaling has increased the reliance on efficient distributed training techniques. Accordingly, as with other distributed computing scenarios, it is important to understand how will compute and communication scale relative to one another as models scale and hardware evolves? A careful study which answers this question can better guide the design of future systems which can efficiently train future large models. Accordingly, this work provides a comprehensive multi-axial (algorithmic, empirical, hardware evolution) analysis of compute vs. communication (Comp-vs.-Comm) scaling for future Transformer models on future hardware. First, our algorithmic analysis shows that compute generally enjoys an edge over communication as models scale. However, since memory capacity scales slower than compute, these trends are being stressed. Next, we quantify this edge by empirically studying how Comp-vs.-Comm scales for future models on future hardware. To avoid profiling numerous Transformer models across many setups, we extract execution regions and project costs using operator models. This allows a spectrum (hundreds) of future model/hardware scenarios to be accurately studied ($<$15% error), and reduces profiling costs by 2100$\times$. Our experiments show that communication will be a significant portion (40-75%) of runtime as models and hardware evolve. Moreover, communication which is hidden by overlapped computation in today's models often cannot be hidden in future, larger models. Overall, this work highlights the increasingly large role communication will play as models scale and discusses techniques and upcoming technologies that can help address it. △ Less

Submitted 2 May, 2023; v1 submitted 6 February, 2023; originally announced February 2023.

ACM Class: C.4; C.2.4

Exploring Levels of Control for a Navigation Assistant for Blind Travelers

Authors: Vinitha Ranganeni, Mike Sinclair, Eyal Ofek, Amos Miller, Jonathan Campbell, Andrey Kolobov, Edward Cutrell

Abstract: Only a small percentage of blind and low-vision people use traditional mobility aids such as a cane or a guide dog. Various assistive technologies have been proposed to address the limitations of traditional mobility aids. These devices often give either the user or the device majority of the control. In this work, we explore how varying levels of control affect the users' sense of agency, trust i… ▽ More Only a small percentage of blind and low-vision people use traditional mobility aids such as a cane or a guide dog. Various assistive technologies have been proposed to address the limitations of traditional mobility aids. These devices often give either the user or the device majority of the control. In this work, we explore how varying levels of control affect the users' sense of agency, trust in the device, confidence, and successful navigation. We present Glide, a novel mobility aid with two modes for control: Glide-directed and User-directed. We employ Glide in a study (N=9) in which blind or low-vision participants used both modes to navigate through an indoor environment. Overall, participants found that Glide was easy to use and learn. Most participants trusted Glide despite its current limitations, and their confidence and performance increased as they continued to use Glide. Users' control mode preference varied in different situations; no single mode "won" in all situations. △ Less

Submitted 5 January, 2023; originally announced January 2023.

Comments: 9 pages, 6 figures, Human-Robot Interaction 2023

Image To Tree with Recursive Prompting

Authors: James Batten, Matthew Sinclair, Ben Glocker, Michiel Schaap

Abstract: Extracting complex structures from grid-based data is a common key step in automated medical image analysis. The conventional solution to recovering tree-structured geometries typically involves computing the minimal cost path through intermediate representations derived from segmentation masks. However, this methodology has significant limitations in the context of projective imaging of tree-stru… ▽ More Extracting complex structures from grid-based data is a common key step in automated medical image analysis. The conventional solution to recovering tree-structured geometries typically involves computing the minimal cost path through intermediate representations derived from segmentation masks. However, this methodology has significant limitations in the context of projective imaging of tree-structured 3D anatomical data such as coronary arteries, since there are often overlap** branches in the 2D projection. In this work, we propose a novel approach to predicting tree connectivity structure which reformulates the task as an optimization problem over individual steps of a recursive process. We design and train a two-stage model which leverages the UNet and Transformer architectures and introduces an image-based prompting technique. Our proposed method achieves compelling results on a pair of synthetic datasets, and outperforms a shortest-path baseline. △ Less

Submitted 1 January, 2023; originally announced January 2023.

Comments: 12 pages, 5 figures

Not All GPUs Are Created Equal: Characterizing Variability in Large-Scale, Accelerator-Rich Systems

Authors: Prasoon Sinha, Akhil Guliani, Rutwik Jain, Brandon Tran, Matthew D. Sinclair, Shivaram Venkataraman

Abstract: Scientists are increasingly exploring and utilizing the massive parallelism of general-purpose accelerators such as GPUs for scientific breakthroughs. As a result, datacenters, hyperscalers, national computing centers, and supercomputers have procured hardware to support this evolving application paradigm. These systems contain hundreds to tens of thousands of accelerators, enabling peta- and exa-… ▽ More Scientists are increasingly exploring and utilizing the massive parallelism of general-purpose accelerators such as GPUs for scientific breakthroughs. As a result, datacenters, hyperscalers, national computing centers, and supercomputers have procured hardware to support this evolving application paradigm. These systems contain hundreds to tens of thousands of accelerators, enabling peta- and exa-scale levels of compute for scientific workloads. Recent work demonstrated that power management (PM) can impact application performance in CPU-based HPC systems, even when machines have the same architecture and SKU (stock kee** unit). This variation occurs due to manufacturing variability and the chip's PM. However, while modern HPC systems widely employ accelerators such as GPUs, it is unclear how much this variability affects applications. Accordingly, we seek to characterize the extent of variation due to GPU PM in modern HPC and supercomputing systems. We study a variety of applications that stress different GPU components on five large-scale computing centers with modern GPUs: Oak Ridge's Summit, Sandia's Vortex, TACC's Frontera and Longhorn, and Livermore's Corona. These clusters use a variety of cooling methods and GPU vendors. In total, we collect over 18,800 hours of data across more than 90% of the GPUs in these clusters. Regardless of the application, cluster, GPU vendor, and cooling method, our results show significant variation: 8% (max 22%) average performance variation even though the GPU architecture and vendor SKU are identical within each cluster, with outliers up to 1.5X slower than the median GPU. These results highlight the difficulty in efficiently using existing GPU clusters for modern HPC and scientific workloads, and the need to embrace variability in future accelerator-based systems. △ Less

Submitted 8 November, 2022; v1 submitted 23 August, 2022; originally announced August 2022.

Comments: 14 pages, 18 figures, to appear at The 34th International Conference for High Performance Computing, Networking, Storage, and Analysis (SC '22)

Sub picosecond steering of ultrafast incoherent emission from semiconductor metasurfaces

Authors: Prasad P. Iyer, Nicholas Karl, Sadhvikas Addamane, Sylvain D. Gennaro, Michael B. Sinclair, Igal Brener

Abstract: The ability to dynamically steer fs pulses from a monolithically integrated source is a critical milestone for the fields of nanophotonics and ultrafast optics. The nascent field of reconfigurable metasurfaces -- made of optically resonant meta-atoms -- has shown great promise in manipulating light-matter interactions through subwavelength control of the phase, amplitude, and polarization of light… ▽ More The ability to dynamically steer fs pulses from a monolithically integrated source is a critical milestone for the fields of nanophotonics and ultrafast optics. The nascent field of reconfigurable metasurfaces -- made of optically resonant meta-atoms -- has shown great promise in manipulating light-matter interactions through subwavelength control of the phase, amplitude, and polarization of light. These active metasurfaces arbitrarily transform an incident wavefront using a reconfigurable spatial phase profile and thus have been limited to manipulating coherent external sources. Light emitting metasurfaces obtained through integration of incoherent emitters with meta-atoms, have been used to statically increase the quantum efficiency of the emission through Purcell factor enhancement and control the far-field emission properties of the light to collimate and focus spontaneous emission. Active manipulation of such incoherent light sources, however, remains a challenge as current phase-sensitive approaches used for coherent sources cannot be directly applied. Spatiotemporal control at ultrafast timescales of incoherent light emission could lead to a transformative technological leap allowing low-power light emitting diodes (LEDs) to replace high-power coherent laser sources, enabling holographic LED displays and other key optical transceiver applications including remote-sensing, perception, and high-speed optical communication systems. In this work, we theoretically predict and experimentally demonstrate for the first time, sub-picosecond steering over a 70° range of ultrafast incoherent emission from a light emitting metasurface. △ Less

Submitted 9 June, 2022; originally announced June 2022.

MaxStyle: Adversarial Style Composition for Robust Medical Image Segmentation

Authors: Chen Chen, Zeju Li, Cheng Ouyang, Matt Sinclair, Wenjia Bai, Daniel Rueckert

Abstract: Convolutional neural networks (CNNs) have achieved remarkable segmentation accuracy on benchmark datasets where training and test sets are from the same domain, yet their performance can degrade significantly on unseen domains, which hinders the deployment of CNNs in many clinical scenarios. Most existing works improve model out-of-domain (OOD) robustness by collecting multi-domain datasets for tr… ▽ More Convolutional neural networks (CNNs) have achieved remarkable segmentation accuracy on benchmark datasets where training and test sets are from the same domain, yet their performance can degrade significantly on unseen domains, which hinders the deployment of CNNs in many clinical scenarios. Most existing works improve model out-of-domain (OOD) robustness by collecting multi-domain datasets for training, which is expensive and may not always be feasible due to privacy and logistical issues. In this work, we focus on improving model robustness using a single-domain dataset only. We propose a novel data augmentation framework called MaxStyle, which maximizes the effectiveness of style augmentation for model OOD performance. It attaches an auxiliary style-augmented image decoder to a segmentation network for robust feature learning and data augmentation. Importantly, MaxStyle augments data with improved image style diversity and hardness, by expanding the style space with noise and searching for the worst-case style composition of latent features via adversarial training. With extensive experiments on multiple public cardiac and prostate MR datasets, we demonstrate that MaxStyle leads to significantly improved out-of-distribution robustness against unseen corruptions as well as common distribution shifts across multiple, different, unseen sites and unknown image sequences under both low- and high-training data settings. The code can be found at https://github.com/cherise215/MaxStyle. △ Less

Submitted 19 June, 2022; v1 submitted 2 June, 2022; originally announced June 2022.

Comments: Early accepted by MICCAI 2022 (Camera-ready version)

CAS-Net: Conditional Atlas Generation and Brain Segmentation for Fetal MRI

Authors: Liu Li, Qiang Ma, Matthew Sinclair, Antonios Makropoulos, Joseph Hajnal, A. David Edwards, Bernhard Kainz, Daniel Rueckert, Amir Alansary

Abstract: Fetal Magnetic Resonance Imaging (MRI) is used in prenatal diagnosis and to assess early brain development. Accurate segmentation of the different brain tissues is a vital step in several brain analysis tasks, such as cortical surface reconstruction and tissue thickness measurements. Fetal MRI scans, however, are prone to motion artifacts that can affect the correctness of both manual and automati… ▽ More Fetal Magnetic Resonance Imaging (MRI) is used in prenatal diagnosis and to assess early brain development. Accurate segmentation of the different brain tissues is a vital step in several brain analysis tasks, such as cortical surface reconstruction and tissue thickness measurements. Fetal MRI scans, however, are prone to motion artifacts that can affect the correctness of both manual and automatic segmentation techniques. In this paper, we propose a novel network structure that can simultaneously generate conditional atlases and predict brain tissue segmentation, called CAS-Net. The conditional atlases provide anatomical priors that can constrain the segmentation connectivity, despite the heterogeneity of intensity values caused by motion or partial volume effects. The proposed method is trained and evaluated on 253 subjects from the develo** Human Connectome Project (dHCP). The results demonstrate that the proposed method can generate conditional age-specific atlas with sharp boundary and shape variance. It also segment multi-category brain tissues for fetal MRI with a high overall Dice similarity coefficient (DSC) of $85.2\%$ for the selected 9 tissue labels. △ Less

Submitted 17 May, 2022; originally announced May 2022.

Efficient Generation of Tunable Magnetic and Optical Vortices Using Plasmas

Authors: Yipeng Wu, Xinlu Xu, Chaojie Zhang, Zan Nie, Mitchell Sinclair, Audrey Farrell, Ken A Marsh, Jianfei Hua, Wei Lu, Warren B. Mori, Chan Joshi

Abstract: Plasma is an attractive medium for generating strong microscopic magnetic structures and tunable electromagnetic radiation with predictable topologies due to its extraordinary ability to sustain and manipulate high currents and strong fields. Here, using theory and simulations, we show efficient generation of multi-megagauss magnetic and tunable optical vortices when a sharp relativistic ionizatio… ▽ More Plasma is an attractive medium for generating strong microscopic magnetic structures and tunable electromagnetic radiation with predictable topologies due to its extraordinary ability to sustain and manipulate high currents and strong fields. Here, using theory and simulations, we show efficient generation of multi-megagauss magnetic and tunable optical vortices when a sharp relativistic ionization front (IF) passes through a relatively long-wavelength Laguerre-Gaussian (LG) laser pulse with orbital angular momentum (OAM). The optical vortex is frequency upshifted within a wide spectral range simply by changing the plasma density and compressed in duration. The topological charges of both vortices can be manipulated by controlling the OAM mode of the incident LG laser and/or by controlling the topology and density of the IF. For relatively high (low) plasma densities, most energy of the incident LG laser pulse is converted to the magnetic (optical) vortex. △ Less

Submitted 19 April, 2022; originally announced April 2022.

Map** the self-generated magnetic fields due to thermal Weibel instability

Authors: Chaojie Zhang, Yipeng Wu, Mitchell Sinclair, Audrey Farrell, Kenneth A. Marsh, Irina Petrushina, Navid Vafaei-Najafabadi, Apurva Gawked, Rotem Kupfer, Karl Kusche, Mikhail Fedurin, Igor Pogorelsky, Mikhail Polyanskiy, Chen-Kang Huang, Jianfei Hua, Wei Lu, Warren B. Mori, Chan Joshi

Abstract: Weibel-type instability can self-generate and amplify magnetic fields in both space and laboratory plasmas with temperature anisotropy. The electron Weibel instability has generally proven more challenging to measure than its ion counterpart owing to the much smaller inertia of electrons, resulting in a faster growth rate and smaller characteristic wavelength. Here, we have probed the evolution of… ▽ More Weibel-type instability can self-generate and amplify magnetic fields in both space and laboratory plasmas with temperature anisotropy. The electron Weibel instability has generally proven more challenging to measure than its ion counterpart owing to the much smaller inertia of electrons, resulting in a faster growth rate and smaller characteristic wavelength. Here, we have probed the evolution of the two-dimensional distribution of the magnetic field components and the current density due to electron Weibel instability, in $\rm CO_2$-ionized hydrogen gas (plasma) with picosecond resolution using a relativistic electron beam. We find that the wavenumber spectra of the magnetic fields are initially broad but eventually shrink to a narrow spectrum representing the dominant quasi-single mode. The measured $k$-resolved growth rates of the instability validate kinetic theory. Concurrently, self-organization of microscopic plasma currents is observed to amplify the current modulation magnitude that converts up to $\sim 1\%$ of the plasma thermal energy into magnetic energy. △ Less

Submitted 8 April, 2022; originally announced April 2022.

Comments: 24 pages, 4 figures

Electron Weibel instability induced magnetic fields in optical-field ionized plasmas

Authors: Chaojie Zhang, Yipeng Wu, Mitchell Sinclair, Audrey Farrell, Kenneth A. Marsh, Jianfei Hua, Irina Petrushina, Navid Vafaei-Najafabadi, Rotem Kupfer, Karl Kusche, Mikhail Fedurin, Igor Pogorelsky, Mikhail Polyanskiy, Chen-Kang Huang, Wei Lu, Warren B. Mori, Chan Joshi

Abstract: Generation and amplification of magnetic fields in plasmas is a long-standing topic that is of great interest to both plasma and space physics. The electron Weibel instability is a well-known mechanism responsible for self-generating magnetic fields in plasmas with temperature anisotropy and has been extensively investigated in both theory and simulations, yet experimental verification of this ins… ▽ More Generation and amplification of magnetic fields in plasmas is a long-standing topic that is of great interest to both plasma and space physics. The electron Weibel instability is a well-known mechanism responsible for self-generating magnetic fields in plasmas with temperature anisotropy and has been extensively investigated in both theory and simulations, yet experimental verification of this instability has been challenging. Recently, we demonstrated a new experimental platform that enables the controlled initialization of highly nonthermal and/or anisotropic plasma electron velocity distributions via optical-field ionization. Using an external electron probe bunch from a linear accelerator, the onset, saturation and decay of the self-generated magnetic fields due to electron Weibel instability were measured for the first time to our knowledge. In this paper, we will first present experimental results on time-resolved measurements of the Weibel magnetic fields in non-relativistic plasmas produced by Ti:Sapphire laser pulses (0.8 $μm$) and then discuss the feasibility of extending the study to quasi-relativistic regime by using intense $\rm CO_2$ (e.g., 9.2 $μm$) lasers to produce much hotter plasmas. △ Less

Submitted 8 April, 2022; originally announced April 2022.

Comments: 22 pages, 10 figures

Cascaded optical nonlinearities in dielectric metasurfaces

Authors: Sylvain D. Gennaro, Chloe F. Doiron, Nicholas Karl, Prasad P. Iyer, Michael B. Sinclair, Igal Brener

Abstract: Since the discovery of the laser, optical parametric nonlinearities have been at the core of efficient light conversion sources. Typically, thick transparent crystals or quasi-phase matched waveguides, are utilized in conjunction with phase-matching techniques to select a single parametric process. In recent years, due to the rapid developments in artificially structured materials, optical frequen… ▽ More Since the discovery of the laser, optical parametric nonlinearities have been at the core of efficient light conversion sources. Typically, thick transparent crystals or quasi-phase matched waveguides, are utilized in conjunction with phase-matching techniques to select a single parametric process. In recent years, due to the rapid developments in artificially structured materials, optical frequency mixing has been achieved at the nanoscale in subwavelength resonators arrayed as metasurfaces. Phase matching becomes relaxed for these wavelength-scale structures, and all allowed nonlinear processes can, in principle, occur on an equal footing. This could promote harmonic generation via a cascaded (consisting of several frequency mixing steps) process. However, so far, all reported work on dielectric metasurfaces have assumed frequency mixing from a direct (single step) nonlinear process. In this work, we prove the existence of cascaded second-order optical nonlinearities by analyzing the second and third wave mixing from a highly nonlinear metasurface in conjunction with polarization selection rules and crystal symmetries. We find that the third wave mixing signal from a cascaded process can be of comparable strength to that from conventional third harmonic generation, and that surface nonlinearities are the dominant mechanism that contributes to cascaded second order nonlinearities △ Less

Submitted 9 December, 2021; v1 submitted 3 December, 2021; originally announced December 2021.

Comments: 7 pages inc references, 4 figures, Journal article

HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots

Authors: Ryo Suzuki, Eyal Ofek, Mike Sinclair, Daneil Leithinger, Mar Gonzalez-Franco

Abstract: HapticBots introduces a novel encountered-type haptic approach for Virtual Reality (VR) based on multiple tabletop-size shape-changing robots. These robots move on a tabletop and change their height and orientation to haptically render various surfaces and objects on-demand. Compared to previous encountered-type haptic approaches like shape displays or robotic arms, our proposed approach has an ad… ▽ More HapticBots introduces a novel encountered-type haptic approach for Virtual Reality (VR) based on multiple tabletop-size shape-changing robots. These robots move on a tabletop and change their height and orientation to haptically render various surfaces and objects on-demand. Compared to previous encountered-type haptic approaches like shape displays or robotic arms, our proposed approach has an advantage in deployability, scalability, and generalizability -- these robots can be easily deployed due to their compact form factor. They can support multiple concurrent touch points in a large area thanks to the distributed nature of the robots. We propose and evaluate a novel set of interactions enabled by these robots which include: 1) rendering haptics for VR objects by providing just-in-time touch-points on the user's hand, 2) simulating continuous surfaces with the concurrent height and position change, and 3) enabling the user to pick up and move VR objects through graspable proxy objects. Finally, we demonstrate HapticBots with various applications, including remote collaboration, education and training, design and 3D modeling, and gaming and entertainment. △ Less

Submitted 24 August, 2021; originally announced August 2021.

Comments: UIST 2021

Detecting Hypo-plastic Left Heart Syndrome in Fetal Ultrasound via Disease-specific Atlas Maps

Authors: Samuel Budd, Matthew Sinclair, Thomas Day, Athanasios Vlontzos, Jeremy Tan, Tianrui Liu, Jaqueline Matthew, Emily Skelton, John Simpson, Reza Razavi, Ben Glocker, Daniel Rueckert, Emma C. Robinson, Bernhard Kainz

Abstract: Fetal ultrasound screening during pregnancy plays a vital role in the early detection of fetal malformations which have potential long-term health impacts. The level of skill required to diagnose such malformations from live ultrasound during examination is high and resources for screening are often limited. We present an interpretable, atlas-learning segmentation method for automatic diagnosis of… ▽ More Fetal ultrasound screening during pregnancy plays a vital role in the early detection of fetal malformations which have potential long-term health impacts. The level of skill required to diagnose such malformations from live ultrasound during examination is high and resources for screening are often limited. We present an interpretable, atlas-learning segmentation method for automatic diagnosis of Hypo-plastic Left Heart Syndrome (HLHS) from a single `4 Chamber Heart' view image. We propose to extend the recently introduced Image-and-Spatial Transformer Networks (Atlas-ISTN) into a framework that enables sensitising atlas generation to disease. In this framework we can jointly learn image segmentation, registration, atlas construction and disease prediction while providing a maximum level of clinical interpretability compared to direct image classification methods. As a result our segmentation allows diagnoses competitive with expert-derived manual diagnosis and yields an AUC-ROC of 0.978 (1043 cases for training, 260 for validation and 325 for testing). △ Less

Submitted 6 July, 2021; originally announced July 2021.

Comments: MICCAI'21 Main Conference

Ionization induced plasma grating and its applications in strong-field ionization measurements

Authors: Chaojie Zhang, Zan Nie, Yipeng Wu, Mitchell Sinclair, Chen-Kang Huang, Ken A. Marsh, Chan Joshi

Abstract: An ionization-induced plasma grating can be formed by spatially selective ionization of gases by the interference of two intersecting ultra-short laser pulses. The density modulation of a plasma grating can approach unity since the plasma is produced only where the two pulses constructively interfere and ionization does not occur in destructive interference regions. Such a large density modulation… ▽ More An ionization-induced plasma grating can be formed by spatially selective ionization of gases by the interference of two intersecting ultra-short laser pulses. The density modulation of a plasma grating can approach unity since the plasma is produced only where the two pulses constructively interfere and ionization does not occur in destructive interference regions. Such a large density modulation leads to efficient Thomson scattering of a second ultra-short probe pulse once the Bragg condition is satisfied. By measuring the scattering efficiency, it is possible to determine the absolute electron density in the plasma grating and thereby deduce the ionization degree for a given neutral gas density. In this paper, we demonstrate the usefulness of this concept by showing two applications: ionization degree measurement of strong-field ionization of atoms and molecules and characterization of extremely low-density gas jets. The former application is of particular interest for ionization physics studies in dense gases where the collision of the ionized electron with neighboring neutrals may become important-sometimes referred to as many-body ionization, and the latter is useful for plasma-based acceleration that requires extremely low-density plasmas. △ Less

Submitted 2 June, 2021; originally announced June 2021.

Comments: 6 figures

A Case for Fine-grain Coherence Specialization in Heterogeneous Systems

Authors: Johnathan Alsop, Weon Taek Na, Matthew D. Sinclair, Samuel Grayson, Sarita V. Adve

Abstract: Hardware specialization is becoming a key enabler of energyefficient performance. Future systems will be increasingly heterogeneous, integrating multiple specialized and programmable accelerators, each with different memory demands. Traditionally, communication between accelerators has been inefficient, typically orchestrated through explicit DMA transfers between different address spaces. More re… ▽ More Hardware specialization is becoming a key enabler of energyefficient performance. Future systems will be increasingly heterogeneous, integrating multiple specialized and programmable accelerators, each with different memory demands. Traditionally, communication between accelerators has been inefficient, typically orchestrated through explicit DMA transfers between different address spaces. More recently, industry has proposed unified coherent memory which enables implicit data movement and more data reuse, but often these interfaces limit the coherence flexibility available to heterogeneous systems. This paper demonstrates the benefits of fine-grained coherence specialization for heterogeneous systems. We propose an architecture that enables low-complexity independent specialization of each individual coherence request in heterogeneous workloads by building upon a simple and flexible baseline coherence interface, Spandex. We then describe how to optimize individual memory requests to improve cache reuse and performance-critical memory latency in emerging heterogeneous workloads. Collectively, our techniques enable significant gains, reducing execution time by up to 61% or network traffic by up to 99% while adding minimal complexity to the Spandex protocol. △ Less

Submitted 23 April, 2021; originally announced April 2021.

Demystifying BERT: Implications for Accelerator Design

Authors: Suchita Pati, Shaizeen Aga, Nuwan Jayasena, Matthew D. Sinclair

Abstract: Transfer learning in natural language processing (NLP), as realized using models like BERT (Bi-directional Encoder Representation from Transformer), has significantly improved language representation with models that can tackle challenging language problems. Consequently, these applications are driving the requirements of future systems. Thus, we focus on BERT, one of the most popular NLP transfer… ▽ More Transfer learning in natural language processing (NLP), as realized using models like BERT (Bi-directional Encoder Representation from Transformer), has significantly improved language representation with models that can tackle challenging language problems. Consequently, these applications are driving the requirements of future systems. Thus, we focus on BERT, one of the most popular NLP transfer learning algorithms, to identify how its algorithmic behavior can guide future accelerator design. To this end, we carefully profile BERT training and identify key algorithmic behaviors which are worthy of attention in accelerator design. We observe that while computations which manifest as matrix multiplication dominate BERT's overall runtime, as in many convolutional neural networks, memory-intensive computations also feature prominently. We characterize these computations, which have received little attention so far. Further, we also identify heterogeneity in compute-intensive BERT computations and discuss software and possible hardware mechanisms to further optimize these computations. Finally, we discuss implications of these behaviors as networks get larger and use distributed training environments, and how techniques such as micro-batching and mixed-precision training scale. Overall, our analysis identifies holistic solutions to optimize systems for BERT-like models. △ Less

Submitted 13 April, 2021; originally announced April 2021.

ACM Class: C.3; C.4

Atlas-ISTN: Joint Segmentation, Registration and Atlas Construction with Image-and-Spatial Transformer Networks

Authors: Matthew Sinclair, Andreas Schuh, Karl Hahn, Kersten Petersen, Ying Bai, James Batten, Michiel Schaap, Ben Glocker

Abstract: Deep learning models for semantic segmentation are able to learn powerful representations for pixel-wise predictions, but are sensitive to noise at test time and do not guarantee a plausible topology. Image registration models on the other hand are able to warp known topologies to target images as a means of segmentation, but typically require large amounts of training data, and have not widely be… ▽ More Deep learning models for semantic segmentation are able to learn powerful representations for pixel-wise predictions, but are sensitive to noise at test time and do not guarantee a plausible topology. Image registration models on the other hand are able to warp known topologies to target images as a means of segmentation, but typically require large amounts of training data, and have not widely been benchmarked against pixel-wise segmentation models. We propose Atlas-ISTN, a framework that jointly learns segmentation and registration on 2D and 3D image data, and constructs a population-derived atlas in the process. Atlas-ISTN learns to segment multiple structures of interest and to register the constructed, topologically consistent atlas labelmap to an intermediate pixel-wise segmentation. Additionally, Atlas-ISTN allows for test time refinement of the model's parameters to optimize the alignment of the atlas labelmap to an intermediate pixel-wise segmentation. This process both mitigates for noise in the target image that can result in spurious pixel-wise predictions, as well as improves upon the one-pass prediction of the model. Benefits of the Atlas-ISTN framework are demonstrated qualitatively and quantitatively on 2D synthetic data and 3D cardiac computed tomography and brain magnetic resonance image data, out-performing both segmentation and registration baseline models. Atlas-ISTN also provides inter-subject correspondence of the structures of interest, enabling population-level shape and motion analysis. △ Less

Submitted 18 December, 2020; originally announced December 2020.

Comments: 33 pages, 15 figures

SeqPoint: Identifying Representative Iterations of Sequence-based Neural Networks

Authors: Suchita Pati, Shaizeen Aga, Matthew D. Sinclair, Nuwan Jayasena

Abstract: The ubiquity of deep neural networks (DNNs) continues to rise, making them a crucial application class for hardware optimizations. However, detailed profiling and characterization of DNN training remains difficult as these applications often run for hours to days on real hardware. Prior works exploit the iterative nature of DNNs to profile a few training iterations. While such a strategy is sound… ▽ More The ubiquity of deep neural networks (DNNs) continues to rise, making them a crucial application class for hardware optimizations. However, detailed profiling and characterization of DNN training remains difficult as these applications often run for hours to days on real hardware. Prior works exploit the iterative nature of DNNs to profile a few training iterations. While such a strategy is sound for networks like convolutional neural networks (CNNs), where the nature of the computation is largely input independent, we observe in this work that this approach is sub-optimal for sequence-based neural networks (SQNNs) such as recurrent neural networks (RNNs). The amount and nature of computations in SQNNs can vary for each input, resulting in heterogeneity across iterations. Thus, arbitrarily selecting a few iterations is insufficient to accurately summarize the behavior of the entire training run. To tackle this challenge, we carefully study the factors that impact SQNN training iterations and identify input sequence length as the key determining factor for variations across iterations. We then use this observation to characterize all iterations of an SQNN training run (requiring no profiling or simulation of the application) and select representative iterations, which we term SeqPoints. We analyze two state-of-the-art SQNNs, DeepSpeech2 and Google's Neural Machine Translation (GNMT), and show that SeqPoints can represent their entire training runs accurately, resulting in geomean errors of only 0.11% and 0.53%, respectively, when projecting overall runtime and 0.13% and 1.50% when projecting speedups due to architectural changes. This high accuracy is achieved while reducing the time needed for profiling by 345x and 214x for the two networks compared to full training runs. As a result, SeqPoint can enable analysis of SQNN training runs in mere minutes instead of hours or days. △ Less

Submitted 20 July, 2020; originally announced July 2020.

Comments: To appear in IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS 2020)

ACM Class: C.4

The gem5 Simulator: Version 20.0+

Authors: Jason Lowe-Power, Abdul Mutaal Ahmad, Ayaz Akram, Mohammad Alian, Rico Amslinger, Matteo Andreozzi, Adrià Armejach, Nils Asmussen, Brad Beckmann, Srikant Bharadwaj, Gabe Black, Gedare Bloom, Bobby R. Bruce, Daniel Rodrigues Carvalho, Jeronimo Castrillon, Lizhong Chen, Nicolas Derumigny, Stephan Diestelhorst, Wendy Elsasser, Carlos Escuin, Marjan Fariborz, Amin Farmahini-Farahani, Pouya Fotouhi, Ryan Gambord, Jayneel Gandhi , et al. (53 additional authors not shown)

Abstract: The open-source and community-supported gem5 simulator is one of the most popular tools for computer architecture research. This simulation infrastructure allows researchers to model modern computer hardware at the cycle level, and it has enough fidelity to boot unmodified Linux-based operating systems and run full applications for multiple architectures including x86, Arm, and RISC-V. The gem5 si… ▽ More The open-source and community-supported gem5 simulator is one of the most popular tools for computer architecture research. This simulation infrastructure allows researchers to model modern computer hardware at the cycle level, and it has enough fidelity to boot unmodified Linux-based operating systems and run full applications for multiple architectures including x86, Arm, and RISC-V. The gem5 simulator has been under active development over the last nine years since the original gem5 release. In this time, there have been over 7500 commits to the codebase from over 250 unique contributors which have improved the simulator by adding new features, fixing bugs, and increasing the code quality. In this paper, we give and overview of gem5's usage and features, describe the current state of the gem5 simulator, and enumerate the major changes since the initial release of gem5. We also discuss how the gem5 simulator has transitioned to a formal governance model to enable continued improvement and community support for the next 20 years of computer architecture research. △ Less

Submitted 29 September, 2020; v1 submitted 6 July, 2020; originally announced July 2020.

Comments: Source, comments, and feedback: https://github.com/darchr/gem5-20-paper

Specializing Coherence, Consistency, and Push/Pull for GPU Graph Analytics

Authors: Giordano Salvador, Wesley H. Darvin, Muhammad Huzaifa, Johnathan Alsop, Matthew D. Sinclair, Sarita V. Adve

Abstract: This work provides the first study to explore the interaction of update propagation with and without fine-grained synchronization (push vs. pull), emerging coherence protocols (GPU vs. DeNovo coherence), and software-centric consistency models (DRF0, DRF1, and DRFrlx) for graph workloads on emerging integrated GPU-CPU systems with native unified shared memory. We study 6 graph applications with 6… ▽ More This work provides the first study to explore the interaction of update propagation with and without fine-grained synchronization (push vs. pull), emerging coherence protocols (GPU vs. DeNovo coherence), and software-centric consistency models (DRF0, DRF1, and DRFrlx) for graph workloads on emerging integrated GPU-CPU systems with native unified shared memory. We study 6 graph applications with 6 graph inputs for a total of 36 workloads running on 12 system (hardware+software) configurations reflecting the above design space of update propagation, coherence, and memory consistency. We make three key contributions. First, we show that there is no single best system configuration for all workloads, motivating systems with flexible coherence and consistency support. Second, we develop a model to accurately predict the best system configuration -- this model can be used by software designers to decide on push vs. pull and the consistency model and by flexible hardware to invoke the appropriate coherence and consistency configuration for the given workload. Third, we show that the design dimensions explored here are inter-dependent, reinforcing the need for software-hardware co-design in the above design dimensions. For example, software designers deciding on push vs. pull must consider the consistency model supported by hardware -- in some cases, push maybe better if hardware supports DRFrlx while pull may be better if hardware does not support DRFrlx. △ Less

Submitted 25 February, 2020; v1 submitted 19 February, 2020; originally announced February 2020.

Automated quantification of myocardial tissue characteristics from native T1 map** using neural networks with Bayesian inference for uncertainty-based quality-control

Authors: Esther Puyol Anton, Bram Ruijsink, Christian F. Baumgartner, Matthew Sinclair, Ender Konukoglu, Reza Razavi, Andrew P. King

Abstract: Tissue characterisation with CMR parametric map** has the potential to detect and quantify both focal and diffuse alterations in myocardial structure not assessable by late gadolinium enhancement. Native T1 map** in particular has shown promise as a useful biomarker to support diagnostic, therapeutic and prognostic decision-making in ischaemic and non-ischaemic cardiomyopathies. Convolutional… ▽ More Tissue characterisation with CMR parametric map** has the potential to detect and quantify both focal and diffuse alterations in myocardial structure not assessable by late gadolinium enhancement. Native T1 map** in particular has shown promise as a useful biomarker to support diagnostic, therapeutic and prognostic decision-making in ischaemic and non-ischaemic cardiomyopathies. Convolutional neural networks with Bayesian inference are a category of artificial neural networks which model the uncertainty of the network output. This study presents an automated framework for tissue characterisation from native ShMOLLI T1 map** at 1.5T using a Probabilistic Hierarchical Segmentation (PHiSeg) network. In addition, we use the uncertainty information provided by the PHiSeg network in a novel automated quality control (QC) step to identify uncertain T1 values. The PHiSeg network and QC were validated against manual analysis on a cohort of the UK Biobank containing healthy subjects and chronic cardiomyopathy patients. We used the proposed method to obtain reference T1 ranges for the left ventricular myocardium in healthy subjects as well as common clinical cardiac conditions. T1 values computed from automatic and manual segmentations were highly correlated (r=0.97). Bland-Altman analysis showed good agreement between the automated and manual measurements. The average Dice metric was 0.84 for the left ventricular myocardium. The sensitivity of detection of erroneous outputs was 91%. Finally, T1 values were automatically derived from 14,683 CMR exams from the UK Biobank. The proposed pipeline allows for automatic analysis of myocardial native T1 map** and includes a QC process to detect potentially erroneous results. T1 reference values were presented for healthy subjects and common clinical cardiac conditions from the largest cohort to date using T1-map** images. △ Less

Submitted 31 January, 2020; originally announced January 2020.

Optimizing GPU Cache Policies for MI Workloads

Authors: Johnathan Alsop, Matthew D. Sinclair, Srikant Bharadwaj, Alexandru Dutu, Anthony Gutierrez, Onur Kayiran, Michael LeBeane, Sooraj Puthoor, Xianwei Zhang, Tsung Tai Yeh, Bradford M. Beckmann

Abstract: In recent years, machine intelligence (MI) applications have emerged as a major driver for the computing industry. Optimizing these workloads is important but complicated. As memory demands grow and data movement overheads increasingly limit performance, determining the best GPU caching policy to use for a diverse range of MI workloads represents one important challenge. To study this, we evaluate… ▽ More In recent years, machine intelligence (MI) applications have emerged as a major driver for the computing industry. Optimizing these workloads is important but complicated. As memory demands grow and data movement overheads increasingly limit performance, determining the best GPU caching policy to use for a diverse range of MI workloads represents one important challenge. To study this, we evaluate 17 MI applications and characterize their behaviors using a range of GPU caching strategies. In our evaluations, we find that the choice of caching policy in GPU caches involves multiple performance trade-offs and interactions, and there is no one-size-fits-all GPU caching policy for MI workloads. Based on detailed simulation results, we motivate and evaluate a set of cache optimizations that consistently match the performance of the best static GPU caching policies. △ Less

Submitted 30 September, 2019; originally announced October 2019.

Comments: Extended version of short paper published in the 2019 IEEE International Symposium on Workload Characterization

Confident Head Circumference Measurement from Ultrasound with Real-time Feedback for Sonographers

Authors: Samuel Budd, Matthew Sinclair, Bishesh Khanal, Jacqueline Matthew, David Lloyd, Alberto Gomez, Nicolas Toussaint, Emma Robinson, Bernhard Kainz

Abstract: Manual estimation of fetal Head Circumference (HC) from Ultrasound (US) is a key biometric for monitoring the healthy development of fetuses. Unfortunately, such measurements are subject to large inter-observer variability, resulting in low early-detection rates of fetal abnormalities. To address this issue, we propose a novel probabilistic Deep Learning approach for real-time automated estimation… ▽ More Manual estimation of fetal Head Circumference (HC) from Ultrasound (US) is a key biometric for monitoring the healthy development of fetuses. Unfortunately, such measurements are subject to large inter-observer variability, resulting in low early-detection rates of fetal abnormalities. To address this issue, we propose a novel probabilistic Deep Learning approach for real-time automated estimation of fetal HC. This system feeds back statistics on measurement robustness to inform users how confident a deep neural network is in evaluating suitable views acquired during free-hand ultrasound examination. In real-time scenarios, this approach may be exploited to guide operators to scan planes that are as close as possible to the underlying distribution of training images, for the purpose of improving inter-operator consistency. We train on free-hand ultrasound data from over 2000 subjects (2848 training/540 test) and show that our method is able to predict HC measurements within 1.81$\pm$1.65mm deviation from the ground truth, with 50% of the test images fully contained within the predicted confidence margins, and an average of 1.82$\pm$1.78mm deviation from the margin for the remaining cases that are not fully contained. △ Less

Submitted 7 August, 2019; originally announced August 2019.

Comments: Accepted at MICCAI 2019; Demo video available on Twitter (@sambuddinc)

High-harmonic generation from an epsilon-near-zero material

Authors: Yuanmu Yang, Jian Lu, Alejandro Manjavacas, Ting S. Luk, Hanzhe Liu, Kyle Kelley, Jon-Paul Maria, Michael B. Sinclair, Shambhu Ghimire, Igal Brener

Abstract: High-harmonic generation (HHG) from a compact, solid-state medium is highly desirable for applications such as coherent attosecond pulse generation and extreme ultra-violet (EUV) spectroscopy, yet the typically weak conversion of pump light to HHG can largely hinder its applications. Here, we use a material operating in its epsilon-near-zero (ENZ) region, where the real part of its permittivity va… ▽ More High-harmonic generation (HHG) from a compact, solid-state medium is highly desirable for applications such as coherent attosecond pulse generation and extreme ultra-violet (EUV) spectroscopy, yet the typically weak conversion of pump light to HHG can largely hinder its applications. Here, we use a material operating in its epsilon-near-zero (ENZ) region, where the real part of its permittivity vanishes, to greatly boost the efficiency of the HHG process at the microscopic level. In experiments, we report high-harmonic emission up to the 9th order directly from a low-loss, solid-state ENZ medium: indium-doped cadmium oxide, with an excitation intensity at the GW cm-2 level. Furthermore, the observed HHG signal exhibits a pronounced spectral red-shift as well as linewidth broadening, resulting from the photo-induced electron heating and the consequent time-dependent resonant frequency of the ENZ film. Our results provide a novel nanophotonic platform for strong field physics, reveal new degrees of freedom for spectral and temporal control of HHG, and open up possibilities of compact solid-state attosecond light sources. △ Less

Submitted 10 February, 2019; originally announced February 2019.

Analyzing Machine Learning Workloads Using a Detailed GPU Simulator

Authors: Jonathan Lew, Deval Shah, Suchita Pati, Shaylin Cattell, Mengchi Zhang, Amruth Sandhupatla, Christopher Ng, Negar Goli, Matthew D. Sinclair, Timothy G. Rogers, Tor Aamodt

Abstract: Most deep neural networks deployed today are trained using GPUs via high-level frameworks such as TensorFlow and PyTorch. This paper describes changes we made to the GPGPU-Sim simulator to enable it to run PyTorch by running PTX kernels included in NVIDIA's cuDNN library. We use the resulting modified simulator, which has been made available publicly with this paper, to study some simple deep lear… ▽ More Most deep neural networks deployed today are trained using GPUs via high-level frameworks such as TensorFlow and PyTorch. This paper describes changes we made to the GPGPU-Sim simulator to enable it to run PyTorch by running PTX kernels included in NVIDIA's cuDNN library. We use the resulting modified simulator, which has been made available publicly with this paper, to study some simple deep learning workloads. With our changes to GPGPU-Sim's functional simulation model, we find GPGPU-Sim performance model running a cuDNN enabled implementation of LeNet for MNIST reports results within 30% of real hardware. Using GPGPU-Sim's AerialVision performance analysis tool we observe that cuDNN API calls contain many varying phases and appear to include potentially inefficient microarchitecture behaviour such as DRAM partition bank cam**, at least when executed on GPGPU-Sim's current performance model. △ Less

Submitted 26 January, 2019; v1 submitted 18 November, 2018; originally announced November 2018.

Comments: Source code available at: https://github.com/gpgpu-sim/gpgpu-sim_distribution/tree/dev

Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging

Authors: Qingjie Meng, Matthew Sinclair, Veronika Zimmer, Benjamin Hou, Martin Rajchl, Nicolas Toussaint, Ozan Oktay, Jo Schlemper, Alberto Gomez, James Housden, Jacqueline Matthew, Daniel Rueckert, Julia Schnabel, Bernhard Kainz

Abstract: Detecting acoustic shadows in ultrasound images is important in many clinical and engineering applications. Real-time feedback of acoustic shadows can guide sonographers to a standardized diagnostic viewing plane with minimal artifacts and can provide additional information for other automatic image analysis algorithms. However, automatically detecting shadow regions using learning-based algorithm… ▽ More Detecting acoustic shadows in ultrasound images is important in many clinical and engineering applications. Real-time feedback of acoustic shadows can guide sonographers to a standardized diagnostic viewing plane with minimal artifacts and can provide additional information for other automatic image analysis algorithms. However, automatically detecting shadow regions using learning-based algorithms is challenging because pixel-wise ground truth annotation of acoustic shadows is subjective and time consuming. In this paper we propose a weakly supervised method for automatic confidence estimation of acoustic shadow regions. Our method is able to generate a dense shadow-focused confidence map. In our method, a shadow-seg module is built to learn general shadow features for shadow segmentation, based on global image-level annotations as well as a small number of coarse pixel-wise shadow annotations. A transfer function is introduced to extend the obtained binary shadow segmentation to a reference confidence map. Additionally, a confidence estimation network is proposed to learn the map** between input images and the reference confidence maps. This network is able to predict shadow confidence maps directly from input images during inference. We use evaluation metrics such as DICE, inter-class correlation and etc. to verify the effectiveness of our method. Our method is more consistent than human annotation, and outperforms the state-of-the-art quantitatively in shadow segmentation and qualitatively in confidence estimation of shadow regions. We further demonstrate the applicability of our method by integrating shadow confidence maps into tasks such as ultrasound image classification, multi-view image fusion and automated biometric measurements. △ Less

Submitted 6 May, 2019; v1 submitted 20 November, 2018; originally announced November 2018.

Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge

Authors: Spyridon Bakas, Mauricio Reyes, Andras Jakab, Stefan Bauer, Markus Rempfler, Alessandro Crimi, Russell Takeshi Shinohara, Christoph Berger, Sung Min Ha, Martin Rozycki, Marcel Prastawa, Esther Alberts, Jana Lipkova, John Freymann, Justin Kirby, Michel Bilello, Hassan Fathallah-Shaykh, Roland Wiest, Jan Kirschke, Benedikt Wiestler, Rivka Colen, Aikaterini Kotrotsou, Pamela Lamontagne, Daniel Marcus, Mikhail Milchenko , et al. (402 additional authors not shown)

Abstract: Gliomas are the most common primary brain malignancies, with different degrees of aggressiveness, variable prognosis and various heterogeneous histologic sub-regions, i.e., peritumoral edematous/invaded tissue, necrotic core, active and non-enhancing core. This intrinsic heterogeneity is also portrayed in their radio-phenotype, as their sub-regions are depicted by varying intensity profiles dissem… ▽ More Gliomas are the most common primary brain malignancies, with different degrees of aggressiveness, variable prognosis and various heterogeneous histologic sub-regions, i.e., peritumoral edematous/invaded tissue, necrotic core, active and non-enhancing core. This intrinsic heterogeneity is also portrayed in their radio-phenotype, as their sub-regions are depicted by varying intensity profiles disseminated across multi-parametric magnetic resonance imaging (mpMRI) scans, reflecting varying biological properties. Their heterogeneous shape, extent, and location are some of the factors that make these tumors difficult to resect, and in some cases inoperable. The amount of resected tumor is a factor also considered in longitudinal scans, when evaluating the apparent tumor for potential diagnosis of progression. Furthermore, there is mounting evidence that accurate segmentation of the various tumor sub-regions can offer the basis for quantitative image analysis towards prediction of patient overall survival. This study assesses the state-of-the-art machine learning (ML) methods used for brain tumor image analysis in mpMRI scans, during the last seven instances of the International Brain Tumor Segmentation (BraTS) challenge, i.e., 2012-2018. Specifically, we focus on i) evaluating segmentations of the various glioma sub-regions in pre-operative mpMRI scans, ii) assessing potential tumor progression by virtue of longitudinal growth of tumor sub-regions, beyond use of the RECIST/RANO criteria, and iii) predicting the overall survival from pre-operative mpMRI scans of patients that underwent gross total resection. Finally, we investigate the challenge of identifying the best ML algorithms for each of these tasks, considering that apart from being diverse on each instance of the challenge, the multi-institutional mpMRI BraTS dataset has also been a continuously evolving/growing dataset. △ Less

Submitted 23 April, 2019; v1 submitted 5 November, 2018; originally announced November 2018.

Comments: The International Multimodal Brain Tumor Segmentation (BraTS) Challenge

A Comprehensive Approach for Learning-based Fully-Automated Inter-slice Motion Correction for Short-Axis Cine Cardiac MR Image Stacks

Authors: Giacomo Tarroni, Ozan Oktay, Matthew Sinclair, Wenjia Bai, Andreas Schuh, Hideaki Suzuki, Antonio de Marvao, Declan O'Regan, Stuart Cook, Daniel Rueckert

Abstract: In the clinical routine, short axis (SA) cine cardiac MR (CMR) image stacks are acquired during multiple subsequent breath-holds. If the patient cannot consistently hold the breath at the same position, the acquired image stack will be affected by inter-slice respiratory motion and will not correctly represent the cardiac volume, introducing potential errors in the following analyses and visualisa… ▽ More In the clinical routine, short axis (SA) cine cardiac MR (CMR) image stacks are acquired during multiple subsequent breath-holds. If the patient cannot consistently hold the breath at the same position, the acquired image stack will be affected by inter-slice respiratory motion and will not correctly represent the cardiac volume, introducing potential errors in the following analyses and visualisations. We propose an approach to automatically correct inter-slice respiratory motion in SA CMR image stacks. Our approach makes use of probabilistic segmentation maps (PSMs) of the left ventricular (LV) cavity generated with decision forests. PSMs are generated for each slice of the SA stack and rigidly registered in-plane to a target PSM. If long axis (LA) images are available, PSMs are generated for them and combined to create the target PSM; if not, the target PSM is produced from the same stack using a 3D model trained from motion-free stacks. The proposed approach was tested on a dataset of SA stacks acquired from 24 healthy subjects (for which anatomical 3D cardiac images were also available as reference) and compared to two techniques which use LA intensity images and LA segmentations as targets, respectively. The results show the accuracy and robustness of the proposed approach in motion compensation. △ Less

Submitted 3 October, 2018; originally announced October 2018.

Comments: Accepted for publication at MICCAI 2018. arXiv admin note: text overlap with arXiv:1803.09354

Weakly Supervised Localisation for Fetal Ultrasound Images

Authors: Nicolas Toussaint, Bishesh Khanal, Matthew Sinclair, Alberto Gomez, Emily Skelton, Jacqueline Matthew, Julia A. Schnabel

Abstract: This paper addresses the task of detecting and localising fetal anatomical regions in 2D ultrasound images, where only image-level labels are present at training, i.e. without any localisation or segmentation information. We examine the use of convolutional neural network architectures coupled with soft proposal layers. The resulting network simultaneously performs anatomical region detection (cla… ▽ More This paper addresses the task of detecting and localising fetal anatomical regions in 2D ultrasound images, where only image-level labels are present at training, i.e. without any localisation or segmentation information. We examine the use of convolutional neural network architectures coupled with soft proposal layers. The resulting network simultaneously performs anatomical region detection (classification) and localisation tasks. We generate a proposal map describing the attention of the network for a particular class. The network is trained on 85,500 2D fetal Ultrasound images and their associated labels. Labels correspond to six anatomical regions: head, spine, thorax, abdomen, limbs, and placenta. Detection achieves an average accuracy of 90\% on individual regions, and show that the proposal maps correlate well with relevant anatomical structures. This work presents itself as a powerful and essential step towards subsequent tasks such as fetal position and pose estimation, organ-specific segmentation, or image-guided navigation. Code and additional material is available at https://ntoussaint.github.io/fetalnav △ Less

Submitted 2 August, 2018; originally announced August 2018.

Comments: 4th Workshop on Deep Learning for Medical Image Analysis, MICCAI 2018, Granada, Spain

Standard Plane Detection in 3D Fetal Ultrasound Using an Iterative Transformation Network

Authors: Yuanwei Li, Bishesh Khanal, Benjamin Hou, Amir Alansary, Juan J. Cerrolaza, Matthew Sinclair, Jacqueline Matthew, Chandni Gupta, Caroline Knight, Bernhard Kainz, Daniel Rueckert

Abstract: Standard scan plane detection in fetal brain ultrasound (US) forms a crucial step in the assessment of fetal development. In clinical settings, this is done by manually manoeuvring a 2D probe to the desired scan plane. With the advent of 3D US, the entire fetal brain volume containing these standard planes can be easily acquired. However, manual standard plane identification in 3D volume is labour… ▽ More Standard scan plane detection in fetal brain ultrasound (US) forms a crucial step in the assessment of fetal development. In clinical settings, this is done by manually manoeuvring a 2D probe to the desired scan plane. With the advent of 3D US, the entire fetal brain volume containing these standard planes can be easily acquired. However, manual standard plane identification in 3D volume is labour-intensive and requires expert knowledge of fetal anatomy. We propose a new Iterative Transformation Network (ITN) for the automatic detection of standard planes in 3D volumes. ITN uses a convolutional neural network to learn the relationship between a 2D plane image and the transformation parameters required to move that plane towards the location/orientation of the standard plane in the 3D volume. During inference, the current plane image is passed iteratively to the network until it converges to the standard plane location. We explore the effect of using different transformation representations as regression outputs of ITN. Under a multi-task learning framework, we introduce additional classification probability outputs to the network to act as confidence measures for the regressed transformation parameters in order to further improve the localisation accuracy. When evaluated on 72 US volumes of fetal brain, our method achieves an error of 3.83mm/12.7 degrees and 3.80mm/12.6 degrees for the transventricular and transcerebellar planes respectively and takes 0.46s per plane. Source code is publicly available at https://github.com/yuanwei1989/plane-detection. △ Less

Submitted 6 October, 2018; v1 submitted 19 June, 2018; originally announced June 2018.

Comments: 8 pages, 2 figures, accepted for MICCAI 2018; Added link to source code

Journal ref: LNCS 11070 (2018) 392-400

Fast Multiple Landmark Localisation Using a Patch-based Iterative Network

Authors: Yuanwei Li, Amir Alansary, Juan J. Cerrolaza, Bishesh Khanal, Matthew Sinclair, Jacqueline Matthew, Chandni Gupta, Caroline Knight, Bernhard Kainz, Daniel Rueckert

Abstract: We propose a new Patch-based Iterative Network (PIN) for fast and accurate landmark localisation in 3D medical volumes. PIN utilises a Convolutional Neural Network (CNN) to learn the spatial relationship between an image patch and anatomical landmark positions. During inference, patches are repeatedly passed to the CNN until the estimated landmark position converges to the true landmark location.… ▽ More We propose a new Patch-based Iterative Network (PIN) for fast and accurate landmark localisation in 3D medical volumes. PIN utilises a Convolutional Neural Network (CNN) to learn the spatial relationship between an image patch and anatomical landmark positions. During inference, patches are repeatedly passed to the CNN until the estimated landmark position converges to the true landmark location. PIN is computationally efficient since the inference stage only selectively samples a small number of patches in an iterative fashion rather than a dense sampling at every location in the volume. Our approach adopts a multi-task learning framework that combines regression and classification to improve localisation accuracy. We extend PIN to localise multiple landmarks by using principal component analysis, which models the global anatomical relationships between landmarks. We have evaluated PIN using 72 3D ultrasound images from fetal screening examinations. PIN achieves quantitatively an average landmark localisation error of 5.59mm and a runtime of 0.44s to predict 10 landmarks per volume. Qualitatively, anatomical 2D standard scan planes derived from the predicted landmark locations are visually similar to the clinical ground truth. Source code is publicly available at https://github.com/yuanwei1989/landmark-detection. △ Less

Submitted 6 October, 2018; v1 submitted 18 June, 2018; originally announced June 2018.

Comments: 8 pages, 4 figures, Accepted for MICCAI 2018

Journal ref: LNCS 11070 (2018) 563-571

Human-level Performance On Automatic Head Biometrics In Fetal Ultrasound Using Fully Convolutional Neural Networks

Authors: Matthew Sinclair, Christian F. Baumgartner, Jacqueline Matthew, Wenjia Bai, Juan Cerrolaza Martinez, Yuanwei Li, Sandra Smith, Caroline L. Knight, Bernhard Kainz, Jo Hajnal, Andrew P. King, Daniel Rueckert

Abstract: Measurement of head biometrics from fetal ultrasonography images is of key importance in monitoring the healthy development of fetuses. However, the accurate measurement of relevant anatomical structures is subject to large inter-observer variability in the clinic. To address this issue, an automated method utilizing Fully Convolutional Networks (FCN) is proposed to determine measurements of fetal… ▽ More Measurement of head biometrics from fetal ultrasonography images is of key importance in monitoring the healthy development of fetuses. However, the accurate measurement of relevant anatomical structures is subject to large inter-observer variability in the clinic. To address this issue, an automated method utilizing Fully Convolutional Networks (FCN) is proposed to determine measurements of fetal head circumference (HC) and biparietal diameter (BPD). An FCN was trained on approximately 2000 2D ultrasound images of the head with annotations provided by 45 different sonographers during routine screening examinations to perform semantic segmentation of the head. An ellipse is fitted to the resulting segmentation contours to mimic the annotation typically produced by a sonographer. The model's performance was compared with inter-observer variability, where two experts manually annotated 100 test images. Mean absolute model-expert error was slightly better than inter-observer error for HC (1.99mm vs 2.16mm), and comparable for BPD (0.61mm vs 0.59mm), as well as Dice coefficient (0.980 vs 0.980). Our results demonstrate that the model performs at a level similar to a human expert, and learns to produce accurate predictions from a large dataset annotated by many sonographers. Additionally, measurements are generated in near real-time at 15fps on a GPU, which could speed up clinical workflow for both skilled and trainee sonographers. △ Less

Submitted 24 April, 2018; originally announced April 2018.

Comments: EMBC 2018

Ensembles of Multiple Models and Architectures for Robust Brain Tumour Segmentation

Authors: Konstantinos Kamnitsas, Wenjia Bai, Enzo Ferrante, Steven McDonagh, Matthew Sinclair, Nick Pawlowski, Martin Rajchl, Matthew Lee, Bernhard Kainz, Daniel Rueckert, Ben Glocker

Abstract: Deep learning approaches such as convolutional neural nets have consistently outperformed previous methods on challenging tasks such as dense, semantic segmentation. However, the various proposed networks perform differently, with behaviour largely influenced by architectural choices and training settings. This paper explores Ensembles of Multiple Models and Architectures (EMMA) for robust perform… ▽ More Deep learning approaches such as convolutional neural nets have consistently outperformed previous methods on challenging tasks such as dense, semantic segmentation. However, the various proposed networks perform differently, with behaviour largely influenced by architectural choices and training settings. This paper explores Ensembles of Multiple Models and Architectures (EMMA) for robust performance through aggregation of predictions from a wide range of methods. The approach reduces the influence of the meta-parameters of individual models and the risk of overfitting the configuration to a particular database. EMMA can be seen as an unbiased, generic deep learning model which is shown to yield excellent performance, winning the first position in the BRATS 2017 competition among 50+ participating teams. △ Less

Submitted 4 November, 2017; originally announced November 2017.

Comments: The method won the 1st-place in the Brain Tumour Segmentation (BRATS) 2017 competition (segmentation task)

An optical metamixer

Authors: Sheng Liu, Polina P. Vabishchevich, Aleksandr Vaskin, John L. Reno, Gordon A. Keeler, Michael B. Sinclair, Isabelle Staude, Igal Brener

Abstract: A frequency mixer is a nonlinear device that combines electromagnetic waves to create waves at new frequencies. Mixers are ubiquitous components in modern radio-frequency technology and are widely used in microwave signal processing. The development of versatile frequency mixers for optical frequencies remains challenging: such devices generally rely on weak nonlinear optical processes and, thus,… ▽ More A frequency mixer is a nonlinear device that combines electromagnetic waves to create waves at new frequencies. Mixers are ubiquitous components in modern radio-frequency technology and are widely used in microwave signal processing. The development of versatile frequency mixers for optical frequencies remains challenging: such devices generally rely on weak nonlinear optical processes and, thus, must satisfy phase matching conditions. In this work, we utilize a GaAs-based dielectric metasurface to demonstrate an optical frequency mixer that concurrently generates eleven new frequencies spanning the ultraviolet to near-infrared (NIR) spectral range. Our approach combines strong intrinsic material nonlinearities, enhanced electromagnetic fields, and relaxed phase-matching requirements, to allow seven different nonlinear optical processes to occur simultaneously. Specifically, when pumped by two femtosecond NIR pulses, we observe second-, third- and fourth-harmonic generation, sum-frequency generation, two-photon absorption induced photoluminescence, four-wave mixing, and six-wave mixing. Such ultracompact optical mixers may enable a plethora of applications in biology, chemistry, sensing, communications and quantum optics. △ Less

Submitted 31 October, 2017; originally announced November 2017.

Comments: total 9 pages, 3 figures

Automated cardiovascular magnetic resonance image analysis with fully convolutional networks

Authors: Wenjia Bai, Matthew Sinclair, Giacomo Tarroni, Ozan Oktay, Martin Rajchl, Ghislain Vaillant, Aaron M. Lee, Nay Aung, Elena Lukaschuk, Mihir M. Sanghvi, Filip Zemrak, Kenneth Fung, Jose Miguel Paiva, Valentina Carapella, Young ** Kim, Hideaki Suzuki, Bernhard Kainz, Paul M. Matthews, Steffen E. Petersen, Stefan K. Piechnik, Stefan Neubauer, Ben Glocker, Daniel Rueckert

Abstract: Cardiovascular magnetic resonance (CMR) imaging is a standard imaging modality for assessing cardiovascular diseases (CVDs), the leading cause of death globally. CMR enables accurate quantification of the cardiac chamber volume, ejection fraction and myocardial mass, providing information for diagnosis and monitoring of CVDs. However, for years, clinicians have been relying on manual approaches fo… ▽ More Cardiovascular magnetic resonance (CMR) imaging is a standard imaging modality for assessing cardiovascular diseases (CVDs), the leading cause of death globally. CMR enables accurate quantification of the cardiac chamber volume, ejection fraction and myocardial mass, providing information for diagnosis and monitoring of CVDs. However, for years, clinicians have been relying on manual approaches for CMR image analysis, which is time consuming and prone to subjective errors. It is a major clinical challenge to automatically derive quantitative and clinically relevant information from CMR images. Deep neural networks have shown a great potential in image pattern recognition and segmentation for a variety of tasks. Here we demonstrate an automated analysis method for CMR images, which is based on a fully convolutional network (FCN). The network is trained and evaluated on a large-scale dataset from the UK Biobank, consisting of 4,875 subjects with 93,500 pixelwise annotated images. The performance of the method has been evaluated using a number of technical metrics, including the Dice metric, mean contour distance and Hausdorff distance, as well as clinically relevant measures, including left ventricle (LV) end-diastolic volume (LVEDV) and end-systolic volume (LVESV), LV mass (LVM); right ventricle (RV) end-diastolic volume (RVEDV) and end-systolic volume (RVESV). By combining FCN with a large-scale annotated dataset, the proposed automated method achieves a high performance on par with human experts in segmenting the LV and RV on short-axis CMR images and the left atrium (LA) and right atrium (RA) on long-axis CMR images. △ Less

Submitted 22 May, 2018; v1 submitted 25 October, 2017; originally announced October 2017.

Comments: Accepted for publication by Journal of Cardiovascular Magnetic Resonance

Demonstration of a switchable dam** system to allow low-noise operation of high-Q low-mass suspension systems

Authors: Jan-Simon Hennig, Bryan W. Barr, Angus S. Bell, William Cunningham, Stefan L. Danilishin, Peter Dupej, Christian Graef, Sabina H. Huttner, Russell Jones, Sean S. Leavey, Daniela Pascucci, Martin Sinclair, Borja Sorazu, Andrew Spencer, Sebastian Steinlechner, Kenneth A. Strain, Jennifer Wright, Teng Zhang, Stefan Hild

Abstract: Low mass suspension systems with high-Q pendulum stages are used to enable quantum radiation pressure noise limited experiments. Utilising multiple pendulum stages with vertical blade springs and materials with high quality factors provides attenuation of seismic and thermal noise, however dam** of these high-Q pendulum systems in multiple degrees of freedom is essential for practical implementa… ▽ More Low mass suspension systems with high-Q pendulum stages are used to enable quantum radiation pressure noise limited experiments. Utilising multiple pendulum stages with vertical blade springs and materials with high quality factors provides attenuation of seismic and thermal noise, however dam** of these high-Q pendulum systems in multiple degrees of freedom is essential for practical implementation. Viscous dam** such as eddy-current dam** can be employed but introduces displacement noise from force noise due to thermal fluctuations in the dam** system. In this paper we demonstrate a passive dam** system with adjustable dam** strength as a solution for this problem that can be used for low mass suspension systems without adding additional displacement noise in science mode. We show a reduction of the dam** factor by a factor of 8 on a test suspension and provide a general optimisation for this system. △ Less

Submitted 25 October, 2017; v1 submitted 24 October, 2017; originally announced October 2017.

Comments: 5 pages, 5 figures

Journal ref: Phys. Rev. D 96, 122005 (2017)

Active tuning of high-Q dielectric metasurfaces

Authors: Matthew Parry, Andrei Komar, Ben Hopkins, Salvatore Campione, Sheng Liu, Andrey E. Miroshnichenko, John Nogan, Michael B. Sinclair, Igal Brener, Dragomir N. Neshev

Abstract: We demonstrate the active tuning of all-dielectric metasurfaces exhibiting high-quality factor (high-Q) resonances. The active control is provided by embedding the asymmetric silicon meta-atoms with liquid crystals, which allows the relative index of refraction to be controlled through heating. It is found that high quality factor resonances ($Q=270\pm30$) can be tuned over more than three resonan… ▽ More We demonstrate the active tuning of all-dielectric metasurfaces exhibiting high-quality factor (high-Q) resonances. The active control is provided by embedding the asymmetric silicon meta-atoms with liquid crystals, which allows the relative index of refraction to be controlled through heating. It is found that high quality factor resonances ($Q=270\pm30$) can be tuned over more than three resonance widths. Our results demonstrate the feasibility of using all-dielectric metasurfaces to construct tunable narrow-band filters. △ Less

Submitted 17 May, 2017; originally announced May 2017.

Comments: 4 pages, 6 figures

Journal ref: Appl. Phys. Lett. 111, 053102 (2017)

Resonantly enhanced second-harmonic generation using III-V semiconductor all-dielectric metasurfaces

Authors: Sheng Liu, Michael B. Sinclair, Sina Saravi, Gordon A. Keeler, Yuanmu Yang, John Reno, Gregory M. Peake, Frank Setzpfandt, Isabelle Staude, Thomas Pertsch, Igal Brener

Abstract: Nonlinear optical phenomena in nanostructured materials have been challenging our perceptions of nonlinear optical processes that have been explored since the invention of lasers. For example, the ability to control optical field confinement, enhancement, and scattering almost independently, allows nonlinear frequency conversion efficiencies to be enhanced by many orders of magnitude compared to b… ▽ More Nonlinear optical phenomena in nanostructured materials have been challenging our perceptions of nonlinear optical processes that have been explored since the invention of lasers. For example, the ability to control optical field confinement, enhancement, and scattering almost independently, allows nonlinear frequency conversion efficiencies to be enhanced by many orders of magnitude compared to bulk materials. Also, the subwavelength length scale renders phase matching issues irrelevant. Compared with plasmonic nanostructures, dielectric resonator metamaterials show great promise for enhanced nonlinear optical processes due to their larger mode volumes. Here, we present, for the first time, resonantly enhanced second-harmonic generation (SHG) using Gallium Arsenide (GaAs) based dielectric metasurfaces. Using arrays of cylindrical resonators we observe SHG enhancement factors as large as 104 relative to unpatterned GaAs. At the magnetic dipole resonance we measure an absolute nonlinear conversion efficiency of ~2X10^(-5) with ~3.4 GW/cm2 pump intensity. The polarization properties of the SHG reveal that both bulk and surface nonlinearities play important roles in the observed nonlinear process. △ Less

Submitted 15 August, 2016; v1 submitted 8 August, 2016; originally announced August 2016.

Broken symmetry dielectric resonators for high quality-factor Fano metasurfaces

Authors: Salvatore Campione, Sheng Liu, Lorena I. Basilio, Larry K. Warne, William L. Langston, Ting S. Luk, Joel R. Wendt, John L. Reno, Gordon A. Keeler, Igal Brener, Michael B. Sinclair

Abstract: We present a new approach to dielectric metasurface design that relies on a single resonator per unit cell and produces robust, high quality-factor Fano resonances. Our approach utilizes symmetry breaking of highly symmetric resonator geoemetries, such as cubes, to induce couplings between the otherwise orthogonal resonator modes. In particular, we design perturbations that couple "bright" dipole… ▽ More We present a new approach to dielectric metasurface design that relies on a single resonator per unit cell and produces robust, high quality-factor Fano resonances. Our approach utilizes symmetry breaking of highly symmetric resonator geoemetries, such as cubes, to induce couplings between the otherwise orthogonal resonator modes. In particular, we design perturbations that couple "bright" dipole modes to "dark" dipole modes whose radiative decay is suppressed by local field effects in the array. Our approach is widely scalable from the near-infrared to radio frequencies. We first unravel the Fano resonance behavior through numerical simulations of a germanium resonator-based metasurface that achieved a quality-factor of ~1300 at ~10.8 um. Then, we present two experimental demonstrations operating in the near-infrared (~1 um): a silicon-based implementation that achieved a quality-factor of ~350; and a gallium arsenide-based structure that achieves a quality-factor of ~600 - the highest near-infrared quality-factor experimentally demonstrated to date with this kind of metasurfaces. Importantly, large electromagnetic field enhancements appear within the resonators at the Fano resonant frequencies. We envision that combining high-quality factor, high field enhancement resonances with nonlinear and active/gain materials such as gallium arsenide will lead to new classes of active optical devices. △ Less

Submitted 21 July, 2016; originally announced July 2016.

III-V semiconductor nano-resonators-a new strategy for passive, active, and nonlinear all-dielectric metamaterials

Authors: Sheng Liu, Gordon A. Keeler, John L. Reno, Michael B. Sinclair, Igal Brener

Abstract: Metamaterials comprising assemblies of dielectric resonators have attracted much attention due to their low intrinsic loss and isotropic optical response. In particular, metasurfaces made from silicon dielectric resonators have shown desirable behaviors such as efficient nonlinear optical conversion, spectral filtering and advanced wave-front engineering. To further explore the potential of dielec… ▽ More Metamaterials comprising assemblies of dielectric resonators have attracted much attention due to their low intrinsic loss and isotropic optical response. In particular, metasurfaces made from silicon dielectric resonators have shown desirable behaviors such as efficient nonlinear optical conversion, spectral filtering and advanced wave-front engineering. To further explore the potential of dielectric metamaterials, we present all-dielectric metamaterials fabricated from epitaxially grown III-V semiconductors that can exploit the high second-order optical susceptibilities of III-V semiconductors, as well as the ease of monolithically integrating active/gain media. Specifically, we create GaAs nano-resonators using a selective wet oxidation process that forms a low refractive index AlGaO (n~1.6) under layer similar to silicon dielectric resonators formed using silicon-on-insulator wafers. We further use the same fabrication processes to demonstrate multilayer III-V dielectric resonator arrays that provide us with new degrees of freedom in device engineering. For these arrays, we experimentally measure ~100% reflectivity over a broad spectral range. We envision that all-dielectric III-V semiconductor metamaterials will open up new avenues for passive, active and nonlinear all dielectric metamaterials △ Less

Submitted 1 May, 2016; originally announced May 2016.

Structural properties of close II$_1$ factors

Authors: Jan Cameron, Erik Christensen, Allan M. Sinclair, Roger R. Smith, Stuart White, Alan D. Wiggins

Abstract: We show that a number of key structural properties transfer between sufficiently close II$_1$ factors, including solidity, strong solidity, uniqueness of Cartan masas and property $Γ$. We also examine II$_1$ factors close to tensor product factors, showing that such factors also factorise as a tensor product in a fashion close to the original. We show that a number of key structural properties transfer between sufficiently close II$_1$ factors, including solidity, strong solidity, uniqueness of Cartan masas and property $Γ$. We also examine II$_1$ factors close to tensor product factors, showing that such factors also factorise as a tensor product in a fashion close to the original. △ Less

Submitted 31 May, 2016; v1 submitted 19 April, 2016; originally announced April 2016.

Comments: Minor typos corrected. Munster J. Math., to appear. 16 pages, section 2 contains material from arXiv:1209.4116v2 which was removed from the final published version (v3)

Report number: CPH-SYM-00; SOAR-GMJT-01 MSC Class: 46L10

Dynamic Endpoint Object Conveyance Using a Large-Scale Actuator Network

Authors: Martin Sinclair, Ioannis Raptis

Abstract: Large-Scale Actuator Networks (LSAN) are a rapidly growing class of electromechanical systems. A prime application of LSANs in the industrial sector is distributed manipulation. LSAN's are typically implemented using: vibrating plates, air jets, and mobile multi-robot teams. This paper investigates a surface capable of morphing its shape using an array of linear actuators to impose two dimensional… ▽ More Large-Scale Actuator Networks (LSAN) are a rapidly growing class of electromechanical systems. A prime application of LSANs in the industrial sector is distributed manipulation. LSAN's are typically implemented using: vibrating plates, air jets, and mobile multi-robot teams. This paper investigates a surface capable of morphing its shape using an array of linear actuators to impose two dimensional translational movement on a set of objects. The collective nature of the actuator network overcomes the limitations of the single Degree of Freedom (DOF) manipulators, and forms a complex topography to convey multiple objects to a reference location. A derivation of the kinematic constraints and limitations of an arbitrary multi-cell surface is provided. These limitations determine the allowable actuator alignments when configuring the surface. A fusion of simulation and practical results demonstrate the advantages of using this technology over static feeders. △ Less

Submitted 15 April, 2016; originally announced April 2016.

Realizing high-quality, ultra-large momentum states using semiconductor hyperbolic metamaterials

Authors: Salvatore Campione, Sheng Liu, Ting S. Luk, Michael B. Sinclair

Abstract: We employ both the effective medium approximation (EMA) and Bloch theory to compare the dispersion properties of semiconductor hyperbolic metamaterials (SHMs) at mid-infrared frequencies and metallic hyperbolic metamaterials (MHMs) at visible frequencies. This analysis reveals the conditions under which the EMA can be safely applied for both MHMs and SHMs. We find that the combination of precise n… ▽ More We employ both the effective medium approximation (EMA) and Bloch theory to compare the dispersion properties of semiconductor hyperbolic metamaterials (SHMs) at mid-infrared frequencies and metallic hyperbolic metamaterials (MHMs) at visible frequencies. This analysis reveals the conditions under which the EMA can be safely applied for both MHMs and SHMs. We find that the combination of precise nanoscale layering and the longer infrared operating wavelengths puts the SHMs well within the effective medium limit and, in contrast to MHMs, allows the attainment of very high photon momentum states. In addition, SHMs allow for new phenomena such as ultrafast creation of the hyperbolic manifold through optical pum**. In particular, we examine the possibility of achieving ultrafast topological transitions through optical pum** which can photo-dope appropriately designed quantum wells on the femtosecond time scale. △ Less

Submitted 20 March, 2015; originally announced March 2015.

Comments: 8 pages, 6 figures

Journal ref: J. Opt. Soc. Am. B 32(09), 1809-1815 (2015)