-
Adaptive Sampling for Discovery
Authors:
Zi** Xu,
Eunjae Shim,
Ambuj Tewari,
Paul Zimmerman
Abstract:
In this paper, we study a sequential decision-making problem, called Adaptive Sampling for Discovery (ASD). Starting with a large unlabeled dataset, algorithms for ASD adaptively label the points with the goal to maximize the sum of responses.
This problem has wide applications to real-world discovery problems, for example drug discovery with the help of machine learning models. ASD algorithms f…
▽ More
In this paper, we study a sequential decision-making problem, called Adaptive Sampling for Discovery (ASD). Starting with a large unlabeled dataset, algorithms for ASD adaptively label the points with the goal to maximize the sum of responses.
This problem has wide applications to real-world discovery problems, for example drug discovery with the help of machine learning models. ASD algorithms face the well-known exploration-exploitation dilemma. The algorithm needs to choose points that yield information to improve model estimates but it also needs to exploit the model. We rigorously formulate the problem and propose a general information-directed sampling (IDS) algorithm. We provide theoretical guarantees for the performance of IDS in linear, graph and low-rank models. The benefits of IDS are shown in both simulation experiments and real-data experiments for discovering chemical reaction conditions.
△ Less
Submitted 2 January, 2023; v1 submitted 29 May, 2022;
originally announced May 2022.
-
Tunable narrow linewidth chip-scale mid-IR laser
Authors:
Euijae Shim,
Andres Gil-Molina,
Ohad Westreich,
Yamac Dikmelik,
Kevin Lascola,
Alexander L. Gaeta,
Michal Lipson
Abstract:
Portable mid-infrared (mid-IR) spectroscopy and sensing applications require widely tunable, narrow linewidth, chip-scale, single-mode sources without sacrificing significant output power. However, no such lasers have been demonstrated beyond 3 $μ$m due to the challenge of building tunable, high quality-factor (Q) on-chip cavities. We demonstrate a tunable, single-mode mid-IR laser at 3.4 $μ$m usi…
▽ More
Portable mid-infrared (mid-IR) spectroscopy and sensing applications require widely tunable, narrow linewidth, chip-scale, single-mode sources without sacrificing significant output power. However, no such lasers have been demonstrated beyond 3 $μ$m due to the challenge of building tunable, high quality-factor (Q) on-chip cavities. We demonstrate a tunable, single-mode mid-IR laser at 3.4 $μ$m using a high-Q silicon microring cavity with integrated heaters and a multi-mode Interband Cascade Laser (ICL). We show that the multiple longitudinal modes of an ICL collapse into a single frequency via self-injection locking with an output power of 0.4 mW and achieve an oxide-clad high confinement waveguide microresonator with a loaded Q of $2.8\times 10^5$. Using integrated microheaters, our laser exhibits a wide tuning range of 54 nm at 3.4 $μ$m with 3 dB output power variation. We further measure an upper-bound effective linewidth of 9.1 MHz from the locked laser using a scanning Fabry-Perot interferometer. Our design of a single-mode laser based on a tunable high-Q microresonator can be expanded to quantum-cascade lasers at higher wavelengths and lead to the development of compact, portable, high-performance mid-IR sensors for spectroscopic and sensing applications.
△ Less
Submitted 26 July, 2021;
originally announced July 2021.
-
Scalable graphene platform for Tbits/s data transmission
Authors:
Brian S. Lee,
Alexandre P. Freitas,
Andres Gil-Molina,
Euijae Shim,
Yibo Zhu,
James Hone,
Michal Lipson
Abstract:
To date, no electro-optic platform enables devices with high bandwidth, small footprint, and low power consumption, while also enabling mass production. Here we demonstrate high-yield fabrication of high-speed graphene electro-absorption modulators using CVD-grown graphene. We minimize variation in device performance from graphene inhomogeneity over large area by engineering graphene-mode overlap…
▽ More
To date, no electro-optic platform enables devices with high bandwidth, small footprint, and low power consumption, while also enabling mass production. Here we demonstrate high-yield fabrication of high-speed graphene electro-absorption modulators using CVD-grown graphene. We minimize variation in device performance from graphene inhomogeneity over large area by engineering graphene-mode overlap and device capacitance to ensure high extinction ratio. We fabricate an 8 mm x 1 mm chip with 32 graphene electro-absorption modulators and measure 94% yield with bit error rate below the hard-decision forward error correction limit at 7 Gbits/s, amounting to a total aggregated data rate of 210 Gbits/s. Monte Carlo simulations show that data rates > 0.6 Tbits/s are within reach by further optimizing device cross-section, paving the way for graphene-based ultra-high data rate applications.
△ Less
Submitted 12 November, 2020;
originally announced November 2020.
-
LCP: A Low-Communication Parallelization Method for Fast Neural Network Inference in Image Recognition
Authors:
Ramyad Hadidi,
Bahar Asgari,
Jiashen Cao,
Younmin Bae,
Da Eun Shim,
Hyojong Kim,
Sung-Kyu Lim,
Michael S. Ryoo,
Hyesoon Kim
Abstract:
Deep neural networks (DNNs) have inspired new studies in myriad edge applications with robots, autonomous agents, and Internet-of-things (IoT) devices. However, performing inference of DNNs in the edge is still a severe challenge, mainly because of the contradiction between the intensive resource requirements of DNNs and the tight resource availability in several edge domains. Further, as communic…
▽ More
Deep neural networks (DNNs) have inspired new studies in myriad edge applications with robots, autonomous agents, and Internet-of-things (IoT) devices. However, performing inference of DNNs in the edge is still a severe challenge, mainly because of the contradiction between the intensive resource requirements of DNNs and the tight resource availability in several edge domains. Further, as communication is costly, taking advantage of other available edge devices by using data- or model-parallelism methods is not an effective solution. To benefit from available compute resources with low communication overhead, we propose the first DNN parallelization method for reducing the communication overhead in a distributed system. We propose a low-communication parallelization (LCP) method in which models consist of several almost-independent and narrow branches. LCP offers close-to-minimum communication overhead with better distribution and parallelization opportunities while significantly reducing memory footprint and computation compared to data- and model-parallelism methods. We deploy LCP models on three distributed systems: AWS instances, Raspberry Pis, and PYNQ boards. We also evaluate the performance of LCP models on a customized hardware (tailored for low latency) implemented on a small edge FPGA and as a 16mW 0.107mm2 ASIC @7nm chip. LCP models achieve a maximum and average speedups of 56x and 7x, compared to the originals, which could be improved by up to an average speedup of 33x by incorporating common optimizations such as pruning and quantization.
△ Less
Submitted 17 November, 2020; v1 submitted 13 March, 2020;
originally announced March 2020.
-
Vortex: OpenCL Compatible RISC-V GPGPU
Authors:
Fares Elsabbagh,
Blaise Tine,
Priyadarshini Roshan,
Ethan Lyons,
Euna Kim,
Da Eun Shim,
Lingjun Zhu,
Sung Kyu Lim,
Hyesoon kim
Abstract:
The current challenges in technology scaling are pushing the semiconductor industry towards hardware specialization, creating a proliferation of heterogeneous systems-on-chip, delivering orders of magnitude performance and power benefits compared to traditional general-purpose architectures. This transition is getting a significant boost with the advent of RISC-V with its unique modular and extens…
▽ More
The current challenges in technology scaling are pushing the semiconductor industry towards hardware specialization, creating a proliferation of heterogeneous systems-on-chip, delivering orders of magnitude performance and power benefits compared to traditional general-purpose architectures. This transition is getting a significant boost with the advent of RISC-V with its unique modular and extensible ISA, allowing a wide range of low-cost processor designs for various target applications. In addition, OpenCL is currently the most widely adopted programming framework for heterogeneous platforms available on mainstream CPUs, GPUs, as well as FPGAs and custom DSP. In this work, we present Vortex, a RISC-V General-Purpose GPU that supports OpenCL. Vortex implements a SIMT architecture with a minimal ISA extension to RISC-V that enables the execution of OpenCL programs. We also extended OpenCL runtime framework to use the new ISA. We evaluate this design using 15nm technology. We also show the performance and energy numbers of running them with a subset of benchmarks from the Rodinia Benchmark suite.
△ Less
Submitted 27 February, 2020;
originally announced February 2020.
-
A Reconfigurable Nanophotonics Platform for Sub-Millisecond, Deep Brain Neural Stimulation
Authors:
Aseema Mohanty,
Qian Li,
Mohammad Amin Tadayon,
Gaurang Bhatt,
Euijae Shim,
Xingchen Ji,
Jaime Cardenas,
Steven A. Miller,
Adam Kepecs,
Michal Lipson
Abstract:
Nanophotonics provides the ability to rapidly and precisely reconfigure light beams on a compact platform. Infrared nanophotonic devices are widely used in data communications to overcome traditional bandwidth limitations of electrical interconnects. Nanophotonic devices also hold promise for use in biological applications that require visible light, but this has remained technically elusive due t…
▽ More
Nanophotonics provides the ability to rapidly and precisely reconfigure light beams on a compact platform. Infrared nanophotonic devices are widely used in data communications to overcome traditional bandwidth limitations of electrical interconnects. Nanophotonic devices also hold promise for use in biological applications that require visible light, but this has remained technically elusive due to the challenges of reconfiguring and guiding light at these smaller dimensions. In neuroscience, for example, there is a need for implantable optical devices to optogenetically stimulate neurons across deep brain regions with the speed and precision matching state-of-the-art recording probes. Here we demonstrate the first platform for reconfigurable nanophotonic devices in the visible wavelength range and show its application in vivo in the brain. We demonstrate an implantable probe endowed with the ability to rapidly switch and route multiple optical beams using a nanoscale switching network. Each switch consists of a silicon nitride waveguide structure that can be reconfigured by electrically tuning the phase of light and is designed for robustness to fabrication variation, enabling scalable devices. By implanting our probe in mouse visual cortex, we demonstrate in vivo the ability to stimulate identified sets of neurons across layers to produce multi-neuron spike patterns and record them simultaneously with sub-millisecond temporal precision. This nanophotonic platform can be scaled up and integrated with high-density neural recording technologies, opening the door to implantable probe technologies that are able to simultaneously record and stimulate the activity of large neural populations at distant regions of the brain with sub-millisecond precision. We expect this platform will enable researchers to gain a deeper understanding into the spatio-temporal precision of the neural code.
△ Less
Submitted 14 May, 2018;
originally announced May 2018.
-
Pro-arrhythmogenic effects of heterogeneous tissue curvature: A suggestion for role of left atrial appendage in atrial fibrillation
Authors:
Jun-Seop Song,
Jaehyeok Kim,
Byounghyun Lim,
Young-Seon Lee,
Minki Hwang,
Boyoung Joung,
Eun Bo Shim,
Hui-Nam Pak
Abstract:
Background: The arrhythmogenic role of atrial complex morphology has not yet been clearly elucidated. We hypothesized that bumpy tissue geometry can induce action potential duration (APD) dispersion and wavebreak in atrial fibrillation (AF).
Methods and Results: We simulated 2D-bumpy atrial model by varying the degree of bumpiness, and 3D-left atrial (LA) models integrated by LA computed tomogra…
▽ More
Background: The arrhythmogenic role of atrial complex morphology has not yet been clearly elucidated. We hypothesized that bumpy tissue geometry can induce action potential duration (APD) dispersion and wavebreak in atrial fibrillation (AF).
Methods and Results: We simulated 2D-bumpy atrial model by varying the degree of bumpiness, and 3D-left atrial (LA) models integrated by LA computed tomographic (CT) images taken from 14 patients with persistent AF. We also analyzed wave-dynamic parameters with bipolar electrograms during AF and compared them with LA-CT geometry in 30 patients with persistent AF. In 2D-bumpy model, APD dispersion increased (p<0.001) and wavebreak occurred spontaneously when the surface bumpiness was higher, showing phase transition-like behavior (p<0.001). Bumpiness gradient 2D-model showed that spiral wave drifted in the direction of higher bumpiness, and phase singularity (PS) points were mostly located in areas with higher bumpiness. In 3D-LA model, PS density was higher in LA appendage (LAA) compared to other LA parts (p<0.05). In 30 persistent AF patients, the surface bumpiness of LAA was 5.8-times that of other LA parts (p<0.001), and exceeded critical bumpiness to induce wavebreak. Wave dynamics complexity parameters were consistently dominant in LAA (p<0.001).
Conclusion: The bumpy tissue geometry promotes APD dispersion, wavebreak, and spiral wave drift in in silico human atrial tissue, and corresponds to clinical electro-anatomical maps.
△ Less
Submitted 14 September, 2018; v1 submitted 5 March, 2018;
originally announced March 2018.
-
Analyzing the Dynamic Relationship between Tumor Growth and Angiogenesis in a Two Dimensional Finite Element Model
Authors:
Eun Bo Shim,
Yoo Seok Kim,
Thomas S. Deisboeck
Abstract:
Employing a novel two-dimensional computational model we have simulated the feedback between angiogenesis and tumor growth dynamics. Analyzing vessel formation and elongation towards the concentration gradient of the tumor-derived angiogenetic basic fibroblast growth factor, bFGF, we assumed that prior to the blood vessels reaching the tumor surface, the resulting pattern of tumor growth is symm…
▽ More
Employing a novel two-dimensional computational model we have simulated the feedback between angiogenesis and tumor growth dynamics. Analyzing vessel formation and elongation towards the concentration gradient of the tumor-derived angiogenetic basic fibroblast growth factor, bFGF, we assumed that prior to the blood vessels reaching the tumor surface, the resulting pattern of tumor growth is symmetric, circular with a common center point. However, after the vessels reach the tumor surface, we assumed that the growth rate of that particular cancer region is accelerated compared to the tumor surface section that lacks neo-vascularization. Therefore, the resulting asymmetric tumor growth pattern is biased towards the site of the nourishing vessels. The simulation results show over time an increase in vessel density, a decrease in vessel branching length, and an increase in fracticality of the vascular branching architecture. Interestingly, over time the fractal dimension displayed a sigmoidal pattern with a reduced rate increase at earlier and later tumor growth stages due to distinct characteristics in vessel length and density. The finding that, at later stages, higher vascular fracticality resulted in a marked increase of tumor slice volume provides further in silico evidence for a functional impact of vascular patterns on cancer growth.
△ Less
Submitted 6 March, 2007;
originally announced March 2007.