-
Adaptive Inference: Theoretical Limits and Unexplored Opportunities
Authors:
Soheil Hor,
Ying Qian,
Mert Pilanci,
Amin Arbabian
Abstract:
This paper introduces the first theoretical framework for quantifying the efficiency and performance gain opportunity size of adaptive inference algorithms. We provide new approximate and exact bounds for the achievable efficiency and performance gains, supported by empirical evidence demonstrating the potential for 10-100x efficiency improvements in both Computer Vision and Natural Language Proce…
▽ More
This paper introduces the first theoretical framework for quantifying the efficiency and performance gain opportunity size of adaptive inference algorithms. We provide new approximate and exact bounds for the achievable efficiency and performance gains, supported by empirical evidence demonstrating the potential for 10-100x efficiency improvements in both Computer Vision and Natural Language Processing tasks without incurring any performance penalties. Additionally, we offer insights on improving achievable efficiency gains through the optimal selection and design of adaptive inference state spaces.
△ Less
Submitted 6 February, 2024;
originally announced February 2024.
-
Sense, Predict, Adapt, Repeat: A Blueprint for Design of New Adaptive AI-Centric Sensing Systems
Authors:
Soheil Hor,
Amin Arbabian
Abstract:
As Moore's Law loses momentum, improving size, performance, and efficiency of processors has become increasingly challenging, ending the era of predictable improvements in hardware performance. Meanwhile, the widespread incorporation of high-definition sensors in consumer devices and autonomous technologies has fueled a significant upsurge in sensory data. Current global trends reveal that the vol…
▽ More
As Moore's Law loses momentum, improving size, performance, and efficiency of processors has become increasingly challenging, ending the era of predictable improvements in hardware performance. Meanwhile, the widespread incorporation of high-definition sensors in consumer devices and autonomous technologies has fueled a significant upsurge in sensory data. Current global trends reveal that the volume of generated data already exceeds human consumption capacity, making AI algorithms the primary consumers of data worldwide. To address this, a novel approach to designing AI-centric sensing systems is needed that can bridge the gap between the increasing capabilities of high-definition sensors and the limitations of AI processors. This paper provides an overview of efficient sensing and perception methods in both AI and sensing domains, emphasizing the necessity of co-designing AI algorithms and sensing systems for dynamic perception. The proposed approach involves a framework for designing and analyzing dynamic AI-in-the-loop sensing systems, suggesting a fundamentally new method for designing adaptive sensing systems through inference-time AI-to-sensor feedback and end-to-end efficiency and performance optimization.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Communication with Crystal-Free Radios
Authors:
Dor Shaviv,
Ayfer Özgür,
Amin Arbabian
Abstract:
We consider a communication channel where there is no common clock between the transmitter and the receiver. This is motivated by the recent interest in building system-on-chip radios for Internet of Things applications, which cannot rely on crystal oscillators for accurate timing. We identify two types of clock uncertainty in such systems: timing jitter, which occurs at a time scale faster than t…
▽ More
We consider a communication channel where there is no common clock between the transmitter and the receiver. This is motivated by the recent interest in building system-on-chip radios for Internet of Things applications, which cannot rely on crystal oscillators for accurate timing. We identify two types of clock uncertainty in such systems: timing jitter, which occurs at a time scale faster than the communication duration (or equivalently blocklength); and clock drift, which occurs at a slower time scale. We study the zero-error capacity under both types of timing imperfections, and obtain optimal zero-error codes for some cases. Our results show that, as opposed to common practice, in the presence of clock drift it is highly suboptimal to try to learn and track the clock frequency at the receiver; rather, one can design codes that come close to the performance of perfectly synchronous communication systems without any clock synchronization at the receiver.
△ Less
Submitted 21 May, 2018;
originally announced May 2018.
-
Geometry-constrained Degrees of Freedom Analysis for Imaging Systems: Monostatic and Multistatic
Authors:
Babak Mamandipoor,
Amin Arbabian,
Upamanyu Madhow
Abstract:
In this paper, we develop a theoretical framework for analyzing the measurable information content of an unknown scene through an active electromagnetic imaging array. We consider monostatic and multistatic array architectures in a one-dimensional setting. Our main results include the following: (a) we introduce the space-bandwidth product (SBP), and show that, under the Born approximation, it pro…
▽ More
In this paper, we develop a theoretical framework for analyzing the measurable information content of an unknown scene through an active electromagnetic imaging array. We consider monostatic and multistatic array architectures in a one-dimensional setting. Our main results include the following: (a) we introduce the space-bandwidth product (SBP), and show that, under the Born approximation, it provides an accurate prediction of the number of the degrees of freedom (DoF) as constrained by the geometry of the scene and the imaging system; (b) we show that both monostatic and multistatic architectures have the same number of DoF; (c) we show that prior DoF analysis based on the more restrictive Fresnel approximation are obtained by specializing our results; (d) we investigate matched-filter (back-propagation) and pseudoinverse image reconstruction schemes, and analyze the achievable resolution through these methods. Our analytical framework opens up new avenues to investigate image formation techniques that aim to reconstruct the reflectivity function of the scene by solving an inverse scattering problem, and provides insights on achievable resolution. For example, we show that matched-filter reconstruction leads to a significant resolution loss for multistatic architectures.
△ Less
Submitted 4 August, 2018; v1 submitted 9 November, 2017;
originally announced November 2017.
-
Exploiting Spatial Degrees of Freedom for High Data Rate Ultrasound Communication with Implantable Devices
Authors:
Max L. Wang,
Amin Arbabian
Abstract:
We propose and demonstrate an ultrasonic communication link using spatial degrees of freedom to increase data rates for deeply implantable medical devices. Low attenuation and millimeter wavelengths make ultrasound an ideal communication medium for miniaturized low-power implants. While small spectral bandwidth has drastically limited achievable data rates in conventional ultrasonic implants, larg…
▽ More
We propose and demonstrate an ultrasonic communication link using spatial degrees of freedom to increase data rates for deeply implantable medical devices. Low attenuation and millimeter wavelengths make ultrasound an ideal communication medium for miniaturized low-power implants. While small spectral bandwidth has drastically limited achievable data rates in conventional ultrasonic implants, large spatial bandwidth can be exploited by using multiple transducers in a multiple-input/multiple-output system to provide spatial multiplexing gain without additional power, larger bandwidth, or complicated packaging. We experimentally verify the communication link in mineral oil with a transmitter and receiver 5 cm apart, each housing two custom-designed mm-sized piezoelectric transducers operating at the same frequency. Two streams of data modulated with quadrature phase-shift keying at 125 kbps are simultaneously transmitted and received on both channels, effectively doubling the data rate to 250 kbps with a measured bit error rate below 1e-4. We also evaluate the performance and robustness of the channel separation network by testing the communication link after introducing position offsets. These results demonstrate the potential of spatial multiplexing to enable more complex implant applications requiring higher data rates.
△ Less
Submitted 16 February, 2017;
originally announced February 2017.
