-
Gated Compression Layers for Efficient Always-On Models
Authors:
Haiguang Li,
Trausti Thormundsson,
Ivan Poupyrev,
Nicholas Gillian
Abstract:
Mobile and embedded machine learning developers frequently have to compromise between two inferior on-device deployment strategies: sacrifice accuracy and aggressively shrink their models to run on dedicated low-power cores; or sacrifice battery by running larger models on more powerful compute cores such as neural processing units or the main application processor. In this paper, we propose a nov…
▽ More
Mobile and embedded machine learning developers frequently have to compromise between two inferior on-device deployment strategies: sacrifice accuracy and aggressively shrink their models to run on dedicated low-power cores; or sacrifice battery by running larger models on more powerful compute cores such as neural processing units or the main application processor. In this paper, we propose a novel Gated Compression layer that can be applied to transform existing neural network architectures into Gated Neural Networks. Gated Neural Networks have multiple properties that excel for on-device use cases that help significantly reduce power, boost accuracy, and take advantage of heterogeneous compute cores. We provide results across five public image and audio datasets that demonstrate the proposed Gated Compression layer effectively stops up to 96% of negative samples, compresses 97% of positive samples, while maintaining or improving model accuracy.
△ Less
Submitted 15 March, 2023;
originally announced March 2023.
-
Fields: Towards Socially Intelligent Spatial Computing
Authors:
Leonardo Giusti,
Lauren Bedal,
Eiji Hayashi,
** Yamanaka,
Timi Oyedeji,
Colin Bay,
Ivan Poupyrev
Abstract:
In our everyday life, we intuitively use space to regulate our social interactions. When we want to talk to someone, we approach them; if someone joins the conversation, we adjust our bodies to make space for them. In contrast, devices are not as considerate: they interrupt us, require us to input commands, and compete for our attention. In this paper, we introduce Fields, a design framework for u…
▽ More
In our everyday life, we intuitively use space to regulate our social interactions. When we want to talk to someone, we approach them; if someone joins the conversation, we adjust our bodies to make space for them. In contrast, devices are not as considerate: they interrupt us, require us to input commands, and compete for our attention. In this paper, we introduce Fields, a design framework for ubiquitous computing that informs the design of connected products with social grace. Inspired by interactionist theories on social interaction, Fields builds on the idea that the physical space we share with computers can be an interface to mediate interactions. It defines a generalized approach to spatial interactions, and a set of interaction patterns that can be adapted to different ubiquitous computing systems. We investigated its value by implementing it in a set of prototypes and evaluating it in a lab setting.
△ Less
Submitted 17 November, 2022;
originally announced November 2022.
-
New interfaces for musical expression
Authors:
Ivan Poupyrev,
Michael J. Lyons,
Sidney Fels,
Tina Blaine
Abstract:
The rapid evolution of electronics, digital media, advanced materials, and other areas of technology, is opening up unprecedented opportunities for musical interface inventors and designers. The possibilities afforded by these new technologies carry with them the challenges of a complex and often confusing array of choices for musical composers and performers. New musical technologies are at least…
▽ More
The rapid evolution of electronics, digital media, advanced materials, and other areas of technology, is opening up unprecedented opportunities for musical interface inventors and designers. The possibilities afforded by these new technologies carry with them the challenges of a complex and often confusing array of choices for musical composers and performers. New musical technologies are at least partly responsible for the current explosion of new musical forms, some of which are controversial and challenge traditional definitions of music. Alternative musical controllers, currently the leading edge of the ongoing dialogue between technology and musical culture, involve many of the issues covered at past CHI meetings. This workshop brings together interface experts interested in musical controllers and musicians and composers involved in the development of new musical interfaces.
△ Less
Submitted 27 October, 2020;
originally announced October 2020.
