-
The "Seen but Unnoticed" Vocabulary of Natural Touch: Revolutionizing Direct Interaction with Our Devices and One Another (UIST 2021 Vision)
Authors:
Ken Hinckley
Abstract:
This UIST Vision argues that "touch" input and interaction remains in its infancy when viewed in context of the seen but unnoticed vocabulary of natural human behaviors, activity, and environments that surround direct interaction with displays. Unlike status-quo touch interaction -- a shadowplay of fingers on a single screen -- I argue that our perspective of direct interaction should encompass th…
▽ More
This UIST Vision argues that "touch" input and interaction remains in its infancy when viewed in context of the seen but unnoticed vocabulary of natural human behaviors, activity, and environments that surround direct interaction with displays. Unlike status-quo touch interaction -- a shadowplay of fingers on a single screen -- I argue that our perspective of direct interaction should encompass the full rich context of individual use (whether via touch, sensors, or in combination with other modalities), as well as collaborative activity where people are engaged in local (co-located), remote (tele-present), and hybrid work. We can further view touch through the lens of the "Society of Devices," where each person's activities span many complementary, oft-distinct devices that offer the right task affordance (input modality, screen size, aspect ratio, or simply a distinct surface with dedicated purpose) at the right place and time. While many hints of this vision already exist (see references), I speculate that a comprehensive program of research to systematically inventory, sense, and design interactions around such human behaviors and activities -- and that fully embrace touch as a multi-modal, multi-sensor, multi-user, and multi-device construct -- could revolutionize both individual and collaborative interaction with technology.
△ Less
Submitted 5 October, 2023;
originally announced October 2023.
-
Spitzer Follow-up of Extremely Cold Brown Dwarfs Discovered by the Backyard Worlds: Planet 9 Citizen Science Project
Authors:
Aaron M. Meisner,
Jacqueline K. Faherty,
J. Davy Kirkpatrick,
Adam C. Schneider,
Dan Caselden,
Jonathan Gagne,
Marc J. Kuchner,
Adam J. Burgasser,
Sarah L. Casewell,
John H. Debes,
Etienne Artigau,
Daniella C. Bardalez Gagliuffi,
Sarah E. Logsdon,
Rocio Kiman,
Katelyn Allers,
Chih-Chun Hsu,
John P. Wisniewski,
Michaela B. Allen,
Paul Beaulieu,
Guillaume Colin,
Hugo A. Durantini Luca,
Sam Goodman,
Leopold Gramaize,
Leslie K. Hamlet,
Ken Hinckley
, et al. (18 additional authors not shown)
Abstract:
We present Spitzer follow-up imaging of 95 candidate extremely cold brown dwarfs discovered by the Backyard Worlds: Planet 9 citizen science project, which uses visually perceived motion in multi-epoch WISE images to identify previously unrecognized substellar neighbors to the Sun. We measure Spitzer [3.6]-[4.5] color to phototype our brown dwarf candidates, with an emphasis on pinpointing the col…
▽ More
We present Spitzer follow-up imaging of 95 candidate extremely cold brown dwarfs discovered by the Backyard Worlds: Planet 9 citizen science project, which uses visually perceived motion in multi-epoch WISE images to identify previously unrecognized substellar neighbors to the Sun. We measure Spitzer [3.6]-[4.5] color to phototype our brown dwarf candidates, with an emphasis on pinpointing the coldest and closest Y dwarfs within our sample. The combination of WISE and Spitzer astrometry provides quantitative confirmation of the transverse motion of 75 of our discoveries. Nine of our motion-confirmed objects have best-fit linear motions larger than 1"/yr; our fastest-moving discovery is WISEA J155349.96+693355.2 (total motion ~2.15"/yr), a possible T type subdwarf. We also report a newly discovered wide-separation (~400 AU) T8 comoving companion to the white dwarf LSPM J0055+5948 (the fourth such system to be found), plus a candidate late T companion to the white dwarf LSR J0002+6357 at 5.5' projected separation (~8,700 AU if associated). Among our motion-confirmed targets, five have Spitzer colors most consistent with spectral type Y. Four of these five have exceptionally red Spitzer colors suggesting types of Y1 or later, adding considerably to the small sample of known objects in this especially valuable low-temperature regime. Our Y dwarf candidates begin bridging the gap between the bulk of the Y dwarf population and the coldest known brown dwarf.
△ Less
Submitted 14 August, 2020;
originally announced August 2020.
-
InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices
Authors:
Arjun Srinivasan,
Bongshin Lee,
Nathalie Henry Riche,
Steven M. Drucker,
Ken Hinckley
Abstract:
While tablet devices are a promising platform for data visualization, supporting consistent interactions across different types of visualizations on tablets remains an open challenge. In this paper, we present multimodal interactions that function consistently across different visualizations, supporting common operations during visual data analysis. By considering standard interface elements (e.g.…
▽ More
While tablet devices are a promising platform for data visualization, supporting consistent interactions across different types of visualizations on tablets remains an open challenge. In this paper, we present multimodal interactions that function consistently across different visualizations, supporting common operations during visual data analysis. By considering standard interface elements (e.g., axes, marks) and grounding our design in a set of core concepts including operations, parameters, targets, and instruments, we systematically develop interactions applicable to different visualization types. To exemplify how the proposed interactions collectively facilitate data exploration, we employ them in a tablet-based system, InChorus that supports pen, touch, and speech input. Based on a study with 12 participants performing replication and fact-checking tasks with InChorus, we discuss how participants adapted to using multimodal input and highlight considerations for future multimodal visualization systems.
△ Less
Submitted 17 January, 2020;
originally announced January 2020.