-
Discovering a change point and piecewise linear structure in a time series of organoid networks via the iso-mirror
Authors:
Tianyi Chen,
Youngser Park,
Ali Saad-Eldin,
Zachary Lubberts,
Avanti Athreya,
Benjamin D. Pedigo,
Joshua T. Vogelstein,
Francesca Puppo,
Gabriel A. Silva,
Alysson R. Muotri,
Weiwei Yang,
Christopher M. White,
Carey E. Priebe
Abstract:
Recent advancements have been made in the development of cell-based in-vitro neuronal networks, or organoids. In order to better understand the network structure of these organoids, a super-selective algorithm has been proposed for inferring the effective connectivity networks from multi-electrode array data. In this paper, we apply a novel statistical method called spectral mirror estimation to t…
▽ More
Recent advancements have been made in the development of cell-based in-vitro neuronal networks, or organoids. In order to better understand the network structure of these organoids, a super-selective algorithm has been proposed for inferring the effective connectivity networks from multi-electrode array data. In this paper, we apply a novel statistical method called spectral mirror estimation to the time series of inferred effective connectivity organoid networks. This method produces a one-dimensional iso-mirror representation of the dynamics of the time series of the networks which exhibits a piecewise linear structure. A classical change point algorithm is then applied to this representation, which successfully detects a change point coinciding with the neuroscientifically significant time inhibitory neurons start appearing and the percentage of astrocytes increases dramatically. This finding demonstrates the potential utility of applying the iso-mirror dynamic structure discovery method to inferred effective connectivity time series of organoid networks.
△ Less
Submitted 12 April, 2023; v1 submitted 8 March, 2023;
originally announced March 2023.
-
When are Deep Networks really better than Decision Forests at small sample sizes, and how?
Authors:
Haoyin Xu,
Kaleab A. Kinfu,
Will LeVine,
Sambit Panda,
Jayanta Dey,
Michael Ainsworth,
Yu-Chung Peng,
Madi Kusmanov,
Florian Engert,
Christopher M. White,
Joshua T. Vogelstein,
Carey E. Priebe
Abstract:
Deep networks and decision forests (such as random forests and gradient boosted trees) are the leading machine learning methods for structured and tabular data, respectively. Many papers have empirically compared large numbers of classifiers on one or two different domains (e.g., on 100 different tabular data settings). However, a careful conceptual and empirical comparison of these two strategies…
▽ More
Deep networks and decision forests (such as random forests and gradient boosted trees) are the leading machine learning methods for structured and tabular data, respectively. Many papers have empirically compared large numbers of classifiers on one or two different domains (e.g., on 100 different tabular data settings). However, a careful conceptual and empirical comparison of these two strategies using the most contemporary best practices has yet to be performed. Conceptually, we illustrate that both can be profitably viewed as "partition and vote" schemes. Specifically, the representation space that they both learn is a partitioning of feature space into a union of convex polytopes. For inference, each decides on the basis of votes from the activated nodes. This formulation allows for a unified basic understanding of the relationship between these methods. Empirically, we compare these two strategies on hundreds of tabular data settings, as well as several vision and auditory settings. Our focus is on datasets with at most 10,000 samples, which represent a large fraction of scientific and biomedical datasets. In general, we found forests to excel at tabular and structured data (vision and audition) with small sample sizes, whereas deep nets performed better on structured data with larger sample sizes. This suggests that further gains in both scenarios may be realized via further combining aspects of forests and networks. We will continue revising this technical report in the coming months with updated results.
△ Less
Submitted 2 November, 2021; v1 submitted 31 August, 2021;
originally announced August 2021.
-
Leveraging semantically similar queries for ranking via combining representations
Authors:
Hayden S. Helm,
Marah Abdin,
Benjamin D. Pedigo,
Shweti Mahajan,
Vince Lyzinski,
Youngser Park,
Amitabh Basu,
Piali~Choudhury,
Christopher M. White,
Weiwei Yang,
Carey E. Priebe
Abstract:
In modern ranking problems, different and disparate representations of the items to be ranked are often available. It is sensible, then, to try to combine these representations to improve ranking. Indeed, learning to rank via combining representations is both principled and practical for learning a ranking function for a particular query. In extremely data-scarce settings, however, the amount of l…
▽ More
In modern ranking problems, different and disparate representations of the items to be ranked are often available. It is sensible, then, to try to combine these representations to improve ranking. Indeed, learning to rank via combining representations is both principled and practical for learning a ranking function for a particular query. In extremely data-scarce settings, however, the amount of labeled data available for a particular query can lead to a highly variable and ineffective ranking function. One way to mitigate the effect of the small amount of data is to leverage information from semantically similar queries. Indeed, as we demonstrate in simulation settings and real data examples, when semantically similar queries are available it is possible to gainfully use them when ranking with respect to a particular query. We describe and explore this phenomenon in the context of the bias-variance trade off and apply it to the data-scarce settings of a Bing navigational graph and the Drosophila larva connectome.
△ Less
Submitted 23 June, 2021;
originally announced June 2021.
-
A partition-based similarity for classification distributions
Authors:
Hayden S. Helm,
Ronak D. Mehta,
Brandon Duderstadt,
Weiwei Yang,
Christoper M. White,
Ali Geisa,
Joshua T. Vogelstein,
Carey E. Priebe
Abstract:
Herein we define a measure of similarity between classification distributions that is both principled from the perspective of statistical pattern recognition and useful from the perspective of machine learning practitioners. In particular, we propose a novel similarity on classification distributions, dubbed task similarity, that quantifies how an optimally-transformed optimal representation for a…
▽ More
Herein we define a measure of similarity between classification distributions that is both principled from the perspective of statistical pattern recognition and useful from the perspective of machine learning practitioners. In particular, we propose a novel similarity on classification distributions, dubbed task similarity, that quantifies how an optimally-transformed optimal representation for a source distribution performs when applied to inference related to a target distribution. The definition of task similarity allows for natural definitions of adversarial and orthogonal distributions. We highlight limiting properties of representations induced by (universally) consistent decision rules and demonstrate in simulation that an empirical estimate of task similarity is a function of the decision rule deployed for inference. We demonstrate that for a given target distribution, both transfer efficiency and semantic similarity of candidate source distributions correlate with empirical task similarity.
△ Less
Submitted 12 November, 2020;
originally announced November 2020.
-
A self-sustaining process theory for uniform momentum zones and internal shear layers in high Reynolds number shear flows
Authors:
Brandon Montemuro,
Christopher M. White,
Joseph C. Klewicki,
Gregory P. Chini
Abstract:
Many exact coherent states (ECS) arising in wall-bounded shear flows have an asymptotic structure at extreme Reynolds number Re in which the effective Reynolds number governing the streak and roll dynamics is O(1). Consequently, these viscous ECS are not suitable candidates for quasi-coherent structures away from the wall that necessarily are inviscid in the mean. Specifically, viscous ECS cannot…
▽ More
Many exact coherent states (ECS) arising in wall-bounded shear flows have an asymptotic structure at extreme Reynolds number Re in which the effective Reynolds number governing the streak and roll dynamics is O(1). Consequently, these viscous ECS are not suitable candidates for quasi-coherent structures away from the wall that necessarily are inviscid in the mean. Specifically, viscous ECS cannot account for the singular nature of the inertial domain, where the flow self-organizes into uniform momentum zones (UMZs) separated by internal shear layers and the instantaneous streamwise velocity develops a staircase-like profile. In this investigation, a large-Re asymptotic analysis is performed to explore the potential for a three-dimensional, short streamwise- and spanwise-wavelength instability of the embedded shear layers to sustain a spatially-distributed array of much larger-scale, effectively inviscid streamwise roll motions. In contrast to other self-sustaining process theories, the rolls are sufficiently strong to differentially homogenize the background shear flow, thereby providing a mechanistic explanation for the formation and maintenance of UMZs and interlaced shear layers that respects the leading-order balance structure of the mean dynamics.
△ Less
Submitted 29 June, 2020;
originally announced June 2020.
-
Design of a Privacy-Preserving Data Platform for Collaboration Against Human Trafficking
Authors:
Darren Edge,
Weiwei Yang,
Kate Lytvynets,
Harry Cook,
Claire Galez-Davis,
Hannah Darnton,
Christopher M. White
Abstract:
Case records on victims of human trafficking are highly sensitive, yet the ability to share such data is critical to evidence-based practice and policy development across government, business, and civil society. We present new methods to anonymize, publish, and explore such data, implemented as a pipeline generating three artifacts: (1) synthetic data mitigating the privacy risk that published att…
▽ More
Case records on victims of human trafficking are highly sensitive, yet the ability to share such data is critical to evidence-based practice and policy development across government, business, and civil society. We present new methods to anonymize, publish, and explore such data, implemented as a pipeline generating three artifacts: (1) synthetic data mitigating the privacy risk that published attribute combinations might be linked to known individuals or groups; (2) aggregate data mitigating the utility risk that synthetic data might misrepresent statistics needed for official reporting; and (3) visual analytics interfaces to both datasets mitigating the accessibility risk that privacy mechanisms or analysis tools might not be understandable and usable by all stakeholders. We present our work as a design study motivated by the goal of transforming how the world's largest database of identified victims is made available for global collaboration against human trafficking.
△ Less
Submitted 18 September, 2020; v1 submitted 12 May, 2020;
originally announced May 2020.
-
Workgroup Map**: Visual Analysis of Collaboration Culture
Authors:
Darren Edge,
Jonathan Larson,
Nikolay Trandev,
Neha Parikh Shah,
Carolyn Buractaon,
Nicholas Caurvina,
Nathan Evans,
Christopher M. White
Abstract:
The digital transformation of work presents new opportunities to understand how informal workgroups organize around the dynamic needs of organizations, potentially in contrast to the formal, static, and idealized hierarchies depicted by org charts. We present a design study that spans multiple enabling capabilities for the visual map** and analysis of organizational workgroups, including metrics…
▽ More
The digital transformation of work presents new opportunities to understand how informal workgroups organize around the dynamic needs of organizations, potentially in contrast to the formal, static, and idealized hierarchies depicted by org charts. We present a design study that spans multiple enabling capabilities for the visual map** and analysis of organizational workgroups, including metrics for quantifying two dimensions of collaboration culture: the fluidity of collaborative relationships (measured using network machine learning) and the freedom with which workgroups form across organizational boundaries. These capabilities come together to create a turnkey pipeline that combines the analysis of a target organization, the generation of data graphics and statistics, and their integration in a template-based presentation that enables narrative visualization of results. Our metrics and visuals have supported hundreds of presentations to executives of major US-based and multinational organizations, while our engineering practices have created an ensemble of standalone tools with broad relevance to visualization and visual analytics. We present our work as an example of applied visual analytics research, describing the design iterations that allowed us to move from experimentation to production, as well as the perspectives of the research team and the customer-facing team at each stage in this process.
△ Less
Submitted 19 March, 2021; v1 submitted 1 May, 2020;
originally announced May 2020.
-
A Simple Lifelong Learning Approach
Authors:
Joshua T. Vogelstein,
Jayanta Dey,
Hayden S. Helm,
Will LeVine,
Ronak D. Mehta,
Tyler M. Tomita,
Haoyin Xu,
Ali Geisa,
Qingyang Wang,
Gido M. van de Ven,
Chenyu Gao,
Weiwei Yang,
Bryan Tower,
Jonathan Larson,
Christopher M. White,
Carey E. Priebe
Abstract:
In lifelong learning, data are used to improve performance not only on the present task, but also on past and future (unencountered) tasks. While typical transfer learning algorithms can improve performance on future tasks, their performance on prior tasks degrades upon learning new tasks (called forgetting). Many recent approaches for continual or lifelong learning have attempted to maintain perf…
▽ More
In lifelong learning, data are used to improve performance not only on the present task, but also on past and future (unencountered) tasks. While typical transfer learning algorithms can improve performance on future tasks, their performance on prior tasks degrades upon learning new tasks (called forgetting). Many recent approaches for continual or lifelong learning have attempted to maintain performance on old tasks given new tasks. But striving to avoid forgetting sets the goal unnecessarily low. The goal of lifelong learning should be to use data to improve performance on both future tasks (forward transfer) and past tasks (backward transfer). In this paper, we show that a simple approach -- representation ensembling -- demonstrates both forward and backward transfer in a variety of simulated and benchmark data scenarios, including tabular, vision (CIFAR-100, 5-dataset, Split Mini-Imagenet, and Food1k), and speech (spoken digit), in contrast to various reference algorithms, which typically failed to transfer either forward or backward, or both. Moreover, our proposed approach can flexibly operate with or without a computational budget.
△ Less
Submitted 11 June, 2024; v1 submitted 27 April, 2020;
originally announced April 2020.
-
Polymer Maximum Drag Reduction: A Unique Transitional State
Authors:
Yves Dubief,
Christopher M. White,
Eric S. G. Shaqfeh,
Vincent E. Terrapon
Abstract:
The upper bound of polymer drag reduction is identified as a unique transitional state between laminar and turbulent flow corresponding to the onset of the nonlinear breakdown of flow instabilities.
The upper bound of polymer drag reduction is identified as a unique transitional state between laminar and turbulent flow corresponding to the onset of the nonlinear breakdown of flow instabilities.
△ Less
Submitted 22 June, 2011;
originally announced June 2011.
-
Likelihood-based semi-supervised model selection with applications to speech processing
Authors:
Christopher M. White,
Sanjeev P. Khudanpur,
Patrick J. Wolfe
Abstract:
In conventional supervised pattern recognition tasks, model selection is typically accomplished by minimizing the classification error rate on a set of so-called development data, subject to ground-truth labeling by human experts or some other means. In the context of speech processing systems and other large-scale practical applications, however, such labeled development data are typically cost…
▽ More
In conventional supervised pattern recognition tasks, model selection is typically accomplished by minimizing the classification error rate on a set of so-called development data, subject to ground-truth labeling by human experts or some other means. In the context of speech processing systems and other large-scale practical applications, however, such labeled development data are typically costly and difficult to obtain. This article proposes an alternative semi-supervised framework for likelihood-based model selection that leverages unlabeled data by using trained classifiers representing each model to automatically generate putative labels. The errors that result from this automatic labeling are shown to be amenable to results from robust statistics, which in turn provide for minimax-optimal censored likelihood ratio tests that recover the nonparametric sign test as a limiting case. This approach is then validated experimentally using a state-of-the-art automatic speech recognition system to select between candidate word pronunciations using unlabeled speech data that only potentially contain instances of the words under test. Results provide supporting evidence for the utility of this approach, and suggest that it may also find use in other applications of machine learning.
△ Less
Submitted 19 November, 2009;
originally announced November 2009.