-
Extending Polaris to Support Transactions
Authors:
Josep Aguilar-Saborit,
Raghu Ramakrishnan,
Kevin Bocksrocker,
Alan Halverson,
Konstantin Kosinsky,
Ryan O'Connor,
Nadejda Poliakova,
Moe Shafiei,
Taewoo Kim,
Phil Kon-Kim,
Haris Mahmud-Ansari,
Blazej Matuszyk,
Matt Miles,
Sumin Mohanan,
Cristian Petculescu,
Ishan Rahesh-Madan,
Emma Rose-Wirshing,
Elias Yousefi
Abstract:
In Polaris, we introduced a cloud-native distributed query processor to perform analytics at scale. In this paper, we extend the underlying Polaris distributed computation framework, which can be thought of as a read-only transaction engine, to execute general transactions (including updates, deletes, inserts and bulk loads, in addition to queries) for Tier 1 warehousing workloads in a highly perf…
▽ More
In Polaris, we introduced a cloud-native distributed query processor to perform analytics at scale. In this paper, we extend the underlying Polaris distributed computation framework, which can be thought of as a read-only transaction engine, to execute general transactions (including updates, deletes, inserts and bulk loads, in addition to queries) for Tier 1 warehousing workloads in a highly performant and predictable manner. We take advantage of the immutability of data files in log-structured data stores and build on SQL Server transaction management to deliver full transactional support with Snapshot Isolation semantics, including multi-table and multi-statement transactions. With the enhancements described in this paper, Polaris supports both query processing and transactions for T-SQL in Microsoft Fabric.
△ Less
Submitted 20 January, 2024;
originally announced January 2024.
-
Efficiency of Multivariate Tests in Trials in Progressive Supranuclear Palsy
Authors:
Elham Yousefi,
Mohamed Gewily,
Franz König,
Günter Höglinger,
Franziska Hopfner,
Mats O. Karlsson,
Robin Ristl,
Sonja Zehetmayer,
Martin Posch
Abstract:
Measuring disease progression in clinical trials for testing novel treatments for multifaceted diseases as Progressive Supranuclear Palsy (PSP), remains challenging. In this study we assess a range of statistical approaches to compare outcomes measured by the items of the Progressive Supranuclear Palsy Rating Scale (PSPRS). We consider several statistical approaches, including sum scores, as an FD…
▽ More
Measuring disease progression in clinical trials for testing novel treatments for multifaceted diseases as Progressive Supranuclear Palsy (PSP), remains challenging. In this study we assess a range of statistical approaches to compare outcomes measured by the items of the Progressive Supranuclear Palsy Rating Scale (PSPRS). We consider several statistical approaches, including sum scores, as an FDA-recommended version of the PSPRS, multivariate tests, and analysis approaches based on multiple comparisons of the individual items. We propose two novel approaches which measure disease status based on Item Response Theory models. We assess the performance of these tests in an extensive simulation study and illustrate their use with a re-analysis of the ABBV-8E12 clinical trial. Furthermore, we discuss the impact of the FDA-recommended scoring of item scores on the power of the statistical tests. We find that classical approaches as the PSPRS sum score demonstrate moderate to high power when treatment effects are consistent across the individual items. The tests based on Item Response Theory models yield the highest power when the simulated data are generated from an IRT model. The multiple testing based approaches have a higher power in settings where the treatment effect is limited to certain domains or items. The FDA-recommended item rescoring tends to decrease the simulated power. The study shows that there is no one-size-fits-all testing procedure for evaluating treatment effects using PSPRS items; the optimal method varies based on the specific effect size patterns. The efficiency of the PSPRS sum score, while generally robust and straightforward to apply, varies depending on the effect sizes' patterns encountered and more powerful alternatives are available in specific settings. These findings can have important implications for the design of future clinical trials in PSP.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Hierarchical Planning and Policy Sha** Shared Autonomy for Articulated Robots
Authors:
Ehsan Yousefi,
Mo Chen,
Inna Sharf
Abstract:
In this work, we propose a novel shared autonomy framework to operate articulated robots. We provide strategies to design both the task-oriented hierarchical planning and policy sha** algorithms for efficient human-robot interactions in context-aware operation of articulated robots. Our framework for interplay between the human and the autonomy, as the participating agents in the system, is part…
▽ More
In this work, we propose a novel shared autonomy framework to operate articulated robots. We provide strategies to design both the task-oriented hierarchical planning and policy sha** algorithms for efficient human-robot interactions in context-aware operation of articulated robots. Our framework for interplay between the human and the autonomy, as the participating agents in the system, is particularly influenced by the ideas from multi-agent systems, game theory, and theory of mind for a sliding level of autonomy. We formulate the sequential hierarchical human-in-the-loop decision making process by extending MDPs and Options framework to shared autonomy, and make use of deep RL techniques to train an uncertainty-aware shared autonomy policy. To fine-tune the formulation to a human, we use history of the system states, human actions, and their error with respect to a surrogate optimal model to encode human's internal state embeddings, beyond the designed values, by using conditional VAEs. We showcase the effectiveness of our formulation for different human skill levels and degrees of cooperativeness by using a case study of a feller-buncher machine in the challenging tasks of timber harvesting. Our framework is successful in providing a sliding level of autonomy from fully autonomous to fully manual, and is particularly successful in handling a noisy non-cooperative human agent in the loop. The proposed framework advances the state-of-the-art in shared autonomy for operating articulated robots, but can also be applied to other domains where autonomous operation is the ultimate goal.
△ Less
Submitted 4 July, 2023;
originally announced July 2023.
-
Active Discrimination Learning for Gaussian Process Models
Authors:
Elham Yousefi,
Luc Pronzato,
Markus Hainy,
Werner G. Müller,
Henry P. Wynn
Abstract:
The paper covers the design and analysis of experiments to discriminate between two Gaussian process models, such as those widely used in computer experiments, kriging, sensor location and machine learning. Two frameworks are considered. First, we study sequential constructions, where successive design (observation) points are selected, either as additional points to an existing design or from the…
▽ More
The paper covers the design and analysis of experiments to discriminate between two Gaussian process models, such as those widely used in computer experiments, kriging, sensor location and machine learning. Two frameworks are considered. First, we study sequential constructions, where successive design (observation) points are selected, either as additional points to an existing design or from the beginning of observation. The selection relies on the maximisation of the difference between the symmetric Kullback Leibler divergences for the two models, which depends on the observations, or on the mean squared error of both models, which does not. Then, we consider static criteria, such as the familiar log-likelihood ratios and the Fréchet distance between the covariance functions of the two models. Other distance-based criteria, simpler to compute than previous ones, are also introduced, for which, considering the framework of approximate design, a necessary condition for the optimality of a design measure is provided. The paper includes a study of the mathematical links between different criteria and numerical illustrations are provided.
△ Less
Submitted 21 November, 2022;
originally announced November 2022.
-
Impact of the error structure on the design and analysis of enzyme kinetic models
Authors:
Elham Yousefi,
Werner G. Müller
Abstract:
The statistical analysis of enzyme kinetic reactions usually involves models of the response functions which are well defined on the basis of Michaelis-Menten type equations. The error structure however is often without good reason assumed as additive Gaussian noise. This simple assumption may lead to undesired properties of the analysis, particularly when simulations are involved and consequently…
▽ More
The statistical analysis of enzyme kinetic reactions usually involves models of the response functions which are well defined on the basis of Michaelis-Menten type equations. The error structure however is often without good reason assumed as additive Gaussian noise. This simple assumption may lead to undesired properties of the analysis, particularly when simulations are involved and consequently negative simulated reaction rates may occur. In this study we investigate the effect of assuming multiplicative lognormal errors instead. While there is typically little impact on the estimates, the experimental designs and their efficiencies are decisively affected, particularly when it comes to model discrimination problems.
△ Less
Submitted 17 March, 2021;
originally announced March 2021.
