-
Branch-and-price with novel cuts, and a new Stackelberg Security Game
Authors:
Pamela Bustamante-Faúndez,
Víctor Bucarey L.,
Martine Labbé,
Vladimir Marianov,
Fernando Ordóñez
Abstract:
Anticipating the strategies of potential attackers is crucial for protecting critical infrastructure. We can represent the challenge of the defenders of such infrastructure as a Stackelberg security game. The defender must decide how to allocate limited resources to protect specific targets, aiming to maximize their expected utility (such as minimizing the extent of damage) and considering that at…
▽ More
Anticipating the strategies of potential attackers is crucial for protecting critical infrastructure. We can represent the challenge of the defenders of such infrastructure as a Stackelberg security game. The defender must decide how to allocate limited resources to protect specific targets, aiming to maximize their expected utility (such as minimizing the extent of damage) and considering that attackers will respond in a way that is most advantageous to them.
We present novel valid inequalities to find a Strong Stackelberg Equilibrium in both Stackelberg games and Stackelberg security games. We also consider a Stackelberg security game that aims to protect targets with a defined budget. We use branch-and-price in this game to show that our approach outperforms the standard formulation in the literature, and we conduct an extensive computational study to analyze the impact of various branch-and-price parameters on the performance of our method in different game settings.
△ Less
Submitted 15 May, 2024;
originally announced May 2024.
-
HiRE: High Recall Approximate Top-$k$ Estimation for Efficient LLM Inference
Authors:
Yashas Samaga B L,
Varun Yerram,
Chong You,
Srinadh Bhojanapalli,
Sanjiv Kumar,
Prateek Jain,
Praneeth Netrapalli
Abstract:
Autoregressive decoding with generative Large Language Models (LLMs) on accelerators (GPUs/TPUs) is often memory-bound where most of the time is spent on transferring model parameters from high bandwidth memory (HBM) to cache. On the other hand, recent works show that LLMs can maintain quality with significant sparsity/redundancy in the feedforward (FFN) layers by appropriately training the model…
▽ More
Autoregressive decoding with generative Large Language Models (LLMs) on accelerators (GPUs/TPUs) is often memory-bound where most of the time is spent on transferring model parameters from high bandwidth memory (HBM) to cache. On the other hand, recent works show that LLMs can maintain quality with significant sparsity/redundancy in the feedforward (FFN) layers by appropriately training the model to operate on a top-$k$ fraction of rows/columns (where $k \approx 0.05$), there by suggesting a way to reduce the transfer of model parameters, and hence latency. However, exploiting this sparsity for improving latency is hindered by the fact that identifying top rows/columns is data-dependent and is usually performed using full matrix operations, severely limiting potential gains. To address these issues, we introduce HiRE (High Recall Approximate Top-k Estimation). HiRE comprises of two novel components: (i) a compression scheme to cheaply predict top-$k$ rows/columns with high recall, followed by full computation restricted to the predicted subset, and (ii) DA-TOP-$k$: an efficient multi-device approximate top-$k$ operator. We demonstrate that on a one billion parameter model, HiRE applied to both the softmax as well as feedforward layers, achieves almost matching pretraining and downstream accuracy, and speeds up inference latency by $1.47\times$ on a single TPUv5e device.
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
On Quantum and Classical Treatments of Radiative Recombination
Authors:
Barabanov A. L.,
Belotsky K. M.,
Esipova E. A.,
Kalashnikov D. S.,
Letunov A. Yu
Abstract:
The quantum-mechanical solution to the problem of radiative recombination of an electron in a Coulomb field, obtained in the approximation of the smallness of the electron coupling with the radiation field, has been known for a long time. However, in astrophysics, the classical approach, which does not explicitly use this smallness, is sometimes used to describe similar processes in systems of mag…
▽ More
The quantum-mechanical solution to the problem of radiative recombination of an electron in a Coulomb field, obtained in the approximation of the smallness of the electron coupling with the radiation field, has been known for a long time. However, in astrophysics, the classical approach, which does not explicitly use this smallness, is sometimes used to describe similar processes in systems of magnetic monopoles or self-interacting dark matter particles. The importance of such problems is determined by the fact that recombination processes play a crucial role in the evolution of the large-scale structure of the Universe. Therefore, of particular interest is the fact that the classical and quantum expressions for the recombination cross section differ significantly in magnitude. It is shown that the applicability of quantum and classical approaches to radiative recombination is closely related to the radiated angular momentum and its quantization. For situations where the classical approach is not suitable, a semi-classical approach based on the angular momentum quantization is proposed, in some respects an alternative to the well-known semi-classical Kramers' approach.
△ Less
Submitted 14 September, 2022; v1 submitted 23 April, 2022;
originally announced April 2022.
-
On Causally Disentangled Representations
Authors:
Abbavaram Gowtham Reddy,
Benin Godfrey L,
Vineeth N Balasubramanian
Abstract:
Representation learners that disentangle factors of variation have already proven to be important in addressing various real world concerns such as fairness and interpretability. Initially consisting of unsupervised models with independence assumptions, more recently, weak supervision and correlated features have been explored, but without a causal view of the generative process. In contrast, we w…
▽ More
Representation learners that disentangle factors of variation have already proven to be important in addressing various real world concerns such as fairness and interpretability. Initially consisting of unsupervised models with independence assumptions, more recently, weak supervision and correlated features have been explored, but without a causal view of the generative process. In contrast, we work under the regime of a causal generative process where generative factors are either independent or can be potentially confounded by a set of observed or unobserved confounders. We present an analysis of disentangled representations through the notion of disentangled causal process. We motivate the need for new metrics and datasets to study causal disentanglement and propose two evaluation metrics and a dataset. We show that our metrics capture the desiderata of disentangled causal process. Finally, we perform an empirical study on state of the art disentangled representation learners using our metrics and dataset to evaluate them from causal perspective.
△ Less
Submitted 10 December, 2021;
originally announced December 2021.
-
Exploiting timing capabilities of the CHEOPS mission with warm-Jupiter planets
Authors:
Borsato L,
Piotto G,
Gandolfi D,
Nascimbeni V,
Lacedelli G,
Marzari F,
Billot N,
Maxted P,
Sousa S G,
Cameron A C,
Bonfanti A,
Wilson T,
Serrano L,
Garai Z,
Alibert Y,
Alonso R,
Asquier J,
Bárczy T,
Bandy T,
Barrado D,
Barros S C,
Baumjohann W,
Beck M,
Beck T,
Benz W
, et al. (53 additional authors not shown)
Abstract:
We present 17 transit light curves of seven known warm-Jupiters observed with the CHaracterising ExOPlanet Satellite (CHEOPS). The light curves have been collected as part of the CHEOPS Guaranteed Time Observation (GTO) program that searches for transit-timing variation (TTV) of warm-Jupiters induced by a possible external perturber to shed light on the evolution path of such planetary systems. We…
▽ More
We present 17 transit light curves of seven known warm-Jupiters observed with the CHaracterising ExOPlanet Satellite (CHEOPS). The light curves have been collected as part of the CHEOPS Guaranteed Time Observation (GTO) program that searches for transit-timing variation (TTV) of warm-Jupiters induced by a possible external perturber to shed light on the evolution path of such planetary systems. We describe the CHEOPS observation process, from the planning to the data analysis. In this work we focused on the timing performance of CHEOPS, the impact of the sampling of the transit phases, and the improvement we can obtain combining multiple transits together. We reached the highest precision on the transit time of about 13-16 s for the brightest target (WASP-38, G = 9.2) in our sample. From the combined analysis of multiple transits of fainter targets with G >= 11 we obtained a timing precision of about 2 min. Additional observations with CHEOPS, covering a longer temporal baseline, will further improve the precision on the transit times and will allow us to detect possible TTV signals induced by an external perturber.
△ Less
Submitted 21 June, 2021;
originally announced June 2021.
-
The CALOCUBE project for a space based cosmic ray experiment: design, construction, and first performance of a high granularity calorimeter prototype
Authors:
Adriani O.,
Albergo S.,
Auditore L.,
Basti A.,
Berti E.,
Bigongiari G.,
Bonechi L.,
Bongi M.,
Bonvicini V.,
Bottai S.,
Brogi P.,
Cappello G.,
Carotenuto G.,
Castellini G.,
Cattaneo P. W.,
Cecchi R.,
Checchia C.,
D'Alessandro R.,
Detti S.,
Fasoli M.,
Finetti N.,
Italiano A.,
Lenzi P.,
Maestro P.,
Manetti M.
, et al. (26 additional authors not shown)
Abstract:
Current research in High Energy Cosmic Ray Physics touches on fundamental questions regarding the origin of cosmic rays, their composition, the acceleration mechanisms, and their production. Unambiguous measurements of the energy spectra and of the composition of cosmic rays at the "knee" region could provide some of the answers to the above questions. So far only ground based observations, which…
▽ More
Current research in High Energy Cosmic Ray Physics touches on fundamental questions regarding the origin of cosmic rays, their composition, the acceleration mechanisms, and their production. Unambiguous measurements of the energy spectra and of the composition of cosmic rays at the "knee" region could provide some of the answers to the above questions. So far only ground based observations, which rely on sophisticated models describing high energy interactions in the earth's atmosphere, have been possible due to the extremely low particle rates at these energies. A calorimetry based space experiment that could provide not only flux measurements but also energy spectra and particle identification, would certainly overcome some of the uncertainties of ground based experiments. Given the expected particle fluxes, a very large acceptance is needed to collect a sufficient quantity of data, in a time compatible with the duration of a space mission. This in turn, contrasts with the lightness and compactness requirements for space based experiments. We present a novel idea in calorimetry which addresses these issues whilst limiting the mass and volume of the detector. In this paper we report on a four year R&D program where we investigated materials, coatings, photo-sensors, Front End electronics, and mechanical structures with the aim of designing a high performance, high granularity calorimeter with the largest possible acceptance. Details are given of the design choices, component characterisation, and of the construction of a sizeable prototype (Calocube) which has been used in various tests with particle beams.
△ Less
Submitted 22 October, 2019;
originally announced October 2019.
-
The Implementation of Quantum Computing Operations with Phase Modulated Microwave Pulses and High-Spin Ions at Zero Magnetic Fields
Authors:
Arifullin M. R.,
Berdinskiy V. L
Abstract:
New physical implementations of quantum computing elementary operations by pulse manipulations with electron spins of paramagnetic ions having two electrons and spin S=1 in a zero magnetic field are proposed. New type of microwave pulses with variable phases and different polarizations are able to induce different transitions between ion spin states, and those transitions are described by quantum…
▽ More
New physical implementations of quantum computing elementary operations by pulse manipulations with electron spins of paramagnetic ions having two electrons and spin S=1 in a zero magnetic field are proposed. New type of microwave pulses with variable phases and different polarizations are able to induce different transitions between ion spin states, and those transitions are described by quantum computing operators. To describe the effects of such pulses, a new way to present exponential operators as polynomials of Pauli matrices is proposed.
△ Less
Submitted 8 October, 2019;
originally announced October 2019.
-
On the Nature of Rapidly Rotating Single Evolved Stars
Authors:
Rodrigues da Silva,
R.,
Canto Martins,
B. L.,
De Medeiros,
J. R
Abstract:
We present an analysis of the nature of the rapidly rotating, apparently single giant based on rotational and radial velocity measurements carried out by the CORAVEL spectrometers. From the analyzed sample, composed of 2010 spectroscopic, apparently single, evolved stars of luminosity classes IV, III, II, and Ib with spectral types G and K, we classified 30 stars that presented unusual, moderate t…
▽ More
We present an analysis of the nature of the rapidly rotating, apparently single giant based on rotational and radial velocity measurements carried out by the CORAVEL spectrometers. From the analyzed sample, composed of 2010 spectroscopic, apparently single, evolved stars of luminosity classes IV, III, II, and Ib with spectral types G and K, we classified 30 stars that presented unusual, moderate to rapid rotation. This work reports, for the first time, the presence of these abnormal rotators among subgiant, bright giant, and Ib supergiant stars. To date, this class of stars was reported only among giant stars of luminosity class III. Most of these abnormal rotators present an IRAS infrared excess, which, in principle, can be related to dust around these stars.
△ Less
Submitted 11 March, 2015;
originally announced March 2015.
