-
A primitive normal pair with prescribed prenorm
Authors:
K. Chatterjee,
S. K. Tiwari
Abstract:
For any positive integers $q$, $n$, $m$ with $q$ being a prime power and $n \geq 5$, we establish a condition sufficient to ensure the existence of a primitive normal pair $(ε,f(ε))$ in $\mathbb{F}_{q^{n}}$ over $\mathbb{F}_{q}$ such that $\mathrm{PN}_{q^n/q}(ε)=a$, where $a\in\mathbb{F}_{q}$ is prescribed. Here $f={f_{1}}/{f_{2}}\in\mathbb{F}_{q^n}(x)$ is a rational function subject to some minor…
▽ More
For any positive integers $q$, $n$, $m$ with $q$ being a prime power and $n \geq 5$, we establish a condition sufficient to ensure the existence of a primitive normal pair $(ε,f(ε))$ in $\mathbb{F}_{q^{n}}$ over $\mathbb{F}_{q}$ such that $\mathrm{PN}_{q^n/q}(ε)=a$, where $a\in\mathbb{F}_{q}$ is prescribed. Here $f={f_{1}}/{f_{2}}\in\mathbb{F}_{q^n}(x)$ is a rational function subject to some minor restrictions such that deg($f_{1}$)+deg($f_{2}$)$=m$ and $\mathrm{PN}_{q^n/q}(ε)
=\sum_{i=0}^{n-1}\Bigg(\underset{j\neq i}{\underset{0\leq j\leq n-1}{\prod_{}^{}}}ε^{q^j}\Bigg)$. Finally, we conclude that for $m=3$, $n\geq 6$, and $q=7^k$ where $k\in\mathbb{N}$, such a pair will exist certainly for all $(q,n)$ except possibly $10$ choices at most.
△ Less
Submitted 26 June, 2024; v1 submitted 5 June, 2024;
originally announced June 2024.
-
Ergodic Unobservable MDPs: Decidability of Approximation
Authors:
Krishnendu Chatterjee,
David Lurie,
Raimundo Saona,
Bruno Ziliotto
Abstract:
Unobservable Markov decision processes (UMDPs) serve as a prominent mathematical framework for modeling sequential decision-making problems. A key aspect in computational analysis is the consideration of decidability, which concerns the existence of algorithms. In general, the computation of the exact and approximated values is undecidable for UMDPs with the long-run average objective. Building on…
▽ More
Unobservable Markov decision processes (UMDPs) serve as a prominent mathematical framework for modeling sequential decision-making problems. A key aspect in computational analysis is the consideration of decidability, which concerns the existence of algorithms. In general, the computation of the exact and approximated values is undecidable for UMDPs with the long-run average objective. Building on matrix product theory and ergodic properties, we introduce a novel subclass of UMDPs, termed ergodic UMDPs. Our main result demonstrates that approximating the value within this subclass is decidable. However, we show that the exact problem remains undecidable. Finally, we discuss the primary challenges of extending these results to partially observable Markov decision processes.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Existence of primitive normal pairs over finite fields with prescribed subtrace
Authors:
K. Chatterjee,
G. Kapetanakis,
S. K. Tiwari,
H. Sharma
Abstract:
Given positive integers $q,n,m$ and $a\in\mathbb{F}_{q}$, where $q$ is an odd prime power and $n\geq 5$, we investigate the existence of a primitive normal pair $(ε,f(ε))$ in $\mathbb{F}_{q^{n}}$ over $\mathbb{F}_{q}$ such that $\mathrm{STr}_{q^n/q}(ε)=a$, where $f(x)=\frac{f_{1}(x)}{f_{2}(x)}\in\mathbb{F}_{q^n}(x)$ is a rational function together with deg$(f_{1})+$deg$(f_{2})=m$ and…
▽ More
Given positive integers $q,n,m$ and $a\in\mathbb{F}_{q}$, where $q$ is an odd prime power and $n\geq 5$, we investigate the existence of a primitive normal pair $(ε,f(ε))$ in $\mathbb{F}_{q^{n}}$ over $\mathbb{F}_{q}$ such that $\mathrm{STr}_{q^n/q}(ε)=a$, where $f(x)=\frac{f_{1}(x)}{f_{2}(x)}\in\mathbb{F}_{q^n}(x)$ is a rational function together with deg$(f_{1})+$deg$(f_{2})=m$ and $\mathrm{STr}_{q^n/q}(ε) = \sum_{0\leq i<j\leq n-1}^{}ε^{q^i+q^j}$. Finally, we conclude that for $m=3$, $n\geq 6$ and $q=7^k$; $k\in\mathbb{N}$, such a pair will exist certainly for all $(q,n)$ except at most $14$ choices.
△ Less
Submitted 19 May, 2024;
originally announced May 2024.
-
Arithmetic progression in a finite field with prescribed norms
Authors:
Kaustav Chatterjee,
Hariom Sharma,
Aastha Shukla,
Shailesh Kumar Tiwari
Abstract:
Given a prime power $q$ and a positive integer $n$, let $\mathbb{F}_{q^{n}}$ represents a finite extension of degree $n$ of the finite field ${\mathbb{F}_{q}}$. In this article, we investigate the existence of $m$ elements in arithmetic progression, where every element is primitive and at least one is normal with prescribed norms. Moreover, for $n\geq6,q=3^k,m=2$ we establish that there are only…
▽ More
Given a prime power $q$ and a positive integer $n$, let $\mathbb{F}_{q^{n}}$ represents a finite extension of degree $n$ of the finite field ${\mathbb{F}_{q}}$. In this article, we investigate the existence of $m$ elements in arithmetic progression, where every element is primitive and at least one is normal with prescribed norms. Moreover, for $n\geq6,q=3^k,m=2$ we establish that there are only $10$ possible exceptions.
△ Less
Submitted 7 January, 2024; v1 submitted 3 January, 2024;
originally announced January 2024.
-
A primitive normal pair in a finite field with prescribed traces and norms
Authors:
Kaustav Chatterjee,
Hariom Sharma,
Shailesh Kumar Tiwari
Abstract:
Given ${\mathbb{F}_{p^t}}$, a field with $p^t$ elements, where $p$ is a prime power, $t$ is a positive integer. Let $f(x)$ be a polynomial over $\mathbb{F}_{p^t}$ of degree $m$ with some restrictions. In this paper, we construct a sufficient condition on $(p,t)$ which guarantees the existence of a primitive normal pair $(ε,f(ε))$ such that $Tr_{\mathbb{F}_{p^t}/\mathbb{F}_p}(ε)=a$,…
▽ More
Given ${\mathbb{F}_{p^t}}$, a field with $p^t$ elements, where $p$ is a prime power, $t$ is a positive integer. Let $f(x)$ be a polynomial over $\mathbb{F}_{p^t}$ of degree $m$ with some restrictions. In this paper, we construct a sufficient condition on $(p,t)$ which guarantees the existence of a primitive normal pair $(ε,f(ε))$ such that $Tr_{\mathbb{F}_{p^t}/\mathbb{F}_p}(ε)=a$, $Tr_{\mathbb{F}_{p^t}/\mathbb{F}_p}(f(ε))=b$ and $N_{\mathbb{F}_{p^t}/\mathbb{F}_p}(ε)=c$, $N_{\mathbb{F}_{p^t}/\mathbb{F}_p}(f(ε))=d$ where $c,d\in\mathbb{F}_{p}$ are primitive elements and $a,b\in\mathbb{F}_{p}^*$. Furthermore, we demonstrate that, for $p=11^k;$ $k\geq1,$ $m=8$ and $t\geq 15$, there are only $4$ possible exceptions where such pairs may not exist.
△ Less
Submitted 5 June, 2024; v1 submitted 5 August, 2023;
originally announced August 2023.
-
Repeated Prophet Inequality with Near-optimal Bounds
Authors:
Krishnendu Chatterjee,
Mona Mohammadi,
Raimundo Saona
Abstract:
In modern sample-driven Prophet Inequality, an adversary chooses a sequence of $n$ items with values $v_1, v_2, \ldots, v_n$ to be presented to a decision maker (DM). The process follows in two phases. In the first phase (sampling phase), some items, possibly selected at random, are revealed to the DM, but she can never accept them. In the second phase, the DM is presented with the other items in…
▽ More
In modern sample-driven Prophet Inequality, an adversary chooses a sequence of $n$ items with values $v_1, v_2, \ldots, v_n$ to be presented to a decision maker (DM). The process follows in two phases. In the first phase (sampling phase), some items, possibly selected at random, are revealed to the DM, but she can never accept them. In the second phase, the DM is presented with the other items in a random order and online fashion. For each item, she must make an irrevocable decision to either accept the item and stop the process or reject the item forever and proceed to the next item. The goal of the DM is to maximize the expected value as compared to a Prophet (or offline algorithm) that has access to all information. In this setting, the sampling phase has no cost and is not part of the optimization process. However, in many scenarios, the samples are obtained as part of the decision-making process.
We model this aspect as a two-phase Prophet Inequality where an adversary chooses a sequence of $2n$ items with values $v_1, v_2, \ldots, v_{2n}$ and the items are randomly ordered. Finally, there are two phases of the Prophet Inequality problem with the first $n$-items and the rest of the items, respectively. We show that some basic algorithms achieve a ratio of at most $0.450$. We present an algorithm that achieves a ratio of at least $0.495$. Finally, we show that for every algorithm the ratio it can achieve is at most $0.502$. Hence our algorithm is near-optimal.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Learning Stabilizing Policies in Stochastic Control Systems
Authors:
Đorđe Žikelić,
Mathias Lechner,
Krishnendu Chatterjee,
Thomas A. Henzinger
Abstract:
In this work, we address the problem of learning provably stable neural network policies for stochastic control systems. While recent work has demonstrated the feasibility of certifying given policies using martingale theory, the problem of how to learn such policies is little explored. Here, we study the effectiveness of jointly learning a policy together with a martingale certificate that proves…
▽ More
In this work, we address the problem of learning provably stable neural network policies for stochastic control systems. While recent work has demonstrated the feasibility of certifying given policies using martingale theory, the problem of how to learn such policies is little explored. Here, we study the effectiveness of jointly learning a policy together with a martingale certificate that proves its stability using a single learning algorithm. We observe that the joint optimization problem becomes easily stuck in local minima when starting from a randomly initialized policy. Our results suggest that some form of pre-training of the policy is required for the joint optimization to repair and verify the policy successfully.
△ Less
Submitted 24 May, 2022;
originally announced May 2022.
-
Stability Verification in Stochastic Control Systems via Neural Network Supermartingales
Authors:
Mathias Lechner,
Đorđe Žikelić,
Krishnendu Chatterjee,
Thomas A. Henzinger
Abstract:
We consider the problem of formally verifying almost-sure (a.s.) asymptotic stability in discrete-time nonlinear stochastic control systems. While verifying stability in deterministic control systems is extensively studied in the literature, verifying stability in stochastic control systems is an open problem. The few existing works on this topic either consider only specialized forms of stochasti…
▽ More
We consider the problem of formally verifying almost-sure (a.s.) asymptotic stability in discrete-time nonlinear stochastic control systems. While verifying stability in deterministic control systems is extensively studied in the literature, verifying stability in stochastic control systems is an open problem. The few existing works on this topic either consider only specialized forms of stochasticity or make restrictive assumptions on the system, rendering them inapplicable to learning algorithms with neural network policies. In this work, we present an approach for general nonlinear stochastic control problems with two novel aspects: (a) instead of classical stochastic extensions of Lyapunov functions, we use ranking supermartingales (RSMs) to certify a.s.~asymptotic stability, and (b) we present a method for learning neural network RSMs. We prove that our approach guarantees a.s.~asymptotic stability of the system and provides the first method to obtain bounds on the stabilization time, which stochastic Lyapunov functions do not. Finally, we validate our approach experimentally on a set of nonlinear stochastic reinforcement learning environments with neural network policies.
△ Less
Submitted 17 December, 2021;
originally announced December 2021.
-
Limits on amplifiers of natural selection under death-Birth updating
Authors:
Josef Tkadlec,
Andreas Pavlogiannis,
Krishnendu Chatterjee,
Martin A. Nowak
Abstract:
The fixation probability of a single mutant invading a population of residents is among the most widely-studied quantities in evolutionary dynamics. Amplifiers of natural selection are population structures that increase the fixation probability of advantageous mutants, compared to well-mixed populations. Extensive studies have shown that many amplifiers exist for the Birth-death Moran process, so…
▽ More
The fixation probability of a single mutant invading a population of residents is among the most widely-studied quantities in evolutionary dynamics. Amplifiers of natural selection are population structures that increase the fixation probability of advantageous mutants, compared to well-mixed populations. Extensive studies have shown that many amplifiers exist for the Birth-death Moran process, some of them substantially increasing the fixation probability or even guaranteeing fixation in the limit of large population size. On the other hand, no amplifiers are known for the death-Birth Moran process, and computer-assisted exhaustive searches have failed to discover amplification. In this work we resolve this disparity, by showing that any amplification under death-Birth updating is necessarily \emph{bounded} and \emph{transient}. Our boundedness result states that even if a population structure does amplify selection, the resulting fixation probability is close to that of the well-mixed population. Our transience result states that for any population structure there exists a threshold $r^*$ such that the population structure ceases to amplify selection if the mutant fitness advantage $r$ is larger than $r^\star$. Finally, we also extend the above results to $δ$-death-Birth updating, which is a combination of Birth-death and death-Birth updating. On the positive side, we identify population structures that maintain amplification for a wide range of values $r$ and $δ$. These results demonstrate that amplification of natural selection depends on the specific mechanisms of the evolutionary process.
△ Less
Submitted 6 June, 2019;
originally announced June 2019.
-
Finite-Memory Strategies in POMDPs with Long-Run Average Objectives
Authors:
Krishnendu Chatterjee,
Raimundo Saona,
Bruno Ziliotto
Abstract:
Partially observable Markov decision processes (POMDPs) are standard models for dynamic systems with probabilistic and nondeterministic behaviour in uncertain environments. We prove that in POMDPs with long-run average objective, the decision maker has approximately optimal strategies with finite memory. This implies notably that approximating the long-run value is recursively enumerable, as well…
▽ More
Partially observable Markov decision processes (POMDPs) are standard models for dynamic systems with probabilistic and nondeterministic behaviour in uncertain environments. We prove that in POMDPs with long-run average objective, the decision maker has approximately optimal strategies with finite memory. This implies notably that approximating the long-run value is recursively enumerable, as well as a weak continuity property of the value with respect to the transition function.
△ Less
Submitted 28 September, 2022; v1 submitted 30 April, 2019;
originally announced April 2019.
-
Computational Approaches for Stochastic Shortest Path on Succinct MDPs
Authors:
Krishnendu Chatterjee,
Hongfei Fu,
Amir Kafshdar Goharshady,
Nastaran Okati
Abstract:
We consider the stochastic shortest path (SSP) problem for succinct Markov decision processes (MDPs), where the MDP consists of a set of variables, and a set of nondeterministic rules that update the variables. First, we show that several examples from the AI literature can be modeled as succinct MDPs. Then we present computational approaches for upper and lower bounds for the SSP problem: (a)~for…
▽ More
We consider the stochastic shortest path (SSP) problem for succinct Markov decision processes (MDPs), where the MDP consists of a set of variables, and a set of nondeterministic rules that update the variables. First, we show that several examples from the AI literature can be modeled as succinct MDPs. Then we present computational approaches for upper and lower bounds for the SSP problem: (a)~for computing upper bounds, our method is polynomial-time in the implicit description of the MDP; (b)~for lower bounds, we present a polynomial-time (in the size of the implicit description) reduction to quadratic programming. Our approach is applicable even to infinite-state MDPs. Finally, we present experimental results to demonstrate the effectiveness of our approach on several classical examples from the AI literature.
△ Less
Submitted 17 July, 2018; v1 submitted 24 April, 2018;
originally announced April 2018.
-
Forward and Inverse Modelling Approaches for Prediction of Light Stimulus from Electrophysiological Response in Plants
Authors:
Shre Kumar Chatterjee,
Sanmitra Ghosh,
Saptarshi Das,
Veronica Manzella,
Andrea Vitaletti,
Elisa Masi,
Luisa Santopolo,
Stefano Mancuso,
Koushik Maharatna
Abstract:
In this paper, system identification approach has been adopted to develop a novel dynamical model for describing the relationship between light as an environmental stimulus and the electrical response as the measured output for a bay leaf (Laurus nobilis) plant. More specifically, the target is to predict the characteristics of the input light stimulus (in terms of on-off timing, duration and inte…
▽ More
In this paper, system identification approach has been adopted to develop a novel dynamical model for describing the relationship between light as an environmental stimulus and the electrical response as the measured output for a bay leaf (Laurus nobilis) plant. More specifically, the target is to predict the characteristics of the input light stimulus (in terms of on-off timing, duration and intensity) from the measured electrical response - leading to an inverse problem. We explored two major classes of system estimators to develop dynamical models - linear and nonlinear - and their several variants for establishing a forward and also an inverse relationship between the light stimulus and plant electrical response. The best class of models are given by the Nonlinear Hammerstein-Wiener (NLHW) estimator showing good data fitting results over other linear and nonlinear estimators in a statistical sense. Consequently, a few set of models using different functional variants of NLHW has been developed and their accuracy in detecting the on-off timing and intensity of the input light stimulus are compared for 19 independent plant datasets (including 2 additional species viz. Zamioculcas zamiifolia and Cucumis sativus) under similar experimental scenario.
△ Less
Submitted 20 October, 2014;
originally announced October 2014.
-
Efficient Controller Synthesis for Consumption Games with Multiple Resource Types
Authors:
Tomáš Brázdil,
Krishnendu Chatterjee,
Antonín Kučera,
Petr Novotný
Abstract:
We introduce consumption games, a model for discrete interactive system with multiple resources that are consumed or reloaded independently. More precisely, a consumption game is a finite-state graph where each transition is labeled by a vector of resource updates, where every update is a non-positive number or omega. The omega updates model the reloading of a given resource. Each vertex belongs e…
▽ More
We introduce consumption games, a model for discrete interactive system with multiple resources that are consumed or reloaded independently. More precisely, a consumption game is a finite-state graph where each transition is labeled by a vector of resource updates, where every update is a non-positive number or omega. The omega updates model the reloading of a given resource. Each vertex belongs either to player \Box or player \Diamond, where the aim of player \Box is to play so that the resources are never exhausted. We consider several natural algorithmic problems about consumption games, and show that although these problems are computationally hard in general, they are solvable in polynomial time for every fixed number of resource types (i.e., the dimension of the update vectors).
△ Less
Submitted 31 May, 2012; v1 submitted 3 February, 2012;
originally announced February 2012.