-
Point-to-set Principle and Constructive Dimension Faithfulness
Authors:
Satyadev Nandakumar,
Subin Pulari,
Akhil S
Abstract:
We introduce a constructive analogue of $Φ$-dimension, a notion of Hausdorff dimension developed using a restricted class of coverings of a set. A class of coverings $Φ$ is said to be "faithful" to Hausdorff dimension if the $Φ$-dimension and Hausdorff dimension coincide for every set.
We prove a Point-to-Set Principle for $Φ$-dimension, through which we get Point-to-Set Principles for Hausdorff…
▽ More
We introduce a constructive analogue of $Φ$-dimension, a notion of Hausdorff dimension developed using a restricted class of coverings of a set. A class of coverings $Φ$ is said to be "faithful" to Hausdorff dimension if the $Φ$-dimension and Hausdorff dimension coincide for every set.
We prove a Point-to-Set Principle for $Φ$-dimension, through which we get Point-to-Set Principles for Hausdorff Dimension, continued-fraction dimension and dimension of Cantor Coverings as special cases. Using the Point-to-Set Principle for Cantor coverings and a new technique for the construction of sequences satisfying a certain Kolmogorov complexity condition, we show that the notions of faithfulness of Cantor coverings at the Hausdorff and constructive levels are equivalent.
We adapt the result by Albeverio, Ivanenko, Lebid, and Torbin to derive the necessary and sufficient conditions for the constructive dimension faithfulness of the coverings generated by the Cantor series expansion. This condition yields two general classes of representations of reals, one whose constructive dimensions that are equivalent to the constructive Hausdorff dimensions, and another, whose effective dimensions are different from the effective Hausdorff dimensions, completely classifying Cantor series expansions of reals.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Analysis of Linux-PRNG (Pseudo Random Number Generator)
Authors:
Ayush Bansal,
Pramod Subramanyan,
Satyadev Nandakumar
Abstract:
The Linux pseudorandom number generator (PRNG) is a PRNG with entropy inputs and is widely used in many security-related applications and protocols. This PRNG is written as an open-source code which is subject to regular changes. It has been analysed in the works of Gutterman et al., Lacharme et al., while in the meantime, several changes have been applied to the code, to counter the attacks prese…
▽ More
The Linux pseudorandom number generator (PRNG) is a PRNG with entropy inputs and is widely used in many security-related applications and protocols. This PRNG is written as an open-source code which is subject to regular changes. It has been analysed in the works of Gutterman et al., Lacharme et al., while in the meantime, several changes have been applied to the code, to counter the attacks presented since then. Our work describes the Linux PRNG of kernel versions 5.3 and upwards. We discuss the PRNG architecture briefly and in detail about the entropy mixing function.
Our goal is to study the entropy mixing function and analyse it over two properties, namely, injectivity and length of the longest chain. For this purpose, we will be using SAT solving and model counting over targetted formulas involving multiple states of the Linux entropy store.
△ Less
Submitted 6 December, 2023;
originally announced December 2023.
-
Effective Continued Fraction Dimension versus Effective Hausdorff Dimension of Reals
Authors:
Satyadev Nandakumar,
Akhil S,
Prateek Vishnoi
Abstract:
We establish that constructive continued fraction dimension originally defined using $s$-gales is robust, but surprisingly, that the effective continued fraction dimension and effective (base-$b$) Hausdorff dimension of the same real can be unequal in general.
We initially provide an equivalent characterization of continued fraction dimension using Kolmogorov complexity. In the process, we const…
▽ More
We establish that constructive continued fraction dimension originally defined using $s$-gales is robust, but surprisingly, that the effective continued fraction dimension and effective (base-$b$) Hausdorff dimension of the same real can be unequal in general.
We initially provide an equivalent characterization of continued fraction dimension using Kolmogorov complexity. In the process, we construct an optimal lower semi-computable $s$-gale for continued fractions. We also prove new bounds on the Lebesgue measure of continued fraction cylinders, which may be of independent interest.
We apply these bounds to reveal an unexpected behavior of continued fraction dimension. It is known that feasible dimension is invariant with respect to base conversion. We also know that Martin-Löf randomness and computable randomness are invariant not only with respect to base conversion, but also with respect to the continued fraction representation. In contrast, for any $0 < \varepsilon < 0.5$, we prove the existence of a real whose effective Hausdorff dimension is less than $\varepsilon$, but whose effective continued fraction dimension is greater than or equal to $0.5$. This phenomenon is related to the ``non-faithfulness'' of certain families of covers, investigated by Peres and Torbin and by Albeverio, Ivanenko, Lebid and Torbin.
We also establish that for any real, the constructive Hausdorff dimension is at most its effective continued fraction dimension.
△ Less
Submitted 15 August, 2023;
originally announced August 2023.
-
Finite-State Relative Dimension, dimensions of A. P. subsequences and a Finite-State van Lambalgen's theorem
Authors:
Satyadev Nandakumar,
Subin Pulari,
Akhil S
Abstract:
Finite-state dimension (Dai, Lathrop, Lutz, and Mayordomo (2004)) quantifies the information rate in an infinite sequence as measured by finite-state automata. In this paper, we define a relative version of finite-state dimension. The finite-state relative dimension $dim_{FS}^Y(X)$ of a sequence $X$ relative to $Y$ is the finite-state dimension of $X$ measured using the class of finite-state gambl…
▽ More
Finite-state dimension (Dai, Lathrop, Lutz, and Mayordomo (2004)) quantifies the information rate in an infinite sequence as measured by finite-state automata. In this paper, we define a relative version of finite-state dimension. The finite-state relative dimension $dim_{FS}^Y(X)$ of a sequence $X$ relative to $Y$ is the finite-state dimension of $X$ measured using the class of finite-state gamblers with an oracle access to $Y$. We show its mathematical robustness by equivalently characterizing this notion using the relative block entropy rate of $X$ conditioned on $Y$.
We derive inequalities relating the dimension of a sequence to the relative dimension of its subsequences along any arithmetic progression (A.P.). These enable us to obtain a strengthening of Wall's Theorem on the normality of A.P. subsequences of a normal number, in terms of relative dimension. In contrast to the original theorem, this stronger version has an exact converse yielding a new characterization of normality.
We also obtain finite-state analogues of van Lambalgen's theorem on the symmetry of relative normality.
△ Less
Submitted 11 May, 2023;
originally announced May 2023.
-
Hardware-aware training for large-scale and diverse deep learning inference workloads using in-memory computing-based accelerators
Authors:
Malte J. Rasch,
Charles Mackin,
Manuel Le Gallo,
An Chen,
Andrea Fasoli,
Frederic Odermatt,
Ning Li,
S. R. Nandakumar,
Pritish Narayanan,
Hsinyu Tsai,
Geoffrey W. Burr,
Abu Sebastian,
Vijay Narayanan
Abstract:
Analog in-memory computing (AIMC) -- a promising approach for energy-efficient acceleration of deep learning workloads -- computes matrix-vector multiplications (MVMs) but only approximately, due to nonidealities that often are non-deterministic or nonlinear. This can adversely impact the achievable deep neural network (DNN) inference accuracy as compared to a conventional floating point (FP) impl…
▽ More
Analog in-memory computing (AIMC) -- a promising approach for energy-efficient acceleration of deep learning workloads -- computes matrix-vector multiplications (MVMs) but only approximately, due to nonidealities that often are non-deterministic or nonlinear. This can adversely impact the achievable deep neural network (DNN) inference accuracy as compared to a conventional floating point (FP) implementation. While retraining has previously been suggested to improve robustness, prior work has explored only a few DNN topologies, using disparate and overly simplified AIMC hardware models. Here, we use hardware-aware (HWA) training to systematically examine the accuracy of AIMC for multiple common artificial intelligence (AI) workloads across multiple DNN topologies, and investigate sensitivity and robustness to a broad set of nonidealities. By introducing a new and highly realistic AIMC crossbar-model, we improve significantly on earlier retraining approaches. We show that many large-scale DNNs of various topologies, including convolutional neural networks (CNNs), recurrent neural networks (RNNs), and transformers, can in fact be successfully retrained to show iso-accuracy on AIMC. Our results further suggest that AIMC nonidealities that add noise to the inputs or outputs, not the weights, have the largest impact on DNN accuracy, and that RNNs are particularly robust to all nonidealities.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
Taranga DR1: Analysis of TESS Short Cadence data for years 1 and 2
Authors:
Sangeetha Nandakumar,
Mauro Barbieri,
Jeremy Tregloan-Reed
Abstract:
TESS (Transiting Exoplanet Survey Satellite) was launched in 2018 with the purpose of observing bright stars in the solar neighbourhood to search for transiting exoplanets. After the completion of the two year nominal mission, TESS has provided 2\,minute cadence photometry of over 200\,000 stars. This large collection of light curves opens the possibility to study the statistical and temporal prop…
▽ More
TESS (Transiting Exoplanet Survey Satellite) was launched in 2018 with the purpose of observing bright stars in the solar neighbourhood to search for transiting exoplanets. After the completion of the two year nominal mission, TESS has provided 2\,minute cadence photometry of over 200\,000 stars. This large collection of light curves opens the possibility to study the statistical and temporal properties of this ensemble of stars.
Most of the currently available data pipelines are designed to work on single sector at a time. We present a new TESS data pipeline called {\tt Taranga}, with the purpose of merging multi-sector light curves, whilst performing a period search for all the observed stars, and stores the statistical results in a database.
{\tt Taranga} pipeline has three components which 1) processes the PDCSAP fluxes of each sector and creates merged PDCSAP light curve, 2) performs a similar operation on the SAP fluxes, and 3) generates the periodograms of the merged SAP and PDCSAP light curves while performing peak identification.
For all the 232\,122 stars observed in short cadence in the nominal TESS mission, we provide the merged PDCSAP and SAP light-curves along with their periodograms. We provide a database that has the statistics of all the results produced from {\tt Taranga} of these stars.
△ Less
Submitted 28 August, 2022; v1 submitted 22 August, 2022;
originally announced August 2022.
-
Real numbers equally compressible in every base
Authors:
Satyadev Nandakumar,
Subin Pulari
Abstract:
This work solves an open question in finite-state compressibility posed by Lutz and Mayordomo about compressibility of real numbers in different bases.
Finite-state compressibility, or equivalently, finite-state dimension, quantifies the asymptotic lower density of information in an infinite sequence. Absolutely normal numbers, being finite-state incompressible in every base of expansion, are pr…
▽ More
This work solves an open question in finite-state compressibility posed by Lutz and Mayordomo about compressibility of real numbers in different bases.
Finite-state compressibility, or equivalently, finite-state dimension, quantifies the asymptotic lower density of information in an infinite sequence. Absolutely normal numbers, being finite-state incompressible in every base of expansion, are precisely those numbers which have finite-state dimension equal to $1$ in every base. At the other extreme, for example, every rational number has finite-state dimension equal to $0$ in every base.
Generalizing this, Lutz and Mayordomo (2021) posed the question: are there numbers which have absolute positive finite-state dimension strictly between 0 and 1 - equivalently, is there a real number $ξ$ and a compressibility ratio $s \in (0,1)$ such that for every base $b$, the compressibility ratio of the base-$b$ expansion of $ξ$ is precisely $s$? It is conceivable that there is no such number. Indeed, some works explore ``zero-one'' laws for other feasible dimensions - i.e. sequences with certain properties either have feasible dimension 0 or 1, taking no value strictly in between.
However, we answer the question of Lutz and Mayordomo affirmatively by proving a more general result. We show that given any sequence of rational numbers $\langle q_b \rangle$, we can explicitly construct a single number $ξ$ such that for any base $b$, the finite-state dimension/compression ratio of $ξ$ in base-$b$ is $q_b$. As a special case, this result implies the existence of absolutely dimensioned numbers for any given rational dimension between $0$ and $1$, as posed by Lutz and Mayordomo.
In our construction, we combine ideas from Wolfgang Schmidt's construction of absolutely normal numbers (1962), results regarding low discrepancy sequences and several new estimates related to exponential sums.
△ Less
Submitted 29 September, 2022; v1 submitted 12 August, 2022;
originally announced August 2022.
-
Multimodal Representation Learning With Text and Images
Authors:
Aishwarya Jayagopal,
Ankireddy Monica Aiswarya,
Ankita Garg,
Srinivasan Kolumam Nandakumar
Abstract:
In recent years, multimodal AI has seen an upward trend as researchers are integrating data of different types such as text, images, speech into modelling to get the best results. This project leverages multimodal AI and matrix factorization techniques for representation learning, on text and image data simultaneously, thereby employing the widely used techniques of Natural Language Processing (NL…
▽ More
In recent years, multimodal AI has seen an upward trend as researchers are integrating data of different types such as text, images, speech into modelling to get the best results. This project leverages multimodal AI and matrix factorization techniques for representation learning, on text and image data simultaneously, thereby employing the widely used techniques of Natural Language Processing (NLP) and Computer Vision. The learnt representations are evaluated using downstream classification and regression tasks. The methodology adopted can be extended beyond the scope of this project as it uses Auto-Encoders for unsupervised representation learning.
△ Less
Submitted 29 April, 2022;
originally announced May 2022.
-
Millimeter-Wave Sensing for Avoidance of High-Risk Ground Conditions for Mobile Robots
Authors:
Jamie Blanche,
Shivoh Chirayil Nandakumar,
Daniel Mitchell,
Sam Harper,
Keir Groves,
Andrew West,
Barry Lennox,
Simon Watson,
David Flynn,
Ikuo Yamamoto
Abstract:
Mobile robot autonomy has made significant advances in recent years, with navigation algorithms well developed and used commercially in certain well-defined environments, such as warehouses. The common link in usage scenarios is that the environments in which the robots are utilized have a high degree of certainty. Operating environments are often designed to be robot friendly, for example augment…
▽ More
Mobile robot autonomy has made significant advances in recent years, with navigation algorithms well developed and used commercially in certain well-defined environments, such as warehouses. The common link in usage scenarios is that the environments in which the robots are utilized have a high degree of certainty. Operating environments are often designed to be robot friendly, for example augmented reality markers are strategically placed and the ground is typically smooth, level, and clear of debris. For robots to be useful in a wider range of environments, especially environments that are not sanitized for their use, robots must be able to handle uncertainty. This requires a robot to incorporate new sensors and sources of information, and to be able to use this information to make decisions regarding navigation and the overall mission. When using autonomous mobile robots in unstructured and poorly defined environments, such as a natural disaster site or in a rural environment, ground condition is of critical importance and is a common cause of failure. Examples include loss of traction due to high levels of ground water, hidden cavities, or material boundary failures. To evaluate a non-contact sensing method to mitigate these risks, Frequency Modulated Continuous Wave (FMCW) radar is integrated with an Unmanned Ground Vehicle (UGV), representing a novel application of FMCW to detect new measurands for Robotic Autonomous Systems (RAS) navigation, informing on terrain integrity and adding to the state-of-the-art in sensing for optimized autonomous path planning. In this paper, the FMCW is first evaluated in a desktop setting to determine its performance in anticipated ground conditions. The FMCW is then fixed to a UGV and the sensor system is tested and validated in a representative environment containing regions with significant levels of ground water saturation.
△ Less
Submitted 30 March, 2022;
originally announced March 2022.
-
Addressing Non-Intervention Challenges via Resilient Robotics utilizing a Digital Twin
Authors:
Sam Harper,
Shivoh Nandakumar,
Daniel Mitchell,
Jamie Blanche,
Theodore Lim,
David Flynn
Abstract:
Multi-robot systems face challenges in reducing human interventions as they are often deployed in dangerous environments. It is therefore necessary to include a methodology to assess robot failure rates to reduce the requirement for costly human intervention. A solution to this problem includes robots with the ability to work together to ensure mission resilience. To prevent this intervention, rob…
▽ More
Multi-robot systems face challenges in reducing human interventions as they are often deployed in dangerous environments. It is therefore necessary to include a methodology to assess robot failure rates to reduce the requirement for costly human intervention. A solution to this problem includes robots with the ability to work together to ensure mission resilience. To prevent this intervention, robots should be able to work together to ensure mission resilience. However, robotic platforms generally lack built-in interconnectivity with other platforms from different vendors. This work aims to tackle this issue by enabling the functionality through a bidirectional digital twin. The twin enables the human operator to transmit and receive information to and from the multi-robot fleet. This digital twin considers mission resilience and autonomous and human-led decision making to enable the resilience of a multi-robot fleet. This creates the cooperation, corroboration, and collaboration of diverse robots to leverage the capability of robots and support recovery of a failed robot.
△ Less
Submitted 27 November, 2022; v1 submitted 29 March, 2022;
originally announced March 2022.
-
Bio-inspired Multi-robot Autonomy
Authors:
Shivoh Chirayil Nandakumar,
Samuel Harper,
Daniel Mitchell,
Jamie Blanche,
Theodore Lim,
Ikuo Yamamoto,
David Flynn
Abstract:
Increasingly, high value industrial markets are driving trends for improved functionality and resilience from resident autonomous systems. This led to an increase in multi-robot fleets that aim to leverage the complementary attributes of the diverse platforms. In this paper we introduce a novel bio-inspired Symbiotic System of Systems Approach (SSOSA) for designing the operational governance of a…
▽ More
Increasingly, high value industrial markets are driving trends for improved functionality and resilience from resident autonomous systems. This led to an increase in multi-robot fleets that aim to leverage the complementary attributes of the diverse platforms. In this paper we introduce a novel bio-inspired Symbiotic System of Systems Approach (SSOSA) for designing the operational governance of a multi-robot fleet consisting of ground-based quadruped and wheeled platforms. SSOSA couples the MR-fleet to the resident infrastructure monitoring systems into one collaborative digital commons. The hyper visibility of the integrated distributed systems, achieved through a latency bidirectional communication network, supports collaboration, coordination and corroboration (3C) across the integrated systems. In our experiment, we demonstrate how an operator can activate a pre-determined autonomous mission and utilize SSOSA to overcome intrinsic and external risks to the autonomous missions. We demonstrate how resilience can be enhanced by local collaboration between SPOT and Husky wherein we detect a replacement battery, and utilize the manipulator arm of SPOT to support a Clearpath Husky A200 wheeled robotic platform. This allows for increased resilience of an autonomous mission as robots can collaborate to ensure the battery state of the Husky robot. Overall, these initial results demonstrate the value of a SSOSA approach in addressing a key operational barrier to scalable autonomy, the resilience.
△ Less
Submitted 15 March, 2022;
originally announced March 2022.
-
AnalogNets: ML-HW Co-Design of Noise-robust TinyML Models and Always-On Analog Compute-in-Memory Accelerator
Authors:
Chuteng Zhou,
Fernando Garcia Redondo,
Julian Büchel,
Irem Boybat,
Xavier Timoneda Comas,
S. R. Nandakumar,
Shidhartha Das,
Abu Sebastian,
Manuel Le Gallo,
Paul N. Whatmough
Abstract:
Always-on TinyML perception tasks in IoT applications require very high energy efficiency. Analog compute-in-memory (CiM) using non-volatile memory (NVM) promises high efficiency and also provides self-contained on-chip model storage. However, analog CiM introduces new practical considerations, including conductance drift, read/write noise, fixed analog-to-digital (ADC) converter gain, etc. These…
▽ More
Always-on TinyML perception tasks in IoT applications require very high energy efficiency. Analog compute-in-memory (CiM) using non-volatile memory (NVM) promises high efficiency and also provides self-contained on-chip model storage. However, analog CiM introduces new practical considerations, including conductance drift, read/write noise, fixed analog-to-digital (ADC) converter gain, etc. These additional constraints must be addressed to achieve models that can be deployed on analog CiM with acceptable accuracy loss. This work describes $\textit{AnalogNets}$: TinyML models for the popular always-on applications of keyword spotting (KWS) and visual wake words (VWW). The model architectures are specifically designed for analog CiM, and we detail a comprehensive training methodology, to retain accuracy in the face of analog non-idealities, and low-precision data converters at inference time. We also describe AON-CiM, a programmable, minimal-area phase-change memory (PCM) analog CiM accelerator, with a novel layer-serial approach to remove the cost of complex interconnects associated with a fully-pipelined design. We evaluate the AnalogNets on a calibrated simulator, as well as real hardware, and find that accuracy degradation is limited to 0.8$\%$/1.2$\%$ after 24 hours of PCM drift (8-bit) for KWS/VWW. AnalogNets running on the 14nm AON-CiM accelerator demonstrate 8.58/4.37 TOPS/W for KWS/VWW workloads using 8-bit activations, respectively, and increasing to 57.39/25.69 TOPS/W with $4$-bit activations.
△ Less
Submitted 10 November, 2021;
originally announced November 2021.
-
A Weyl Criterion for Finite-State Dimension and Applications
Authors:
Jack H. Lutz,
Satyadev Nandakumar,
Subin Pulari
Abstract:
Finite-state dimension, introduced early in this century as a finite-state version of classical Hausdorff dimension, is a quantitative measure of the lower asymptotic density of information in an infinite sequence over a finite alphabet, as perceived by finite automata. Finite-state dimension is a robust concept that now has equivalent formulations in terms of finite-state gambling, lossless finit…
▽ More
Finite-state dimension, introduced early in this century as a finite-state version of classical Hausdorff dimension, is a quantitative measure of the lower asymptotic density of information in an infinite sequence over a finite alphabet, as perceived by finite automata. Finite-state dimension is a robust concept that now has equivalent formulations in terms of finite-state gambling, lossless finite-state data compression, finite-state prediction, entropy rates, and automatic Kolmogorov complexity. The Schnorr-Stimm dichotomy theorem gave the first automata-theoretic characterization of normal sequences, which had been studied in analytic number theory since Borel defined them. This theorem implies that a sequence (or a real number having this sequence as its base-b expansion) is normal if and only if it has finite-state dimension 1. One of the most powerful classical tools for investigating normal numbers is the Weyl criterion, which characterizes normality in terms of exponential sums. Such sums are well studied objects with many connections to other aspects of analytic number theory, and this has made use of Weyl criterion especially fruitful. This raises the question whether Weyl criterion can be generalized from finite-state dimension 1 to arbitrary finite-state dimensions, thereby making it a quantitative tool for studying data compression, prediction, etc.
This paper does exactly this. We extend the Weyl criterion from a characterization of sequences with finite-state dimension 1 to a criterion that characterizes every finite-state dimension. This turns out not to be a routine generalization of the original Weyl criterion. Even though exponential sums may diverge for non-normal numbers, finite-state dimension can be characterized in terms of the dimensions of the subsequence limits of the exponential sums. We demonstrate the utility of our criterion though examples.
△ Less
Submitted 10 May, 2023; v1 submitted 7 November, 2021;
originally announced November 2021.
-
A pair of warm giant planets near the 2:1 mean motion resonance around the K-dwarf star TOI-2202
Authors:
Trifon Trifonov,
Rafael Brahm,
Nestor Espinoza,
Thomas Henning,
Andrés Jordán,
David Nesvorny,
Rebekah I. Dawson,
Jack J. Lissauer,
Man Hoi Lee,
Diana Kossakowski,
Felipe I. Rojas,
Melissa J. Hobson,
Paula Sarkis,
Martin Schlecker,
Bertram Bitsch,
Gaspar Á. Bakos,
Mauro Barbieri,
Waqas Bhatti,
R. Paul Butler,
Jeffrey D. Crane,
Sangeetha Nandakumar,
Matías R. Díaz,
Stephen Shectman,
Johanna Teske,
Pascal Torres
, et al. (15 additional authors not shown)
Abstract:
TOI-2202 b is a transiting warm Jovian-mass planet with an orbital period of P=11.91 days identified from the Full Frame Images data of five different sectors of the TESS mission. Ten TESS transits of TOI-2202 b combined with three follow-up light curves obtained with the CHAT robotic telescope show strong transit timing variations (TTVs) with an amplitude of about 1.2 hours. Radial velocity follo…
▽ More
TOI-2202 b is a transiting warm Jovian-mass planet with an orbital period of P=11.91 days identified from the Full Frame Images data of five different sectors of the TESS mission. Ten TESS transits of TOI-2202 b combined with three follow-up light curves obtained with the CHAT robotic telescope show strong transit timing variations (TTVs) with an amplitude of about 1.2 hours. Radial velocity follow-up with FEROS, HARPS and PFS confirms the planetary nature of the transiting candidate (a$_{\rm b}$ = 0.096 $\pm$ 0.002 au, m$_{\rm b}$ = 0.98 $\pm$ 0.06 M$_{\rm Jup}$), and dynamical analysis of RVs, transit data, and TTVs points to an outer Saturn-mass companion (a$_{\rm c}$ = 0.155 $\pm$ 0.003 au, m$_{\rm c}$= $0.37 \pm 0.10$ M$_{\rm Jup}$) near the 2:1 mean motion resonance. Our stellar modeling indicates that TOI-2202 is an early K-type star with a mass of 0.82 M$_\odot$, a radius of 0.79 R$_\odot$, and solar-like metallicity. The TOI-2202 system is very interesting because of the two warm Jovian-mass planets near the 2:1 MMR, which is a rare configuration, and their formation and dynamical evolution are still not well understood.
△ Less
Submitted 11 August, 2021;
originally announced August 2021.
-
Precise transit and radial-velocity characterization of a resonant pair: a warm Jupiter TOI-216c and eccentric warm Neptune TOI-216b
Authors:
Rebekah I. Dawson,
Chelsea X. Huang,
Rafael Brahm,
Karen A. Collins,
Melissa J. Hobson,
Andrés Jordán,
Jiayin Dong,
Judith Korth,
Trifon Trifonov,
Lyu Abe,
Abdelkrim Agabi,
Ivan Bruni,
R. Paul Butler,
Mauro Barbieri,
Kevin I. Collins,
Dennis M. Conti,
Jeffrey D. Crane,
Nicolas Crouzet,
Georgina Dransfield,
Phil Evans,
Néstor Espinoza,
Tianjun Gan,
Tristan Guillot,
Thomas Henning,
Jack J. Lissauer
, et al. (31 additional authors not shown)
Abstract:
TOI-216 hosts a pair of warm, large exoplanets discovered by the TESS Mission. These planets were found to be in or near the 2:1 resonance, and both of them exhibit transit timing variations (TTVs). Precise characterization of the planets' masses and radii, orbital properties, and resonant behavior can test theories for the origins of planets orbiting close to their stars. Previous characterizatio…
▽ More
TOI-216 hosts a pair of warm, large exoplanets discovered by the TESS Mission. These planets were found to be in or near the 2:1 resonance, and both of them exhibit transit timing variations (TTVs). Precise characterization of the planets' masses and radii, orbital properties, and resonant behavior can test theories for the origins of planets orbiting close to their stars. Previous characterization of the system using the first six sectors of TESS data suffered from a degeneracy between planet mass and orbital eccentricity. Radial velocity measurements using HARPS, FEROS, and PFS break that degeneracy, and an expanded TTV baseline from TESS and an ongoing ground-based transit observing campaign increase the precision of the mass and eccentricity measurements. We determine that TOI-216c is a warm Jupiter, TOI-216b is an eccentric warm Neptune, and that they librate in the 2:1 resonance with a moderate libration amplitude of 60 +/- 2 degrees; small but significant free eccentricity of 0.0222 +0.0005/-0.0003 for TOI-216b; and small but significant mutual inclination of 1.2-3.9 degrees (95% confidence interval). The libration amplitude, free eccentricity, and mutual inclination imply a disturbance of TOI-216b before or after resonance capture, perhaps by an undetected third planet.
△ Less
Submitted 12 February, 2021;
originally announced February 2021.
-
Ergodic Theorems for PSPACE functions and their converses
Authors:
Satyadev Nandakumar,
Subin Pulari
Abstract:
We initiate the study of effective pointwise ergodic theorems in resource-bounded settings. Classically, the convergence of the ergodic averages for integrable functions can be arbitrarily slow. In contrast, we show that for a class of PSPACE L1 functions, and a class of PSPACE computable measure-preserving ergodic transformations, the ergodic average exists for all PSPACE randoms and is equal to…
▽ More
We initiate the study of effective pointwise ergodic theorems in resource-bounded settings. Classically, the convergence of the ergodic averages for integrable functions can be arbitrarily slow. In contrast, we show that for a class of PSPACE L1 functions, and a class of PSPACE computable measure-preserving ergodic transformations, the ergodic average exists for all PSPACE randoms and is equal to the space average on every EXP random. We establish a partial converse that PSPACE non-randomness can be characterized as non-convergence of ergodic averages. Further, we prove that there is a class of resource-bounded randoms, viz. SUBEXP-space randoms, on which the corresponding ergodic theorem has an exact converse - a point x is SUBEXP-space random if and only if the corresponding effective ergodic theorem holds for x.
△ Less
Submitted 14 February, 2021; v1 submitted 21 December, 2020;
originally announced December 2020.
-
Revisiting the HD 21749 Planetary System with Stellar Activity Modeling
Authors:
Tianjun Gan,
Sharon Xuesong Wang,
Johanna K. Teske,
Shude Mao,
Ward S. Howard,
Nicholas M. Law,
Natasha E. Batalha,
Andrew Vanderburg,
Diana Dragomir,
Chelsea X. Huang,
Fabo Feng,
R. Paul Butler,
Jeffrey D. Crane,
Stephen A. Shectman,
Yuri Beletsky,
Avi Shporer,
Benjamin T. Montet,
Jennifer A. Burt,
Adina D. Feinstein,
Erin Flowers,
Sangeetha Nandakumar,
Mauro Barbieri,
Hank Corbett,
Jeffrey K. Ratzloff,
Nathan Galliher
, et al. (4 additional authors not shown)
Abstract:
HD 21749 is a bright ($V=8.1$ mag) K dwarf at 16 pc known to host an inner terrestrial planet HD 21749c as well as an outer sub-Neptune HD 21749b, both delivered by TESS. Follow-up spectroscopic observations measured the mass of HD 21749b to be $22.7\pm2.2\ M_{\oplus}$ with a density of $7.0^{+1.6}_{-1.3}$ g~cm$^{-3}$, making it one of the densest sub-Neptunes. However, the mass measurement was su…
▽ More
HD 21749 is a bright ($V=8.1$ mag) K dwarf at 16 pc known to host an inner terrestrial planet HD 21749c as well as an outer sub-Neptune HD 21749b, both delivered by TESS. Follow-up spectroscopic observations measured the mass of HD 21749b to be $22.7\pm2.2\ M_{\oplus}$ with a density of $7.0^{+1.6}_{-1.3}$ g~cm$^{-3}$, making it one of the densest sub-Neptunes. However, the mass measurement was suspected to be influenced by stellar rotation. Here we present new high-cadence PFS RV data to disentangle the stellar activity signal from the planetary signal. We find that HD 21749 has a similar rotational timescale as the planet's orbital period, and the amplitude of the planetary orbital RV signal is estimated to be similar to that of the stellar activity signal. We perform Gaussian Process (GP) regression on the photometry and RVs from HARPS and PFS to model the stellar activity signal. Our new models reveal that HD 21749b has a radius of $2.86\pm0.20\ R_{\oplus}$, an orbital period of $35.6133\pm0.0005$ d with a mass of $M_{b}=20.0\pm2.7\ M_{\oplus}$ and a density of $4.8^{+2.0}_{-1.4}$ g~cm$^{-3}$ on an eccentric orbit with $e=0.16\pm0.06$, which is consistent with the most recent values published for this system. HD 21749c has an orbital period of $7.7902\pm0.0006$ d, a radius of $1.13\pm0.10\ R_{\oplus}$, and a 3$σ$ mass upper limit of $3.5\ M_{\oplus}$. Our Monte Carlo simulations confirm that without properly taking stellar activity signals into account, the mass measurement of HD 21749b is likely to arrive at a significantly underestimated error bar.
△ Less
Submitted 9 December, 2020;
originally announced December 2020.
-
The CARMENES search for exoplanets around M dwarfs -- LP 714-47b (TOI 442.01): Populating the Neptune desert
Authors:
S. Dreizler,
I.,
J.,
M. Crossfield,
D. Kossakowski,
P. Plavchan,
S.,
V. Jeffers,
J. Kemmer,
R. Luque,
N. Espinoza,
E. Pallé,
K. Stassun,
E. Matthews,
B. Cale,
J.,
A. Caballero,
M. Schlecker,
J. Lillo-Box,
M. Zechmeister,
S. Lalitha,
A. Reiners,
A. Soubkiou,
B. Bitsch,
M.
, et al. (130 additional authors not shown)
Abstract:
We report the discovery of a Neptune-like planet (LP 714-47 b, P = 4.05204 d, m_b = 30.8 +/- 1.5 M_earth , R_b = 4.7 +/- 0.3 R_earth ) located in the 'hot Neptune desert'. Confirmation of the TESS Object of Interest (TOI 442.01) was achieved with radial-velocity follow-up using CARMENES, ESPRESSO, HIRES, iSHELL, and PFS, as well as from photometric data using TESS, Spitzer, and ground-based photom…
▽ More
We report the discovery of a Neptune-like planet (LP 714-47 b, P = 4.05204 d, m_b = 30.8 +/- 1.5 M_earth , R_b = 4.7 +/- 0.3 R_earth ) located in the 'hot Neptune desert'. Confirmation of the TESS Object of Interest (TOI 442.01) was achieved with radial-velocity follow-up using CARMENES, ESPRESSO, HIRES, iSHELL, and PFS, as well as from photometric data using TESS, Spitzer, and ground-based photometry from MuSCAT2, TRAPPIST- South, MONET-South, the George Mason University telescope, the Las Cumbres Observatory Global Telescope network, the El Sauce telescope, the TUBITAK National Observatory, the University of Louisville Manner Telescope, and WASP-South. We also present high-spatial resolution adaptive optics imaging with the Gemini Near-Infrared Imager. The low uncertainties in the mass and radius determination place LP 714-47 b among physically well-characterised planets, allowing for a meaningful comparison with planet structure models. The host star LP 714-47 is a slowly rotating early M dwarf (T_eff = 3950 +/- 51 K) with a mass of 0.59 +/- 0.02 M_sun and a radius of 0.58 +/- 0.02 R_sun. From long-term photometric monitoring and spectroscopic activity indicators, we determine a stellar rotation period of about 33 d. The stellar activity is also manifested as correlated noise in the radial-velocity data. In the power spectrum of the radial-velocity data, we detect a second signal with a period of 16 days in addition to the four-day signal of the planet. This could be shown to be a harmonic of the stellar rotation period or the signal of a second planet. It may be possible to tell the difference once more TESS data and radial-velocity data are obtained.
△ Less
Submitted 3 November, 2020;
originally announced November 2020.
-
Cluster Difference Imaging Photometric Survey. II. TOI 837: A Young Validated Planet in IC 2602
Authors:
L. G. Bouma,
J. D. Hartman,
R. Brahm,
P. Evans,
K. A. Collins,
G. Zhou,
P. Sarkis,
S. N. Quinn,
J. de Leon,
J. Livingston,
C. Bergmann,
K. G. Stassun,
W. Bhatti,
J. N. Winn,
G. Á Bakos,
L. Abe,
N. Crouzet,
G. Dransfield,
T. Guillot,
W. Marie-Sainte,
D. Mékarnia,
A. H. M. J. Triaud,
C. G. Tinney,
T. Henning,
N. Espinoza
, et al. (20 additional authors not shown)
Abstract:
We report the discovery of TOI 837b and its validation as a transiting planet. We characterize the system using data from the NASA TESS mission, the ESA Gaia mission, ground-based photometry from El Sauce and ASTEP400, and spectroscopy from CHIRON, FEROS, and Veloce. We find that TOI 837 is a $T=9.9$ mag G0/F9 dwarf in the southern open cluster IC 2602. The star and planet are therefore…
▽ More
We report the discovery of TOI 837b and its validation as a transiting planet. We characterize the system using data from the NASA TESS mission, the ESA Gaia mission, ground-based photometry from El Sauce and ASTEP400, and spectroscopy from CHIRON, FEROS, and Veloce. We find that TOI 837 is a $T=9.9$ mag G0/F9 dwarf in the southern open cluster IC 2602. The star and planet are therefore $35^{+11}_{-5}$ million years old. Combining the transit photometry with a prior on the stellar parameters derived from the cluster color-magnitude diagram, we find that the planet has an orbital period of $8.3\,{\rm d}$ and is slightly smaller than Jupiter ($R_{\rm p} = 0.77^{+0.09}_{-0.07} \,R_{\rm Jup}$). From radial velocity monitoring, we limit $M_{\rm p}\sin i$ to less than 1.20 $M_{\rm Jup}$ (3-$σ$). The transits either graze or nearly graze the stellar limb. Grazing transits are a cause for concern, as they are often indicative of astrophysical false positive scenarios. Our follow-up data show that such scenarios are unlikely. Our combined multi-color photometry, high-resolution imaging, and radial velocities rule out hierarchical eclipsing binary scenarios. Background eclipsing binary scenarios, though limited by speckle imaging, remain a 0.2% possibility. TOI 837b is therefore a validated adolescent exoplanet. The planetary nature of the system can be confirmed or refuted through observations of the stellar obliquity and the planetary mass. Such observations may also improve our understanding of how the physical and orbital properties of exoplanets change in time.
△ Less
Submitted 16 September, 2020;
originally announced September 2020.
-
Mixed-precision deep learning based on computational memory
Authors:
S. R. Nandakumar,
Manuel Le Gallo,
Christophe Piveteau,
Vinay Joshi,
Giovanni Mariani,
Irem Boybat,
Geethan Karunaratne,
Riduan Khaddam-Aljameh,
Urs Egger,
Anastasios Petropoulos,
Theodore Antonakopoulos,
Bipin Rajendran,
Abu Sebastian,
Evangelos Eleftheriou
Abstract:
Deep neural networks (DNNs) have revolutionized the field of artificial intelligence and have achieved unprecedented success in cognitive tasks such as image and speech recognition. Training of large DNNs, however, is computationally intensive and this has motivated the search for novel computing architectures targeting this application. A computational memory unit with nanoscale resistive memory…
▽ More
Deep neural networks (DNNs) have revolutionized the field of artificial intelligence and have achieved unprecedented success in cognitive tasks such as image and speech recognition. Training of large DNNs, however, is computationally intensive and this has motivated the search for novel computing architectures targeting this application. A computational memory unit with nanoscale resistive memory devices organized in crossbar arrays could store the synaptic weights in their conductance states and perform the expensive weighted summations in place in a non-von Neumann manner. However, updating the conductance states in a reliable manner during the weight update process is a fundamental challenge that limits the training accuracy of such an implementation. Here, we propose a mixed-precision architecture that combines a computational memory unit performing the weighted summations and imprecise conductance updates with a digital processing unit that accumulates the weight updates in high precision. A combined hardware/software training experiment of a multilayer perceptron based on the proposed architecture using a phase-change memory (PCM) array achieves 97.73% test accuracy on the task of classifying handwritten digits (based on the MNIST dataset), within 0.6% of the software baseline. The architecture is further evaluated using accurate behavioral models of PCM on a wide class of networks, namely convolutional neural networks, long-short-term-memory networks, and generative-adversarial networks. Accuracies comparable to those of floating-point implementations are achieved without being constrained by the non-idealities associated with the PCM devices. A system-level study demonstrates 173x improvement in energy efficiency of the architecture when used for training a multilayer perceptron compared with a dedicated fully digital 32-bit implementation.
△ Less
Submitted 31 January, 2020;
originally announced January 2020.
-
Bio-mimetic Synaptic Plasticity and Learning in a sub-500mV Cu/SiO$_2$/W Memristor
Authors:
S. R. Nandakumar,
Bipin Rajendran
Abstract:
The computational efficiency of the human brain is believed to stem from the parallel information processing capability of neurons with integrated storage in synaptic interconnections programmed by local spike triggered learning rules such as spike timing dependent plasticity (STDP). The extremely low operating voltages (approximately $100\,$mV) used to trigger neuronal signaling and synaptic adap…
▽ More
The computational efficiency of the human brain is believed to stem from the parallel information processing capability of neurons with integrated storage in synaptic interconnections programmed by local spike triggered learning rules such as spike timing dependent plasticity (STDP). The extremely low operating voltages (approximately $100\,$mV) used to trigger neuronal signaling and synaptic adaptation is believed to be a critical reason for the brain's power efficiency. We demonstrate the feasibility of spike triggered STDP behavior in a two-terminal Cu/SiO$_2$/W memristive device capable of operating below $500\,$mV. We analyze the state-dependent nature of conductance updates in the device to develop a phenomenological model. Using the model, we evaluate the potential of such devices to generate precise spike times under supervised learning conditions and classify handwritten digits from the MNIST dataset in an unsupervised learning setting. The results form a promising step towards creating a low power synaptic device capable of on-chip learning.
△ Less
Submitted 15 March, 2020; v1 submitted 25 January, 2020;
originally announced January 2020.
-
TOI-677 b: A Warm Jupiter (P=11.2d) on an eccentric orbit transiting a late F-type star
Authors:
Andrés Jordán,
Rafael Brahm,
Néstor Espinoza,
Thomas Henning,
Matías I. Jones,
Diana Kossakowski,
Paula Sarkis,
Trifon Trifonov,
Felipe Rojas,
Pascal Torres,
Holger Drass,
Sangeetha Nandakumar,
Mauro Barbieri,
Allen Davis,
Songhu Wang,
Daniel Bayliss,
Luke Bouma,
Diana Dragomir,
Jason D. Eastman,
Tansu Daylan,
Natalia Guerrero,
Thomas Barclay,
Eric B. Ting,
Christopher E. Henze,
George Ricker
, et al. (24 additional authors not shown)
Abstract:
We report the discovery of TOI-677 b, first identified as a candidate in light curves obtained within Sectors 9 and 10 of the Transiting Exoplanet Survey Satellite (TESS) mission and confirmed with radial velocities. TOI-677 b has a mass of M_p = 1.236$^{+0.069}_{-0.067}$ M_J, a radius of R_p = 1.170 +- 0.03 R_J,and orbits its bright host star (V=9.8 mag) with an orbital period of 11.23660 +- 0.00…
▽ More
We report the discovery of TOI-677 b, first identified as a candidate in light curves obtained within Sectors 9 and 10 of the Transiting Exoplanet Survey Satellite (TESS) mission and confirmed with radial velocities. TOI-677 b has a mass of M_p = 1.236$^{+0.069}_{-0.067}$ M_J, a radius of R_p = 1.170 +- 0.03 R_J,and orbits its bright host star (V=9.8 mag) with an orbital period of 11.23660 +- 0.00011 d, on an eccentric orbit with e = 0.435 +- 0.024. The host star has a mass of M_* = 1.181 +- 0.058 M_sun, a radius of R_* = 1.28 +- 0.03 R_sun, an age of 2.92$^{+0.80}_{-0.73}$ Gyr and solar metallicity, properties consistent with a main sequence late F star with T_eff = 6295 +- 77 K. We find evidence in the radial velocity measurements of a secondary long term signal which could be due to an outer companion. The TOI-677 b system is a well suited target for Rossiter-Mclaughlin observations that can constrain migration mechanisms of close-in giant planets.
△ Less
Submitted 13 November, 2019;
originally announced November 2019.
-
Impartial binary decisions through qubits
Authors:
Sujan Vijayaraj,
S. Nandakumar
Abstract:
Binary decisions are the simplest form of decisions that are made in our daily lives. Examples include choosing a two-way path in a maze, accepting or declining an offer, etc. These decisions are also made by computers, machines and various electronic components. But decisions made on these devices can be partial and deterministic, and hence compromised. In this paper, a simple framework to implem…
▽ More
Binary decisions are the simplest form of decisions that are made in our daily lives. Examples include choosing a two-way path in a maze, accepting or declining an offer, etc. These decisions are also made by computers, machines and various electronic components. But decisions made on these devices can be partial and deterministic, and hence compromised. In this paper, a simple framework to implement binary decisions using one or many qubits is presented. Such systems are based on a separate hardware infrastructure rather than computer codes. This helps enable true randomness and impartial decision making. The multi-armed bandit problem is used to highlight the decision making ability of qubits by predictive modelling based on quantum Bayesianism. Bipartite and multipartite entangled states are also used to solve specific cases of the problem.
△ Less
Submitted 5 October, 2019; v1 submitted 23 September, 2019;
originally announced September 2019.
-
An analogue of Pillai's theorem for continued fraction normality and an application to subsequences
Authors:
Satyadev Nandakumar,
Subin Pulari,
Prateek Vishnoi,
Gopal Viswanathan
Abstract:
We show that two notions of continued fraction normality, one where overlap** occurrences of finite patterns are counted as distinct occurrences, and another where only disjoint occurrences are counted as distinct, are identical. This equivalence involves an analogue of a theorem due to S. S. Pillai in 1940 for base-$b$ expansions. The proof requires techniques which are fundamentally different,…
▽ More
We show that two notions of continued fraction normality, one where overlap** occurrences of finite patterns are counted as distinct occurrences, and another where only disjoint occurrences are counted as distinct, are identical. This equivalence involves an analogue of a theorem due to S. S. Pillai in 1940 for base-$b$ expansions. The proof requires techniques which are fundamentally different, since the continued fraction expansion utilizes a countably infinite alphabet, leading to a non-compact space. Utilizing the equivalence of these two notions, we provide a new proof of Heersink and Vandehey's recent result that selection of subsequences along arithmetic progressions does not preserve continued fraction normality.
△ Less
Submitted 10 September, 2019; v1 submitted 8 September, 2019;
originally announced September 2019.
-
Cartilage-binding antibodies induce pain through immune complex-mediated activation of neurons
Authors:
Alex Bersellini Farinotti,
Gustaf Wigerblad,
Diana Nascimento,
Duygu B Bas,
Carlos Morado Urbina,
Kutty Selva Nandakumar,
Katalin Sandor,
Bingze Xu,
Sally Abdelmoaty,
Matthew A Hunt,
Kristina Ängeby Möller,
Azar Baharpoor,
Jon Sinclair,
Kent Jardemark,
Johanna T Lanner,
Ia Khmaladze,
Lars E. Borm,
Lu Zhang,
Fredrik Wermeling,
Mark S Cragg,
Johan Lengqvist,
Anne-Julie Chabot-Doré,
Luda Diatchenko,
Inna Belfer,
Mattias Collin
, et al. (6 additional authors not shown)
Abstract:
Rheumatoid arthritis-associated joint pain is frequently observed independent of disease activity, suggesting unidentified pain mechanisms. We demonstrate that antibodies binding to cartilage, specific for collagen type II (CII) or cartilage oligomeric matrix protein (COMP), elicit mechanical hypersensitivity in mice, uncoupled from visual, histological and molecular indications of inflammation. C…
▽ More
Rheumatoid arthritis-associated joint pain is frequently observed independent of disease activity, suggesting unidentified pain mechanisms. We demonstrate that antibodies binding to cartilage, specific for collagen type II (CII) or cartilage oligomeric matrix protein (COMP), elicit mechanical hypersensitivity in mice, uncoupled from visual, histological and molecular indications of inflammation. Cartilage antibody-induced pain-like behavior does not depend on complement activation or joint inflammation, but instead on tissue antigen recognition and local immune complex (IC) formation. smFISH and IHC suggest that neuronal Fcgr1 and Fcgr2b mRNA are transported to peripheral ends of primary afferents. CII-ICs directly activate cultured WT but not FcRγ chain-deficient DRG neurons. In line with this observation, CII-IC does not induce mechanical hypersensitivity in FcRγ chain-deficient mice. Furthermore, injection of CII antibodies does not generate pain-like behavior in FcRγ chain-deficient mice or mice lacking activating FcγRs in neurons. In summary, this study defines functional coupling between autoantibodies and pain transmission that may facilitate the development of new disease-relevant pain therapeutics.
△ Less
Submitted 8 August, 2019;
originally announced August 2019.
-
Accurate deep neural network inference using computational phase-change memory
Authors:
Vinay Joshi,
Manuel Le Gallo,
Simon Haefeli,
Irem Boybat,
S. R. Nandakumar,
Christophe Piveteau,
Martino Dazzi,
Bipin Rajendran,
Abu Sebastian,
Evangelos Eleftheriou
Abstract:
In-memory computing is a promising non-von Neumann approach for making energy-efficient deep learning inference hardware. Crossbar arrays of resistive memory devices can be used to encode the network weights and perform efficient analog matrix-vector multiplications without intermediate movements of data. However, due to device variability and noise, the network needs to be trained in a specific w…
▽ More
In-memory computing is a promising non-von Neumann approach for making energy-efficient deep learning inference hardware. Crossbar arrays of resistive memory devices can be used to encode the network weights and perform efficient analog matrix-vector multiplications without intermediate movements of data. However, due to device variability and noise, the network needs to be trained in a specific way so that transferring the digitally trained weights to the analog resistive memory devices will not result in significant loss of accuracy. Here, we introduce a methodology to train ResNet-type convolutional neural networks that results in no appreciable accuracy loss when transferring weights to in-memory computing hardware based on phase-change memory (PCM). We also propose a compensation technique that exploits the batch normalization parameters to improve the accuracy retention over time. We achieve a classification accuracy of 93.7% on the CIFAR-10 dataset and a top-1 accuracy on the ImageNet benchmark of 71.6% after map** the trained weights to PCM. Our hardware results on CIFAR-10 with ResNet-32 demonstrate an accuracy above 93.5% retained over a one day period, where each of the 361,722 synaptic weights of the network is programmed on just two PCM devices organized in a differential configuration.
△ Less
Submitted 11 April, 2020; v1 submitted 7 June, 2019;
originally announced June 2019.
-
Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses
Authors:
S. R. Nandakumar,
Irem Boybat,
Manuel Le Gallo,
Evangelos Eleftheriou,
Abu Sebastian,
Bipin Rajendran
Abstract:
Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more computationally efficient than the conventional artificial neural networks, though their full computational capabilities are yet to be explored. Recently, computa…
▽ More
Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more computationally efficient than the conventional artificial neural networks, though their full computational capabilities are yet to be explored. Recently, computational memory architectures based on non-volatile memory crossbar arrays have shown great promise to implement parallel computations in artificial and spiking neural networks. In this work, we experimentally demonstrate for the first time, the feasibility to realize high-performance event-driven in-situ supervised learning systems using nanoscale and stochastic phase-change synapses. Our SNN is trained to recognize audio signals of alphabets encoded using spikes in the time domain and to generate spike trains at precise time instances to represent the pixel intensities of their corresponding images. Moreover, with a statistical model capturing the experimental behavior of the devices, we investigate architectural and systems-level solutions for improving the training and inference performance of our computational memory-based system. Combining the computational potential of supervised SNNs with the parallel compute power of computational memory, the work paves the way for next-generation of efficient brain-inspired systems.
△ Less
Submitted 28 May, 2019;
originally announced May 2019.
-
Neuromorphic computing with multi-memristive synapses
Authors:
Irem Boybat,
Manuel Le Gallo,
S. R. Nandakumar,
Timoleon Moraitis,
Thomas Parnell,
Tomas Tuma,
Bipin Rajendran,
Yusuf Leblebici,
Abu Sebastian,
Evangelos Eleftheriou
Abstract:
Neuromorphic computing has emerged as a promising avenue towards building the next generation of intelligent computing systems. It has been proposed that memristive devices, which exhibit history-dependent conductivity modulation, could efficiently represent the synaptic weights in artificial neural networks. However, precise modulation of the device conductance over a wide dynamic range, necessar…
▽ More
Neuromorphic computing has emerged as a promising avenue towards building the next generation of intelligent computing systems. It has been proposed that memristive devices, which exhibit history-dependent conductivity modulation, could efficiently represent the synaptic weights in artificial neural networks. However, precise modulation of the device conductance over a wide dynamic range, necessary to maintain high network accuracy, is proving to be challenging. To address this, we present a multi-memristive synaptic architecture with an efficient global counter-based arbitration scheme. We focus on phase change memory devices, develop a comprehensive model and demonstrate via simulations the effectiveness of the concept for both spiking and non-spiking neural networks. Moreover, we present experimental results involving over a million phase change memory devices for unsupervised learning of temporal correlations using a spiking neural network. The work presents a significant step towards the realization of large-scale and energy-efficient neuromorphic computing systems.
△ Less
Submitted 24 February, 2019; v1 submitted 17 November, 2017;
originally announced November 2017.
-
Normality of the Ehrenfeucht-Mycielski Sequence
Authors:
Kundan Krishna,
Satyadev Nandakumar
Abstract:
We study the binary Ehrenfeucht Mycielski sequence seeking a balance between the number of occurrences of different binary strings. There have been numerous attempts to prove the balance conjecture of the sequence, which roughly states that 1 and 0 occur equally often in it. Our contribution is twofold. First, we study weaker forms of the conjecture proved in the past and lay out detailed proofs f…
▽ More
We study the binary Ehrenfeucht Mycielski sequence seeking a balance between the number of occurrences of different binary strings. There have been numerous attempts to prove the balance conjecture of the sequence, which roughly states that 1 and 0 occur equally often in it. Our contribution is twofold. First, we study weaker forms of the conjecture proved in the past and lay out detailed proofs for many lemmas which were stated without proofs. Secondly, we extend the claim of balance to that of normality and prove a weaker form of simple normality to word length 2.
△ Less
Submitted 3 October, 2017;
originally announced October 2017.
-
On Resource-bounded versions of the van Lambalgen theorem
Authors:
Diptarka Chakraborty,
Satyadev Nandakumar,
Himanshu Shukla
Abstract:
The van Lambalgen theorem is a surprising result in algorithmic information theory concerning the symmetry of relative randomness. It establishes that for any pair of infinite sequences $A$ and $B$, $B$ is Martin-Löf random and $A$ is Martin-Löf random relative to $B$ if and only if the interleaved sequence $A \uplus B$ is Martin-Löf random. This implies that $A$ is relative random to $B$ if and o…
▽ More
The van Lambalgen theorem is a surprising result in algorithmic information theory concerning the symmetry of relative randomness. It establishes that for any pair of infinite sequences $A$ and $B$, $B$ is Martin-Löf random and $A$ is Martin-Löf random relative to $B$ if and only if the interleaved sequence $A \uplus B$ is Martin-Löf random. This implies that $A$ is relative random to $B$ if and only if $B$ is random relative to $A$ \cite{vanLambalgen}, \cite{Nies09}, \cite{HirschfeldtBook}. This paper studies the validity of this phenomenon for different notions of time-bounded relative randomness.
We prove the classical van Lambalgen theorem using martingales and Kolmogorov compressibility. We establish the failure of relative randomness in these settings, for both time-bounded martingales and time-bounded Kolmogorov complexity. We adapt our classical proofs when applicable to the time-bounded setting, and construct counterexamples when they fail. The mode of failure of the theorem may depend on the notion of time-bounded randomness.
△ Less
Submitted 4 April, 2017;
originally announced April 2017.
-
Multiple Recurrence and Algorithmic Randomness
Authors:
Rodney G. Downey,
Satyadev Nandakumar,
Andre Nies
Abstract:
This work contributes to the programme of studying effective versions of "almost everywhere" theorems in analysis and ergodic theory via algorithmic randomness. We determine the level of randomness needed for a point in a Cantor space $ \{0,1\}^{\NN}$ with the uniform measure and the usual shift so that effective versions of the multiple recurrence theorem of Furstenberg holds for iterations start…
▽ More
This work contributes to the programme of studying effective versions of "almost everywhere" theorems in analysis and ergodic theory via algorithmic randomness. We determine the level of randomness needed for a point in a Cantor space $ \{0,1\}^{\NN}$ with the uniform measure and the usual shift so that effective versions of the multiple recurrence theorem of Furstenberg holds for iterations starting at the point. We consider recurrence into closed sets that possess various degrees of effectiveness: clopen, $\PPI$ with computable measure, and $\PPI$. The notions of Kurtz, Schnorr, and \ML\ randomness, respectively, turn out to be sufficient. We obtain similar results for multiple recurrence with respect to the $k$ commuting shift operators on $\{0,1\}^{\NN^{\normalsize k}}$.
△ Less
Submitted 9 May, 2016; v1 submitted 14 April, 2016;
originally announced April 2016.
-
Ornstein Isomorphism and Algorithmic Randomness
Authors:
Mrinalkanti Ghosh,
Satyadev Nandakumar,
Atanu Pal
Abstract:
In 1970, Donald Ornstein proved a landmark result in dynamical systems, viz., two Bernoulli systems with the same entropy are isomorphic except for a measure 0 set. Keane and Smorodinsky gave a finitary proof of this result. They also indicated how one can generalize the result to mixing Markov Shifts. We adapt their construction to show that if two computable mixing Markov systems have the same e…
▽ More
In 1970, Donald Ornstein proved a landmark result in dynamical systems, viz., two Bernoulli systems with the same entropy are isomorphic except for a measure 0 set. Keane and Smorodinsky gave a finitary proof of this result. They also indicated how one can generalize the result to mixing Markov Shifts. We adapt their construction to show that if two computable mixing Markov systems have the same entropy, then there is a layerwise computable isomorphism defined on all Martin-Lof random points in the system. Since the set of Martin-Lof random points forms a measure 1 set, it implies the classical result for such systems.
This result uses several recent developments in computable analysis and algorithmic randomness. Following the work by Braverman, Nandakumar, and Hoyrup and Rojas introduced discontinuous functions into the study of algorithmic randomness. We utilize Hoyrup and Rojas' elegant notion of layerwise computable functions to produce the test of randomness in our result. Further, we use the recent result of the effective Shannon-McMillan-Breiman theorem, independently established by Hochman and Hoyrup to prove the properties of our construction.
We show that the result cannot be improved to include all points in the systems - only trivial computable isomorphisms exist between systems with the same entropy.
△ Less
Submitted 4 March, 2016; v1 submitted 3 April, 2014;
originally announced April 2014.
-
Predictive Complexity and Generalized Entropy Rate of Stationary Ergodic Processes
Authors:
Mrinalkanti Ghosh,
Satyadev Nandakumar
Abstract:
In the online prediction framework, we use generalized entropy of to study the loss rate of predictors when outcomes are drawn according to stationary ergodic distributions over the binary alphabet. We show that the notion of generalized entropy of a regular game \cite{KVV04} is well-defined for stationary ergodic distributions. In proving this, we obtain new game-theoretic proofs of some classica…
▽ More
In the online prediction framework, we use generalized entropy of to study the loss rate of predictors when outcomes are drawn according to stationary ergodic distributions over the binary alphabet. We show that the notion of generalized entropy of a regular game \cite{KVV04} is well-defined for stationary ergodic distributions. In proving this, we obtain new game-theoretic proofs of some classical information theoretic inequalities. Using Birkhoff's ergodic theorem and convergence properties of conditional distributions, we prove that a classical Shannon-McMillan-Breiman theorem holds for a restricted class of regular games, when no computational constraints are imposed on the prediction strategies.
If a game is mixable, then there is an optimal aggregating strategy which loses at most an additive constant when compared to any other lower semicomputable strategy. The loss incurred by this algorithm on an infinite sequence of outcomes is called its predictive complexity. We use our version of Shannon-McMillan-Breiman theorem to prove that when a restriced regular game has a predictive complexity, the predictive complexity converges to the generalized entropy of the game almost everywhere with respect to the stationary ergodic distribution.
△ Less
Submitted 4 March, 2016; v1 submitted 14 May, 2012;
originally announced May 2012.
-
Normality and Finite-state Dimension of Liouville numbers
Authors:
Satyadev Nandakumar,
Santhosh Kumar Vangapelli
Abstract:
Liouville numbers were the first class of real numbers which were proven to be transcendental. It is easy to construct non-normal Liouville numbers. Kano and Bugeaud have proved, using analytic techniques, that there are normal Liouville numbers. Here, for a given base k >= 2, we give two simple constructions of a Liouville number which is normal to the base k.
The first construction is combinat…
▽ More
Liouville numbers were the first class of real numbers which were proven to be transcendental. It is easy to construct non-normal Liouville numbers. Kano and Bugeaud have proved, using analytic techniques, that there are normal Liouville numbers. Here, for a given base k >= 2, we give two simple constructions of a Liouville number which is normal to the base k.
The first construction is combinatorial, and is based on de Bruijn sequences. A real number in the unit interval is normal if and only if its finite-state dimension is 1. We generalize our construction to prove that for any rational r in the closed unit interval, there is a Liouville number with finite state dimension r. This refines Staiger's result that the set of Liouville numbers has constructive Hausdorff dimension zero, showing a new quantitative classification of Liouville numbers can be attained using finite-state dimension.
In the second number-theoretic construction, we use an arithmetic property of numbers - the existence of primitive roots - to construct Liouville numbers normal in finitely many bases, assuming a Generalized Artin's conjecture on primitive roots.
△ Less
Submitted 20 January, 2014; v1 submitted 18 April, 2012;
originally announced April 2012.
-
Axiomatizing Resource Bounds for Measure
Authors:
Xiaoyang Gu,
Jack H. Lutz,
Satyadev Nandakumar,
James S. Royer
Abstract:
Resource-bounded measure is a generalization of classical Lebesgue measure that is useful in computational complexity. The central parameter of resource-bounded measure is the {\it resource bound} $Δ$, which is a class of functions. When $Δ$ is unrestricted, i.e., contains all functions with the specified domains and codomains, resource-bounded measure coincides with classical Lebesgue measure. On…
▽ More
Resource-bounded measure is a generalization of classical Lebesgue measure that is useful in computational complexity. The central parameter of resource-bounded measure is the {\it resource bound} $Δ$, which is a class of functions. When $Δ$ is unrestricted, i.e., contains all functions with the specified domains and codomains, resource-bounded measure coincides with classical Lebesgue measure. On the other hand, when $Δ$ contains functions satisfying some complexity constraint, resource-bounded measure imposes internal measure structure on a corresponding complexity class.
Most applications of resource-bounded measure use only the "measure-zero/measure-one fragment" of the theory. For this fragment, $Δ$ can be taken to be a class of type-one functions (e.g., from strings to rationals). However, in the full theory of resource-bounded measurability and measure, the resource bound $Δ$ also contains type-two functionals. To date, both the full theory and its zero-one fragment have been developed in terms of a list of example resource bounds chosen for their apparent utility.
This paper replaces this list-of-examples approach with a careful investigation of the conditions that suffice for a class $Δ$ to be a resource bound. Our main theorem says that every class $Δ$ that has the closure properties of Mehlhorn's basic feasible functionals is a resource bound for measure.
We also prove that the type-2 versions of the time and space hierarchies that have been extensively used in resource-bounded measure have these closure properties. In the course of doing this, we prove theorems establishing that these time and space resource bounds are all robust.
△ Less
Submitted 31 January, 2012; v1 submitted 10 February, 2011;
originally announced February 2011.
-
Finite-State Dimension and Real Arithmetic
Authors:
David Doty,
Jack H. Lutz,
Satyadev Nandakumar
Abstract:
We use entropy rates and Schur concavity to prove that, for every integer k >= 2, every nonzero rational number q, and every real number alpha, the base-k expansions of alpha, q+alpha, and q*alpha all have the same finite-state dimension and the same finite-state strong dimension. This extends, and gives a new proof of, Wall's 1949 theorem stating that the sum or product of a nonzero rational nu…
▽ More
We use entropy rates and Schur concavity to prove that, for every integer k >= 2, every nonzero rational number q, and every real number alpha, the base-k expansions of alpha, q+alpha, and q*alpha all have the same finite-state dimension and the same finite-state strong dimension. This extends, and gives a new proof of, Wall's 1949 theorem stating that the sum or product of a nonzero rational number and a Borel normal number is always Borel normal.
△ Less
Submitted 8 February, 2006;
originally announced February 2006.
