-
Harnessing AI for efficient analysis of complex policy documents: a case study of Executive Order 14110
Authors:
Mark A. Kramer,
Allen Leavens,
Alexander Scarlat
Abstract:
Policy documents, such as legislation, regulations, and executive orders, are crucial in sha** society. However, their length and complexity make interpretation and application challenging and time-consuming. Artificial intelligence (AI), particularly large language models (LLMs), has the potential to automate the process of analyzing these documents, improving accuracy and efficiency. This stud…
▽ More
Policy documents, such as legislation, regulations, and executive orders, are crucial in sha** society. However, their length and complexity make interpretation and application challenging and time-consuming. Artificial intelligence (AI), particularly large language models (LLMs), has the potential to automate the process of analyzing these documents, improving accuracy and efficiency. This study aims to evaluate the potential of AI in streamlining policy analysis and to identify the strengths and limitations of current AI approaches. The research focuses on question answering and tasks involving content extraction from policy documents. A case study was conducted using Executive Order 14110 on "Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence" as a test case. Four commercial AI systems were used to analyze the document and answer a set of representative policy questions. The performance of the AI systems was compared to manual analysis conducted by human experts. The study found that two AI systems, Gemini 1.5 Pro and Claude 3 Opus, demonstrated significant potential for supporting policy analysis, providing accurate and reliable information extraction from complex documents. They performed comparably to human analysts but with significantly higher efficiency. However, achieving reproducibility remains a challenge, necessitating further research and development.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Golden rhythms as a theoretical framework for cross-frequency organization
Authors:
Mark A. Kramer
Abstract:
While brain rhythms appear fundamental to brain function, why brain rhythms consistently organize into the small set of discrete frequency bands observed remains unknown. Here we propose that rhythms separated by factors of the golden ratio ($φ=(1+ \sqrt{5})/2$) optimally support segregation and cross-frequency integration of information transmission in the brain. Organized by the golden ratio, pa…
▽ More
While brain rhythms appear fundamental to brain function, why brain rhythms consistently organize into the small set of discrete frequency bands observed remains unknown. Here we propose that rhythms separated by factors of the golden ratio ($φ=(1+ \sqrt{5})/2$) optimally support segregation and cross-frequency integration of information transmission in the brain. Organized by the golden ratio, pairs of transient rhythms support multiplexing by reducing interference between separate communication channels, and triplets of transient rhythms support integration of signals to establish a hierarchy of cross-frequency interactions. We illustrate this framework in simulation and apply this framework to propose four hypotheses.
△ Less
Submitted 14 October, 2022; v1 submitted 18 November, 2021;
originally announced November 2021.
-
Inferring the Type of Phase Transitions Undergone in Epileptic Seizures Using Random Graph Hidden Markov Models for Percolation in Noisy Dynamic Networks
Authors:
Xiao**g Zhu,
Heather Shappell,
Mark A. Kramer,
Catherine J. Chu,
Eric D. Kolaczyk
Abstract:
In clinical neuroscience, epileptic seizures have been associated with the sudden emergence of coupled activity across the brain. The resulting functional networks - in which edges indicate strong enough coupling between brain regions - are consistent with the notion of percolation, which is a phenomenon in complex networks corresponding to the sudden emergence of a giant connected component. Trad…
▽ More
In clinical neuroscience, epileptic seizures have been associated with the sudden emergence of coupled activity across the brain. The resulting functional networks - in which edges indicate strong enough coupling between brain regions - are consistent with the notion of percolation, which is a phenomenon in complex networks corresponding to the sudden emergence of a giant connected component. Traditionally, work has concentrated on noise-free percolation with a monotonic process of network growth, but real-world networks are more complex. We develop a class of random graph hidden Markov models (RG-HMMs) for characterizing percolation regimes in noisy, dynamically evolving networks in the presence of edge birth and edge death, as well as noise. This class is used to understand the type of phase transitions undergone in a seizure, and in particular, distinguishing between different percolation regimes in epileptic seizures. We develop a hypothesis testing framework for inferring putative percolation mechanisms. As a necessary precursor, we present an EM algorithm for estimating parameters from a sequence of noisy networks only observed at a longitudinal subsampling of time points. Our results suggest that different types of percolation can occur in human seizures. The type inferred may suggest tailored treatment strategies and provide new insights into the fundamental science of epilepsy.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Percolation under Noise: Detecting Explosive Percolation Using the Second Largest Component
Authors:
Wes Viles,
Cedric E. Ginestet,
Ariana Tang,
Mark A. Kramer,
Eric D. Kolaczyk
Abstract:
We consider the problem of distinguishing classical (Erdős-Rényi) percolation from explosive (Achlioptas) percolation, under noise. A statistical model of percolation is constructed allowing for the birth and death of edges as well as the presence of noise in the observations. This graph-valued stochastic process is composed of a latent and an observed non-stationary process, where the observed gr…
▽ More
We consider the problem of distinguishing classical (Erdős-Rényi) percolation from explosive (Achlioptas) percolation, under noise. A statistical model of percolation is constructed allowing for the birth and death of edges as well as the presence of noise in the observations. This graph-valued stochastic process is composed of a latent and an observed non-stationary process, where the observed graph process is corrupted by Type I and Type II errors. This produces a hidden Markov graph model. We show that for certain choices of parameters controlling the noise, the classical (ER) percolation is visually indistinguishable from the explosive (Achlioptas) percolation model. In this setting, we compare two different criteria for discriminating between these two percolation models, based on a quantile difference (QD) of the first component's size and on the maximal size of the second largest component. We show through data simulations that this second criterion outperforms the QD of the first component's size, in terms of discriminatory power. The maximal size of the second component therefore provides a useful statistic for distinguishing between the ER and Achlioptas models of percolation, under physically motivated conditions for the birth and death of edges, and under noise. The potential application of the proposed criteria for percolation detection in clinical neuroscience is also discussed.
△ Less
Submitted 15 January, 2014;
originally announced January 2014.
-
GALGO: A Genetic ALGOrithm Decision Support Tool for Complex Uncertain Systems Modeled with Bayesian Belief Networks
Authors:
Carlos Rojas-Guzman,
Mark A. Kramer
Abstract:
Bayesian belief networks can be used to represent and to reason about complex systems with uncertain, incomplete and conflicting information. Belief networks are graphs encoding and quantifying probabilistic dependence and conditional independence among variables. One type of reasoning of interest in diagnosis is called abductive inference (determination of the global most probable system descri…
▽ More
Bayesian belief networks can be used to represent and to reason about complex systems with uncertain, incomplete and conflicting information. Belief networks are graphs encoding and quantifying probabilistic dependence and conditional independence among variables. One type of reasoning of interest in diagnosis is called abductive inference (determination of the global most probable system description given the values of any partial subset of variables). In some cases, abductive inference can be performed with exact algorithms using distributed network computations but it is an NP-hard problem and complexity increases drastically with the presence of undirected cycles, number of discrete states per variable, and number of variables in the network. This paper describes an approximate method based on genetic algorithms to perform abductive inference in large, multiply connected networks for which complexity is a concern when using most exact methods and for which systematic search methods are not feasible. The theoretical adequacy of the method is discussed and preliminary experimental results are presented.
△ Less
Submitted 6 March, 2013;
originally announced March 2013.
-
A showcase of torus canards in neuronal bursters
Authors:
John Burke,
Mathieu Desroches,
Anna M. Barry,
Tasso J. Kaper,
Mark A. Kramer
Abstract:
Rapid action potential generation --- spiking --- and alternating intervals of spiking and quiescence --- bursting --- are two dynamic patterns observed in neuronal activity. In computational models of neuronal systems, the transition from spiking to bursting often exhibits complex bifurcation structure. One type of transition involves the torus canard, which was originally observed in a simple bi…
▽ More
Rapid action potential generation --- spiking --- and alternating intervals of spiking and quiescence --- bursting --- are two dynamic patterns observed in neuronal activity. In computational models of neuronal systems, the transition from spiking to bursting often exhibits complex bifurcation structure. One type of transition involves the torus canard, which was originally observed in a simple biophysical model of a Purkinje cell. In this article, we expand on that original result by showing that torus canards arise in a broad array of well-known computational neuronal models with three different classes of bursting dynamics: sub-Hopf/fold cycle bursting, circle/fold cycle bursting, and fold/fold cycle bursting. The essential features that these models share are multiple time scales leading naturally to decomposition into slow and fast systems, a saddle-node of periodic orbits in the fast system, and a torus bifurcation in the full system. We show that the transition from spiking to bursting in each model system is given by an explosion of torus canards. Based on these examples, as well as on emerging theory, we propose that torus canards are a common dynamic phenomenon separating the regimes of spiking and bursting activity.
△ Less
Submitted 14 July, 2011;
originally announced July 2011.
-
Network inference - with confidence - from multivariate time series
Authors:
Mark A. Kramer,
Uri T. Eden,
Sydney S. Cash,
Eric D. Kolaczyk
Abstract:
Networks - collections of interacting elements or nodes - abound in the natural and manmade worlds. For many networks, complex spatiotemporal dynamics stem from patterns of physical interactions unknown to us. To infer these interactions, it is common to include edges between those nodes whose time series exhibit sufficient functional connectivity, typically defined as a measure of coupling exce…
▽ More
Networks - collections of interacting elements or nodes - abound in the natural and manmade worlds. For many networks, complex spatiotemporal dynamics stem from patterns of physical interactions unknown to us. To infer these interactions, it is common to include edges between those nodes whose time series exhibit sufficient functional connectivity, typically defined as a measure of coupling exceeding a pre-determined threshold. However, when uncertainty exists in the original network measurements, uncertainty in the inferred network is likely, and hence a statistical propagation-of-error is needed. In this manuscript, we describe a principled and systematic procedure for the inference of functional connectivity networks from multivariate time series data. Our procedure yields as output both the inferred network and a quantification of uncertainty of the most fundamental interest: uncertainty in the number of edges. To illustrate this approach, we apply our procedure to simulated data and electrocorticogram data recorded from a human subject during an epileptic seizure. We demonstrate that the procedure is accurate and robust in both the determination of edges and the reporting of uncertainty associated with that determination.
△ Less
Submitted 12 March, 2009;
originally announced March 2009.
-
New dynamics in cerebellar Purkinje cells: torus canards
Authors:
M. A. Kramer,
R. D. Traub,
N. J. Kopell
Abstract:
We describe a transition from bursting to rapid spiking in a reduced mathematical model of a cerebellar Purkinje cell. We perform a slow-fast analysis of the system and find that -- after a saddle node bifurcation of limit cycles -- the full model dynamics follow temporarily a repelling branch of limit cycles. We propose that the system exhibits a dynamical phenomenon new to realistic, biophysic…
▽ More
We describe a transition from bursting to rapid spiking in a reduced mathematical model of a cerebellar Purkinje cell. We perform a slow-fast analysis of the system and find that -- after a saddle node bifurcation of limit cycles -- the full model dynamics follow temporarily a repelling branch of limit cycles. We propose that the system exhibits a dynamical phenomenon new to realistic, biophysical applications: torus canards.
△ Less
Submitted 13 August, 2008; v1 submitted 29 March, 2008;
originally announced March 2008.
-
Faint Scattering Around Pulsars: Probing the Interstellar Medium on Solar System Size Scales
Authors:
D. R. Stinebring,
M. A. McLaughlin,
J. M. Cordes,
K. M. Becker,
J. E. Espinoza Goodman,
M. A. Kramer,
J. L. Sheckard,
T. C. T. Smith
Abstract:
We have made high-resolution, high-sensitivity dynamic spectra of a sample of strong pulsars at 430 MHz with the Arecibo radiotelescope. For 4 pulsars we find faint but sharply delineated features in the secondary spectra. These are examples of the previously observed ``crisscross'' or ``multiple drift slope'' phenomenon presumed to be due to multiple imaging of the pulsar by the interstellar me…
▽ More
We have made high-resolution, high-sensitivity dynamic spectra of a sample of strong pulsars at 430 MHz with the Arecibo radiotelescope. For 4 pulsars we find faint but sharply delineated features in the secondary spectra. These are examples of the previously observed ``crisscross'' or ``multiple drift slope'' phenomenon presumed to be due to multiple imaging of the pulsar by the interstellar medium. The unprecedented resolution and dynamic range of our observations allow a deeper level of analysis. Distances to the dominant scattering screen along the line of sight are determined and are shown to agree well with those inferred from other scintillation phenomena. Multiple imaging of the pulsar by the ISM is required. A compact central image surrounded by a faint scattering halo, roughly circularly symmetric, is consistent with the data. Scattering from filaments may also be consistent. The angular extent of the scattering material parallel to the direction of the pulsar velocity is roughly 5 mas, corresponding to a linear extent of about 2 AU. Further observations of these features should allow better discrimination between models and an identification of the scattering structures.
△ Less
Submitted 15 December, 2000; v1 submitted 18 October, 2000;
originally announced October 2000.
