Showing 1–50 of 55 results for author: Palmer, N

Efficient Online String Matching through Linked Weak Factors

Authors: Matthew N. Palmer, Simone Faro, Stefano Scafiti

Abstract: Online string matching is a computational problem involving the search for patterns or substrings in a large text dataset, with the pattern and text being processed sequentially, without prior access to the entire text. Its relevance stems from applications in data compression, data mining, text editing, and bioinformatics, where rapid and efficient pattern matching is crucial. Various solutions h… ▽ More Online string matching is a computational problem involving the search for patterns or substrings in a large text dataset, with the pattern and text being processed sequentially, without prior access to the entire text. Its relevance stems from applications in data compression, data mining, text editing, and bioinformatics, where rapid and efficient pattern matching is crucial. Various solutions have been proposed over the past few decades, employing diverse techniques. Recently, weak recognition approaches have attracted increasing attention. This paper presents Hash Chain, a new algorithm based on a robust weak factor recognition approach that connects adjacent factors through hashing. Despite its O(nm) complexity, the algorithm exhibits a sublinear behavior in practice and achieves superior performance compared to the most effective algorithms. △ Less

Submitted 24 October, 2023; originally announced October 2023.

Further analysis of cGAN: A system for Generative Deep Learning Post-processing of Precipitation

Authors: Fenwick C. Cooper, Andrew T. T. McRae, Matthew Chantry, Bobby Antonio, Tim N. Palmer

Abstract: The conditional generative adversarial rainfall model "cGAN" developed for the UK \cite{Harris22} was trained to post-process into an ensemble and downscale ERA5 rainfall to 1km resolution over three regions of the USA and the UK. Relative to radar data (stage IV and NIMROD), the quality of the forecast rainfall distribution was quantified locally at each grid point and between grid points using t… ▽ More The conditional generative adversarial rainfall model "cGAN" developed for the UK \cite{Harris22} was trained to post-process into an ensemble and downscale ERA5 rainfall to 1km resolution over three regions of the USA and the UK. Relative to radar data (stage IV and NIMROD), the quality of the forecast rainfall distribution was quantified locally at each grid point and between grid points using the spatial correlation structure. Despite only having information from a single lower quality analysis, the ensembles of post processed rainfall produced were found to be competitive with IFS ensemble forecasts with lead times of between 8 and 16 hours. Comparison to the original cGAN trained on the UK using the IFS HRES forecast indicates that improved training forecasts result in improved post-processing. The cGAN models were additionally applied to the regions that they were not trained on. Each model performed well in their own region indicating that each model is somewhat region specific. However the model trained on the Washington DC, Atlantic coast, region achieved good scores across the USA and was competitive over the UK. There are more overall rainfall events spread over the whole region so the improved scores might be simply due to increased data. A model was therefore trained using data from all four regions which then outperformed the models trained locally. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Inverse non-linear problem of the long wave run-up on coast

Authors: Alexei Rybkin, Efim Pelinovsky, Oleksandr Bobrovnikov, Noah Palmer, Ekaterina Pniushkova, Daniel Abramowicz

Abstract: The study of the process of catastrophic tsunami-type waves on the coast makes it possible to determine the destructive force of waves on the coast. In hydrodynamics, the one-dimensional theory of the run-up of non-linear waves on a flat slope has gained great popularity, within which rigorous analytical results have been obtained in the class of non-breaking waves. In general, the result depends… ▽ More The study of the process of catastrophic tsunami-type waves on the coast makes it possible to determine the destructive force of waves on the coast. In hydrodynamics, the one-dimensional theory of the run-up of non-linear waves on a flat slope has gained great popularity, within which rigorous analytical results have been obtained in the class of non-breaking waves. In general, the result depends on the characteristics of the wave approaching (or generated on) the slope, which is usually not known in the measurements. Here we describe a rigorous method for recovering the initial displacement in a source localised in an inclined power-shaped channel from the characteristics of a moving shoreline. The method uses the generalised Carrier-Greenspan transformation, which allows one-dimensional non-linear shallow-water equations to be reduced to linear ones. The solution is found in terms of Erdélyi-Kober integral operator. Numerical verification of our results is presented for the cases of a parabolic bay and an infinite plane beach. △ Less

Submitted 25 September, 2023; originally announced September 2023.

Comments: 15 pages, 8 figures

Taxonomy for Physics Beyond Quantum Mechanics

Authors: Emily Adlam, Jonte R. Hance, Sabine Hossenfelder, Tim N. Palmer

Abstract: We propose terminology to classify interpretations of quantum mechanics and models that modify or complete quantum mechanics. Our focus is on models which have previously been referred to as superdeterministic (strong or weak), retrocausal (with or without signalling, dynamical or non-dynamical), future-input-dependent, atemporal and all-at-once, not always with the same meaning or context. Someti… ▽ More We propose terminology to classify interpretations of quantum mechanics and models that modify or complete quantum mechanics. Our focus is on models which have previously been referred to as superdeterministic (strong or weak), retrocausal (with or without signalling, dynamical or non-dynamical), future-input-dependent, atemporal and all-at-once, not always with the same meaning or context. Sometimes these models are assumed to be deterministic, sometimes not, the word deterministic has been given different meanings, and different notions of causality have been used when classifying them. This has created much confusion in the literature, and we hope that the terms proposed here will help to clarify the nomenclature. The general model framework that we will propose may also be useful to classify other interpretations and modifications of quantum mechanics. This document grew out of the discussions at the 2022 Bonn Workshop on Superdeterminism and Retrocausality. △ Less

Submitted 13 June, 2024; v1 submitted 21 September, 2023; originally announced September 2023.

Comments: 18 pages, 7 figures. Accepted for publication in Proceedings of the Royal Society A; matches accepted version

Hyperfine Spectroscopy of Isotopically Engineered Group-IV Color Centers in Diamond

Authors: Isaac B. W. Harris, Cathryn P. Michaels, Kevin C. Chen, Ryan A. Parker, Michael Titze, Jesus Arjona Martinez, Madison Sutula, Ian R. Christen, Alexander M. Stramma, William Roth, Carola M. Purser, Martin Hayhurst Appel, Chao Li, Matthew E. Trusheim, Nicola L. Palmer, Matthew L. Markham, Edward S. Bielejec, Mete Atature, Dirk Englund

Abstract: A quantum register coupled to a spin-photon interface is a key component in quantum communication and information processing. Group-IV color centers in diamond (SiV, GeV, and SnV) are promising candidates for this application, comprising an electronic spin with optical transitions coupled to a nuclear spin as the quantum register. However, the creation of a quantum register for these color centers… ▽ More A quantum register coupled to a spin-photon interface is a key component in quantum communication and information processing. Group-IV color centers in diamond (SiV, GeV, and SnV) are promising candidates for this application, comprising an electronic spin with optical transitions coupled to a nuclear spin as the quantum register. However, the creation of a quantum register for these color centers with deterministic and strong coupling to the spin-photon interface remains challenging. Here, we make first-principles predictions of the hyperfine parameters of the group-IV color centers, which we verify experimentally with a comprehensive comparison between the spectra of spin active and spin neutral intrinsic dopant nuclei in single GeV and SnV emitters. In line with the theoretical predictions, detailed spectroscopy on large sample sizes reveals that hyperfine coupling causes a splitting of the optical transition of SnV an order of magnitude larger than the optical linewidth and provides a magnetic-field insensitive transition. This strong coupling provides access to a new regime for quantum registers in diamond color centers, opening avenues for novel spin-photon entanglement and quantum sensing schemes for these well-studied emitters. △ Less

Submitted 6 June, 2023; v1 submitted 31 May, 2023; originally announced June 2023.

Inverse problem for the nonlinear long wave runup on a plane slo** beach

Authors: Alexei Rybkin, Efim Pelinovsky, Noah Palmer

Abstract: We put forward a simple but effective explicit method of recovering initial data for the nonlinear shallow water system from the reading at the shoreline. We then apply our method to the tsunami waves inverse problem. We put forward a simple but effective explicit method of recovering initial data for the nonlinear shallow water system from the reading at the shoreline. We then apply our method to the tsunami waves inverse problem. △ Less

Submitted 5 July, 2023; v1 submitted 11 April, 2023; originally announced April 2023.

Comments: To be published in Applied Math Letters

A telecom O-band emitter in diamond

Authors: Sounak Mukherjee, Zi-Huai Zhang, Daniel G. Oblinsky, Mitchell O. de Vries, Brett C. Johnson, Brant C. Gibson, Edwin L. H. Mayes, Andrew M. Edmonds, Nicola Palmer, Matthew L. Markham, Ádám Gali, Gergő Thiering, Adam Dalis, Timothy Dumm, Gregory D. Scholes, Alastair Stacey, Philipp Reineck, Nathalie P. de Leon

Abstract: Color centers in diamond are promising platforms for quantum technologies. Most color centers in diamond discovered thus far emit in the visible or near-infrared wavelength range, which are incompatible with long-distance fiber communication and unfavorable for imaging in biological tissues. Here, we report the experimental observation of a new color center that emits in the telecom O-band, which… ▽ More Color centers in diamond are promising platforms for quantum technologies. Most color centers in diamond discovered thus far emit in the visible or near-infrared wavelength range, which are incompatible with long-distance fiber communication and unfavorable for imaging in biological tissues. Here, we report the experimental observation of a new color center that emits in the telecom O-band, which we observe in silicon-doped bulk single crystal diamonds and microdiamonds. Combining absorption and photoluminescence measurements, we identify a zero-phonon line at 1221 nm and phonon replicas separated by 42 meV. Using transient absorption spectroscopy, we measure an excited state lifetime of around 270 ps and observe a long-lived baseline that may arise from intersystem crossing to another spin manifold. △ Less

Submitted 10 November, 2022; originally announced November 2022.

Neutral Silicon Vacancy Centers in Diamond via Photoactivated Itinerant Carriers

Authors: Zi-Huai Zhang, Andrew M. Edmonds, Nicola Palmer, Matthew L. Markham, Nathalie P. de Leon

Abstract: Neutral silicon vacancy (SiV0) centers in diamond are promising candidates for quantum network applications because of their exceptional optical properties and spin coherence. However, the stabilization of SiV0 centers requires careful Fermi level engineering of the diamond host material, making further technological development challenging. Here, we show that SiV0 centers can be efficiently stabi… ▽ More Neutral silicon vacancy (SiV0) centers in diamond are promising candidates for quantum network applications because of their exceptional optical properties and spin coherence. However, the stabilization of SiV0 centers requires careful Fermi level engineering of the diamond host material, making further technological development challenging. Here, we show that SiV0 centers can be efficiently stabilized by photoactivated itinerant carriers. Even in this nonequilibrium configuration, the resulting SiV0 centers are stable enough to allow for resonant optical excitation and optically detected magnetic resonance. Our results pave the way for on-demand generation of SiV0 centers as well as other emerging quantum defects in diamond. △ Less

Submitted 18 September, 2022; originally announced September 2022.

Neutral silicon vacancy centers in undoped diamond via surface control

Authors: Zi-Huai Zhang, Josh A. Zuber, Lila V. H. Rodgers, Xin Gui, Paul Stevenson, Minghao Li, Marietta Batzer, Marcel. li Grimau, Brendan Shields, Andrew M. Edmonds, Nicola Palmer, Matthew L. Markham, Robert J. Cava, Patrick Maletinsky, Nathalie P. de Leon

Abstract: Neutral silicon vacancy centers (SiV0) in diamond are promising candidates for quantum networks because of their long spin coherence times and stable, narrow optical transitions. However, stabilizing SiV0 requires high purity, boron doped diamond, which is not a readily available material. Here, we demonstrate an alternative approach via chemical control of the diamond surface. We use low-damage c… ▽ More Neutral silicon vacancy centers (SiV0) in diamond are promising candidates for quantum networks because of their long spin coherence times and stable, narrow optical transitions. However, stabilizing SiV0 requires high purity, boron doped diamond, which is not a readily available material. Here, we demonstrate an alternative approach via chemical control of the diamond surface. We use low-damage chemical processing and annealing in a hydrogen environment to realize reversible and highly stable charge state tuning in undoped diamond. The resulting SiV0 centers display optically detected magnetic resonance and bulk-like optical properties. Controlling the charge state tuning via surface termination offers a route for scalable technologies based on SiV0 centers, as well as charge state engineering of other defects. △ Less

Submitted 27 June, 2022; originally announced June 2022.

Discretised Hilbert Space and Superdeterminism

Authors: T. N. Palmer

Abstract: In computational physics it is standard to approximate continuum systems with discretised representations. Here we consider a specific discretisation of the continuum complex Hilbert space of quantum mechanics - a discretisation where squared amplitudes and complex phases are rational numbers. The fineness of this discretisation is determined by a finite (prime-number) parameter $p$. As… ▽ More In computational physics it is standard to approximate continuum systems with discretised representations. Here we consider a specific discretisation of the continuum complex Hilbert space of quantum mechanics - a discretisation where squared amplitudes and complex phases are rational numbers. The fineness of this discretisation is determined by a finite (prime-number) parameter $p$. As $p \rightarrow \infty$, unlike standard discretised representations in computational physics, this model does not tend smoothly to the continuum limit. Instead, the state space of quantum mechanics is a singular limit of the discretised model at $p=\infty$. Using number theoretic properties of trigonometric functions, it is shown that for large enough values of $p$, discretised Hilbert space accurately describes ensemble representations of quantum systems within an inherently superdeterministic framework, one where the Statistical Independence assumption in Bell's theorem is formally violated. In this sense, the discretised model can explain the violation of Bell inequalities without appealing to nonlocality or indefinite reality. It is shown that this discretised framework is not fine tuned (and hence not conspiratorial) with respect to its natural state-space $p$-adic metric. As described by Michael Berry, old theories of physics are typically the singular limits of new theories as a parameter of the new theory is set equal to zero or infinity. Using this, we can answer the challenge posed by Scott Aaronson, critic of superderminism: to explain when a great theory in physics (here quantum mechanics) has ever been `grudgingly accommodated' rather than `gloriously explained' by its candidate successor theory (here a superdeterministic theory of quantum physics based on discretised Hilbert space). △ Less

Submitted 16 April, 2022; v1 submitted 7 April, 2022; originally announced April 2022.

A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecasts

Authors: Lucy Harris, Andrew T. T. McRae, Matthew Chantry, Peter D. Dueben, Tim N. Palmer

Abstract: Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation distribution and intensity occur below the resolved scale of global weather models. Generative adversarial networks (GANs) have been demonstrated by the computer vision c… ▽ More Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation distribution and intensity occur below the resolved scale of global weather models. Generative adversarial networks (GANs) have been demonstrated by the computer vision community to be successful at super-resolution problems, i.e., learning to add fine-scale structure to coarse images. Leinonen et al. (2020) previously applied a GAN to produce ensembles of reconstructed high-resolution atmospheric fields, given coarsened input data. In this paper, we demonstrate this approach can be extended to the more challenging problem of increasing the accuracy and resolution of comparatively low-resolution input from a weather forecasting model, using high-resolution radar measurements as a "ground truth". The neural network must learn to add resolution and structure whilst accounting for non-negligible forecast error. We show that GANs and VAE-GANs can match the statistical properties of state-of-the-art pointwise post-processing methods whilst creating high-resolution, spatially coherent precipitation maps. Our model compares favourably to the best existing downscaling methods in both pixel-wise and pooled CRPS scores, power spectrum information and rank histograms (used to assess calibration). We test our models and show that they perform in a range of scenarios, including heavy rainfall. △ Less

Submitted 28 July, 2022; v1 submitted 5 April, 2022; originally announced April 2022.

Comments: Revised version 28/7/22

Bell's Theorem, Non-Computability and Conformal Cyclic Cosmology: A Top-Down Approach to Quantum Gravity

Authors: T. N. Palmer

Abstract: This paper draws on a number of Roger Penrose's ideas - including the non-Hamiltonian phase-space flow of the Hawking Box, Conformal Cyclic Cosmology, non-computability and gravitationally induced quantum state reduction - in order to propose a radically unconventional approach to quantum gravity: Invariant Set Theory (IST). In IST, the fundamental laws of physics describe the geometry of the phas… ▽ More This paper draws on a number of Roger Penrose's ideas - including the non-Hamiltonian phase-space flow of the Hawking Box, Conformal Cyclic Cosmology, non-computability and gravitationally induced quantum state reduction - in order to propose a radically unconventional approach to quantum gravity: Invariant Set Theory (IST). In IST, the fundamental laws of physics describe the geometry of the phase portrait of the universe as a whole: "quantum" process are associated with fine-scale fractal geometry, "gravitational" process with larger-scale heterogeneous geometry. With this, it becomes possible to explain the experimental violation of Bell Inequalities without having to abandon key ingredients of general relativity: determinism and local causality. Ensembles in IST can be described by complex Hilbert states over a finite set $\mathbb C_p$ of complex numbers, where $p$ is a large finite integer. The quantum mechanics of finite-dimensional Hilbert spaces is emergent as a singular limit when $p \rightarrow \infty$. A small modification to the field equations of general relativity is proposed to make it consistent with IST. △ Less

Submitted 27 August, 2021; v1 submitted 24 August, 2021; originally announced August 2021.

Comments: To appear in Special Edition of AVS Quantum Science, celebrating Roger Penrose's 90th Birthday

Properties of Invariant Set Theory

Authors: J. R. Hance, S. Hossenfelder, T. N. Palmer

Abstract: In a recent paper (arXiv:2107.04761), Sen critiques a superdeterministic model of quantum physics, Invariant Set Theory, proposed by one of the authors. He concludes that superdeterminism is `unlikely to solve the puzzle posed by the Bell correlations'. He also claims that the model is neither local nor $ψ$-epistemic. We here detail multiple inaccuracies with Sen's arguments - notably that the hid… ▽ More In a recent paper (arXiv:2107.04761), Sen critiques a superdeterministic model of quantum physics, Invariant Set Theory, proposed by one of the authors. He concludes that superdeterminism is `unlikely to solve the puzzle posed by the Bell correlations'. He also claims that the model is neither local nor $ψ$-epistemic. We here detail multiple inaccuracies with Sen's arguments - notably that the hidden-variable model of quantum physics he uses to critique Invariant Set Theory bares no relation to Invariant Set Theory - and use this opportunity to lay out the properties of Invariant Set Theory as clearly as possible. △ Less

Submitted 8 March, 2022; v1 submitted 18 August, 2021; originally announced August 2021.

Comments: 6 pages, no figures. Substantial edits to address published version of Sen's paper

Supermeasured: Violating Bell-Statistical Independence without violating physical statistical independence

Authors: Jonte R. Hance, Sabine Hossenfelder, Tim N. Palmer

Abstract: Bell's theorem is often said to imply that quantum mechanics violates local causality, and that local causality cannot be restored with a hidden-variables theory. This however is only correct if the hidden-variables theory fulfils an assumption called Statistical Independence. Violations of Statistical Independence are commonly interpreted as correlations between the measurement settings and the h… ▽ More Bell's theorem is often said to imply that quantum mechanics violates local causality, and that local causality cannot be restored with a hidden-variables theory. This however is only correct if the hidden-variables theory fulfils an assumption called Statistical Independence. Violations of Statistical Independence are commonly interpreted as correlations between the measurement settings and the hidden variables (which determine the measurement outcomes). Such correlations have been discarded as ``fine-tuning'' or a ``conspiracy''. We here point out that the common interpretation is at best physically ambiguous and at worst incorrect. The problem with the common interpretation is that Statistical Independence might be violated because of a non-trivial measure in state space, a possibility we propose to call ``supermeasured''. We use Invariant Set Theory as an example of a supermeasured theory that violates the Statistical Independence assumption in Bell's theorem without requiring correlations between hidden variables and measurement settings (physical statistical independence). △ Less

Submitted 19 July, 2022; v1 submitted 16 August, 2021; originally announced August 2021.

Comments: 15 pages, 1 figure. Published in Foundations of Physics (matched published version)

Journal ref: Found Phys 52, 81 (2022)

Mixed-precision for Linear Solvers in Global Geophysical Flows

Authors: Jan Ackmann, Peter D. Düben, Tim N. Palmer, Piotr K. Smolarkiewicz

Abstract: Semi-implicit time-step** schemes for atmosphere and ocean models require elliptic solvers that work efficiently on modern supercomputers. This paper reports our study of the potential computational savings when using mixed precision arithmetic in the elliptic solvers. The essential components of a representative elliptic solver are run at precision levels as low as half (16 bits), and accompani… ▽ More Semi-implicit time-step** schemes for atmosphere and ocean models require elliptic solvers that work efficiently on modern supercomputers. This paper reports our study of the potential computational savings when using mixed precision arithmetic in the elliptic solvers. The essential components of a representative elliptic solver are run at precision levels as low as half (16 bits), and accompanied with a detailed evaluation of the impact of reduced precision on the solver convergence and the solution quality. A detailed inquiry into reduced precision requires a model configuration that is meaningful but cheaper to run and easier to evaluate than full atmosphere/ocean models. This study is therefore conducted in the context of a novel semi-implicit shallow-water model on the sphere, purposely designed to mimic numerical intricacies of modern all-scale weather and climate (W&C) models with the numerical stability independent on celerity of all wave motions. The governing algorithm of the shallow-water model is based on the non-oscillatory MPDATA methods for geophysical flows, whereas the resulting elliptic problem employs a strongly preconditioned non-symmetric Krylov-subspace solver GCR, proven in advanced atmospheric applications. The classical longitude/latitude grid is deliberately chosen to retain the stiffness of global W&C models posed in thin spherical shells as well as to better understand the performance of reduced-precision arithmetic in the vicinity of grid singularities. Precision reduction is done on a software level, using an emulator. The reduced-precision experiments are conducted for established dynamical-core test-cases, like the Rossby-Haurwitz wave number 4 and a zonal orographic flow. The study shows that selected key components of the elliptic solver, most prominently the preconditioning, can be performed at the level of half precision. △ Less

Submitted 30 March, 2021; originally announced March 2021.

Comments: 38 pages, 12 figures; to be submitted to the Journal of Computational Physics (JCP)

Experimental Tests of Invariant Set Theory

Authors: Jonte R. Hance, Tim N. Palmer, John Rarity

Abstract: We identify points of difference between Invariant Set Theory and standard quantum theory, and evaluate if these would lead to noticeable differences in predictions between the two theories. From this evaluation, we design a number of experiments, which, if undertaken, would allow us to investigate whether standard quantum theory or invariant set theory best describes reality. We identify points of difference between Invariant Set Theory and standard quantum theory, and evaluate if these would lead to noticeable differences in predictions between the two theories. From this evaluation, we design a number of experiments, which, if undertaken, would allow us to investigate whether standard quantum theory or invariant set theory best describes reality. △ Less

Submitted 15 February, 2021; originally announced February 2021.

Comments: 6 pages, 4 figures

Machine-Learned Preconditioners for Linear Solvers in Geophysical Fluid Flows

Authors: Jan Ackmann, Peter D. Düben, Tim N. Palmer, Piotr K. Smolarkiewicz

Abstract: It is tested whether machine learning methods can be used for preconditioning to increase the performance of the linear solver -- the backbone of the semi-implicit, grid-point model approach for weather and climate models. Embedding the machine-learning method within the framework of a linear solver circumvents potential robustness issues that machine learning approaches are often criticized for,… ▽ More It is tested whether machine learning methods can be used for preconditioning to increase the performance of the linear solver -- the backbone of the semi-implicit, grid-point model approach for weather and climate models. Embedding the machine-learning method within the framework of a linear solver circumvents potential robustness issues that machine learning approaches are often criticized for, as the linear solver ensures that a sufficient, pre-set level of accuracy is reached. The approach does not require prior availability of a conventional preconditioner and is highly flexible regarding complexity and machine learning design choices. Several machine learning methods are used to learn the optimal preconditioner for a shallow-water model with semi-implicit timestep** that is conceptually similar to more complex atmosphere models. The machine-learning preconditioner is competitive with a conventional preconditioner and provides good results even if it is used outside of the dynamical range of the training dataset. △ Less

Submitted 6 October, 2020; originally announced October 2020.

Comments: To be submitted to GRL, 15 pages, 3 figures

A matrix-free approach to geostatistical filtering

Authors: Mike Pereira, Nicolas Desassis, Cédric Magneron, Nathan Palmer

Abstract: In this paper, we present a novel approach to geostatistical filtering which tackles two challenges encountered when applying this method to complex spatial datasets: modeling the non-stationarity of the data while still being able to work with large datasets. The approach is based on a finite element approximation of Gaussian random fields expressed as an expansion of the eigenfunctions of a Lapl… ▽ More In this paper, we present a novel approach to geostatistical filtering which tackles two challenges encountered when applying this method to complex spatial datasets: modeling the non-stationarity of the data while still being able to work with large datasets. The approach is based on a finite element approximation of Gaussian random fields expressed as an expansion of the eigenfunctions of a Laplace--Beltrami operator defined to account for local anisotropies. The numerical approximation of the resulting random fields using a finite element approach is then leveraged to solve the scalability issue through a matrix-free approach. Finally, two cases of application of this approach, on simulated and real seismic data are presented. △ Less

Submitted 6 April, 2020; originally announced April 2020.

Comments: 25 pages, 8 figures

Using reduced-precision arithmetic in the adjoint model of MITgcm

Authors: Andrew T. T. McRae, Tim N. Palmer

Abstract: In recent years, it has been convincingly shown that weather forecasting models can be run in single-precision arithmetic. Several models or components thereof have been tested with even lower precision than this. This previous work has largely focused on the main nonlinear `forward' model. A nonlinear model (in weather forecasting or otherwise) can have corresponding tangent linear and adjoint mo… ▽ More In recent years, it has been convincingly shown that weather forecasting models can be run in single-precision arithmetic. Several models or components thereof have been tested with even lower precision than this. This previous work has largely focused on the main nonlinear `forward' model. A nonlinear model (in weather forecasting or otherwise) can have corresponding tangent linear and adjoint models, which are used in 4D variational data assimilation. The linearised models are plausibly far more sensitive to reductions in numerical precision since unbounded error growth can occur with no possibility of nonlinear saturation. In this paper, we present a geophysical experiment that makes use of an adjoint model to calculate sensitivities and perform optimisation. Using software emulation, we investigate the effect of degrading the numerical precision of the adjoint model. We find that reasonable results are obtained with as few as 10 significand bits, equal to the significand precision in the IEEE half-precision standard. △ Less

Submitted 19 March, 2020; originally announced March 2020.

Comments: Submitted to AGU JAMES

Human Creativity and Consciousness: Unintended Consequences of the Brain's Extraordinary Energy Efficiency?

Authors: T. N. Palmer

Abstract: It is proposed that both human creativity and human consciousness are (unintended) consequences of the human brain's extraordinary energy efficiency. The topics of creativity and consciousness are treated separately, though have a common sub-structure. It is argued that creativity arises from a synergy between two cognitive modes of the human brain (which broadly coincide with Kahneman's Systems 1… ▽ More It is proposed that both human creativity and human consciousness are (unintended) consequences of the human brain's extraordinary energy efficiency. The topics of creativity and consciousness are treated separately, though have a common sub-structure. It is argued that creativity arises from a synergy between two cognitive modes of the human brain (which broadly coincide with Kahneman's Systems 1 and 2). In the first, available energy is spread across a relatively large network of neurons. As such, the amount of energy per active neuron is so small that the operation of such neurons is susceptible to thermal (ultimately quantum decoherent) noise. In the second, available energy is focussed on a small enough subset of neurons to guarantee a deterministic operation. An illustration of how this synergy can lead to creativity with implications for computing in silicon are discussed. Starting with a discussion of the concept of free will, the notion of consciousness is defined in terms of an awareness of what are perceived to be nearby counterfactual worlds in state space. It is argued that such awareness arises from an interplay between our memories on the one hand, and quantum physical mechanisms (where, unlike in classical physics, nearby counterfactual worlds play an indispensable dynamical role) in the ion channels of neural networks. As with the brain's susceptibility to noise, it is argued that in situations where quantum physics plays a role in the brain, it does so for reasons of energy efficiency. As an illustration of this definition of consciousness, a novel proposal is outlined as to why quantum entanglement appears so counter-intuitive. △ Less

Submitted 31 January, 2020; originally announced February 2020.

Comments: Based on invited talk at Models of Consciousness Conference, Mathematical Institute, University of Oxford, September 2019

Rethinking Superdeterminism

Authors: S. Hossenfelder, T. N. Palmer

Abstract: Quantum mechanics has irked physicists ever since its conception more than 100 years ago. While some of the misgivings, such as it being unintuitive, are merely aesthetic, quantum mechanics has one serious shortcoming: it lacks a physical description of the measurement process. This "measurement problem" indicates that quantum mechanics is at least an incomplete theory -- good as far as it goes, b… ▽ More Quantum mechanics has irked physicists ever since its conception more than 100 years ago. While some of the misgivings, such as it being unintuitive, are merely aesthetic, quantum mechanics has one serious shortcoming: it lacks a physical description of the measurement process. This "measurement problem" indicates that quantum mechanics is at least an incomplete theory -- good as far as it goes, but missing a piece -- or, more radically, is in need of complete overhaul. Here we describe an approach which may provide this sought-for completion or replacement: Superdeterminism. A superdeterministic theory is one which violates the assumption of Statistical Independence (that distributions of hidden variables are independent of measurement settings). Intuition suggests that Statistical Independence is an essential ingredient of any theory of science (never mind physics), and for this reason Superdeterminism is typically discarded swiftly in any discussion of quantum foundations. The purpose of this paper is to explain why the existing objections to Superdeterminism are based on experience with classical physics and linear systems, but that this experience misleads us. Superdeterminism is a promising approach not only to solve the measurement problem, but also to understand the apparent nonlocality of quantum physics. Most importantly, we will discuss how it may be possible to test this hypothesis in an (almost) model independent way. △ Less

Submitted 20 December, 2019; v1 submitted 13 December, 2019; originally announced December 2019.

Comments: 23 pages, 2 figures, typos fixed, references added

Journal ref: Front. Phys. 8:139 (2020)

The impact of stochastic physics on climate sensitivity in EC-Earth

Authors: K. Strommen, P. A. G. Watson, T. N. Palmer

Abstract: Stochastic schemes, designed to represent unresolved sub-grid scale variability, are frequently used in short and medium-range weather forecasts, where they are found to improve several aspects of the model. In recent years, the impact of stochastic physics has also been found to be beneficial for the model's long term climate. In this paper, we demonstrate for the first time that the inclusion of… ▽ More Stochastic schemes, designed to represent unresolved sub-grid scale variability, are frequently used in short and medium-range weather forecasts, where they are found to improve several aspects of the model. In recent years, the impact of stochastic physics has also been found to be beneficial for the model's long term climate. In this paper, we demonstrate for the first time that the inclusion of a stochastic physics scheme can notably affect a model's projection of global warming, as well as its historical climatological global temperature. Specifically, we find that when including the 'stochastically perturbed parametrisation tendencies' scheme (SPPT) in the fully coupled climate model EC-Earth v3.1, the predicted level of global warming between 1850 and 2100 is reduced by 10% under an RCP8.5 forcing scenario. We link this reduction in climate sensitivity to a change in the cloud feedbacks with SPPT. In particular, the scheme appears to reduce the positive low cloud cover feedback, and increase the negative cloud optical feedback. A key role is played by a robust, rapid increase in cloud liquid water with SPPT, which we speculate is due to the scheme's non-linear interaction with condensation. △ Less

Submitted 16 May, 2019; originally announced May 2019.

Comments: Under review in Journal of Geophysical Research: Atmospheres

Signal and noise in regime systems: a hypothesis on the predictability of the North Atlantic Oscillation

Authors: Kristian Strommen, Tim N. Palmer

Abstract: Studies conducted by the UK Met Office reported significant skill at predicting the winter NAO index with their seasonal prediction system. At the same time, a very low signal-to-noise ratio was observed, as measured using the `ratio of predictable components' (RPC) metric. We analyse both the skill and signal-to-noise ratio using a new statistical toy-model which assumes NAO predictability is dri… ▽ More Studies conducted by the UK Met Office reported significant skill at predicting the winter NAO index with their seasonal prediction system. At the same time, a very low signal-to-noise ratio was observed, as measured using the `ratio of predictable components' (RPC) metric. We analyse both the skill and signal-to-noise ratio using a new statistical toy-model which assumes NAO predictability is driven by regime dynamics. It is shown that if the system is approximately bimodal in nature, with the model consistently underestimating the level of regime persistence each season, then both the high skill and high RPC value of the Met Office hindcasts can easily be reproduced. Underestimation of regime persistence could be attributable to any number of sources of model error, including imperfect regime structure or errors in the propagation of teleconnections. In particular, a high RPC value for a seasonal mean prediction may be expected even if the models internal level of noise is realistic. △ Less

Submitted 30 April, 2019; originally announced April 2019.

Comments: Published in the Quarterly Journal of the Royal Meteorological Society (2019)

Bell Inequality Violation with Free Choice and Local Causality on the Invariant Set

Authors: T. N. Palmer

Abstract: Bell's Theorem requires any theory which obeys the technical definitions of Free Choice and Local Causality to satisfy the Bell inequality. Invariant set theory is a finite theory of quantum physics which violates the Bell inequality exactly as does quantum theory: in it neither Free Choice nor Local Causality hold, consistent with Bell's Theorem. However, within the proposed theory, the mathemati… ▽ More Bell's Theorem requires any theory which obeys the technical definitions of Free Choice and Local Causality to satisfy the Bell inequality. Invariant set theory is a finite theory of quantum physics which violates the Bell inequality exactly as does quantum theory: in it neither Free Choice nor Local Causality hold, consistent with Bell's Theorem. However, within the proposed theory, the mathematical expressions of both Free Choice and Local Causality involve states which, for number-theoretic reasons, cannot be ontic (cannot lie on the theory's fractal-like invariant set $I_U$ in state space). Weaker versions of Free Choice and Local Causality are proposed involving only the theory's ontic states. Conventional hidden-variable theories satisfying only these weaker definitions still obey the Bell inequality. However, invariant set theory, which violates the Bell inequality, satisfies these weaker definitions. It is argued that the weaker definitions are consistent with the physical meaning behind free choice and local causality as defined in space-time, and hence that Free Choice and Local Causality are physically too strong. It is concluded that the experimental violation of the Bell inequality may have less to do with free choice or local causality \emph{per se}, and more to do with the presence of a holistic but causal state-space geometry onto which quantum ontic states are constrained. △ Less

Submitted 25 March, 2019; originally announced March 2019.

Discretisation of the Bloch Sphere, Fractal Invariant Sets and Bell's Theorem

Authors: T. N. Palmer

Abstract: An arbitrarily dense discretisation of the Bloch sphere of complex Hilbert states is constructed, where points correspond to bit strings of fixed finite length. Number-theoretic properties of trigonometric functions (not part of the quantum-theoretic canon) are used to show that this constructive discretised representation incorporates many of the defining characteristics of quantum systems: compl… ▽ More An arbitrarily dense discretisation of the Bloch sphere of complex Hilbert states is constructed, where points correspond to bit strings of fixed finite length. Number-theoretic properties of trigonometric functions (not part of the quantum-theoretic canon) are used to show that this constructive discretised representation incorporates many of the defining characteristics of quantum systems: completementarity, uncertainty relationships and (with a simple Cartesian product of discretised spheres) entanglement. Unlike Meyer's earlier discretisation of the Bloch Sphere, there are no orthonormal triples, hence the Kocken-Specker theorem is not nullified. A physical interpretation of points on the discretised Bloch sphere is given in terms of ensembles of trajectories on a dynamically invariant fractal set in state space, where states of physical reality correspond to points on the invariant set. This deterministic construction provides a new way to understand the violation of the Bell inequality without violating statistical independence or factorisation, where these conditions are defined solely from states on the invariant set. In this finite representation there is an upper limit to the number of qubits that can be entangled, a property with potential experimental consequences. △ Less

Submitted 5 March, 2020; v1 submitted 5 April, 2018; originally announced April 2018.

Comments: Proceedings of the Royal Society A. To appear

Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Data

Authors: Andrew L. Beam, Benjamin Kompa, Allen Schmaltz, Inbar Fried, Griffin Weber, Nathan P. Palmer, Xu Shi, Tianxi Cai, Isaac S. Kohane

Abstract: Word embeddings are a popular approach to unsupervised learning of word relationships that are widely used in natural language processing. In this article, we present a new set of embeddings for medical concepts learned using an extremely large collection of multimodal medical data. Leaning on recent theoretical insights, we demonstrate how an insurance claims database of 60 million members, a col… ▽ More Word embeddings are a popular approach to unsupervised learning of word relationships that are widely used in natural language processing. In this article, we present a new set of embeddings for medical concepts learned using an extremely large collection of multimodal medical data. Leaning on recent theoretical insights, we demonstrate how an insurance claims database of 60 million members, a collection of 20 million clinical notes, and 1.7 million full text biomedical journal articles can be combined to embed concepts into a common space, resulting in the largest ever set of embeddings for 108,477 medical concepts. To evaluate our approach, we present a new benchmark methodology based on statistical power specifically designed to test embeddings of medical concepts. Our approach, called cui2vec, attains state-of-the-art performance relative to previous methods in most instances. Finally, we provide a downloadable set of pre-trained embeddings for other researchers to use, as well as an online tool for interactive exploration of the cui2vec embeddings △ Less

Submitted 19 August, 2019; v1 submitted 4 April, 2018; originally announced April 2018.

A Fast Divide-and-Conquer Sparse Cox Regression

Authors: Yan Wang, Nathan Palmer, Qian Di, Joel Schwartz, Isaac Kohane, Tianxi Cai

Abstract: We propose a computationally and statistically efficient divide-and-conquer (DAC) algorithm to fit sparse Cox regression to massive datasets where the sample size $n_0$ is exceedingly large and the covariate dimension $p$ is not small but $n_0\gg p$. The proposed algorithm achieves computational efficiency through a one-step linear approximation followed by a least square approximation to the part… ▽ More We propose a computationally and statistically efficient divide-and-conquer (DAC) algorithm to fit sparse Cox regression to massive datasets where the sample size $n_0$ is exceedingly large and the covariate dimension $p$ is not small but $n_0\gg p$. The proposed algorithm achieves computational efficiency through a one-step linear approximation followed by a least square approximation to the partial likelihood (PL). These sequences of linearization enable us to maximize the PL with only a small subset and perform penalized estimation via a fast approximation to the PL. The algorithm is applicable for the analysis of both time-independent and time-dependent survival data. Simulations suggest that the proposed DAC algorithm substantially outperforms the full sample-based estimators and the existing DAC algorithm with respect to the computational speed, while it achieves similar statistical efficiency as the full sample-based estimators. The proposed algorithm was applied to an extraordinarily large time-independent survival dataset and an extraordinarily large time-dependent survival dataset for the prediction of heart failure-specific readmission within 30 days among Medicare heart failure patients. △ Less

Submitted 2 April, 2018; originally announced April 2018.

Experimental Non-Violation of the Bell Inequality

Authors: T. N. Palmer

Abstract: A finite non-classical framework for physical theory is described which challenges the conclusion that the Bell Inequality has been shown to have been violated experimentally, even approximately. This framework postulates the universe as a deterministic locally causal system evolving on a measure-zero fractal-like geometry $I_U$ in cosmological state space. Consistent with the assumed primacy of… ▽ More A finite non-classical framework for physical theory is described which challenges the conclusion that the Bell Inequality has been shown to have been violated experimentally, even approximately. This framework postulates the universe as a deterministic locally causal system evolving on a measure-zero fractal-like geometry $I_U$ in cosmological state space. Consistent with the assumed primacy of $I_U$, and $p$-adic number theory, a non-Euclidean (and hence non-classical) metric $g_p$ is defined on cosmological state space, where $p$ is a large but finite Pythagorean prime. Using number-theoretic properties of spherical triangles, the inequalities violated experimentally are shown to be $g_p$-distant from the CHSH inequality, whose violation would rule out local realism. This result fails in the singular limit $p=\infty$, at which $g_p$ is Euclidean. Broader implications are discussed. △ Less

Submitted 4 September, 2017; originally announced September 2017.

Comments: arXiv admin note: text overlap with arXiv:1709.00329

A Gravitational Theory of the Quantum

Authors: T. N. Palmer

Abstract: The synthesis of quantum and gravitational physics is sought through a finite, realistic, locally causal theory where gravity plays a vital role not only during decoherent measurement but also during non-decoherent unitary evolution. Invariant set theory is built on geometric properties of a compact fractal-like subset $I_U$ of cosmological state space on which the universe is assumed to evolve an… ▽ More The synthesis of quantum and gravitational physics is sought through a finite, realistic, locally causal theory where gravity plays a vital role not only during decoherent measurement but also during non-decoherent unitary evolution. Invariant set theory is built on geometric properties of a compact fractal-like subset $I_U$ of cosmological state space on which the universe is assumed to evolve and from which the laws of physics are assumed to derive. Consistent with the primacy of $I_U$, a non-Euclidean (and hence non-classical) state-space metric $g_p$ is defined, related to the $p$-adic metric of number theory where $p$ is a large but finite Pythagorean prime. Uncertain states on $I_U$ are described using complex Hilbert states, but only if their squared amplitudes are rational and corresponding complex phase angles are rational multiples of $2 π$. Such Hilbert states are necessarily $g_p$-distant from states with either irrational squared amplitudes or irrational phase angles. The gappy fractal nature of $I_U$ accounts for quantum complementarity and is characterised numerically by a generic number-theoretic incommensurateness between rational angles and rational cosines of angles. The Bell inequality, whose violation would be inconsistent with local realism, is shown to be $g_p$-distant from all forms of the inequality that are violated in any finite-precision experiment. The delayed-choice paradox is resolved through the computational irreducibility of $I_U$. The Schrödinger and Dirac equations describe evolution on $I_U$ in the singular limit at $p=\infty$. By contrast, an extension of the Einstein field equations on $I_U$ is proposed which reduces smoothly to general relativity as $p \rightarrow \infty$. Novel proposals for the dark universe and the elimination of classical space-time singularities are given and experimental implications outlined. △ Less

Submitted 30 August, 2017; originally announced September 2017.

Doubly robust matching estimators for high dimensional confounding adjustment

Authors: Joseph Antonelli, Matthew Cefalu, Nathan Palmer, Denis Agniel

Abstract: Valid estimation of treatment effects from observational data requires proper control of confounding. If the number of covariates is large relative to the number of observations, then controlling for all available covariates is infeasible. In cases where a sparsity condition holds, variable selection or penalization can reduce the dimension of the covariate space in a manner that allows for valid… ▽ More Valid estimation of treatment effects from observational data requires proper control of confounding. If the number of covariates is large relative to the number of observations, then controlling for all available covariates is infeasible. In cases where a sparsity condition holds, variable selection or penalization can reduce the dimension of the covariate space in a manner that allows for valid estimation of treatment effects. In this article, we propose matching on both the estimated propensity score and the estimated prognostic scores when the number of covariates is large relative to the number of observations. We derive asymptotic results for the matching estimator and show that it is doubly robust, in the sense that only one of the two score models need be correct to obtain a consistent estimator. We show via simulation its effectiveness in controlling for confounding and highlight its potential to address nonlinear confounding. Finally, we apply the proposed procedure to analyze the effect of gender on prescription opioid use using insurance claims data. △ Less

Submitted 10 January, 2018; v1 submitted 1 December, 2016; originally announced December 2016.

$p$-adic Distance, Finite Precision and Emergent Superdeterminism: A Number-Theoretic Consistent-Histories Approach to Local Quantum Realism

Authors: T. N. Palmer

Abstract: Although the notion of superdeterminism can, in principle, account for the violation of the Bell inequalities, this potential explanation has been roundly rejected by the quantum foundations community. The arguments for rejection, one of the most substantive coming from Bell himself, are critically reviewed. In particular, analysis of Bell's argument reveals an implicit unwarranted assumption: tha… ▽ More Although the notion of superdeterminism can, in principle, account for the violation of the Bell inequalities, this potential explanation has been roundly rejected by the quantum foundations community. The arguments for rejection, one of the most substantive coming from Bell himself, are critically reviewed. In particular, analysis of Bell's argument reveals an implicit unwarranted assumption: that the Euclidean metric is the appropriate yardstick for measuring distances in state space. Bell's argument is largely negated if this yardstick is instead based on the alternative $p$-adic metric. Such a metric, common in number theory, arises naturally when describing chaotic systems which evolve precisely on self-similar invariant sets in their state space. A locally-causal realistic model of quantum entanglement is developed, based on the premise that the laws of physics ultimately derive from an invariant-set geometry in the state space of a deterministic quasi-cyclic mono-universe. Based on this, the notion of a complex Hilbert vector is reinterpreted in terms of an uncertain selection from a finite sample space of states, leading to a novel form of `consistent histories' based on number-theoretic properties of the transcendental cosine function. This leads to novel realistic interpretations of position/momentum non-commutativity, EPR, the Bell Theorem and the Tsirelson bound. In this inherently holistic theory - neither conspiratorial, retrocausal, fine tuned nor nonlocal - superdeterminism is not invoked by fiat but is emergent from these `consistent histories' number-theoretic constraints. Invariant set theory provides new perspectives on many of the contemporary problems at the interface of quantum and gravitational physics, and, if correct, may signal the end of particle physics beyond the Standard Model. △ Less

Submitted 24 September, 2016; originally announced September 2016.

Comments: 40 pages, 6 Figures

Invariant Set Theory

Authors: T. N. Palmer

Abstract: Invariant Set Theory (IST) is a realistic, locally causal theory of fundamental physics which assumes a much stronger synergy between cosmology and quantum physics than exists in contemporary theory. In IST the (quasi-cyclic) universe $U$ is treated as a deterministic dynamical system evolving precisely on a measure-zero fractal invariant subset $I_U$ of its state space. In this approach, the geom… ▽ More Invariant Set Theory (IST) is a realistic, locally causal theory of fundamental physics which assumes a much stronger synergy between cosmology and quantum physics than exists in contemporary theory. In IST the (quasi-cyclic) universe $U$ is treated as a deterministic dynamical system evolving precisely on a measure-zero fractal invariant subset $I_U$ of its state space. In this approach, the geometry of $I_U$, and not a set of differential evolution equations in space-time $\mathcal M_U$, provides the most primitive description of the laws of physics. As such, IST is non-classical. The geometry of $I_U$ is based on Cantor sets of space-time trajectories in state space, homeomorphic to the algebraic set of $p$-adic integers, for large but finite $p$. In IST, the non-commutativity of position and momentum observables arises from number theory - in particular the non-commensurateness of $φ$ and $\cos φ$. The complex Hilbert Space and the relativistic Dirac Equation respectively are shown to describe $I_U$, and evolution on $I_U$, in the singular limit of IST at $p=\infty$; particle properties such as de Broglie relationships arise from the helical geometry of trajectories on $I_U$ in the neighbourhood of $\mathcal M_U$. With the p-adic metric as a fundamental measure of distance on $I_U$, certain key perturbations which seem conspiratorially small relative to the more traditional Euclidean metric, take points away from $I_U$ and are therefore unphysically large. This allows (the $ψ$-epistemic) IST to evade the Bell and Pusey et al theorems without fine tuning or other objections. In IST, the problem of quantum gravity becomes one of combining the pseudo-Riemannian metric of $\mathcal M_U$ with the p-adic metric of $I_U$. A generalisation of the field equations of general relativity which can achieve this is proposed. △ Less

Submitted 30 April, 2016; originally announced May 2016.

Comments: Phys Rev D In Review. supercedes arXiv:1502.06968

Stochastic Parameterization: Towards a new view of Weather and Climate Models

Authors: Judith Berner, Ulrich Achatz, Lauriane Batte, Lisa Bengtsson, Alvaro De La Camara, Daan Crommelin, Hannah Christensen, Matteo Colangeli, Stamen Dolaptchiev, Christian L. E. Franzke, Petra Friederichs, Peter Imkeller, Heikki Jarvinen, Stephan Juricke, Vassili Kitsios, Franois Lott, Valerio Lucarini, Salil Mahajan, Timothy N. Palmer, Cecile Penland, **-Song Von Storch, Mirjana Sakradzija, Michael Weniger, Antje Weisheimer, Paul D. Williams , et al. (1 additional authors not shown)

Abstract: The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not… ▽ More The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not only provides better estimates of uncertainty, but it is also extremely promising for reducing longstanding climate biases and relevant for determining the climate response to external forcing. This article highlights recent developments from different research groups which show that the stochastic representation of unresolved processes in the atmosphere, oceans, land surface and cryosphere of comprehensive weather and climate models (a) gives rise to more reliable probabilistic forecasts of weather and climate and (b) reduces systematic model bias. We make a case that the use of mathematically stringent methods for the derivation of stochastic dynamic equations will lead to substantial improvements in our ability to accurately simulate weather and climate at all scales. Recent work in mathematics, statistical mechanics and turbulence is reviewed, its relevance for the climate problem demonstrated, and future research directions outlined. △ Less

Submitted 20 March, 2017; v1 submitted 29 October, 2015; originally announced October 2015.

Comments: 26 pages, 15 figures. Final published version

Oceanic stochastic parametrizations in a seasonal forecast system

Authors: M. Andrejczuk, F. C. Cooper, S. Juricke, T. N. Palmer, A. Weisheimer, L. Zanna

Abstract: We study the impact of three stochastic parametrizations in the ocean component of a coupled model, on forecast reliability over seasonal timescales. The relative impacts of these schemes upon the ocean mean state and ensemble spread are analyzed. The oceanic variability induced by the atmospheric forcing of the coupled system is, in most regions, the major source of ensemble spread. The largest i… ▽ More We study the impact of three stochastic parametrizations in the ocean component of a coupled model, on forecast reliability over seasonal timescales. The relative impacts of these schemes upon the ocean mean state and ensemble spread are analyzed. The oceanic variability induced by the atmospheric forcing of the coupled system is, in most regions, the major source of ensemble spread. The largest impact on spread and bias came from the Stochastically Perturbed Parametrization Tendency (SPPT) scheme - which has proven particularly effective in the atmosphere. The key regions affected are eddy-active regions, namely the western boundary currents and the Southern Ocean. However, unlike its impact in the atmosphere, SPPT in the ocean did not result in a significant decrease in forecast error. Whilst there are good grounds for implementing stochastic schemes in ocean models, our results suggest that they will have to be more sophisticated. Some suggestions for next-generation stochastic schemes are made. △ Less

Submitted 30 June, 2015; originally announced June 2015.

Comments: 24 pages, 3 figures

Bell's Conspiracy, Schrödinger's Black Cat and Global Invariant Sets

Authors: T. N. Palmer

Abstract: A locally causal hidden-variable theory of quantum physics need not be constrained by the Bell inequalities if this theory also partially violates the measurement independence condition. However, such violation can appear unphysical, implying implausible conspiratorial correlations between the hidden-variables of particles being measured and earlier determinants of instrumental settings. A novel p… ▽ More A locally causal hidden-variable theory of quantum physics need not be constrained by the Bell inequalities if this theory also partially violates the measurement independence condition. However, such violation can appear unphysical, implying implausible conspiratorial correlations between the hidden-variables of particles being measured and earlier determinants of instrumental settings. A novel physically plausible explanation for such correlations is proposed, based on the hypothesis that states of physical reality lie precisely on a non-computational measure-zero dynamically invariant set in the state space of the universe: the Cosmological Invariant Set Postulate. To illustrate the relevance of the concept of a global invariant set, a simple analogy is considered where a massive object is propelled into a black hole depending on the decay of a radioactive atom. It is claimed that a locally causal hidden-variable theory constrained by the Cosmological Invariant Set Postulate can violate the CHSH inequality without being conspiratorial, superdeterministic, fine-tuned or retrocausal, and the theory readily accommodates the classical compatibilist notion of (experimenter) free will. △ Less

Submitted 24 February, 2015; originally announced February 2015.

Comments: To appear in Special Issue "New Geometric Concepts in the Foundations of Quantum Physics" of Phil Trans Roy Soc A

Invariant Set Theory and the Symbolism of Quantum Measurement

Authors: T. N. Palmer

Abstract: Elements of a novel theory of quantum physics are developed, synthesising the role of symbolism in describing quantum measurement and in the topological representation of fractal invariant sets in nonlinear dynamical systems theory. In this synthesis, the universe $U$ is treated as an isolated deterministic dynamical system evolving precisely on a measure-zero fractal invariant subset $I_U$ of its… ▽ More Elements of a novel theory of quantum physics are developed, synthesising the role of symbolism in describing quantum measurement and in the topological representation of fractal invariant sets in nonlinear dynamical systems theory. In this synthesis, the universe $U$ is treated as an isolated deterministic dynamical system evolving precisely on a measure-zero fractal invariant subset $I_U$ of its state space. A non-classical approach to the physics of $U$ is developed by treating the geometry of $I_U$ as more primitive than dynamical evolution equations on $I_U$. A specific symbolic representation of $I_U$ is constructed which encodes quaternionic multiplication and from which the statistical properties of complex Hilbert Space vectors are emergent. The Hilbert Space itself arises as the singular limit of Invariant Set Theory as a fractal parameter $N \rightarrow \infty$. Although the Hilbert Space of quantum theory is counterfactually complete, the measure-zero set $I_U$ is counterfactually incomplete, no matter how large is $N$. Such incompleteness allows reinterpretations of familiar quantum phenomena, consistent with realism and local causality. The non-computable nature of $I_U$ ensures that these reinterpretations are neither conspiratorial nor retrocausal and, through a homeomorphism with the ring of $2^N$-adic integers, are robust to noise and hence not fine tuned. The non-commutativity of Hilbert Space observables emerges from the symbolic representation of $I_U$ through the generic number-theoretic incommensurateness of $φ/π$ and $\cos φ$. Invariant Set Theory implies a much stronger synergy between cosmology and quantum physics than exists in contemporary theory, suggesting a novel approach to synthesising gravitational and quantum physics and providing new perspectives on the dark universe and information loss in black holes. △ Less

Submitted 10 June, 2016; v1 submitted 24 February, 2015; originally announced February 2015.

Comments: I am replacing this paper with a revised version (arXiv:1605.01051) that is sufficiently different to this original one that it is not a simple "replacement"

Neuronal noise as a physical resource for human cognition

Authors: T. N. Palmer, M. O'Shea

Abstract: A new class of energy-efficient digital microprocessor is being developed which is susceptible to thermal noise and consequently operates in probabilistic rather than conventional deterministic mode. Hybrid computing systems which combine probabilistic and deterministic processors can provide robust and efficient tools for computational problems that hitherto would be intractable by conventional d… ▽ More A new class of energy-efficient digital microprocessor is being developed which is susceptible to thermal noise and consequently operates in probabilistic rather than conventional deterministic mode. Hybrid computing systems which combine probabilistic and deterministic processors can provide robust and efficient tools for computational problems that hitherto would be intractable by conventional deterministic algorithm. These developments suggest a revised perspective on the consequences of ion-channel noise in slender axons, often regarded as a hindrance to neuronal computations. It is proposed that the human brain is such an energy-efficient hybrid computational system whose remarkable characteristics emerge from constructive synergies between probabilistic and deterministic modes of operation. In particular, the capacity for intuition and creative problem solving appears to arise naturally from such a hybrid system. Bearing in mind that physical thermal noise is both pure and available at no cost, our proposal has implications for attempts to emulate the energy-efficient human brain on conventional energy-intensive deterministic supercomputers. △ Less

Submitted 16 December, 2014; originally announced December 2014.

On the reliability of Seasonal Climate Forecasts

Authors: Antje Weisheimer, T. N. Palmer

Abstract: Seasonal climate forecasts are being used increasingly across a range of application sectors. A recent UK governmental report asked: How good are seasonal climate forecasts on a scale of 1-5 (where 5 is very good), and how good can we expect them to be in 30 years time? Seasonal climate forecasts are made from ensembles of integrations of numerical models of climate. We argue that goodness should… ▽ More Seasonal climate forecasts are being used increasingly across a range of application sectors. A recent UK governmental report asked: How good are seasonal climate forecasts on a scale of 1-5 (where 5 is very good), and how good can we expect them to be in 30 years time? Seasonal climate forecasts are made from ensembles of integrations of numerical models of climate. We argue that goodness should be assessed primarily in terms of the probabilistic reliability of these ensemble-based forecasts and that a 5 should be reserved for systems which are not only reliable overall, but where, in particular, small ensemble spread is a reliable indicator of low ensemble forecast error. We study the reliability of regional temperature and precipitation forecasts of the current operational seasonal forecast system of the European Centre for Medium-Range Weather Forecasts, universally regarded as a world leading operational institute producing seasonal climate forecasts. A wide range of goodness rankings, depending on region and variable (with summer forecasts of rainfall over Northern Europe performing exceptionally poorly) is found. Finally, we discuss the prospects of reaching 5 across all regions and variables in 30 years time. △ Less

Submitted 12 October, 2013; originally announced October 2013.

Lorenz, Gödel and Penrose: New perspectives on determinism and causality in fundamental physics

Authors: T. N. Palmer

Abstract: Despite being known for his pioneering work on chaotic unpredictability, the key discovery at the core of meteorologist Ed Lorenz's work is the link between space-time calculus and state-space fractal geometry. Indeed, properties of Lorenz's fractal invariant set relate space-time calculus to deep areas of mathematics such as Gödel's Incompleteness Theorem. These properties, combined with some rec… ▽ More Despite being known for his pioneering work on chaotic unpredictability, the key discovery at the core of meteorologist Ed Lorenz's work is the link between space-time calculus and state-space fractal geometry. Indeed, properties of Lorenz's fractal invariant set relate space-time calculus to deep areas of mathematics such as Gödel's Incompleteness Theorem. These properties, combined with some recent developments in theoretical and observational cosmology, motivate what is referred to as the `cosmological invariant set postulate': that the universe $U$ can be considered a deterministic dynamical system evolving on a causal measure-zero fractal invariant set $I_U$ in its state space. Symbolic representations of $I_U$ are constructed explicitly based on permutation representations of quaternions. The resulting `invariant set theory' provides some new perspectives on determinism and causality in fundamental physics. For example, whilst the cosmological invariant set appears to have a rich enough structure to allow a description of quantum probability, its measure-zero character ensures it is sparse enough to prevent invariant set theory being constrained by the Bell inequality (consistent with a partial violation of the so-called measurement independence postulate). The primacy of geometry as embodied in the proposed theory extends the principles underpinning general relativity. As a result, the physical basis for contemporary programmes which apply standard field quantisation to some putative gravitational lagrangian is questioned. Consistent with Penrose's suggestion of a deterministic but non-computable theory of fundamental physics, a `gravitational theory of the quantum' is proposed based on the geometry of $I_U$, with potential observational consequences for the dark universe. △ Less

Submitted 25 March, 2014; v1 submitted 10 September, 2013; originally announced September 2013.

Comments: This manuscript has been accepted for publication in Contemporary Physics and is based on the author's 9th Dennis Sciama Lecture, given in Oxford and Trieste

Quantum Theory and The Symbolic Dynamics of Invariant Sets: Towards a Gravitational Theory of the Quantum

Authors: T. N. Palmer

Abstract: A realistic measurement-free theory for the quantum physics of multiple qubits is proposed. This theory is based on a symbolic representation of a fractal state-space geometry which is invariant under the action of deterministic and locally causal dynamics. This symbolic representation is constructed from self-similar families of quaternionic operators. Using number-theoretic properties of the cos… ▽ More A realistic measurement-free theory for the quantum physics of multiple qubits is proposed. This theory is based on a symbolic representation of a fractal state-space geometry which is invariant under the action of deterministic and locally causal dynamics. This symbolic representation is constructed from self-similar families of quaternionic operators. Using number-theoretic properties of the cosine function, the statistical properties of the symbolic representation of the invariant set are shown to be consistent with the contextual requirements of the Kochen-Specker theorem, are not constrained by Bell inequalities, and mirror the statistics of entangled qubits. These number-theoretic properties in turn reflect the sparseness of the invariant set in state space, and relate to the metaphysical notion of counterfactual incompleteness. Using the concept of probability, the complex Hilbert Space can be considered the completion of this symbolic representation into the state space continuum. As a result, it is proposed that the complex Hilbert Space should merely be considered a computational convenience in the light of the algorithmic intractability of the invariant set geometry, and consequently the superposed state should not be considered a fundamental aspect of physical theory. The physical basis for the proposed theory is relativistic gravity; for example the symbols used to describe the invariant set themselves label gravitationally distinct cosmological space-times. This implies that the very notion of a `quantum theory of gravity' may be profoundly misguided - erroneously putting the quantum cart before the gravitational horse. Here some elements of an alternative `gravitational theory of the quantum' are proposed, based on a deterministic and locally causal theory of gravity which extends general relativity by being geometric in both space-time and state space. △ Less

Submitted 20 May, 2013; v1 submitted 15 October, 2012; originally announced October 2012.

Comments: Minor revisions, including some shortening, to first submission

Warkworth 12-m VLBI Station: WARK12M

Authors: Sergei Gulyaev, Tim Natusch, Stuart Weston, Neville Palmer, David Collett

Abstract: This report summarizes the geodetic VLBI activities in New Zealand in 2010. It provides geographical and technical details of WARK12M - the new IVS network station operated by the Institute for Radio Astronomy and Space Research (IRASR) of Auckland University of Technology (AUT). The details of the VLBI system installed in the station are outlined along with those of the collocated GNSS station. W… ▽ More This report summarizes the geodetic VLBI activities in New Zealand in 2010. It provides geographical and technical details of WARK12M - the new IVS network station operated by the Institute for Radio Astronomy and Space Research (IRASR) of Auckland University of Technology (AUT). The details of the VLBI system installed in the station are outlined along with those of the collocated GNSS station. We report on the status of broadband connectivity and on the results of testing data transfer protocols; we investigate UDP protocols such as 'tsunami' and UDT and demonstrate that the UDT protocol is more efficient than 'tsunami' and 'ftp'. In general, the WARK12M IVS network station is fully equipped, connected and tested to start participating in regular IVS observational sessions from the beginning of 2011. △ Less

Submitted 14 March, 2011; originally announced March 2011.

Comments: 5 pages, 1 figure, Accepeted for the IVS 2010 Annual Report

First geodetic observations using new VLBI stations ASKAP-29 and WARK12M

Authors: Leonid Petrov, Chris Phillips, Tasso Tzioumis, Bruce Stansby, Cormac Reynolds, Hayley Bignall, Sergei Gulyaev, Tim Natusch, Neville Palmer, David Collett, John Reynolds, Shaun W Amy, Randall Wayth, Steven Tingay

Abstract: We report the results of a successful 7 hour 1.4 GHz VLBI experiment using two new stations, ASKAP-29 located in Western Australia and WARK12M located on the North Island of New Zealand. This was the first geodetic VLBI observing session with the participation of these new stations. We have determined the positions of ASKAP-29 and WARK12M. Random errors on position estimates are 150-200 mm for the… ▽ More We report the results of a successful 7 hour 1.4 GHz VLBI experiment using two new stations, ASKAP-29 located in Western Australia and WARK12M located on the North Island of New Zealand. This was the first geodetic VLBI observing session with the participation of these new stations. We have determined the positions of ASKAP-29 and WARK12M. Random errors on position estimates are 150-200 mm for the vertical component and 40-50 mm for the horizontal component. Systematic errors caused by the unmodeled ionosphere path delay may reach 1.3 m for the vertical component. △ Less

Submitted 25 June, 2011; v1 submitted 20 December, 2010; originally announced December 2010.

Comments: 11 pages, 6 flgures, 4 tables

Journal ref: Publications of the Astronomical Society of Australia, 2011, 28(2), 107-115

Fractional quantum Hall effect in a U(1)xSU(2) gauge field

Authors: Rebecca N. Palmer, Jiannis K. Pachos

Abstract: We consider the bosonic fractional quantum Hall effect in the presence of a non-Abelian gauge field in addition to the usual Abelian magnetic field. The non-Abelian field breaks the twofold internal state degeneracy, but preserves the Landau level degeneracy. Using exact diagonalization, we find that for moderate non-Abelian field strengths the system's behaviour resembles a single internal state… ▽ More We consider the bosonic fractional quantum Hall effect in the presence of a non-Abelian gauge field in addition to the usual Abelian magnetic field. The non-Abelian field breaks the twofold internal state degeneracy, but preserves the Landau level degeneracy. Using exact diagonalization, we find that for moderate non-Abelian field strengths the system's behaviour resembles a single internal state quantum Hall system, while for stronger fields there is a phase transition to either two internal state behaviour or the complete absence of fractional quantum Hall plateaus. Usually the energy gap is reduced by the presence of a non-Abelian field, but some non-Abelian fields appear to slightly increase the gap of the $ν=1$ and $ν=3/2$ Read-Rezayi states. △ Less

Submitted 16 December, 2010; originally announced December 2010.

Comments: 15 pages, 8 figures, submitted to New J. Phys

Journal ref: New J. Phys. 13, 065002 (2011)

Enhancing laser sideband cooling in one-dimensional optical lattices via the dipole interaction

Authors: Rebecca N. Palmer, Almut Beige

Abstract: We study resolved sideband laser cooling of a one-dimensional optical lattice with one atom per site, and in particular the effect of the dipole interaction between radiating atoms. For simplicity, we consider the case where only a single cooling laser is applied. We derive a master equation, and solve it in the limit of a deep lattice and weak laser driving. We find that the dipole interaction… ▽ More We study resolved sideband laser cooling of a one-dimensional optical lattice with one atom per site, and in particular the effect of the dipole interaction between radiating atoms. For simplicity, we consider the case where only a single cooling laser is applied. We derive a master equation, and solve it in the limit of a deep lattice and weak laser driving. We find that the dipole interaction significantly changes the final temperature of the particles, increasing it for some phonon wavevectors and decreasing it for others. The total phonon energy over all modes is typically higher than in the non-interacting case, but can be made lower by the right choice of parameters. △ Less

Submitted 14 January, 2010; originally announced January 2010.

Journal ref: Phys. Rev. A 81, 053411 (2010)

The Invariant Set Postulate: A New Geometric Framework for the Foundations of Quantum Theory and the Role Played by Gravity

Authors: T. N. Palmer

Abstract: A new law of physics is proposed, defined on the cosmological scale but with significant implications for the microscale. Motivated by nonlinear dynamical systems theory and black-hole thermodynamics, the Invariant Set Postulate proposes that cosmological states of physical reality belong to a non-computable fractal state-space geometry I, invariant under the action of some subordinate determini… ▽ More A new law of physics is proposed, defined on the cosmological scale but with significant implications for the microscale. Motivated by nonlinear dynamical systems theory and black-hole thermodynamics, the Invariant Set Postulate proposes that cosmological states of physical reality belong to a non-computable fractal state-space geometry I, invariant under the action of some subordinate deterministic causal dynamics. An exploratory analysis is made of a possible causal realistic framework for quantum physics, based on key properties of I. For example, sparseness is used to relate generic counterfactual states to points not lying on I, thus providing a geometric basis for the essential contextuality of quantum physics and the role of the abstract Hilbert Space in quantum theory. Also, self-similarity, described in a symbolic setting, provides a possible "realistic" perspective on the essential role of complex numbers and quaternions in quantum theory. A new interpretation is given to the standard "mysteries" of quantum theory: superposition, measurement, nonlocality, emergence of classicality and so on. It is proposed that heterogeneities in the fractal geometry of I are manifestations of the phenomenon of gravity. Since quantum theory is inherently blind to the existence of such state-space geometries, the analysis here suggests that attempts to formulate unified theories of physics within a conventional quantum-theoretic framework are misguided, and that a successful quantum theory of gravity should unify the causal non-Euclidean geometry of space time with the atemporal fractal geometry of state space. △ Less

Submitted 30 June, 2009; v1 submitted 5 December, 2008; originally announced December 2008.

Comments: Accepted for publication in Proceedings of the Royal Society A

Journal ref: Proc.Roy.Soc.Lond.A465:3187-3207,2009

Towards the Probabilistic Earth-System Model

Authors: T. N. Palmer, F. J. Doblas-Reyes, A. Weisheimer, G. J. Shutts, J. Berner, J. M. Murphy

Abstract: Multi-model ensembles provide a pragmatic approach to the representation of model uncertainty in climate prediction. However, such representations are inherently ad hoc, and, as shown, probability distributions of climate variables based on current-generation multi-model ensembles, are not accurate. Results from seasonal re-forecast studies suggest that climate model ensembles based on stochasti… ▽ More Multi-model ensembles provide a pragmatic approach to the representation of model uncertainty in climate prediction. However, such representations are inherently ad hoc, and, as shown, probability distributions of climate variables based on current-generation multi-model ensembles, are not accurate. Results from seasonal re-forecast studies suggest that climate model ensembles based on stochastic-dynamic parametrisation are beginning to outperform multi-model ensembles, and have the potential to become significantly more skilful than multi-model ensembles. The case is made for stochastic representations of model uncertainty in future-generation climate prediction models. Firstly, a guiding characteristic of the scientific method is an ability to characterise and predict uncertainty; individual climate models are not currently able to do this. Secondly, through the effects of noise-induced rectification, stochastic-dynamic parametrisation may provide a (poor man's) surrogate to high resolution. Thirdly, stochastic-dynamic parametrisations may be able to take advantage of the inherent stochasticity of electron flow through certain types of low-energy computer chips, currently under development. These arguments have particular resonance for next-generation Earth-System models, which purport to be comprehensive numerical representations of climate, and where integrations at high resolution may be unaffordable. △ Less

Submitted 26 August, 2009; v1 submitted 5 December, 2008; originally announced December 2008.

Comments: 19 pages, 4 figures

Optical lattice quantum Hall effect

Authors: Rebecca N. Palmer, Alexander Klein, Dieter Jaksch

Abstract: We explore the behavior of interacting bosonic atoms in an optical lattice subject to a large artificial magnetic field. We extend earlier investigations of this system where the number of magnetic flux quanta per unit cell alpha is close to a simple rational number [Phys. Rev. Lett. 96, 180407 (2006)]. Interesting topological states such as the Laughlin and Read-Rezayi states can occur even if… ▽ More We explore the behavior of interacting bosonic atoms in an optical lattice subject to a large artificial magnetic field. We extend earlier investigations of this system where the number of magnetic flux quanta per unit cell alpha is close to a simple rational number [Phys. Rev. Lett. 96, 180407 (2006)]. Interesting topological states such as the Laughlin and Read-Rezayi states can occur even if the atoms experience a weak trap** potential in one direction. An explicit numerical calculation near alpha = 1/2 shows that the system exhibits a striped vortex lattice phase of one species, which is analogous to the behavior of a two-species system for small alpha. We also investigate methods to probe the encountered states. These include spatial correlation functions and the measurement of noise correlations in time of flight expanded atomic clouds. Characteristic differences arise which allow for an identification of the respective quantum Hall states. We furthermore discuss that a counterintuitive flow of the Hall current occurs for certain values of alpha. △ Less

Submitted 8 July, 2008; v1 submitted 26 March, 2008; originally announced March 2008.

Comments: 14 pages, 5 figures, slight changes in the Introduction, typos corrected

Journal ref: Phys. Rev. A 78, 013609 (2008)

PAC Classification based on PAC Estimates of Label Class Distributions

Authors: Nick Palmer, Paul W. Goldberg

Abstract: A standard approach in pattern classification is to estimate the distributions of the label classes, and then to apply the Bayes classifier to the estimates of the distributions in order to classify unlabeled examples. As one might expect, the better our estimates of the label class distributions, the better the resulting classifier will be. In this paper we make this observation precise by iden… ▽ More A standard approach in pattern classification is to estimate the distributions of the label classes, and then to apply the Bayes classifier to the estimates of the distributions in order to classify unlabeled examples. As one might expect, the better our estimates of the label class distributions, the better the resulting classifier will be. In this paper we make this observation precise by identifying risk bounds of a classifier in terms of the quality of the estimates of the label class distributions. We show how PAC learnability relates to estimates of the distributions that have a PAC guarantee on their $L_1$ distance from the true distribution, and we bound the increase in negative log likelihood risk in terms of PAC bounds on the KL-divergence. We give an inefficient but general-purpose smoothing method for converting an estimated distribution that is good under the $L_1$ metric into a distribution that is good under the KL-divergence. △ Less

Submitted 11 July, 2006; originally announced July 2006.

Comments: 14 pages

High field fractional quantum Hall effect in optical lattices

Authors: R. N. Palmer, D. Jaksch

Abstract: We consider interacting bosonic atoms in an optical lattice subject to a large simulated magnetic field. We develop a model similar to a bilayer fractional quantum Hall system valid near simple rational numbers of magnetic flux quanta per lattice cell. Then we calculate its ground state, magnetic lengths, fractional fillings, and find unexpected sign changes in the Hall current. Finally we study… ▽ More We consider interacting bosonic atoms in an optical lattice subject to a large simulated magnetic field. We develop a model similar to a bilayer fractional quantum Hall system valid near simple rational numbers of magnetic flux quanta per lattice cell. Then we calculate its ground state, magnetic lengths, fractional fillings, and find unexpected sign changes in the Hall current. Finally we study methods for detecting these novel features via shot noise and Hall current measurements. △ Less

Submitted 26 April, 2006; originally announced April 2006.

Comments: 4 pages, 4 figures, accepted by PRL

Journal ref: Phys. Rev. Lett. 96, 180407 (2006)

Causal Incompleteness: A New Perspective on Quantum Non-locality

Authors: T. N. Palmer

Abstract: The mathematical notion of incompleteness (eg of rational numbers, Turing-computable functions, and arithmetic proof) does not play a key role in conventional physics. Here, a reformulation of the kinematics of quantum theory is attempted, based on an inherently granular and discontinuous state space, in which the quantum wavefunction is associated with a finite set of finite bit strings, and th… ▽ More The mathematical notion of incompleteness (eg of rational numbers, Turing-computable functions, and arithmetic proof) does not play a key role in conventional physics. Here, a reformulation of the kinematics of quantum theory is attempted, based on an inherently granular and discontinuous state space, in which the quantum wavefunction is associated with a finite set of finite bit strings, and the unitary transformations of complex Hilbert space are reformulated as finite permutation and related operators incorporating complex and hyper-complex structure. Such a reformulation, consistent with Wheeler's `It from Bit' programme, provides the basis for a novel interpretation of the Bell theorem: that the experimental violation of the Bell inequalities reveals the inevitable incompleteness of the causal structure of physical theory. The kinematic reformulation of quantum theory so developed, provides a new perspective on the age-old dichotomy of free will versus determinism. △ Less

Submitted 29 November, 2005; originally announced November 2005.

Comments: 20 pages, no figures