Showing 1–50 of 71 results for author: Palmer, T

Global sensitivity analysis in Monte Carlo radiation transport

Authors: Kayla Clements, Gianluca Geraci, Aaron J Olson, Todd S Palmer

Abstract: We consider Global Sensitivity Analysis for Monte Carlo radiation transport applications. GSA is usually combined with Uncertainty Quantification, where the latter quantifies the variability of a model output in the presence of uncertain inputs and the former attributes this variability to the inputs. The additional noise inherent to MC RT solvers due to the finite number of particle histories pre… ▽ More We consider Global Sensitivity Analysis for Monte Carlo radiation transport applications. GSA is usually combined with Uncertainty Quantification, where the latter quantifies the variability of a model output in the presence of uncertain inputs and the former attributes this variability to the inputs. The additional noise inherent to MC RT solvers due to the finite number of particle histories presents an additional challenge to GSA and UQ, which are well-established for deterministic solvers. In this contribution, we apply variance deconvolution to the Saltelli method to address MC RT solver noise without having to over-resolve the MC RT simulation. △ Less

Submitted 15 March, 2024; v1 submitted 10 March, 2024; originally announced March 2024.

Comments: Presented at The International Conference on Mathematics and Computational Methods Applied to Nuclear Science and Engineering, 2023

Journal ref: Proceedings of The International Conference on Mathematics and Computational Methods Applied to Nuclear Science and Engineering, 2023

The Monte Carlo Computational Summit -- October 25 & 26, 2023 -- Notre Dame, Indiana, USA

Authors: Joanna Piper Morgan, Alexander Mote, Samuel Lee Pasmann, Gavin Ridley, Todd Palmer, Kyle E. Niemeyer, Ryan McClarren

Abstract: The Monte Carlo Computational Summit was held on the campus of the University of Notre Dame in South Bend, Indiana, USA on 25--26 October 2023. The goals of the summit were to discuss algorithmic and software alterations required for successfully porting respective code bases to exascale-class computing hardware, compare software engineering techniques used by various code teams, and consider the… ▽ More The Monte Carlo Computational Summit was held on the campus of the University of Notre Dame in South Bend, Indiana, USA on 25--26 October 2023. The goals of the summit were to discuss algorithmic and software alterations required for successfully porting respective code bases to exascale-class computing hardware, compare software engineering techniques used by various code teams, and consider the adoption of industry-standard benchmark problems to better facilitate code-to-code performance comparisons. A large portion of the meeting included candid discussions of direct experiences with approaches that have and have not worked. Participants reported that identifying and implementing suitable Monte Carlo algorithms for GPUs continues to be a sticking point. They also report significant difficulty porting existing algorithms between GPU APIs (specifically Nvidia CUDA to AMD ROCm). To better compare code-to-code performance, participants decided to design a C5G7-like benchmark problem with a defined figure of merit, with the expectation of adding more benchmarks in the future. Problem specifications and results will eventually be hosted in a public repository and will be open to submissions by all Monte Carlo transport codes capable of running the benchmark problem. The participants also identified the need to explore the intermediate and long-term future of the Monte Carlo neutron transport community and how best to modernize and contextualize Monte Carlo as a useful tool in modern industry. Overall the summit was considered to be a success by the organizers and participants, and the group shared a strong desire for future, potentially larger, Monte Carlo summits. △ Less

Submitted 12 February, 2024; originally announced February 2024.

Comments: conference report

Further analysis of cGAN: A system for Generative Deep Learning Post-processing of Precipitation

Authors: Fenwick C. Cooper, Andrew T. T. McRae, Matthew Chantry, Bobby Antonio, Tim N. Palmer

Abstract: The conditional generative adversarial rainfall model "cGAN" developed for the UK \cite{Harris22} was trained to post-process into an ensemble and downscale ERA5 rainfall to 1km resolution over three regions of the USA and the UK. Relative to radar data (stage IV and NIMROD), the quality of the forecast rainfall distribution was quantified locally at each grid point and between grid points using t… ▽ More The conditional generative adversarial rainfall model "cGAN" developed for the UK \cite{Harris22} was trained to post-process into an ensemble and downscale ERA5 rainfall to 1km resolution over three regions of the USA and the UK. Relative to radar data (stage IV and NIMROD), the quality of the forecast rainfall distribution was quantified locally at each grid point and between grid points using the spatial correlation structure. Despite only having information from a single lower quality analysis, the ensembles of post processed rainfall produced were found to be competitive with IFS ensemble forecasts with lead times of between 8 and 16 hours. Comparison to the original cGAN trained on the UK using the IFS HRES forecast indicates that improved training forecasts result in improved post-processing. The cGAN models were additionally applied to the regions that they were not trained on. Each model performed well in their own region indicating that each model is somewhat region specific. However the model trained on the Washington DC, Atlantic coast, region achieved good scores across the USA and was competitive over the UK. There are more overall rainfall events spread over the whole region so the improved scores might be simply due to increased data. A model was therefore trained using data from all four regions which then outperformed the models trained locally. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Taxonomy for Physics Beyond Quantum Mechanics

Authors: Emily Adlam, Jonte R. Hance, Sabine Hossenfelder, Tim N. Palmer

Abstract: We propose terminology to classify interpretations of quantum mechanics and models that modify or complete quantum mechanics. Our focus is on models which have previously been referred to as superdeterministic (strong or weak), retrocausal (with or without signalling, dynamical or non-dynamical), future-input-dependent, atemporal and all-at-once, not always with the same meaning or context. Someti… ▽ More We propose terminology to classify interpretations of quantum mechanics and models that modify or complete quantum mechanics. Our focus is on models which have previously been referred to as superdeterministic (strong or weak), retrocausal (with or without signalling, dynamical or non-dynamical), future-input-dependent, atemporal and all-at-once, not always with the same meaning or context. Sometimes these models are assumed to be deterministic, sometimes not, the word deterministic has been given different meanings, and different notions of causality have been used when classifying them. This has created much confusion in the literature, and we hope that the terms proposed here will help to clarify the nomenclature. The general model framework that we will propose may also be useful to classify other interpretations and modifications of quantum mechanics. This document grew out of the discussions at the 2022 Bonn Workshop on Superdeterminism and Retrocausality. △ Less

Submitted 13 June, 2024; v1 submitted 21 September, 2023; originally announced September 2023.

Comments: 18 pages, 7 figures. Accepted for publication in Proceedings of the Royal Society A; matches accepted version

Superdeterminism Without Conspiracy

Authors: Tim Palmer

Abstract: Superdeterminism - where the Measurement Independence assumption in Bell's Theorem is violated - is frequently assumed to imply implausibly conspiratorial correlations between properties $λ$ of particles being measured and measurement settings $x$ and $y$. But it doesn't have to be: a superdeterministic but non-conspiratorial locally causal model is developed where each pair of entangled particles… ▽ More Superdeterminism - where the Measurement Independence assumption in Bell's Theorem is violated - is frequently assumed to imply implausibly conspiratorial correlations between properties $λ$ of particles being measured and measurement settings $x$ and $y$. But it doesn't have to be: a superdeterministic but non-conspiratorial locally causal model is developed where each pair of entangled particles has unique $λ$. The model is based on a specific but arbitrarily fine discretisation of complex Hilbert space, where $λ$ defines the information, over and above the freely chosen nominal settings $x$ and $y$, which fixes the exact measurement settings $X$ and $Y$ of a run of a Bell experiment. Pearlean interventions, needed to assess whether $x$ and $y$ are Bell-type free variables, are shown to be inconsistent with rational-number constraints on the discretised Hilbert states. These constraints limit the post-hoc freedom to vary $x$ kee** $λ$ and $y$ fixed but disappear with any coarse-graining of $λ$, $X$ and $Y$, rendering so-called drug-trial conspiracies irrelevant. Points in the discretised space can be realised as ensembles of symbolically labelled deterministic trajectories on an `all-at-once' fractal attractor. It is shown how quantum mechanics might be `gloriously explained and derived' as the singular continuum limit of the discretisation of Hilbert space; It is argued that the real message behind Bell's Theorem has less to do with locality, realism or freedom to choose, and more to do with the need to develop more explicitly holistic theories when attempting to synthesise quantum and gravitational physics. △ Less

Submitted 8 January, 2024; v1 submitted 22 August, 2023; originally announced August 2023.

Comments: To appear in Special Issue of the Universe - edited by Jim Al Khalili and Inge Svein Helland

Exploring One-Cell Inversion Method for Transient Transport on GPU

Authors: J. P. Morgan, Ilham Variansyah, Todd S. Palmer, Kyle E. Niemeyer

Abstract: To find deterministic solutions to the transient $S_N$ neutron transport equation, iterative schemes are typically used to treat the scattering (and fission) source terms. We explore the one-cell inversion iteration scheme to do this on the GPU and make comparisons to a source iteration scheme. We examine convergence behavior, through the analysis of spectral radii, of both one-cell inversion and… ▽ More To find deterministic solutions to the transient $S_N$ neutron transport equation, iterative schemes are typically used to treat the scattering (and fission) source terms. We explore the one-cell inversion iteration scheme to do this on the GPU and make comparisons to a source iteration scheme. We examine convergence behavior, through the analysis of spectral radii, of both one-cell inversion and source iterations. To further boost the GPU parallel efficiency, we derive a higher-order discretization method, simple corner balance (in space) and multiple balance (in time), to add more work to the threads and gain accuracy. Fourier analysis on this higher-order numerical method shows that it is unconditionally stable, but it can produce negative flux alterations that are critically damped through time. We explore a whole-problem (in all angle and all cell) sparse linear algebra framework, for both iterative schemes, to quickly produce performant code for GPUs. Despite one-cell inversion requiring additional iterations to convergence, those iterations can be done faster to provide a significant speedup over source iteration in quadrature sets at or below $S_{128}$. Going forward we will produce a two-dimensional implementation of this code to experiment with memory and performance impacts of a whole-problem framework including methods of synthetic acceleration and pre-conditioners for this scheme, then we will begin making direct comparisons to traditionally implemented source iteration in production code. △ Less

Submitted 9 August, 2023; v1 submitted 22 May, 2023; originally announced May 2023.

Comments: 11 pages, 4 figures, M&C 2023 ANS conference

A generalized k-epsilon model for turbulence modulation in fluid-particle flows

Authors: Roar Skartlien, Teresa Lynne Palmer, Olaf Skjæraasen

Abstract: A large amount of published data show that particles with diameter above 10\% of the turbulence integral length scale ($D/l >0.1$) tend to increase the turbulent kinetic energy of the carrier fluid above the single-phase value, and smaller particles tend to suppress it. A revised phenomenological model of the $k-ε$ type was developed to reproduce these effects with the correct asymptotic limit of… ▽ More A large amount of published data show that particles with diameter above 10\% of the turbulence integral length scale ($D/l >0.1$) tend to increase the turbulent kinetic energy of the carrier fluid above the single-phase value, and smaller particles tend to suppress it. A revised phenomenological model of the $k-ε$ type was developed to reproduce these effects with the correct asymptotic limit of no turbulence modulation for small particles, and augmentation for larger diameter solids. Particle-kinetic theory was used to derive the work exchanged between the particles and the fluid due to both drag and added mass forces to accommodate any particle/fluid density ratios including bubbles, droplets and heavy solids. For the larger particles, we devised a new model for vortex shedding induced by the slip between the particles and the turbulent flow, due to particle inertia. Simple approximate formulae for the turbulence modulation were obtained through asymptotic analysis. The overall effect for solid particles is that augmentation for large diameter solids is due to vortex shedding, and turbulence suppression for small diameters is due to mainly to turbulent drag forces and extra fluid dissipation. The transition from suppression to augmentation around $D/l = 0.1$ is a robust feature for a wide range of particle Reynolds and Stokes numbers, but we could not prove this to be a general relation on a theoretical basis. Indeed, bubbles and droplets may not display turbulence augmentation at all for the larger diameters due to moderate turbulence levels needed to prevent breakup, and the velocity difference between particles and fluid may therefore be too low for vortex shedding to occur. On the basis of the model we find that some data for solids in vertical gas flow show very large turbulence augmentation that can only be due to gravitational settling. △ Less

Submitted 8 November, 2022; originally announced November 2022.

Comments: 19 pages 8 figures

Quantum Computers for Weather and Climate Prediction: The Good, the Bad and the Noisy

Authors: Felix Tennie, Tim Palmer

Abstract: Over the past few years, quantum computers and quantum algorithms have attracted considerable interest and attention from numerous scientific disciplines. In this article, we aim to provide a non-technical, yet informative introduction to key aspects of quantum computing. We discuss whether quantum computers one day might become useful tools for numerical weather and climate prediction. Using a re… ▽ More Over the past few years, quantum computers and quantum algorithms have attracted considerable interest and attention from numerous scientific disciplines. In this article, we aim to provide a non-technical, yet informative introduction to key aspects of quantum computing. We discuss whether quantum computers one day might become useful tools for numerical weather and climate prediction. Using a recently developed quantum algorithm for solving non-linear differential equations, we integrate a simple non-linear model. In addition to considering the advantages that quantum computers have to offer, we shall also discuss the challenges one faces when trying to use quantum computers for real-world problems involving ''big data'', such as weather prediction. △ Less

Submitted 31 October, 2022; originally announced October 2022.

Deep learning for quality control of surface physiographic fields using satellite Earth observations

Authors: Tom Kimpson, Margarita Choulga, Matthew Chantry, Gianpaolo Balsamo, Souhail Boussetta, Peter Dueben, Tim Palmer

Abstract: A purposely built deep learning algorithm for the Verification of Earth-System ParametERisation (VESPER) is used to assess recent upgrades of the global physiographic datasets underpinning the quality of the Integrated Forecasting System (IFS) of the European Centre for Medium-Range Weather Forecasts (ECMWF), which is used both in numerical weather prediction and climate reanalyses. A neural netwo… ▽ More A purposely built deep learning algorithm for the Verification of Earth-System ParametERisation (VESPER) is used to assess recent upgrades of the global physiographic datasets underpinning the quality of the Integrated Forecasting System (IFS) of the European Centre for Medium-Range Weather Forecasts (ECMWF), which is used both in numerical weather prediction and climate reanalyses. A neural network regression model is trained to learn the map** between the surface physiographic dataset plus the meteorology from ERA5, and the MODIS satellite skin temperature observations. Once trained, this tool is applied to rapidly assess the quality of upgrades of the land-surface scheme. Upgrades which improve the prediction accuracy of the machine learning tool indicate a reduction of the errors in the surface fields used as input to the surface parametrisation schemes. Conversely, incorrect specifications of the surface fields decrease the accuracy with which VESPER can make predictions. We apply VESPER to assess the accuracy of recent upgrades of the permanent lake and glaciers covers as well as planned upgrades to represent seasonally varying water bodies (i.e. ephemeral lakes). We show that for grid-cells where the lake fields have been updated, the prediction accuracy in the land surface temperature (i.e mean absolute error difference between updated and original physiographic datasets) improves by 0.37 K on average, whilst for the subset of points where the lakes have been exchanged for bare ground (or vice versa) the improvement is 0.83 K. We also show that updates to the glacier cover improve the prediction accuracy by 0.22 K. We highlight how neural networks such as VESPER can assist the research and development of surface parameterizations and their input physiography to better represent Earth's surface couples processes in weather and climate models. △ Less

Submitted 24 October, 2023; v1 submitted 30 October, 2022; originally announced October 2022.

Comments: 26 pages, 16 figures. Accepted for publication in Hydrology and Earth System Sciences (HESS)

Quantum Physics from Number Theory

Authors: Tim Palmer

Abstract: The properties which give quantum mechanics its unique character - unitarity, complementarity, non-commutativity, uncertainty, nonlocality - derive from the algebraic structure of Hermitian operators acting on the wavefunction in complex Hilbert space. Because of this, the wavefunction cannot be shown to describe an ensemble of deterministic states where uncertainty simply reflects a lack of knowl… ▽ More The properties which give quantum mechanics its unique character - unitarity, complementarity, non-commutativity, uncertainty, nonlocality - derive from the algebraic structure of Hermitian operators acting on the wavefunction in complex Hilbert space. Because of this, the wavefunction cannot be shown to describe an ensemble of deterministic states where uncertainty simply reflects a lack of knowledge about which ensemble member describes reality. This has led to endless debates about the ontology of quantum mechanics. Here we derive these same quantum properties from number theoretic attributes of trigonometric functions applied to an explicitly ensemble-based representation of discretised complex Hilbert states. To avoid fine-tuning, the metric on state space must be $p$-adic rather than Euclidean where $1/p$ determines the fineness of the discretisation. This hints at both the existence of an underpinning fractal state-space geometry onto which states of the world are constrained. In this model, violation of Bell inequalities is a manifestation of this geometric constraint and does not imply a breakdown of local space-time causality. Because the discretised wavefunction describes an ensemble of states, there is no collapse of the wavefunction. Instead measurement describes a nonlinear clustering of state-space trajectories on the state-space geometry. In this model, systems with mass greater than the Planck mass will not exhibit quantum properties and instead behave classically. The geometric constraint suggests that the exponential increase in the size of state space with qubit number may break down with qubit numbers as small as a few hundred. Quantum mechanics is itself a singular limit of this number-theoretic model at $p=\infty$. A modification of general relativity, consistent with this discretised model of quantum physics, is proposed. △ Less

Submitted 12 September, 2022; originally announced September 2022.

Climate Change Modelling at Reduced Float Precision with Stochastic Rounding

Authors: Tom Kimpson, E. Adam Paxton, Matthew Chantry, Tim Palmer

Abstract: Reduced precision floating point arithmetic is now routinely deployed in numerical weather forecasting over short timescales. However the applicability of these reduced precision techniques to longer timescale climate simulations - especially those which seek to describe a dynamical, changing climate - remains unclear. We investigate this question by deploying a global atmospheric, coarse resoluti… ▽ More Reduced precision floating point arithmetic is now routinely deployed in numerical weather forecasting over short timescales. However the applicability of these reduced precision techniques to longer timescale climate simulations - especially those which seek to describe a dynamical, changing climate - remains unclear. We investigate this question by deploying a global atmospheric, coarse resolution model known as SPEEDY to simulate a changing climate system subject to increased $\text{CO}_2$ concentrations, over a 100 year timescale. Whilst double precision is typically the operational standard for climate modelling, we find that reduced precision solutions (Float32, Float16) are sufficiently accurate. Rounding the finite precision floats stochastically, rather than using the more common ``round-to-nearest" technique, notably improves the performance of the reduced precision solutions. Over 100 years the mean bias error (MBE) in the global mean surface temperature (precipitation) relative to the double precision solution is $+2 \times 10^{-4}$K ($-8 \times 10^{-5}$ mm/6hr) at single precision and $-3.5\times 10^{-2}$ K($-1 \times 10^{-2}$ mm/6hr) at half precision, whilst the inclusion of stochastic rounding reduced the half precision error to +1.8 $\times 10^{-2}$ K ($-8 \times10^{-4}$ mm/6hr). By examining the resultant climatic distributions that arise after 100 years, the difference in the expected value of the global surface temperature, relative to the double precision solution is $\leq 5 \times 10^{-3}$ K and for precipitation $8 \times 10^{-4}$ mm/6h when numerically integrating at half precision with stochastic rounding. Areas of the model which notably improve due to the inclusion of stochastic over deterministic rounding are also explored and discussed. [abridged] △ Less

Submitted 29 July, 2022; originally announced July 2022.

Comments: 13 pages, 9 figures. Submitted to QJRMS. Abstract abridged to meet arxiv requirements

Discretised Hilbert Space and Superdeterminism

Authors: T. N. Palmer

Abstract: In computational physics it is standard to approximate continuum systems with discretised representations. Here we consider a specific discretisation of the continuum complex Hilbert space of quantum mechanics - a discretisation where squared amplitudes and complex phases are rational numbers. The fineness of this discretisation is determined by a finite (prime-number) parameter $p$. As… ▽ More In computational physics it is standard to approximate continuum systems with discretised representations. Here we consider a specific discretisation of the continuum complex Hilbert space of quantum mechanics - a discretisation where squared amplitudes and complex phases are rational numbers. The fineness of this discretisation is determined by a finite (prime-number) parameter $p$. As $p \rightarrow \infty$, unlike standard discretised representations in computational physics, this model does not tend smoothly to the continuum limit. Instead, the state space of quantum mechanics is a singular limit of the discretised model at $p=\infty$. Using number theoretic properties of trigonometric functions, it is shown that for large enough values of $p$, discretised Hilbert space accurately describes ensemble representations of quantum systems within an inherently superdeterministic framework, one where the Statistical Independence assumption in Bell's theorem is formally violated. In this sense, the discretised model can explain the violation of Bell inequalities without appealing to nonlocality or indefinite reality. It is shown that this discretised framework is not fine tuned (and hence not conspiratorial) with respect to its natural state-space $p$-adic metric. As described by Michael Berry, old theories of physics are typically the singular limits of new theories as a parameter of the new theory is set equal to zero or infinity. Using this, we can answer the challenge posed by Scott Aaronson, critic of superderminism: to explain when a great theory in physics (here quantum mechanics) has ever been `grudgingly accommodated' rather than `gloriously explained' by its candidate successor theory (here a superdeterministic theory of quantum physics based on discretised Hilbert space). △ Less

Submitted 16 April, 2022; v1 submitted 7 April, 2022; originally announced April 2022.

A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecasts

Authors: Lucy Harris, Andrew T. T. McRae, Matthew Chantry, Peter D. Dueben, Tim N. Palmer

Abstract: Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation distribution and intensity occur below the resolved scale of global weather models. Generative adversarial networks (GANs) have been demonstrated by the computer vision c… ▽ More Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation distribution and intensity occur below the resolved scale of global weather models. Generative adversarial networks (GANs) have been demonstrated by the computer vision community to be successful at super-resolution problems, i.e., learning to add fine-scale structure to coarse images. Leinonen et al. (2020) previously applied a GAN to produce ensembles of reconstructed high-resolution atmospheric fields, given coarsened input data. In this paper, we demonstrate this approach can be extended to the more challenging problem of increasing the accuracy and resolution of comparatively low-resolution input from a weather forecasting model, using high-resolution radar measurements as a "ground truth". The neural network must learn to add resolution and structure whilst accounting for non-negligible forecast error. We show that GANs and VAE-GANs can match the statistical properties of state-of-the-art pointwise post-processing methods whilst creating high-resolution, spatially coherent precipitation maps. Our model compares favourably to the best existing downscaling methods in both pixel-wise and pooled CRPS scores, power spectrum information and rank histograms (used to assess calibration). We test our models and show that they perform in a range of scenarios, including heavy rainfall. △ Less

Submitted 28 July, 2022; v1 submitted 5 April, 2022; originally announced April 2022.

Comments: Revised version 28/7/22

Bell's Theorem, Non-Computability and Conformal Cyclic Cosmology: A Top-Down Approach to Quantum Gravity

Authors: T. N. Palmer

Abstract: This paper draws on a number of Roger Penrose's ideas - including the non-Hamiltonian phase-space flow of the Hawking Box, Conformal Cyclic Cosmology, non-computability and gravitationally induced quantum state reduction - in order to propose a radically unconventional approach to quantum gravity: Invariant Set Theory (IST). In IST, the fundamental laws of physics describe the geometry of the phas… ▽ More This paper draws on a number of Roger Penrose's ideas - including the non-Hamiltonian phase-space flow of the Hawking Box, Conformal Cyclic Cosmology, non-computability and gravitationally induced quantum state reduction - in order to propose a radically unconventional approach to quantum gravity: Invariant Set Theory (IST). In IST, the fundamental laws of physics describe the geometry of the phase portrait of the universe as a whole: "quantum" process are associated with fine-scale fractal geometry, "gravitational" process with larger-scale heterogeneous geometry. With this, it becomes possible to explain the experimental violation of Bell Inequalities without having to abandon key ingredients of general relativity: determinism and local causality. Ensembles in IST can be described by complex Hilbert states over a finite set $\mathbb C_p$ of complex numbers, where $p$ is a large finite integer. The quantum mechanics of finite-dimensional Hilbert spaces is emergent as a singular limit when $p \rightarrow \infty$. A small modification to the field equations of general relativity is proposed to make it consistent with IST. △ Less

Submitted 27 August, 2021; v1 submitted 24 August, 2021; originally announced August 2021.

Comments: To appear in Special Edition of AVS Quantum Science, celebrating Roger Penrose's 90th Birthday

Properties of Invariant Set Theory

Authors: J. R. Hance, S. Hossenfelder, T. N. Palmer

Abstract: In a recent paper (arXiv:2107.04761), Sen critiques a superdeterministic model of quantum physics, Invariant Set Theory, proposed by one of the authors. He concludes that superdeterminism is `unlikely to solve the puzzle posed by the Bell correlations'. He also claims that the model is neither local nor $ψ$-epistemic. We here detail multiple inaccuracies with Sen's arguments - notably that the hid… ▽ More In a recent paper (arXiv:2107.04761), Sen critiques a superdeterministic model of quantum physics, Invariant Set Theory, proposed by one of the authors. He concludes that superdeterminism is `unlikely to solve the puzzle posed by the Bell correlations'. He also claims that the model is neither local nor $ψ$-epistemic. We here detail multiple inaccuracies with Sen's arguments - notably that the hidden-variable model of quantum physics he uses to critique Invariant Set Theory bares no relation to Invariant Set Theory - and use this opportunity to lay out the properties of Invariant Set Theory as clearly as possible. △ Less

Submitted 8 March, 2022; v1 submitted 18 August, 2021; originally announced August 2021.

Comments: 6 pages, no figures. Substantial edits to address published version of Sen's paper

Supermeasured: Violating Bell-Statistical Independence without violating physical statistical independence

Authors: Jonte R. Hance, Sabine Hossenfelder, Tim N. Palmer

Abstract: Bell's theorem is often said to imply that quantum mechanics violates local causality, and that local causality cannot be restored with a hidden-variables theory. This however is only correct if the hidden-variables theory fulfils an assumption called Statistical Independence. Violations of Statistical Independence are commonly interpreted as correlations between the measurement settings and the h… ▽ More Bell's theorem is often said to imply that quantum mechanics violates local causality, and that local causality cannot be restored with a hidden-variables theory. This however is only correct if the hidden-variables theory fulfils an assumption called Statistical Independence. Violations of Statistical Independence are commonly interpreted as correlations between the measurement settings and the hidden variables (which determine the measurement outcomes). Such correlations have been discarded as ``fine-tuning'' or a ``conspiracy''. We here point out that the common interpretation is at best physically ambiguous and at worst incorrect. The problem with the common interpretation is that Statistical Independence might be violated because of a non-trivial measure in state space, a possibility we propose to call ``supermeasured''. We use Invariant Set Theory as an example of a supermeasured theory that violates the Statistical Independence assumption in Bell's theorem without requiring correlations between hidden variables and measurement settings (physical statistical independence). △ Less

Submitted 19 July, 2022; v1 submitted 16 August, 2021; originally announced August 2021.

Comments: 15 pages, 1 figure. Published in Foundations of Physics (matched published version)

Journal ref: Found Phys 52, 81 (2022)

Convection, Heat Generation and Particle Deposition in Direct Laser Writing of Metallic Microstructures

Authors: Thomas Palmer, Erik H. Waller, Heiko Andrä, Konrad Steiner, Georg von Freymann

Abstract: Three-dimensional metallic microstructures find applications as stents in medicine, as ultrabroadband antennas in communications, in micromechanical parts or as structures of more fundamental interest in photonics like metamaterials. Direct metal printing of such structures using three-dimensional laser lithography is a promising approach, which is not extensively applied yet, as fabrication speed… ▽ More Three-dimensional metallic microstructures find applications as stents in medicine, as ultrabroadband antennas in communications, in micromechanical parts or as structures of more fundamental interest in photonics like metamaterials. Direct metal printing of such structures using three-dimensional laser lithography is a promising approach, which is not extensively applied yet, as fabrication speed, surface quality, and stability of the resulting structures are limited so far. In order to identify the limiting factors, we investigate the influence of light-particle interactions and varying scan speed on heat generation and particle deposition in direct laser writing of silver. We introduce a theoretical model which captures diffusion of particles and heat as well as the fluid dynamics of the photo-resist. Chemical reactions are excluded from the model but particle production is calibrated using experimental data. We find that optical forces generally surmount those due to convection of the photo-resist. Simulations predict overheating of the photo-resist at laser powers similar to those found in experiments. The thermal sensitivity of the system is essentially determined by the largest particles present in the laser focus. Our results suggest that to improve particle deposition and to achieve higher writing speeds in metal direct laser writing, strong optical trap** of the emerging particles is desirable. Furthermore, precise control of the particle size reduces the risk of spontaneous overheating. △ Less

Submitted 27 May, 2021; v1 submitted 21 May, 2021; originally announced May 2021.

Comments: Corrected formatting of metadata

Climate Modelling in Low-Precision: Effects of both Deterministic & Stochastic Rounding

Authors: E. Adam Paxton, Matthew Chantry, Milan Klöwer, Leo Saffin, Tim Palmer

Abstract: Motivated by recent advances in operational weather forecasting, we study the efficacy of low-precision arithmetic for climate simulations. We develop a framework to measure rounding error in a climate model which provides a stress-test for a low-precision version of the model, and we apply our method to a variety of models including the Lorenz system; a shallow water approximation for flow over a… ▽ More Motivated by recent advances in operational weather forecasting, we study the efficacy of low-precision arithmetic for climate simulations. We develop a framework to measure rounding error in a climate model which provides a stress-test for a low-precision version of the model, and we apply our method to a variety of models including the Lorenz system; a shallow water approximation for flow over a ridge; and a coarse resolution global atmospheric model with simplified parameterisations (SPEEDY). Although double precision (52 significant bits) is standard across operational climate models, in our experiments we find that single precision (23 sbits) is more than enough and that as low as half precision (10 sbits) is often sufficient. For example, SPEEDY can be run with 12 sbits across the entire code with negligible rounding error and this can be lowered to 10 sbits if very minor errors are accepted, amounting to less than 0.1 mm/6hr for the average grid-point precipitation, for example. Our test is based on the Wasserstein metric and this provides stringent non-parametric bounds on rounding error accounting for annual means as well as extreme weather events. In addition, by testing models using both round-to-nearest (RN) and stochastic rounding (SR) we find that SR can mitigate rounding error across a range of applications. Thus our results also provide evidence that SR could be relevant to next-generation climate models. While many studies have shown that low-precision arithmetic can be suitable on short-term weather forecasting timescales, our results give the first evidence that a similar low precision level can be suitable for climate. △ Less

Submitted 30 April, 2021; originally announced April 2021.

Mixed-precision for Linear Solvers in Global Geophysical Flows

Authors: Jan Ackmann, Peter D. Düben, Tim N. Palmer, Piotr K. Smolarkiewicz

Abstract: Semi-implicit time-step** schemes for atmosphere and ocean models require elliptic solvers that work efficiently on modern supercomputers. This paper reports our study of the potential computational savings when using mixed precision arithmetic in the elliptic solvers. The essential components of a representative elliptic solver are run at precision levels as low as half (16 bits), and accompani… ▽ More Semi-implicit time-step** schemes for atmosphere and ocean models require elliptic solvers that work efficiently on modern supercomputers. This paper reports our study of the potential computational savings when using mixed precision arithmetic in the elliptic solvers. The essential components of a representative elliptic solver are run at precision levels as low as half (16 bits), and accompanied with a detailed evaluation of the impact of reduced precision on the solver convergence and the solution quality. A detailed inquiry into reduced precision requires a model configuration that is meaningful but cheaper to run and easier to evaluate than full atmosphere/ocean models. This study is therefore conducted in the context of a novel semi-implicit shallow-water model on the sphere, purposely designed to mimic numerical intricacies of modern all-scale weather and climate (W&C) models with the numerical stability independent on celerity of all wave motions. The governing algorithm of the shallow-water model is based on the non-oscillatory MPDATA methods for geophysical flows, whereas the resulting elliptic problem employs a strongly preconditioned non-symmetric Krylov-subspace solver GCR, proven in advanced atmospheric applications. The classical longitude/latitude grid is deliberately chosen to retain the stiffness of global W&C models posed in thin spherical shells as well as to better understand the performance of reduced-precision arithmetic in the vicinity of grid singularities. Precision reduction is done on a software level, using an emulator. The reduced-precision experiments are conducted for established dynamical-core test-cases, like the Rossby-Haurwitz wave number 4 and a zonal orographic flow. The study shows that selected key components of the elliptic solver, most prominently the preconditioning, can be performed at the level of half precision. △ Less

Submitted 30 March, 2021; originally announced March 2021.

Comments: 38 pages, 12 figures; to be submitted to the Journal of Computational Physics (JCP)

Experimental Tests of Invariant Set Theory

Authors: Jonte R. Hance, Tim N. Palmer, John Rarity

Abstract: We identify points of difference between Invariant Set Theory and standard quantum theory, and evaluate if these would lead to noticeable differences in predictions between the two theories. From this evaluation, we design a number of experiments, which, if undertaken, would allow us to investigate whether standard quantum theory or invariant set theory best describes reality. We identify points of difference between Invariant Set Theory and standard quantum theory, and evaluate if these would lead to noticeable differences in predictions between the two theories. From this evaluation, we design a number of experiments, which, if undertaken, would allow us to investigate whether standard quantum theory or invariant set theory best describes reality. △ Less

Submitted 15 February, 2021; originally announced February 2021.

Comments: 6 pages, 4 figures

Machine learning emulation of gravity wave drag in numerical weather forecasting

Authors: Matthew Chantry, Sam Hatfield, Peter Duben, Inna Polichtchouk, Tim Palmer

Abstract: We assess the value of machine learning as an accelerator for the parameterisation schemes of operational weather forecasting systems, specifically the parameterisation of non-orographic gravity wave drag. Emulators of this scheme can be trained to produce stable and accurate results up to seasonal forecasting timescales. Generally, more complex networks produce more accurate emulators. By trainin… ▽ More We assess the value of machine learning as an accelerator for the parameterisation schemes of operational weather forecasting systems, specifically the parameterisation of non-orographic gravity wave drag. Emulators of this scheme can be trained to produce stable and accurate results up to seasonal forecasting timescales. Generally, more complex networks produce more accurate emulators. By training on an increased complexity version of the existing parameterisation scheme we build emulators that produce more accurate forecasts. {For medium range forecasting we find evidence our emulators are more accurate} than the version of the parametrisation scheme that is used for operational predictions. Using the current operational CPU hardware our emulators have a similar computational cost to the existing scheme, but are heavily limited by data movement. On GPU hardware our emulators perform ten times faster than the existing scheme on a CPU. △ Less

Submitted 7 May, 2021; v1 submitted 20 January, 2021; originally announced January 2021.

Network experimentation at scale

Authors: Brian Karrer, Liang Shi, Monica Bhole, Matt Goldman, Tyrone Palmer, Charlie Gelman, Mikael Konutgan, Feng Sun

Abstract: We describe our framework, deployed at Facebook, that accounts for interference between experimental units through cluster-randomized experiments. We document this system, including the design and estimation procedures, and detail insights we have gained from the many experiments that have used this system at scale. We introduce a cluster-based regression adjustment that substantially improves pre… ▽ More We describe our framework, deployed at Facebook, that accounts for interference between experimental units through cluster-randomized experiments. We document this system, including the design and estimation procedures, and detail insights we have gained from the many experiments that have used this system at scale. We introduce a cluster-based regression adjustment that substantially improves precision for estimating global treatment effects as well as testing for interference as part of our estimation procedure. With this regression adjustment, we find that imbalanced clusters can better account for interference than balanced clusters without sacrificing accuracy. In addition, we show how logging exposure to a treatment can be used for additional variance reduction. Interference is a widely acknowledged issue with online field experiments, yet there is less evidence from real-world experiments demonstrating interference in online settings. We fill this gap by describing two case studies that capture significant network effects and highlight the value of this experimentation framework. △ Less

Submitted 15 December, 2020; originally announced December 2020.

Comments: 12 pages, 8 figures

Quantum algorithm for nonlinear differential equations

Authors: Seth Lloyd, Giacomo De Palma, Can Gokler, Bobak Kiani, Zi-Wen Liu, Milad Marvian, Felix Tennie, Tim Palmer

Abstract: Quantum computers are known to provide an exponential advantage over classical computers for the solution of linear differential equations in high-dimensional spaces. Here, we present a quantum algorithm for the solution of nonlinear differential equations. The quantum algorithm provides an exponential advantage over classical algorithms for solving nonlinear differential equations. Potential appl… ▽ More Quantum computers are known to provide an exponential advantage over classical computers for the solution of linear differential equations in high-dimensional spaces. Here, we present a quantum algorithm for the solution of nonlinear differential equations. The quantum algorithm provides an exponential advantage over classical algorithms for solving nonlinear differential equations. Potential applications include the Navier-Stokes equation, plasma hydrodynamics, epidemiology, and more. △ Less

Submitted 21 December, 2020; v1 submitted 12 November, 2020; originally announced November 2020.

Comments: 13 pages, plain TeX, replaced to correct an error in equation 10 and to add a section on normalization to the supplementary material

Machine-Learned Preconditioners for Linear Solvers in Geophysical Fluid Flows

Authors: Jan Ackmann, Peter D. Düben, Tim N. Palmer, Piotr K. Smolarkiewicz

Abstract: It is tested whether machine learning methods can be used for preconditioning to increase the performance of the linear solver -- the backbone of the semi-implicit, grid-point model approach for weather and climate models. Embedding the machine-learning method within the framework of a linear solver circumvents potential robustness issues that machine learning approaches are often criticized for,… ▽ More It is tested whether machine learning methods can be used for preconditioning to increase the performance of the linear solver -- the backbone of the semi-implicit, grid-point model approach for weather and climate models. Embedding the machine-learning method within the framework of a linear solver circumvents potential robustness issues that machine learning approaches are often criticized for, as the linear solver ensures that a sufficient, pre-set level of accuracy is reached. The approach does not require prior availability of a conventional preconditioner and is highly flexible regarding complexity and machine learning design choices. Several machine learning methods are used to learn the optimal preconditioner for a shallow-water model with semi-implicit timestep** that is conceptually similar to more complex atmosphere models. The machine-learning preconditioner is competitive with a conventional preconditioner and provides good results even if it is used outside of the dynamical range of the training dataset. △ Less

Submitted 6 October, 2020; originally announced October 2020.

Comments: To be submitted to GRL, 15 pages, 3 figures

A Vision for Numerical Weather Prediction in 2030

Authors: Tim Palmer

Abstract: In this essay, I outline a personal vision of how I think Numerical Weather Prediction (NWP) should evolve in the years leading up to 2030 and hence what it should look like in 2030. By NWP I mean initial-value predictions from timescales of hours to seasons ahead. Here I want to focus on how NWP can better help save lives from increasingly extreme weather in those parts of the world where society… ▽ More In this essay, I outline a personal vision of how I think Numerical Weather Prediction (NWP) should evolve in the years leading up to 2030 and hence what it should look like in 2030. By NWP I mean initial-value predictions from timescales of hours to seasons ahead. Here I want to focus on how NWP can better help save lives from increasingly extreme weather in those parts of the world where society is most vulnerable. Whilst we can rightly be proud of many parts of our NWP heritage, its evolution has been influenced by national or institutional politics as well as by underpinning scientific principles. Sometimes these conflict with each other. It is important to be able to separate these issues when discussing how best meteorological science can serve society in 2030; otherwise any disruptive change - no matter how compelling the scientific case for it - becomes impossibly difficult. △ Less

Submitted 19 April, 2022; v1 submitted 3 July, 2020; originally announced July 2020.

Comments: For World Meteorological Organisation White Paper on Future of NWP

Using reduced-precision arithmetic in the adjoint model of MITgcm

Authors: Andrew T. T. McRae, Tim N. Palmer

Abstract: In recent years, it has been convincingly shown that weather forecasting models can be run in single-precision arithmetic. Several models or components thereof have been tested with even lower precision than this. This previous work has largely focused on the main nonlinear `forward' model. A nonlinear model (in weather forecasting or otherwise) can have corresponding tangent linear and adjoint mo… ▽ More In recent years, it has been convincingly shown that weather forecasting models can be run in single-precision arithmetic. Several models or components thereof have been tested with even lower precision than this. This previous work has largely focused on the main nonlinear `forward' model. A nonlinear model (in weather forecasting or otherwise) can have corresponding tangent linear and adjoint models, which are used in 4D variational data assimilation. The linearised models are plausibly far more sensitive to reductions in numerical precision since unbounded error growth can occur with no possibility of nonlinear saturation. In this paper, we present a geophysical experiment that makes use of an adjoint model to calculate sensitivities and perform optimisation. Using software emulation, we investigate the effect of degrading the numerical precision of the adjoint model. We find that reasonable results are obtained with as few as 10 significand bits, equal to the significand precision in the IEEE half-precision standard. △ Less

Submitted 19 March, 2020; originally announced March 2020.

Comments: Submitted to AGU JAMES

Human Creativity and Consciousness: Unintended Consequences of the Brain's Extraordinary Energy Efficiency?

Authors: T. N. Palmer

Abstract: It is proposed that both human creativity and human consciousness are (unintended) consequences of the human brain's extraordinary energy efficiency. The topics of creativity and consciousness are treated separately, though have a common sub-structure. It is argued that creativity arises from a synergy between two cognitive modes of the human brain (which broadly coincide with Kahneman's Systems 1… ▽ More It is proposed that both human creativity and human consciousness are (unintended) consequences of the human brain's extraordinary energy efficiency. The topics of creativity and consciousness are treated separately, though have a common sub-structure. It is argued that creativity arises from a synergy between two cognitive modes of the human brain (which broadly coincide with Kahneman's Systems 1 and 2). In the first, available energy is spread across a relatively large network of neurons. As such, the amount of energy per active neuron is so small that the operation of such neurons is susceptible to thermal (ultimately quantum decoherent) noise. In the second, available energy is focussed on a small enough subset of neurons to guarantee a deterministic operation. An illustration of how this synergy can lead to creativity with implications for computing in silicon are discussed. Starting with a discussion of the concept of free will, the notion of consciousness is defined in terms of an awareness of what are perceived to be nearby counterfactual worlds in state space. It is argued that such awareness arises from an interplay between our memories on the one hand, and quantum physical mechanisms (where, unlike in classical physics, nearby counterfactual worlds play an indispensable dynamical role) in the ion channels of neural networks. As with the brain's susceptibility to noise, it is argued that in situations where quantum physics plays a role in the brain, it does so for reasons of energy efficiency. As an illustration of this definition of consciousness, a novel proposal is outlined as to why quantum entanglement appears so counter-intuitive. △ Less

Submitted 31 January, 2020; originally announced February 2020.

Comments: Based on invited talk at Models of Consciousness Conference, Mathematical Institute, University of Oxford, September 2019

Beyond skill scores: exploring sub-seasonal forecast value through a case study of French month-ahead energy prediction

Authors: Joshua Dorrington, Isla Finney, Tim Palmer, Antje Weisheimer

Abstract: We quantify the value of sub-seasonal forecasts for a real-world prediction problem: the forecasting of French month-ahead energy demand. Using surface temperature as a predictor, we construct a trading strategy and assess the financial value of using meteorological forecasts, based on actual energy demand and price data. We show that forecasts with lead times greater than 2 weeks can have value f… ▽ More We quantify the value of sub-seasonal forecasts for a real-world prediction problem: the forecasting of French month-ahead energy demand. Using surface temperature as a predictor, we construct a trading strategy and assess the financial value of using meteorological forecasts, based on actual energy demand and price data. We show that forecasts with lead times greater than 2 weeks can have value for this application, both on their own and in conjunction with shorter range forecasts, especially during boreal winter. We consider a cost/loss framework based on this example, and show that while it captures the performance of the short range forecasts well, it misses the marginal value present in the longer range forecasts. We also contrast our assessment of forecast value to that given by traditional skill scores, which we show could be misleading if used in isolation. We emphasise the importance of basing assessment of forecast skill on variables actually used by end-users. △ Less

Submitted 22 April, 2020; v1 submitted 5 February, 2020; originally announced February 2020.

Comments: 22 pages, 8 figures, revised submission to QJRMS

Rethinking Superdeterminism

Authors: S. Hossenfelder, T. N. Palmer

Abstract: Quantum mechanics has irked physicists ever since its conception more than 100 years ago. While some of the misgivings, such as it being unintuitive, are merely aesthetic, quantum mechanics has one serious shortcoming: it lacks a physical description of the measurement process. This "measurement problem" indicates that quantum mechanics is at least an incomplete theory -- good as far as it goes, b… ▽ More Quantum mechanics has irked physicists ever since its conception more than 100 years ago. While some of the misgivings, such as it being unintuitive, are merely aesthetic, quantum mechanics has one serious shortcoming: it lacks a physical description of the measurement process. This "measurement problem" indicates that quantum mechanics is at least an incomplete theory -- good as far as it goes, but missing a piece -- or, more radically, is in need of complete overhaul. Here we describe an approach which may provide this sought-for completion or replacement: Superdeterminism. A superdeterministic theory is one which violates the assumption of Statistical Independence (that distributions of hidden variables are independent of measurement settings). Intuition suggests that Statistical Independence is an essential ingredient of any theory of science (never mind physics), and for this reason Superdeterminism is typically discarded swiftly in any discussion of quantum foundations. The purpose of this paper is to explain why the existing objections to Superdeterminism are based on experience with classical physics and linear systems, but that this experience misleads us. Superdeterminism is a promising approach not only to solve the measurement problem, but also to understand the apparent nonlocality of quantum physics. Most importantly, we will discuss how it may be possible to test this hypothesis in an (almost) model independent way. △ Less

Submitted 20 December, 2019; v1 submitted 13 December, 2019; originally announced December 2019.

Comments: 23 pages, 2 figures, typos fixed, references added

Journal ref: Front. Phys. 8:139 (2020)

A review of problem- and team-based methods for teaching statistics in Higher Education

Authors: Elinor Jones, Tom Palmer

Abstract: The teaching of statistics in higher education in the UK is still largely lecture-based. This is despite recommendations such as those given by the American Statistical Association's GAISE report that more emphasis should be placed on active learning strategies where students take more responsibility for their own learning. One possible model is that of collaborative learning, where students learn… ▽ More The teaching of statistics in higher education in the UK is still largely lecture-based. This is despite recommendations such as those given by the American Statistical Association's GAISE report that more emphasis should be placed on active learning strategies where students take more responsibility for their own learning. One possible model is that of collaborative learning, where students learn in groups through carefully crafted `problems', which has long been suggested as a strategy for teaching statistics. In this article, we review two specific approaches that fall under the collaborative learning model: problem- and team-based learning. We consider the evidence for changing to this model of teaching in statistics, as well as give practical suggestions on how this could be implemented in typical statistics classes in Higher Education. △ Less

Submitted 10 March, 2021; v1 submitted 1 October, 2019; originally announced October 2019.

Comments: Jones E and Palmer T. A review of problem- and team-based methods for teaching statistics in Higher Education. Teaching Mathematics and its Applications: An International Journal of the IMA. Published online 09-03-2021

The impact of stochastic physics on climate sensitivity in EC-Earth

Authors: K. Strommen, P. A. G. Watson, T. N. Palmer

Abstract: Stochastic schemes, designed to represent unresolved sub-grid scale variability, are frequently used in short and medium-range weather forecasts, where they are found to improve several aspects of the model. In recent years, the impact of stochastic physics has also been found to be beneficial for the model's long term climate. In this paper, we demonstrate for the first time that the inclusion of… ▽ More Stochastic schemes, designed to represent unresolved sub-grid scale variability, are frequently used in short and medium-range weather forecasts, where they are found to improve several aspects of the model. In recent years, the impact of stochastic physics has also been found to be beneficial for the model's long term climate. In this paper, we demonstrate for the first time that the inclusion of a stochastic physics scheme can notably affect a model's projection of global warming, as well as its historical climatological global temperature. Specifically, we find that when including the 'stochastically perturbed parametrisation tendencies' scheme (SPPT) in the fully coupled climate model EC-Earth v3.1, the predicted level of global warming between 1850 and 2100 is reduced by 10% under an RCP8.5 forcing scenario. We link this reduction in climate sensitivity to a change in the cloud feedbacks with SPPT. In particular, the scheme appears to reduce the positive low cloud cover feedback, and increase the negative cloud optical feedback. A key role is played by a robust, rapid increase in cloud liquid water with SPPT, which we speculate is due to the scheme's non-linear interaction with condensation. △ Less

Submitted 16 May, 2019; originally announced May 2019.

Comments: Under review in Journal of Geophysical Research: Atmospheres

Prediction of thermal conductivity in dielectrics using fast, spectrally-resolved phonon transport simulations

Authors: Jackson R. Harter, Aria Hosseini, Todd. S. Palmer, P. Alex Greaney

Abstract: We present a new method for predicting effective thermal conductivity ($κ_{\textrm{eff}}$) in materials, informed by ${ab\,initio}$ material property simulations. Using the Boltzmann transport equation in a Self-Adjoint Angular Flux formulation, we performed simulations in silicon at room temperatures over length scales varying from 10 nm to 10 $μ$m and report temperature distributions, spectral h… ▽ More We present a new method for predicting effective thermal conductivity ($κ_{\textrm{eff}}$) in materials, informed by ${ab\,initio}$ material property simulations. Using the Boltzmann transport equation in a Self-Adjoint Angular Flux formulation, we performed simulations in silicon at room temperatures over length scales varying from 10 nm to 10 $μ$m and report temperature distributions, spectral heat flux and thermal conductivity. Our implementation utilizes a Richardson iteration on a modified version of the phonon scattering source. In this method, a closure term is introduced to the transport equation which acts as a redistribution kernel for the total energy bath of the system. This term is an effective indicator of the degree of disorder between the spectral phonon radiance and the angular phonon intensity of the transport system. We employ polarization, density of states and full dispersion spectra to resolve thermal conductivity with numerous angular and spatial discretizations. △ Less

Submitted 20 August, 2019; v1 submitted 9 May, 2019; originally announced May 2019.

Comments: 36 pages, 13 figures

Signal and noise in regime systems: a hypothesis on the predictability of the North Atlantic Oscillation

Authors: Kristian Strommen, Tim N. Palmer

Abstract: Studies conducted by the UK Met Office reported significant skill at predicting the winter NAO index with their seasonal prediction system. At the same time, a very low signal-to-noise ratio was observed, as measured using the `ratio of predictable components' (RPC) metric. We analyse both the skill and signal-to-noise ratio using a new statistical toy-model which assumes NAO predictability is dri… ▽ More Studies conducted by the UK Met Office reported significant skill at predicting the winter NAO index with their seasonal prediction system. At the same time, a very low signal-to-noise ratio was observed, as measured using the `ratio of predictable components' (RPC) metric. We analyse both the skill and signal-to-noise ratio using a new statistical toy-model which assumes NAO predictability is driven by regime dynamics. It is shown that if the system is approximately bimodal in nature, with the model consistently underestimating the level of regime persistence each season, then both the high skill and high RPC value of the Met Office hindcasts can easily be reproduced. Underestimation of regime persistence could be attributable to any number of sources of model error, including imperfect regime structure or errors in the propagation of teleconnections. In particular, a high RPC value for a seasonal mean prediction may be expected even if the models internal level of noise is realistic. △ Less

Submitted 30 April, 2019; originally announced April 2019.

Comments: Published in the Quarterly Journal of the Royal Meteorological Society (2019)

Bell Inequality Violation with Free Choice and Local Causality on the Invariant Set

Authors: T. N. Palmer

Abstract: Bell's Theorem requires any theory which obeys the technical definitions of Free Choice and Local Causality to satisfy the Bell inequality. Invariant set theory is a finite theory of quantum physics which violates the Bell inequality exactly as does quantum theory: in it neither Free Choice nor Local Causality hold, consistent with Bell's Theorem. However, within the proposed theory, the mathemati… ▽ More Bell's Theorem requires any theory which obeys the technical definitions of Free Choice and Local Causality to satisfy the Bell inequality. Invariant set theory is a finite theory of quantum physics which violates the Bell inequality exactly as does quantum theory: in it neither Free Choice nor Local Causality hold, consistent with Bell's Theorem. However, within the proposed theory, the mathematical expressions of both Free Choice and Local Causality involve states which, for number-theoretic reasons, cannot be ontic (cannot lie on the theory's fractal-like invariant set $I_U$ in state space). Weaker versions of Free Choice and Local Causality are proposed involving only the theory's ontic states. Conventional hidden-variable theories satisfying only these weaker definitions still obey the Bell inequality. However, invariant set theory, which violates the Bell inequality, satisfies these weaker definitions. It is argued that the weaker definitions are consistent with the physical meaning behind free choice and local causality as defined in space-time, and hence that Free Choice and Local Causality are physically too strong. It is concluded that the experimental violation of the Bell inequality may have less to do with free choice or local causality \emph{per se}, and more to do with the presence of a holistic but causal state-space geometry onto which quantum ontic states are constrained. △ Less

Submitted 25 March, 2019; originally announced March 2019.

Discretisation of the Bloch Sphere, Fractal Invariant Sets and Bell's Theorem

Authors: T. N. Palmer

Abstract: An arbitrarily dense discretisation of the Bloch sphere of complex Hilbert states is constructed, where points correspond to bit strings of fixed finite length. Number-theoretic properties of trigonometric functions (not part of the quantum-theoretic canon) are used to show that this constructive discretised representation incorporates many of the defining characteristics of quantum systems: compl… ▽ More An arbitrarily dense discretisation of the Bloch sphere of complex Hilbert states is constructed, where points correspond to bit strings of fixed finite length. Number-theoretic properties of trigonometric functions (not part of the quantum-theoretic canon) are used to show that this constructive discretised representation incorporates many of the defining characteristics of quantum systems: completementarity, uncertainty relationships and (with a simple Cartesian product of discretised spheres) entanglement. Unlike Meyer's earlier discretisation of the Bloch Sphere, there are no orthonormal triples, hence the Kocken-Specker theorem is not nullified. A physical interpretation of points on the discretised Bloch sphere is given in terms of ensembles of trajectories on a dynamically invariant fractal set in state space, where states of physical reality correspond to points on the invariant set. This deterministic construction provides a new way to understand the violation of the Bell inequality without violating statistical independence or factorisation, where these conditions are defined solely from states on the invariant set. In this finite representation there is an upper limit to the number of qubits that can be entangled, a property with potential experimental consequences. △ Less

Submitted 5 March, 2020; v1 submitted 5 April, 2018; originally announced April 2018.

Comments: Proceedings of the Royal Society A. To appear

The ECMWF Ensemble Prediction System: Looking Back (more than) 25 Years and Projecting Forward 25 Years

Authors: Tim Palmer

Abstract: This paper has been written to mark 25 years of operational medium-range ensemble forecasting. The origins of the ECMWF Ensemble Prediction System are outlined, including the development of the precursor real-time Met Office monthly ensemble forecast system. In particular, the reasons for the development of singular vectors and stochastic physics - particular features of the ECMWF Ensemble Predict… ▽ More This paper has been written to mark 25 years of operational medium-range ensemble forecasting. The origins of the ECMWF Ensemble Prediction System are outlined, including the development of the precursor real-time Met Office monthly ensemble forecast system. In particular, the reasons for the development of singular vectors and stochastic physics - particular features of the ECMWF Ensemble Prediction System - are discussed. The author speculates about the development and use of ensemble prediction in the next 25 years. △ Less

Submitted 16 March, 2018; originally announced March 2018.

Comments: Submitted to Special Issue of the Quarterly Journal of the Royal Meteorological Society: 25 years of ensemble prediction

A Workload Analysis of NSF's Innovative HPC Resources Using XDMoD

Authors: Nikolay A. Simakov, Joseph P. White, Robert L. DeLeon, Steven M. Gallo, Matthew D. Jones, Jeffrey T. Palmer, Benjamin Plessinger, Thomas R. Furlani

Abstract: Workload characterization is an integral part of performance analysis of high performance computing (HPC) systems. An understanding of workload properties sheds light on resource utilization and can be used to inform performance optimization both at the software and system configuration levels. It can provide information on how computational science usage modalities are changing that could potenti… ▽ More Workload characterization is an integral part of performance analysis of high performance computing (HPC) systems. An understanding of workload properties sheds light on resource utilization and can be used to inform performance optimization both at the software and system configuration levels. It can provide information on how computational science usage modalities are changing that could potentially aid holistic capacity planning for the wider HPC ecosystem. Here, we report on the results of a detailed workload analysis of the portfolio of supercomputers comprising the NSF Innovative HPC program in order to characterize its past and current workload and look for trends to understand the nature of how the broad portfolio of computational science research is being supported and how it is changing over time. The workload analysis also sought to illustrate a wide variety of usage patterns and performance requirements for jobs running on these systems. File system performance, memory utilization and the types of parallelism employed by users (MPI, threads, etc) were also studied for all systems for which job level performance data was available. △ Less

Submitted 12 January, 2018; originally announced January 2018.

Comments: 93 pages, 82 figures, 19 tables

MSC Class: 68M14; 68M20; 68U20 ACM Class: I.6.3; J.2; J.3; J.4; J.5; K.6.4

Experimental Non-Violation of the Bell Inequality

Authors: T. N. Palmer

Abstract: A finite non-classical framework for physical theory is described which challenges the conclusion that the Bell Inequality has been shown to have been violated experimentally, even approximately. This framework postulates the universe as a deterministic locally causal system evolving on a measure-zero fractal-like geometry $I_U$ in cosmological state space. Consistent with the assumed primacy of… ▽ More A finite non-classical framework for physical theory is described which challenges the conclusion that the Bell Inequality has been shown to have been violated experimentally, even approximately. This framework postulates the universe as a deterministic locally causal system evolving on a measure-zero fractal-like geometry $I_U$ in cosmological state space. Consistent with the assumed primacy of $I_U$, and $p$-adic number theory, a non-Euclidean (and hence non-classical) metric $g_p$ is defined on cosmological state space, where $p$ is a large but finite Pythagorean prime. Using number-theoretic properties of spherical triangles, the inequalities violated experimentally are shown to be $g_p$-distant from the CHSH inequality, whose violation would rule out local realism. This result fails in the singular limit $p=\infty$, at which $g_p$ is Euclidean. Broader implications are discussed. △ Less

Submitted 4 September, 2017; originally announced September 2017.

Comments: arXiv admin note: text overlap with arXiv:1709.00329

A Gravitational Theory of the Quantum

Authors: T. N. Palmer

Abstract: The synthesis of quantum and gravitational physics is sought through a finite, realistic, locally causal theory where gravity plays a vital role not only during decoherent measurement but also during non-decoherent unitary evolution. Invariant set theory is built on geometric properties of a compact fractal-like subset $I_U$ of cosmological state space on which the universe is assumed to evolve an… ▽ More The synthesis of quantum and gravitational physics is sought through a finite, realistic, locally causal theory where gravity plays a vital role not only during decoherent measurement but also during non-decoherent unitary evolution. Invariant set theory is built on geometric properties of a compact fractal-like subset $I_U$ of cosmological state space on which the universe is assumed to evolve and from which the laws of physics are assumed to derive. Consistent with the primacy of $I_U$, a non-Euclidean (and hence non-classical) state-space metric $g_p$ is defined, related to the $p$-adic metric of number theory where $p$ is a large but finite Pythagorean prime. Uncertain states on $I_U$ are described using complex Hilbert states, but only if their squared amplitudes are rational and corresponding complex phase angles are rational multiples of $2 π$. Such Hilbert states are necessarily $g_p$-distant from states with either irrational squared amplitudes or irrational phase angles. The gappy fractal nature of $I_U$ accounts for quantum complementarity and is characterised numerically by a generic number-theoretic incommensurateness between rational angles and rational cosines of angles. The Bell inequality, whose violation would be inconsistent with local realism, is shown to be $g_p$-distant from all forms of the inequality that are violated in any finite-precision experiment. The delayed-choice paradox is resolved through the computational irreducibility of $I_U$. The Schrödinger and Dirac equations describe evolution on $I_U$ in the singular limit at $p=\infty$. By contrast, an extension of the Einstein field equations on $I_U$ is proposed which reduces smoothly to general relativity as $p \rightarrow \infty$. Novel proposals for the dark universe and the elimination of classical space-time singularities are given and experimental implications outlined. △ Less

Submitted 30 August, 2017; originally announced September 2017.

Monte Carlo Chord Length Sampling for $d$-dimensional Markov binary mixtures

Authors: Colline Larmier, Adam Lam, Patrick Brantley, Fausto Malvagi, Todd Palmer, Andrea Zoia

Abstract: The Chord Length Sampling (CLS) algorithm is a powerful Monte Carlo method that models the effects of stochastic media on particle transport by generating on-the-fly the material interfaces seen by the random walkers during their trajectories. This annealed disorder approach, which formally consists of solving the approximate Levermore-Pomraning equations for linear particle transport, enables a c… ▽ More The Chord Length Sampling (CLS) algorithm is a powerful Monte Carlo method that models the effects of stochastic media on particle transport by generating on-the-fly the material interfaces seen by the random walkers during their trajectories. This annealed disorder approach, which formally consists of solving the approximate Levermore-Pomraning equations for linear particle transport, enables a considerable speed-up with respect to transport in quenched disorder, where ensemble-averaging of the Boltzmann equation with respect to all possible realizations is needed. However, CLS intrinsically neglects the correlations induced by the spatial disorder, so that the accuracy of the solutions obtained by using this algorithm must be carefully verified with respect to reference solutions based on quenched disorder realizations. When the disorder is described by Markov mixing statistics, such comparisons have been attempted so far only for one-dimensional geometries, of the rod or slab type. In this work we extend these results to Markov media in two-dimensional (extruded) and three-dimensional geometries, by revisiting the classical set of benchmark configurations originally proposed by Adams, Larsen and Pomraning, and extended by Brantley. In particular, we examine the discrepancies between CLS and reference solutions for scalar particle flux and transmission/reflection coefficients as a function of the material properties of the benchmark specifications and of the system dimensionality. △ Less

Submitted 11 September, 2017; v1 submitted 31 July, 2017; originally announced August 2017.

Comments: 20 pages, 6 figures. arXiv admin note: substantial text overlap with arXiv:1708.04260; text overlap with arXiv:1609.07948

Workload Analysis of Blue Waters

Authors: Matthew D. Jones, Joseph P. White, Martins Innus, Robert L. DeLeon, Nikolay Simakov, Jeffrey T. Palmer, Steven M. Gallo, Thomas R. Furlani, Michael Showerman, Robert Brunner, Andry Kot, Gregory Bauer, Brett Bode, Jeremy Enos, William Kramer

Abstract: Blue Waters is a Petascale-level supercomputer whose mission is to enable the national scientific and research community to solve "grand challenge" problems that are orders of magnitude more complex than can be carried out on other high performance computing systems. Given the important and unique role that Blue Waters plays in the U.S. research portfolio, it is important to have a detailed unders… ▽ More Blue Waters is a Petascale-level supercomputer whose mission is to enable the national scientific and research community to solve "grand challenge" problems that are orders of magnitude more complex than can be carried out on other high performance computing systems. Given the important and unique role that Blue Waters plays in the U.S. research portfolio, it is important to have a detailed understanding of its workload in order to guide performance optimization both at the software and system configuration level as well as inform architectural balance tradeoffs. Furthermore, understanding the computing requirements of the Blue Water's workload (memory access, IO, communication, etc.), which is comprised of some of the most computationally demanding scientific problems, will help drive changes in future computing architectures, especially at the leading edge. With this objective in mind, the project team carried out a detailed workload analysis of Blue Waters. △ Less

Submitted 2 March, 2017; originally announced March 2017.

Comments: 107 pages, >100 figures (figure sizes reduced to save space, contact authors for version with full resolution)

MSC Class: 68M14; 68M20; 68U20 ACM Class: I.6.3; J.2; J.3; J.4; J.5; K.6.4

Thermodynamic formalism for transport coefficients with an application to the shear modulus and shear viscosity

Authors: Thomas Palmer, Thomas Speck

Abstract: We discuss Onsager's thermodynamic formalism for transport coefficients and apply it to the calculation of the shear modulus and shear viscosity of a monodisperse system of repulsive particles. We focus on the concept of extensive "distance" and intensive "field" conjugated via a Fenchel-Legendre transform involving a thermodynamic(-like) potential, which allows to switch ensembles. Employing Brow… ▽ More We discuss Onsager's thermodynamic formalism for transport coefficients and apply it to the calculation of the shear modulus and shear viscosity of a monodisperse system of repulsive particles. We focus on the concept of extensive "distance" and intensive "field" conjugated via a Fenchel-Legendre transform involving a thermodynamic(-like) potential, which allows to switch ensembles. Employing Brownian dynamics, we calculate both the shear modulus and the shear viscosity from strain fluctuations and show that they agree with direct calculations from strained and non-equilibrium simulations, respectively. We find a dependence of the fluctuations on the coupling strength to the strain reservoir, which can be traced back to the discrete-time integration. These results demonstrate the viability of exploiting fluctuations of extensive quantities for the numerical calculation of transport coefficients. △ Less

Submitted 7 December, 2016; originally announced December 2016.

Journal ref: J. Chem. Phys. 146, 124130 (2017)

$p$-adic Distance, Finite Precision and Emergent Superdeterminism: A Number-Theoretic Consistent-Histories Approach to Local Quantum Realism

Authors: T. N. Palmer

Abstract: Although the notion of superdeterminism can, in principle, account for the violation of the Bell inequalities, this potential explanation has been roundly rejected by the quantum foundations community. The arguments for rejection, one of the most substantive coming from Bell himself, are critically reviewed. In particular, analysis of Bell's argument reveals an implicit unwarranted assumption: tha… ▽ More Although the notion of superdeterminism can, in principle, account for the violation of the Bell inequalities, this potential explanation has been roundly rejected by the quantum foundations community. The arguments for rejection, one of the most substantive coming from Bell himself, are critically reviewed. In particular, analysis of Bell's argument reveals an implicit unwarranted assumption: that the Euclidean metric is the appropriate yardstick for measuring distances in state space. Bell's argument is largely negated if this yardstick is instead based on the alternative $p$-adic metric. Such a metric, common in number theory, arises naturally when describing chaotic systems which evolve precisely on self-similar invariant sets in their state space. A locally-causal realistic model of quantum entanglement is developed, based on the premise that the laws of physics ultimately derive from an invariant-set geometry in the state space of a deterministic quasi-cyclic mono-universe. Based on this, the notion of a complex Hilbert vector is reinterpreted in terms of an uncertain selection from a finite sample space of states, leading to a novel form of `consistent histories' based on number-theoretic properties of the transcendental cosine function. This leads to novel realistic interpretations of position/momentum non-commutativity, EPR, the Bell Theorem and the Tsirelson bound. In this inherently holistic theory - neither conspiratorial, retrocausal, fine tuned nor nonlocal - superdeterminism is not invoked by fiat but is emergent from these `consistent histories' number-theoretic constraints. Invariant set theory provides new perspectives on many of the contemporary problems at the interface of quantum and gravitational physics, and, if correct, may signal the end of particle physics beyond the Standard Model. △ Less

Submitted 24 September, 2016; originally announced September 2016.

Comments: 40 pages, 6 Figures

Invariant Set Theory

Authors: T. N. Palmer

Abstract: Invariant Set Theory (IST) is a realistic, locally causal theory of fundamental physics which assumes a much stronger synergy between cosmology and quantum physics than exists in contemporary theory. In IST the (quasi-cyclic) universe $U$ is treated as a deterministic dynamical system evolving precisely on a measure-zero fractal invariant subset $I_U$ of its state space. In this approach, the geom… ▽ More Invariant Set Theory (IST) is a realistic, locally causal theory of fundamental physics which assumes a much stronger synergy between cosmology and quantum physics than exists in contemporary theory. In IST the (quasi-cyclic) universe $U$ is treated as a deterministic dynamical system evolving precisely on a measure-zero fractal invariant subset $I_U$ of its state space. In this approach, the geometry of $I_U$, and not a set of differential evolution equations in space-time $\mathcal M_U$, provides the most primitive description of the laws of physics. As such, IST is non-classical. The geometry of $I_U$ is based on Cantor sets of space-time trajectories in state space, homeomorphic to the algebraic set of $p$-adic integers, for large but finite $p$. In IST, the non-commutativity of position and momentum observables arises from number theory - in particular the non-commensurateness of $φ$ and $\cos φ$. The complex Hilbert Space and the relativistic Dirac Equation respectively are shown to describe $I_U$, and evolution on $I_U$, in the singular limit of IST at $p=\infty$; particle properties such as de Broglie relationships arise from the helical geometry of trajectories on $I_U$ in the neighbourhood of $\mathcal M_U$. With the p-adic metric as a fundamental measure of distance on $I_U$, certain key perturbations which seem conspiratorially small relative to the more traditional Euclidean metric, take points away from $I_U$ and are therefore unphysically large. This allows (the $ψ$-epistemic) IST to evade the Bell and Pusey et al theorems without fine tuning or other objections. In IST, the problem of quantum gravity becomes one of combining the pseudo-Riemannian metric of $\mathcal M_U$ with the p-adic metric of $I_U$. A generalisation of the field equations of general relativity which can achieve this is proposed. △ Less

Submitted 30 April, 2016; originally announced May 2016.

Comments: Phys Rev D In Review. supercedes arXiv:1502.06968

Stochastic Parameterization: Towards a new view of Weather and Climate Models

Authors: Judith Berner, Ulrich Achatz, Lauriane Batte, Lisa Bengtsson, Alvaro De La Camara, Daan Crommelin, Hannah Christensen, Matteo Colangeli, Stamen Dolaptchiev, Christian L. E. Franzke, Petra Friederichs, Peter Imkeller, Heikki Jarvinen, Stephan Juricke, Vassili Kitsios, Franois Lott, Valerio Lucarini, Salil Mahajan, Timothy N. Palmer, Cecile Penland, **-Song Von Storch, Mirjana Sakradzija, Michael Weniger, Antje Weisheimer, Paul D. Williams , et al. (1 additional authors not shown)

Abstract: The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not… ▽ More The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not only provides better estimates of uncertainty, but it is also extremely promising for reducing longstanding climate biases and relevant for determining the climate response to external forcing. This article highlights recent developments from different research groups which show that the stochastic representation of unresolved processes in the atmosphere, oceans, land surface and cryosphere of comprehensive weather and climate models (a) gives rise to more reliable probabilistic forecasts of weather and climate and (b) reduces systematic model bias. We make a case that the use of mathematically stringent methods for the derivation of stochastic dynamic equations will lead to substantial improvements in our ability to accurately simulate weather and climate at all scales. Recent work in mathematics, statistical mechanics and turbulence is reviewed, its relevance for the climate problem demonstrated, and future research directions outlined. △ Less

Submitted 20 March, 2017; v1 submitted 29 October, 2015; originally announced October 2015.

Comments: 26 pages, 15 figures. Final published version

Generalising separating families of fixed size

Authors: Fabrício S. Benevides, Dániel Gerbner, Cory T. Palmer, Dominik K. Vu

Abstract: We examine the following version of a classic combinatorial search problem introduced by Rényi: Given a finite set $X$ of $n$ elements we want to identify an unknown subset $Y \subset X$ of exactly $d$ elements by testing, by as few as possible subsets $A$ of $X$, whether $A$ contains an element of $Y$ or not. We are primarily concerned with the model where the family of test sets is specified in… ▽ More We examine the following version of a classic combinatorial search problem introduced by Rényi: Given a finite set $X$ of $n$ elements we want to identify an unknown subset $Y \subset X$ of exactly $d$ elements by testing, by as few as possible subsets $A$ of $X$, whether $A$ contains an element of $Y$ or not. We are primarily concerned with the model where the family of test sets is specified in advance (non-adaptive) and each test set is of size at most a given $k$. Our main results are asymptotically sharp bounds on the minimum number of tests necessary for fixed $d$ and $k$ and for $n$ tending to infinity. △ Less

Submitted 1 September, 2015; originally announced September 2015.

Invariant Set Theory: Violating Measurement Independence without Fine Tuning, Conspiracy, Constraints on Free Will or Retrocausality

Authors: Tim Palmer

Abstract: Invariant Set (IS) theory is a locally causal ontic theory of physics based on the Cosmological Invariant Set postulate that the universe $U$ can be considered a deterministic dynamical system evolving precisely on a (suitably constructed) fractal dynamically invariant set in $U$'s state space. IS theory violates the Bell inequalities by violating Measurement Independence. Despite this, IS theory… ▽ More Invariant Set (IS) theory is a locally causal ontic theory of physics based on the Cosmological Invariant Set postulate that the universe $U$ can be considered a deterministic dynamical system evolving precisely on a (suitably constructed) fractal dynamically invariant set in $U$'s state space. IS theory violates the Bell inequalities by violating Measurement Independence. Despite this, IS theory is not fine tuned, is not conspiratorial, does not constrain experimenter free will and does not invoke retrocausality. The reasons behind these claims are discussed in this paper. These arise from properties not found in conventional ontic models: the invariant set has zero measure in its Euclidean embedding space, has Cantor Set structure homeomorphic to the p-adic integers ($p \ggg 0$) and is non-computable. In particular, it is shown that the p-adic metric encapulates the physics of the Cosmological Invariant Set postulate, and provides the technical means to demonstrate no fine tuning or conspiracy. Quantum theory can be viewed as the singular limit of IS theory when when $p$ is set equal to infinity. Since it is based around a top-down constraint from cosmology, IS theory suggests that gravitational and quantum physics will be unified by a gravitational theory of the quantum, rather than a quantum theory of gravity. Some implications arising from such a perspective are discussed. △ Less

Submitted 6 November, 2015; v1 submitted 7 July, 2015; originally announced July 2015.

Comments: In Proceedings QPL 2015, arXiv:1511.01181

Journal ref: EPTCS 195, 2015, pp. 285-294

Oceanic stochastic parametrizations in a seasonal forecast system

Authors: M. Andrejczuk, F. C. Cooper, S. Juricke, T. N. Palmer, A. Weisheimer, L. Zanna

Abstract: We study the impact of three stochastic parametrizations in the ocean component of a coupled model, on forecast reliability over seasonal timescales. The relative impacts of these schemes upon the ocean mean state and ensemble spread are analyzed. The oceanic variability induced by the atmospheric forcing of the coupled system is, in most regions, the major source of ensemble spread. The largest i… ▽ More We study the impact of three stochastic parametrizations in the ocean component of a coupled model, on forecast reliability over seasonal timescales. The relative impacts of these schemes upon the ocean mean state and ensemble spread are analyzed. The oceanic variability induced by the atmospheric forcing of the coupled system is, in most regions, the major source of ensemble spread. The largest impact on spread and bias came from the Stochastically Perturbed Parametrization Tendency (SPPT) scheme - which has proven particularly effective in the atmosphere. The key regions affected are eddy-active regions, namely the western boundary currents and the Southern Ocean. However, unlike its impact in the atmosphere, SPPT in the ocean did not result in a significant decrease in forecast error. Whilst there are good grounds for implementing stochastic schemes in ocean models, our results suggest that they will have to be more sophisticated. Some suggestions for next-generation stochastic schemes are made. △ Less

Submitted 30 June, 2015; originally announced June 2015.

Comments: 24 pages, 3 figures

Estimating Structural Mean Models with Multiple Instrumental Variables Using the Generalised Method of Moments

Authors: Paul S. Clarke, Tom M. Palmer, Frank Windmeijer

Abstract: Instrumental variables analysis using genetic markers as instruments is now a widely used technique in epidemiology and biostatistics. As single markers tend to explain only a small proportion of phenotypic variation, there is increasing interest in using multiple genetic markers to obtain more precise estimates of causal parameters. Structural mean models (SMMs) are semiparametric models that use… ▽ More Instrumental variables analysis using genetic markers as instruments is now a widely used technique in epidemiology and biostatistics. As single markers tend to explain only a small proportion of phenotypic variation, there is increasing interest in using multiple genetic markers to obtain more precise estimates of causal parameters. Structural mean models (SMMs) are semiparametric models that use instrumental variables to identify causal parameters. Recently, interest has started to focus on using these models with multiple instruments, particularly for multiplicative and logistic SMMs. In this paper we show how additive, multiplicative and logistic SMMs with multiple orthogonal binary instrumental variables can be estimated efficiently in models with no further (continuous) covariates, using the generalised method of moments (GMM) estimator. We discuss how the Hansen J-test can be used to test for model misspecification, and how standard GMM software routines can be used to fit SMMs. We further show that multiplicative SMMs, like the additive SMM, identify a weighted average of local causal effects if selection is monotonic. We use these methods to reanalyse a study of the relationship between adiposity and hypertension using SMMs with two genetic markers as instruments for adiposity. We find strong effects of adiposity on hypertension. △ Less

Submitted 8 April, 2015; originally announced April 2015.

Comments: Published at http://dx.doi.org/10.1214/14-STS503 in the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-STS-STS503

Journal ref: Statistical Science 2015, Vol. 30, No. 1, 96-117

Bell's Conspiracy, Schrödinger's Black Cat and Global Invariant Sets

Authors: T. N. Palmer

Abstract: A locally causal hidden-variable theory of quantum physics need not be constrained by the Bell inequalities if this theory also partially violates the measurement independence condition. However, such violation can appear unphysical, implying implausible conspiratorial correlations between the hidden-variables of particles being measured and earlier determinants of instrumental settings. A novel p… ▽ More A locally causal hidden-variable theory of quantum physics need not be constrained by the Bell inequalities if this theory also partially violates the measurement independence condition. However, such violation can appear unphysical, implying implausible conspiratorial correlations between the hidden-variables of particles being measured and earlier determinants of instrumental settings. A novel physically plausible explanation for such correlations is proposed, based on the hypothesis that states of physical reality lie precisely on a non-computational measure-zero dynamically invariant set in the state space of the universe: the Cosmological Invariant Set Postulate. To illustrate the relevance of the concept of a global invariant set, a simple analogy is considered where a massive object is propelled into a black hole depending on the decay of a radioactive atom. It is claimed that a locally causal hidden-variable theory constrained by the Cosmological Invariant Set Postulate can violate the CHSH inequality without being conspiratorial, superdeterministic, fine-tuned or retrocausal, and the theory readily accommodates the classical compatibilist notion of (experimenter) free will. △ Less

Submitted 24 February, 2015; originally announced February 2015.

Comments: To appear in Special Issue "New Geometric Concepts in the Foundations of Quantum Physics" of Phil Trans Roy Soc A