-
Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs
Authors:
Krista Opsahl-Ong,
Michael J Ryan,
Josh Purtell,
David Broman,
Christopher Potts,
Matei Zaharia,
Omar Khattab
Abstract:
Language Model Programs, i.e. sophisticated pipelines of modular language model (LM) calls, are increasingly advancing NLP tasks, but they require crafting prompts that are jointly effective for all modules. We study prompt optimization for LM programs, i.e. how to update these prompts to maximize a downstream metric without access to module-level labels or gradients. To make this tractable, we fa…
▽ More
Language Model Programs, i.e. sophisticated pipelines of modular language model (LM) calls, are increasingly advancing NLP tasks, but they require crafting prompts that are jointly effective for all modules. We study prompt optimization for LM programs, i.e. how to update these prompts to maximize a downstream metric without access to module-level labels or gradients. To make this tractable, we factorize our problem into optimizing the free-form instructions and few-shot demonstrations of every module and introduce several strategies to craft task-grounded instructions and navigate credit assignment across modules. Our strategies include (i) program- and data-aware techniques for proposing effective instructions, (ii) a stochastic mini-batch evaluation function for learning a surrogate model of our objective, and (iii) a meta-optimization procedure in which we refine how LMs construct proposals over time. Using these insights we develop MIPRO, a novel optimizer that outperforms baselines on five of six diverse LM programs using a best-in-class open-source model (Llama-3-8B), by as high as 12.9% accuracy. We will release our new optimizers and benchmark in DSPy at https://github.com/stanfordnlp/dspy
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
Refining the grading of irreducible Lie colour algebra representations
Authors:
Mitchell Ryan
Abstract:
We define the refining extension of representations for Lie colour algebras which simultaneously extends the representations and refines the grading to a larger grading group.We show that the refining extension provides a general method for deriving all finite-dimensional irreducible Lie colour algebra representations from those for Lie superalgebras. This method yields a bijection between equival…
▽ More
We define the refining extension of representations for Lie colour algebras which simultaneously extends the representations and refines the grading to a larger grading group.We show that the refining extension provides a general method for deriving all finite-dimensional irreducible Lie colour algebra representations from those for Lie superalgebras. This method yields a bijection between equivalence classes but, despite this, Lie colour algebras maintain a non-trivial representation theory distinct from that of Lie superalgebras. We expect this result to be useful for the many applications of Lie colour algebras that make use of irreducible representations. In addition, we show that the refining extension provides a natural way to construct the Hilbert space realisation for colour algebra quantum-mechanical models by giving an example that has previously appeared in the literature.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Unintended Impacts of LLM Alignment on Global Representation
Authors:
Michael J. Ryan,
William Held,
Diyi Yang
Abstract:
Before being deployed for user-facing applications, developers align Large Language Models (LLMs) to user preferences through a variety of procedures, such as Reinforcement Learning From Human Feedback (RLHF) and Direct Preference Optimization (DPO). Current evaluations of these procedures focus on benchmarks of instruction following, reasoning, and truthfulness. However, human preferences are not…
▽ More
Before being deployed for user-facing applications, developers align Large Language Models (LLMs) to user preferences through a variety of procedures, such as Reinforcement Learning From Human Feedback (RLHF) and Direct Preference Optimization (DPO). Current evaluations of these procedures focus on benchmarks of instruction following, reasoning, and truthfulness. However, human preferences are not universal, and aligning to specific preference sets may have unintended effects. We explore how alignment impacts performance along three axes of global representation: English dialects, multilingualism, and opinions from and about countries worldwide. Our results show that current alignment procedures create disparities between English dialects and global opinions. We find alignment improves capabilities in several languages. We conclude by discussing design decisions that led to these unintended impacts and recommendations for more equitable preference tuning. We make our code and data publicly available on Github.
△ Less
Submitted 6 June, 2024; v1 submitted 22 February, 2024;
originally announced February 2024.
-
Power calculation for cross-sectional stepped wedge cluster randomized trials with a time-to-event endpoint
Authors:
Mary M. Ryan,
Denise Esserman,
Monica Taljaard,
Fan Li
Abstract:
A popular design choice in public health and implementation science research, stepped wedge cluster randomized trials (SW-CRTs) are a form of randomized trial whereby clusters are progressively transitioned from control to intervention, and the timing of transition is randomized for each cluster. An important task at the design stage is to ensure that the planned trial has sufficient power to obse…
▽ More
A popular design choice in public health and implementation science research, stepped wedge cluster randomized trials (SW-CRTs) are a form of randomized trial whereby clusters are progressively transitioned from control to intervention, and the timing of transition is randomized for each cluster. An important task at the design stage is to ensure that the planned trial has sufficient power to observe a clinically meaningful effect size. While methods for determining study power have been well-developed for SW-CRTs with continuous and binary outcomes, limited methods for power calculation are available for SW-CRTs with censored time-to-event outcomes. In this article, we propose a stratified marginal Cox model to account for secular trend in cross-sectional SW-CRTs, and derive an explicit expression of the robust sandwich variance to facilitate power calculations without the need for computationally intensive simulations. Power formulas based on both the Wald and robust score tests are developed and compared via simulation, generally demonstrating superiority of robust score procedures in different finite-sample scenarios. Finally, we illustrate our methods using a SW-CRT testing the effect of a new electronic reminder system on time to catheter removal in hospital settings. We also offer an R Shiny application to facilitate sample size and power calculations using our proposed methods.
△ Less
Submitted 20 December, 2023;
originally announced December 2023.
-
Multimodal deep learning for map** forest dominant height by fusing GEDI with earth observation data
Authors:
Man Chen,
Wenquan Dong,
Hao Yu,
Iain Woodhouse,
Casey M. Ryan,
Haoyu Liu,
Selena Georgiou,
Edward T. A. Mitchard
Abstract:
The integration of multisource remote sensing data and deep learning models offers new possibilities for accurately map** high spatial resolution forest height. We found that GEDI relative heights (RH) metrics exhibited strong correlation with the mean of the top 10 highest trees (dominant height) measured in situ at the corresponding footprint locations. Consequently, we proposed a novel deep l…
▽ More
The integration of multisource remote sensing data and deep learning models offers new possibilities for accurately map** high spatial resolution forest height. We found that GEDI relative heights (RH) metrics exhibited strong correlation with the mean of the top 10 highest trees (dominant height) measured in situ at the corresponding footprint locations. Consequently, we proposed a novel deep learning framework termed the multi-modal attention remote sensing network (MARSNet) to estimate forest dominant height by extrapolating dominant height derived from GEDI, using Setinel-1 data, ALOS-2 PALSAR-2 data, Sentinel-2 optical data and ancillary data. MARSNet comprises separate encoders for each remote sensing data modality to extract multi-scale features, and a shared decoder to fuse the features and estimate height. Using individual encoders for each remote sensing imagery avoids interference across modalities and extracts distinct representations. To focus on the efficacious information from each dataset, we reduced the prevalent spatial and band redundancies in each remote sensing data by incorporating the extended spatial and band reconstruction convolution modules in the encoders. MARSNet achieved commendable performance in estimating dominant height, with an R2 of 0.62 and RMSE of 2.82 m, outperforming the widely used random forest approach which attained an R2 of 0.55 and RMSE of 3.05 m. Finally, we applied the trained MARSNet model to generate wall-to-wall maps at 10 m resolution for Jilin, China. Through independent validation using field measurements, MARSNet demonstrated an R2 of 0.58 and RMSE of 3.76 m, compared to 0.41 and 4.37 m for the random forest baseline. Our research demonstrates the effectiveness of a multimodal deep learning approach fusing GEDI with SAR and passive optical imagery for enhancing the accuracy of high resolution dominant height estimation.
△ Less
Submitted 20 November, 2023;
originally announced November 2023.
-
Forest aboveground biomass estimation using GEDI and earth observation data through attention-based deep learning
Authors:
Wenquan Dong,
Edward T. A. Mitchard,
Hao Yu,
Steven Hancock,
Casey M. Ryan
Abstract:
Accurate quantification of forest aboveground biomass (AGB) is critical for understanding carbon accounting in the context of climate change. In this study, we presented a novel attention-based deep learning approach for forest AGB estimation, primarily utilizing openly accessible EO data, including: GEDI LiDAR data, C-band Sentinel-1 SAR data, ALOS-2 PALSAR-2 data, and Sentinel-2 multispectral da…
▽ More
Accurate quantification of forest aboveground biomass (AGB) is critical for understanding carbon accounting in the context of climate change. In this study, we presented a novel attention-based deep learning approach for forest AGB estimation, primarily utilizing openly accessible EO data, including: GEDI LiDAR data, C-band Sentinel-1 SAR data, ALOS-2 PALSAR-2 data, and Sentinel-2 multispectral data. The attention UNet (AU) model achieved markedly higher accuracy for biomass estimation compared to the conventional RF algorithm. Specifically, the AU model attained an R2 of 0.66, RMSE of 43.66 Mg ha-1, and bias of 0.14 Mg ha-1, while RF resulted in lower scores of R2 0.62, RMSE 45.87 Mg ha-1, and bias 1.09 Mg ha-1. However, the superiority of the deep learning approach was not uniformly observed across all tested models. ResNet101 only achieved an R2 of 0.50, an RMSE of 52.93 Mg ha-1, and a bias of 0.99 Mg ha-1, while the UNet reported an R2 of 0.65, an RMSE of 44.28 Mg ha-1, and a substantial bias of 1.84 Mg ha-1. Moreover, to explore the performance of AU in the absence of spatial information, fully connected (FC) layers were employed to eliminate spatial information from the remote sensing data. AU-FC achieved intermediate R2 of 0.64, RMSE of 44.92 Mgha-1, and bias of -0.56 Mg ha-1, outperforming RF but underperforming AU model using spatial information. We also generated 10m forest AGB maps across Guangdong for the year 2019 using AU and compared it with that produced by RF. The AGB distributions from both models showed strong agreement with similar mean values; the mean forest AGB estimated by AU was 102.18 Mg ha-1 while that of RF was 104.84 Mg ha-1. Additionally, it was observed that the AGB map generated by AU provided superior spatial information. Overall, this research substantiates the feasibility of employing deep learning for biomass estimation based on satellite data.
△ Less
Submitted 6 November, 2023;
originally announced November 2023.
-
Group sequential two-stage preference designs
Authors:
Ruyi Liu,
Fan Li,
Denise Esserman,
Mary M. Ryan
Abstract:
The two-stage preference design (TSPD) enables the inference for treatment efficacy while allowing for incorporation of patient preference to treatment. It can provide unbiased estimates for selection and preference effects, where a selection effect occurs when patients who prefer one treatment respond differently than those who prefer another, and a preference effect is the difference in response…
▽ More
The two-stage preference design (TSPD) enables the inference for treatment efficacy while allowing for incorporation of patient preference to treatment. It can provide unbiased estimates for selection and preference effects, where a selection effect occurs when patients who prefer one treatment respond differently than those who prefer another, and a preference effect is the difference in response caused by an interaction between the patient's preference and the actual treatment they receive. One potential barrier to adopting TSPD in practice, however, is the relatively large sample size required to estimate selection and preference effects with sufficient power. To address this concern, we propose a group sequential two-stage preference design (GS-TSPD), which combines TSPD with sequential monitoring for early stop**. In the GS-TSPD, pre-planned sequential monitoring allows investigators to conduct repeated hypothesis tests on accumulated data prior to full enrollment to assess study eligibility for early trial termination without inflating type I error rates. Thus, the procedure allows investigators to terminate the study when there is sufficient evidence of treatment, selection, or preference effects during an interim analysis, thereby reducing the design resource in expectation. To formalize such a procedure, we verify the independent increments assumption for testing the selection and preference effects and apply group sequential stop** boundaries from the approximate sequential density functions. Simulations are then conducted to investigate the operating characteristics of our proposed GS-TSPD compared to the traditional TSPD. We demonstrate the applicability of the design using a study of Hepatitis C treatment modality.
△ Less
Submitted 17 October, 2023;
originally announced October 2023.
-
Using Reed-Muller Codes for Classification with Rejection and Recovery
Authors:
Daniel Fentham,
David Parker,
Mark Ryan
Abstract:
When deploying classifiers in the real world, users expect them to respond to inputs appropriately. However, traditional classifiers are not equipped to handle inputs which lie far from the distribution they were trained on. Malicious actors can exploit this defect by making adversarial perturbations designed to cause the classifier to give an incorrect output. Classification-with-rejection method…
▽ More
When deploying classifiers in the real world, users expect them to respond to inputs appropriately. However, traditional classifiers are not equipped to handle inputs which lie far from the distribution they were trained on. Malicious actors can exploit this defect by making adversarial perturbations designed to cause the classifier to give an incorrect output. Classification-with-rejection methods attempt to solve this problem by allowing networks to refuse to classify an input in which they have low confidence. This works well for strongly adversarial examples, but also leads to the rejection of weakly perturbed images, which intuitively could be correctly classified. To address these issues, we propose Reed-Muller Aggregation Networks (RMAggNet), a classifier inspired by Reed-Muller error-correction codes which can correct and reject inputs. This paper shows that RMAggNet can minimise incorrectness while maintaining good correctness over multiple adversarial attacks at different perturbation budgets by leveraging the ability to correct errors in the classification process. This provides an alternative classification-with-rejection method which can reduce the amount of additional processing in situations where a small number of incorrect classifications are permissible.
△ Less
Submitted 12 September, 2023;
originally announced September 2023.
-
Determining the Fundamental Failure Modes in Ni-rich Lithium Ion Battery Cathodes
Authors:
Siyang Wang,
Zonghao Shen,
Aigerim Omirkhan,
Oriol Gavalda-Diaz,
Mary P. Ryan,
Finn Giuliani
Abstract:
Challenges associated with in-service mechanical degradation of Li-ion battery cathodes has prompted a transition from polycrystalline to single crystal cathode materials. Whilst for single crystal materials, dislocation-assisted crack formation is assumed to be the dominating failure mechanism throughout battery life, there is little direct information about their mechanical behaviour, and mechan…
▽ More
Challenges associated with in-service mechanical degradation of Li-ion battery cathodes has prompted a transition from polycrystalline to single crystal cathode materials. Whilst for single crystal materials, dislocation-assisted crack formation is assumed to be the dominating failure mechanism throughout battery life, there is little direct information about their mechanical behaviour, and mechanistic understanding remains elusive. Here, we demonstrated, using in situ micromechanical testing, direct measurement of local mechanical properties within LiNi0.8Mn0.1Co0.1O2 single crystalline domains. We elucidated the dislocation slip systems, their critical stresses, and how slip facilitate cracking. We then compared single crystal and polycrystal deformation behaviour. Our findings answer two fundamental questions critical to understanding cathode degradation: What dislocation slip systems operate in Ni-rich cathode materials? And how does slip cause fracture? This knowledge unlocks our ability to develop tools for lifetime prediction and failure risk assessment, as well as in designing novel cathode materials with increased toughness in-service.
△ Less
Submitted 12 August, 2023;
originally announced August 2023.
-
Capturing functional connectomics using Riemannian partial least squares
Authors:
Matt Ryan,
Gary Glonek,
Jono Tuke,
Melissa Humphries
Abstract:
For neurological disorders and diseases, functional and anatomical connectomes of the human brain can be used to better inform targeted interventions and treatment strategies. Functional magnetic resonance imaging (fMRI) is a non-invasive neuroimaging technique that captures spatio-temporal brain function through blood flow over time. FMRI can be used to study the functional connectome through the…
▽ More
For neurological disorders and diseases, functional and anatomical connectomes of the human brain can be used to better inform targeted interventions and treatment strategies. Functional magnetic resonance imaging (fMRI) is a non-invasive neuroimaging technique that captures spatio-temporal brain function through blood flow over time. FMRI can be used to study the functional connectome through the functional connectivity matrix; that is, Pearson's correlation matrix between time series from the regions of interest of an fMRI image. One approach to analysing functional connectivity is using partial least squares (PLS), a multivariate regression technique designed for high-dimensional predictor data. However, analysing functional connectivity with PLS ignores a key property of the functional connectivity matrix; namely, these matrices are positive definite. To account for this, we introduce a generalisation of PLS to Riemannian manifolds, called R-PLS, and apply it to symmetric positive definite matrices with the affine invariant geometry. We apply R-PLS to two functional imaging datasets: COBRE, which investigates functional differences between schizophrenic patients and healthy controls, and; ABIDE, which compares people with autism spectrum disorder and neurotypical controls. Using the variable importance in the projection statistic on the results of R-PLS, we identify key functional connections in each dataset that are well represented in the literature. Given the generality of R-PLS, this method has potential to open up new avenues for multi-model imaging analysis linking structural and functional connectomics.
△ Less
Submitted 29 June, 2023;
originally announced June 2023.
-
Statistical Relationship Between Long-duration High-Energy Gamma-Ray Emission and Solar Energetic Particles
Authors:
Alessandro Bruno,
Georgia A. de Nolfo,
James M. Ryan,
Ian G. Richardson,
Silvia Dalla
Abstract:
Large solar eruptions are often associated with long-duration gamma-ray emission extending well above 100 MeV. While this phenomenon is known to be caused by high-energy ions interacting with the solar atmosphere, the underlying dominant acceleration process remains under debate. Potential mechanisms include continuous acceleration of particles trapped within large coronal loops or acceleration at…
▽ More
Large solar eruptions are often associated with long-duration gamma-ray emission extending well above 100 MeV. While this phenomenon is known to be caused by high-energy ions interacting with the solar atmosphere, the underlying dominant acceleration process remains under debate. Potential mechanisms include continuous acceleration of particles trapped within large coronal loops or acceleration at coronal mass ejection (CME)-driven shocks, with subsequent back-propagation towards the Sun. As a test of the latter scenario, previous studies have explored the relationship between the inferred particle population producing the high-energy gamma-rays, and the population of solar energetic particles (SEPs) measured in situ. However, given the significant limitations on available observations, these estimates unavoidably rely on a number of assumptions. In an effort to better constrain theories of the gamma-ray emission origin, we re-examine the calculation uncertainties and how they influence the comparison of these two proton populations. We show that, even accounting for conservative assumptions related to gamma-ray flare, SEP event and interplanetary scattering modeling, their statistical relationship is only poorly/moderately significant. However, though the level of correlation is of interest, it does not provide conclusive evidence for or against a causal connection. The main result of this investigation is that the fraction of the shock-accelerated protons required to account for the gamma-ray observations is >20-40% for six of the fourteen eruptions analyzed. Such high values argue against current CME-shock origin models, predicting a <2% back-precipitation, hence the computed numbers of high-energy SEPs appear to be greatly insufficient to sustain the measured gamma-ray emission.
△ Less
Submitted 26 June, 2023;
originally announced June 2023.
-
Revisiting non-English Text Simplification: A Unified Multilingual Benchmark
Authors:
Michael J. Ryan,
Tarek Naous,
Wei Xu
Abstract:
Recent advancements in high-quality, large-scale English resources have pushed the frontier of English Automatic Text Simplification (ATS) research. However, less work has been done on multilingual text simplification due to the lack of a diverse evaluation benchmark that covers complex-simple sentence pairs in many languages. This paper introduces the MultiSim benchmark, a collection of 27 resour…
▽ More
Recent advancements in high-quality, large-scale English resources have pushed the frontier of English Automatic Text Simplification (ATS) research. However, less work has been done on multilingual text simplification due to the lack of a diverse evaluation benchmark that covers complex-simple sentence pairs in many languages. This paper introduces the MultiSim benchmark, a collection of 27 resources in 12 distinct languages containing over 1.7 million complex-simple sentence pairs. This benchmark will encourage research in develo** more effective multilingual text simplification models and evaluation metrics. Our experiments using MultiSim with pre-trained multilingual language models reveal exciting performance improvements from multilingual training in non-English settings. We observe strong performance from Russian in zero-shot cross-lingual transfer to low-resource languages. We further show that few-shot prompting with BLOOM-176b achieves comparable quality to reference simplifications outperforming fine-tuned models in most languages. We validate these findings through human evaluation.
△ Less
Submitted 24 May, 2023;
originally announced May 2023.
-
ReadMe++: Benchmarking Multilingual Language Models for Multi-Domain Readability Assessment
Authors:
Tarek Naous,
Michael J. Ryan,
Anton Lavrouk,
Mohit Chandra,
Wei Xu
Abstract:
We present a comprehensive evaluation of large language models for multilingual readability assessment. Existing evaluation resources lack domain and language diversity, limiting the ability for cross-domain and cross-lingual analyses. This paper introduces ReadMe++, a multilingual multi-domain dataset with human annotations of 9757 sentences in Arabic, English, French, Hindi, and Russian, collect…
▽ More
We present a comprehensive evaluation of large language models for multilingual readability assessment. Existing evaluation resources lack domain and language diversity, limiting the ability for cross-domain and cross-lingual analyses. This paper introduces ReadMe++, a multilingual multi-domain dataset with human annotations of 9757 sentences in Arabic, English, French, Hindi, and Russian, collected from 112 different data sources. This benchmark will encourage research on develo** robust multilingual readability assessment methods. Using ReadMe++, we benchmark multilingual and monolingual language models in the supervised, unsupervised, and few-shot prompting settings. The domain and language diversity in ReadMe++ enable us to test more effective few-shot prompting, and identify shortcomings in state-of-the-art unsupervised methods. Our experiments also reveal exciting results of superior domain generalization and enhanced cross-lingual transfer capabilities by models trained on ReadMe++. We will make our data publicly available and release a python package tool for multilingual sentence readability prediction using our trained models at: https://github.com/tareknaous/readme
△ Less
Submitted 8 June, 2024; v1 submitted 23 May, 2023;
originally announced May 2023.
-
Having Beer after Prayer? Measuring Cultural Bias in Large Language Models
Authors:
Tarek Naous,
Michael J. Ryan,
Alan Ritter,
Wei Xu
Abstract:
As the reach of large language models (LMs) expands globally, their ability to cater to diverse cultural contexts becomes crucial. Despite advancements in multilingual capabilities, models are not designed with appropriate cultural nuances. In this paper, we show that multilingual and Arabic monolingual LMs exhibit bias towards entities associated with Western culture. We introduce CAMeL, a novel…
▽ More
As the reach of large language models (LMs) expands globally, their ability to cater to diverse cultural contexts becomes crucial. Despite advancements in multilingual capabilities, models are not designed with appropriate cultural nuances. In this paper, we show that multilingual and Arabic monolingual LMs exhibit bias towards entities associated with Western culture. We introduce CAMeL, a novel resource of 628 naturally-occurring prompts and 20,368 entities spanning eight types that contrast Arab and Western cultures. CAMeL provides a foundation for measuring cultural biases in LMs through both extrinsic and intrinsic evaluations. Using CAMeL, we examine the cross-cultural performance in Arabic of 16 different LMs on tasks such as story generation, NER, and sentiment analysis, where we find concerning cases of stereoty** and cultural unfairness. We further test their text-infilling performance, revealing the incapability of appropriate adaptation to Arab cultural contexts. Finally, we analyze 6 Arabic pre-training corpora and find that commonly used sources such as Wikipedia may not be best suited to build culturally aware LMs, if used as they are without adjustment. We will make CAMeL publicly available at: https://github.com/tareknaous/camel
△ Less
Submitted 20 March, 2024; v1 submitted 23 May, 2023;
originally announced May 2023.
-
The James Webb Space Telescope Mission
Authors:
Jonathan P. Gardner,
John C. Mather,
Randy Abbott,
James S. Abell,
Mark Abernathy,
Faith E. Abney,
John G. Abraham,
Roberto Abraham,
Yasin M. Abul-Huda,
Scott Acton,
Cynthia K. Adams,
Evan Adams,
David S. Adler,
Maarten Adriaensen,
Jonathan Albert Aguilar,
Mansoor Ahmed,
Nasif S. Ahmed,
Tanjira Ahmed,
Rüdeger Albat,
Loïc Albert,
Stacey Alberts,
David Aldridge,
Mary Marsha Allen,
Shaune S. Allen,
Martin Altenburg
, et al. (983 additional authors not shown)
Abstract:
Twenty-six years ago a small committee report, building on earlier studies, expounded a compelling and poetic vision for the future of astronomy, calling for an infrared-optimized space telescope with an aperture of at least $4m$. With the support of their governments in the US, Europe, and Canada, 20,000 people realized that vision as the $6.5m$ James Webb Space Telescope. A generation of astrono…
▽ More
Twenty-six years ago a small committee report, building on earlier studies, expounded a compelling and poetic vision for the future of astronomy, calling for an infrared-optimized space telescope with an aperture of at least $4m$. With the support of their governments in the US, Europe, and Canada, 20,000 people realized that vision as the $6.5m$ James Webb Space Telescope. A generation of astronomers will celebrate their accomplishments for the life of the mission, potentially as long as 20 years, and beyond. This report and the scientific discoveries that follow are extended thank-you notes to the 20,000 team members. The telescope is working perfectly, with much better image quality than expected. In this and accompanying papers, we give a brief history, describe the observatory, outline its objectives and current observing program, and discuss the inventions and people who made it possible. We cite detailed reports on the design and the measured performance on orbit.
△ Less
Submitted 10 April, 2023;
originally announced April 2023.
-
Automatic verification of transparency protocols (extended version)
Authors:
Vincent Cheval,
José Moreira,
Mark Ryan
Abstract:
Transparency protocols are protocols whose actions can be publicly monitored by observers (such observers may include regulators, rights advocacy groups, or the general public). The observed actions are typically usages of private keys such as decryptions, and signings. Examples of transparency protocols include certificate transparency, cryptocurrency, transparent decryption, and electronic votin…
▽ More
Transparency protocols are protocols whose actions can be publicly monitored by observers (such observers may include regulators, rights advocacy groups, or the general public). The observed actions are typically usages of private keys such as decryptions, and signings. Examples of transparency protocols include certificate transparency, cryptocurrency, transparent decryption, and electronic voting. These protocols usually pose a challenge for automatic verification, because they involve sophisticated data types that have strong properties, such as Merkle trees, that allow compact proofs of data presence and tree extension.
We address this challenge by introducing new features in ProVerif, and a methodology for using them. With our methodology, it is possible to describe the data type quite abstractly, using ProVerif axioms, and prove the correctness of the protocol using those axioms as assumptions. Then, in separate steps, one can define one or more concrete implementations of the data type, and again use ProVerif to show that the implementations satisfy the assumptions that were coded as axioms. This helps make compositional proofs, splitting the proof burden into several manageable pieces. We illustrate the methodology and features by providing the first formal verification of the transparent decryption and certificate transparency protocols with a precise modelling of the Merkle tree data structure.
△ Less
Submitted 16 April, 2023; v1 submitted 8 March, 2023;
originally announced March 2023.
-
Maximin optimal cluster randomized designs for assessing treatment effect heterogeneity
Authors:
Mary M. Ryan,
Denise Esserman,
Fan Li
Abstract:
Cluster randomized trials (CRTs) are studies where treatment is randomized at the cluster level but outcomes are typically collected at the individual level. When CRTs are employed in pragmatic settings, baseline population characteristics may moderate treatment effects, leading to what is known as heterogeneous treatment effects (HTEs). Pre-specified, hypothesis-driven HTE analyses in CRTs can en…
▽ More
Cluster randomized trials (CRTs) are studies where treatment is randomized at the cluster level but outcomes are typically collected at the individual level. When CRTs are employed in pragmatic settings, baseline population characteristics may moderate treatment effects, leading to what is known as heterogeneous treatment effects (HTEs). Pre-specified, hypothesis-driven HTE analyses in CRTs can enable an understanding of how interventions may impact subpopulation outcomes. While closed-form sample size formulas have recently been proposed, assuming known intracluster correlation coefficients (ICCs) for both the covariate and outcome, guidance on optimal cluster randomized designs to ensure maximum power with pre-specified HTE analyses has not yet been developed. We derive new design formulas to determine the cluster size and number of clusters to achieve the locally optimal design (LOD) that minimizes variance for estimating the HTE parameter given a budget constraint. Given the LODs are based on covariate and outcome-ICC values that are usually unknown, we further develop the maximin design for assessing HTE, identifying the combination of design resources that maximize the relative efficiency of the HTE analysis in the worst case scenario. In addition, given the analysis of the average treatment effect is often of primary interest, we also establish optimal designs to accommodate multiple objectives by combining considerations for studying both the average and heterogeneous treatment effects. We illustrate our methods using the context of the Kerala Diabetes Prevention Program CRT, and provide an R Shiny app to facilitate calculation of optimal designs under a wide range of design parameters.
△ Less
Submitted 30 May, 2023; v1 submitted 17 February, 2023;
originally announced February 2023.
-
Fracture properties of La(Fe,Mn,Si)13 magnetocaloric materials
Authors:
Siyang Wang,
Paul Burdett,
Edmund Lovell,
Rachel Bettles,
Neil Wilson,
Mary P. Ryan,
Finn Giuliani
Abstract:
La(Fe,Mn,Si)13 alloys are a promising material family for magnetic refrigeration. Challenges associated with their structural integrity during device assembly and operation requires deep understanding of the mechanical properties. Here we developed a workflow to quantitatively study the fracture properties of La(Fe,Mn,Si)13 plates used in magnetic cooling devices. We employed microstructural chara…
▽ More
La(Fe,Mn,Si)13 alloys are a promising material family for magnetic refrigeration. Challenges associated with their structural integrity during device assembly and operation requires deep understanding of the mechanical properties. Here we developed a workflow to quantitatively study the fracture properties of La(Fe,Mn,Si)13 plates used in magnetic cooling devices. We employed microstructural characterisation, optical examination of defects, and four-point bending tests of samples with known defect sizes to evaluate their mechanical performance. We established the residual strength curve which directly links observed defects to mechanical strength. The estimated fracture toughness KC of hydrogenated La(Fe,Mn,Si)13 is approximately 4 MPa m^1/2 for the geometry employed. The established relationship between strength and crack length enables the prediction of mechanical performance through examination of defects via optical microscopy, therefore can be used industrially for directing plate selection to guarantee the mechanical stability of refrigeration devices.
△ Less
Submitted 27 January, 2023;
originally announced January 2023.
-
Recent Results from the FASTSUM Collaboration
Authors:
Chris Allton,
Gert Aarts,
Ryan Bignell,
Tim Burns,
Sergio Chaves,
Simon Hands,
Benjamin Jäger,
Seyong Kim,
Maria Paola Lombardo,
Ben Page,
Sinéad M. Ryan,
Jon-Ivar Skullerud,
Thomas Spriggs
Abstract:
The FASTSUM Collaboration has developed a comprehensive research programme in thermal QCD using 2+1 flavour, anisotropic ensembles. In this talk, we summarise some of our recent results including thermal hadron spectrum calculations using our ``Generation 2L'' ensembles which have pion masses of 239(1) MeV. These include open charm mesons and charm baryons. We also summarise our work using the Bac…
▽ More
The FASTSUM Collaboration has developed a comprehensive research programme in thermal QCD using 2+1 flavour, anisotropic ensembles. In this talk, we summarise some of our recent results including thermal hadron spectrum calculations using our ``Generation 2L'' ensembles which have pion masses of 239(1) MeV. These include open charm mesons and charm baryons. We also summarise our work using the Backus Gilbert approach to determining the spectral function of the NRQCD bottomonium system. Finally, we review our determination of the interquark potential in the same system, but using our ``Generation 2'' ensembles which have heavier pion masses of 384(4) MeV.
△ Less
Submitted 24 January, 2023;
originally announced January 2023.
-
Radiative Transitions in Charmonium from Lattice QCD
Authors:
James Delaney,
Christopher E. Thomas,
Sinéad M. Ryan
Abstract:
The coupling of various charmonium mesons to a photon is studied using lattice QCD, giving access to radiative form factors and transitions, and probing the mesons' structure. Methods are developed which allow the robust determination of amplitudes, including those involving an excited state as well as multiple form factors, for a range of kinematics. These are applied in dynamical lattice QCD cal…
▽ More
The coupling of various charmonium mesons to a photon is studied using lattice QCD, giving access to radiative form factors and transitions, and probing the mesons' structure. Methods are developed which allow the robust determination of amplitudes, including those involving an excited state as well as multiple form factors, for a range of kinematics. These are applied in dynamical lattice QCD calculations using the distillation technique to compute the underlying three-point correlation functions. Form factors and amplitudes involving the low-lying charmonia, $η_c$, $J/ψ$, $χ_{c0}$ and $η_c'$, are calculated, demonstrating the methods and providing the first dynamical lattice QCD results for some quantities.
△ Less
Submitted 24 May, 2024; v1 submitted 19 January, 2023;
originally announced January 2023.
-
Phase Transitions in Particle Physics -- Results and Perspectives from Lattice Quantum Chromo-Dynamics
Authors:
Gert Aarts,
Joerg Aichelin,
Chris Allton,
Andreas Athenodorou,
Dimitrios Bachtis,
Claudio Bonanno,
Nora Brambilla,
Elena Bratkovskaya,
Mattia Bruno,
Michele Caselle,
Costanza Conti,
Roberto Contino,
Leonardo Cosmai,
Francesca Cuteri,
Luigi Del Debbio,
Massimo D'Elia,
Petros Dimopoulos,
Francesco Di Renzo,
Tetyana Galatyuk,
Jana N. Guenther,
Rachel Houtz,
Frithjof Karsch,
Andrey Yu. Kotov,
Maria Paola Lombardo,
Biagio Lucini
, et al. (16 additional authors not shown)
Abstract:
Phase transitions in a non-perturbative regime can be studied by ab initio Lattice Field Theory methods. The status and future research directions for LFT investigations of Quantum Chromo-Dynamics under extreme conditions are reviewed, including properties of hadrons and of the hypothesized QCD axion as inferred from QCD topology in different phases. We discuss phase transitions in strong interact…
▽ More
Phase transitions in a non-perturbative regime can be studied by ab initio Lattice Field Theory methods. The status and future research directions for LFT investigations of Quantum Chromo-Dynamics under extreme conditions are reviewed, including properties of hadrons and of the hypothesized QCD axion as inferred from QCD topology in different phases. We discuss phase transitions in strong interactions in an extended parameter space, and the possibility of model building for Dark Matter and Electro-Weak Symmetry Breaking. Methodological challenges are addressed as well, including new developments in Artificial Intelligence geared towards the identification of different phases and transitions.
△ Less
Submitted 11 July, 2023; v1 submitted 11 January, 2023;
originally announced January 2023.
-
Hadrons at high temperature: an update from the FASTSUM collaboration
Authors:
Jon-Ivar Skullerud,
Gert Aarts,
Chris Allton,
M. Naeem Anwar,
Ryan Bignell,
Tim Burns,
Sergio Chaves García-Mascaraque,
Simon Hands,
Rachel Horohan D'Arcy,
Benjamin Jäger,
Seyong Kim,
Maria Paola Lombardo,
Eoghan Murphy,
Sam Offler,
Ben Page,
Sinéad M. Ryan,
Thomas Spriggs,
Dawid Stasiak,
Felix P. G. Ziegler
Abstract:
We present the most recent results from the FASTSUM collaboration for hadron properties at high temperature. This includes the temperature dependence of the light and charmed meson and baryon spectrum, as well as properties of heavy quarkonia. The results are obtained using anisotropic lattices with a fixed scale approach. We also present the status of our next generation gauge ensembles.
We present the most recent results from the FASTSUM collaboration for hadron properties at high temperature. This includes the temperature dependence of the light and charmed meson and baryon spectrum, as well as properties of heavy quarkonia. The results are obtained using anisotropic lattices with a fixed scale approach. We also present the status of our next generation gauge ensembles.
△ Less
Submitted 24 November, 2022;
originally announced November 2022.
-
Open charm mesons at nonzero temperature: results in the hadronic phase from lattice QCD
Authors:
Gert Aarts,
Chris Allton,
Ryan Bignell,
Timothy J. Burns,
Sergio Chaves García-Mascaraque,
Simon Hands,
Benjamin Jäger,
Seyong Kim,
Sinéad M. Ryan,
Jon-Ivar Skullerud
Abstract:
We study what happens to D and D_s mesons as the temperature increases, using lattice QCD simulations with N_f=2+1 dynamical flavours on anistropic lattices. We have access to five temperatures in the hadronic phase. Using the determined groundstate mass at the lowest temperature, we investigate the effect of rising temperature by analysing ratios of mesonic correlators, without the need for furth…
▽ More
We study what happens to D and D_s mesons as the temperature increases, using lattice QCD simulations with N_f=2+1 dynamical flavours on anistropic lattices. We have access to five temperatures in the hadronic phase. Using the determined groundstate mass at the lowest temperature, we investigate the effect of rising temperature by analysing ratios of mesonic correlators, without the need for further fitting or spectral reconstruction. In the pseudoscalar and vector channels, we demonstrate that temperature effects are at the percent level and can be captured by a reduction of the groundstate mass as the thermal crossover is approached. In the axial-vector and scalar channels on the other hand, temperature effects are prominent throughout the hadronic phase.
△ Less
Submitted 29 September, 2022;
originally announced September 2022.
-
Effect of alloying on the microstructure, phase stability, hardness and partitioning behavior of a new dual-superlattice nickel-based superalloy
Authors:
C. Rodenkirchen,
A. K. Ackerman,
P. M. Mignanelli,
A. Cliff,
G. J. Wise,
J. O. Douglas,
P. A. J. Bagot,
M. P. Moody,
M. Appleton,
M. P. Ryan,
M. C. Hardy,
S. Pedrazzini,
H. J. Stone
Abstract:
A novel y-y'-y" dual-superlattice superalloy, with promising mechanical properties up to elevated temperatures was recently reported. The present work employs state of the art chemical and spatial characterization techniques to study the effect systematic additions of Mo, W and Fe and variations in Nb and Al contents have on the phase fraction, thermal stability, elemental partitioning and mechani…
▽ More
A novel y-y'-y" dual-superlattice superalloy, with promising mechanical properties up to elevated temperatures was recently reported. The present work employs state of the art chemical and spatial characterization techniques to study the effect systematic additions of Mo, W and Fe and variations in Nb and Al contents have on the phase fraction, thermal stability, elemental partitioning and mechanical properties. Alloys were produced through arc melting followed by heat treatment. Multi-scale characterization techniques and hardness testing were employed to characterize their microstructure, thermal stability and mechanical properties. Alterations in such properties or in elemental partitioning behaviour were then explained through thermodynamic modelling.
A modest addition of 1.8 at.% Mo had a strong effect on the microstructure and thermal stability: it minimized microstructural coarsening during heat treatments while not significantly decreasing the y' solvus temperature. A reduction of Nb by 0.6 at.%, strongly reduced the y" volume fraction, without affecting the y' volume fraction. The reduced precipitate fraction led to a significant reduction in alloy hardness. Fe, added to achieve better processability and reduced material cost, decreased the y' solvus temperature and caused rapid microstructural coarsening during heat treatments, without affecting alloy hardness. A reduction of Al by 0.4 at.%, reduced the y' volume fraction and the y' solvus temperature, also without affecting alloy hardness. The addition of 0.9 at.% W decreased the y' solvus temperature but increased both precipitate volume fractions. These data will be invaluable to optimize current alloy design and to inform future alloy design efforts.
△ Less
Submitted 19 September, 2022;
originally announced September 2022.
-
Soliton cellular automata for the affine general linear Lie superalgebra
Authors:
Mitchell Ryan,
Benjamin Solomon
Abstract:
The box-ball system (BBS) is a cellular automaton that is an ultradiscrete analogue of the Korteweg--de Vries equation, a non-linear PDE used to model water waves. In 2001, Hikami and Inoue generalised the BBS to the general linear Lie superalgebra $\mathfrak{gl}(m|n)$. We further generalise the Hikami--Inoue BBS to column tableaux using the Kirillov--Reshetikhin crystals for…
▽ More
The box-ball system (BBS) is a cellular automaton that is an ultradiscrete analogue of the Korteweg--de Vries equation, a non-linear PDE used to model water waves. In 2001, Hikami and Inoue generalised the BBS to the general linear Lie superalgebra $\mathfrak{gl}(m|n)$. We further generalise the Hikami--Inoue BBS to column tableaux using the Kirillov--Reshetikhin crystals for $\hat{\mathfrak{gl}}{(m|n)}$ devised by Kwon and Okado (arXiv:1804.05456), where we find similar solitonic behaviour under certain conditions.
△ Less
Submitted 1 September, 2023; v1 submitted 19 September, 2022;
originally announced September 2022.
-
A Lower Bound on the Mass of Compact Objects from Dissipative Dark Matter
Authors:
James Gurian,
Michael Ryan,
Sarah Schon,
Donghui Jeong,
Sarah Shandera
Abstract:
We study the minimum mass of dark compact objects formed in dissipative dark-matter halos and show that the simple atomic-dark-matter model consistent with all current observations can create low-mass fragments that can evolve into compact objects forbidden by stellar astrophysics. We model the collapse of the dark halo's dense core by tracing the thermo-chemical evolution of a uniform-density vol…
▽ More
We study the minimum mass of dark compact objects formed in dissipative dark-matter halos and show that the simple atomic-dark-matter model consistent with all current observations can create low-mass fragments that can evolve into compact objects forbidden by stellar astrophysics. We model the collapse of the dark halo's dense core by tracing the thermo-chemical evolution of a uniform-density volume element under two extreme assumptions for density evolution: hydrostatic equilibrium and pressure-free collapse. We then compute the opacity-limited minimum fragment mass from the minimum temperature achieved in these calculations.
△ Less
Submitted 17 May, 2023; v1 submitted 31 August, 2022;
originally announced September 2022.
-
Outcome Adaptive Propensity Score Methods for Handling Censoring and High-Dimensionality: Application to Insurance Claims
Authors:
Youfei Yu,
Jiacong Du,
Min Zhang,
Zhenke Wu,
Andrew M. Ryan,
Bhramar Mukherjee
Abstract:
Propensity scores are commonly used to reduce the confounding bias in non-randomized observational studies for estimating the average treatment effect. An important assumption underlying this approach is that all confounders that are associated with both the treatment and the outcome of interest are measured and included in the propensity score model. In the absence of strong prior knowledge about…
▽ More
Propensity scores are commonly used to reduce the confounding bias in non-randomized observational studies for estimating the average treatment effect. An important assumption underlying this approach is that all confounders that are associated with both the treatment and the outcome of interest are measured and included in the propensity score model. In the absence of strong prior knowledge about potential confounders, researchers may agnostically want to adjust for a high-dimensional set of pre-treatment variables. As such, variable selection procedure is needed for propensity score estimation. In addition, recent studies show that including variables related to treatment only in the propensity score model may inflate the variance of the treatment effect estimates, while including variables that are predictive of only the outcome can improve efficiency. In this paper, we propose a flexible approach to incorporating outcome-covariate relationship in the propensity score model by including the predicted binary outcome probability (OP) as a covariate. Our approach can be easily adapted to an ensemble of variable selection methods, including regularization methods and modern machine learning tools based on classification and regression trees. We evaluate our method to estimate the treatment effects on a binary outcome, which is possibly censored, among multiple treatment groups. Simulation studies indicate that incorporating OP for estimating the propensity scores can improve statistical efficiency and protect against model misspecification. The proposed methods are applied to a cohort of advanced stage prostate cancer patients identified from a private insurance claims database for comparing the adverse effects of four commonly used drugs for treating castration-resistant prostate cancer.
△ Less
Submitted 29 July, 2022;
originally announced August 2022.
-
Characterization of Nb films for superconducting qubits using phase boundary measurements
Authors:
Kevin M. Ryan,
Carlos G. Torres-Castanedo,
Dominic P. Goronzy,
David A. Garcia Wetter,
Matthew J Reagor,
Mark Field,
Cameron J Kopas,
Jayss Marshall,
Michael J. Bedzyk,
Mark C. Hersam,
Venkat Chandrasekhar
Abstract:
Continued advances in superconducting qubit performance require more detailed understandings of the many sources of decoherence. Within these devices, two-level systems arise due to defects, interfaces, and grain boundaries, and are thought to be a major source of qubit decoherence at millikelvin temperatures. In addition to Al, Nb is a commonly used metalization layer for superconducting qubits.…
▽ More
Continued advances in superconducting qubit performance require more detailed understandings of the many sources of decoherence. Within these devices, two-level systems arise due to defects, interfaces, and grain boundaries, and are thought to be a major source of qubit decoherence at millikelvin temperatures. In addition to Al, Nb is a commonly used metalization layer for superconducting qubits. Consequently, a significant effort is required to develop and qualify processes that mitigate defects in Nb films. As the fabrication of complete superconducting qubits and their characterization at millikelvin temperatures is a time and resource intensive process, it is desirable to have measurement tools that can rapidly characterize the properties of films and evaluate different treatments. Here we show that measurements of the variation of the superconducting critical temperature $T_c$ with an applied external magnetic field $H$ (of the phase boundary $T_c - H$) performed with very high resolution show features that are directly correlated with the structure of the Nb films. In combination with x-ray diffraction measurements, we show that one can even distinguish variations quality and crystal orientation of the grains in a Nb film by small but reproducible changes in the measured superconducting phase boundary.
△ Less
Submitted 8 August, 2022; v1 submitted 26 July, 2022;
originally announced July 2022.
-
Global existence for reaction-diffusion systems on multiple domains
Authors:
William E. Fitzgibbon,
Jeff Morgan,
Joh Maurice-Car Ryan
Abstract:
We study the global existence of solutions reaction-diffusion systems with control of mass on multiple domains. Some of these domains overlap, and as a result, an unknown defined on one subdomain can impact another unknown defined on a different domain that intersects with the first. Our results extend those in \cite{fmty}.
We study the global existence of solutions reaction-diffusion systems with control of mass on multiple domains. Some of these domains overlap, and as a result, an unknown defined on one subdomain can impact another unknown defined on a different domain that intersects with the first. Our results extend those in \cite{fmty}.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
-
Exploring Web3 From the View of Blockchain
Authors:
Qin Wang,
Rujia Li,
Qi Wang,
Shi** Chen,
Mark Ryan,
Thomas Hardjono
Abstract:
Web3 is the most hyped concept from 2020 to date, greatly motivating the prosperity of the Internet of Value and Metaverse. However, no solid evidence stipulates the exact definition, criterion, or standard in the sense of such a buzzword. To fill the gap, we aim to clarify the term in this work. We narrow down the connotation of Web3 by separating it from high-level controversy argues and, instea…
▽ More
Web3 is the most hyped concept from 2020 to date, greatly motivating the prosperity of the Internet of Value and Metaverse. However, no solid evidence stipulates the exact definition, criterion, or standard in the sense of such a buzzword. To fill the gap, we aim to clarify the term in this work. We narrow down the connotation of Web3 by separating it from high-level controversy argues and, instead, focusing on its protocol, architecture, and evaluation from the perspective of blockchain fields. Specifically, we have identified all potential architectural design types and evaluated each of them by employing the scenario-based architecture evaluation method. The evaluation shows that existing applications are neither secure nor adoptable as claimed. Meanwhile, we also discuss opportunities and challenges surrounding the Web3 space and answer several prevailing questions from communities. A primary result is that Web3 still relies on traditional internet infrastructure, not as independent as advocated. This report, as of June 2022, provides the first strict research on Web3 in the view of blockchain. We hope that this work would provide a guide for the development of future Web3 services.
△ Less
Submitted 17 June, 2022;
originally announced June 2022.
-
Social-ecological feedbacks drive tip** points in farming system diversification
Authors:
Melissa Chapman,
Serge Wiltshire,
Patrick Baur,
Timothy Bowles,
Liz Carlisle,
Federico Castillo,
Kenzo Esquivel,
Sasha Gennet,
Alastair Iles,
Daniel Karp,
Claire Kremen,
Jeffrey Liebert,
Elissa M. Olimpi,
Joanna Ory,
Matthew Ryan,
Amber Sciligo,
Jennifer Thompson,
Hannah Waterhouse,
Carl Boettiger
Abstract:
The emergence and impact of tip** points have garnered significant interest in both the social and natural sciences. Despite widespread recognition of the importance of feedbacks between human and natural systems, it is often assumed that the observed nonlinear dynamics in these coupled systems rests within either underlying human or natural processes, rather than the rates at which they interac…
▽ More
The emergence and impact of tip** points have garnered significant interest in both the social and natural sciences. Despite widespread recognition of the importance of feedbacks between human and natural systems, it is often assumed that the observed nonlinear dynamics in these coupled systems rests within either underlying human or natural processes, rather than the rates at which they interact. Using adoption of agricultural diversification practices as a case study, we show how two stable management paradigms (one dominated by conventional, homogeneous practices, the other by diversified practices) can emerge purely from temporal feedbacks between human decisions and ecological responses. We explore how this temporal mechanism of tip** points provides insight into designing more effective interventions that promote farmers transitions towards sustainable agriculture. Moreover, our flexible modeling framework could be applied to other cases to provide insight into numerous questions in social-ecological systems research and environmental policy.
△ Less
Submitted 30 March, 2022;
originally announced May 2022.
-
Single Image Internal Distribution Measurement Using Non-Local Variational Autoencoder
Authors:
Yeahia Sarker,
Abdullah-Al-Zubaer Imran,
Md Hafiz Ahamed,
Ripon K. Chakrabortty,
Michael J. Ryan,
Sajal K. Das
Abstract:
Deep learning-based super-resolution methods have shown great promise, especially for single image super-resolution (SISR) tasks. Despite the performance gain, these methods are limited due to their reliance on copious data for model training. In addition, supervised SISR solutions rely on local neighbourhood information focusing only on the feature learning processes for the reconstruction of low…
▽ More
Deep learning-based super-resolution methods have shown great promise, especially for single image super-resolution (SISR) tasks. Despite the performance gain, these methods are limited due to their reliance on copious data for model training. In addition, supervised SISR solutions rely on local neighbourhood information focusing only on the feature learning processes for the reconstruction of low-dimensional images. Moreover, they fail to capitalize on global context due to their constrained receptive field. To combat these challenges, this paper proposes a novel image-specific solution, namely non-local variational autoencoder (\texttt{NLVAE}), to reconstruct a high-resolution (HR) image from a single low-resolution (LR) image without the need for any prior training. To harvest maximum details for various receptive regions and high-quality synthetic images, \texttt{NLVAE} is introduced as a self-supervised strategy that reconstructs high-resolution images using disentangled information from the non-local neighbourhood. Experimental results from seven benchmark datasets demonstrate the effectiveness of the \texttt{NLVAE} model. Moreover, our proposed model outperforms a number of baseline and state-of-the-art methods as confirmed through extensive qualitative and quantitative evaluations.
△ Less
Submitted 2 April, 2022;
originally announced April 2022.
-
Bayesian outcome selection modelling
Authors:
Khue-Dung Dang,
Louise M. Ryan,
Richard J. Cook,
Tugba Akkaya-Hocagil,
Sandra W. Jacobson,
Joseph L. Jacobson
Abstract:
Psychiatric and social epidemiology often involves assessing the effects of environmental exposure on outcomes that are difficult to measure directly. To address this problem, it is common to measure outcomes using a comprehensive battery of different tests thought to be related to a common, underlying construct of interest. In the application that motivates our work, for example, researchers want…
▽ More
Psychiatric and social epidemiology often involves assessing the effects of environmental exposure on outcomes that are difficult to measure directly. To address this problem, it is common to measure outcomes using a comprehensive battery of different tests thought to be related to a common, underlying construct of interest. In the application that motivates our work, for example, researchers wanted to assess the impact of in utero alcohol exposure on child cognition and neuropsychological development, which were evaluated using a range of different tests. Statistical analysis of the resulting multiple outcomes data can be challenging, not only because of the need to account for the correlation between outcomes measured on the same individual, but because it is often unclear, a priori, which outcomes are impacted by the exposure under study. While researchers will generally have some hypotheses about which outcomes are important, a framework is needed to help identify outcomes that are sensitive to the exposure and to quantify the associated treatment or exposure effects of interest. We propose such a framework using a modification of stochastic search variable selection (SSVS), a popular Bayesian variable selection model and use it to quantify an overall effect of the exposure on the affected outcomes. We investigate the performance of the method via simulation and illustrate its application to data from a study involving the effects of prenatal alcohol exposure on child cognition.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
SoK: TEE-assisted Confidential Smart Contract
Authors:
Rujia Li,
Qin Wang,
Qi Wang,
David Galindo,
Mark Ryan
Abstract:
The blockchain-based smart contract lacks privacy since the contract state and instruction code are exposed to the public. Combining smart-contract execution with Trusted Execution Environments (TEEs) provides an efficient solution, called TEE-assisted smart contracts, for protecting the confidentiality of contract states. However, the combination approaches are varied, and a systematic study is a…
▽ More
The blockchain-based smart contract lacks privacy since the contract state and instruction code are exposed to the public. Combining smart-contract execution with Trusted Execution Environments (TEEs) provides an efficient solution, called TEE-assisted smart contracts, for protecting the confidentiality of contract states. However, the combination approaches are varied, and a systematic study is absent. Newly released systems may fail to draw upon the experience learned from existing protocols, such as repeating known design mistakes or applying TEE technology in insecure ways. In this paper, we first investigate and categorize the existing systems into two types: the layer-one solution and layer-two solution. Then, we establish an analysis framework to capture their common lights, covering the desired properties (for contract services), threat models, and security considerations (for underlying systems). Based on our taxonomy, we identify their ideal functionalities and uncover the fundamental flaws and reasons for the challenges in each specification design. We believe that this work would provide a guide for the development of TEE-assisted smart contracts, as well as a framework to evaluate future TEE-assisted confidential contract systems.
△ Less
Submitted 19 April, 2022; v1 submitted 16 March, 2022;
originally announced March 2022.
-
Hadron Spectroscopy with Lattice QCD
Authors:
John Bulava,
Raúl Briceño,
William Detmold,
Michael Döring,
Robert G. Edwards,
Anthony Francis,
Francesco Knechtli,
Randy Lewis,
Sasa Prelovsek,
Sinéad M. Ryan,
Akaki Rusetsky,
Stephen R. Sharpe,
Adam Szczepaniak,
Christopher E. Thomas,
Michael L. Wagman,
Marc Wagner
Abstract:
The status and prospects for investigations of exotic and conventional hadrons with lattice QCD are discussed. The majority of hadrons decay strongly via one or multiple decay-channels, including most of the experimentally discovered exotic hadrons. Despite this difficult challenge, the properties of several hadronic resonances have been determined within lattice QCD. To further discern the spectr…
▽ More
The status and prospects for investigations of exotic and conventional hadrons with lattice QCD are discussed. The majority of hadrons decay strongly via one or multiple decay-channels, including most of the experimentally discovered exotic hadrons. Despite this difficult challenge, the properties of several hadronic resonances have been determined within lattice QCD. To further discern the spectroscopic properties of various hadrons and to help resolve their nature we present our suggestions for future analytic and lattice studies.
△ Less
Submitted 15 March, 2022; v1 submitted 7 March, 2022;
originally announced March 2022.
-
The effect of hydrogen on the multiscale mechanical behaviour of a La(Fe,Mn,Si)13-based magnetocaloric material
Authors:
Siyang Wang,
Oriol Gavalda-Diaz,
Ting Luo,
Liya Guo,
Edmund Lovell,
Neil Wilson,
Baptiste Gault,
Mary P. Ryan,
Finn Giuliani
Abstract:
Magnetocaloric cooling offers the potential to improve the efficiency of refrigeration devices and hence cut the significant CO2 emissions associated with cooling processes. A critical issue in deployment of this technology is the mechanical degradation of the magnetocaloric material during processing and operation, leading to limited service-life. The mechanical properties of hydrogenated La(Fe,M…
▽ More
Magnetocaloric cooling offers the potential to improve the efficiency of refrigeration devices and hence cut the significant CO2 emissions associated with cooling processes. A critical issue in deployment of this technology is the mechanical degradation of the magnetocaloric material during processing and operation, leading to limited service-life. The mechanical properties of hydrogenated La(Fe,Mn,Si)13-based magnetocaloric material are studied using macroscale bending tests of polycrystalline specimens and in situ micropillar compression tests of single crystal specimens. The impact of hydrogenation on the mechanical properties are quantified. Understanding of the deformation/failure mechanisms is aided by characterization with transmission electron microscopy and atom probe tomography to reveal the arrangement of hydrogen atoms in the crystal lattice. Results indicate that the intrinsic strength of this material is ~3-6 GPa and is dependent on the crystal orientation. Single crystals under compressive load exhibit shearing along specific crystallographic planes. Hydrogen deteriorates the strength of La(Fe,Mn,Si)13 through promotion of transgranular fracture. The weakening effect of hydrogen on single crystals is anisotropic; it is significant upon shearing parallel to the {111} crystallographic planes but is negligible when the shear plane is {001}-oriented. APT analysis suggests that this is associated with the close arrangement of hydrogen atoms on {222} planes.
△ Less
Submitted 18 February, 2022;
originally announced February 2022.
-
Multivariate distance matrix regression for a manifold-valued response variable
Authors:
Matt Ryan,
Gary Glonek,
Melissa Humphries,
Jono Tuke
Abstract:
In this paper, we propose the use of geodesic distances in conjunction with multivariate distance matrix regression, called geometric-MDMR, as a powerful first step analysis method for manifold-valued data. Manifold-valued data is appearing more frequently in the literature from analyses of earthquake to analysing brain patterns. Accounting for the structure of this data increases the complexity o…
▽ More
In this paper, we propose the use of geodesic distances in conjunction with multivariate distance matrix regression, called geometric-MDMR, as a powerful first step analysis method for manifold-valued data. Manifold-valued data is appearing more frequently in the literature from analyses of earthquake to analysing brain patterns. Accounting for the structure of this data increases the complexity of your analysis, but allows for much more interpretable results in terms of the data. To test geometric-MDMR, we develop a method to simulate functional connectivity matrices for fMRI data to perform a simulation study, which shows that our method outperforms the current standards in fMRI analysis.
△ Less
Submitted 10 February, 2022;
originally announced February 2022.
-
Exotic Compact Objects: The Dark White Dwarf
Authors:
Michael Ryan,
David Radice
Abstract:
Several dark matter models allow for the intriguing possibility of exotic compact object formation. These objects might have unique characteristics that set them apart from their baryonic counterparts. Furthermore, gravitational wave observations of their mergers may provide the only direct window on a potentially entirely hidden sector. Here we discuss dark white dwarfs, starting with an overview…
▽ More
Several dark matter models allow for the intriguing possibility of exotic compact object formation. These objects might have unique characteristics that set them apart from their baryonic counterparts. Furthermore, gravitational wave observations of their mergers may provide the only direct window on a potentially entirely hidden sector. Here we discuss dark white dwarfs, starting with an overview of the microphysical model and analytic scaling relations of macroscopic properties derived from the non-relativistic limit. We use the full relativistic formalism to confirm these scaling relations and demonstrate that dark white dwarfs, if they exist, would have masses and tidal deformabilities that are very different from those of baryonic compact objects. Further, and most importantly, we demonstrate that dark white dwarf mergers would be detectable by current or planned gravitational observatories across several orders of magnitude in the particle-mass parameter space. Lastly, we find universal relations analogous to the compactness-Love and binary Love relations in neutron star literature. Using these results, we show that gravitational wave observations would constrain the properties of the dark matter particles constituting these objects.
△ Less
Submitted 27 June, 2022; v1 submitted 14 January, 2022;
originally announced January 2022.
-
Environment-assisted crack nucleation in La(Fe,Mn,Si)13-based magnetocaloric materials
Authors:
Siyang Wang,
Edmund Lovell,
Liya Guo,
Neil Wilson,
Mary P. Ryan,
Finn Giuliani
Abstract:
Cracking in La(Fe,Si)13-based magnetocaloric materials has been observed to predominantly form around La-rich (La2O3) particles and pose a threat to their long-term structural integrity. To understand the formation of these cracks, FIB cross-sectional polishing followed by SEM characterisation was employed to study local microstructural evolution after air exposure. Results suggest that volume exp…
▽ More
Cracking in La(Fe,Si)13-based magnetocaloric materials has been observed to predominantly form around La-rich (La2O3) particles and pose a threat to their long-term structural integrity. To understand the formation of these cracks, FIB cross-sectional polishing followed by SEM characterisation was employed to study local microstructural evolution after air exposure. Results suggest that volume expansion and internal degradation associated with a chemical reaction between La2O3 particles and water/moisture can lead to crack nucleation in the 1:13 phase adjacent to La-rich particles. This observation indicates that the formation of La-rich phase should be suppressed, or their size minimised during material processing to ensure the long-term structural integrity of La(Fe,Mn,Si)13 magnetocaloric materials.
△ Less
Submitted 16 December, 2021;
originally announced December 2021.
-
A comparison of spectral reconstruction methods applied to non-zero temperature NRQCD meson correlation functions
Authors:
Thomas Spriggs,
Gert Aarts,
Chris Allton,
Timothy Burns,
Rachel Horohan D'Arcy,
Benjamin Jäger,
Seyong Kim,
Maria-Paola Lombardo,
Sam Offler,
Ben Page,
Sinead M. Ryan,
Jon-Ivar Skullerud
Abstract:
We present results from the fastsum collaboration's programme to determine the spectrum of the bottomonium system as a function of temperature. Three different methods of extracting spectral information are discussed: a Maximum Likelihood approach using a Gaussian spectral function for the ground state, the Backus Gilbert method, and the Kernel Ridge Regression machine learning procedure. We emplo…
▽ More
We present results from the fastsum collaboration's programme to determine the spectrum of the bottomonium system as a function of temperature. Three different methods of extracting spectral information are discussed: a Maximum Likelihood approach using a Gaussian spectral function for the ground state, the Backus Gilbert method, and the Kernel Ridge Regression machine learning procedure. We employ the fastsum anisotropic lattices with 2+1 dynamical quark flavours, with temperatures ranging from 47 to 375 MeV.
△ Less
Submitted 8 December, 2021;
originally announced December 2021.
-
Reconstruction of bottomonium spectral functions in thermal QCD using Kernel Ridge Regression
Authors:
Sam Offler,
Gert Aarts,
Chris Allton,
Benjamin Jäger,
Seyong Kim,
Maria-Paola Lombardo,
Benjamin Page,
Sinead M. Ryan,
Jon-Ivar Skullerud,
Thomas Spriggs
Abstract:
We discuss results for bottomonium at nonzero temperature obtained using NRQCD on Fastsum Generation 2L ensembles, as part of the Fastsum collaboration's programme to determine the spectrum of the bottomonium system as a function of temperature using a variety of approaches. Here we give an update on results for spectral functions obtained using Kernel Ridge Regression. We pay in particular attent…
▽ More
We discuss results for bottomonium at nonzero temperature obtained using NRQCD on Fastsum Generation 2L ensembles, as part of the Fastsum collaboration's programme to determine the spectrum of the bottomonium system as a function of temperature using a variety of approaches. Here we give an update on results for spectral functions obtained using Kernel Ridge Regression. We pay in particular attention to the generation of training data and introduce the notion of using lattice QCD ensembles to learn how to improve the generation of training data. A practical implementation is given.
△ Less
Submitted 3 December, 2021;
originally announced December 2021.
-
Spectral reconstruction in NRQCD via the Backus-Gilbert method
Authors:
Benjamin Page,
Gert Aarts,
Chris Allton,
Benjamin Jäger,
Seyong Kim,
Maria Paola Lombardo,
Sam Offler,
Sinead M. Ryan,
Jon-Ivar Skullerud,
Thomas Spriggs
Abstract:
We present progress results from the FASTSUM collaboration's programme to determine the spectrum of the bottomonium system as a function of temperature using a variety of approaches. In this contribution, the Backus Gilbert method is used to reconstruct spectral functions from NRQCD meson correlator data from FASTSUM's anisotropic ensembles at nonzero temperature. We focus in particular on the res…
▽ More
We present progress results from the FASTSUM collaboration's programme to determine the spectrum of the bottomonium system as a function of temperature using a variety of approaches. In this contribution, the Backus Gilbert method is used to reconstruct spectral functions from NRQCD meson correlator data from FASTSUM's anisotropic ensembles at nonzero temperature. We focus in particular on the resolving power of the method, providing a demonstration of how the underlying resolution functions can be probed by exploiting the Laplacian nature of the NRQCD kernel. We conclude with estimates of the bottomonium ground state mass and widths at nonzero temperature.
△ Less
Submitted 21 December, 2021; v1 submitted 3 December, 2021;
originally announced December 2021.
-
Bottomonium spectral widths at nonzero temperature using maximum likelihood
Authors:
Thomas Spriggs,
Gert Aarts,
Chris Allton,
Timothy Burns,
Benjamin Jäger,
Seyong Kim,
Maria Paola Lombardo,
Sam Offler,
Ben Page,
Sinéad M. Ryan,
Jon-Ivar Skullerud
Abstract:
We present progress results from the Fastsum collaboration's programme to determine the spectrum of the bottomonium system as a function of temperature using a variety of approaches. In these proceedings, the Maximum Likelihood approach is used with an Ansatz comprising of a Gaussian spectral function for the ground state. Fastsum anisotropic lattices with 2+1 dynamical quark flavours were used wi…
▽ More
We present progress results from the Fastsum collaboration's programme to determine the spectrum of the bottomonium system as a function of temperature using a variety of approaches. In these proceedings, the Maximum Likelihood approach is used with an Ansatz comprising of a Gaussian spectral function for the ground state. Fastsum anisotropic lattices with 2+1 dynamical quark flavours were used with temperatures ranging from 47 to 375 MeV.
△ Less
Submitted 15 December, 2021; v1 submitted 2 December, 2021;
originally announced December 2021.
-
Lattice QCD at nonzero temperature and density
Authors:
G. Aarts,
C. Allton,
S. Hands,
B. Jäger,
S. Kim,
M. P. Lombardo,
A. A. Nikolaev,
S. M. Ryan,
J. -I. Skullerud
Abstract:
We discuss some selected recent developments in the field of lattice QCD at nonzero temperature and density, describing in particular the transition from the hadronic gas to the quark-gluon plasma, as seen in simulations using Wilson fermions.
We discuss some selected recent developments in the field of lattice QCD at nonzero temperature and density, describing in particular the transition from the hadronic gas to the quark-gluon plasma, as seen in simulations using Wilson fermions.
△ Less
Submitted 21 November, 2021;
originally announced November 2021.
-
Molecular Chemistry for Dark Matter III: DarkKROME
Authors:
Michael Ryan,
Sarah Shandera,
James Gurian,
Donghui Jeong
Abstract:
Dark matter that is dissipative may cool sufficiently to form compact objects, including black holes. Determining the abundance and mass spectrum of those objects requires an accurate model of the chemistry relevant for the cooling of the dark matter gas. Here we introduce a chemistry tool for dark matter, DarkKROME, an extension of the KROME software package. DarkKROME is designed to include all…
▽ More
Dark matter that is dissipative may cool sufficiently to form compact objects, including black holes. Determining the abundance and mass spectrum of those objects requires an accurate model of the chemistry relevant for the cooling of the dark matter gas. Here we introduce a chemistry tool for dark matter, DarkKROME, an extension of the KROME software package. DarkKROME is designed to include all atomic and molecular processes relevant for dark matter with two unequal-mass fundamental fermions, interacting via a massless-photon mediated $U(1)$ force. We use DarkKROME to perform one-zone collapse simulations and study the evolution of temperature-density phase diagrams for various dark-sector parameters.
△ Less
Submitted 5 August, 2022; v1 submitted 22 October, 2021;
originally announced October 2021.
-
Molecular Chemistry for Dark Matter II: Recombination, Molecule Formation, and Halo Mass Function in Atomic Dark Matter
Authors:
James Gurian,
Donghui Jeong,
Michael Ryan,
Sarah Shandera
Abstract:
Dissipative dark matter predicts rich observable phenomena that can be tested with future large-scale structure surveys. As a specific example, we study atomic dark matter, consisting of a heavy particle and a light particle charged under a dark electromagnetism. In particular, we calculate the cosmological evolution of atomic dark matter focusing on dark recombination and dark-molecule formation.…
▽ More
Dissipative dark matter predicts rich observable phenomena that can be tested with future large-scale structure surveys. As a specific example, we study atomic dark matter, consisting of a heavy particle and a light particle charged under a dark electromagnetism. In particular, we calculate the cosmological evolution of atomic dark matter focusing on dark recombination and dark-molecule formation. We have obtained the relevant interaction-rate coefficients by re-scaling the rates for normal hydrogen, and evolved the abundances for ionized, atomic, and molecular states using a modified version of Recfast++ (which we have released publicly at https://github.com/jamesgurian/RecfastJulia). We also provide an analytical approximation for the final abundances. We then calculate the effects of the atomic dark matter on the linear power spectrum, which enter through a dark-photon diffusion and dark acoustic oscillations. At the formation time, the atomic dark matter model suppresses halo abundances on scales smaller than the diffusion scale, just like the warm dark matter models suppress the abundance below the free-streaming scale. The subsequent evolution with radiative cooling, however, will alter the halo mass function further.
△ Less
Submitted 6 August, 2022; v1 submitted 22 October, 2021;
originally announced October 2021.
-
First Results from the REAL-time Transient Acquisition backend (REALTA) at the Irish LOFAR station
Authors:
P. C. Murphy,
P. Callanan,
J. McCauley,
D. J. McKenna,
D. Ó Fionnagáin,
C. K. Louis,
M. P. Redman,
L. A. Cañizares,
E. P. Carley,
S. A. Maloney,
B. Coghlan,
M. Daly,
J. Scully,
J. Dooley,
V. Gajjar,
C. Giese,
A. Brennan,
E. F. Keane,
C. A. Maguire,
J. Quinn,
S. Mooney,
A. M. Ryan,
J. Walsh,
C. M. Jackman,
A. Golden
, et al. (5 additional authors not shown)
Abstract:
Modern radio interferometers such as the LOw Frequency ARray (LOFAR) are capable of producing data at hundreds of gigabits to terabits per second. This high data rate makes the analysis of radio data cumbersome and computationally expensive. While high performance computing facilities exist for large national and international facilities, that may not be the case for instruments operated by a sing…
▽ More
Modern radio interferometers such as the LOw Frequency ARray (LOFAR) are capable of producing data at hundreds of gigabits to terabits per second. This high data rate makes the analysis of radio data cumbersome and computationally expensive. While high performance computing facilities exist for large national and international facilities, that may not be the case for instruments operated by a single institution or a small consortium. Data rates for next generation radio telescopes are set to eclipse those currently in operation, hence local processing of data will become all the more important. Here, we introduce the REAL-time Transient Acquisition backend (REALTA), a computing backend at the Irish LOFAR station (I-LOFAR) which facilitates the recording of data in near real-time and post-processing. We also present first searches and scientific results of a number of radio phenomena observed by I-LOFAR and REALTA, including pulsars, fast radio bursts (FRBs), rotating radio transients (RRATs), the search for extraterrestrial intelligence (SETI), Jupiter, and the Sun.
△ Less
Submitted 25 August, 2021;
originally announced August 2021.
-
Pseudo-Riemannian Lie groups of modified H-type
Authors:
Justin M. Ryan
Abstract:
We define a class of Riemannian and pseudo-Riemannian 2-step nilpotent Lie groups with nondegenerate centers that generalize the H-type groups of Kaplan. Examples are given and geometric properties are investigated.
We define a class of Riemannian and pseudo-Riemannian 2-step nilpotent Lie groups with nondegenerate centers that generalize the H-type groups of Kaplan. Examples are given and geometric properties are investigated.
△ Less
Submitted 3 August, 2021;
originally announced August 2021.
-
Molecular Chemistry for Dark Matter
Authors:
Michael Ryan,
James Gurian,
Sarah Shandera,
Donghui Jeong
Abstract:
Molecular cooling is essential for studying the formation of sub-structure of dissipative dark-matter halos that may host compact objects such as black holes. Here, we analyze the reaction rates relevant for the formation, dissociation, and transition of hydrogenic molecules while allowing for different values of the physical parameters: the coupling constant, the proton mass, and the electron mas…
▽ More
Molecular cooling is essential for studying the formation of sub-structure of dissipative dark-matter halos that may host compact objects such as black holes. Here, we analyze the reaction rates relevant for the formation, dissociation, and transition of hydrogenic molecules while allowing for different values of the physical parameters: the coupling constant, the proton mass, and the electron mass. For all cases, we re-scale the reaction rates for the standard molecular hydrogen, so our results are valid as long as the dark matter is weakly coupled and one of the fermions is much heavier than the other. These results will allow a robust numerical treatment of cosmic structure, in particular for mini-halos for which molecular cooling is important, in a dissipative dark matter scenario.
△ Less
Submitted 5 August, 2022; v1 submitted 24 June, 2021;
originally announced June 2021.
-
Modelling age-related changes in executive functions of soccer players
Authors:
Vincent Chin,
Adam Beavan,
Job Fransen,
Jan Mayer,
Robert Kohn,
Louise M. Ryan,
Scott A. Sisson
Abstract:
The widespread popularity of soccer across the globe has turned it into a multi-billion dollar industry. As a result, most professional clubs actively engage in talent identification and development programmes. Contemporary research has generally supported the use of executive functions - a class of neuropsychological processes responsible for cognitive behaviours - in predicting a soccer player's…
▽ More
The widespread popularity of soccer across the globe has turned it into a multi-billion dollar industry. As a result, most professional clubs actively engage in talent identification and development programmes. Contemporary research has generally supported the use of executive functions - a class of neuropsychological processes responsible for cognitive behaviours - in predicting a soccer player's future success. However, studies on the developmental evolution of executive functions have yielded differing results in their structural form (such as inverted U-shapes, or otherwise). This article presents the first analysis of changes in the domain-generic and domain-specific executive functions based on longitudinal data measured on elite German soccer players. Results obtained from a latent variable model show that these executive functions experience noticeable growth from late childhood until pre-adolescence, but remain fairly stable in later growth stages. As a consequence, our results suggest that the role of executive functions in facilitating talent identification may have been overly emphasised.
△ Less
Submitted 3 May, 2021;
originally announced May 2021.