-
Location-based Radiology Report-Guided Semi-supervised Learning for Prostate Cancer Detection
Authors:
Alex Chen,
Nathan Lay,
Stephanie Harmon,
Kutsev Ozyoruk,
Enis Yilmaz,
Brad J. Wood,
Peter A. Pinto,
Peter L. Choyke,
Baris Turkbey
Abstract:
Prostate cancer is one of the most prevalent malignancies in the world. While deep learning has potential to further improve computer-aided prostate cancer detection on MRI, its efficacy hinges on the exhaustive curation of manually annotated images. We propose a novel methodology of semisupervised learning (SSL) guided by automatically extracted clinical information, specifically the lesion locat…
▽ More
Prostate cancer is one of the most prevalent malignancies in the world. While deep learning has potential to further improve computer-aided prostate cancer detection on MRI, its efficacy hinges on the exhaustive curation of manually annotated images. We propose a novel methodology of semisupervised learning (SSL) guided by automatically extracted clinical information, specifically the lesion locations in radiology reports, allowing for use of unannotated images to reduce the annotation burden. By leveraging lesion locations, we refined pseudo labels, which were then used to train our location-based SSL model. We show that our SSL method can improve prostate lesion detection by utilizing unannotated images, with more substantial impacts being observed when larger proportions of unannotated images are used.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD
Authors:
Pierfrancesco Beneventano,
Andrea Pinto,
Tomaso Poggio
Abstract:
We investigate the ability of deep neural networks to identify the support of the target function. Our findings reveal that mini-batch SGD effectively learns the support in the first layer of the network by shrinking to zero the weights associated with irrelevant components of input. In contrast, we demonstrate that while vanilla GD also approximates the target function, it requires an explicit re…
▽ More
We investigate the ability of deep neural networks to identify the support of the target function. Our findings reveal that mini-batch SGD effectively learns the support in the first layer of the network by shrinking to zero the weights associated with irrelevant components of input. In contrast, we demonstrate that while vanilla GD also approximates the target function, it requires an explicit regularization term to learn the support in the first layer. We prove that this property of mini-batch SGD is due to a second-order implicit regularization effect which is proportional to $η/ b$ (step size / batch size). Our results are not only another proof that implicit regularization has a significant impact on training optimization dynamics but they also shed light on the structure of the features that are learned by the network. Additionally, they suggest that smaller batches enhance feature interpretability and reduce dependency on initialization.
△ Less
Submitted 16 June, 2024;
originally announced June 2024.
-
A Multimodal Learning-based Approach for Autonomous Landing of UAV
Authors:
Francisco Neves,
Luís Branco,
Maria Pereira,
Rafael Claro,
Andry Pinto
Abstract:
In the field of autonomous Unmanned Aerial Vehicles (UAVs) landing, conventional approaches fall short in delivering not only the required precision but also the resilience against environmental disturbances. Yet, learning-based algorithms can offer promising solutions by leveraging their ability to learn the intelligent behaviour from data. On one hand, this paper introduces a novel multimodal tr…
▽ More
In the field of autonomous Unmanned Aerial Vehicles (UAVs) landing, conventional approaches fall short in delivering not only the required precision but also the resilience against environmental disturbances. Yet, learning-based algorithms can offer promising solutions by leveraging their ability to learn the intelligent behaviour from data. On one hand, this paper introduces a novel multimodal transformer-based Deep Learning detector, that can provide reliable positioning for precise autonomous landing. It surpasses standard approaches by addressing individual sensor limitations, achieving high reliability even in diverse weather and sensor failure conditions. It was rigorously validated across varying environments, achieving optimal true positive rates and average precisions of up to 90%. On the other hand, it is proposed a Reinforcement Learning (RL) decision-making model, based on a Deep Q-Network (DQN) rationale. Initially trained in sumlation, its adaptive behaviour is successfully transferred and validated in a real outdoor scenario. Furthermore, this approach demonstrates rapid inference times of approximately 5ms, validating its applicability on edge devices.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
MINCE II. Neutron capture elements
Authors:
P. François,
G. Cescutti,
P. Bonifacio,
E. Caffau,
L. Monaco,
M. Steffen,
J. Puschnig,
F. Calura,
S. Cristallo,
P. Di Marcantonio,
V. Dobrovolskas,
M. Franchini,
A. J. Gallagher,
C. J. Hansen,
A. Korn,
A. Kuvinskas,
R. Lallement,
L. Lombardo,
F. Lucertini,
L. Magrini,
A. M. Matas Pinto,
F. Matteucci,
A. Mucciarelli,
L. Sbordone,
M. Spite
, et al. (2 additional authors not shown)
Abstract:
The MINCE (Measuring at Intermediate metallicity Neutron-Capture Elements) project aims to gather the abundances of neutron-capture elements but also of light elements and iron peak elements in a large sample of giant stars in this metallicity range. T The aim of this work is to study the chemical evolution of galactic sub-components recently identified (i.e. Gaia Sausage Enceladus (GSE), Sequoia)…
▽ More
The MINCE (Measuring at Intermediate metallicity Neutron-Capture Elements) project aims to gather the abundances of neutron-capture elements but also of light elements and iron peak elements in a large sample of giant stars in this metallicity range. T The aim of this work is to study the chemical evolution of galactic sub-components recently identified (i.e. Gaia Sausage Enceladus (GSE), Sequoia). We used high signal-to-noise ratios, high-resolution spectra and standard 1D LTE spectrum synthesis to determine the detailed abundances. We could determine the abundances for up to 10 neutron-capture elements (Sr, Y, Zr, Ba, La, Ce, Pr, Nd, Sm and Eu) in 33 stars. The general trends of abundance ratios [n-capture element/Fe] versus [Fe/H] are in agreement with the results found in the literature. When our sample is divided in sub-groups depending on their kinematics, we found that the run of [Sr/Ba] vs [Ba/H] for the stars belonging to the GSE accretion event shows a tight anti-correlation. The results for the Sequoia stars, although based on a very limited sample, shows a [Sr/Ba] systematically higher than the [Sr/Ba] found in the GSE stars at a given [Ba/H] hinting at a different nucleosynthetic history. Stochastic chemical evolution models have been computed to understand the evolution of the GSE chemical composition of Sr and Ba. The first conclusions are that the GSE chemical evolution is similar to the evolution of a dwarf galaxy with galactic winds and inefficient star formation.
Detailed abundances of neutron-capture elements have been measured in high-resolution, high signal-to-noise spectra of intermediate metal-poor stars, the metallicity range covered by the MINCE project. These abundances have been compared to detailed stochastic models of galactic chemical evolution.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
The PEAL Method: a mathematical framework to streamline securitization structuring
Authors:
Andrea Pinto,
Antonio Scala
Abstract:
Securitization is a financial process where the cash flows of income-generating assets are sold to institutional investors as securities, liquidating illiquid assets. This practice presents persistent challenges due to the absence of a comprehensive mathematical framework for structuring asset-backed securities. While existing literature provides technical analysis of credit risk modeling, there r…
▽ More
Securitization is a financial process where the cash flows of income-generating assets are sold to institutional investors as securities, liquidating illiquid assets. This practice presents persistent challenges due to the absence of a comprehensive mathematical framework for structuring asset-backed securities. While existing literature provides technical analysis of credit risk modeling, there remains a need for a definitive framework detailing the allocation of the inbound cash flows to the outbound positions. To fill this gap, we introduce the PEAL Method: a 10-step mathematical framework to streamline the securitization structuring across all time periods.
The PEAL Method offers a rigorous and versatile approach, allowing practitioners to structure various types of securitizations, including those with complex vertical positions. By employing standardized equations, it facilitates the delineation of payment priorities and enhances risk characterization for both the asset and the liability sides throughout the securitization life cycle.
In addition to its technical contributions, the PEAL Method aims to elevate industry standards by addressing longstanding challenges in securitization. By providing detailed information to investors and enabling transparent risk profile comparisons, it promotes market transparency and enables stronger regulatory oversight.
In summary, the PEAL Method represents a significant advancement in securitization literature, offering a standardized framework for precision and efficiency in structuring transactions. Its adoption has the potential to drive innovation and enhance risk management practices in the securitization market.
△ Less
Submitted 8 April, 2024;
originally announced April 2024.
-
LocCa: Visual Pretraining with Location-aware Captioners
Authors:
Bo Wan,
Michael Tschannen,
Yongqin Xian,
Filip Pavetic,
Ibrahim Alabdulmohsin,
Xiao Wang,
André Susano Pinto,
Andreas Steiner,
Lucas Beyer,
Xiaohua Zhai
Abstract:
Image captioning has been shown as an effective pretraining method similar to contrastive pretraining. However, the incorporation of location-aware information into visual pretraining remains an area with limited research. In this paper, we propose a simple visual pretraining method with location-aware captioners (LocCa). LocCa uses a simple image captioner task interface, to teach a model to read…
▽ More
Image captioning has been shown as an effective pretraining method similar to contrastive pretraining. However, the incorporation of location-aware information into visual pretraining remains an area with limited research. In this paper, we propose a simple visual pretraining method with location-aware captioners (LocCa). LocCa uses a simple image captioner task interface, to teach a model to read out rich information, i.e. bounding box coordinates, and captions, conditioned on the image pixel input. Thanks to the multitask capabilities of an encoder-decoder architecture, we show that an image captioner can easily handle multiple tasks during pretraining. Our experiments demonstrate that LocCa outperforms standard captioners significantly on localization downstream tasks while maintaining comparable performance on holistic tasks.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Learning Hierarchical Control For Multi-Agent Capacity-Constrained Systems
Authors:
Charlott Vallon,
Alessandro Pinto,
Bartolomeo Stellato,
Francesco Borrelli
Abstract:
This paper introduces a novel data-driven hierarchical control scheme for managing a fleet of nonlinear, capacity-constrained autonomous agents in an iterative environment. We propose a control framework consisting of a high-level dynamic task assignment and routing layer and low-level motion planning and tracking layer. Each layer of the control hierarchy uses a data-driven Model Predictive Contr…
▽ More
This paper introduces a novel data-driven hierarchical control scheme for managing a fleet of nonlinear, capacity-constrained autonomous agents in an iterative environment. We propose a control framework consisting of a high-level dynamic task assignment and routing layer and low-level motion planning and tracking layer. Each layer of the control hierarchy uses a data-driven Model Predictive Control (MPC) policy, maintaining bounded computational complexity at each calculation of a new task assignment or actuation input. We utilize collected data to iteratively refine estimates of agent capacity usage, and update MPC policy parameters accordingly. Our approach leverages tools from iterative learning control to integrate learning at both levels of the hierarchy, and coordinates learning between levels in order to maintain closed-loop feasibility and performance improvement of the connected architecture.
△ Less
Submitted 10 April, 2024; v1 submitted 21 March, 2024;
originally announced March 2024.
-
Learning Hierarchical Control Systems for Autonomous Systems with Energy Constraints
Authors:
Charlott Vallon,
Mark Pustilnik,
Alessandro Pinto,
Francesco Borrelli
Abstract:
This paper focuses on the design of hierarchical control architectures for autonomous systems with energy constraints. We focus on systems where energy storage limitations and slow recharge rates drastically affect the way the autonomous systems are operated. Using examples from space robotics and public transportation, we motivate the need for formally designed learning hierarchical control syste…
▽ More
This paper focuses on the design of hierarchical control architectures for autonomous systems with energy constraints. We focus on systems where energy storage limitations and slow recharge rates drastically affect the way the autonomous systems are operated. Using examples from space robotics and public transportation, we motivate the need for formally designed learning hierarchical control systems. We propose a learning control architecture which incorporates learning mechanisms at various levels of the control hierarchy to improve performance and resource utilization. The proposed hierarchical control scheme relies on high-level energy-aware task planning and assignment, complemented by a low-level predictive control mechanism responsible for the autonomous execution of tasks, including motion control and energy management. Simulation examples show the benefits and the limitations of the proposed architecture when learning is used to obtain a more energy-efficient task allocation.
△ Less
Submitted 21 March, 2024;
originally announced March 2024.
-
Characterisation of Anti-Arrhythmic Drug Effects on Cardiac Electrophysiology using Physics-Informed Neural Networks
Authors:
Ching-En Chiu,
Arieh Levy Pinto,
Rasheda A Chowdhury,
Kim Christensen,
Marta Varela
Abstract:
The ability to accurately infer cardiac electrophysiological (EP) properties is key to improving arrhythmia diagnosis and treatment. In this work, we developed a physics-informed neural networks (PINNs) framework to predict how different myocardial EP parameters are modulated by anti-arrhythmic drugs. Using $\textit{in vitro}$ optical map** images and the 3-channel Fenton-Karma model, we estimat…
▽ More
The ability to accurately infer cardiac electrophysiological (EP) properties is key to improving arrhythmia diagnosis and treatment. In this work, we developed a physics-informed neural networks (PINNs) framework to predict how different myocardial EP parameters are modulated by anti-arrhythmic drugs. Using $\textit{in vitro}$ optical map** images and the 3-channel Fenton-Karma model, we estimated the changes in ionic channel conductance caused by these drugs.
Our framework successfully characterised the action of drugs HMR1556, nifedipine and lidocaine - respectively, blockade of $I_{K}$, $I_{Ca}$, and $I_{Na}$ currents - by estimating that they decreased the respective channel conductance by $31.8\pm2.7\%$ $(p=8.2 \times 10^{-5})$, $80.9\pm21.6\%$ $(p=0.02)$, and $8.6\pm0.5\%$ $ (p=0.03)$, leaving the conductance of other channels unchanged. For carbenoxolone, whose main action is the blockade of intercellular gap junctions, PINNs also successfully predicted no significant changes $(p>0.09)$ in all ionic conductances.
Our results are an important step towards the deployment of PINNs for model parameter estimation from experimental data, bringing this framework closer to clinical or laboratory images analysis and for the personalisation of mathematical models.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Offline Risk-sensitive RL with Partial Observability to Enhance Performance in Human-Robot Teaming
Authors:
Giorgio Angelotti,
Caroline P. C. Chanel,
Adam H. M. Pinto,
Christophe Lounis,
Corentin Chauffaut,
Nicolas Drougard
Abstract:
The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the decision-making system. This approach may alleviate the cognitive load on human operators by intelligently allocating mission tasks between agents. Nevertheless, accommodati…
▽ More
The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the decision-making system. This approach may alleviate the cognitive load on human operators by intelligently allocating mission tasks between agents. Nevertheless, accommodating a diverse pool of human participants with varying physiological and behavioral measurements presents a substantial challenge. To address this, resorting to a probabilistic framework becomes necessary, given the inherent uncertainty and partial observability on the human's state. Recent research suggests to learn a Partially Observable Markov Decision Process (POMDP) model from a data set of previously collected experiences that can be solved using Offline Reinforcement Learning (ORL) methods. In the present work, we not only highlight the potential of partially observable representations and physiological measurements to improve human operator state estimation and performance, but also enhance the overall mission effectiveness of a human-robot team. Importantly, as the fixed data set may not contain enough information to fully represent complex stochastic processes, we propose a method to incorporate model uncertainty, thus enabling risk-sensitive sequential decision-making. Experiments were conducted with a group of twenty-six human participants within a simulated robot teleoperation environment, yielding empirical evidence of the method's efficacy. The obtained adaptive task allocation policy led to statistically significant higher scores than the one that was used to collect the data set, allowing for generalization across diverse participants also taking into account risk-sensitive metrics.
△ Less
Submitted 8 February, 2024;
originally announced February 2024.
-
High-speed stars. II. An unbound star, young stars, bulge metal-poor stars, and Aurora candidates
Authors:
P. Bonifacio,
E. Caffau,
L. Monaco,
L. Sbordone,
M. Spite,
A. Mucciarelli,
P. François,
L. Lombardo,
A. D. M. Matas Pinto
Abstract:
The data from the Gaia satellite led us to revise our conception of the Galaxy structure and history. Hitherto unknown components have been discovered and a deep re-thinking of what the Galactic halo is is in progress. We selected from the Gaia catalogue stars with extreme transverse velocities with respect to the Sun ($|V_T| > 500 $ and observed them with FORS2 at the ESO VLT, to classify them us…
▽ More
The data from the Gaia satellite led us to revise our conception of the Galaxy structure and history. Hitherto unknown components have been discovered and a deep re-thinking of what the Galactic halo is is in progress. We selected from the Gaia catalogue stars with extreme transverse velocities with respect to the Sun ($|V_T| > 500 $ and observed them with FORS2 at the ESO VLT, to classify them using both their chemical and dynamical properties. Two apparently young stars, identified in paper\,I, were observed with UVES. We derived abundances for Na, Mg, Ca, Ti, Mn, and Fe, analysing the spectra with while for Ba we used line profile fitting. We computed actions from parallaxes and kinematical data. The stars span the metallicity range $ Fe/H -0.5$ with $ Fe/H = -1.6$. Star GHS143 has a total speed of about 1440 which is almost three times faster than the local escape velocity of 522 strongly implying this star is unbound to the Galaxy. Remarkably, this star is not esca** from the Galaxy, but it is falling into it. Ten stars are apparently young with masses in excess of 1.3M. Their interpretation as evolved blue stragglers is doubtful. The existence of a young metal-poor population is possible. The two stars observed with UVES show no lithium, suggesting they are blue stragglers. We detected a metal-poor population, confined to the bulge, that we call SpiteF, and argue that it is the result of a recent accretion event. We detect 102 candidates of the Aurora population that should have formed prior to the formation of the disc. Our sample is non-homogeneous and mainly retrograde. The stars are metal poor, and 23<!PCT!> have Fe/H -2.0$. Our selection is efficient at finding very metal-poor stars, but it selects peculiar populations.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
ONDA: ONline Database Architect
Authors:
Nuno Laranjeiro,
Alexandre Miguel Pinto
Abstract:
Database modeling is a key activity towards the fulfillment of storage requirements. Despite the availability of several database modeling tools for developers, these often come with associated costs, setup complexities, usability challenges, or dependency on specific operating systems. In this paper we present ONDA, a web-based tool developed at the University of Coimbra, that allows the creation…
▽ More
Database modeling is a key activity towards the fulfillment of storage requirements. Despite the availability of several database modeling tools for developers, these often come with associated costs, setup complexities, usability challenges, or dependency on specific operating systems. In this paper we present ONDA, a web-based tool developed at the University of Coimbra, that allows the creation of Entity-Relationship diagrams, visualization of physical models, and generation of SQL code for various database engines. ONDA is freely available at https://onda.dei.uc.pt and was created with the intention of supporting teaching activities at university-level database courses. At the time of writing, the tool being used by more than three hundred university students every academic year.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
Using Zero-shot Prompting in the Automatic Creation and Expansion of Topic Taxonomies for Tagging Retail Banking Transactions
Authors:
Daniel de S. Moraes,
Pedro T. C. Santos,
Polyana B. da Costa,
Matheus A. S. Pinto,
Ivan de J. P. Pinto,
Álvaro M. G. da Veiga,
Sergio Colcher,
Antonio J. G. Busson,
Rafael H. Rocha,
Rennan Gaio,
Rafael Miceli,
Gabriela Tourinho,
Marcos Rabaioli,
Leandro Santos,
Fellipe Marques,
David Favaro
Abstract:
This work presents an unsupervised method for automatically constructing and expanding topic taxonomies using instruction-based fine-tuned LLMs (Large Language Models). We apply topic modeling and keyword extraction techniques to create initial topic taxonomies and LLMs to post-process the resulting terms and create a hierarchy. To expand an existing taxonomy with new terms, we use zero-shot promp…
▽ More
This work presents an unsupervised method for automatically constructing and expanding topic taxonomies using instruction-based fine-tuned LLMs (Large Language Models). We apply topic modeling and keyword extraction techniques to create initial topic taxonomies and LLMs to post-process the resulting terms and create a hierarchy. To expand an existing taxonomy with new terms, we use zero-shot prompting to find out where to add new nodes, which, to our knowledge, is the first work to present such an approach to taxonomy tasks. We use the resulting taxonomies to assign tags that characterize merchants from a retail bank dataset. To evaluate our work, we asked 12 volunteers to answer a two-part form in which we first assessed the quality of the taxonomies created and then the tags assigned to merchants based on that taxonomy. The evaluation revealed a coherence rate exceeding 90% for the chosen taxonomies. The taxonomies' expansion with LLMs also showed exciting results for parent node prediction, with an f1-score above 70% in our taxonomies.
△ Less
Submitted 11 February, 2024; v1 submitted 7 January, 2024;
originally announced January 2024.
-
Two is enough: a flip on Bertrand through positive network effects
Authors:
Renato Soeiro,
Alberto Pinto
Abstract:
We discuss price competition when positive network effects are the only other factor in consumption choices. We show that partitioning consumers into two groups creates a rich enough interaction structure to induce negative marginal demand and produce pure price equilibria where both firms profit. The crucial condition is one group has centripetal influence while the other has centrifugal influenc…
▽ More
We discuss price competition when positive network effects are the only other factor in consumption choices. We show that partitioning consumers into two groups creates a rich enough interaction structure to induce negative marginal demand and produce pure price equilibria where both firms profit. The crucial condition is one group has centripetal influence while the other has centrifugal influence. The result is contrary to when positive network effects depend on a single aggregate variable and challenges the prevalent assumption that demand must be micro-founded on a distribution of consumer characteristics with specific properties, highlighting the importance of interaction structures in sha** market outcomes.
△ Less
Submitted 5 December, 2023;
originally announced December 2023.
-
Bubble wall velocities with an extended fluid Ansatz
Authors:
Glauber C. Dorsch,
Daniel A. Pinto
Abstract:
We compute the terminal bubble wall velocity during a cosmological phase transition by modelling non-equilibrium effects in the plasma with the so-called "extended fluid Ansatz". A $φ^6$ operator is included in the Standard Model effective potential to mimic effects of new physics. Hydrodynamical heating of the plasma ahead of the bubble is taken into account. We find that the inclusion of higher…
▽ More
We compute the terminal bubble wall velocity during a cosmological phase transition by modelling non-equilibrium effects in the plasma with the so-called "extended fluid Ansatz". A $φ^6$ operator is included in the Standard Model effective potential to mimic effects of new physics. Hydrodynamical heating of the plasma ahead of the bubble is taken into account. We find that the inclusion of higher order terms in the fluid Ansatz is typically relevant, and may even turn detonation solutions into deflagrations. Our results also corroborate recent findings in the literature that, for a Standard Model particle content in the plasma, only deflagration solutions are viable. However, we also show that this outcome may be altered in a theory with a different particle content.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Gravitationally induced matter creation in scalar-tensor $f(R,T_{μν}T^{μν})$ gravity
Authors:
Ricardo A. C. Cipriano,
Tiberiu Harko,
Francisco S. N. Lobo,
Miguel A. S. Pinto,
João Luís Rosa
Abstract:
In this work, we analyze the possibility of gravitationally induced matter creation in the so-called Energy-Momentum-Squared gravity (EMSG), i.e. $f(R,T_{μν}T^{μν})$ gravity, in its dynamically equivalent scalar-tensor representation. Given the explicit nonminimal coupling between matter and geometry in this theory, the energy-momentum tensor is not generally covariantly conserved, which motivates…
▽ More
In this work, we analyze the possibility of gravitationally induced matter creation in the so-called Energy-Momentum-Squared gravity (EMSG), i.e. $f(R,T_{μν}T^{μν})$ gravity, in its dynamically equivalent scalar-tensor representation. Given the explicit nonminimal coupling between matter and geometry in this theory, the energy-momentum tensor is not generally covariantly conserved, which motivates the study of cosmological scenarios by resorting to the formalism of irreversible thermodynamics of open systems. We start by deriving the universe matter creation rates and subsequent thermodynamical properties, such as, the creation pressure, temperature evolution, and entropy evolution, in the framework of $f(R,T_{μν}T^{μν})$ gravity. These quantities are then analyzed for a Friedmann-Lemaître-Robertson-Walker (FLRW) background with a scale factor described by the de Sitter solution, under different assumptions for the mater distribution, namely a vacuum universe, a constant density universe, and a time-varying density universe. Finally, we explore cosmological solutions with varying Hubble parameters and provide a comparison with the standard cosmological model. Our results indicate that the cosmological evolution in the framework of EMSG are in close agreement with the observational cosmological data for low redshift.
△ Less
Submitted 14 March, 2024; v1 submitted 23 October, 2023;
originally announced October 2023.
-
Observational Constraints and Cosmological Implications of Scalar-Tensor $f(R, T)$ Gravity
Authors:
Amine Bouali,
Himanshu Chaudhary,
Tiberiu Harko,
Francisco S. N. Lobo,
Taoufik Ouali,
Miguel A. S. Pinto
Abstract:
Recently, the scalar-tensor representation of $f (R,T)$ gravity was used to explore gravitationally induced particle production/annihilation. Using the framework of irreversible thermodynamics of open systems in the presence of matter creation/annihilation, the physical and cosmological consequences of this setup were investigated in detail. In this paper, we test observationally the scalar-tensor…
▽ More
Recently, the scalar-tensor representation of $f (R,T)$ gravity was used to explore gravitationally induced particle production/annihilation. Using the framework of irreversible thermodynamics of open systems in the presence of matter creation/annihilation, the physical and cosmological consequences of this setup were investigated in detail. In this paper, we test observationally the scalar-tensor representation of $f(R,T)$ gravity in the context of the aforementioned framework, using the Hubble and Pantheon+ measurements. The best fit parameters are obtained by solving numerically the modified Friedmann equations of two distinct cosmological models in scalar tensor $f(R, T)$ gravity, corresponding to two different choices of the potential, and by performing a Markov Chain Monte Carlo analysis. The best parameters are used to compute the cosmographic parameters, i.e., the deceleration, the jerk and the snap parameters. Using the output resulting from the Markov Chain Monte Carlo analysis, the cosmological evolution of the creation pressure and of the matter creation rates are presented for both models. To figure out the statistical significance of the studied scalar-tensor $f(R,T)$ gravity, the Bayesian and the corrected Akaike information criteria are used. The latter indicates that the first considered model in scalar tensor $f(R,T)$ gravity is statistically better than $Λ$CDM, i.e., it is more favored by observations. Besides, a continuous particle creation process is present in Model 1. On the other hand, for large redshifts, in Model 2 the particle creation rate may become negative, thus indicating the presence of particle annihilation processes. However, both models lead to an accelerating expansion of the Universe at late times, with a deceleration parameter equivalent to that of the $Λ$CDM model.
△ Less
Submitted 27 September, 2023;
originally announced September 2023.
-
Analysis and Design of Uncertain Cyber-Physical Systems
Authors:
Alessandro Pinto
Abstract:
Several sources of uncertainty have to be taken into account in the analysis and design of CPS. The set of parameters used in the model of the physical plant of a CPS may be uncertain due, for example, to manufacturing processes that are precise up to some bounded tolerance. Physical quantities are sensed by electronic components that add noise to the sensed signals. Abstraction of the physical wo…
▽ More
Several sources of uncertainty have to be taken into account in the analysis and design of CPS. The set of parameters used in the model of the physical plant of a CPS may be uncertain due, for example, to manufacturing processes that are precise up to some bounded tolerance. Physical quantities are sensed by electronic components that add noise to the sensed signals. Abstraction of the physical world, which is often necessary to limit the complexity of the models used in analysis and at run-time in decision-making, leads to non-determinism. The cyber side of a CPS, which includes both hardware and software components, exposes several types of uncertainty such as failures, latency, and implementation errors. Design processes and tools allow engineers to minimize the impact of these types of uncertainty, and to deliver systems which can be operated with an acceptable level of risk. In the past several years, cyber-physical systems have evolved, primarily due to pervasive connectivity, miniaturization, cost-effectiveness of hardware, and advances in the area of Artificial Intelligence. This new class of applications features an environment that is much more complex to model than traditional physical systems due not only to their scale, but also to new sources and types of uncertainty. Consider, for example, the typical case of echo chambers which is attributed to the effect that machine learning algorithms have on the bias of people. Such behavior is not easily predictable because of high uncertainty in the environment (people), which is only approximately represented by machine learning models, but that is inherently due to lack of knowledge. New models and analysis methods are therefore needed to capture different types of uncertainties, and to analyze these new classes of systems.
△ Less
Submitted 31 July, 2023;
originally announced August 2023.
-
Survey of Human Models for Verification of Human-Machine Systems
Authors:
Timothy E. Wang,
Alessandro Pinto
Abstract:
We survey the landscape of human operator modeling ranging from the early cognitive models developed in artificial intelligence to more recent formal task models developed for model-checking of human machine interactions. We review human performance modeling and human factors studies in the context of aviation, and models of how the pilot interacts with automation in the cockpit. The purpose of th…
▽ More
We survey the landscape of human operator modeling ranging from the early cognitive models developed in artificial intelligence to more recent formal task models developed for model-checking of human machine interactions. We review human performance modeling and human factors studies in the context of aviation, and models of how the pilot interacts with automation in the cockpit. The purpose of the survey is to assess the applicability of available state-of-the-art models of the human operators for the design, verification and validation of future safety-critical aviation systems that exhibit higher-level of autonomy, but still require human operators in the loop. These systems include the single-pilot aircraft and NextGen air traffic management. We discuss the gaps in existing models and propose future research to address them.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
Uncertainty components in profile likelihood fits
Authors:
Andrés Pinto,
Zhibo Wu,
Fabrice Balli,
Nicolas Berger,
Maarten Boonekamp,
Émilien Chapon,
Tatsuo Kawamoto,
Bogdan Malaescu
Abstract:
When a measurement of a physical quantity is reported, the total uncertainty is usually decomposed into statistical and systematic uncertainties. This decomposition is not only useful to understand the contributions to the total uncertainty, but also required to propagate these contributions in subsequent analyses, such as combinations or interpretation fits including results from other measuremen…
▽ More
When a measurement of a physical quantity is reported, the total uncertainty is usually decomposed into statistical and systematic uncertainties. This decomposition is not only useful to understand the contributions to the total uncertainty, but also required to propagate these contributions in subsequent analyses, such as combinations or interpretation fits including results from other measurements or experiments. In profile-likelihood fits, widely applied in high-energy physics analyses, contributions of systematic uncertainties are routinely quantified using "impacts", which are not adequate for such applications. We discuss the difference between impacts and actual uncertainty components, and establish methods to determine the latter in a wide range of statistical models.
△ Less
Submitted 14 March, 2024; v1 submitted 8 July, 2023;
originally announced July 2023.
-
Irreversible Geometrothermodynamics of Open Systems in Modified Gravity
Authors:
Miguel A. S. Pinto,
Tiberiu Harko,
Francisco S. N. Lobo
Abstract:
In this work, we explore the formalism of the irreversible thermodynamics of open systems and the possibility of gravitationally generated particle production in modified gravity. More specifically, we consider the scalar-tensor representation of $f(R,T)$ gravity, in which the matter energy-momentum tensor is not conserved due to a nonminimal curvature-matter coupling. In the context of the irreve…
▽ More
In this work, we explore the formalism of the irreversible thermodynamics of open systems and the possibility of gravitationally generated particle production in modified gravity. More specifically, we consider the scalar-tensor representation of $f(R,T)$ gravity, in which the matter energy-momentum tensor is not conserved due to a nonminimal curvature-matter coupling. In the context of the irreversible thermodynamics of open systems, this non-conservation of the energy-momentum tensor can be interpreted as an irreversible flow of energy from the gravitational sector to the matter sector, which, in general, could result in particle creation. We obtain and discuss the expressions for the particle creation rate, the creation pressure, and the entropy and temperature evolutions. Applied together with the modified field equations of scalar-tensor $f(R,T)$ gravity, the thermodynamics of open systems lead to a generalization of the $Λ$CDM cosmological paradigm, in which the particle creation rate and pressure are considered effectively as components of the cosmological fluid energy-momentum tensor. Thus, generally, modified theories of gravity in which these two quantities do not vanish provide a macroscopic phenomenological description of particle production in the cosmological fluid filling the Universe and also lead to the possibility of cosmological models that start from empty conditions and gradually build up matter and entropy.
△ Less
Submitted 24 June, 2023;
originally announced June 2023.
-
Assurance for Autonomy -- JPL's past research, lessons learned, and future directions
Authors:
Martin S. Feather,
Alessandro Pinto
Abstract:
Robotic space missions have long depended on automation, defined in the 2015 NASA Technology Roadmaps as "the automatically-controlled operation of an apparatus, process, or system using a pre-planned set of instructions (e.g., a command sequence)," to react to events when a rapid response is required. Autonomy, defined there as "the capacity of a system to achieve goals while operating independen…
▽ More
Robotic space missions have long depended on automation, defined in the 2015 NASA Technology Roadmaps as "the automatically-controlled operation of an apparatus, process, or system using a pre-planned set of instructions (e.g., a command sequence)," to react to events when a rapid response is required. Autonomy, defined there as "the capacity of a system to achieve goals while operating independently from external control," is required when a wide variation in circumstances precludes responses being pre-planned, instead autonomy follows an on-board deliberative process to determine the situation, decide the response, and manage its execution. Autonomy is increasingly called for to support adventurous space mission concepts, as an enabling capability or as a significant enhancer of the science value that those missions can return. But if autonomy is to be allowed to control these missions' expensive assets, all parties in the lifetime of a mission, from proposers through ground control, must have high confidence that autonomy will perform as intended to keep the asset safe to (if possible) accomplish the mission objectives. The role of mission assurance is a key contributor to providing this confidence, yet assurance practices honed over decades of spaceflight have relatively little experience with autonomy. To remedy this situation, researchers in JPL's software assurance group have been involved in the development of techniques specific to the assurance of autonomy. This paper summarizes over two decades of this research, and offers a vision of where further work is needed to address open issues.
△ Less
Submitted 16 May, 2023;
originally announced May 2023.
-
Leveraging Compositional Methods for Modeling and Verification of an Autonomous Taxi System
Authors:
Alessandro Pinto,
Anthony Corso,
Edward Schmerling
Abstract:
We apply a compositional formal modeling and verification method to an autonomous aircraft taxi system. We provide insights into the modeling approach and we identify several research areas where further development is needed. Specifically, we identify the following needs: (1) semantics of composition of viewpoints expressed in different specification languages, and tools to reason about heterogen…
▽ More
We apply a compositional formal modeling and verification method to an autonomous aircraft taxi system. We provide insights into the modeling approach and we identify several research areas where further development is needed. Specifically, we identify the following needs: (1) semantics of composition of viewpoints expressed in different specification languages, and tools to reason about heterogeneous declarative models; (2) libraries of formal models for autonomous systems to speed up modeling and enable efficient reasoning; (3) methods to lift verification results generated by automated reasoning tools to the specification level; (4) probabilistic contract frameworks to reason about imperfect implementations; (5) standard high-level functional architectures for autonomous systems; and (6) a theory of higher-order contracts. We believe that addressing these research needs, among others, could improve the adoption of formal methods in the design of autonomous systems including learning-enabled systems, and increase confidence in their safe operations.
△ Less
Submitted 26 April, 2023;
originally announced April 2023.
-
A Study of Autoregressive Decoders for Multi-Tasking in Computer Vision
Authors:
Lucas Beyer,
Bo Wan,
Gagan Madan,
Filip Pavetic,
Andreas Steiner,
Alexander Kolesnikov,
André Susano Pinto,
Emanuele Bugliarello,
Xiao Wang,
Qihang Yu,
Liang-Chieh Chen,
Xiaohua Zhai
Abstract:
There has been a recent explosion of computer vision models which perform many tasks and are composed of an image encoder (usually a ViT) and an autoregressive decoder (usually a Transformer). However, most of this work simply presents one system and its results, leaving many questions regarding design decisions and trade-offs of such systems unanswered. In this work, we aim to provide such answer…
▽ More
There has been a recent explosion of computer vision models which perform many tasks and are composed of an image encoder (usually a ViT) and an autoregressive decoder (usually a Transformer). However, most of this work simply presents one system and its results, leaving many questions regarding design decisions and trade-offs of such systems unanswered. In this work, we aim to provide such answers. We take a close look at autoregressive decoders for multi-task learning in multimodal computer vision, including classification, captioning, visual question answering, and optical character recognition. Through extensive systematic experiments, we study the effects of task and data mixture, training and regularization hyperparameters, conditioning type and specificity, modality combination, and more. Importantly, we compare these to well-tuned single-task baselines to highlight the cost incurred by multi-tasking. A key finding is that a small decoder learned on top of a frozen pretrained encoder works surprisingly well. We call this setup locked-image tuning with decoder (LiT-decoder). It can be seen as teaching a decoder to interact with a pretrained vision model via natural language.
△ Less
Submitted 30 March, 2023;
originally announced March 2023.
-
Tuning computer vision models with task rewards
Authors:
André Susano Pinto,
Alexander Kolesnikov,
Yuge Shi,
Lucas Beyer,
Xiaohua Zhai
Abstract:
Misalignment between model predictions and intended usage can be detrimental for the deployment of computer vision models. The issue is exacerbated when the task involves complex structured outputs, as it becomes harder to design procedures which address this misalignment. In natural language processing, this is often addressed using reinforcement learning techniques that align models with a task…
▽ More
Misalignment between model predictions and intended usage can be detrimental for the deployment of computer vision models. The issue is exacerbated when the task involves complex structured outputs, as it becomes harder to design procedures which address this misalignment. In natural language processing, this is often addressed using reinforcement learning techniques that align models with a task reward. We adopt this approach and show its surprising effectiveness across multiple computer vision tasks, such as object detection, panoptic segmentation, colorization and image captioning. We believe this approach has the potential to be widely useful for better aligning models with a diverse range of computer vision tasks.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
Privacy and Efficiency of Communications in Federated Split Learning
Authors:
Zongshun Zhang,
Andrea Pinto,
Valeria Turina,
Flavio Esposito,
Ibrahim Matta
Abstract:
Everyday, large amounts of sensitive data is distributed across mobile phones, wearable devices, and other sensors. Traditionally, these enormous datasets have been processed on a single system, with complex models being trained to make valuable predictions. Distributed machine learning techniques such as Federated and Split Learning have recently been developed to protect user data and privacy be…
▽ More
Everyday, large amounts of sensitive data is distributed across mobile phones, wearable devices, and other sensors. Traditionally, these enormous datasets have been processed on a single system, with complex models being trained to make valuable predictions. Distributed machine learning techniques such as Federated and Split Learning have recently been developed to protect user data and privacy better while ensuring high performance. Both of these distributed learning architectures have advantages and disadvantages. In this paper, we examine these tradeoffs and suggest a new hybrid Federated Split Learning architecture that combines the efficiency and privacy benefits of both. Our evaluation demonstrates how our hybrid Federated Split Learning approach can lower the amount of processing power required by each client running a distributed learning system, reduce training and inference time while kee** a similar accuracy. We also discuss the resiliency of our approach to deep learning privacy inference attacks and compare our solution to other recently proposed benchmarks.
△ Less
Submitted 6 January, 2023; v1 submitted 4 January, 2023;
originally announced January 2023.
-
MINCE I. Presentation of the project and of the first year sample
Authors:
G. Cescutti,
P. Bonifacio,
E. Caffau,
L. Monaco,
M. Franchini,
L. Lombardo,
A. M. Matas Pinto,
F. Lucertini,
P. François,
E. Spitoni,
R. Lallement,
L. Sbordone,
A. Mucciarelli,
M. Spite,
C. J. Hansen,
P. Di Marcantonio,
A. Kučinskas,
V. Dobrovolskas,
A. J. Korn,
M. Valentini,
L. Magrini,
S. Cristallo,
F. Matteucci
Abstract:
In recent years, Galactic archaeology has become a particularly vibrant field of astronomy, with its main focus set on the oldest stars of our Galaxy. In most cases, these stars have been identified as the most metal-poor. However, the struggle to find these ancient fossils has produced an important bias in the observations - in particular, the intermediate metal-poor stars (-2.5<[Fe/H]< -1.5) hav…
▽ More
In recent years, Galactic archaeology has become a particularly vibrant field of astronomy, with its main focus set on the oldest stars of our Galaxy. In most cases, these stars have been identified as the most metal-poor. However, the struggle to find these ancient fossils has produced an important bias in the observations - in particular, the intermediate metal-poor stars (-2.5<[Fe/H]< -1.5) have been frequently overlooked. The missing information has consequences for the precise study of the chemical enrichment of our Galaxy, in particular for what concerns neutron-capture elements and it will be only partially covered by future multi-object spectroscopic surveys such as WEAVE and 4MOST. Measuring at Intermediate Metallicity Neutron Capture Elements (MINCE) is gathering the first high-quality spectra (high S/N ratio and high resolution) for several hundreds of bright and metal-poor stars, mainly located in our Galactic halo. We compiled our selection mainly on the basis of Gaia data and determined the stellar atmospheres of our sample and the chemical abundances of each star. In this paper, we present the first sample of 59 spectra of 46 stars. We measured the radial velocities and computed the Galactic orbits for all stars. We found that 8 stars belong to the thin disc, 15 to disrupted satellites, and the remaining cannot be associated to the mentioned structures, and we call them halo stars. For 33 of these stars, we provide abundances for the elements up to zinc. We also show the chemical evolution results for eleven chemical elements, based on recent models. Our observational strategy of using multiple telescopes and spectrographs to acquire high S/N and high-resolution spectra has proven to be very efficient since the present sample was acquired over only about one year of observations. Finally, our target selection strategy proved satisfactory for our purposes.
△ Less
Submitted 11 November, 2022;
originally announced November 2022.
-
Sifting composite from elementary models at FCCee and CePC
Authors:
G. Cacciapaglia,
A. Deandrea,
A. M. Iyer,
A. Pinto
Abstract:
New Physics models with either an elementary or composite origin are often associated with a similar imprint in a direct search at colliders, case in point being the production of a light pseudoscalar in association with a monochromatic photon from the decay of a Z boson at future $e+e-$ colliders. We exploit the correlation between the discovery of a signal in the Z decays and electroweak precisi…
▽ More
New Physics models with either an elementary or composite origin are often associated with a similar imprint in a direct search at colliders, case in point being the production of a light pseudoscalar in association with a monochromatic photon from the decay of a Z boson at future $e+e-$ colliders. We exploit the correlation between the discovery of a signal in the Z decays and electroweak precision measurements as a tool to distinguish a composite model from an elementary scalar one. Our results offer an appealing and rich physics case for future colliders and demonstrate how a lepton collider at the Z mass can be a discovery machine for new physics in the Higgs sector.
△ Less
Submitted 2 November, 2022;
originally announced November 2022.
-
The effectiveness of factorization and similarity blending
Authors:
Andrea Pinto,
Giacomo Camposampiero,
Loïc Houmard,
Marc Lundwall
Abstract:
Collaborative Filtering (CF) is a widely used technique which allows to leverage past users' preferences data to identify behavioural patterns and exploit them to predict custom recommendations. In this work, we illustrate our review of different CF techniques in the context of the Computational Intelligence Lab (CIL) CF project at ETH Zürich. After evaluating the performances of the individual mo…
▽ More
Collaborative Filtering (CF) is a widely used technique which allows to leverage past users' preferences data to identify behavioural patterns and exploit them to predict custom recommendations. In this work, we illustrate our review of different CF techniques in the context of the Computational Intelligence Lab (CIL) CF project at ETH Zürich. After evaluating the performances of the individual models, we show that blending factorization-based and similarity-based approaches can lead to a significant error decrease (-9.4%) on the best-performing stand-alone model. Moreover, we propose a novel stochastic extension of a similarity model, SCSR, which consistently reduce the asymptotic complexity of the original algorithm.
△ Less
Submitted 16 September, 2022;
originally announced September 2022.
-
Cosmological Perturbations in Double Field Theory
Authors:
Olaf Hohm,
Allison F. Pinto
Abstract:
We explore perturbative double field theory about time-dependent (cosmological) backgrounds to cubic order. To this order the theory is consistent in a weakly constrained sense, so that for a toroidal geometry it encodes both momentum and genuine winding modes. We give a self-contained discussion of the consistency problems and their resolution, including the role of cocycle factors and the…
▽ More
We explore perturbative double field theory about time-dependent (cosmological) backgrounds to cubic order. To this order the theory is consistent in a weakly constrained sense, so that for a toroidal geometry it encodes both momentum and genuine winding modes. We give a self-contained discussion of the consistency problems and their resolution, including the role of cocycle factors and the $O(d,d,\mathbb{Z})$ duality. Finally, as a first step toward the computation of cosmological correlation functions, we propose a generalized scalar-vector-tensor decomposition and use it to construct gauge invariant generalized Bardeen variables. Compared to standard cosmology there are fewer tensor modes but more vector and scalar modes.
△ Less
Submitted 29 July, 2022;
originally announced July 2022.
-
A Decentralised Real Estate Transfer Verification Based on Self-Sovereign Identity and Smart Contracts
Authors:
Abubakar-Sadiq Shehu,
Antonio Pinto,
Manuel E. Correia
Abstract:
Since its first introduction in late 90s, the use of marketplaces has continued to grow, today virtually everything from physical assets to services can be purchased on digital marketplaces, real estate is not an exception. Some marketplaces allow acclaimed asset owners to advertise their products, to which the services gets commission/percentage from proceeds of sale/lease. Despite the success re…
▽ More
Since its first introduction in late 90s, the use of marketplaces has continued to grow, today virtually everything from physical assets to services can be purchased on digital marketplaces, real estate is not an exception. Some marketplaces allow acclaimed asset owners to advertise their products, to which the services gets commission/percentage from proceeds of sale/lease. Despite the success recorded in the use of the marketplaces, they are not without limitations which include identity and property fraud, impersonation and the use of centralised technology with trusted parties that are prone to single point of failures (SPOF). Being one of the most valuable assets, real estate has been a target for marketplace fraud as impersonators take pictures of properties they do not own, upload them on marketplace with promising prices that lures innocent or naive buyers. This paper addresses these issues by proposing a self sovereign identity (SSI) and smart contract based framework for identity verification and verified transaction management on secure digital marketplaces. First, the use of SSI technology enable methods for acquiring verified credential (VC) that are verifiable on a decentralised blockchain registry to identify both real estate owner(s) and real estate property. Second, the smart contracts are used to negotiate the secure transfer of real estate property deeds on the marketplace. To assess the viability of our proposal we define an application scenario and compare our work with other approaches
△ Less
Submitted 10 July, 2022;
originally announced July 2022.
-
Quantum oblivious transfer: a short review
Authors:
Manuel B. Santos,
Paulo Mateus,
Armando N. Pinto
Abstract:
Quantum cryptography is the field of cryptography that explores the quantum properties of matter. Its aim is to develop primitives beyond the reach of classical cryptography or to improve on existing classical implementations. Although much of the work in this field is dedicated to quantum key distribution (QKD), some important steps were made towards the study and development of quantum oblivious…
▽ More
Quantum cryptography is the field of cryptography that explores the quantum properties of matter. Its aim is to develop primitives beyond the reach of classical cryptography or to improve on existing classical implementations. Although much of the work in this field is dedicated to quantum key distribution (QKD), some important steps were made towards the study and development of quantum oblivious transfer (QOT). It is possible to draw a comparison between the application structure of both QKD and QOT primitives. Just as QKD protocols allow quantum-safe communication, QOT protocols allow quantum-safe computation. However, the conditions under which QOT is actually quantum-safe have been subject to a great amount of scrutiny and study. In this review article, we survey the work developed around the concept of oblivious transfer in the area of theoretical quantum cryptography, with an emphasis on some proposed protocols and their security requirements. We review the impossibility results that daunt this primitive and discuss several quantum security models under which it is possible to prove QOT security.
△ Less
Submitted 26 June, 2022; v1 submitted 6 June, 2022;
originally announced June 2022.
-
Gravitationally induced particle production in scalar-tensor $f(R,T)$ gravity
Authors:
Miguel A. S. Pinto,
Tiberiu Harko,
Francisco S. N. Lobo
Abstract:
We explore the possibility of gravitationally generated particle production in the scalar-tensor representation of $f(R,T)$ gravity. Due to the explicit nonminimal curvature-matter coupling in the theory, the divergence of the matter energy-momentum tensor does not vanish. We explore the physical and cosmological implications of this property by using the formalism of irreversible thermodynamics o…
▽ More
We explore the possibility of gravitationally generated particle production in the scalar-tensor representation of $f(R,T)$ gravity. Due to the explicit nonminimal curvature-matter coupling in the theory, the divergence of the matter energy-momentum tensor does not vanish. We explore the physical and cosmological implications of this property by using the formalism of irreversible thermodynamics of open systems in the presence of matter creation/annihilation. The particle creation rates, pressure, temperature evolution and the expression of the comoving entropy are obtained in a covariant formulation and discussed in detail. Applied together with the gravitational field equations, the thermodynamics of open systems lead to a generalization of the standard $Λ$CDM cosmological paradigm, in which the particle creation rates and pressures are effectively considered as components of the cosmological fluid energy-momentum tensor. We also consider specific models, and compare the scalar-tensor $f(R,T)$ cosmology with the $Λ$CDM scenario and the observational data for the Hubble function. The properties of the particle creation rates, of the creation pressures, and entropy generation through gravitational matter production are further investigated in both the low and high redshift limits.
△ Less
Submitted 1 September, 2022; v1 submitted 25 May, 2022;
originally announced May 2022.
-
UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes
Authors:
Alexander Kolesnikov,
André Susano Pinto,
Lucas Beyer,
Xiaohua Zhai,
Jeremiah Harmsen,
Neil Houlsby
Abstract:
We introduce UViM, a unified approach capable of modeling a wide range of computer vision tasks. In contrast to previous models, UViM has the same functional form for all tasks; it requires no task-specific modifications which require extensive human expertise. The approach involves two components: (I) a base model (feed-forward) which is trained to directly predict raw vision outputs, guided by a…
▽ More
We introduce UViM, a unified approach capable of modeling a wide range of computer vision tasks. In contrast to previous models, UViM has the same functional form for all tasks; it requires no task-specific modifications which require extensive human expertise. The approach involves two components: (I) a base model (feed-forward) which is trained to directly predict raw vision outputs, guided by a learned discrete code and (II) a language model (autoregressive) that is trained to generate the guiding code. These components complement each other: the language model is well-suited to modeling structured interdependent data, while the base model is efficient at dealing with high-dimensional outputs. We demonstrate the effectiveness of UViM on three diverse and challenging vision tasks: panoptic segmentation, depth prediction and image colorization, where we achieve competitive and near state-of-the-art results. Our experimental results suggest that UViM is a promising candidate for a unified modeling approach in computer vision.
△ Less
Submitted 14 October, 2022; v1 submitted 20 May, 2022;
originally announced May 2022.
-
The role of O+ and He+ on the propagation of Kinetic Alfvén Waves in the Earth's inner magnetosphere
Authors:
Pablo S Moya,
Bea Zenteno-Quinteros,
Iván Gallo-Méndez,
Víctor A Pinto
Abstract:
Interactions between plasma particles and electromagnetic waves play a crucial role in the dynamics and regulation of the state of space environments. From plasma physics theory, the characteristics of the waves and their interactions with the plasma strongly depend on the composition of the plasma, among other factors. In the case of the Earth's magnetosphere, the plasma is usually composed by el…
▽ More
Interactions between plasma particles and electromagnetic waves play a crucial role in the dynamics and regulation of the state of space environments. From plasma physics theory, the characteristics of the waves and their interactions with the plasma strongly depend on the composition of the plasma, among other factors. In the case of the Earth's magnetosphere, the plasma is usually composed by electrons, protons, O+, and He+ ions, all with their particular properties and characteristics. Here, using plasma parameters relevant for the inner magnetosphere we study the dispersion properties of Kinetic Alfvén Waves (KAW) in a plasma composed by electrons, protons, He+ ions, and O+ ions. We show that heavy ions induce significant changes to the dispersion properties of KAW, such as polarization, compressibility, and electric-to-magnetic amplitude ratio, and therefore the propagation of Kinetic Alfvén Waves is highly determined by the relative abundance of He+ and O+ in the plasma. These results when discussed in the context of observations in the Earth's magnetosphere, suggest that for many types of studies based on theory and numerical simulations, the inclusion of heavy ions should be customary for realistic modeling of plasma phenomena in the inner magnetosphere or other space environments in which heavy ions can contribute with a substantial portion of the plasma such as planetary magnetospheres and comet plasma tails.
△ Less
Submitted 19 May, 2022;
originally announced May 2022.
-
Frozen spatial coherence
Authors:
M. A. Pinto,
P. A. Brandão
Abstract:
Inspired by the concept of coherent frozen waves, this paper introduces one possible theoretical framework of its partially coherent version, a frozen spatial coherence, in which a desired two-point correlation structure of an optical field is created on the propagation axis by superposing partially coherent zero-order Bessel beams. It is shown that the cross-spectral density can be given a descri…
▽ More
Inspired by the concept of coherent frozen waves, this paper introduces one possible theoretical framework of its partially coherent version, a frozen spatial coherence, in which a desired two-point correlation structure of an optical field is created on the propagation axis by superposing partially coherent zero-order Bessel beams. It is shown that the cross-spectral density can be given a description in terms of a two-dimensional Fourier series, analogous to the one-dimensional approach of coherent frozen waves. The formalism is applied to the design of a partially coherent field which is highly coherent only if the pair of points in the propagation axis belong to a predetermined and finite range and highly incoherent outside that range.
△ Less
Submitted 25 May, 2022; v1 submitted 10 May, 2022;
originally announced May 2022.
-
Learning to Merge Tokens in Vision Transformers
Authors:
Cedric Renggli,
André Susano Pinto,
Neil Houlsby,
Basil Mustafa,
Joan Puigcerver,
Carlos Riquelme
Abstract:
Transformers are widely applied to solve natural language understanding and computer vision tasks. While scaling up these architectures leads to improved performance, it often comes at the expense of much higher computational costs. In order for large-scale models to remain practical in real-world systems, there is a need for reducing their computational overhead. In this work, we present the Patc…
▽ More
Transformers are widely applied to solve natural language understanding and computer vision tasks. While scaling up these architectures leads to improved performance, it often comes at the expense of much higher computational costs. In order for large-scale models to remain practical in real-world systems, there is a need for reducing their computational overhead. In this work, we present the PatchMerger, a simple module that reduces the number of patches or tokens the network has to process by merging them between two consecutive intermediate layers. We show that the PatchMerger achieves a significant speedup across various model sizes while matching the original performance both upstream and downstream after fine-tuning.
△ Less
Submitted 24 February, 2022;
originally announced February 2022.
-
Polarization diverse true heterodyne receiver for continuous variable quantum key distribution
Authors:
Daniel Pereira,
Armando N Pinto,
Nuno A Silva
Abstract:
We present a polarization diverse receiver architecture for continuous variables quantum key distribution. Our receiver architecture forgoes the need for any polarization matching calibrations or feedback loops and is usable in any locally generated local oscillator key distribution system. We demonstrate experimentally that our system is capable of reliably achieving theoretical security against…
▽ More
We present a polarization diverse receiver architecture for continuous variables quantum key distribution. Our receiver architecture forgoes the need for any polarization matching calibrations or feedback loops and is usable in any locally generated local oscillator key distribution system. We demonstrate experimentally that our system is capable of reliably achieving theoretical security against coherent attacks, even under very adverse random polarization drift scenarios, where the single polarization channels are unable to achieve security, and is capable of functioning for long periods of time.
△ Less
Submitted 31 January, 2022;
originally announced January 2022.
-
Cold Atoms in Space: Community Workshop Summary and Proposed Road-Map
Authors:
Ivan Alonso,
Cristiano Alpigiani,
Brett Altschul,
Henrique Araujo,
Gianluigi Arduini,
Jan Arlt,
Leonardo Badurina,
Antun Balaz,
Satvika Bandarupally,
Barry C Barish Michele Barone,
Michele Barsanti,
Steven Bass,
Angelo Bassi,
Baptiste Battelier,
Charles F. A. Baynham,
Quentin Beaufils,
Aleksandar Belic,
Joel Berge,
Jose Bernabeu,
Andrea Bertoldi,
Robert Bingham,
Sebastien Bize,
Diego Blas,
Kai Bongs,
Philippe Bouyer
, et al. (224 additional authors not shown)
Abstract:
We summarize the discussions at a virtual Community Workshop on Cold Atoms in Space concerning the status of cold atom technologies, the prospective scientific and societal opportunities offered by their deployment in space, and the developments needed before cold atoms could be operated in space. The cold atom technologies discussed include atomic clocks, quantum gravimeters and accelerometers, a…
▽ More
We summarize the discussions at a virtual Community Workshop on Cold Atoms in Space concerning the status of cold atom technologies, the prospective scientific and societal opportunities offered by their deployment in space, and the developments needed before cold atoms could be operated in space. The cold atom technologies discussed include atomic clocks, quantum gravimeters and accelerometers, and atom interferometers. Prospective applications include metrology, geodesy and measurement of terrestrial mass change due to, e.g., climate change, and fundamental science experiments such as tests of the equivalence principle, searches for dark matter, measurements of gravitational waves and tests of quantum mechanics. We review the current status of cold atom technologies and outline the requirements for their space qualification, including the development paths and the corresponding technical milestones, and identifying possible pathfinder missions to pave the way for missions to exploit the full potential of cold atoms in space. Finally, we present a first draft of a possible road-map for achieving these goals, that we propose for discussion by the interested cold atom, Earth Observation, fundamental physics and other prospective scientific user communities, together with ESA and national space and research funding agencies.
△ Less
Submitted 19 January, 2022;
originally announced January 2022.
-
Predição de Incidência de Lesão por Pressão em Pacientes de UTI usando Aprendizado de Máquina
Authors:
Henrique P. Silva,
Arthur D. Reys,
Daniel S. Severo,
Dominique H. Ruther,
Flávio A. O. B. Silva,
Maria C. S. S. Guimarães,
Roberto Z. A. Pinto,
Saulo D. S. Pedro,
Túlio P. Navarro,
Danilo Silva
Abstract:
Pressure ulcers have high prevalence in ICU patients but are preventable if identified in initial stages. In practice, the Braden scale is used to classify high-risk patients. This paper investigates the use of machine learning in electronic health records data for this task, by using data available in MIMIC-III v1.4. Two main contributions are made: a new approach for evaluating models that consi…
▽ More
Pressure ulcers have high prevalence in ICU patients but are preventable if identified in initial stages. In practice, the Braden scale is used to classify high-risk patients. This paper investigates the use of machine learning in electronic health records data for this task, by using data available in MIMIC-III v1.4. Two main contributions are made: a new approach for evaluating models that considers all predictions made during a stay, and a new training method for the machine learning models. The results show a superior performance in comparison to the state of the art; moreover, all models surpass the Braden scale in every operating point in the precision-recall curve. -- --
Lesões por pressão possuem alta prevalência em pacientes de UTI e são preveníveis ao serem identificadas em estágios iniciais. Na prática utiliza-se a escala de Braden para classificação de pacientes em risco. Este artigo investiga o uso de aprendizado de máquina em dados de registros eletrônicos para este fim, a partir da base de dados MIMIC-III v1.4. São feitas duas contribuições principais: uma nova abordagem para a avaliação dos modelos e da escala de Braden levando em conta todas as predições feitas ao longo das internações, e um novo método de treinamento para os modelos de aprendizado de máquina. Os resultados obtidos superam o estado da arte e verifica-se que os modelos superam significativamente a escala de Braden em todos os pontos de operação da curva de precisão por sensibilidade.
△ Less
Submitted 23 December, 2021;
originally announced December 2021.
-
Homological Quantum Mechanics
Authors:
Christoph Chiaffrino,
Olaf Hohm,
Allison F. Pinto
Abstract:
We provide a formulation of quantum mechanics based on the cohomology of the Batalin-Vilkovisky (BV) algebra. Focusing on quantum-mechanical systems without gauge symmetry we introduce a homotopy retract from the chain complex of the harmonic oscillator to finite-dimensional phase space. This induces a homotopy transfer from the BV algebra to the algebra of functions on phase space. Quantum expect…
▽ More
We provide a formulation of quantum mechanics based on the cohomology of the Batalin-Vilkovisky (BV) algebra. Focusing on quantum-mechanical systems without gauge symmetry we introduce a homotopy retract from the chain complex of the harmonic oscillator to finite-dimensional phase space. This induces a homotopy transfer from the BV algebra to the algebra of functions on phase space. Quantum expectation values for a given operator or functional are computed by the function whose pullback gives a functional in the same cohomology class. This statement is proved in perturbation theory by relating the perturbation lemma to Wick's theorem. We test this method by computing two-point functions for the harmonic oscillator for position eigenstates and coherent states. Finally, we derive the Unruh effect, illustrating that these methods are applicable to quantum field theory.
△ Less
Submitted 10 February, 2024; v1 submitted 21 December, 2021;
originally announced December 2021.
-
End-to-end LSTM based estimation of volcano event epicenter localization
Authors:
Nestor Becerra Yoma,
Jorge Wuth,
Andres Pinto,
Nicolas de Celis,
Jorge Celis,
Fernando Huenupan
Abstract:
In this paper, an end-to-end based LSTM scheme is proposed to address the problem of volcano event localization without any a priori model relating phase picking with localization estimation. It is worth emphasizing that automatic phase picking in volcano signals is highly inaccurate because of the short distances between the event epicenters and the seismograph stations. LSTM was chosen due to it…
▽ More
In this paper, an end-to-end based LSTM scheme is proposed to address the problem of volcano event localization without any a priori model relating phase picking with localization estimation. It is worth emphasizing that automatic phase picking in volcano signals is highly inaccurate because of the short distances between the event epicenters and the seismograph stations. LSTM was chosen due to its capability to capture the dynamics of time varying signals, and to remove or add information within the memory cell state and model long-term dependencies. A brief insight into LSTM is also discussed here. The results presented in this paper show that the LSTM based architecture provided a success rate, i.e., an error smaller than 1.0Km, equal to 48.5%, which in turn is dramatically superior to the one delivered by automatic phase picking. Moreover, the proposed end-to-end LSTM based method gave a success rate 18% higher than CNN.
△ Less
Submitted 27 October, 2021;
originally announced October 2021.
-
The $\texttt{Abacus}$ Cosmological $N$-body Code
Authors:
Lehman H. Garrison,
Daniel J. Eisenstein,
Douglas Ferrer,
Nina A. Maksimova,
Philip A. Pinto
Abstract:
We present $\texttt{Abacus}$, a fast and accurate cosmological $N$-body code based on a new method for calculating the gravitational potential from a static multipole mesh. The method analytically separates the near- and far-field forces, reducing the former to direct $1/r^2$ summation and the latter to a discrete convolution over multipoles. The method achieves 70 million particle updates per sec…
▽ More
We present $\texttt{Abacus}$, a fast and accurate cosmological $N$-body code based on a new method for calculating the gravitational potential from a static multipole mesh. The method analytically separates the near- and far-field forces, reducing the former to direct $1/r^2$ summation and the latter to a discrete convolution over multipoles. The method achieves 70 million particle updates per second per node of the Summit supercomputer, while maintaining a median fractional force error of $10^{-5}$. We express the simulation time step as an event-driven "pipeline", incorporating asynchronous events such as completion of co-processor work, Input/Output, and network communication. $\texttt{Abacus}$ has been used to produce the largest suite of $N$-body simulations to date, the $\texttt{AbacusSummit}$ suite of 60 trillion particles (Maksimova et al., 2021), incorporating on-the-fly halo finding. $\texttt{Abacus}$ enables the production of mock catalogs of the volume and resolution required by the coming generation of cosmological surveys.
△ Less
Submitted 21 October, 2021;
originally announced October 2021.
-
Group network effects in price competition
Authors:
Renato Soeiro,
Alberto Pinto
Abstract:
The partition of society into groups, polarization, and social networks are part of most conversations today. How do they influence price competition? We discuss Bertrand duopoly equilibria with demand subject to network effects. Contrary to models where network effects depend on one aggregate variable (demand for each choice), partitioning the dependence into groups creates a wealth of pure price…
▽ More
The partition of society into groups, polarization, and social networks are part of most conversations today. How do they influence price competition? We discuss Bertrand duopoly equilibria with demand subject to network effects. Contrary to models where network effects depend on one aggregate variable (demand for each choice), partitioning the dependence into groups creates a wealth of pure price equilibria with profit for both price setters, even if positive network effects are the dominant element of the game. If there is some asymmetry in how groups interact, two groups are sufficient. If network effects are based on undirected and unweighted graphs, at least five groups are required but, without other differentiation, outcomes are symmetric.
△ Less
Submitted 12 October, 2021;
originally announced October 2021.
-
Young giants of intermediate mass Evidence of rotation and mixing
Authors:
Linda Lombardo,
Patrick François,
Piercarlo Bonifacio,
Elisabetta Caffau,
A. Matas Pinto,
Corinne Charbonnel,
Georges Meynet,
Lorenzo Monaco,
Gabriele Cescutti,
Alessio Mucciarelli
Abstract:
In the search of a sample of metal-poor bright giants using Str{ö}mgren photometry, we serendipitously found a sample of 26 young (ages younger than 1 Gyr) metal-rich giants, some of which have high rotational velocities.We determined the chemical composition and rotational velocities of these stars in order to compare them with predictions from stellar evolution models. These stars where of spect…
▽ More
In the search of a sample of metal-poor bright giants using Str{ö}mgren photometry, we serendipitously found a sample of 26 young (ages younger than 1 Gyr) metal-rich giants, some of which have high rotational velocities.We determined the chemical composition and rotational velocities of these stars in order to compare them with predictions from stellar evolution models. These stars where of spectral type A to B when on the main sequence, and we therefore wished to compare their abundance pattern to that of main-sequence A and B stars.Stellar masses were derived by comparison of the position of the stars in the colour-magnitude diagram with theoretical evolutionary tracks. These masses, together with Gaia photometry and parallaxes, were used to derive the stellar parameters. We used spectrum synthesis and model atmospheres to determine chemical abundances for 16 elements (C, N, O, Mg, Al, Ca, Fe, Sr, Y, Ba, La, Ce, Pr, Nd, Sm, and Eu) and rotational velocities.The age-metallicity degeneracy can affect photometric metallicity calibrations. We identify 15 stars as likely binary stars. All stars are in prograde motion around the Galactic centre and belong to the thin-disc population. All but one of the sample stars present low [C/Fe] and high [N/Fe] ratios together with constant [(C+N+O)/Fe], suggesting that they have undergone CNO processing and first dredge-up. The observed rotational velocities are in line with theoretical predictions of the evolution of rotating stars.
△ Less
Submitted 8 December, 2021; v1 submitted 11 October, 2021;
originally announced October 2021.
-
The metal-poor end of the Spite plateau. II. Detailed chemical investigation
Authors:
A. Matas Pinto,
M. Spite,
E. Caffau,
P. Bonifacio,
L. Sbordone,
T. Sivarani,
M. Steffen,
F. Spite,
P. Francois,
P. Di Matteo
Abstract:
Context. The study of old, metal-poor stars deepens our knowledge on the early stages of the universe. In particular, the study of these stars gives us a valuable insight into the masses of the first massive stars and their emission of ionising photons. Aims. We present a detailed chemical analysis and determination of the kinematic and orbital properties of a sample of 11 dwarf stars. These are m…
▽ More
Context. The study of old, metal-poor stars deepens our knowledge on the early stages of the universe. In particular, the study of these stars gives us a valuable insight into the masses of the first massive stars and their emission of ionising photons. Aims. We present a detailed chemical analysis and determination of the kinematic and orbital properties of a sample of 11 dwarf stars. These are metal-poor stars, and a few of them present a low lithium content. We inspected whether the other elements also present anomalies. Methods. We analysed the high-resolution UVES spectra of a few metal-poor stars using the Turbospectrum code to synthesise spectral lines profiles. This allowed us to derive a detailed chemical analysis of Fe,
△ Less
Submitted 1 October, 2021;
originally announced October 2021.
-
Constraints on planetesimal accretion inferred from particle-size distribution in CO chondrites
Authors:
Gabriel A. Pinto,
Yves Marrocchi,
Alessandro Morbidelli,
Sébastien Charnoz,
Maria Eugenia Varela,
Kevin Soto,
Rodrigo Martínez,
Felipe Olivares
Abstract:
The formation of planetesimals was a key step in the assemblage of planetary bodies, yet many aspects of their formation remain poorly constrained. Notably, the mechanism by which chondrules -- sub-millimetric spheroids that dominate primitive meteorites -- were incorporated into planetesimals remains poorly understood. Here we classify and analyze particle-size distributions in various CO carbona…
▽ More
The formation of planetesimals was a key step in the assemblage of planetary bodies, yet many aspects of their formation remain poorly constrained. Notably, the mechanism by which chondrules -- sub-millimetric spheroids that dominate primitive meteorites -- were incorporated into planetesimals remains poorly understood. Here we classify and analyze particle-size distributions in various CO carbonaceous chondrites found in the Atacama Desert. Our results show that the average circle-equivalent diameters of chondrules define a positive trend with the petrographic grade, which reflects the progressive role of thermal metamorphism within the CO parent body. We show that this relationship could not have been established by thermal metamorphism alone but rather by aerodynamic sorting during accretion. By modeling the self-gravitational contraction of clumps of chondrules, we show that (i) the accretion of the CO parent body(ies) would have generated a gradual change of chondrule size with depth in the parent body, with larger chondrules being more centrally concentrated than smaller ones, and (ii) any subsequent growth by pebble accretion would have been insignificant. These findings give substantial support to the view that planetesimals formed via gravitational collapse.
△ Less
Submitted 19 August, 2021; v1 submitted 27 July, 2021;
originally announced July 2021.
-
Scaling Vision with Sparse Mixture of Experts
Authors:
Carlos Riquelme,
Joan Puigcerver,
Basil Mustafa,
Maxim Neumann,
Rodolphe Jenatton,
André Susano Pinto,
Daniel Keysers,
Neil Houlsby
Abstract:
Sparsely-gated Mixture of Experts networks (MoEs) have demonstrated excellent scalability in Natural Language Processing. In Computer Vision, however, almost all performant networks are "dense", that is, every input is processed by every parameter. We present a Vision MoE (V-MoE), a sparse version of the Vision Transformer, that is scalable and competitive with the largest dense networks. When app…
▽ More
Sparsely-gated Mixture of Experts networks (MoEs) have demonstrated excellent scalability in Natural Language Processing. In Computer Vision, however, almost all performant networks are "dense", that is, every input is processed by every parameter. We present a Vision MoE (V-MoE), a sparse version of the Vision Transformer, that is scalable and competitive with the largest dense networks. When applied to image recognition, V-MoE matches the performance of state-of-the-art networks, while requiring as little as half of the compute at inference time. Further, we propose an extension to the routing algorithm that can prioritize subsets of each input across the entire batch, leading to adaptive per-image compute. This allows V-MoE to trade-off performance and compute smoothly at test-time. Finally, we demonstrate the potential of V-MoE to scale vision models, and train a 15B parameter model that attains 90.35% on ImageNet.
△ Less
Submitted 10 June, 2021;
originally announced June 2021.
-
Prospects for Multi-omics in the Microbial Ecology of Water Engineering
Authors:
Elizabeth A. McDaniel,
Sebastian Aljoscha Wahl,
Shun'ichi Ishii,
Ameet Pinto,
Ryan Ziels,
Per H. Nielsen,
Katherine D. McMahon,
Rohan B. H. Williams
Abstract:
Advances in high-throughput sequencing technologies and bioinformatics approaches over almost the last three decades have substantially increased our ability to explore microorganisms and their functions-including those that have yet to be cultivated in pure isolation. Genome-resolved metagenomic approaches have enabled linking powerful functional predictions to specific taxonomical groups with in…
▽ More
Advances in high-throughput sequencing technologies and bioinformatics approaches over almost the last three decades have substantially increased our ability to explore microorganisms and their functions-including those that have yet to be cultivated in pure isolation. Genome-resolved metagenomic approaches have enabled linking powerful functional predictions to specific taxonomical groups with increasing fidelity. Additionally, whole community gene expression surveys and metabolite profiling have permitted direct surveys of community-scale functions in specific environmental settings. These advances have allowed for a shift in microbiome science away from descriptive studies and towards mechanistic and predictive frameworks for designing and harnessing microbial communities for desired beneficial outcomes. Here, we review how modern genome-resolved metagenomic approaches have been applied to a variety of water engineering applications from lab-scale bioreactors to full-scale systems. We describe integrated omics analysis across engineered water systems and the foundations for pairing these insights with modeling approaches. Lastly, we summarize emerging omics-based technologies that we believe will be powerful tools for water engineering applications. Overall, we provide a framework for microbial ecologists specializing in water engineering to apply cutting-edge omics approaches to their research questions to achieve novel functional insights. Successful adoption of predictive frameworks in engineered water systems could enable more economically and environmentally sustainable bioprocesses as demand for water and energy resources increases.
△ Less
Submitted 18 May, 2021;
originally announced May 2021.
-
Measuring economic activity from space: a case study using flying airplanes and COVID-19
Authors:
Mauricio Pamplona Segundo,
Allan Pinto,
Rodrigo Minetto,
Ricardo da Silva Torres,
Sudeep Sarkar
Abstract:
This work introduces a novel solution to measure economic activity through remote sensing for a wide range of spatial areas. We hypothesized that disturbances in human behavior caused by major life-changing events leave signatures in satellite imagery that allows devising relevant image-based indicators to estimate their impacts and support decision-makers. We present a case study for the COVID-19…
▽ More
This work introduces a novel solution to measure economic activity through remote sensing for a wide range of spatial areas. We hypothesized that disturbances in human behavior caused by major life-changing events leave signatures in satellite imagery that allows devising relevant image-based indicators to estimate their impacts and support decision-makers. We present a case study for the COVID-19 coronavirus outbreak, which imposed severe mobility restrictions and caused worldwide disruptions, using flying airplane detection around the 30 busiest airports in Europe to quantify and analyze the lockdown's effects and post-lockdown recovery. Our solution won the Rapid Action Coronavirus Earth observation (RACE) upscaling challenge, sponsored by the European Space Agency and the European Commission, and now integrates the RACE dashboard. This platform combines satellite data and artificial intelligence to promote a progressive and safe reopening of essential activities. Code and CNN models are available at https://github.com/maups/covid19-custom-script-contest
△ Less
Submitted 21 April, 2021;
originally announced April 2021.