-
Photon frequency variation in non-linear electro-magnetism
Authors:
Alessandro D. A. M. Spallicci,
Abedennour Dib,
José A. Helayël-Neto
Abstract:
We set a generalised non-linear Lagrangian, encompassing Born-Infeld and Heisenberg-Euler theories among others. The Lagrangian reduces to the Maxwell Lagrangian at lowest order. The field is composed by a propagating light-wave in an electro-magnetic background. The wave exhibits energy variation when the background is space-time dependent. In the photon description, this implies a red or a blue…
▽ More
We set a generalised non-linear Lagrangian, encompassing Born-Infeld and Heisenberg-Euler theories among others. The Lagrangian reduces to the Maxwell Lagrangian at lowest order. The field is composed by a propagating light-wave in an electro-magnetic background. The wave exhibits energy variation when the background is space-time dependent. In the photon description, this implies a red or a blue shift, like what we obtained in massive theories, as the de Broglie-Proca or effective mass theories as the Standard-Model Extension under Lorentz symmetry violation. The two results, photon energy-conservation and the frequency shift are instead new for non-linear electro-magnetism. We conclude by discussing how these static frequency shifts when added to the expansion red shift allow new interpretations in cosmology or for atomic spectra. We finally consider the consequences on the Poincaré symmetry.
△ Less
Submitted 27 April, 2024;
originally announced April 2024.
-
Unified Occupancy on a Public Transport Network through Combination of AFC and APC Data
Authors:
Amir Dib,
Noëlie Cherrier,
Martin Graive,
Baptiste Rérolle,
Eglantine Schmitt
Abstract:
In a transport network, the onboard occupancy is key for gaining insights into travelers' habits and adjusting the offer. Traditionally, operators have relied on field studies to evaluate ridership of a typical workday. However, automated fare collection (AFC) and automatic passenger counting (APC) data, which provide complete temporal coverage, are often available but underexploited. It should be…
▽ More
In a transport network, the onboard occupancy is key for gaining insights into travelers' habits and adjusting the offer. Traditionally, operators have relied on field studies to evaluate ridership of a typical workday. However, automated fare collection (AFC) and automatic passenger counting (APC) data, which provide complete temporal coverage, are often available but underexploited. It should be noted, however, that each data source comes with its own biases: AFC data may not account for fraud, while not all vehicles are equipped with APC systems.
This paper introduces the unified occupancy method, a geostatistical model to extrapolate occupancy to every course of a public transportation network by combining AFC and APC data with partial coverage. Unified occupancy completes missing APC information for courses on lines where other courses have APC measures, as well as for courses on lines where no APC data is available at all. The accuracy of this method is evaluated on real data from several public transportation networks in France.
△ Less
Submitted 6 February, 2024;
originally announced March 2024.
-
Context-Aware Automated Passenger Counting Data Denoising
Authors:
Noëlie Cherrier,
Baptiste Rérolle,
Martin Graive,
Amir Dib,
Eglantine Schmitt
Abstract:
A reliable and accurate knowledge of the ridership in public transportation networks is crucial for public transport operators and public authorities to be aware of their network's use and optimize transport offering. Several techniques to estimate ridership exist nowadays, some of them in an automated manner. Among them, Automatic Passenger Counting (APC) systems detect passengers entering and le…
▽ More
A reliable and accurate knowledge of the ridership in public transportation networks is crucial for public transport operators and public authorities to be aware of their network's use and optimize transport offering. Several techniques to estimate ridership exist nowadays, some of them in an automated manner. Among them, Automatic Passenger Counting (APC) systems detect passengers entering and leaving the vehicle at each station of its course. However, data resulting from these systems are often noisy or even biased, resulting in under or overestimation of onboard occupancy. In this work, we propose a denoising algorithm for APC data to improve their robustness and ease their analyzes. The proposed approach consists in a constrained integer linear optimization, taking advantage of ticketing data and historical ridership data to further constrain and guide the optimization. The performances are assessed and compared to other denoising methods on several public transportation networks in France, to manual counts available on one of these networks, and on simulated data.
△ Less
Submitted 6 February, 2024;
originally announced February 2024.
-
MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable Shading
Authors:
Abdallah Dib,
Luiz Gustavo Hafemann,
Emeline Got,
Trevor Anderson,
Amin Fadaeinejad,
Rafael M. O. Cruz,
Marc-Andre Carbonneau
Abstract:
Reconstructing an avatar from a portrait image has many applications in multimedia, but remains a challenging research problem. Extracting reflectance maps and geometry from one image is ill-posed: recovering geometry is a one-to-many map** problem and reflectance and light are difficult to disentangle. Accurate geometry and reflectance can be captured under the controlled conditions of a light…
▽ More
Reconstructing an avatar from a portrait image has many applications in multimedia, but remains a challenging research problem. Extracting reflectance maps and geometry from one image is ill-posed: recovering geometry is a one-to-many map** problem and reflectance and light are difficult to disentangle. Accurate geometry and reflectance can be captured under the controlled conditions of a light stage, but it is costly to acquire large datasets in this fashion. Moreover, training solely with this type of data leads to poor generalization with in-the-wild images. This motivates the introduction of MoSAR, a method for 3D avatar generation from monocular images. We propose a semi-supervised training scheme that improves generalization by learning from both light stage and in-the-wild datasets. This is achieved using a novel differentiable shading formulation. We show that our approach effectively disentangles the intrinsic face parameters, producing relightable avatars. As a result, MoSAR estimates a richer set of skin reflectance maps, and generates more realistic avatars than existing state-of-the-art methods. We also introduce a new dataset, named FFHQ-UV-Intrinsics, the first public dataset providing intrinsic face attributes at scale (diffuse, specular, ambient occlusion and translucency maps) for a total of 10k subjects. The project website and the dataset are available on the following link: https://ubisoft-laforge.github.io/character/mosar/
△ Less
Submitted 21 December, 2023; v1 submitted 20 December, 2023;
originally announced December 2023.
-
Testing the Ampère-Maxwell law on the photon mass and Lorentz-Poincaré symmetry violation with MMS multi-spacecraft data
Authors:
Alessandro D. A. M. Spallicci,
Giuseppe Sarracino,
Orélien Randriamboarison,
José A. Helayël-Neto,
Abedennour Dib
Abstract:
We investigate possible evidence from Extended Theories of Electro-Magnetism by looking for deviations from the Ampère-Maxwell law. The photon, main messenger for interpreting the universe, is the only free massless particle in the Standard-Model (SM). Indeed, the deviations may be due to a photon mass for the de Broglie-Proca (dBP) theory or the Lorentz Symmetry Violation (LSV) in the SM Extensio…
▽ More
We investigate possible evidence from Extended Theories of Electro-Magnetism by looking for deviations from the Ampère-Maxwell law. The photon, main messenger for interpreting the universe, is the only free massless particle in the Standard-Model (SM). Indeed, the deviations may be due to a photon mass for the de Broglie-Proca (dBP) theory or the Lorentz Symmetry Violation (LSV) in the SM Extension (SME), but also to non-linearities from theories as of Born-Infeld, Heisenberg-Euler. With this aim, we have analysed six years of data of the Magnetospheric Multi-Scale mission, which is a four-satellite constellation, crossing mostly turbulent regions of magnetic reconnection and collecting about $95\%$ of the downloaded data, outside the solar wind. We examined 3.8 million data points from the solar wind, magnetosheath, and magnetosphere regions. In a minority of cases, for the highest time resolution burst data and optimal tetrahedron configurations drawn by the four spacecraft, deviations have been found ($2.2\%$ in modulus and $4.8\%$ in Cartesian components for all regions, but raising up in the solar wind alone to $20.8\%$ in modulus and $29.7\%$ in Cartesian components and up to 45.2\% in the extreme low-mass range). The deviations might be due to unaccounted experimental errors or, less likely, to non-Maxwellian contributions, for which we have inferred the related parameters for the dBP and SME cases. Possibly, we are at the boundaries of measurability for non-dedicated missions. We discuss our experimental results (upper limit of photon mass of $2.1 \times 10^{-51}$ kg, and of the LSV parameter $|\vec{k}^{\rm AF}|$ of $6 \times 10^{-9}$ m$^{-1}$), as the deviations in the solar wind, versus more stringent but model-dependent limits.
△ Less
Submitted 26 April, 2024; v1 submitted 5 May, 2022;
originally announced May 2022.
-
S2F2: Self-Supervised High Fidelity Face Reconstruction from Monocular Image
Authors:
Abdallah Dib,
Junghyun Ahn,
Cedric Thebault,
Philippe-Henri Gosselin,
Louis Chevallier
Abstract:
We present a novel face reconstruction method capable of reconstructing detailed face geometry, spatially varying face reflectance from a single monocular image. We build our work upon the recent advances of DNN-based auto-encoders with differentiable ray tracing image formation, trained in self-supervised manner. While providing the advantage of learning-based approaches and real-time reconstruct…
▽ More
We present a novel face reconstruction method capable of reconstructing detailed face geometry, spatially varying face reflectance from a single monocular image. We build our work upon the recent advances of DNN-based auto-encoders with differentiable ray tracing image formation, trained in self-supervised manner. While providing the advantage of learning-based approaches and real-time reconstruction, the latter methods lacked fidelity. In this work, we achieve, for the first time, high fidelity face reconstruction using self-supervised learning only. Our novel coarse-to-fine deep architecture allows us to solve the challenging problem of decoupling face reflectance from geometry using a single image, at high computational speed. Compared to state-of-the-art methods, our method achieves more visually appealing reconstruction.
△ Less
Submitted 5 April, 2022; v1 submitted 15 March, 2022;
originally announced March 2022.
-
Epidemic Models for COVID-19 during the First Wave from February to May 2020: a Methodological Review
Authors:
Marie Garin,
Myrto Limnios,
Alice Nicolaï,
Ioannis Bargiotas,
Olivier Boulant,
Stephen Chick,
Amir Dib,
Theodoros Evgeniou,
Mathilde Fekom,
Argyris Kalogeratos,
Christophe Labourdette,
Anton Ovchinnikov,
Raphaël Porcher,
Camille Pouchol,
Nicolas Vayatis
Abstract:
We review epidemiological models for the propagation of the COVID-19 pandemic during the early months of the outbreak: from February to May 2020. The aim is to propose a methodological review that highlights the following characteristics: (i) the epidemic propagation models, (ii) the modeling of intervention strategies, (iii) the models and estimation procedures of the epidemic parameters and (iv)…
▽ More
We review epidemiological models for the propagation of the COVID-19 pandemic during the early months of the outbreak: from February to May 2020. The aim is to propose a methodological review that highlights the following characteristics: (i) the epidemic propagation models, (ii) the modeling of intervention strategies, (iii) the models and estimation procedures of the epidemic parameters and (iv) the characteristics of the data used. We finally selected 80 articles from open access databases based on criteria such as the theoretical background, the reproducibility, the incorporation of interventions strategies, etc. It mainly resulted to phenomenological, compartmental and individual-level models. A digital companion including an online sheet, a Kibana interface and a markdown document is proposed. Finally, this work provides an opportunity to witness how the scientific community reacted to this unique situation.
△ Less
Submitted 3 September, 2021;
originally announced September 2021.
-
Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing
Authors:
Abdallah Dib,
Cedric Thebault,
Junghyun Ahn,
Philippe-Henri Gosselin,
Christian Theobalt,
Louis Chevallier
Abstract:
Robust face reconstruction from monocular image in general lighting conditions is challenging. Methods combining deep neural network encoders with differentiable rendering have opened up the path for very fast monocular reconstruction of geometry, lighting and reflectance. They can also be trained in self-supervised manner for increased robustness and better generalization. However, their differen…
▽ More
Robust face reconstruction from monocular image in general lighting conditions is challenging. Methods combining deep neural network encoders with differentiable rendering have opened up the path for very fast monocular reconstruction of geometry, lighting and reflectance. They can also be trained in self-supervised manner for increased robustness and better generalization. However, their differentiable rasterization based image formation models, as well as underlying scene parameterization, limit them to Lambertian face reflectance and to poor shape details. More recently, ray tracing was introduced for monocular face reconstruction within a classic optimization-based framework and enables state-of-the art results. However optimization-based approaches are inherently slow and lack robustness. In this paper, we build our work on the aforementioned approaches and propose a new method that greatly improves reconstruction quality and robustness in general scenes. We achieve this by combining a CNN encoder with a differentiable ray tracer, which enables us to base the reconstruction on much more advanced personalized diffuse and specular albedos, a more sophisticated illumination model and a plausible representation of self-shadows. This enables to take a big leap forward in reconstruction quality of shape, appearance and lighting even in scenes with difficult illumination. With consistent face attributes reconstruction, our method leads to practical applications such as relighting and self-shadows removal. Compared to state-of-the-art methods, our results show improved accuracy and validity of the approach.
△ Less
Submitted 22 November, 2021; v1 submitted 29 March, 2021;
originally announced March 2021.
-
PhotoApp: Photorealistic Appearance Editing of Head Portraits
Authors:
Mallikarjun B R,
Ayush Tewari,
Abdallah Dib,
Tim Weyrich,
Bernd Bickel,
Hans-Peter Seidel,
Hanspeter Pfister,
Wojciech Matusik,
Louis Chevallier,
Mohamed Elgharib,
Christian Theobalt
Abstract:
Photorealistic editing of portraits is a challenging task as humans are very sensitive to inconsistencies in faces. We present an approach for high-quality intuitive editing of the camera viewpoint and scene illumination in a portrait image. This requires our method to capture and control the full reflectance field of the person in the image. Most editing approaches rely on supervised learning usi…
▽ More
Photorealistic editing of portraits is a challenging task as humans are very sensitive to inconsistencies in faces. We present an approach for high-quality intuitive editing of the camera viewpoint and scene illumination in a portrait image. This requires our method to capture and control the full reflectance field of the person in the image. Most editing approaches rely on supervised learning using training data captured with setups such as light and camera stages. Such datasets are expensive to acquire, not readily available and do not capture all the rich variations of in-the-wild portrait images. In addition, most supervised approaches only focus on relighting, and do not allow camera viewpoint editing. Thus, they only capture and control a subset of the reflectance field. Recently, portrait editing has been demonstrated by operating in the generative model space of StyleGAN. While such approaches do not require direct supervision, there is a significant loss of quality when compared to the supervised approaches. In this paper, we present a method which learns from limited supervised training data. The training images only include people in a fixed neutral expression with eyes closed, without much hair or background variations. Each person is captured under 150 one-light-at-a-time conditions and under 8 camera poses. Instead of training directly in the image space, we design a supervised problem which learns transformations in the latent space of StyleGAN. This combines the best of supervised learning and generative adversarial modeling. We show that the StyleGAN prior allows for generalisation to different expressions, hairstyles and backgrounds. This produces high-quality photorealistic results for in-the-wild images and significantly outperforms existing methods. Our approach can edit the illumination and pose simultaneously, and runs at interactive rates.
△ Less
Submitted 13 May, 2021; v1 submitted 13 March, 2021;
originally announced March 2021.
-
Practical Face Reconstruction via Differentiable Ray Tracing
Authors:
Abdallah Dib,
Gaurav Bharaj,
Junghyun Ahn,
Cédric Thébault,
Philippe-Henri Gosselin,
Marco Romeo,
Louis Chevallier
Abstract:
We present a differentiable ray-tracing based novel face reconstruction approach where scene attributes - 3D geometry, reflectance (diffuse, specular and roughness), pose, camera parameters, and scene illumination - are estimated from unconstrained monocular images. The proposed method models scene illumination via a novel, parameterized virtual light stage, which in-conjunction with differentiabl…
▽ More
We present a differentiable ray-tracing based novel face reconstruction approach where scene attributes - 3D geometry, reflectance (diffuse, specular and roughness), pose, camera parameters, and scene illumination - are estimated from unconstrained monocular images. The proposed method models scene illumination via a novel, parameterized virtual light stage, which in-conjunction with differentiable ray-tracing, introduces a coarse-to-fine optimization formulation for face reconstruction. Our method can not only handle unconstrained illumination and self-shadows conditions, but also estimates diffuse and specular albedos. To estimate the face attributes consistently and with practical semantics, a two-stage optimization strategy systematically uses a subset of parametric attributes, where subsequent attribute estimations factor those previously estimated. For example, self-shadows estimated during the first stage, later prevent its baking into the personalized diffuse and specular albedos in the second stage. We show the efficacy of our approach in several real-world scenarios, where face attributes can be estimated even under extreme illumination conditions. Ablation studies, analyses and comparisons against several recent state-of-the-art methods show improved accuracy and versatility of our approach. With consistent face attributes reconstruction, our method leads to several style -- illumination, albedo, self-shadow -- edit and transfer applications, as discussed in the paper.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
Quantized Variational Inference
Authors:
Amir Dib
Abstract:
We present Quantized Variational Inference, a new algorithm for Evidence Lower Bound maximization. We show how Optimal Voronoi Tesselation produces variance free gradients for ELBO optimization at the cost of introducing asymptotically decaying bias. Subsequently, we propose a Richardson extrapolation type method to improve the asymptotic bound. We show that using the Quantized Variational Inferen…
▽ More
We present Quantized Variational Inference, a new algorithm for Evidence Lower Bound maximization. We show how Optimal Voronoi Tesselation produces variance free gradients for ELBO optimization at the cost of introducing asymptotically decaying bias. Subsequently, we propose a Richardson extrapolation type method to improve the asymptotic bound. We show that using the Quantized Variational Inference framework leads to fast convergence for both score function and the reparametrized gradient estimator at a comparable computational cost. Finally, we propose several experiments to assess the performance of our method and its limitations.
△ Less
Submitted 4 November, 2020;
originally announced November 2020.
-
Face Reflectance and Geometry Modeling via Differentiable Ray Tracing
Authors:
Abdallah Dib,
Gaurav Bharaj,
Junghyun Ahn,
Cedric Thebault,
Philippe-Henri Gosselin,
Louis Chevallier
Abstract:
We present a novel strategy to automatically reconstruct 3D faces from monocular images with explicitly disentangled facial geometry (pose, identity and expression), reflectance (diffuse and specular albedo), and self-shadows. The scene lights are modeled as a virtual light stage with pre-oriented area lights used in conjunction with differentiable Monte-Carlo ray tracing to optimize the scene and…
▽ More
We present a novel strategy to automatically reconstruct 3D faces from monocular images with explicitly disentangled facial geometry (pose, identity and expression), reflectance (diffuse and specular albedo), and self-shadows. The scene lights are modeled as a virtual light stage with pre-oriented area lights used in conjunction with differentiable Monte-Carlo ray tracing to optimize the scene and face parameters. With correctly disentangled self-shadows and specular reflection parameters, we can not only obtain robust facial geometry reconstruction, but also gain explicit control over these parameters, with several practical applications. We can change facial expressions with accurate resultant self-shadows or relight the scene and obtain accurate specular reflection and several other parameter combinations.
△ Less
Submitted 3 October, 2019;
originally announced October 2019.
-
Instrumental Methods for Professional and Amateur Collaborations in Planetary Astronomy
Authors:
O. Mousis,
R. Hueso,
J. -P. Beaulieu,
S. Bouley,
B. Carry,
F. Colas,
A. Klotz,
C. Pellier,
J. -M. Petit,
P. Rousselot,
M. Ali Dib,
W. Beisker,
M. Birlan,
C. Buil,
A. Delsanti,
E. Frappa,
H. B. Hammel,
A. -C. Levasseur-Regourd,
G. S. Orton,
A. Sanchez-Lavega,
A. Santerne,
P. Tanga,
J. Vaubaillon,
B. Zanda,
D. Baratoux
, et al. (35 additional authors not shown)
Abstract:
Amateur contributions to professional publications have increased exponentially over the last decades in the field of Planetary Astronomy. Here we review the different domains of the field in which collaborations between professional and amateur astronomers are effective and regularly lead to scientific publications. We discuss the instruments, detectors, softwares and methodologies typically used…
▽ More
Amateur contributions to professional publications have increased exponentially over the last decades in the field of Planetary Astronomy. Here we review the different domains of the field in which collaborations between professional and amateur astronomers are effective and regularly lead to scientific publications. We discuss the instruments, detectors, softwares and methodologies typically used by amateur astronomers to collect the scientific data in the different domains of interest. Amateur contributions to the monitoring of planets and interplanetary matter, characterization of asteroids and comets, as well as the determination of the physical properties of Kuiper Belt Objects and exoplanets are discussed.
△ Less
Submitted 4 March, 2014; v1 submitted 15 May, 2013;
originally announced May 2013.