-
SAT-NGP : Unleashing Neural Graphics Primitives for Fast Relightable Transient-Free 3D reconstruction from Satellite Imagery
Authors:
Camille Billouard,
Dawa Derksen,
Emmanuelle Sarrazin,
Bruno Vallet
Abstract:
Current stereo-vision pipelines produce high accuracy 3D reconstruction when using multiple pairs or triplets of satellite images. However, these pipelines are sensitive to the changes between images that can occur as a result of multi-date acquisitions. Such variations are mainly due to variable shadows, reflexions and transient objects (cars, vegetation). To take such changes into account, Neura…
▽ More
Current stereo-vision pipelines produce high accuracy 3D reconstruction when using multiple pairs or triplets of satellite images. However, these pipelines are sensitive to the changes between images that can occur as a result of multi-date acquisitions. Such variations are mainly due to variable shadows, reflexions and transient objects (cars, vegetation). To take such changes into account, Neural Radiance Fields (NeRF) have recently been applied to multi-date satellite imagery. However, Neural methods are very compute-intensive, taking dozens of hours to learn, compared with minutes for standard stereo-vision pipelines. Following the ideas of Instant Neural Graphics Primitives we propose to use an efficient sampling strategy and multi-resolution hash encoding to accelerate the learning. Our model, Satellite Neural Graphics Primitives (SAT-NGP) decreases the learning time to 15 minutes while maintaining the quality of the 3D reconstruction.
△ Less
Submitted 27 March, 2024;
originally announced March 2024.
-
Radar Fields: An Extension of Radiance Fields to SAR
Authors:
Thibaud Ehret,
Roger Marí,
Dawa Derksen,
Nicolas Gasnier,
Gabriele Facciolo
Abstract:
Radiance fields have been a major breakthrough in the field of inverse rendering, novel view synthesis and 3D modeling of complex scenes from multi-view image collections. Since their introduction, it was shown that they could be extended to other modalities such as LiDAR, radio frequencies, X-ray or ultrasound. In this paper, we show that, despite the important difference between optical and synt…
▽ More
Radiance fields have been a major breakthrough in the field of inverse rendering, novel view synthesis and 3D modeling of complex scenes from multi-view image collections. Since their introduction, it was shown that they could be extended to other modalities such as LiDAR, radio frequencies, X-ray or ultrasound. In this paper, we show that, despite the important difference between optical and synthetic aperture radar (SAR) image formation models, it is possible to extend radiance fields to radar images thus presenting the first "radar fields". This allows us to learn surface models using only collections of radar images, similar to how regular radiance fields are learned and with the same computational complexity on average. Thanks to similarities in how both fields are defined, this work also shows a potential for hybrid methods combining both optical and SAR images.
△ Less
Submitted 20 December, 2023;
originally announced December 2023.
-
A 2D kinetic model for crowd dynamics with disease contagion
Authors:
Daewa Kim,
Annalisa Quaini
Abstract:
We focus on the modeling and simulation of an infectious disease spreading in a medium size population occupying a confined environment, such as an airport terminal, for short periods of time. Because of the size of the crowd and venue, we opt for a kinetic type model. The paper is divided into two parts. In the first part, we adopt the simplifying assumption that people's walking speed and direct…
▽ More
We focus on the modeling and simulation of an infectious disease spreading in a medium size population occupying a confined environment, such as an airport terminal, for short periods of time. Because of the size of the crowd and venue, we opt for a kinetic type model. The paper is divided into two parts. In the first part, we adopt the simplifying assumption that people's walking speed and direction are given. The resulting kinetic model features a variable that denotes the level of exposure to people spreading the disease, a parameter describing the contagion interaction strength, and a kernel function that is a decreasing function of the distance between a person and a spreading individual. Such model is tested on problems involving a small crowd in a square walkable domain. In the second part, ideas from the simplified model are used to incorporate disease spreading in a kinetic theory approach for crowd dynamics, i.e. the walking speed and direction result from interaction with other people and the venue.
△ Less
Submitted 23 July, 2021;
originally announced July 2021.
-
Vision-based Neural Scene Representations for Spacecraft
Authors:
Anne Mergy,
Gurvan Lecuyer,
Dawa Derksen,
Dario Izzo
Abstract:
In advanced mission concepts with high levels of autonomy, spacecraft need to internally model the pose and shape of nearby orbiting objects. Recent works in neural scene representations show promising results for inferring generic three-dimensional scenes from optical images. Neural Radiance Fields (NeRF) have shown success in rendering highly specular surfaces using a large number of images and…
▽ More
In advanced mission concepts with high levels of autonomy, spacecraft need to internally model the pose and shape of nearby orbiting objects. Recent works in neural scene representations show promising results for inferring generic three-dimensional scenes from optical images. Neural Radiance Fields (NeRF) have shown success in rendering highly specular surfaces using a large number of images and their pose. More recently, Generative Radiance Fields (GRAF) achieved full volumetric reconstruction of a scene from unposed images only, thanks to the use of an adversarial framework to train a NeRF. In this paper, we compare and evaluate the potential of NeRF and GRAF to render novel views and extract the 3D shape of two different spacecraft, the Soil Moisture and Ocean Salinity satellite of ESA's Living Planet Programme and a generic cube sat. Considering the best performances of both models, we observe that NeRF has the ability to render more accurate images regarding the material specularity of the spacecraft and its pose. For its part, GRAF generates precise novel views with accurate details even when parts of the satellites are shadowed while having the significant advantage of not needing any information about the relative pose.
△ Less
Submitted 11 May, 2021;
originally announced May 2021.
-
Shadow Neural Radiance Fields for Multi-view Satellite Photogrammetry
Authors:
Dawa Derksen,
Dario Izzo
Abstract:
We present a new generic method for shadow-aware multi-view satellite photogrammetry of Earth Observation scenes. Our proposed method, the Shadow Neural Radiance Field (S-NeRF) follows recent advances in implicit volumetric representation learning. For each scene, we train S-NeRF using very high spatial resolution optical images taken from known viewing angles. The learning requires no labels or s…
▽ More
We present a new generic method for shadow-aware multi-view satellite photogrammetry of Earth Observation scenes. Our proposed method, the Shadow Neural Radiance Field (S-NeRF) follows recent advances in implicit volumetric representation learning. For each scene, we train S-NeRF using very high spatial resolution optical images taken from known viewing angles. The learning requires no labels or shape priors: it is self-supervised by an image reconstruction loss. To accommodate for changing light source conditions both from a directional light source (the Sun) and a diffuse light source (the sky), we extend the NeRF approach in two ways. First, direct illumination from the Sun is modeled via a local light source visibility field. Second, indirect illumination from a diffuse light source is learned as a non-local color field as a function of the position of the Sun. Quantitatively, the combination of these factors reduces the altitude and color errors in shaded areas, compared to NeRF. The S-NeRF methodology not only performs novel view synthesis and full 3D shape estimation, it also enables shadow detection, albedo synthesis, and transient object filtering, without any explicit shape supervision.
△ Less
Submitted 20 April, 2021;
originally announced April 2021.
-
A kinetic theory approach to model crowd dynamics with disease contagion
Authors:
Daewa Kim,
Annalisa Quaini
Abstract:
We present some ideas on how to extend a kinetic type model for crowd dynamics to account for an infectious disease spreading. We focus on a medium size crowd occupying a confined environment where the disease is easily spread. The kinetic theory approach we choose uses tools of game theory to model the interactions of a person with the surrounding people and the environment and it features a para…
▽ More
We present some ideas on how to extend a kinetic type model for crowd dynamics to account for an infectious disease spreading. We focus on a medium size crowd occupying a confined environment where the disease is easily spread. The kinetic theory approach we choose uses tools of game theory to model the interactions of a person with the surrounding people and the environment and it features a parameter to represent the level of stress. It is known that people choose different walking strategies when subjected to fear or stressful situations. To demonstrate that our model for crowd dynamics could be used to reproduce realistic scenarios, we simulate passengers in one terminal of Hobby Airport in Houston. In order to model disease spreading in a walking crowd, we introduce a variable that denotes the level of exposure to people spreading the disease. In addition, we introduce a parameter that describes the contagion interaction strength and a kernel function that is a decreasing function of the distance between a person and a spreading individual. We test our contagion model on a problem involving a small crowd walking through a corridor.
△ Less
Submitted 2 April, 2021; v1 submitted 28 March, 2021;
originally announced March 2021.
-
A kinetic theory approach for 2D crowd dynamics with emotional contagion
Authors:
Daewa Kim,
Kaylie O'Connell,
William Ott,
Annalisa Quaini
Abstract:
In this paper, we present a computational modeling approach for the dynamics of human crowds, where the spreading of an emotion (specifically fear) has an influence on the pedestrians' behavior. Our approach is based on the methods of the kinetic theory of active particles. The model allows us to weight between two competing behaviors depending on fear level: the search for less congested areas an…
▽ More
In this paper, we present a computational modeling approach for the dynamics of human crowds, where the spreading of an emotion (specifically fear) has an influence on the pedestrians' behavior. Our approach is based on the methods of the kinetic theory of active particles. The model allows us to weight between two competing behaviors depending on fear level: the search for less congested areas and the tendency to follow the stream unconsciously (herding). The fear level of each pedestrian influences her walking speed and is influenced by the fear levels of her neighbors. Numerically, we solve our pedestrian model with emotional contagion using an operator splitting scheme. We simulate evacuation scenarios involving two groups of interacting pedestrians to assess how domain geometry and the details of fear propagation impact evacuation dynamics. Further, we reproduce the evacuation dynamics of an experimental study involving distressed ants.
△ Less
Submitted 17 February, 2021; v1 submitted 15 December, 2020;
originally announced December 2020.
-
Coupling kinetic theory approaches for pedestrian dynamics and disease contagion in a confined environment
Authors:
Daewa Kim,
Annalisa Quaini
Abstract:
The goal of this work is to study an infectious disease spreading in a medium size population occupying a confined environment. For this purpose, we consider a kinetic theory approach to model crowd dynamics in bounded domains and couple it to a kinetic equation to model contagion. The interactions of a person with other pedestrians and the environment are modeled by using tools of game theory. Th…
▽ More
The goal of this work is to study an infectious disease spreading in a medium size population occupying a confined environment. For this purpose, we consider a kinetic theory approach to model crowd dynamics in bounded domains and couple it to a kinetic equation to model contagion. The interactions of a person with other pedestrians and the environment are modeled by using tools of game theory. The pedestrian dynamics model allows to weight between two competing behaviors: the search for less congested areas and the tendency to follow the stream unconsciously in a panic situation. Each person in the system has a contagion level that is affected by their neighborhood. For the numerical solution of the coupled problem, we propose a numerical algorithm that at every time step solves one crowd dynamics problem and one contagion problem, i.e. with no subiterations between the two. We test our coupled model on a problem involving a small crowd walking through a corridor.
△ Less
Submitted 26 April, 2020; v1 submitted 16 March, 2020;
originally announced March 2020.
-
SENSEI: Direct-Detection Constraints on Sub-GeV Dark Matter from a Shallow Underground Run Using a Prototype Skipper-CCD
Authors:
Orr Abramoff,
Liron Barak,
Itay M. Bloch,
Luke Chaplinsky,
Michael Crisler,
Dawa,
Alex Drlica-Wagner,
Rouven Essig,
Juan Estrada,
Erez Etzion,
Guillermo Fernandez,
Daniel Gift,
Joseph Taenzer,
Javier Tiffenberg,
Miguel Sofo Haro,
Tomer Volansky,
Tien-Tien Yu
Abstract:
We present new direct-detection constraints on eV-to-GeV dark matter interacting with electrons using a prototype detector of the Sub-Electron-Noise Skipper-CCD Experimental Instrument. The results are based on data taken in the MINOS cavern at the Fermi National Accelerator Laboratory. We focus on data obtained with two distinct readout strategies. For the first strategy, we read out the Skipper-…
▽ More
We present new direct-detection constraints on eV-to-GeV dark matter interacting with electrons using a prototype detector of the Sub-Electron-Noise Skipper-CCD Experimental Instrument. The results are based on data taken in the MINOS cavern at the Fermi National Accelerator Laboratory. We focus on data obtained with two distinct readout strategies. For the first strategy, we read out the Skipper-CCD continuously, accumulating an exposure of 0.177 gram-days. While we observe no events containing three or more electrons, we find a large one- and two-electron background event rate, which we attribute to spurious events induced by the amplifier in the Skipper-CCD readout stage. For the second strategy, we take five sets of data in which we switch off all amplifiers while exposing the Skipper-CCD for 120k seconds, and then read out the data through the best prototype amplifier. We find a one-electron event rate of (3.51 +- 0.10) x 10^(-3) events/pixel/day, which is almost two orders of magnitude lower than the one-electron event rate observed in the continuous-readout data, and a two-electron event rate of (3.18 +0.86 -0.55) x 10^(-5) events/pixel/day. We again observe no events containing three or more electrons, for an exposure of 0.069 gram-days. We use these data to derive world-leading constraints on dark matter-electron scattering for masses between 500 keV to 5 MeV, and on dark-photon dark matter being absorbed by electrons for a range of masses below 12.4 eV.
△ Less
Submitted 29 January, 2019;
originally announced January 2019.
-
A Kinetic Theory Approach to Model Pedestrian Dynamics in Bounded Domains with Obstacles
Authors:
Daewa Kim,
Annalisa Quaini
Abstract:
We consider a kinetic theory approach to model the evacuation of a crowd from bounded domains. The interactions of a person with other pedestrians and the environment, which includes walls, exits, and obstacles, are modeled by using tools of game theory and are transferred to the crowd dynamics. The model allows to weight between two competing behaviors: the search for less congested areas and the…
▽ More
We consider a kinetic theory approach to model the evacuation of a crowd from bounded domains. The interactions of a person with other pedestrians and the environment, which includes walls, exits, and obstacles, are modeled by using tools of game theory and are transferred to the crowd dynamics. The model allows to weight between two competing behaviors: the search for less congested areas and the tendency to follow the stream unconsciously in a panic situation. For the numerical approximation of the solution to our model, we apply an operator splitting scheme which breaks the problem into two pure advection problems and a problem involving the interactions. We compare our numerical results against the data reported in a recent empirical study on evacuation from a room with two exits. For medium and medium-to-large groups of people we achieve good agreement between the computed average people density and flow rate and the respective measured quantities. Through a series of numerical tests we also show that our approach is capable of handling evacuation from a room with one or more exits with variable size, with and without obstacles, and can reproduce lane formation in bidirectional flow in a corridor.
△ Less
Submitted 13 June, 2019; v1 submitted 22 January, 2019;
originally announced January 2019.
-
A new proof for small cancellation conditions of 2-bridge link groups
Authors:
Daewa Kim,
Donghi Lee
Abstract:
In this paper, we give a simple proof for the small cancellation conditions of the upper presentations of 2-bridge link groups, which holds the key to the proof of the main result of [1]. We also give an alternative proof of the main result of [1] using transfinite induction.
In this paper, we give a simple proof for the small cancellation conditions of the upper presentations of 2-bridge link groups, which holds the key to the proof of the main result of [1]. We also give an alternative proof of the main result of [1] using transfinite induction.
△ Less
Submitted 19 April, 2012;
originally announced April 2012.
