-
RNb-NeuS: Reflectance and Normal-based Multi-View 3D Reconstruction
Authors:
Baptiste Brument,
Robin Bruneau,
Yvain Quéau,
Jean Mélou,
François Bernard Lauze,
Jean-Denis,
Jean-Denis Durou,
Lilian Calvet
Abstract:
This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal, considering them as a vector of radiances rendered under simulated, varying illumination. This re-parameterization enables the seamless integration of reflectance and…
▽ More
This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal, considering them as a vector of radiances rendered under simulated, varying illumination. This re-parameterization enables the seamless integration of reflectance and normal maps as input data in neural volume rendering-based 3D reconstruction while preserving a single optimization objective. In contrast, recent multi-view photometric stereo (MVPS) methods depend on multiple, potentially conflicting objectives. Despite its apparent simplicity, our proposed approach outperforms state-of-the-art approaches in MVPS benchmarks across F-score, Chamfer distance, and mean angular error metrics. Notably, it significantly improves the detailed 3D reconstruction of areas with high curvature or low visibility.
△ Less
Submitted 29 March, 2024; v1 submitted 2 December, 2023;
originally announced December 2023.
-
Time calibration studies for the Timepix3 hybrid pixel detector in electron microscopy
Authors:
Yves Auad,
Jassem Baaboura,
Jean-Denis Blazit,
Marcel Tencé,
Odile Stéphan,
Mathieu Kociak,
Luiz H. G. Tizei
Abstract:
Direct electron detection is currently revolutionizing many fields of electron microscopy due to its lower noise, its reduced point-spread function, and its increased quantum efficiency. More specifically to this work, Timepix3 is a hybrid-pixel direct electron detector capable of outputting temporal information of individual hits in its pixel array. Its architecture results in a data-driven detec…
▽ More
Direct electron detection is currently revolutionizing many fields of electron microscopy due to its lower noise, its reduced point-spread function, and its increased quantum efficiency. More specifically to this work, Timepix3 is a hybrid-pixel direct electron detector capable of outputting temporal information of individual hits in its pixel array. Its architecture results in a data-driven detector, also called event-based, in which individual hits trigger the data off the chip for readout as fast as possible. The presence of a pixel threshold value results in an almost readout-noise-free detector while also defining the hit time of arrival and the time the signal stays over the pixel threshold. In this work, we have performed various experiments to calibrate and correct the Timepix3 temporal information, specifically in the context of electron microscopy. These include the energy calibration, and the time-walk and pixel delay corrections, reaching an average temporal resolution throughout the entire pixel matrix of $1.37 \pm 0.04$ ns. Additionally, we have also studied cosmic rays tracks to characterize the charge dynamics along the volume of the sensor layer, allowing us to estimate the limits of the detector's temporal response depending on different bias voltages, sensor thickness, and the electron beam ionization volume. We have estimated the uncertainty due to the ionization volume ranging from about 0.8 ns for 60 keV electrons to 8.8 ns for 300 keV electrons.
△ Less
Submitted 28 August, 2023;
originally announced August 2023.
-
Excitation's lifetime extracted from electron-photon (EELS-CL) nanosecond-scale temporal coincidences
Authors:
Nadezda Varkentina,
Yves Auad,
Steffi Y. Woo,
Florian Castioni,
Jean-Denis Blazit,
Marcel Tencé,
Huan-Cheng Chang,
Jeson Chen,
Kenji Watanabe,
Takashi Taniguchi,
Mathieu Kociak,
Luiz H. G. Tizei
Abstract:
Electron-photon temporal correlations in electron energy loss (EELS) and cathodoluminescence (CL) spectroscopies have recently been used to measure the relative quantum efficiency of materials. This combined spectroscopy, named Cathodoluminescence excitation spectroscopy (CLE), allows the identification of excitation and decay channels which are hidden in average measurements. Here, we demonstrate…
▽ More
Electron-photon temporal correlations in electron energy loss (EELS) and cathodoluminescence (CL) spectroscopies have recently been used to measure the relative quantum efficiency of materials. This combined spectroscopy, named Cathodoluminescence excitation spectroscopy (CLE), allows the identification of excitation and decay channels which are hidden in average measurements. Here, we demonstrate that CLE can also be used to measure excitation's decay time. In addition, the decay time as a function of the excitation energy is accessed, as the energy for each electron-photon pair is probed. We used two well-known insulating materials to characterize this technique, nanodiamonds with \textit{NV$^0$} defect emission and h-BN with a \textit{4.1 eV} defect emission. Both also exhibit marked transition radiations, whose extremely short decay times can be used to characterize the instrumental response function. It is found to be typically 2 ns, in agreement with the expected limit of the EELS detector temporal resolution. The measured lifetimes of \textit{NV$^0$} centers in diamond nanoparticles (20 to 40 ns) and \textit{4.1 eV} defect in h-BN flakes ($<$ 2 ns) matches those reported for those materials previously.
△ Less
Submitted 11 November, 2023; v1 submitted 27 June, 2023;
originally announced June 2023.
-
$μ$eV electron spectromicroscopy using free-space light
Authors:
Yves Auad,
Eduardo J. C. Dias,
Marcel Tencé,
Jean-Denis Blazit,
Xiaoyan Li,
Luiz Fernando Zagonel,
Odile Stéphan,
Luiz H. G. Tizei,
F. Javier García de Abajo,
Mathieu Kociak
Abstract:
The synergy between free electrons and light has recently been leveraged to reach an impressive degree of simultaneous spatial and spectral resolution, enabling applications in microscopy and quantum optics. However, the required combination of electron optics and light injection into the spectrally narrow modes of arbitrary specimens remains a challenge. Here, we demonstrate microelectronvolt spe…
▽ More
The synergy between free electrons and light has recently been leveraged to reach an impressive degree of simultaneous spatial and spectral resolution, enabling applications in microscopy and quantum optics. However, the required combination of electron optics and light injection into the spectrally narrow modes of arbitrary specimens remains a challenge. Here, we demonstrate microelectronvolt spectral resolution in the nanoscale map** of photonic modes with quality factors as high as 10$^4$. We rely on mode-matching of a tightly focused laser beam to whispering gallery modes to achieve a 10$^8$-fold increase in light-electron coupling efficiency. By adapting the shape and size of free-space optical beams to address specific physical questions, our approach allows us to interrogate any type of photonic structure with unprecedented spectral and spatial detail
△ Less
Submitted 23 December, 2022;
originally announced December 2022.
-
Cathodoluminescence excitation spectroscopy: nanoscale imaging of excitation pathways
Authors:
Nadezda Varkentina,
Yves Auad,
Steffi Y. Woo,
Alberto Zobelli,
Jean-Denis Blazit,
Xiaoyan Li,
Marcel Tencé,
Kenji Watanabe,
Takashi Taniguchi,
Odile Stéphan,
Mathieu Kociak,
Luiz H. G. Tizei
Abstract:
Following the lifespan of optical excitations from their creation to decay into photons is crucial in understanding materials optical properties. Macroscopically, techniques such as the photoluminescence excitation spectroscopy provide unique information on the photophysics of materials with applications as diverse as quantum optics or photovoltaics. Materials excitation and emission pathways are…
▽ More
Following the lifespan of optical excitations from their creation to decay into photons is crucial in understanding materials optical properties. Macroscopically, techniques such as the photoluminescence excitation spectroscopy provide unique information on the photophysics of materials with applications as diverse as quantum optics or photovoltaics. Materials excitation and emission pathways are affected by nanometer scale variations directly impacting devices performances. However, they cannot be directly accessed, despite techniques, such as optical spectroscopies with free electrons, having the relevant spatial, spectral or time resolution. Here, we explore optical excitation creation and decay in two representative optical devices: plasmonic nanoparticles and luminescent 2D layers. The analysis of the energy lost by an exciting electron that is coincident in time with a visible-UV photon unveils the decay pathways from excitation towards light emission. This is demonstrated for phase-locked interactions, such as in localized surface plasmons, and non-phase-locked ones, such as the light emission by individual point defects. This newly developed cathodoluminescence excitation spectroscopy images energy transfer pathways at the nanometer scale. It widens the toolset available to explore nanoscale materials.
△ Less
Submitted 8 July, 2022; v1 submitted 25 February, 2022;
originally announced February 2022.
-
Event-based hyperspectral EELS: towards nanosecond temporal resolution
Authors:
Yves Auad,
Michael Walls,
Jean-Denis Blazit,
Odile Stéphan,
Luiz H. G. Tizei,
Mathieu Kociak,
Francisco De la Peña,
Marcel Tencé
Abstract:
The acquisition of a hyperspectral image is nowadays a standard technique used in the scanning transmission electron microscope. It relates the spatial position of the electron probe to the spectral data associated with it. In the case of electron energy loss spectroscopy (EELS), frame-based hyperspectral acquisition is much slower than the achievable rastering time of the scan unit (SU), which so…
▽ More
The acquisition of a hyperspectral image is nowadays a standard technique used in the scanning transmission electron microscope. It relates the spatial position of the electron probe to the spectral data associated with it. In the case of electron energy loss spectroscopy (EELS), frame-based hyperspectral acquisition is much slower than the achievable rastering time of the scan unit (SU), which sometimes leads to undesirable effects in the sample, such as electron irradiation damage, that goes unperceived during frame acquisition. In this work, we have developed an event-based hyperspectral EELS by using a Timepix3 application-specific integrated circuit detector with two supplementary time-to-digital (TDC) lines embedded. In such a system, electron events are characterized by their positional and temporal coordinates, but TDC events only by temporal ones. By sending reference signals from the SU to the TDC line, it is possible to reconstruct the entire spectral image with SU-limited scanning pixel dwell time and thus acquire, with no additional cost, a hyperspectral image at the same rate as that of a single channel detector, such as annular dark-field. To exemplify the possibilities behind event-based hyperspectral EELS, we have studied the decomposition of calcite (CaCO$_3$) into calcium oxide (CaO) and carbon dioxide (CO$_2$) under the electron beam irradiation.
△ Less
Submitted 3 May, 2022; v1 submitted 4 October, 2021;
originally announced October 2021.
-
Modelling the relationship between deformed microstructures and static recrystallization textures: application to ferritic stainless steels
Authors:
Arthur Després,
Jean-Denis Mithieux,
Chad. W. Sinclair
Abstract:
We present an original approach for predicting the static recrystallization texture development during annealing of deformed crystalline materials. The microstructure is considered as a population of subgrains and grains whose sizes and boundary properties determine their growth rates. The model input parameters are measured directly on orientation maps maps of the deformed microstructure measured…
▽ More
We present an original approach for predicting the static recrystallization texture development during annealing of deformed crystalline materials. The microstructure is considered as a population of subgrains and grains whose sizes and boundary properties determine their growth rates. The model input parameters are measured directly on orientation maps maps of the deformed microstructure measured by electron backscattered diffraction. The anisotropy in subgrain properties then drives a competitive growth giving rise to the recrystallization texture development. The method is illustrated by a simulation of the static recrystallization texture development in a hot rolled ferritic stainless steel. The model predictions are found to be in good agreement with the experimental measurements, and allow for an in-depth investigation of the formation sequence of the recrystallization texture. A distinction is established between the texture components which develop due to favorable growth conditions and those develo** due to their predominance in the prior deformed state. The high fraction of alpha fibre orientations in the recrystallized state is shown to be a consequence of their predominance in the deformed microstructure rather than a preferred growth mechanism. A close control of the fraction of these orientations before annealing is thus required to minimize their presence in the recrystallized state.
△ Less
Submitted 18 February, 2021;
originally announced February 2021.
-
Nanoscale modification of WS$_2$ trion emission by its local electromagnetic environment
Authors:
Noémie Bonnet,
Hae Yeon Lee,
Fuhui Shao,
Steffi Y. Woo,
Jean-Denis Blazit,
Kenji Watanabe,
Takashi Taniguchi,
Alberto Zobelli,
Odile Stéphan,
Mathieu Kociak,
Silvija Gradecak-Garaj,
Luiz H. G. Tizei
Abstract:
Structural, electronic, and chemical nanoscale modifications of transition metal dichalcogenide monolayers alter their optical properties, including the generation of single photon emitters. A key missing element for complete control is a direct spatial correlation of optical response to nanoscale modifications, due to the large gap in spatial resolution between optical spectroscopy and nanometer…
▽ More
Structural, electronic, and chemical nanoscale modifications of transition metal dichalcogenide monolayers alter their optical properties, including the generation of single photon emitters. A key missing element for complete control is a direct spatial correlation of optical response to nanoscale modifications, due to the large gap in spatial resolution between optical spectroscopy and nanometer resolved techniques, such as transmission electron microscopy or scanning tunneling microscopy. Here, we bridge this gap by obtaining nanometer resolved optical properties using electron spectroscopy, specifically electron energy loss spectroscopy (EELS) for absorption and cathodoluminescence (CL) for emission, which were directly correlated to chemical and structural information. In an h-BN/WS$_2$/h-BN heterostructure, we observe local modulation of the trion (X$^{-}$) emission due to tens of nanometer wide dielectric patches, while the exciton, X$_A$, does not follow the same modulation. Trion emission also increases in regions where charge accumulation occurs, close to the carbon film supporting the heterostructures. Finally, localized exciton emission (L) detection is not correlated to strain variations above 1 $\%$, suggesting point defects might be involved in their formations.
△ Less
Submitted 12 February, 2021; v1 submitted 11 February, 2021;
originally announced February 2021.
-
Doubly robust treatment effect estimation with missing attributes
Authors:
Imke Mayer,
Erik Sverdrup,
Tobias Gauss,
Jean-Denis Moyer,
Stefan Wager,
Julie Josse
Abstract:
Missing attributes are ubiquitous in causal inference, as they are in most applied statistical work. In this paper, we consider various sets of assumptions under which causal inference is possible despite missing attributes and discuss corresponding approaches to average treatment effect estimation, including generalized propensity score methods and multiple imputation. Across an extensive simulat…
▽ More
Missing attributes are ubiquitous in causal inference, as they are in most applied statistical work. In this paper, we consider various sets of assumptions under which causal inference is possible despite missing attributes and discuss corresponding approaches to average treatment effect estimation, including generalized propensity score methods and multiple imputation. Across an extensive simulation study, we show that no single method systematically out-performs others. We find, however, that doubly robust modifications of standard methods for average treatment effect estimation with missing data repeatedly perform better than their non-doubly robust baselines; for example, doubly robust generalized propensity score methods beat inverse-weighting with the generalized propensity score. This finding is reinforced in an analysis of an observations study on the effect on mortality of tranexamic acid administration among patients with traumatic brain injury in the context of critical care management. Here, doubly robust estimators recover confidence intervals that are consistent with evidence from randomized trials, whereas non-doubly robust estimators do not.
△ Less
Submitted 22 May, 2020; v1 submitted 23 October, 2019;
originally announced October 2019.
-
Tailored nanoscale plasmon-enhanced vibrational electron spectroscopy
Authors:
Luiz H. G. Tizei,
Vahagn Mkhitaryan,
Hugo Lourenço-Martins,
Leonardo Scarabelli,
Kenji Watanabe,
Takashi Taniguchi,
Marcel Tencé,
Jean-Denis Blazit,
Xiaoyan Li,
Alexandre Gloter,
Alberto Zobelli,
Luis Líz-Marzan,
F. Javier García de Abajo,
Odile Stephan,
Mathieu Kociak
Abstract:
Vibrational optical spectroscopies can be enhanced by surface plasmons to reach molecular-sized limits of detection and characterization. The level of enhancement strongly depends on microscopic details of the sample that are generally missed by macroscopic techniques. Here we investigate phonons in h-BN by coupling them to silver-nanowire plasmons, whose energy is tuned by modifying the nanowire…
▽ More
Vibrational optical spectroscopies can be enhanced by surface plasmons to reach molecular-sized limits of detection and characterization. The level of enhancement strongly depends on microscopic details of the sample that are generally missed by macroscopic techniques. Here we investigate phonons in h-BN by coupling them to silver-nanowire plasmons, whose energy is tuned by modifying the nanowire length. Specifically, we use electron beam milling to accurately and iteratively change the nanowire length, followed by electron energy-loss spectroscopy to reveal the plasmon-enhanced vibrational features of h-BN. This allows us to investigate otherwise hidden bulk phonons and observe strong plasmon-phonon coupling. The new milling-and-spectroscopy technique holds great potential for resolving vibrational features in material nanostructures.
△ Less
Submitted 29 May, 2019;
originally announced May 2019.
-
Few self-involved agents among BC agents can lead to polarized local or global consensus
Authors:
Sylvie Huet,
Jean-Denis Mathias
Abstract:
Social issues are generally discussed by highly-involved and less-involved people to build social norms defining what has to be thought and done about them. As self-involved agents share different attitude dynamics to other agents Wood, Pool et al, 1996, we study the emergence and evolution of norms through an individual-based model involving these two types of agents. The dynamics of self-involve…
▽ More
Social issues are generally discussed by highly-involved and less-involved people to build social norms defining what has to be thought and done about them. As self-involved agents share different attitude dynamics to other agents Wood, Pool et al, 1996, we study the emergence and evolution of norms through an individual-based model involving these two types of agents. The dynamics of self-involved agents is drawn from Huet and Deffuant, 2010, and the dynamics of others, from Deffuant et al, 2001. The attitude of an agent is represented as a segment on a continuous attitudinal space. Two agents are close if their attitude segments share sufficient overlap. Our agents discuss two different issues, one of which, called main issue, is more important for the self-involved agents than the other, called secondary issue. Self-involved agents are attracted on both issues if they are close on main issue, but shift away from their peer's opinion if they are only close on secondary issue. Differently, non-self-involved agents are attracted by other agents when they are close on both the main and secondary issues. We observe the emergence of various types of extreme minor clusters. In one or different groups of attitudes, they can lead to an already-built moderate norm or a norm polarized on secondary and/or main issues. They can also push disagreeing agents gathered in different groups to a global moderate consensus.
△ Less
Submitted 25 May, 2018;
originally announced May 2018.
-
A Variational Approach to Shape-from-shading Under Natural Illumination
Authors:
Yvain Quéau,
Jean Mélou,
Fabien Castan,
Daniel Cremers,
Jean-Denis Durou
Abstract:
A numerical solution to shape-from-shading under natural illumination is presented. It builds upon an augmented Lagrangian approach for solving a generic PDE-based shape-from-shading model which handles directional or spherical harmonic lighting, orthographic or perspective projection, and greylevel or multi-channel images. Real-world applications to shading-aware depth map denoising, refinement a…
▽ More
A numerical solution to shape-from-shading under natural illumination is presented. It builds upon an augmented Lagrangian approach for solving a generic PDE-based shape-from-shading model which handles directional or spherical harmonic lighting, orthographic or perspective projection, and greylevel or multi-channel images. Real-world applications to shading-aware depth map denoising, refinement and completion are presented.
△ Less
Submitted 3 December, 2017; v1 submitted 29 September, 2017;
originally announced September 2017.
-
Variational Reflectance Estimation from Multi-view Images
Authors:
Jean Mélou,
Yvain Quéau,
Jean-Denis Durou,
Fabien Castan,
Daniel Cremers
Abstract:
We tackle the problem of reflectance estimation from a set of multi-view images, assuming known geometry. The approach we put forward turns the input images into reflectance maps, through a robust variational method. The variational model comprises an image-driven fidelity term and a term which enforces consistency of the reflectance estimates with respect to each view. If illumination is fixed ac…
▽ More
We tackle the problem of reflectance estimation from a set of multi-view images, assuming known geometry. The approach we put forward turns the input images into reflectance maps, through a robust variational method. The variational model comprises an image-driven fidelity term and a term which enforces consistency of the reflectance estimates with respect to each view. If illumination is fixed across the views, then reflectance estimation remains under-constrained: a regularization term, which ensures piecewise-smoothness of the reflectance, is thus used. Reflectance is parameterized in the image domain, rather than on the surface, which makes the numerical solution much easier, by resorting to an alternating majorization-minimization approach. Experiments on both synthetic and real datasets are carried out to validate the proposed strategy.
△ Less
Submitted 23 January, 2018; v1 submitted 25 September, 2017;
originally announced September 2017.
-
Variational Methods for Normal Integration
Authors:
Yvain Quéau,
Jean-Denis Durou,
Jean-François Aujol
Abstract:
The need for an efficient method of integration of a dense normal field is inspired by several computer vision tasks, such as shape-from-shading, photometric stereo, deflectometry, etc. Inspired by edge-preserving methods from image processing, we study in this paper several variational approaches for normal integration, with a focus on non-rectangular domains, free boundary and depth discontinuit…
▽ More
The need for an efficient method of integration of a dense normal field is inspired by several computer vision tasks, such as shape-from-shading, photometric stereo, deflectometry, etc. Inspired by edge-preserving methods from image processing, we study in this paper several variational approaches for normal integration, with a focus on non-rectangular domains, free boundary and depth discontinuities. We first introduce a new discretization for quadratic integration, which is designed to ensure both fast recovery and the ability to handle non-rectangular domains with a free boundary. Yet, with this solver, discontinuous surfaces can be handled only if the scene is first segmented into pieces without discontinuity. Hence, we then discuss several discontinuity-preserving strategies. Those inspired, respectively, by the Mumford-Shah segmentation method and by anisotropic diffusion, are shown to be the most effective for recovering discontinuities.
△ Less
Submitted 18 September, 2017;
originally announced September 2017.
-
Normal Integration: A Survey
Authors:
Yvain Quéau,
Jean-Denis Durou,
Jean-François Aujol
Abstract:
The need for efficient normal integration methods is driven by several computer vision tasks such as shape-from-shading, photometric stereo, deflectometry, etc. In the first part of this survey, we select the most important properties that one may expect from a normal integration method, based on a thorough study of two pioneering works by Horn and Brooks [28] and by Frankot and Chellappa [19]. Ap…
▽ More
The need for efficient normal integration methods is driven by several computer vision tasks such as shape-from-shading, photometric stereo, deflectometry, etc. In the first part of this survey, we select the most important properties that one may expect from a normal integration method, based on a thorough study of two pioneering works by Horn and Brooks [28] and by Frankot and Chellappa [19]. Apart from accuracy, an integration method should at least be fast and robust to a noisy normal field. In addition, it should be able to handle several types of boundary condition, including the case of a free boundary, and a reconstruction domain of any shape i.e., which is not necessarily rectangular. It is also much appreciated that a minimum number of parameters have to be tuned, or even no parameter at all. Finally, it should preserve the depth discontinuities. In the second part of this survey, we review most of the existing methods in view of this analysis, and conclude that none of them satisfies all of the required properties. This work is complemented by a companion paper entitled Variational Methods for Normal Integration, in which we focus on the problem of normal integration in the presence of depth discontinuities, a problem which occurs as soon as there are occlusions.
△ Less
Submitted 18 September, 2017;
originally announced September 2017.
-
LED-based Photometric Stereo: Modeling, Calibration and Numerical Solution
Authors:
Yvain Quéau,
Bastien Durix,
Tao Wu,
Daniel Cremers,
François Lauze,
Jean-Denis Durou
Abstract:
We conduct a thorough study of photometric stereo under nearby point light source illumination, from modeling to numerical solution, through calibration. In the classical formulation of photometric stereo, the luminous fluxes are assumed to be directional, which is very difficult to achieve in practice. Rather, we use light-emitting diodes (LEDs) to illuminate the scene to reconstruct. Such point…
▽ More
We conduct a thorough study of photometric stereo under nearby point light source illumination, from modeling to numerical solution, through calibration. In the classical formulation of photometric stereo, the luminous fluxes are assumed to be directional, which is very difficult to achieve in practice. Rather, we use light-emitting diodes (LEDs) to illuminate the scene to reconstruct. Such point light sources are very convenient to use, yet they yield a more complex photometric stereo model which is arduous to solve. We first derive in a physically sound manner this model, and show how to calibrate its parameters. Then, we discuss two state-of-the-art numerical solutions. The first one alternatingly estimates the albedo and the normals, and then integrates the normals into a depth map. It is shown empirically to be independent from the initialization, but convergence of this sequential approach is not established. The second one directly recovers the depth, by formulating photometric stereo as a system of PDEs which are partially linearized using image ratios. Although the sequential approach is avoided, initialization matters a lot and convergence is not established either. Therefore, we introduce a provably convergent alternating reweighted least-squares scheme for solving the original system of PDEs, without resorting to image ratios for linearization. Finally, we extend this study to the case of RGB images.
△ Less
Submitted 4 September, 2017; v1 submitted 4 July, 2017;
originally announced July 2017.
-
From lakes and glades to viability algorithms: Automatic classification of system states according to the Topology of Sustainable Management
Authors:
Tim Kittel,
Finn Müller-Hansen,
Rebekka Koch,
Jobst Heitzig,
Guillaume Deffuant,
Jean-Denis Mathias,
Jürgen Kurths
Abstract:
The framework Topology of Sustainable Management by Heitzig et al. (2016) distinguishes qualitatively different regions in state space of dynamical models representing manageable systems with default dynamics. In this paper, we connect the framework to viability theory by defining its main components based on viability kernels and capture basins. This enables us to use the Saint-Pierre algorithm t…
▽ More
The framework Topology of Sustainable Management by Heitzig et al. (2016) distinguishes qualitatively different regions in state space of dynamical models representing manageable systems with default dynamics. In this paper, we connect the framework to viability theory by defining its main components based on viability kernels and capture basins. This enables us to use the Saint-Pierre algorithm to visualize the shape and calculate the volume of the main partition of the Topology of Sustainable Management. We present an extension of the algorithm to compute implicitly defined capture basins. To demonstrate the applicability of our approach, we introduce a low-complexity model coupling environmental and socioeconomic dynamics. With this example, we also address two common estimation problems: an unbounded state space and highly varying time scales. We show that appropriate coordinate transformations can solve these problems. It is thus demonstrated how algorithmic approaches from viability theory can be used to get a better understanding of the state space of manageable dynamical systems.
△ Less
Submitted 1 December, 2020; v1 submitted 8 June, 2017;
originally announced June 2017.
-
Dense Multi-view 3D-reconstruction Without Dense Correspondences
Authors:
Yvain Quéau,
Jean Mélou,
Jean-Denis Durou,
Daniel Cremers
Abstract:
We introduce a variational method for multi-view shape-from-shading under natural illumination. The key idea is to couple PDE-based solutions for single-image based shape-from-shading problems across multiple images and multiple color channels by means of a variational formulation. Rather than alternatingly solving the individual SFS problems and optimizing the consistency across images and channe…
▽ More
We introduce a variational method for multi-view shape-from-shading under natural illumination. The key idea is to couple PDE-based solutions for single-image based shape-from-shading problems across multiple images and multiple color channels by means of a variational formulation. Rather than alternatingly solving the individual SFS problems and optimizing the consistency across images and channels which is known to lead to suboptimal results, we propose an efficient solution of the coupled problem by means of an ADMM algorithm. In numerous experiments on both simulated and real imagery, we demonstrate that the proposed fusion of multiple-view reconstruction and shape-from-shading provides highly accurate dense reconstructions without the need to compute dense correspondences. With the proposed variational integration across multiple views shape-from-shading techniques become applicable to challenging real-world reconstruction problems, giving rise to highly detailed geometry even in areas of smooth brightness variation and lacking texture.
△ Less
Submitted 2 April, 2017;
originally announced April 2017.
-
Fast and Accurate Surface Normal Integration on Non-Rectangular Domains
Authors:
Martin Bähr,
Michael Breuß,
Yvain Quéau,
Ali Sharifi Boroujerdi,
Jean-Denis Durou
Abstract:
The integration of surface normals for the purpose of computing the shape of a surface in 3D space is a classic problem in computer vision. However, even nowadays it is still a challenging task to devise a method that combines the flexibility to work on non-trivial computational domains with high accuracy, robustness and computational efficiency. By uniting a classic approach for surface normal in…
▽ More
The integration of surface normals for the purpose of computing the shape of a surface in 3D space is a classic problem in computer vision. However, even nowadays it is still a challenging task to devise a method that combines the flexibility to work on non-trivial computational domains with high accuracy, robustness and computational efficiency. By uniting a classic approach for surface normal integration with modern computational techniques we construct a solver that fulfils these requirements. Building upon the Poisson integration model we propose to use an iterative Krylov subspace solver as a core step in tackling the task. While such a method can be very efficient, it may only show its full potential when combined with a suitable numerical preconditioning and a problem-specific initialisation. We perform a thorough numerical study in order to identify an appropriate preconditioner for our purpose. To address the issue of a suitable initialisation we propose to compute this initial state via a recently developed fast marching integrator. Detailed numerical experiments illuminate the benefits of this novel combination. In addition, we show on real-world photometric stereo datasets that the developed numerical framework is flexible enough to tackle modern computer vision applications.
△ Less
Submitted 19 October, 2016;
originally announced October 2016.
-
BluePyOpt: Leveraging open source software and cloud infrastructure to optimise model parameters in neuroscience
Authors:
Werner Van Geit,
Michael Gevaert,
Giuseppe Chindemi,
Christian Rössert,
Jean-Denis Courcol,
Eilif Muller,
Felix Schürmann,
Idan Segev,
Henry Markram
Abstract:
At many scales in neuroscience, appropriate mathematical models take the form of complex dynamical systems. Parametrising such models to conform to the multitude of available experimental constraints is a global nonlinear optimisation problem with a complex fitness landscape, requiring numerical techniques to find suitable approximate solutions. Stochastic optimisation approaches, such as evolutio…
▽ More
At many scales in neuroscience, appropriate mathematical models take the form of complex dynamical systems. Parametrising such models to conform to the multitude of available experimental constraints is a global nonlinear optimisation problem with a complex fitness landscape, requiring numerical techniques to find suitable approximate solutions. Stochastic optimisation approaches, such as evolutionary algorithms, have been shown to be effective, but often the setting up of such optimisations and the choice of a specific search algorithm and its parameters is non-trivial, requiring domain-specific expertise. Here we describe BluePyOpt, a Python package targeted at the broad neuroscience community to simplify this task. BluePyOpt is an extensible framework for data-driven model parameter optimisation that wraps and standardises several existing open-source tools. It simplifies the task of creating and sharing these optimisations, and the associated techniques and knowledge. This is achieved by abstracting the optimisation and evaluation tasks into various reusable and flexible discrete elements according to established best-practices. Further, BluePyOpt provides methods for setting up both small- and large-scale optimisations on a variety of platforms, ranging from laptops to Linux clusters and cloud-based compute infrastructures. The versatility of the BluePyOpt framework is demonstrated by working through three representative neuroscience specific use cases.
△ Less
Submitted 1 March, 2016;
originally announced March 2016.