-
Quantum groups from homologies of configuration spaces
Authors:
Stephen Bigelow,
Jules Martel
Abstract:
We reconstruct a quantum group associated with any Lie algebra together with its representation theory from twisted homologies of generalized configuration spaces of disks. Along the way it brings new combinatorics to the theory, but our diagrams represent true submanifolds of configuration spaces and combinatorial relations between them translate actual twisted homological relations.
We reconstruct a quantum group associated with any Lie algebra together with its representation theory from twisted homologies of generalized configuration spaces of disks. Along the way it brings new combinatorics to the theory, but our diagrams represent true submanifolds of configuration spaces and combinatorial relations between them translate actual twisted homological relations.
△ Less
Submitted 11 May, 2024;
originally announced May 2024.
-
On kernels of homological representations of map** class groups
Authors:
Renaud Detcherry,
Jules Martel
Abstract:
We study the kernels of representations of map** class groups of surfaces on twisted homologies of configuration spaces. We relate them with the kernel of a natural twisted intersection pairing: if the latter kernel is trivial then the representation is faithful. As a main example, we study the representations $ρ_{n}$ of $\mathrm{Mod}(Σ_{g,1})$ based on a Heisenberg local system on the $n$ point…
▽ More
We study the kernels of representations of map** class groups of surfaces on twisted homologies of configuration spaces. We relate them with the kernel of a natural twisted intersection pairing: if the latter kernel is trivial then the representation is faithful. As a main example, we study the representations $ρ_{n}$ of $\mathrm{Mod}(Σ_{g,1})$ based on a Heisenberg local system on the $n$ points configuration space of $Σ_{g,1}$, introduced by Blanchet--Palmer--Shaukat, and some of their specializations. In the one point configuration case, or when the Heisenberg group is quotiented by an element of its center, we find kernel elements in the twisted intersection form. On the other hand, for $n>2$ configuration points and the full Heisenberg local system, we identify subrepresentations of subgroups of $\mathrm{Mod}(Σ_{g,1})$ with Lawrence representations. In particular, we find one of these subgroups, which is isomorphic to a pure braid group on $g$ strands, on which the representations $ρ_n$ are faithful.
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
-
Hennings TQFTs for Cobordisms Decorated With Cohomology Classes
Authors:
Marco De Renzi,
Jules Martel,
Bangxin Wang
Abstract:
Starting from an abelian group $G$ and a factorizable ribbon Hopf $G$-bialgebra $H$, we construct a TQFT $J_H$ for connected framed cobordisms between connected surfaces with connected boundary decorated with cohomology classes with coefficients in $G$. When restricted to the subcategory of cobordisms with trivial decorations, our functor recovers a special case of Kerler-Lyubashenko TQFTs, namely…
▽ More
Starting from an abelian group $G$ and a factorizable ribbon Hopf $G$-bialgebra $H$, we construct a TQFT $J_H$ for connected framed cobordisms between connected surfaces with connected boundary decorated with cohomology classes with coefficients in $G$. When restricted to the subcategory of cobordisms with trivial decorations, our functor recovers a special case of Kerler-Lyubashenko TQFTs, namely those associated with factorizable ribbon Hopf algebras. Our result is inspired by the work of Blanchet-Costantino-Geer-Patureau, who constructed non-semisimple TQFTs for admissible decorated cobordisms using the unrolled quantum group of $\mathfrak{sl}_2$, and by that of Geer-Ha-Patureau, who reformulated the underlying invariants of admissible decorated $3$-manifolds using ribbon Hopf $G$-coalgebras. Our work represents the first step towards a homological model for non-semisimple TQFTs decorated with cohomology classes that appears in a conjecture by the first two authors.
△ Less
Submitted 7 February, 2024;
originally announced February 2024.
-
CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Images
Authors:
Bong** Koo,
Julien Martel,
Ariana Peck,
Axel Levy,
Frédéric Poitevin,
Nina Miolane
Abstract:
Cryogenic electron microscopy (cryo-EM) has transformed structural biology by allowing to reconstruct 3D biomolecular structures up to near-atomic resolution. However, the 3D reconstruction process remains challenging, as the 3D structures may exhibit substantial shape variations, while the 2D image acquisition suffers from a low signal-to-noise ratio, requiring to acquire very large datasets that…
▽ More
Cryogenic electron microscopy (cryo-EM) has transformed structural biology by allowing to reconstruct 3D biomolecular structures up to near-atomic resolution. However, the 3D reconstruction process remains challenging, as the 3D structures may exhibit substantial shape variations, while the 2D image acquisition suffers from a low signal-to-noise ratio, requiring to acquire very large datasets that are time-consuming to process. Current reconstruction methods are precise but computationally expensive, or faster but lack a physically-plausible model of large molecular shape variations. To fill this gap, we propose CryoChains that encodes large deformations of biomolecules via rigid body transformation of their chains, while representing their finer shape variations with the normal mode analysis framework of biophysics. Our synthetic data experiments on the human GABA\textsubscript{B} and heat shock protein show that CryoChains gives a biophysically-grounded quantification of the heterogeneous conformations of biomolecules, while reconstructing their 3D molecular structures at an improved resolution compared to the current fastest, interpretable deep learning method.
△ Less
Submitted 15 July, 2023; v1 submitted 12 June, 2023;
originally announced June 2023.
-
Homological Construction of Quantum Representations of Map** Class Groups
Authors:
Marco De Renzi,
Jules Martel
Abstract:
We provide a homological model for a family of quantum representations of map** class groups arising from non-semisimple TQFTs (Topological Quantum Field Theories). Our approach gives a new geometric point of view on these representations, and it gathers into one theory two of the most promising constructions for investigating linearity of map** class groups. More precisely, if…
▽ More
We provide a homological model for a family of quantum representations of map** class groups arising from non-semisimple TQFTs (Topological Quantum Field Theories). Our approach gives a new geometric point of view on these representations, and it gathers into one theory two of the most promising constructions for investigating linearity of map** class groups. More precisely, if $\varSigma_{g,1}$ is a surface of genus $g$ with $1$ boundary component, we consider a (crossed) action of its map** class group $\mathrm{Mod}(\varSigma_{g,1})$ on the homology of its configuration space $\mathrm{Conf}_n(\varSigma_{g,1})$ with twisted coefficients in the Heisenberg quotient $\mathbb{H}_g$ of its surface braid group $π_1(\mathrm{Conf}_n(\varSigma_{g,1}))$. We show that this action intertwines an action of the quantum group of $\mathfrak{sl}_2$, that we define by purely homological means. For a finite-dimensional linear representation of $\mathbb{H}_g$ (depending on a root of unity $ζ$), we tweak the construction to obtain a projective representation of $\mathrm{Mod}(\varSigma_{g,1})$. Finally, we identify, by an explicit isomorphism, a subrepresentation of $\mathrm{Mod}(\varSigma_{g,1})$ that is equivalent to the quantum representation arising from the non-semisimple TQFT associated with quantum $\mathfrak{sl}_2$ at $ζ$. In the process, we provide concrete bases and explicit formulas for the actions of all the standard generators of $\mathrm{Mod}(\varSigma_{g,1})$ and of quantum $\mathfrak{sl}_2$ on both sides of the equivalence, and answer a question by Crivelli, Felder, and Wieczerkowski. We also make sure that the restriction of these representations to the Torelli group $\mathcal{I}(\varSigma_{g,1})$ are integral, in the sense that the actions have coefficients in the ring of cyclotomic integers $\mathbb{Z}[ζ]$, when expressed in these bases.
△ Less
Submitted 8 March, 2023; v1 submitted 21 December, 2022;
originally announced December 2022.
-
Amortized Inference for Heterogeneous Reconstruction in Cryo-EM
Authors:
Axel Levy,
Gordon Wetzstein,
Julien Martel,
Frederic Poitevin,
Ellen D. Zhong
Abstract:
Cryo-electron microscopy (cryo-EM) is an imaging modality that provides unique insights into the dynamics of proteins and other building blocks of life. The algorithmic challenge of jointly estimating the poses, 3D structure, and conformational heterogeneity of a biomolecule from millions of noisy and randomly oriented 2D projections in a computationally efficient manner, however, remains unsolved…
▽ More
Cryo-electron microscopy (cryo-EM) is an imaging modality that provides unique insights into the dynamics of proteins and other building blocks of life. The algorithmic challenge of jointly estimating the poses, 3D structure, and conformational heterogeneity of a biomolecule from millions of noisy and randomly oriented 2D projections in a computationally efficient manner, however, remains unsolved. Our method, cryoFIRE, performs ab initio heterogeneous reconstruction with unknown poses in an amortized framework, thereby avoiding the computationally expensive step of pose search while enabling the analysis of conformational heterogeneity. Poses and conformation are jointly estimated by an encoder while a physics-based decoder aggregates the images into an implicit neural representation of the conformational space. We show that our method can provide one order of magnitude speedup on datasets containing millions of images without any loss of accuracy. We validate that the joint estimation of poses and conformations can be amortized over the size of the dataset. For the first time, we prove that an amortized method can extract interpretable dynamic information from experimental datasets.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
Towards Trustworthy Automatic Diagnosis Systems by Emulating Doctors' Reasoning with Deep Reinforcement Learning
Authors:
Arsene Fansi Tchango,
Rishab Goel,
Julien Martel,
Zhi Wen,
Gaetan Marceau Caron,
Joumana Ghosn
Abstract:
The automation of the medical evidence acquisition and diagnosis process has recently attracted increasing attention in order to reduce the workload of doctors and democratize access to medical care. However, most works proposed in the machine learning literature focus solely on improving the prediction accuracy of a patient's pathology. We argue that this objective is insufficient to ensure docto…
▽ More
The automation of the medical evidence acquisition and diagnosis process has recently attracted increasing attention in order to reduce the workload of doctors and democratize access to medical care. However, most works proposed in the machine learning literature focus solely on improving the prediction accuracy of a patient's pathology. We argue that this objective is insufficient to ensure doctors' acceptability of such systems. In their initial interaction with patients, doctors do not only focus on identifying the pathology a patient is suffering from; they instead generate a differential diagnosis (in the form of a short list of plausible diseases) because the medical evidence collected from patients is often insufficient to establish a final diagnosis. Moreover, doctors explicitly explore severe pathologies before potentially ruling them out from the differential, especially in acute care settings. Finally, for doctors to trust a system's recommendations, they need to understand how the gathered evidences led to the predicted diseases. In particular, interactions between a system and a patient need to emulate the reasoning of doctors. We therefore propose to model the evidence acquisition and automatic diagnosis tasks using a deep reinforcement learning framework that considers three essential aspects of a doctor's reasoning, namely generating a differential diagnosis using an exploration-confirmation approach while prioritizing severe pathologies. We propose metrics for evaluating interaction quality based on these three aspects. We show that our approach performs better than existing models while maintaining competitive pathology prediction accuracy.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
Heterogeneous reconstruction of deformable atomic models in Cryo-EM
Authors:
Youssef Nashed,
Ariana Peck,
Julien Martel,
Axel Levy,
Bong** Koo,
Gordon Wetzstein,
Nina Miolane,
Daniel Ratner,
Frédéric Poitevin
Abstract:
Cryogenic electron microscopy (cryo-EM) provides a unique opportunity to study the structural heterogeneity of biomolecules. Being able to explain this heterogeneity with atomic models would help our understanding of their functional mechanisms but the size and ruggedness of the structural space (the space of atomic 3D cartesian coordinates) presents an immense challenge. Here, we describe a heter…
▽ More
Cryogenic electron microscopy (cryo-EM) provides a unique opportunity to study the structural heterogeneity of biomolecules. Being able to explain this heterogeneity with atomic models would help our understanding of their functional mechanisms but the size and ruggedness of the structural space (the space of atomic 3D cartesian coordinates) presents an immense challenge. Here, we describe a heterogeneous reconstruction method based on an atomistic representation whose deformation is reduced to a handful of collective motions through normal mode analysis. Our implementation uses an autoencoder. The encoder jointly estimates the amplitude of motion along the normal modes and the 2D shift between the center of the image and the center of the molecule . The physics-based decoder aggregates a representation of the heterogeneity readily interpretable at the atomic level. We illustrate our method on 3 synthetic datasets corresponding to different distributions along a simulated trajectory of adenylate kinase transitioning from its open to its closed structures. We show for each distribution that our approach is able to recapitulate the intermediate atomic models with atomic-level accuracy.
△ Less
Submitted 29 September, 2022;
originally announced September 2022.
-
DDXPlus: A New Dataset For Automatic Medical Diagnosis
Authors:
Arsene Fansi Tchango,
Rishab Goel,
Zhi Wen,
Julien Martel,
Joumana Ghosn
Abstract:
There has been a rapidly growing interest in Automatic Symptom Detection (ASD) and Automatic Diagnosis (AD) systems in the machine learning research literature, aiming to assist doctors in telemedicine services. These systems are designed to interact with patients, collect evidence about their symptoms and relevant antecedents, and possibly make predictions about the underlying diseases. Doctors w…
▽ More
There has been a rapidly growing interest in Automatic Symptom Detection (ASD) and Automatic Diagnosis (AD) systems in the machine learning research literature, aiming to assist doctors in telemedicine services. These systems are designed to interact with patients, collect evidence about their symptoms and relevant antecedents, and possibly make predictions about the underlying diseases. Doctors would review the interactions, including the evidence and the predictions, collect if necessary additional information from patients, before deciding on next steps. Despite recent progress in this area, an important piece of doctors' interactions with patients is missing in the design of these systems, namely the differential diagnosis. Its absence is largely due to the lack of datasets that include such information for models to train on. In this work, we present a large-scale synthetic dataset of roughly 1.3 million patients that includes a differential diagnosis, along with the ground truth pathology, symptoms and antecedents for each patient. Unlike existing datasets which only contain binary symptoms and antecedents, this dataset also contains categorical and multi-choice symptoms and antecedents useful for efficient data collection. Moreover, some symptoms are organized in a hierarchy, making it possible to design systems able to interact with patients in a logical way. As a proof-of-concept, we extend two existing AD and ASD systems to incorporate the differential diagnosis, and provide empirical evidence that using differentials as training signals is essential for the efficiency of such systems or for hel** doctors better understand the reasoning of those systems.
△ Less
Submitted 13 October, 2022; v1 submitted 18 May, 2022;
originally announced May 2022.
-
Learning Spatially Varying Pixel Exposures for Motion Deblurring
Authors:
Cindy M. Nguyen,
Julien N. P. Martel,
Gordon Wetzstein
Abstract:
Computationally removing the motion blur introduced by camera shake or object motion in a captured image remains a challenging task in computational photography. Deblurring methods are often limited by the fixed global exposure time of the image capture process. The post-processing algorithm either must deblur a longer exposure that contains relatively little noise or denoise a short exposure that…
▽ More
Computationally removing the motion blur introduced by camera shake or object motion in a captured image remains a challenging task in computational photography. Deblurring methods are often limited by the fixed global exposure time of the image capture process. The post-processing algorithm either must deblur a longer exposure that contains relatively little noise or denoise a short exposure that intentionally removes the opportunity for blur at the cost of increased noise. We present a novel approach of leveraging spatially varying pixel exposures for motion deblurring using next-generation focal-plane sensor--processors along with an end-to-end design of these exposures and a machine learning--based motion-deblurring framework. We demonstrate in simulation and a physical prototype that learned spatially varying pixel exposures (L-SVPE) can successfully deblur scenes while recovering high frequency detail. Our work illustrates the promising role that focal-plane sensor--processors can play in the future of computational imaging.
△ Less
Submitted 14 April, 2022;
originally announced April 2022.
-
CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images
Authors:
Axel Levy,
Frédéric Poitevin,
Julien Martel,
Youssef Nashed,
Ariana Peck,
Nina Miolane,
Daniel Ratner,
Mike Dunne,
Gordon Wetzstein
Abstract:
Cryo-electron microscopy (cryo-EM) has become a tool of fundamental importance in structural biology, hel** us understand the basic building blocks of life. The algorithmic challenge of cryo-EM is to jointly estimate the unknown 3D poses and the 3D electron scattering potential of a biomolecule from millions of extremely noisy 2D images. Existing reconstruction algorithms, however, cannot easily…
▽ More
Cryo-electron microscopy (cryo-EM) has become a tool of fundamental importance in structural biology, hel** us understand the basic building blocks of life. The algorithmic challenge of cryo-EM is to jointly estimate the unknown 3D poses and the 3D electron scattering potential of a biomolecule from millions of extremely noisy 2D images. Existing reconstruction algorithms, however, cannot easily keep pace with the rapidly growing size of cryo-EM datasets due to their high computational and memory cost. We introduce cryoAI, an ab initio reconstruction algorithm for homogeneous conformations that uses direct gradient-based optimization of particle poses and the electron scattering potential from single-particle cryo-EM data. CryoAI combines a learned encoder that predicts the poses of each particle image with a physics-based decoder to aggregate each particle image into an implicit representation of the scattering potential volume. This volume is stored in the Fourier domain for computational efficiency and leverages a modern coordinate network architecture for memory efficiency. Combined with a symmetrized loss function, this framework achieves results of a quality on par with state-of-the-art cryo-EM solvers for both simulated and experimental data, one order of magnitude faster for large datasets and with significantly lower memory requirements than existing methods.
△ Less
Submitted 30 August, 2022; v1 submitted 15 March, 2022;
originally announced March 2022.
-
Topology of Singularities of Optimal Semicouplings
Authors:
J. H. Martel
Abstract:
We study the topology of singularities of $c$-optimal semicouplings in unequal dimension. Our main results describe homotopy-reductions from a source space $(X,σ)$ onto the singularities $Z_j$, $j\geq 0$ of $c$-optimal semicouplings whenever $(Y, τ)$ is a Riemannian target space and $c$ is a cost on $X\times Y$ satisfying some general assumptions (A0)--(A5). We construct continuous strong deformat…
▽ More
We study the topology of singularities of $c$-optimal semicouplings in unequal dimension. Our main results describe homotopy-reductions from a source space $(X,σ)$ onto the singularities $Z_j$, $j\geq 0$ of $c$-optimal semicouplings whenever $(Y, τ)$ is a Riemannian target space and $c$ is a cost on $X\times Y$ satisfying some general assumptions (A0)--(A5). We construct continuous strong deformation retracts $X\leadsto Z_j$ whenever a condition called Uniform Halfspace (UHS) condition is satisfied along appropriate subsets. This article summarizes some results from the author's PhD thesis (2019).
△ Less
Submitted 30 January, 2022;
originally announced January 2022.
-
Unified invariant of knots from homological braid action on Verma modules
Authors:
Jules Martel,
Sonny Willetts
Abstract:
We re-build the quantum sl2 unified invariant of knots $F_{\infty}$ from braid groups' action on tensors of Verma modules. It is a two variables series having the particularity of interpolating both families of colored Jones polynomials and ADO polynomials, i.e. semi-simple and non semi-simple invariants of knots constructed from quantum sl2. We prove this last fact in our context which re-proves…
▽ More
We re-build the quantum sl2 unified invariant of knots $F_{\infty}$ from braid groups' action on tensors of Verma modules. It is a two variables series having the particularity of interpolating both families of colored Jones polynomials and ADO polynomials, i.e. semi-simple and non semi-simple invariants of knots constructed from quantum sl2. We prove this last fact in our context which re-proves (a generalization of) the famous Melvin-Morton-Rozansky conjecture first proved by Bar-Natan and Garoufalidis. We find a symmetry of $F_{\infty}$ nicely generalizing the well known one of the Alexander polynomial, ADO polynomials also inherit this symmetry. It implies that quantum sl2 non semi-simple invariants are not detecting knots' orientation. Using the homological definition of Verma modules we express $F_{\infty}$ as a generating sum of intersection pairing between fixed Lagrangians of configuration spaces of disks. Finally, we give a formula for $F_{\infty}$ using a generalized notion of determinant, that provides one for the ADO family. It generalizes that for the Alexander invariant.
△ Less
Submitted 30 December, 2021;
originally announced December 2021.
-
MantissaCam: Learning Snapshot High-dynamic-range Imaging with Perceptually-based In-pixel Irradiance Encoding
Authors:
Haley M. So,
Julien N. P. Martel,
Piotr Dudek,
Gordon Wetzstein
Abstract:
The ability to image high-dynamic-range (HDR) scenes is crucial in many computer vision applications. The dynamic range of conventional sensors, however, is fundamentally limited by their well capacity, resulting in saturation of bright scene parts. To overcome this limitation, emerging sensors offer in-pixel processing capabilities to encode the incident irradiance. Among the most promising encod…
▽ More
The ability to image high-dynamic-range (HDR) scenes is crucial in many computer vision applications. The dynamic range of conventional sensors, however, is fundamentally limited by their well capacity, resulting in saturation of bright scene parts. To overcome this limitation, emerging sensors offer in-pixel processing capabilities to encode the incident irradiance. Among the most promising encoding schemes is modulo wrap**, which results in a computational photography problem where the HDR scene is computed by an irradiance unwrap** algorithm from the wrapped low-dynamic-range (LDR) sensor image. Here, we design a neural network--based algorithm that outperforms previous irradiance unwrap** methods and we design a perceptually inspired "mantissa" encoding scheme that more efficiently wraps an HDR scene into an LDR sensor. Combined with our reconstruction framework, MantissaCam achieves state-of-the-art results among modulo-type snapshot HDR imaging approaches. We demonstrate the efficacy of our method in simulation and show benefits of our algorithm on modulo images captured with a prototype implemented with a programmable sensor.
△ Less
Submitted 20 April, 2022; v1 submitted 9 December, 2021;
originally announced December 2021.
-
ACORN: Adaptive Coordinate Networks for Neural Scene Representation
Authors:
Julien N. P. Martel,
David B. Lindell,
Connor Z. Lin,
Eric R. Chan,
Marco Monteiro,
Gordon Wetzstein
Abstract:
Neural representations have emerged as a new paradigm for applications in rendering, imaging, geometric modeling, and simulation. Compared to traditional representations such as meshes, point clouds, or volumes they can be flexibly incorporated into differentiable learning-based pipelines. While recent improvements to neural representations now make it possible to represent signals with fine detai…
▽ More
Neural representations have emerged as a new paradigm for applications in rendering, imaging, geometric modeling, and simulation. Compared to traditional representations such as meshes, point clouds, or volumes they can be flexibly incorporated into differentiable learning-based pipelines. While recent improvements to neural representations now make it possible to represent signals with fine details at moderate resolutions (e.g., for images and 3D shapes), adequately representing large-scale or complex scenes has proven a challenge. Current neural representations fail to accurately represent images at resolutions greater than a megapixel or 3D scenes with more than a few hundred thousand polygons. Here, we introduce a new hybrid implicit-explicit network architecture and training strategy that adaptively allocates resources during training and inference based on the local complexity of a signal of interest. Our approach uses a multiscale block-coordinate decomposition, similar to a quadtree or octree, that is optimized during training. The network architecture operates in two stages: using the bulk of the network parameters, a coordinate encoder generates a feature grid in a single forward pass. Then, hundreds or thousands of samples within each block can be efficiently evaluated using a lightweight feature decoder. With this hybrid implicit-explicit network architecture, we demonstrate the first experiments that fit gigapixel images to nearly 40 dB peak signal-to-noise ratio. Notably this represents an increase in scale of over 1000x compared to the resolution of previously demonstrated image-fitting experiments. Moreover, our approach is able to represent 3D shapes significantly faster and better than previous techniques; it reduces training times from days to hours or minutes and memory requirements by over an order of magnitude.
△ Less
Submitted 6 May, 2021;
originally announced May 2021.
-
Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systems
Authors:
Edwin Vargas,
Julien N. P. Martel,
Gordon Wetzstein,
Henry Arguello
Abstract:
Compressive imaging using coded apertures (CA) is a powerful technique that can be used to recover depth, light fields, hyperspectral images and other quantities from a single snapshot. The performance of compressive imaging systems based on CAs mostly depends on two factors: the properties of the mask's attenuation pattern, that we refer to as "codification" and the computational techniques used…
▽ More
Compressive imaging using coded apertures (CA) is a powerful technique that can be used to recover depth, light fields, hyperspectral images and other quantities from a single snapshot. The performance of compressive imaging systems based on CAs mostly depends on two factors: the properties of the mask's attenuation pattern, that we refer to as "codification" and the computational techniques used to recover the quantity of interest from the coded snapshot. In this work, we introduce the idea of using time-varying CAs synchronized with spatially varying pixel shutters. We divide the exposure of a sensor into sub-exposures at the beginning of which the CA mask changes and at which the sensor's pixels are simultaneously and individually switched "on" or "off". This is a practically appealing codification as it does not introduce additional optical components other than the already present CA but uses a change in the pixel shutter that can be easily realized electronically. We show that our proposed time multiplexed coded aperture (TMCA) can be optimized end-to-end and induces better coded snapshots enabling superior reconstructions in two different applications: compressive light field imaging and hyperspectral imaging. We demonstrate both in simulation and on real captures (taken with prototypes we built) that this codification outperforms the state-of-the-art compressive imaging systems by more than 4dB in those applications.
△ Less
Submitted 6 April, 2021;
originally announced April 2021.
-
Colored Jones polynomials and abelianized Lefschetz numbers
Authors:
Jules Martel
Abstract:
We show that the family of colored Jones polynomials of the closure of a braid compute weighted sums of abelianized Lefschetz numbers associated with the action of the braid on configuration spaces. The sum is over the number of configuration points. Then we interpret this sum in terms of Poincare--Lefschetz duality intersection pairing between homology classes.
We show that the family of colored Jones polynomials of the closure of a braid compute weighted sums of abelianized Lefschetz numbers associated with the action of the braid on configuration spaces. The sum is over the number of configuration points. Then we interpret this sum in terms of Poincare--Lefschetz duality intersection pairing between homology classes.
△ Less
Submitted 16 December, 2020;
originally announced December 2020.
-
AutoInt: Automatic Integration for Fast Neural Volume Rendering
Authors:
David B. Lindell,
Julien N. P. Martel,
Gordon Wetzstein
Abstract:
Numerical integration is a foundational technique in scientific computing and is at the core of many computer vision applications. Among these applications, neural volume rendering has recently been proposed as a new paradigm for view synthesis, achieving photorealistic image quality. However, a fundamental obstacle to making these methods practical is the extreme computational and memory requirem…
▽ More
Numerical integration is a foundational technique in scientific computing and is at the core of many computer vision applications. Among these applications, neural volume rendering has recently been proposed as a new paradigm for view synthesis, achieving photorealistic image quality. However, a fundamental obstacle to making these methods practical is the extreme computational and memory requirements caused by the required volume integrations along the rendered rays during training and inference. Millions of rays, each requiring hundreds of forward passes through a neural network are needed to approximate those integrations with Monte Carlo sampling. Here, we propose automatic integration, a new framework for learning efficient, closed-form solutions to integrals using coordinate-based neural networks. For training, we instantiate the computational graph corresponding to the derivative of the network. The graph is fitted to the signal to integrate. After optimization, we reassemble the graph to obtain a network that represents the antiderivative. By the fundamental theorem of calculus, this enables the calculation of any definite integral in two evaluations of the network. Applying this approach to neural rendering, we improve a tradeoff between rendering speed and image quality: improving render times by greater than 10 times with a tradeoff of slightly reduced image quality.
△ Less
Submitted 22 May, 2021; v1 submitted 3 December, 2020;
originally announced December 2020.
-
Implicit Neural Representations with Periodic Activation Functions
Authors:
Vincent Sitzmann,
Julien N. P. Martel,
Alexander W. Bergman,
David B. Lindell,
Gordon Wetzstein
Abstract:
Implicitly defined, continuous, differentiable signal representations parameterized by neural networks have emerged as a powerful paradigm, offering many possible benefits over conventional representations. However, current network architectures for such implicit neural representations are incapable of modeling signals with fine detail, and fail to represent a signal's spatial and temporal derivat…
▽ More
Implicitly defined, continuous, differentiable signal representations parameterized by neural networks have emerged as a powerful paradigm, offering many possible benefits over conventional representations. However, current network architectures for such implicit neural representations are incapable of modeling signals with fine detail, and fail to represent a signal's spatial and temporal derivatives, despite the fact that these are essential to many physical signals defined implicitly as the solution to partial differential equations. We propose to leverage periodic activation functions for implicit neural representations and demonstrate that these networks, dubbed sinusoidal representation networks or Sirens, are ideally suited for representing complex natural signals and their derivatives. We analyze Siren activation statistics to propose a principled initialization scheme and demonstrate the representation of images, wavefields, video, sound, and their derivatives. Further, we show how Sirens can be leveraged to solve challenging boundary value problems, such as particular Eikonal equations (yielding signed distance functions), the Poisson equation, and the Helmholtz and wave equations. Lastly, we combine Sirens with hypernetworks to learn priors over the space of Siren functions.
△ Less
Submitted 17 June, 2020;
originally announced June 2020.
-
The non semi-simple TQFT of the sphere with four punctures
Authors:
Jules Martel
Abstract:
In this work, we compute the representation of the map** class group of the sphere with $4$ punctures arising from the non semi-simple TQFT (constructed by Blanchet--Costantino--Geer--Patureau). We show that it is faithful. Lastly, we compare quantum representations of punctured spheres in general with those of braid groups.
In this work, we compute the representation of the map** class group of the sphere with $4$ punctures arising from the non semi-simple TQFT (constructed by Blanchet--Costantino--Geer--Patureau). We show that it is faithful. Lastly, we compare quantum representations of punctured spheres in general with those of braid groups.
△ Less
Submitted 12 June, 2020;
originally announced June 2020.
-
Event Based, Near Eye Gaze Tracking Beyond 10,000Hz
Authors:
Anastasios N. Angelopoulos,
Julien N. P. Martel,
Amit P. S. Kohli,
Jorg Conradt,
Gordon Wetzstein
Abstract:
The cameras in modern gaze-tracking systems suffer from fundamental bandwidth and power limitations, constraining data acquisition speed to 300 Hz realistically. This obstructs the use of mobile eye trackers to perform, e.g., low latency predictive rendering, or to study quick and subtle eye motions like microsaccades using head-mounted devices in the wild. Here, we propose a hybrid frame-event-ba…
▽ More
The cameras in modern gaze-tracking systems suffer from fundamental bandwidth and power limitations, constraining data acquisition speed to 300 Hz realistically. This obstructs the use of mobile eye trackers to perform, e.g., low latency predictive rendering, or to study quick and subtle eye motions like microsaccades using head-mounted devices in the wild. Here, we propose a hybrid frame-event-based near-eye gaze tracking system offering update rates beyond 10,000 Hz with an accuracy that matches that of high-end desktop-mounted commercial trackers when evaluated in the same conditions. Our system builds on emerging event cameras that simultaneously acquire regularly sampled frames and adaptively sampled events. We develop an online 2D pupil fitting method that updates a parametric model every one or few events. Moreover, we propose a polynomial regressor for estimating the point of gaze from the parametric pupil model in real time. Using the first event-based gaze dataset, available at https://github.com/aangelopoulos/event_based_gaze_tracking , we demonstrate that our system achieves accuracies of 0.45 degrees--1.75 degrees for fields of view from 45 degrees to 98 degrees. With this technology, we hope to enable a new generation of ultra-low-latency gaze-contingent rendering and display techniques for virtual and augmented reality.
△ Less
Submitted 8 August, 2022; v1 submitted 7 April, 2020;
originally announced April 2020.
-
Colored version for Lawrence representations
Authors:
Jules Martel
Abstract:
We give an explicit isomorphism between the Gassner representation and the first weight level of a representation of quantum sl(2). Then we construct and provide matrices for colored versions of the BKL representation and higher Lawrence's representations.
We give an explicit isomorphism between the Gassner representation and the first weight level of a representation of quantum sl(2). Then we construct and provide matrices for colored versions of the BKL representation and higher Lawrence's representations.
△ Less
Submitted 9 April, 2020; v1 submitted 2 April, 2020;
originally announced April 2020.
-
A homological model for $U_q \mathfrak{sl}(2)$ Verma-modules and their braid representations
Authors:
Jules Martel
Abstract:
We extend Lawrence's representations of the braid groups to relative homology modules, and we show that they are free modules over a Laurent polynomials ring. We define homological operators and we show that they actually provide a representation for an integral version for $U_q \mathfrak{sl}(2)$. We suggest an isomorphism between a given basis of homological modules and the standard basis of tens…
▽ More
We extend Lawrence's representations of the braid groups to relative homology modules, and we show that they are free modules over a Laurent polynomials ring. We define homological operators and we show that they actually provide a representation for an integral version for $U_q \mathfrak{sl}(2)$. We suggest an isomorphism between a given basis of homological modules and the standard basis of tensor products of Verma modules, and we show it to preserve the integral ring of coefficients, the action of $U_q \mathfrak{sl}(2)$, the braid group representations and their grading. This recovers an integral version for Kohno's theorem relating absolute Lawrence representations with quantum braid representation on highest weight vectors. It is an extension of the latter theorem as we get rid of generic conditions on parameters, and as we recover the entire product of Verma-modules as a braid group and a $U_q \mathfrak{sl}(2)$-module.
△ Less
Submitted 12 January, 2021; v1 submitted 20 February, 2020;
originally announced February 2020.
-
Estimation of Z-Thickness and XY-Anisotropy of Electron Microscopy Images using Gaussian Processes
Authors:
Thanuja D. Ambegoda,
Julien N. P. Martel,
Jozef Adamcik,
Matthew Cook,
Richard H. R. Hahnloser
Abstract:
Serial section electron microscopy (ssEM) is a widely used technique for obtaining volumetric information of biological tissues at nanometer scale. However, accurate 3D reconstructions of identified cellular structures and volumetric quantifications require precise estimates of section thickness and anisotropy (or stretching) along the XY imaging plane. In fact, many image processing algorithms si…
▽ More
Serial section electron microscopy (ssEM) is a widely used technique for obtaining volumetric information of biological tissues at nanometer scale. However, accurate 3D reconstructions of identified cellular structures and volumetric quantifications require precise estimates of section thickness and anisotropy (or stretching) along the XY imaging plane. In fact, many image processing algorithms simply assume isotropy within the imaging plane. To ameliorate this problem, we present a method for estimating thickness and stretching of electron microscopy sections using non-parametric Bayesian regression of image statistics. We verify our thickness and stretching estimates using direct measurements obtained by atomic force microscopy (AFM) and show that our method has a lower estimation error compared to a recent indirect thickness estimation method as well as a relative Z coordinate estimation method. Furthermore, we have made the first dataset of ssSEM images with directly measured section thickness values publicly available for the evaluation of indirect thickness estimation methods.
△ Less
Submitted 4 February, 2020; v1 submitted 1 February, 2020;
originally announced February 2020.
-
Adaptive motor control and learning in a spiking neural network realised on a mixed-signal neuromorphic processor
Authors:
Sebastian Glatz,
Julien N. P. Martel,
Raphaela Kreiser,
Ning Qiao,
Yulia Sandamirskaya
Abstract:
Neuromorphic computing is a new paradigm for design of both the computing hardware and algorithms inspired by biological neural networks. The event-based nature and the inherent parallelism make neuromorphic computing a promising paradigm for building efficient neural network based architectures for control of fast and agile robots. In this paper, we present a spiking neural network architecture t…
▽ More
Neuromorphic computing is a new paradigm for design of both the computing hardware and algorithms inspired by biological neural networks. The event-based nature and the inherent parallelism make neuromorphic computing a promising paradigm for building efficient neural network based architectures for control of fast and agile robots. In this paper, we present a spiking neural network architecture that uses sensory feedback to control rotational velocity of a robotic vehicle. When the velocity reaches the target value, the map** from the target velocity of the vehicle to the correct motor command, both represented in the spiking neural network on the neuromorphic device, is autonomously stored on the device using on-chip plastic synaptic weights. We validate the controller using a wheel motor of a miniature mobile vehicle and inertia measurement unit as the sensory feedback and demonstrate online learning of a simple 'inverse model' in a two-layer spiking neural network on the neuromorphic chip. The prototype neuromorphic device that features 256 spiking neurons allows us to realise a simple proof of concept architecture for the purely neuromorphic motor control and learning. The architecture can be easily scaled-up if a larger neuromorphic device is available.
△ Less
Submitted 25 October, 2018;
originally announced October 2018.
