-
Embedded event based object detection with spiking neural network
Authors:
Jonathan Courtois,
Pierre-Emmanuel Novac,
Edgar Lemaire,
Alain Pegatoquet,
Benoit Miramond
Abstract:
The complexity of event-based object detection (OD) poses considerable challenges. Spiking Neural Networks (SNNs) show promising results and pave the way for efficient event-based OD. Despite this success, the path to efficient SNNs on embedded devices remains a challenge. This is due to the size of the networks required to accomplish the task and the ability of devices to take advantage of SNNs b…
▽ More
The complexity of event-based object detection (OD) poses considerable challenges. Spiking Neural Networks (SNNs) show promising results and pave the way for efficient event-based OD. Despite this success, the path to efficient SNNs on embedded devices remains a challenge. This is due to the size of the networks required to accomplish the task and the ability of devices to take advantage of SNNs benefits. Even when "edge" devices are considered, they typically use embedded GPUs that consume tens of watts. In response to these challenges, our research introduces an embedded neuromorphic testbench that utilizes the SPiking Low-power Event-based ArchiTecture (SPLEAT) accelerator. Using an extended version of the Qualia framework, we can train, evaluate, quantize, and deploy spiking neural networks on an FPGA implementation of SPLEAT. We used this testbench to load a state-of-the-art SNN solution, estimate the performance loss associated with deploying the network on dedicated hardware, and run real-world event-based OD on neuromorphic hardware specifically designed for low-power spiking neural networks. Remarkably, our embedded spiking solution, which includes a model with 1.08 million parameters, operates efficiently with 490 mJ per prediction.
△ Less
Submitted 25 June, 2024;
originally announced June 2024.
-
An Analytical Estimation of Spiking Neural Networks Energy Efficiency
Authors:
Edgar Lemaire,
Loic Cordone,
Andrea Castagnetti,
Pierre-Emmanuel Novac,
Jonathan Courtois,
Benoit Miramond
Abstract:
Spiking Neural Networks are a type of neural networks where neurons communicate using only spikes. They are often presented as a low-power alternative to classical neural networks, but few works have proven these claims to be true. In this work, we present a metric to estimate the energy consumption of SNNs independently of a specific hardware. We then apply this metric on SNNs processing three di…
▽ More
Spiking Neural Networks are a type of neural networks where neurons communicate using only spikes. They are often presented as a low-power alternative to classical neural networks, but few works have proven these claims to be true. In this work, we present a metric to estimate the energy consumption of SNNs independently of a specific hardware. We then apply this metric on SNNs processing three different data types (static, dynamic and event-based) representative of real-world applications. As a result, all of our SNNs are 6 to 8 times more efficient than their FNN counterparts.
△ Less
Submitted 24 October, 2022;
originally announced October 2022.
-
Bare and Polymer Coated Iron Oxide Superparamagnetic Nanoparticles for Effective Removal of U (VI) from Acidic and Neutral Aqueous Medium
Authors:
Shan Zhu,
Yangchun Leng,
Minhao Yan,
Xianguo Tuo,
Jianbo Yang,
László Almásy,
Qiang Tian,
Guangai Sun,
Lin Zou,
Qintang Li,
Jérémie Courtois,
Hong Zhang
Abstract:
Superparamagnetic γ-Fe2O3 nanoparticles (5 nm diameter) were synthesized in water. The bare particles exhibit good colloidal stability at ~ pH 2 because of the strong electrostatic repulsion with a surface charge of +25 mV. The polyacrylic acid (PAA)-coated particles exhibit remarkable colloidal stability at ~ pH 7 with abundant free carboxyl groups as reactive sites for subsequent functionalizati…
▽ More
Superparamagnetic γ-Fe2O3 nanoparticles (5 nm diameter) were synthesized in water. The bare particles exhibit good colloidal stability at ~ pH 2 because of the strong electrostatic repulsion with a surface charge of +25 mV. The polyacrylic acid (PAA)-coated particles exhibit remarkable colloidal stability at ~ pH 7 with abundant free carboxyl groups as reactive sites for subsequent functionalization. In this work, we used zeta potential analysis, transmission electron microscopy, small angle X-ray scattering, and Inductively coupled plasma mass spectrometry to investigate the adsorption behavior of U (VI) on bare and coated colloidal superparamagnetic nanoparticles at pH 2 and pH 7. At pH 2, uranyl ion (UO22+) absorbed on the surface of the bare particles with decreasing particle surface charge. This induced particle agglomeration. At pH 7, uranyl ion (UO22+) hydrolyzed and formed plate-like particles of uranium hydroxide that were ~ 50 nm in diameter. The PAA-coated iron oxide nanoparticles absorbed on the surface of these U (VI) hydroxide plates to form large aggregates that precipitate to the bottom of the dispersion. At both pH 2 and pH 7, the resulting U (VI)/nanoparticle complex can be easily collected and extracted from the aqueous environment via an external magnetic field. The results show that both bare and polymer-coated superparamagnetic γ-Fe2O3 nanoparticles are potential absorbents for removing U (VI) from water.
△ Less
Submitted 7 April, 2018;
originally announced April 2018.
-
Poly(acrylic acid)-coated iron oxide nanoparticles : quantitative evaluation of the coating properties and applications for the removal of a pollutant dye
Authors:
J. Fresnais,
M. Yan,
J. Courtois,
T. Bostelmann,
A. Bée,
J. -F. Berret
Abstract:
In this work, 6 to 12 nm iron oxide nanoparticles were synthesized and coated with poly(acrylic acid) chains of molecular weight 2100 g/mol. Based on a quantitative evaluation of the dispersions, the bare and coated particles were thoroughly characterized. The number densities of polymers adsorbed at the particle surface and of available chargeable groups were found to be 1.9 +/- 0.3 nm-2 and 26 +…
▽ More
In this work, 6 to 12 nm iron oxide nanoparticles were synthesized and coated with poly(acrylic acid) chains of molecular weight 2100 g/mol. Based on a quantitative evaluation of the dispersions, the bare and coated particles were thoroughly characterized. The number densities of polymers adsorbed at the particle surface and of available chargeable groups were found to be 1.9 +/- 0.3 nm-2 and 26 +/- 4 nm-2, respectively. Occurring via a multi-site binding mechanism, the electrostatic coupling leads to a solid and resilient anchoring of the chains. To assess the efficacy of the particles for pollutant remediation, the adsorption isotherm of methylene blue molecules, a model of pollutant, was determined. The excellent agreement between the predicted and measured amounts of adsorbed dyes suggests that most carboxylates participate to the complexation and adsorption mechanisms. An adsorption of 830 mg/g was obtained. This quantity compares well with the highest values available for this dye.
△ Less
Submitted 7 December, 2012;
originally announced December 2012.
-
The effects of aggregation and protein corona on the cellular internalization of iron oxide nanoparticles
Authors:
M. Safi,
J. Courtois,
M. Seigneuret,
H. Conjeaud,
J. -F. Berret
Abstract:
Engineered inorganic nanoparticles are essential components in the development of nanotechnologies. For applications in nanomedicine, particles need to be functionalized to ensure a good dispersibility in biological fluids. In many cases however, functionalization is not sufficient : the particles become either coated by a corona of serum proteins or precipitate out of the solvent. In the present…
▽ More
Engineered inorganic nanoparticles are essential components in the development of nanotechnologies. For applications in nanomedicine, particles need to be functionalized to ensure a good dispersibility in biological fluids. In many cases however, functionalization is not sufficient : the particles become either coated by a corona of serum proteins or precipitate out of the solvent. In the present paper, we show that by changing the coating of iron oxide nanoparticles from a low-molecular weight ligand (citrate ions) to small carboxylated polymers (poly(acrylic acid)), the colloidal stability of the dispersion is improved and the adsorption/internalization of iron towards living mammalian cells is profoundly affected. Citrate-coated particles are shown to destabilize in all fetal-calf-serum based physiological conditions tested, whereas the polymer coated particles exhibit an outstanding dispersibility as well as a structure devoid of protein corona. The interactions between nanoparticles and human lymphoblastoid cells are investigated by transmission electron microscopy and flow cytometry. Two types of nanoparticle/cell interactions are underlined. Iron oxides are found either adsorbed on the cellular membranes, or internalized into membrane-bound endocytosis compartments. For the precipitating citrate-coated particles, the kinetics of interactions reveal a massive and rapid adsorption of iron oxide on the cell surfaces. The quantification of the partition between adsorbed and internalized iron was performed from the cytometry data. The results highlight the importance of resilient adsorbed nanomaterials at the cytoplasmic membrane.
△ Less
Submitted 24 August, 2011;
originally announced August 2011.
-
Probing oppositely charged surfactant and copolymer interactions by isothermal titration microcalorimetry
Authors:
J. Courtois,
J. -F. Berret
Abstract:
The complexation between charged-neutral block copolymers and oppositely charged surfactants was investigated by light scattering experiments and by isothermal titration calorimetry (ITC). The copolymer was poly(sodium acrylate)-b-poly(acrylamide) and the surfactant dodecyltrimethylammonium bromide (DTAB). In a previous report, we had shown that the copolymers and the surfactants co-assembled spon…
▽ More
The complexation between charged-neutral block copolymers and oppositely charged surfactants was investigated by light scattering experiments and by isothermal titration calorimetry (ITC). The copolymer was poly(sodium acrylate)-b-poly(acrylamide) and the surfactant dodecyltrimethylammonium bromide (DTAB). In a previous report, we had shown that the copolymers and the surfactants co-assembled spontaneously into colloidal complexes. Depending of the charge ratio Z = [DTA+]/[COO-], the complexes were either single surfactant micelles decorated by copolymers, or core-shell hierarchical structures. ITC was performed in order to investigate the thermodynamics of the complex formation. Titrations of copolymers by surfactants and of surfactants by copolymers revealed that the electrostatic co-assembly was an endothermic reaction, suggesting a process dominated by the entropy of the counterions. Here we found that the thermodynamic quantities associated with the reaction depended on the mixing order. When surfactants were added stepwise to copolymers, the titration was associated with the formation of single micelles decorated by a unique polymer. Above a critical charge ratio, the micelles rearranged themselves into 100 nm colloidal complexes in a collective process which displayed the following features : i) the process was very slow as compared to the timescale of Brownian diffusion, ii) the thermodynamic signature was a endothermic peak and iii) the stoichiometry between the positive and negative charges was modified from n = 0.48 (single micelles) to 0.75 (core-shell complexes). The amount of polyelectrolytes needed for the complex formation exceeded the number required to compensate the net micellar charge, confirming the evidence of overcharging in the complex formation.
△ Less
Submitted 26 July, 2011;
originally announced July 2011.
-
Atomic diffraction by a thin phase grating
Authors:
C. Henkel,
J. -Y. Courtois,
A. Aspect
Abstract:
We present a semiclassical perturbation method for the description of atomic diffraction by a weakly modulated potential. It proceeds in a way similar to the treatment of light diffraction by a thin phase grating, and consists in calculating the atomic wavefunction by means of action integrals along the classical trajectories of the atoms in the absence of the modulated part of the potential. Th…
▽ More
We present a semiclassical perturbation method for the description of atomic diffraction by a weakly modulated potential. It proceeds in a way similar to the treatment of light diffraction by a thin phase grating, and consists in calculating the atomic wavefunction by means of action integrals along the classical trajectories of the atoms in the absence of the modulated part of the potential. The capabilities and the validity condition of the method are illustrated on the well-known case of atomic diffraction by a Gaussian standing wave. We prove that in this situation the perturbation method is equivalent to the Raman-Nath approximation, and we point out that the usually-considered Raman-Nath validity condition can lead to inaccuracies in the evaluation of the phases of the diffraction amplitudes. The method is also applied to the case of an evanescent wave reflection grating, and an analytical expression for the diffraction pattern at any incidence angle is obtained for the first time. Finally, the application of the method to other situations is briefly discussed.
△ Less
Submitted 25 August, 2004;
originally announced August 2004.
-
Phase shifts of atomic de Broglie waves at an evanescent wave mirror
Authors:
C. Henkel,
J. -Y. Courtois,
R. Kaiser,
C. Westbrook,
A. Aspect
Abstract:
A detailed theoretical investigation of the reflection of an atomic de Broglie wave at an evanescent wave mirror is presented. The classical and the semiclassical descriptions of the reflection process are reviewed, and a full wave-mechanical approach based on the analytical soution of the corresponding Schrödinger equation is presented. The phase shift at reflection is calculated exactly and in…
▽ More
A detailed theoretical investigation of the reflection of an atomic de Broglie wave at an evanescent wave mirror is presented. The classical and the semiclassical descriptions of the reflection process are reviewed, and a full wave-mechanical approach based on the analytical soution of the corresponding Schrödinger equation is presented. The phase shift at reflection is calculated exactly and interpreted in terms of instantaneous reflection of the atom at an effective mirror. Besides the semiclassical regime of reflection describable by the WKB method, a pure quantum regime of reflection is identified in the limit where the incident de Broglie wavelength is large compared to the evanescent wave decay length.
△ Less
Submitted 16 January, 2003;
originally announced January 2003.
-
Atom cooling and trap** by disorder
Authors:
Peter Horak,
Jean-Yves Courtois,
Gilbert Grynberg
Abstract:
We demonstrate the possibility of three-dimensional cooling of neutral atoms by illuminating them with two counterpropagating laser beams of mutually orthogonal linear polarization, where one of the lasers is a speckle field, i.e. a highly disordered but stationary coherent light field. This configuration gives rise to atom cooling in the transverse plane via a Sisyphus cooling mechanism similar…
▽ More
We demonstrate the possibility of three-dimensional cooling of neutral atoms by illuminating them with two counterpropagating laser beams of mutually orthogonal linear polarization, where one of the lasers is a speckle field, i.e. a highly disordered but stationary coherent light field. This configuration gives rise to atom cooling in the transverse plane via a Sisyphus cooling mechanism similar to the one known in standard two-dimensional optical lattices formed by several plane laser waves. However, striking differences occur in the spatial diffusion coefficients as well as in local properties of the trapped atoms.
△ Less
Submitted 29 May, 1998;
originally announced May 1998.
-
Recoil and momentum diffusion of an atom close to a vacuum-dielectric interface
Authors:
Carsten Henkel,
Jean-Yves Courtois
Abstract:
We derive the quantum-mechanical master equation (generalized optical Bloch equation) for an atom in the vicinity of a flat dielectric surface. This equation gives access to the semiclassical radiation pressure force and the atomic momentum diffusion tensor, that are expressed in terms of the vacuum field correlation function (electromagnetic field susceptibility). It is demonstrated that the at…
▽ More
We derive the quantum-mechanical master equation (generalized optical Bloch equation) for an atom in the vicinity of a flat dielectric surface. This equation gives access to the semiclassical radiation pressure force and the atomic momentum diffusion tensor, that are expressed in terms of the vacuum field correlation function (electromagnetic field susceptibility). It is demonstrated that the atomic center-of-mass motion provides a nonlocal probe of the electromagnetic vacuum fluctuations. We show in particular that in a circularly polarized evanescent wave, the radiation pressure force experienced by the atoms is not colinear with the evanescent wave's propagation vector. In a linearly polarized evanescent wave, the recoil per fluorescence cycle leads to a net magnetization for a Jg = 1/2 ground state atom.
△ Less
Submitted 9 April, 1998;
originally announced April 1998.
