Physics and semantic informed multi-sensor calibration via optimization theory and self-supervised learning
Authors:
Shmuel Y. Hayoun,
Meir Halachmi,
Doron Serebro,
Kfir Twizer,
Elinor Medezinski,
Liron Korkidi,
Moshik Cohen,
Itai Orr
Abstract:
Achieving safe and reliable autonomous driving relies greatly on the ability to achieve an accurate and robust perception system; however, this cannot be fully realized without precisely calibrated sensors. Environmental and operational conditions as well as improper maintenance can produce calibration errors inhibiting sensor fusion and, consequently, degrading the perception performance. Traditi…
▽ More
Achieving safe and reliable autonomous driving relies greatly on the ability to achieve an accurate and robust perception system; however, this cannot be fully realized without precisely calibrated sensors. Environmental and operational conditions as well as improper maintenance can produce calibration errors inhibiting sensor fusion and, consequently, degrading the perception performance. Traditionally, sensor calibration is performed in a controlled environment with one or more known targets. Such a procedure can only be carried out in between drives and requires manual operation; a tedious task if needed to be conducted on a regular basis. This sparked a recent interest in online targetless methods, capable of yielding a set of geometric transformations based on perceived environmental features, however, the required redundancy in sensing modalities makes this task even more challenging, as the features captured by each modality and their distinctiveness may vary. We present a holistic approach to performing joint calibration of a camera-lidar-radar trio. Leveraging prior knowledge and physical properties of these sensing modalities together with semantic information, we propose two targetless calibration methods within a cost minimization framework once via direct online optimization, and second via self-supervised learning (SSL).
△ Less
Submitted 6 June, 2022;
originally announced June 2022.
Analysis of dislocations in quasicrystals composed of self-assembled nanoparticles
Authors:
Liron Korkidi,
Kobi Barkan,
Ron Lifshitz
Abstract:
We analyze transmission electron microscopy (TEM) images of self-assembled quasicrystals, composed of binary systems of nanoparticles. We use an automated procedure that identifies the positions of dislocations and determines their topological character. To achieve this we decompose the quasicrystal into its individual density modes, or Fourier components, and identify their topological winding nu…
▽ More
We analyze transmission electron microscopy (TEM) images of self-assembled quasicrystals, composed of binary systems of nanoparticles. We use an automated procedure that identifies the positions of dislocations and determines their topological character. To achieve this we decompose the quasicrystal into its individual density modes, or Fourier components, and identify their topological winding numbers for every dislocation. This procedure associates a Burgers function with each dislocation, from which we extract the components of the Burgers vector after choosing a basis. The Burgers vectors that we see in the experimental images are all of lowest order, containing only 0's and 1's as their components. We argue that the density of the different types of Burgers vectors depends on their energetic cost.
△ Less
Submitted 14 November, 2012;
originally announced November 2012.
