-
Sparsity-based background removal for STORM super-resolution images
Authors:
Patris Valera,
Josué Page Vizcaíno,
Tobias Lasser
Abstract:
Single-molecule localization microscopy techniques, like stochastic optical reconstruction microscopy (STORM), visualize biological specimens by stochastically exciting sparse blinking emitters. The raw images suffer from unwanted background fluorescence, which must be removed to achieve super-resolution. We introduce a sparsity-based background removal method by adapting a neural network (SLNet)…
▽ More
Single-molecule localization microscopy techniques, like stochastic optical reconstruction microscopy (STORM), visualize biological specimens by stochastically exciting sparse blinking emitters. The raw images suffer from unwanted background fluorescence, which must be removed to achieve super-resolution. We introduce a sparsity-based background removal method by adapting a neural network (SLNet) from a different microscopy domain. The SLNet computes a low-rank representation of the images, and then, by subtracting it from the raw images, the sparse component is computed, representing the frames without the background. We compared our approach with widely used background removal methods, such as the median background removal or the rolling ball algorithm, on two commonly used STORM datasets, one glial cell, and one microtubule dataset. The SLNet delivers STORM frames with less background, leading to higher emitters' localization precision and higher-resolution reconstructed images than commonly used methods. Notably, the SLNet is lightweight and easily trainable (<5 min). Since it is trained in an unsupervised manner, no prior information is required and can be applied to any STORM dataset. We uploaded a pre-trained SLNet to the Bioimage model zoo, easily accessible through ImageJ. Our results show that our sparse decomposition method could be an essential and efficient STORM pre-processing tool.
△ Less
Submitted 15 January, 2024;
originally announced January 2024.
-
Short reasons for long vectors in HPC CPUs: a study based on RISC-V
Authors:
Pablo Vizcaino,
Georgios Ieronymakis,
Nikolaos Dimou,
Vassilis Papaefstathiou,
Jesus Labarta,
Filippo Mantovani
Abstract:
For years, SIMD/vector units have enhanced the capabilities of modern CPUs in High-Performance Computing (HPC) and mobile technology. Typical commercially-available SIMD units process up to 8 double-precision elements with one instruction. The optimal vector width and its impact on CPU throughput due to memory latency and bandwidth remain challenging research areas. This study examines the behavio…
▽ More
For years, SIMD/vector units have enhanced the capabilities of modern CPUs in High-Performance Computing (HPC) and mobile technology. Typical commercially-available SIMD units process up to 8 double-precision elements with one instruction. The optimal vector width and its impact on CPU throughput due to memory latency and bandwidth remain challenging research areas. This study examines the behavior of four computational kernels on a RISC-V core connected to a customizable vector unit, capable of operating up to 256 double precision elements per instruction. The four codes have been purposefully selected to represent non-dense workloads: SpMV, BFS, PageRank, FFT. The experimental setup allows us to measure their performance while varying the vector length, the memory latency, and bandwidth. Our results not only show that larger vector lengths allow for better tolerance of limitations in the memory subsystem but also offer hope to code developers beyond dense linear algebra.
△ Less
Submitted 11 November, 2023; v1 submitted 13 September, 2023;
originally announced September 2023.
-
Fast light-field 3D microscopy with out-of-distribution detection and adaptation through Conditional Normalizing Flows
Authors:
Josué Page Vizcaíno,
Panagiotis Symvoulidis,
Zeguan Wang,
Jonas Jelten,
Paolo Favaro,
Edward S. Boyden,
Tobias Lasser
Abstract:
Real-time 3D fluorescence microscopy is crucial for the spatiotemporal analysis of live organisms, such as neural activity monitoring. The eXtended field-of-view light field microscope (XLFM), also known as Fourier light field microscope, is a straightforward, single snapshot solution to achieve this. The XLFM acquires spatial-angular information in a single camera exposure. In a subsequent step,…
▽ More
Real-time 3D fluorescence microscopy is crucial for the spatiotemporal analysis of live organisms, such as neural activity monitoring. The eXtended field-of-view light field microscope (XLFM), also known as Fourier light field microscope, is a straightforward, single snapshot solution to achieve this. The XLFM acquires spatial-angular information in a single camera exposure. In a subsequent step, a 3D volume can be algorithmically reconstructed, making it exceptionally well-suited for real-time 3D acquisition and potential analysis. Unfortunately, traditional reconstruction methods (like deconvolution) require lengthy processing times (0.0220 Hz), hampering the speed advantages of the XLFM. Neural network architectures can overcome the speed constraints at the expense of lacking certainty metrics, which renders them untrustworthy for the biomedical realm. This work proposes a novel architecture to perform fast 3D reconstructions of live immobilized zebrafish neural activity based on a conditional normalizing flow. It reconstructs volumes at 8 Hz spanning 512x512x96 voxels, and it can be trained in under two hours due to the small dataset requirements (10 image-volume pairs). Furthermore, normalizing flows allow for exact Likelihood computation, enabling distribution monitoring, followed by out-of-distribution detection and retraining of the system when a novel sample is detected. We evaluate the proposed method on a cross-validation approach involving multiple in-distribution samples (genetically identical zebrafish) and various out-of-distribution ones.
△ Less
Submitted 14 June, 2023; v1 submitted 10 June, 2023;
originally announced June 2023.
-
Software Development Vehicles to enable extended and early co-design: a RISC-V and HPC case of study
Authors:
Filippo Mantovani,
Pablo Vizcaino,
Fabio Banchelli,
Marta Garcia-Gasulla,
Roger Ferrer,
Giorgos Ieronymakis,
Nikos Dimou,
Vassilis Papaefstathiou,
Jesus Labarta
Abstract:
Prototy** HPC systems with low-to-mid technology readiness level (TRL) systems is critical for providing feedback to hardware designers, the system software team (e.g., compiler developers), and early adopters from the scientific community. The typical approach to hardware design and HPC system prototy** often limits feedback or only allows it at a late stage. In this paper, we present a set o…
▽ More
Prototy** HPC systems with low-to-mid technology readiness level (TRL) systems is critical for providing feedback to hardware designers, the system software team (e.g., compiler developers), and early adopters from the scientific community. The typical approach to hardware design and HPC system prototy** often limits feedback or only allows it at a late stage. In this paper, we present a set of tools for co-designing HPC systems, called software development vehicles (SDV). We use an innovative RISC-V design as a demonstrator, which includes a scalar CPU and a vector processing unit capable of operating large vectors up to 16 kbits. We provide an incremental methodology and early tangible evidence of the co-design process that provide feedback to improve both architecture and system software at a very early stage of system development.
△ Less
Submitted 1 June, 2023;
originally announced June 2023.
-
Concurrent Segmentation and Localization for Tracking of Surgical Instruments
Authors:
Iro Laina,
Nicola Rieke,
Christian Rupprecht,
Josué Page Vizcaíno,
Abouzar Eslami,
Federico Tombari,
Nassir Navab
Abstract:
Real-time instrument tracking is a crucial requirement for various computer-assisted interventions. In order to overcome problems such as specular reflections and motion blur, we propose a novel method that takes advantage of the interdependency between localization and segmentation of the surgical tool. In particular, we reformulate the 2D instrument pose estimation as heatmap regression and ther…
▽ More
Real-time instrument tracking is a crucial requirement for various computer-assisted interventions. In order to overcome problems such as specular reflections and motion blur, we propose a novel method that takes advantage of the interdependency between localization and segmentation of the surgical tool. In particular, we reformulate the 2D instrument pose estimation as heatmap regression and thereby enable a concurrent, robust and near real-time regression of both tasks via deep learning. As demonstrated by our experimental results, this modeling leads to a significantly improved performance than directly regressing the tool position and allows our method to outperform the state of the art on a Retinal Microsurgery benchmark and the MICCAI EndoVis Challenge 2015.
△ Less
Submitted 1 August, 2017; v1 submitted 30 March, 2017;
originally announced March 2017.
-
Relations between ex falso, tertium non datur, and double negation elimination
Authors:
Pedro Francisco Valencia Vizcaíno
Abstract:
We show which implicational relations hold between the three principles ex falso sequitur quodlibet, tertium non datur, and double negation elimination, on the basis of minimal logic.
We show which implicational relations hold between the three principles ex falso sequitur quodlibet, tertium non datur, and double negation elimination, on the basis of minimal logic.
△ Less
Submitted 31 March, 2013;
originally announced April 2013.
