-
Resolving the Orientations of and Separation between an Overlap** Pair of Dipole Emitters
Authors:
Yiyang Chen,
Yuanxin Qiu,
Matthew D. Lew
Abstract:
We prove that it is impossible to distinguish two spatially overlap** fluorescent molecules from a single rotating molecule, even if one modulates the polarization of pum** light or the detection dipole-spread function (DSF). If the target is known to be a dipole pair, existing imaging methods perform poorly for measuring their angular separation. We propose simultaneously modulating the excit…
▽ More
We prove that it is impossible to distinguish two spatially overlap** fluorescent molecules from a single rotating molecule, even if one modulates the polarization of pum** light or the detection dipole-spread function (DSF). If the target is known to be a dipole pair, existing imaging methods perform poorly for measuring their angular separation. We propose simultaneously modulating the excitation polarization and DSF, which demonstrates robust discrimination between dipole pairs versus single molecules. Our method improves the precision of measuring centroid orientation by 50% and angular separation by 4- to 6-fold over existing techniques.
△ Less
Submitted 26 June, 2024; v1 submitted 6 June, 2024;
originally announced June 2024.
-
Dipole-Spread Function Engineering for 6D Super-Resolution Microscopy
Authors:
Tingting Wu,
Matthew D. Lew
Abstract:
Fluorescent molecules are versatile nanoscale emitters that enable detailed observations of biophysical processes with nanoscale resolution. Because they are well-approximated as electric dipoles, imaging systems can be designed to visualize their 3D positions and 3D orientations, so-called dipole-spread function (DSF) engineering, for 6D super-resolution single-molecule orientation-localization m…
▽ More
Fluorescent molecules are versatile nanoscale emitters that enable detailed observations of biophysical processes with nanoscale resolution. Because they are well-approximated as electric dipoles, imaging systems can be designed to visualize their 3D positions and 3D orientations, so-called dipole-spread function (DSF) engineering, for 6D super-resolution single-molecule orientation-localization microscopy (SMOLM). We review fundamental image-formation theory for fluorescent di-poles, as well as how phase and polarization modulation can be used to change the image of a dipole emitter produced by a microscope, called its DSF. We describe several methods for designing these modulations for optimum performance, as well as compare recently developed techniques, including the double-helix, tetrapod, crescent, and DeepSTORM3D learned point-spread functions (PSFs), in addition to the tri-spot, vortex, pixOL, raPol, CHIDO, and MVR DSFs. We also cover common imaging system designs and techniques for implementing engineered DSFs. Finally, we discuss recent biological applications of 6D SMOLM and future challenges for pushing the capabilities and utility of the technology.
△ Less
Submitted 9 October, 2023;
originally announced October 2023.
-
Deep Learning-based Synthetic High-Resolution In-Depth Imaging Using an Attachable Dual-element Endoscopic Ultrasound Probe
Authors:
Hah Min Lew,
Jae Seong Kim,
Moon Hwan Lee,
Jaegeun Park,
Sangyeon Youn,
Hee Man Kim,
Jihun Kim,
Jae Youn Hwang
Abstract:
Endoscopic ultrasound (EUS) imaging has a trade-off between resolution and penetration depth. By considering the in-vivo characteristics of human organs, it is necessary to provide clinicians with appropriate hardware specifications for precise diagnosis. Recently, super-resolution (SR) ultrasound imaging studies, including the SR task in deep learning fields, have been reported for enhancing ultr…
▽ More
Endoscopic ultrasound (EUS) imaging has a trade-off between resolution and penetration depth. By considering the in-vivo characteristics of human organs, it is necessary to provide clinicians with appropriate hardware specifications for precise diagnosis. Recently, super-resolution (SR) ultrasound imaging studies, including the SR task in deep learning fields, have been reported for enhancing ultrasound images. However, most of those studies did not consider ultrasound imaging natures, but rather they were conventional SR techniques based on downsampling of ultrasound images. In this study, we propose a novel deep learning-based high-resolution in-depth imaging probe capable of offering low- and high-frequency ultrasound image pairs. We developed an attachable dual-element EUS probe with customized low- and high-frequency ultrasound transducers under small hardware constraints. We also designed a special geared structure to enable the same image plane. The proposed system was evaluated with a wire phantom and a tissue-mimicking phantom. After the evaluation, 442 ultrasound image pairs from the tissue-mimicking phantom were acquired. We then applied several deep learning models to obtain synthetic high-resolution in-depth images, thus demonstrating the feasibility of our approach for clinical unmet needs. Furthermore, we quantitatively and qualitatively analyzed the results to find a suitable deep-learning model for our task. The obtained results demonstrate that our proposed dual-element EUS probe with an image-to-image translation network has the potential to provide synthetic high-frequency ultrasound images deep inside tissues.
△ Less
Submitted 13 September, 2023;
originally announced September 2023.
-
RONELDv2: A faster, improved lane tracking method
Authors:
Zhe Ming Chng,
Joseph Mun Hung Lew,
Jimmy Addison Lee
Abstract:
Lane detection is an integral part of control systems in autonomous vehicles and lane departure warning systems as lanes are a key component of the operating environment for road vehicles. In a previous paper, a robust neural network output enhancement for active lane detection (RONELD) method augmenting deep learning lane detection models to improve active, or ego, lane accuracy performance was p…
▽ More
Lane detection is an integral part of control systems in autonomous vehicles and lane departure warning systems as lanes are a key component of the operating environment for road vehicles. In a previous paper, a robust neural network output enhancement for active lane detection (RONELD) method augmenting deep learning lane detection models to improve active, or ego, lane accuracy performance was presented. This paper extends the work by further investigating the lane tracking methods used to increase robustness of the method to lane changes and different lane dimensions (e.g. lane marking thickness) and proposes an improved, lighter weight lane detection method, RONELDv2. It improves on the previous RONELD method by detecting the lane point variance, merging lanes to find a more accurate set of lane parameters, and using an exponential moving average method to calculate more robust lane weights. Experiments using the proposed improvements show a consistent increase in lane detection accuracy results across different datasets and deep learning models, as well as a decrease in computational complexity observed via an up to two-fold decrease in runtime, which enhances its suitability for real-time use on autonomous vehicles and lane departure warning systems.
△ Less
Submitted 26 February, 2022;
originally announced February 2022.
-
Towards optimal point spread function design for resolving closely spaced emitters in three dimensions
Authors:
James M. Jusuf,
Matthew D. Lew
Abstract:
The past decade has brought many innovations in optical design for 3D super-resolution imaging of point-like emitters, but these methods often focus on single-emitter localization precision as a performance metric. Here, we propose a simple heuristic for designing a point spread function (PSF) that allows for precise measurement of the distance between two emitters. We discover that there are two…
▽ More
The past decade has brought many innovations in optical design for 3D super-resolution imaging of point-like emitters, but these methods often focus on single-emitter localization precision as a performance metric. Here, we propose a simple heuristic for designing a point spread function (PSF) that allows for precise measurement of the distance between two emitters. We discover that there are two types of PSFs that achieve high performance for resolving emitters in 3D, as quantified by the Cramér-Rao bounds for estimating the separation between two closely spaced emitters. One PSF is very similar to the existing Tetrapod PSFs; the other is a rotating single-spot PSF, which we call the crescent PSF. The latter exhibits excellent performance for localizing single emitters throughout a 1-$μ$m focal volume (localization precisions of 7.3~nm in $x$, 7.7~nm in $y$, and 18.3~nm in $z$ using 1000 detected photons), and it distinguishes between one and two closely spaced emitters with superior accuracy ($25$-$53\%$ lower error rates than the best-performing Tetrapod PSF, averaged throughout a 1-$μ$m focal volume). Our study provides additional insights into optimal strategies for encoding 3D spatial information into optical PSFs.
△ Less
Submitted 11 September, 2022; v1 submitted 29 November, 2021;
originally announced November 2021.
-
Integrating Information Theory and Adversarial Learning for Cross-modal Retrieval
Authors:
Wei Chen,
Yu Liu,
Erwin M. Bakker,
Michael S. Lew
Abstract:
Accurately matching visual and textual data in cross-modal retrieval has been widely studied in the multimedia community. To address these challenges posited by the heterogeneity gap and the semantic gap, we propose integrating Shannon information theory and adversarial learning. In terms of the heterogeneity gap, we integrate modality classification and information entropy maximization adversaria…
▽ More
Accurately matching visual and textual data in cross-modal retrieval has been widely studied in the multimedia community. To address these challenges posited by the heterogeneity gap and the semantic gap, we propose integrating Shannon information theory and adversarial learning. In terms of the heterogeneity gap, we integrate modality classification and information entropy maximization adversarially. For this purpose, a modality classifier (as a discriminator) is built to distinguish the text and image modalities according to their different statistical properties. This discriminator uses its output probabilities to compute Shannon information entropy, which measures the uncertainty of the modality classification it performs. Moreover, feature encoders (as a generator) project uni-modal features into a commonly shared space and attempt to fool the discriminator by maximizing its output information entropy. Thus, maximizing information entropy gradually reduces the distribution discrepancy of cross-modal features, thereby achieving a domain confusion state where the discriminator cannot classify two modalities confidently. To reduce the semantic gap, Kullback-Leibler (KL) divergence and bi-directional triplet loss are used to associate the intra- and inter-modality similarity between features in the shared space. Furthermore, a regularization term based on KL-divergence with temperature scaling is used to calibrate the biased label classifier caused by the data imbalance issue. Extensive experiments with four deep models on four benchmarks are conducted to demonstrate the effectiveness of the proposed approach.
△ Less
Submitted 11 April, 2021;
originally announced April 2021.
-
Lifelong Person Re-Identification via Adaptive Knowledge Accumulation
Authors:
Nan Pu,
Wei Chen,
Yu Liu,
Erwin M. Bakker,
Michael S. Lew
Abstract:
Person ReID methods always learn through a stationary domain that is fixed by the choice of a given dataset. In many contexts (e.g., lifelong learning), those methods are ineffective because the domain is continually changing in which case incremental learning over multiple domains is required potentially. In this work we explore a new and challenging ReID task, namely lifelong person re-identific…
▽ More
Person ReID methods always learn through a stationary domain that is fixed by the choice of a given dataset. In many contexts (e.g., lifelong learning), those methods are ineffective because the domain is continually changing in which case incremental learning over multiple domains is required potentially. In this work we explore a new and challenging ReID task, namely lifelong person re-identification (LReID), which enables to learn continuously across multiple domains and even generalise on new and unseen domains. Following the cognitive processes in the human brain, we design an Adaptive Knowledge Accumulation (AKA) framework that is endowed with two crucial abilities: knowledge representation and knowledge operation. Our method alleviates catastrophic forgetting on seen domains and demonstrates the ability to generalize to unseen domains. Correspondingly, we also provide a new and large-scale benchmark for LReID. Extensive experiments demonstrate our method outperforms other competitors by a margin of 5.8% mAP in generalising evaluation.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Preprint: Norm Loss: An efficient yet effective regularization method for deep neural networks
Authors:
Theodoros Georgiou,
Sebastian Schmitt,
Thomas Bäck,
Wei Chen,
Michael Lew
Abstract:
Convolutional neural network training can suffer from diverse issues like exploding or vanishing gradients, scaling-based weight space symmetry and covariant-shift. In order to address these issues, researchers develop weight regularization methods and activation normalization methods. In this work we propose a weight soft-regularization method based on the Oblique manifold. The proposed method us…
▽ More
Convolutional neural network training can suffer from diverse issues like exploding or vanishing gradients, scaling-based weight space symmetry and covariant-shift. In order to address these issues, researchers develop weight regularization methods and activation normalization methods. In this work we propose a weight soft-regularization method based on the Oblique manifold. The proposed method uses a loss function which pushes each weight vector to have a norm close to one, i.e. the weight matrix is smoothly steered toward the so-called Oblique manifold. We evaluate our method on the very popular CIFAR-10, CIFAR-100 and ImageNet 2012 datasets using two state-of-the-art architectures, namely the ResNet and wide-ResNet. Our method introduces negligible computational overhead and the results show that it is competitive to the state-of-the-art and in some cases superior to it. Additionally, the results are less sensitive to hyperparameter settings such as batch size and regularization factor.
△ Less
Submitted 11 March, 2021;
originally announced March 2021.
-
PREPRINT: Comparison of deep learning and hand crafted features for mining simulation data
Authors:
Theodoros Georgiou,
Sebastian Schmitt,
Thomas Bäck,
Nan Pu,
Wei Chen,
Michael Lew
Abstract:
Computational Fluid Dynamics (CFD) simulations are a very important tool for many industrial applications, such as aerodynamic optimization of engineering designs like cars shapes, airplanes parts etc. The output of such simulations, in particular the calculated flow fields, are usually very complex and hard to interpret for realistic three-dimensional real-world applications, especially if time-d…
▽ More
Computational Fluid Dynamics (CFD) simulations are a very important tool for many industrial applications, such as aerodynamic optimization of engineering designs like cars shapes, airplanes parts etc. The output of such simulations, in particular the calculated flow fields, are usually very complex and hard to interpret for realistic three-dimensional real-world applications, especially if time-dependent simulations are investigated. Automated data analysis methods are warranted but a non-trivial obstacle is given by the very large dimensionality of the data. A flow field typically consists of six measurement values for each point of the computational grid in 3D space and time (velocity vector values, turbulent kinetic energy, pressure and viscosity). In this paper we address the task of extracting meaningful results in an automated manner from such high dimensional data sets. We propose deep learning methods which are capable of processing such data and which can be trained to solve relevant tasks on simulation data, i.e. predicting drag and lift forces applied on an airfoil. We also propose an adaptation of the classical hand crafted features known from computer vision to address the same problem and compare a large variety of descriptors and detectors. Finally, we compile a large dataset of 2D simulations of the flow field around airfoils which contains 16000 flow fields with which we tested and compared approaches. Our results show that the deep learning-based methods, as well as hand crafted feature based approaches, are well-capable to accurately describe the content of the CFD simulation output on the proposed dataset.
△ Less
Submitted 11 March, 2021;
originally announced March 2021.
-
Deep Learning for Instance Retrieval: A Survey
Authors:
Wei Chen,
Yu Liu,
Wei** Wang,
Erwin Bakker,
Theodoros Georgiou,
Paul Fieguth,
Li Liu,
Michael S. Lew
Abstract:
In recent years a vast amount of visual content has been generated and shared from many fields, such as social media platforms, medical imaging, and robotics. This abundance of content creation and sharing has introduced new challenges, particularly that of searching databases for similar content-Content Based Image Retrieval (CBIR)-a long-established research area in which improved efficiency and…
▽ More
In recent years a vast amount of visual content has been generated and shared from many fields, such as social media platforms, medical imaging, and robotics. This abundance of content creation and sharing has introduced new challenges, particularly that of searching databases for similar content-Content Based Image Retrieval (CBIR)-a long-established research area in which improved efficiency and accuracy are needed for real-time retrieval. Artificial intelligence has made progress in CBIR and has significantly facilitated the process of instance search. In this survey we review recent instance retrieval works that are developed based on deep learning algorithms and techniques, with the survey organized by deep network architecture types, deep features, feature embedding and aggregation methods, and network fine-tuning strategies. Our survey considers a wide variety of recent methods, whereby we identify milestone work, reveal connections among various methods and present the commonly used benchmarks, evaluation results, common challenges, and propose promising future directions.
△ Less
Submitted 30 October, 2022; v1 submitted 27 January, 2021;
originally announced January 2021.
-
RONELD: Robust Neural Network Output Enhancement for Active Lane Detection
Authors:
Zhe Ming Chng,
Joseph Mun Hung Lew,
Jimmy Addison Lee
Abstract:
Accurate lane detection is critical for navigation in autonomous vehicles, particularly the active lane which demarcates the single road space that the vehicle is currently traveling on. Recent state-of-the-art lane detection algorithms utilize convolutional neural networks (CNNs) to train deep learning models on popular benchmarks such as TuSimple and CULane. While each of these models works part…
▽ More
Accurate lane detection is critical for navigation in autonomous vehicles, particularly the active lane which demarcates the single road space that the vehicle is currently traveling on. Recent state-of-the-art lane detection algorithms utilize convolutional neural networks (CNNs) to train deep learning models on popular benchmarks such as TuSimple and CULane. While each of these models works particularly well on train and test inputs obtained from the same dataset, the performance drops significantly on unseen datasets of different environments. In this paper, we present a real-time robust neural network output enhancement for active lane detection (RONELD) method to identify, track, and optimize active lanes from deep learning probability map outputs. We first adaptively extract lane points from the probability map outputs, followed by detecting curved and straight lanes before using weighted least squares linear regression on straight lanes to fix broken lane edges resulting from fragmentation of edge maps in real images. Lastly, we hypothesize true active lanes through tracking preceding frames. Experimental results demonstrate an up to two-fold increase in accuracy using RONELD on cross-dataset validation tests.
△ Less
Submitted 2 November, 2020; v1 submitted 19 October, 2020;
originally announced October 2020.
-
New Ideas and Trends in Deep Multimodal Content Understanding: A Review
Authors:
Wei Chen,
Wei** Wang,
Li Liu,
Michael S. Lew
Abstract:
The focus of this survey is on the analysis of two modalities of multimodal deep learning: image and text. Unlike classic reviews of deep learning where monomodal image classifiers such as VGG, ResNet and Inception module are central topics, this paper will examine recent multimodal deep models and structures, including auto-encoders, generative adversarial nets and their variants. These models go…
▽ More
The focus of this survey is on the analysis of two modalities of multimodal deep learning: image and text. Unlike classic reviews of deep learning where monomodal image classifiers such as VGG, ResNet and Inception module are central topics, this paper will examine recent multimodal deep models and structures, including auto-encoders, generative adversarial nets and their variants. These models go beyond the simple image classifiers in which they can do uni-directional (e.g. image captioning, image generation) and bi-directional (e.g. cross-modal retrieval, visual question answering) multimodal tasks. Besides, we analyze two aspects of the challenge in terms of better content understanding in deep multimodal applications. We then introduce current ideas and trends in deep multimodal feature learning, such as feature embedding approaches and objective function design, which are crucial in overcoming the aforementioned challenges. Finally, we include several promising directions for future research.
△ Less
Submitted 16 October, 2020;
originally announced October 2020.
-
On the Exploration of Incremental Learning for Fine-grained Image Retrieval
Authors:
Wei Chen,
Yu Liu,
Wei** Wang,
Tinne Tuytelaars,
Erwin M. Bakker,
Michael Lew
Abstract:
In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On the other hand, fine-tuning the learned representation only with the new classes leads to catastrophic forgetting. To this end, we propose an incremental learn…
▽ More
In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On the other hand, fine-tuning the learned representation only with the new classes leads to catastrophic forgetting. To this end, we propose an incremental learning method to mitigate retrieval performance degradation caused by the forgetting issue. Without accessing any samples of the original classes, the classifier of the original network provides soft "labels" to transfer knowledge to train the adaptive network, so as to preserve the previous capability for classification. More importantly, a regularization function based on Maximum Mean Discrepancy is devised to minimize the discrepancy of new classes features from the original network and the adaptive network, respectively. Extensive experiments on two datasets show that our method effectively mitigates the catastrophic forgetting on the original classes while achieving high performance on the new classes.
△ Less
Submitted 15 October, 2020;
originally announced October 2020.
-
Single-molecule orientation localization microscopy II: a performance comparison
Authors:
Oumeng Zhang,
Matthew D. Lew
Abstract:
Various techniques have been developed to measure the 2D and 3D positions and 2D and 3D orientations of fluorescent molecules with improved precision over standard epifluorescence microscopes. Due to the challenging signal-to-background ratio in typical single-molecule experiments, it is essential to choose an imaging system optimized for the specific target sample. In this work, we compare the pe…
▽ More
Various techniques have been developed to measure the 2D and 3D positions and 2D and 3D orientations of fluorescent molecules with improved precision over standard epifluorescence microscopes. Due to the challenging signal-to-background ratio in typical single-molecule experiments, it is essential to choose an imaging system optimized for the specific target sample. In this work, we compare the performance of multiple state-of-the-art and commonly used methods for orientation localization microscopy against the fundamental limits of measurement precision. Our analysis reveals optimal imaging methods for various experiment conditions and sample geometries. Interestingly, simple modifications to the standard fluorescence microscope exhibit superior performance in many imaging scenarios.
△ Less
Submitted 31 January, 2021; v1 submitted 8 October, 2020;
originally announced October 2020.
-
Single-molecule orientation localization microscopy I: fundamental limits
Authors:
Oumeng Zhang,
Matthew D. Lew
Abstract:
Precisely measuring the three-dimensional position and orientation of individual fluorophores is challenging due to the substantial photon shot noise in single-molecule experiments. Facing this limited photon budget, numerous techniques have been developed to encode 2D and 3D position and 2D and 3D orientation information into fluorescence images. In this work, we adapt classical and quantum estim…
▽ More
Precisely measuring the three-dimensional position and orientation of individual fluorophores is challenging due to the substantial photon shot noise in single-molecule experiments. Facing this limited photon budget, numerous techniques have been developed to encode 2D and 3D position and 2D and 3D orientation information into fluorescence images. In this work, we adapt classical and quantum estimation theory and propose a mathematical framework to derive the best possible precision for measuring the position and orientation of dipole-like emitters for any fixed imaging system. We find that it is impossible to design an instrument that achieves the maximum sensitivity limit for measuring all possible rotational motions. Further, our vectorial dipole imaging model shows that the best quantum-limited localization precision is ~4-8% worse than that suggested by a scalar monopole model. Overall, we conclude that no single instrument can be optimized for maximum precision across all possible 2D and 3D localization and orientation measurement tasks.
△ Less
Submitted 31 January, 2021; v1 submitted 8 October, 2020;
originally announced October 2020.
-
Dual Gaussian-based Variational Subspace Disentanglement for Visible-Infrared Person Re-Identification
Authors:
Nan Pu,
Wei Chen,
Yu Liu,
Erwin M. Bakker,
Michael S. Lew
Abstract:
Visible-infrared person re-identification (VI-ReID) is a challenging and essential task in night-time intelligent surveillance systems. Except for the intra-modality variance that RGB-RGB person re-identification mainly overcomes, VI-ReID suffers from additional inter-modality variance caused by the inherent heterogeneous gap. To solve the problem, we present a carefully designed dual Gaussian-bas…
▽ More
Visible-infrared person re-identification (VI-ReID) is a challenging and essential task in night-time intelligent surveillance systems. Except for the intra-modality variance that RGB-RGB person re-identification mainly overcomes, VI-ReID suffers from additional inter-modality variance caused by the inherent heterogeneous gap. To solve the problem, we present a carefully designed dual Gaussian-based variational auto-encoder (DG-VAE), which disentangles an identity-discriminable and an identity-ambiguous cross-modality feature subspace, following a mixture-of-Gaussians (MoG) prior and a standard Gaussian distribution prior, respectively. Disentangling cross-modality identity-discriminable features leads to more robust retrieval for VI-ReID. To achieve efficient optimization like conventional VAE, we theoretically derive two variational inference terms for the MoG prior under the supervised setting, which not only restricts the identity-discriminable subspace so that the model explicitly handles the cross-modality intra-identity variance, but also enables the MoG distribution to avoid posterior collapse. Furthermore, we propose a triplet swap reconstruction (TSR) strategy to promote the above disentangling process. Extensive experiments demonstrate that our method outperforms state-of-the-art methods on two VI-ReID datasets.
△ Less
Submitted 6 August, 2020;
originally announced August 2020.
-
Quantum limits for precisely estimating the orientation and wobble of dipole emitters
Authors:
Oumeng Zhang,
Matthew D. Lew
Abstract:
Precisely measuring molecular orientation is key to understanding how molecules organize and interact in soft matter, but the maximum theoretical limit of measurement precision has yet to be quantified. We use quantum estimation theory and Fisher information (QFI) to derive a fundamental bound on the precision of estimating the orientations of rotationally fixed molecules. While direct imaging of…
▽ More
Precisely measuring molecular orientation is key to understanding how molecules organize and interact in soft matter, but the maximum theoretical limit of measurement precision has yet to be quantified. We use quantum estimation theory and Fisher information (QFI) to derive a fundamental bound on the precision of estimating the orientations of rotationally fixed molecules. While direct imaging of the microscope pupil achieves the quantum bound, it is not compatible with widefield imaging, so we propose an interferometric imaging system that also achieves QFI-limited measurement precision. Extending our analysis to rotationally diffusing molecules, we derive conditions that enable a subset of second-order dipole orientation moments to be measured with quantum-limited precision. Interestingly, we find that no existing techniques can measure all second moments simultaneously with QFI-limited precision; there exists a fundamental trade-off between precisely measuring the mean orientation of a molecule versus its wobble. This theoretical analysis provides crucial insight for optimizing the design of orientation-sensitive imaging systems.
△ Less
Submitted 24 June, 2020; v1 submitted 17 March, 2020;
originally announced March 2020.
-
A reckless guide to P-values: local evidence, global errors
Authors:
Michael J. Lew
Abstract:
This chapter demystifies P-values, hypothesis tests and significance tests, and introduces the concepts of local evidence and global error rates. The local evidence is embodied in \textit{this} data and concerns the hypotheses of interest for \textit{this} experiment, whereas the global error rate is a property of the statistical analysis and sampling procedure. It is shown using simple examples t…
▽ More
This chapter demystifies P-values, hypothesis tests and significance tests, and introduces the concepts of local evidence and global error rates. The local evidence is embodied in \textit{this} data and concerns the hypotheses of interest for \textit{this} experiment, whereas the global error rate is a property of the statistical analysis and sampling procedure. It is shown using simple examples that local evidence and global error rates can be, and should be, considered together when making inferences. Power analysis for experimental design for hypothesis testing are explained, along with the more locally focussed expected P-values. Issues relating to multiple testing, HARKing, and P-hacking are explained, and it is shown that, in many situation, their effects on local evidence and global error rates are in conflict, a conflict that can always be overcome by a fresh dataset from replication of key experiments. Statistics is complicated, and so is science. There is no singular right way to do either, and universally acceptable compromises may not exist. Statistics offers a wide array of tools for assisting with scientific inference by calibrating uncertainty, but statistical inference is not a substitute for scientific inference. P-values are useful indices of evidence and deserve their place in the statistical toolbox of basic pharmacologists.
△ Less
Submitted 22 September, 2019;
originally announced October 2019.
-
A Comparison of CNN and Classic Features for Image Retrieval
Authors:
Umut Özaydın,
Theodoros Georgiou,
Michael Lew
Abstract:
Feature detectors and descriptors have been successfully used for various computer vision tasks, such as video object tracking and content-based image retrieval. Many methods use image gradients in different stages of the detection-description pipeline to describe local image structures. Recently, some, or all, of these stages have been replaced by convolutional neural networks (CNNs), in order to…
▽ More
Feature detectors and descriptors have been successfully used for various computer vision tasks, such as video object tracking and content-based image retrieval. Many methods use image gradients in different stages of the detection-description pipeline to describe local image structures. Recently, some, or all, of these stages have been replaced by convolutional neural networks (CNNs), in order to increase their performance. A detector is defined as a selection problem, which makes it more challenging to implement as a CNN. They are therefore generally defined as regressors, converting input images to score maps and keypoints can be selected with non-maximum suppression. This paper discusses and compares several recent methods that use CNNs for keypoint detection. Experiments are performed both on the CNN based approaches, as well as a selection of conventional methods. In addition to qualitative measures defined on keypoints and descriptors, the bag-of-words (BoW) model is used to implement an image retrieval application, in order to determine how the methods perform in practice. The results show that each type of features are best in different contexts.
△ Less
Submitted 25 August, 2019;
originally announced August 2019.
-
Dense Super-Resolution Imaging of Molecular Orientation via Joint Sparse Basis Deconvolution and Spatial Pooling
Authors:
Hesam Mazidi,
Eshan S. King,
Oumeng Zhang,
Arye Nehorai,
Matthew D. Lew
Abstract:
In single-molecule super-resolution microscopy, engineered point-spread functions (PSFs) are designed to efficiently encode new molecular properties, such as 3D orientation, into complex spatial features captured by a camera. To fully benefit from their optimality, algorithms must estimate multi-dimensional parameters such as molecular position and orientation in the presence of PSF overlap and mo…
▽ More
In single-molecule super-resolution microscopy, engineered point-spread functions (PSFs) are designed to efficiently encode new molecular properties, such as 3D orientation, into complex spatial features captured by a camera. To fully benefit from their optimality, algorithms must estimate multi-dimensional parameters such as molecular position and orientation in the presence of PSF overlap and model-experiment mismatches. Here, we present a novel joint sparse deconvolution algorithm based on the decomposition of fluorescence images into six basis images that characterize molecular orientation. The proposed algorithm exploits a group-sparsity structure across these basis images and applies a pooling strategy on corresponding spatial features for robust simultaneous estimates of the number, brightness, 2D position, and 3D orientation of fluorescent molecules. We demonstrate this method by imaging DNA transiently labeled with the intercalating dye YOYO-1. Imaging the position and orientation of each molecule reveals orientational order and disorder within DNA with nanoscale spatial precision.
△ Less
Submitted 12 January, 2019;
originally announced January 2019.
-
Fundamental Limits on Measuring the Rotational Constraint of Single Molecules using Fluorescence Microscopy
Authors:
Oumeng Zhang,
Matthew D. Lew
Abstract:
Optical fluorescence imaging is capable of measuring both the spatial and rotational dynamics of single molecules. However, unavoidable measurement noise will result in inaccurate estimates of rotational dynamics, causing a molecule to appear to be more rotationally constrained than it actually is. We report a mathematical framework to compute the fundamental limit of accuracy in measuring the rot…
▽ More
Optical fluorescence imaging is capable of measuring both the spatial and rotational dynamics of single molecules. However, unavoidable measurement noise will result in inaccurate estimates of rotational dynamics, causing a molecule to appear to be more rotationally constrained than it actually is. We report a mathematical framework to compute the fundamental limit of accuracy in measuring the rotational mobility of dipole-like emitters. By applying our framework to both in-plane and three-dimensional methods, we provide a means to choose the optimal orientation-measurement technique based on experimental conditions.
△ Less
Submitted 19 April, 2019; v1 submitted 21 November, 2018;
originally announced November 2018.
-
On the Exploration of Convolutional Fusion Networks for Visual Recognition
Authors:
Yu Liu,
Yanming Guo,
Michael S. Lew
Abstract:
Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called convolutional fusion networks (CFN). Owing to using 1$\times$1 convolution and global average pooling, CFN can efficiently generate the side branches while adding few p…
▽ More
Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called convolutional fusion networks (CFN). Owing to using 1$\times$1 convolution and global average pooling, CFN can efficiently generate the side branches while adding few parameters. In addition, we present a locally-connected fusion module, which can learn adaptive weights for the side branches and form a discriminatively fused feature. CFN models trained on the CIFAR and ImageNet datasets demonstrate remarkable improvements over the plain CNNs. Furthermore, we generalize CFN to three new tasks, including scene recognition, fine-grained recognition and image retrieval. Our experiments show that it can obtain consistent improvements towards the transferring tasks.
△ Less
Submitted 16 November, 2016;
originally announced November 2016.
-
Speckle-Free Coherence Tomography of Turbid Media
Authors:
Orly Liba,
Matthew D. Lew,
Elliott D. SoRelle,
Rebecca Dutta,
Debasish Sen,
Darius M. Moshfeghi,
Steven Chu,
Adam de la Zerda
Abstract:
Optical coherence tomography (OCT) is a powerful biomedical imaging technology that relies on the coherent detection of backscattered light to image tissue morphology in vivo. As a consequence, OCT is susceptible to coherent noise (speckle noise), which imposes significant limitations on its diagnostic capabilities. Here we show a method based purely on light manipulation that is able to entirely…
▽ More
Optical coherence tomography (OCT) is a powerful biomedical imaging technology that relies on the coherent detection of backscattered light to image tissue morphology in vivo. As a consequence, OCT is susceptible to coherent noise (speckle noise), which imposes significant limitations on its diagnostic capabilities. Here we show a method based purely on light manipulation that is able to entirely remove the speckle noise originating from turbid samples without any compromise in resolution. We refer to this method as Speckle-Free OCT (SFOCT). Using SFOCT, we succeeded in revealing small structures that are otherwise hidden by speckle noise when using conventional OCT, including the inner stromal structure of a live mouse cornea, the fine structures inside the mouse pinna, sweat ducts, and Meissners corpuscle in the human fingertip skin. SFOCT has the potential to markedly increase OCTs diagnostic capabilities of various human diseases by revealing minute features that correlate with early pathology.
△ Less
Submitted 31 August, 2016;
originally announced September 2016.
-
An Electrochemical Potentiostat Interface for Mobile Devices: Enabling Remote Medical Diagnostics
Authors:
Henry Fu,
Henry Chow,
Michael Lew,
Shruti Menon,
Craig Scratchley,
M. Ash Parameswaran
Abstract:
An electrochemical potentiostat interface for mobile devices has been designed and implemented. The interface consists of a potentiostat module, a microcontroller module, and a Bluetooth module. The potentiostat module performs electrochemical measurements and detects the responses from the samples. The microcontroller module controls the test and communication processes. The Bluetooth module link…
▽ More
An electrochemical potentiostat interface for mobile devices has been designed and implemented. The interface consists of a potentiostat module, a microcontroller module, and a Bluetooth module. The potentiostat module performs electrochemical measurements and detects the responses from the samples. The microcontroller module controls the test and communication processes. The Bluetooth module links the system to a mobile device, where the mobile device acts as a control-console, data storage system, communication unit, and graphical plotter for the overall diagnostic processes. This interface is suitable for point-of-care and remote diagnostics, enhancing the capabilities of mobile devices in telemedicine.
△ Less
Submitted 29 September, 2015;
originally announced September 2015.
-
The likelihood principle does not entail a `sure thing', `evil demon' or `determinist' hypothesis
Authors:
Michael J. Lew
Abstract:
The likelihood principle makes strong claims about the nature of statistical evidence but is controversial. Its claims are undermined by the existence of several examples that are assumed to show that it allows, with unity probability, domination of all other hypotheses by the uninteresting, determinist hypothesis that whatever happened had to happen. Such examples are generally assumed to be impo…
▽ More
The likelihood principle makes strong claims about the nature of statistical evidence but is controversial. Its claims are undermined by the existence of several examples that are assumed to show that it allows, with unity probability, domination of all other hypotheses by the uninteresting, determinist hypothesis that whatever happened had to happen. Such examples are generally assumed to be important obstacles to the application of the likelihood principle: they are counter-examples to the principle. A re-analysis of Birnbaum's 1969 `counter-example', demonstrates that the standardly reported analyses of such examples involves an inappropriate treatment of a nuisance parameter and that, when the nuisance parameter is adequately considered, there is no conflict between the evidential consequences of the likelihood principle and the intuitive evidential account of the problem. It also shows that the conclusion that the likelihood principle allows the determinist hypothesis to dominate with unity probability requires a misconception about the scope of the likelihood principle or an inappropriately specified statistical model. Whatever happened did \textit{not} have to happen.
△ Less
Submitted 23 August, 2015; v1 submitted 30 July, 2015;
originally announced July 2015.
-
To P or not to P: on the evidential nature of P-values and their place in scientific inference
Authors:
Michael J. Lew
Abstract:
The customary use of P-values in scientific research has been attacked as being ill-conceived, and the utility of P-values has been derided. This paper reviews common misconceptions about P-values and their alleged deficits as indices of experimental evidence and, using an empirical exploration of the properties of P-values, documents the intimate relationship between P-values and likelihood funct…
▽ More
The customary use of P-values in scientific research has been attacked as being ill-conceived, and the utility of P-values has been derided. This paper reviews common misconceptions about P-values and their alleged deficits as indices of experimental evidence and, using an empirical exploration of the properties of P-values, documents the intimate relationship between P-values and likelihood functions. It is shown that P-values quantify experimental evidence not by their numerical value, but through the likelihood functions that they index. Many arguments against the utility of P-values are refuted and the conclusion is drawn that P-values are useful indices of experimental evidence. The widespread use of P-values in scientific research is well justified by the actual properties of P-values, but those properties need to be more widely understood.
△ Less
Submitted 31 October, 2013;
originally announced November 2013.
-
Across Browsers SVG Implementation
Authors:
Liang Wang,
Nies Huijsmans,
Michael S. Lew,
Dan Tsymbala
Abstract:
In this work SVG will be translated into VML or HTML by using Javascript based on Backbase Client Framework. The target of this project is to implement SVG to be viewed in Internet Explorer without any plug-in and work together with other Backbase Client Framework languages. The result of this project will be added as an extension to the current Backbase Client Framework.
In this work SVG will be translated into VML or HTML by using Javascript based on Backbase Client Framework. The target of this project is to implement SVG to be viewed in Internet Explorer without any plug-in and work together with other Backbase Client Framework languages. The result of this project will be added as an extension to the current Backbase Client Framework.
△ Less
Submitted 31 December, 2010;
originally announced January 2011.
-
Binary and nonbinary description of hypointensity in human brain MR images
Authors:
Xiao**g Chen,
Michael S. Lew
Abstract:
Accumulating evidence has shown that iron is involved in the mechanism underlying many neurodegenerative diseases, such as Alzheimer's disease, Parkinson's disease and Huntington's disease. Abnormal (higher) iron accumulation has been detected in the brains of most neurodegenerative patients, especially in the basal ganglia region. Presence of iron leads to changes in MR signal in both magnitude a…
▽ More
Accumulating evidence has shown that iron is involved in the mechanism underlying many neurodegenerative diseases, such as Alzheimer's disease, Parkinson's disease and Huntington's disease. Abnormal (higher) iron accumulation has been detected in the brains of most neurodegenerative patients, especially in the basal ganglia region. Presence of iron leads to changes in MR signal in both magnitude and phase. Accordingly, tissues with high iron concentration appear hypo-intense (darker than usual) in MR contrasts. In this report, we proposed an improved binary hypointensity description and a novel nonbinary hypointensity description based on principle components analysis. Moreover, Kendall's rank correlation coefficient was used to compare the complementary and redundant information provided by the two methods in order to better understand the individual descriptions of iron accumulation in the brain.
△ Less
Submitted 31 December, 2010;
originally announced January 2011.
-
A Framework for Real-Time Face and Facial Feature Tracking using Optical Flow Pre-estimation and Template Tracking
Authors:
E. R. Gast,
Michael S. Lew
Abstract:
This work presents a framework for tracking head movements and capturing the movements of the mouth and both the eyebrows in real-time. We present a head tracker which is a combination of a optical flow and a template based tracker. The estimation of the optical flow head tracker is used as starting point for the template tracker which fine-tunes the head estimation. This approach together with re…
▽ More
This work presents a framework for tracking head movements and capturing the movements of the mouth and both the eyebrows in real-time. We present a head tracker which is a combination of a optical flow and a template based tracker. The estimation of the optical flow head tracker is used as starting point for the template tracker which fine-tunes the head estimation. This approach together with re-updating the optical flow points prevents the head tracker from drifting. This combination together with our switching scheme, makes our tracker very robust against fast movement and motion-blur. We also propose a way to reduce the influence of partial occlusion of the head. In both the optical flow and the template based tracker we identify and exclude occluded points.
△ Less
Submitted 31 December, 2010;
originally announced January 2011.
-
Analysis of Using Browser-native Technology to Build Rich Internet Applications for Image Manipulation
Authors:
Thomas Steenbergen,
Michael S. Lew
Abstract:
In this work we investigate whether browser-native technologies can be used to perform photo manipulation tasks e.g crop**, resizing or rotating an image within the current mainstream browser. By the use of a case study we will analyze problems that have occurred during the implementation of a prototype web application that utilizes browser-native web technology in order to create an online vers…
▽ More
In this work we investigate whether browser-native technologies can be used to perform photo manipulation tasks e.g crop**, resizing or rotating an image within the current mainstream browser. By the use of a case study we will analyze problems that have occurred during the implementation of a prototype web application that utilizes browser-native web technology in order to create an online version of a real world photo scrapbook. Implementation of a prototype will allows us to analyze the strengths and weaknesses of current web technology when it comes to browser-based image manipulation. Furthermore we explore the possibilities of the Ajax in combination Canvas, SVG and VML to provide a more interactive graphical user interface to perform image manipulation tasks on the web.
△ Less
Submitted 31 December, 2010;
originally announced January 2011.
-
Dynamic Feature Description in Human Action Recognition
Authors:
Ruoyun Gao,
Michael S. Lew,
Ling Shao
Abstract:
This work aims to present novel description methods for human action recognition. Generally, a video sequence can be represented as a collection of spatial temporal words by detecting space-time interest points and describing the unique features around the detected points (Bag of Words representation). Interest points as well as the cuboids around them are considered informative for feature descri…
▽ More
This work aims to present novel description methods for human action recognition. Generally, a video sequence can be represented as a collection of spatial temporal words by detecting space-time interest points and describing the unique features around the detected points (Bag of Words representation). Interest points as well as the cuboids around them are considered informative for feature description in terms of both the structural distribution of interest points and the information content inside the cuboids. Our proposed description approaches are based on this idea and making the feature descriptors more discriminative.
△ Less
Submitted 31 December, 2010;
originally announced January 2011.
