-
Ptychographic lensless coherent endomicroscopy through a flexible fiber bundle
Authors:
Gil Weinberg,
Munkyu Kang,
Wonjun Choi,
Wonshik Choi,
Ori Katz
Abstract:
Conventional fiber-bundle-based endoscopes allow minimally invasive imaging through flexible multi-core fiber (MCF) bundles by placing a miniature lens at the distal tip and using each core as an imaging pixel. In recent years, lensless imaging through MCFs was made possible by correcting the core-to-core phase distortions pre-measured in a calibration procedure. However, temporally varying wavefr…
▽ More
Conventional fiber-bundle-based endoscopes allow minimally invasive imaging through flexible multi-core fiber (MCF) bundles by placing a miniature lens at the distal tip and using each core as an imaging pixel. In recent years, lensless imaging through MCFs was made possible by correcting the core-to-core phase distortions pre-measured in a calibration procedure. However, temporally varying wavefront distortions, for instance, due to dynamic fiber bending, pose a challenge for such approaches. Here, we demonstrate a coherent lensless imaging technique based on intensity-only measurements insensitive to core-to-core phase distortions. We leverage a ptychographic reconstruction algorithm to retrieve the phase and amplitude profiles of reflective objects placed at a distance from the fiber tip, using as input a set of diffracted intensity patterns reflected from the object when the illumination is scanned over the MCF cores. Our approach thus utilizes an acquisition process equivalent to confocal microendoscopy, only replacing the single detector with a camera.
△ Less
Submitted 31 January, 2024;
originally announced February 2024.
-
Selecting the Number of Sensor Scans in Surveillance Operations
Authors:
Graham V. Weinberg
Abstract:
Searching for concealed threats within a surveillance region is an important role for military sensors. One prominent case is the search for a submarine by a helicopter deploying a dip** sonar in anti-submarine warfare. Another is the utilisation of an uncrewed aerial vehicle for remote detection of land mines. These platforms will deploy an appropriate sensor to search within a given region for…
▽ More
Searching for concealed threats within a surveillance region is an important role for military sensors. One prominent case is the search for a submarine by a helicopter deploying a dip** sonar in anti-submarine warfare. Another is the utilisation of an uncrewed aerial vehicle for remote detection of land mines. These platforms will deploy an appropriate sensor to search within a given region for a potential threat. The sensors employed may not provide continuous surveillance, but may have active periods where the inherent sensor is scanning for threats. The reasons for disjoint activation periods may be both functional as well as tactical. Therefore, given a specified search pattern under which the surveillance platform operates, the question of the number of sensor scans required becomes relevant for search mission pre-planning. Hence it is not only important to develop a modelling framework to assess performance but it is of relevance to consider whether a minimum number of sensor scans can be determined to guarantee a desired level of performance. Consequently this paper introduces a framework for this and illustrates how it can be utilised in practice.
△ Less
Submitted 12 December, 2023;
originally announced December 2023.
-
K-space interpretation of image-scanning-microscopy
Authors:
Tal I. Sommer,
Gil Weinberg,
Ori Katz
Abstract:
In recent years, image-scanning microscopy (ISM, also termed pixel-reassignment microscopy) has emerged as a technique that improves the resolution and signal-to-noise compared to confocal and widefield microscopy by employing a detector array at the image plane of a confocal laser scanning microscope. Here, we present a k-space analysis of coherent ISM, showing that ISM is equivalent to spotlight…
▽ More
In recent years, image-scanning microscopy (ISM, also termed pixel-reassignment microscopy) has emerged as a technique that improves the resolution and signal-to-noise compared to confocal and widefield microscopy by employing a detector array at the image plane of a confocal laser scanning microscope. Here, we present a k-space analysis of coherent ISM, showing that ISM is equivalent to spotlight synthetic-aperture radar (SAR) and analogous to oblique-illumination microscopy. This insight indicates that ISM can be performed with a single detector placed in the k-space of the sample, which we numerically demonstrate.
△ Less
Submitted 11 January, 2023;
originally announced January 2023.
-
Preliminary Model for Operational Effectiveness Assessment of Dismounted Combat Teams
Authors:
Graham V. Weinberg
Abstract:
This paper is concerned with introducing a framework in which the operational effectiveness of a dismounted combat team can be assessed. It has been motivated by studies at Defence Science and Technology Group which have focused on the structure of the future dismounted fighting force. In order to determine the operational effectiveness of different combat team designs a metric, based upon simple…
▽ More
This paper is concerned with introducing a framework in which the operational effectiveness of a dismounted combat team can be assessed. It has been motivated by studies at Defence Science and Technology Group which have focused on the structure of the future dismounted fighting force. In order to determine the operational effectiveness of different combat team designs a metric, based upon simple additive weighting of warfighting functions, is proposed. This then allows a single measure of expected performance to be produced. The model itself is a preliminary attempt to capture essential features of dismounted combat, and the study will indicate how it can then be applied in practice. Discussion on model refinement, based upon subject matter expert data elicitation, is also included.
△ Less
Submitted 17 October, 2022;
originally announced October 2022.
-
Armoured Fighting Vehicle Team Performance Prediction against Missile Attacks with Directed Energy Weapons
Authors:
Graham V. Weinberg,
Mitchell Kracman
Abstract:
A recent study has introduced a procedure to quantify the survivability of a team of armoured fighting vehicles when it is subjected to a single missile attack. In particular this study investigated the concept of collaborative active protection systems, focusing on the case where vehicle defence is provided by high power radio frequency directed energy weapons. The purpose of the current paper is…
▽ More
A recent study has introduced a procedure to quantify the survivability of a team of armoured fighting vehicles when it is subjected to a single missile attack. In particular this study investigated the concept of collaborative active protection systems, focusing on the case where vehicle defence is provided by high power radio frequency directed energy weapons. The purpose of the current paper is to demonstrate how this analysis can be extended to account for more than one missile threat. This is achieved by introducing a jump stochastic process whose states represent the number of missiles defeated at a given time instant. Analysis proceeds through consideration of the sojourn times of this stochastic process, and it is shown how consideration of these jump times can be related to transition probabilities of the auxiliary stochastic process. The latter probabilities are then related to the probabilities of detection and disruption of missile threats. The sum of these sojourn times can then be used to quantify the survivability of the team at any given time instant. Due to the fact that there is much interest in the application of high energy lasers in the context of this paper, the numerical examples will thus focus on such directed energy weapons for armoured fighting vehicle team defence.
△ Less
Submitted 27 June, 2021;
originally announced June 2021.
-
Musical Prosody-Driven Emotion Classification: Interpreting Vocalists Portrayal of Emotions Through Machine Learning
Authors:
Nicholas Farris,
Brian Model,
Richard Savery,
Gil Weinberg
Abstract:
The task of classifying emotions within a musical track has received widespread attention within the Music Information Retrieval (MIR) community. Music emotion recognition has traditionally relied on the use of acoustic features, verbal features, and metadata-based filtering. The role of musical prosody remains under-explored despite several studies demonstrating a strong connection between prosod…
▽ More
The task of classifying emotions within a musical track has received widespread attention within the Music Information Retrieval (MIR) community. Music emotion recognition has traditionally relied on the use of acoustic features, verbal features, and metadata-based filtering. The role of musical prosody remains under-explored despite several studies demonstrating a strong connection between prosody and emotion. In this study, we restrict the input of traditional machine learning algorithms to the features of musical prosody. Furthermore, our proposed approach builds upon the prior by classifying emotions under an expanded emotional taxonomy, using the Geneva Wheel of Emotion. We utilize a methodology for individual data collection from vocalists, and personal ground truth labeling by the artist themselves. We found that traditional machine learning algorithms when limited to the features of musical prosody (1) achieve high accuracies for a single singer, (2) maintain high accuracy when the dataset is expanded to multiple singers, and (3) achieve high accuracies when trained on a reduced subset of the total features.
△ Less
Submitted 13 June, 2021; v1 submitted 4 June, 2021;
originally announced June 2021.
-
Shimon the Robot Film Composer and DeepScore: An LSTM for Generation of Film Scores based on Visual Analysis
Authors:
Richard Savery,
Gil Weinberg
Abstract:
Composing for a film requires develo** an understanding of the film, its characters and the film aesthetic choices made by the director. We propose using existing visual analysis systems as a core technology for film music generation. We extract film features including main characters and their emotions to develop a computer understanding of the film's narrative arc. This arc is combined with vi…
▽ More
Composing for a film requires develo** an understanding of the film, its characters and the film aesthetic choices made by the director. We propose using existing visual analysis systems as a core technology for film music generation. We extract film features including main characters and their emotions to develop a computer understanding of the film's narrative arc. This arc is combined with visually analyzed director aesthetic choices including pacing and levels of movement. Two systems are presented, the first using a robotic film composer and marimbist to generate film scores in real-time performance. The second software-based system builds on the results from the robot film composer to create narrative driven film scores.
△ Less
Submitted 26 October, 2020;
originally announced November 2020.
-
100,000 frames-per-second compressive imaging with a conventional rolling-shutter camera by random point-spread-function engineering
Authors:
Gil Weinberg,
Ori Katz
Abstract:
We demonstrate an approach that allows taking videos at very high-speeds of over 100,000 frames per second (fps) by exploiting the fast sampling rate of the standard rolling-shutter readout mechanism, common to most conventional sensors, and a compressive-sampling acquisition scheme. Our approach is directly applied to a conventional imaging system by the simple addition of a diffuser to the pupil…
▽ More
We demonstrate an approach that allows taking videos at very high-speeds of over 100,000 frames per second (fps) by exploiting the fast sampling rate of the standard rolling-shutter readout mechanism, common to most conventional sensors, and a compressive-sampling acquisition scheme. Our approach is directly applied to a conventional imaging system by the simple addition of a diffuser to the pupil plane, randomly encoding the entire field-of-view to each camera row, while maintaining diffraction-limited resolution. A short video is reconstructed from a single camera frame via a compressed-sensing reconstruction algorithm, exploiting inherent sparsity of the imaged scene.
△ Less
Submitted 20 April, 2020;
originally announced April 2020.
-
Multipulse Order Statistic Constant False Alarm Rate Detector in Pareto Background
Authors:
Graham V. Weinberg
Abstract:
In a recent study, the extension of sliding window detectors from the single to multipulse case has been considered. This short note continues the analysis of such detectors, and specifies an order statistic variation. The probability of false alarm is derived in a useful compact mathematical expression.
In a recent study, the extension of sliding window detectors from the single to multipulse case has been considered. This short note continues the analysis of such detectors, and specifies an order statistic variation. The probability of false alarm is derived in a useful compact mathematical expression.
△ Less
Submitted 10 January, 2019;
originally announced January 2019.
-
Compensating for Interference in Sliding Window Detection Processes using a Bayesian Paradigm
Authors:
Graham V. Weinberg
Abstract:
Sliding window detectors are non-coherent decision processes, designed in an attempt to control the probability of false alarm, for application to radar target detection. In earlier low resolution radar systems it was possible to specify such detectors quite easily, due to the Gaussian nature of clutter returns, in an X-band maritime surveillance radar context. As radar resolution improved with co…
▽ More
Sliding window detectors are non-coherent decision processes, designed in an attempt to control the probability of false alarm, for application to radar target detection. In earlier low resolution radar systems it was possible to specify such detectors quite easily, due to the Gaussian nature of clutter returns, in an X-band maritime surveillance radar context. As radar resolution improved with corresponding developments in modern technology, it became difficult to construct sliding window detectors with the constant false alarm rate property. However, over the last eight years this situation has been rectified, due to improved understanding of the way in which such detectors should be constructed. This paper examines the Bayesian approach to the construction of such detectors. In particular, the design of sliding window detectors, with the constant false alarm rate property, with the capacity to manage interfering targets, will be outlined.
△ Less
Submitted 4 January, 2019;
originally announced January 2019.
-
Extension of the Geometric Mean Constant False Alarm Rate Detector to Multiple Pulses
Authors:
Graham V. Weinberg
Abstract:
The development of sliding window detection processes, based upon a single cell under test, and operating in clutter modelled by a Pareto distribution, has been examined extensively. This includes the construction of decision rules with the complete constant false alarm rate property. However, the case where there are multiple pulses available has only been examined in the partial constant false a…
▽ More
The development of sliding window detection processes, based upon a single cell under test, and operating in clutter modelled by a Pareto distribution, has been examined extensively. This includes the construction of decision rules with the complete constant false alarm rate property. However, the case where there are multiple pulses available has only been examined in the partial constant false alarm rate scenario. This paper outlines in the latter case how the probability of false alarm can be produced, for a geometric mean detector, using properties of gamma distributions. The extension of this result, to the full constant false alarm rate detector case, is then presented.
△ Less
Submitted 1 January, 2019;
originally announced January 2019.
