-
Distributed Multi-Object Tracking Under Limited Field of View Heterogeneous Sensors with Density Clustering
Authors:
Fei Chen,
Hoa Van Nguyen,
Alex S. Leong,
Sabita Panicker,
Robin Baker,
Damith C. Ranasinghe
Abstract:
We consider the problem of tracking multiple, unknown, and time-varying numbers of objects using a distributed network of heterogeneous sensors. In an effort to derive a formulation for practical settings, we consider limited and unknown sensor field-of-views (FoVs), sensors with limited local computational resources and communication channel capacity. The resulting distributed multi-object tracki…
▽ More
We consider the problem of tracking multiple, unknown, and time-varying numbers of objects using a distributed network of heterogeneous sensors. In an effort to derive a formulation for practical settings, we consider limited and unknown sensor field-of-views (FoVs), sensors with limited local computational resources and communication channel capacity. The resulting distributed multi-object tracking algorithm involves solving an NP-hard multidimensional assignment problem either optimally for small-size problems or sub-optimally for general practical problems. For general problems, we propose an efficient distributed multi-object tracking algorithm that performs track-to-track fusion using a clustering-based analysis of the state space transformed into a density space to mitigate the complexity of the assignment problem. The proposed algorithm can more efficiently group local track estimates for fusion than existing approaches. To ensure we achieve globally consistent identities for tracks across a network of nodes as objects move between FoVs, we develop a graph-based algorithm to achieve label consensus and minimise track segmentation. Numerical experiments with a synthetic and a real-world trajectory dataset demonstrate that our proposed method is significantly more computationally efficient than state-of-the-art solutions, achieving similar tracking accuracy and bandwidth requirements but with improved label consistency.
△ Less
Submitted 31 December, 2023;
originally announced January 2024.
-
Single-target mineral detection with site-specific endmember extraction for survey points identification: A case study of Jaffna, Sri Lanka
Authors:
D. Y. L. Ranasinghe,
H. M. H. K. Weerasooriya,
S. Herath,
H. M. V. R. Herath,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
A. Senaratne,
S. L. P. Yasakethu
Abstract:
As field surveys used for manual lithological map** are costly and time-consuming, digital lithological map** (DLM) that utilizes remotely sensed spectral imaging provides a viable and economical alternative. Generally, DLM has been performed using spectral imaging with the use of laboratory-generated generic endmember signatures. To that end, this paper proposes generating a single-target abu…
▽ More
As field surveys used for manual lithological map** are costly and time-consuming, digital lithological map** (DLM) that utilizes remotely sensed spectral imaging provides a viable and economical alternative. Generally, DLM has been performed using spectral imaging with the use of laboratory-generated generic endmember signatures. To that end, this paper proposes generating a single-target abundance mineral map for DLM, where the generated map can further be used as a guide for the selection or avoidance of a field survey. For that, a stochastic cancellation-based methodology was used to generate a site-specific endemic signature for the mineral in concern to reduce the inclusive nature otherwise present in DLM. Furthermore, a soil pixel alignment strategy to visualize the relative purity level of the target mineral has been introduced in the proposed work. Then, for the method validation, map** of limestone deposits in the Jaffna peninsula of Sri Lanka was conducted as the case study using satellite-based spectral imaging as the input. It was observed that despite the low signal-to-noise ratio of the input hyperspectral data the proposed methodology was able to robustly extract the rich information contained in the input data. Further, a field survey was conducted to collect soil samples of four sites chosen by the proposed DLM from the Jaffna peninsula as an algorithm validation and to demonstrate the application of the proposed solution. The proposed abundance threshold of 0.1 coincided with the industrial standard X-ray diffraction (XRD) threshold of 5% for the mineral presence. The results of the XRD test validated the use of the algorithm in the selection of sites to be surveyed, hence could avoid conducting a costly field survey on the assumption of the existence of a mineral.
△ Less
Submitted 6 September, 2021;
originally announced September 2021.
-
Transmittance Multispectral Imaging for Reheated Coconut Oil Differentiation
Authors:
D. Y. L. Ranasinghe,
H. M. H. K. Weerasooriya,
S. Herath,
M. P. B. Ekanayake,
H. M. V. R. Herath,
G. M. R. I. Godaliyadda,
T. Madhujith
Abstract:
Oil reheating has a significant impact on global health due to its extensive consumption, especially in South Asia, and severe health risks. Nevertheless, food image analysis using multispectral imaging systems(MISs) has not been applied to oil reheating analysis despite their vast application in rapid food quality screening. To that end, the paper discusses the application of a low-cost MSI to es…
▽ More
Oil reheating has a significant impact on global health due to its extensive consumption, especially in South Asia, and severe health risks. Nevertheless, food image analysis using multispectral imaging systems(MISs) has not been applied to oil reheating analysis despite their vast application in rapid food quality screening. To that end, the paper discusses the application of a low-cost MSI to estimate the 'reheat cycle count classes' (number of times an oil sample is recursively heated) and identify 'critical classes' at which substantial changes in the oil sample have materialized. Firstly, the reheat cycle count class is estimated with Bhattacharyya distance between the reheated and a pure oil sample as the input. The classification was performed using a support vector machine classifier that resulted in an accuracy of 83.34 % for reheat cycle count identification. Subsequently, an unsupervised clustering procedure was introduced using a modified spectral clustering (SC) algorithm to distinguish critical classes under reheating. In addition, laboratory experiments were performed to ascertain the ramifications of the reheating process with a chemical analysis. The chemical analysis of the coconut oil samples used in the experiment coincided with the chemical analysis results and was statistically significant (p < 0.05). Accordingly, the proposed work closes the gap for using multispectral imaging for oil reheating and proposes a novel algorithm for unsupervised detection of critical property changes in the oil. Hence, the proposed research work is significant in its practical implications, contribution to food image analysis, and unsupervised classification mechanisms.
△ Less
Submitted 5 January, 2022; v1 submitted 28 August, 2021;
originally announced August 2021.
-
Quantitative Assessment of Adulteration and Reuse of Coconut Oil Using Transmittance Multispectral Imaging
Authors:
S. Herath,
H. K. Weerasooriya,
D. Y. L. Ranasinghe,
W. G. C. Bandara,
H. M. V. R. Herath,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
Terrence Madhujith
Abstract:
Coconut oil known for its wide range of uses is often adulterated with other edible oils. Repeated use of coconut oil in food preparation could lead to many health issues. Existing methods available for evaluating quality of oil are laborious and time consuming. Therefore, we propose an imaging system hardware and image processing-based algorithm to estimate the adulteration of coconut oil with pa…
▽ More
Coconut oil known for its wide range of uses is often adulterated with other edible oils. Repeated use of coconut oil in food preparation could lead to many health issues. Existing methods available for evaluating quality of oil are laborious and time consuming. Therefore, we propose an imaging system hardware and image processing-based algorithm to estimate the adulteration of coconut oil with palm oil as the adulterant. A clear functional relationship between adulteration level and Bhattacharyya distance was observed as R2 = 0.9876 on the training samples. Thereafter, another algorithm is proposed to develop a spectral-clustering based classifier to determine the effect of reheat and reuse of coconut oil. Distinct clusters were obtained for different levels of reheated oil classes and the classification was performed with an accuracy of 0.983 on training samples. Further, the input images for the proposed algorithms were generated using an in-house developed transmittance based multispectral imaging system.
△ Less
Submitted 30 November, 2020;
originally announced November 2020.
-
Towards Deep Clustering of Human Activities from Wearables
Authors:
Alireza Abedin,
Farbod Motlagh,
Qinfeng Shi,
Seyed Hamid Rezatofighi,
Damith Chinthana Ranasinghe
Abstract:
Our ability to exploit low-cost wearable sensing modalities for critical human behaviour and activity monitoring applications in health and wellness is reliant on supervised learning regimes; here, deep learning paradigms have proven extremely successful in learning activity representations from annotated data. However, the costly work of gathering and annotating sensory activity datasets is labor…
▽ More
Our ability to exploit low-cost wearable sensing modalities for critical human behaviour and activity monitoring applications in health and wellness is reliant on supervised learning regimes; here, deep learning paradigms have proven extremely successful in learning activity representations from annotated data. However, the costly work of gathering and annotating sensory activity datasets is labor-intensive, time consuming and not scalable to large volumes of data. While existing unsupervised remedies of deep clustering leverage network architectures and optimization objectives that are tailored for static image datasets, deep architectures to uncover cluster structures from raw sequence data captured by on-body sensors remains largely unexplored. In this paper, we develop an unsupervised end-to-end learning strategy for the fundamental problem of human activity recognition (HAR) from wearables. Through extensive experiments, including comparisons with existing methods, we show the effectiveness of our approach to jointly learn unsupervised representations for sensory data and generate cluster assignments with strong semantic correspondence to distinct human activities.
△ Less
Submitted 19 August, 2020; v1 submitted 2 August, 2020;
originally announced August 2020.
-
LAVAPilot: Lightweight UAV Trajectory Planner with Situational Awareness for Embedded Autonomy to Track and Locate Radio-tags
Authors:
Hoa Van Nguyen,
Fei Chen,
Joshua Chesser,
Hamid Rezatofighi,
Damith Ranasinghe
Abstract:
Tracking and locating radio-tagged wildlife is a labor-intensive and time-consuming task necessary in wildlife conservation. In this article, we focus on the problem of achieving embedded autonomy for a resource-limited aerial robot for the task capable of avoiding undesirable disturbances to wildlife. We employ a lightweight sensor system capable of simultaneous (noisy) measurements of radio sign…
▽ More
Tracking and locating radio-tagged wildlife is a labor-intensive and time-consuming task necessary in wildlife conservation. In this article, we focus on the problem of achieving embedded autonomy for a resource-limited aerial robot for the task capable of avoiding undesirable disturbances to wildlife. We employ a lightweight sensor system capable of simultaneous (noisy) measurements of radio signal strength information from multiple tags for estimating object locations. We formulate a new lightweight task-based trajectory planning method-LAVAPilot-with a greedy evaluation strategy and a void functional formulation to achieve situational awareness to maintain a safe distance from objects of interest. Conceptually, we embed our intuition of moving closer to reduce the uncertainty of measurements into LAVAPilot instead of employing a computationally intensive information gain based planning strategy. We employ LAVAPilot and the sensor to build a lightweight aerial robot platform with fully embedded autonomy for jointly tracking and planning to track and locate multiple VHF radio collar tags used by conservation biologists. Using extensive Monte Carlo simulation-based experiments, implementations on a single board compute module, and field experiments using an aerial robot platform with multiple VHF radio collar tags, we evaluate our joint planning and tracking algorithms. Further, we compare our method with other information-based planning methods with and without situational awareness to demonstrate the effectiveness of our robot executing LAVAPilot. Our experiments demonstrate that LAVAPilot significantly reduces (by 98.5%) the computational cost of planning to enable real-time planning decisions whilst achieving similar localization accuracy of objects compared to information gain based planning methods, albeit taking a slightly longer time to complete a mission.
△ Less
Submitted 31 July, 2020;
originally announced July 2020.
-
Super Low Resolution RF Powered Accelerometers for Alerting on Hospitalized Patient Bed Exits
Authors:
Michael Chesser,
Asangi Jayatilaka,
Renuka Visvanathan,
Christophe Fumeaux,
Alanson Sample,
Damith C. Ranasinghe
Abstract:
Falls have serious consequences and are prevalent in acute hospitals and nursing homes caring for older people. Most falls occur in bedrooms and near the bed. Technological interventions to mitigate the risk of falling aim to automatically monitor bed-exit events and subsequently alert healthcare personnel to provide timely supervisions. We observe that frequency-domain information related to pati…
▽ More
Falls have serious consequences and are prevalent in acute hospitals and nursing homes caring for older people. Most falls occur in bedrooms and near the bed. Technological interventions to mitigate the risk of falling aim to automatically monitor bed-exit events and subsequently alert healthcare personnel to provide timely supervisions. We observe that frequency-domain information related to patient activities exist predominantly in very low frequencies. Therefore, we recognise the potential to employ a low resolution acceleration sensing modality in contrast to powering and sensing with a conventional MEMS (Micro Electro Mechanical System) accelerometer. Consequently, we investigate a batteryless sensing modality with low cost wirelessly powered Radio Frequency Identification (RFID) technology with the potential for convenient integration into clothing, such as hospital gowns. We design and build a passive accelerometer-based RFID sensor embodiment---ID-Sensor---for our study. The sensor design allows deriving ultra low resolution acceleration data from the rate of change of unique RFID tag identifiers in accordance with the movement of a patient's upper body. We investigate two convolutional neural network architectures for learning from raw RFID-only data streams and compare performance with a traditional shallow classifier with engineered features. We evaluate performance with 23 hospitalized older patients. We demonstrate, for the first time and to the best of knowledge, that: i) the low resolution acceleration data embedded in the RF powered ID-Sensor data stream can provide a practicable method for activity recognition; and ii) highly discriminative features can be efficiently learned from the raw RFID-only data stream using a fully convolutional network architecture.
△ Less
Submitted 18 March, 2020;
originally announced March 2020.
-
Constrained Nonnegative Matrix Factorization for Blind Hyperspectral Unmixing incorporating Endmember Independence
Authors:
E. M. M. B. Ekanayake,
H. M. H. K. Weerasooriya,
D. Y. L. Ranasinghe,
S. Herath,
B. Rathnayake,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
H. M. V. R. Herath
Abstract:
Hyperspectral unmixing (HU) has become an important technique in exploiting hyperspectral data since it decomposes a mixed pixel into a collection of endmembers weighted by fractional abundances. The endmembers of a hyperspectral image (HSI) are more likely to be generated by independent sources and be mixed in a macroscopic degree before arriving at the sensor element of the imaging spectrometer…
▽ More
Hyperspectral unmixing (HU) has become an important technique in exploiting hyperspectral data since it decomposes a mixed pixel into a collection of endmembers weighted by fractional abundances. The endmembers of a hyperspectral image (HSI) are more likely to be generated by independent sources and be mixed in a macroscopic degree before arriving at the sensor element of the imaging spectrometer as mixed spectra. Over the past few decades, many attempts have focused on imposing auxiliary constraints on the conventional nonnegative matrix factorization (NMF) framework in order to effectively unmix these mixed spectra. As a promising step toward finding an optimum constraint to extract endmembers, this paper presents a novel blind HU algorithm, referred to as Kurtosis-based Smooth Nonnegative Matrix Factorization (KbSNMF) which incorporates a novel constraint based on the statistical independence of the probability density functions of endmember spectra. Imposing this constraint on the conventional NMF framework promotes the extraction of independent endmembers while further enhancing the parts-based representation of data. Experiments conducted on diverse synthetic HSI datasets (with numerous numbers of endmembers, spectral bands, pixels, and noise levels) and three standard real HSI datasets demonstrate the validity of the proposed KbSNMF algorithm compared to several state-of-the-art NMF-based HU baselines. The proposed algorithm exhibits superior performance especially in terms of extracting endmember spectra from hyperspectral data; therefore, it could uplift the performance of recent deep learning HU methods which utilize the endmember spectra as supervisory input data for abundance extraction.
△ Less
Submitted 7 August, 2021; v1 submitted 2 March, 2020;
originally announced March 2020.
-
Multi-Objective Multi-Agent Planning for Jointly Discovering and Tracking Mobile Object
Authors:
Hoa Van Nguyen,
Hamid Rezatofighi,
Ba-Ngu Vo,
Damith C. Ranasinghe
Abstract:
We consider the challenging problem of online planning for a team of agents to autonomously search and track a time-varying number of mobile objects under the practical constraint of detection range limited onboard sensors. A standard POMDP with a value function that either encourages discovery or accurate tracking of mobile objects is inadequate to simultaneously meet the conflicting goals of sea…
▽ More
We consider the challenging problem of online planning for a team of agents to autonomously search and track a time-varying number of mobile objects under the practical constraint of detection range limited onboard sensors. A standard POMDP with a value function that either encourages discovery or accurate tracking of mobile objects is inadequate to simultaneously meet the conflicting goals of searching for undiscovered mobile objects whilst kee** track of discovered objects. The planning problem is further complicated by misdetections or false detections of objects caused by range limited sensors and noise inherent to sensor measurements. We formulate a novel multi-objective POMDP based on information theoretic criteria, and an online multi-object tracking filter for the problem. Since controlling multi-agent is a well known combinatorial optimization problem, assigning control actions to agents necessitates a greedy algorithm. We prove that our proposed multi-objective value function is a monotone submodular set function; consequently, the greedy algorithm can achieve a (1-1/e) approximation for maximizing the submodular multi-objective function.
△ Less
Submitted 21 November, 2019;
originally announced November 2019.
-
Online UAV Path Planning for Joint Detection and Tracking of Multiple Radio-tagged Objects
Authors:
Hoa Van Nguyen,
S. Hamid Rezatofighi,
Ba-Ngu Vo,
Damith C. Ranasinghe
Abstract:
We consider the problem of online path planning for joint detection and tracking of multiple unknown radio-tagged objects. This is a necessary task for gathering spatio-temporal information using UAVs with on-board sensors in a range of monitoring applications. In this paper, we propose an online path planning algorithm with joint detection and tracking because signal measurements from these objec…
▽ More
We consider the problem of online path planning for joint detection and tracking of multiple unknown radio-tagged objects. This is a necessary task for gathering spatio-temporal information using UAVs with on-board sensors in a range of monitoring applications. In this paper, we propose an online path planning algorithm with joint detection and tracking because signal measurements from these objects are inherently noisy. We derive a partially observable Markov decision process with a random finite set track-before-detect (TBD) multi-object filter, which also maintains a safe distance between the UAV and the objects of interest using a void probability constraint. We show that, in practice, the multi-object likelihood function of raw signals received by the UAV in the time-frequency domain is separable and results in a numerically efficient multi-object TBD filter. We derive a TBD filter with a jump Markov system to accommodate maneuvering objects capable of switching between different dynamic modes. Our evaluations demonstrate the capability of the proposed approach to handle multiple radio-tagged objects subject to birth, death, and motion modes. Moreover, this online planning method with the TBD-based filter outperforms its detection-based counterparts in detection and tracking, especially in low signal-to-noise ratio environments.
△ Less
Submitted 12 August, 2019; v1 submitted 8 August, 2018;
originally announced August 2018.
-
An Adaptive Markov Random Field for Structured Compressive Sensing
Authors:
Suwichaya Suwanwimolkul,
Lei Zhang,
Dong Gong,
Zhen Zhang,
Chao Chen,
Damith C. Ranasinghe,
Qinfeng Shi
Abstract:
Exploiting intrinsic structures in sparse signals underpins the recent progress in compressive sensing (CS). The key for exploiting such structures is to achieve two desirable properties: generality (\ie, the ability to fit a wide range of signals with diverse structures) and adaptability (\ie, being adaptive to a specific signal). Most existing approaches, however, often only achieve one of these…
▽ More
Exploiting intrinsic structures in sparse signals underpins the recent progress in compressive sensing (CS). The key for exploiting such structures is to achieve two desirable properties: generality (\ie, the ability to fit a wide range of signals with diverse structures) and adaptability (\ie, being adaptive to a specific signal). Most existing approaches, however, often only achieve one of these two properties. In this study, we propose a novel adaptive Markov random field sparsity prior for CS, which not only is able to capture a broad range of sparsity structures, but also can adapt to each sparse signal through refining the parameters of the sparsity prior with respect to the compressed measurements. To maximize the adaptability, we also propose a new sparse signal estimation where the sparse signals, support, noise and signal parameter estimation are unified into a variational optimization problem, which can be effectively solved with an alternative minimization scheme. Extensive experiments on three real-world datasets demonstrate the effectiveness of the proposed method in recovery accuracy, noise tolerance, and runtime.
△ Less
Submitted 2 December, 2018; v1 submitted 14 February, 2018;
originally announced February 2018.
-
TrackerBots: Autonomous Unmanned Aerial Vehicle for Real-Time Localization and Tracking of Multiple Radio-Tagged Animals
Authors:
Hoa Van Nguyen,
Michael Chesser,
Lian Pin Koh,
S. Hamid Rezatofighi,
Damith C. Ranasinghe
Abstract:
Autonomous aerial robots provide new possibilities to study the habitats and behaviors of endangered species through the efficient gathering of location information at temporal and spatial granularities not possible with traditional manual survey methods. We present a novel autonomous aerial vehicle system-TrackerBots-to track and localize multiple radio-tagged animals. The simplicity of measuring…
▽ More
Autonomous aerial robots provide new possibilities to study the habitats and behaviors of endangered species through the efficient gathering of location information at temporal and spatial granularities not possible with traditional manual survey methods. We present a novel autonomous aerial vehicle system-TrackerBots-to track and localize multiple radio-tagged animals. The simplicity of measuring the received signal strength indicator (RSSI) values of very high frequency (VHF) radio-collars commonly used in the field is exploited to realize a low cost and lightweight tracking platform suitable for integration with unmanned aerial vehicles (UAVs). Due to uncertainty and the nonlinearity of the system based on RSSI measurements, our tracking and planning approaches integrate a particle filter for tracking and localizing; a partially observable Markov decision process (POMDP) for dynamic path planning. This approach allows autonomous navigation of a UAV in a direction of maximum information gain to locate multiple mobile animals and reduce exploration time; and, consequently, conserve onboard battery power. We also employ the concept of a search termination criteria to maximize the number of located animals within power constraints of the aerial system. We validated our real-time and online approach through both extensive simulations and field experiments with two mobile VHF radio-tags.
△ Less
Submitted 19 March, 2020; v1 submitted 5 December, 2017;
originally announced December 2017.