-
Device-Free Human State Estimation using UWB Multi-Static Radios
Authors:
Saria Al Laham,
Bobak H. Baghi,
Pierre-Yves Lajoie,
Amal Feriani,
Sachini Herath,
Steve Liu,
Gregory Dudek
Abstract:
We present a human state estimation framework that allows us to estimate the location, and even the activities, of people in an indoor environment without the requirement that they carry a specific devices with them. To achieve this "device free" localization we use a small number of low-cost Ultra-Wide Band (UWB) sensors distributed across the environment of interest. To achieve high quality esti…
▽ More
We present a human state estimation framework that allows us to estimate the location, and even the activities, of people in an indoor environment without the requirement that they carry a specific devices with them. To achieve this "device free" localization we use a small number of low-cost Ultra-Wide Band (UWB) sensors distributed across the environment of interest. To achieve high quality estimation from the UWB signals merely reflected of people in the environment, we exploit a deep network that can learn to make inferences. The hardware setup consists of commercial off-the-shelf (COTS) single antenna UWB modules for sensing, paired with Raspberry PI units for computational processing and data transfer. We make use of the channel impulse response (CIR) measurements from the UWB sensors to estimate the human state - comprised of location and activity - in a given area. Additionally, we can also estimate the number of humans that occupy this region of interest. In our approach, first, we pre-process the CIR data which involves meticulous aggregation of measurements and extraction of key statistics. Afterwards, we leverage a convolutional deep neural network to map the CIRs into precise location estimates with sub-30 cm accuracy. Similarly, we achieve accurate human activity recognition and occupancy counting results. We show that we can quickly fine-tune our model for new out-of-distribution users, a process that requires only a few minutes of data and a few epochs of training. Our results show that UWB is a promising solution for adaptable smart-home localization and activity recognition problems.
△ Less
Submitted 26 December, 2023;
originally announced January 2024.
-
PEOPLEx: PEdestrian Opportunistic Positioning LEveraging IMU, UWB, BLE and WiFi
Authors:
Pierre-Yves Lajoie,
Bobak Hamed Baghi,
Sachini Herath,
Francois Hogan,
Xue Liu,
Gregory Dudek
Abstract:
This paper advances the field of pedestrian localization by introducing a unifying framework for opportunistic positioning based on nonlinear factor graph optimization. While many existing approaches assume constant availability of one or multiple sensing signals, our methodology employs IMU-based pedestrian inertial navigation as the backbone for sensor fusion, opportunistically integrating Ultra…
▽ More
This paper advances the field of pedestrian localization by introducing a unifying framework for opportunistic positioning based on nonlinear factor graph optimization. While many existing approaches assume constant availability of one or multiple sensing signals, our methodology employs IMU-based pedestrian inertial navigation as the backbone for sensor fusion, opportunistically integrating Ultra-Wideband (UWB), Bluetooth Low Energy (BLE), and WiFi signals when they are available in the environment. The proposed PEOPLEx framework is designed to incorporate sensing data as it becomes available, operating without any prior knowledge about the environment (e.g. anchor locations, radio frequency maps, etc.). Our contributions are twofold: 1) we introduce an opportunistic multi-sensor and real-time pedestrian positioning framework fusing the available sensor measurements; 2) we develop novel factors for adaptive scaling and coarse loop closures, significantly improving the precision of indoor positioning. Experimental validation confirms that our approach achieves accurate localization estimates in real indoor scenarios using commercial smartphones.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
WiCV@CVPR2023: The Eleventh Women In Computer Vision Workshop at the Annual CVPR Conference
Authors:
Doris Antensteiner,
Marah Halawa,
Asra Aslam,
Ivaxi Sheth,
Sachini Herath,
Ziqi Huang,
Sunnie S. Y. Kim,
Aparna Akula,
Xin Wang
Abstract:
In this paper, we present the details of Women in Computer Vision Workshop - WiCV 2023, organized alongside the hybrid CVPR 2023 in Vancouver, Canada. WiCV aims to amplify the voices of underrepresented women in the computer vision community, fostering increased visibility in both academia and industry. We believe that such events play a vital role in addressing gender imbalances within the field.…
▽ More
In this paper, we present the details of Women in Computer Vision Workshop - WiCV 2023, organized alongside the hybrid CVPR 2023 in Vancouver, Canada. WiCV aims to amplify the voices of underrepresented women in the computer vision community, fostering increased visibility in both academia and industry. We believe that such events play a vital role in addressing gender imbalances within the field. The annual WiCV@CVPR workshop offers a) opportunity for collaboration between researchers from minority groups, b) mentorship for female junior researchers, c) financial support to presenters to alleviate finanacial burdens and d) a diverse array of role models who can inspire younger researchers at the outset of their careers. In this paper, we present a comprehensive report on the workshop program, historical trends from the past WiCV@CVPR events, and a summary of statistics related to presenters, attendees, and sponsorship for the WiCV 2023 workshop.
△ Less
Submitted 22 September, 2023;
originally announced September 2023.
-
RIS-Assisted Energy Harvesting Gains for Bistatic Backscatter Networks: Performance Analysis and RIS Phase Optimization
Authors:
Diluka Galappaththige,
Fatemeh Rezaei,
Chintha Tellambura,
Sanjeewa Herath
Abstract:
Inexpensive tags powered by energy harvesting (EH) can realize green (energy-efficient) Internet of Things (IoT) networks. However, tags are vulnerable to energy insecurities, resulting in poor communication ranges, activation distances, and data rates. To overcome these challenges, we explore the use of a reconfigurable intelligent surface (RIS) for EH-based IoT networks. The RIS is deployed to e…
▽ More
Inexpensive tags powered by energy harvesting (EH) can realize green (energy-efficient) Internet of Things (IoT) networks. However, tags are vulnerable to energy insecurities, resulting in poor communication ranges, activation distances, and data rates. To overcome these challenges, we explore the use of a reconfigurable intelligent surface (RIS) for EH-based IoT networks. The RIS is deployed to enhance RF power at the tag, improving EH capabilities. We consider linear and non-linear EH models and analyze single-tag and multi-tag scenarios. For single-tag networks, the tag's maximum received power and the reader's signal-to-noise ratio with the optimized RIS phase-shifts are derived. Key metrics, such as received power, harvested power, achievable rate, outage probability, bit error rate, and diversity order, are also evaluated. The impact of RIS phase shift quantization errors is also studied. For the multi-tag case, an algorithm to compute the optimal RIS phase-shifts is developed. Numerical results and simulations demonstrate significant improvements compared to the benchmarks of no-RIS case and random RIS-phase design. For instance, our optimal design with a \num{200}-element RIS increases the activation distance by \qty{270}{\percent} and \qty{55}{\percent} compared to those benchmarks. In summary, RIS deployment improves the energy autonomy of tags while maintaining the basic tag design intact.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
Design-Informed Generative Modelling using Structural Optimization
Authors:
Lowhikan Sivanantha Sarma,
Chinthaka Mallikarachchi,
Sumudu Herath
Abstract:
Although various structural optimization techniques have a sound mathematical basis, the practical constructability of optimal designs poses a great challenge in the manufacturing stage. Currently, there is only a limited number of unified frameworks which output ready-to-manufacture parametric Computer-Aided Designs (CAD) of the optimal designs. From a generative design perspective, it is essenti…
▽ More
Although various structural optimization techniques have a sound mathematical basis, the practical constructability of optimal designs poses a great challenge in the manufacturing stage. Currently, there is only a limited number of unified frameworks which output ready-to-manufacture parametric Computer-Aided Designs (CAD) of the optimal designs. From a generative design perspective, it is essential to have a single platform that outputs a structurally optimized CAD model because CAD models are an integral part of most industrial product development and manufacturing stages. This study focuses on develo** a novel unified workflow handling topology, layout and size optimization in a single parametric platform, which subsequently outputs a ready-to-manufacture CAD model. All such outputs are checked and validated for structural requirements; strength, stiffness and stability in accordance with standard codes of practice. In the proposed method, first, topology-optimal model is generated and converted to a one-pixel-wide chain model using skeletonization. Secondly, a spatial frame is extracted from the skeleton for its member size and layout optimization. Finally, the CAD model is generated using constructive solid geometry trees and the structural integrity of each member is assessed to ensure structural robustness prior to manufacturing. Various examples presented in the paper showcase the validity of the proposed method across various engineering disciplines.
△ Less
Submitted 13 August, 2023;
originally announced August 2023.
-
NOMA-Assisted Symbiotic Backscatter: Novel Beamforming Designs Under Imperfect SIC
Authors:
Fatemeh Rezaei,
Diluka Galappaththige,
Chintha Tellambura,
Sanjeewa Herath
Abstract:
Optimal beamforming designs under imperfect successive interference cancellation (SIC) decoding for a symbiotic network of non-orthogonal multiple access (NOMA) primary users and a secondary ambient tag have been lacking. We address that issue here. The primary base station (BS) serves NOMA users and a passive tag simultaneously in this network. We develop two transmit beamforming designs to meet…
▽ More
Optimal beamforming designs under imperfect successive interference cancellation (SIC) decoding for a symbiotic network of non-orthogonal multiple access (NOMA) primary users and a secondary ambient tag have been lacking. We address that issue here. The primary base station (BS) serves NOMA users and a passive tag simultaneously in this network. We develop two transmit beamforming designs to meet the user and tag requirements while mitigating the effect of imperfect SIC. Specifically, we design optimal BS transmit beamforming and power allocation to either maximize the weighted sum rate of NOMA users and the tag or minimize the BS transmit power under the minimum rate requirements while satisfying the tag minimum energy requirement. Because both these problems are non-convex, we propose algorithms using alternative optimization, fractional programming, and semi-definite relaxation techniques. We also analyze their computational complexity. Finally, we present extensive numerical results to validate the proposed schemes and to show significant performance gains while kee** the tag design intact. For example, the proposed digital beamforming increases the harvested power and data rate by 2.16e3 % and 314.5 % compared to random beamforming.
△ Less
Submitted 27 November, 2023; v1 submitted 17 February, 2023;
originally announced February 2023.
-
User Scheduling and Trajectory Optimization for Energy-Efficient IRS-UAV Networks with SWIPT
Authors:
S. Zargari,
A. Hakimi,
C. Tellambura,
S. Herath
Abstract:
This paper investigates user scheduling and trajectory optimization for a network supported by an intelligent reflecting surface (IRS) mounted on an unmanned aerial vehicle (UAV). The IRS is powered via the simultaneous wireless information and power transfer (SWIPT) technique. The IRS boosts users' uplink signals to improve the network's longevity and energy efficiency. It simultaneously harvests…
▽ More
This paper investigates user scheduling and trajectory optimization for a network supported by an intelligent reflecting surface (IRS) mounted on an unmanned aerial vehicle (UAV). The IRS is powered via the simultaneous wireless information and power transfer (SWIPT) technique. The IRS boosts users' uplink signals to improve the network's longevity and energy efficiency. It simultaneously harvests energy with a non-linear energy harvesting circuit and reflects the incident signals by controlling its reflection coefficients and phase shifts. The trajectory of the UAV impacts the efficiency of these operations. We minimize the maximum energy consumption of all users by joint optimization of user scheduling, UAV trajectory/velocity, and IRS phase shifts/reflection coefficients while guaranteeing each user's minimum required data rate and harvested energy of the IRS. We first derive a closed-form solution for the IRS phase shifts and then address the non-convexity of the critical problem. Finally, we propose an alternating optimization (AO) algorithm to optimize the remaining variables iteratively. We demonstrate the gains over several benchmarks. For instance, with a 50-element IRS, min-max energy consumption can be as low as 0.0404 (Joule), a 7.13% improvement over the No IRS case (achieving 0.0435 (Joule)). We also show that IRS-UAV without EH performs best at the cost of circuit power consumption of the IRS (a 20% improvement over the No IRS case).
△ Less
Submitted 12 September, 2022;
originally announced September 2022.
-
IRS-Enabled Backscattering in a Downlink Non-Orthogonal Multiple Access System
Authors:
Azar Hakimi,
Shayan Zargari,
Chintha Tellambura,
Sanjeewa Herath
Abstract:
Intelligent reflecting surface (IRS)-enabled backscatter communications can be enabled by an access point (AP) that splits its transmit signal into modulated and unmodulated parts. This letter integrates non-orthogonal multiple access (NOMA) with this method to create a two-user primary system and a secondary system of IRS data. Considering the decoding order, we maximize the rate of the strongest…
▽ More
Intelligent reflecting surface (IRS)-enabled backscatter communications can be enabled by an access point (AP) that splits its transmit signal into modulated and unmodulated parts. This letter integrates non-orthogonal multiple access (NOMA) with this method to create a two-user primary system and a secondary system of IRS data. Considering the decoding order, we maximize the rate of the strongest primary user by jointly optimizing the IRS phase shifts, power splitting (PS) factor at the AP, and NOMA power coefficients while guaranteeing the quality of service (QoS) for both weak user and IRS data in the primary and secondary systems, respectively. The resulting optimization problem is non-convex. Thus, we split it into three parts and develop an alternating optimization (AO) algorithm. The advantage is that we derive closed-form solutions for the PS factor and NOMA power coefficients in the first two parts. In the third part, we optimize the phase shifts by exploiting semi-definite relaxation (SDR) and penalty techniques to handle the unit-modulus constraints. This algorithm achieves substantial gains (e.g., 40--68%) compared to relevant baseline schemes.
△ Less
Submitted 2 September, 2022;
originally announced September 2022.
-
Multiuser MISO PS-SWIPT Systems: Active or Passive RIS?
Authors:
Shayan Zargari,
Azar Hakimi,
Chintha Tellambura,
Sanjeewa Herath
Abstract:
Reconfigurable intelligent surface (RIS)-based communication networks promise to improve channel capacity and energy efficiency. However, the promised capacity gains could be negligible for passive RISs because of the double pathloss effect. Active RISs can overcome this issue because they have reflector elements with a low-cost amplifier. This letter studies the active RIS-aided simultaneous wire…
▽ More
Reconfigurable intelligent surface (RIS)-based communication networks promise to improve channel capacity and energy efficiency. However, the promised capacity gains could be negligible for passive RISs because of the double pathloss effect. Active RISs can overcome this issue because they have reflector elements with a low-cost amplifier. This letter studies the active RIS-aided simultaneous wireless information and power transfer (SWIPT) in a multiuser system. The users exploit power splitting (PS) to decode information and harvest energy simultaneously based on a realistic piecewise nonlinear energy harvesting model. The goal is to minimize the base station (BS) transmit power by optimizing its beamformers, PS ratios, and RIS phase shifts/amplification factors. The simulation results show significant improvements (e.g., 19% and 28%) with the maximum reflect power of 10 mW and 15 mW, respectively, compared to the passive RIS without higher computational complexity cost. We also show the robustness of the proposed algorithm against imperfect channel state information.
△ Less
Submitted 28 June, 2022;
originally announced June 2022.
-
Energy-Efficient Hybrid Offloading for Backscatter-Assisted Wirelessly Powered MEC with Reconfigurable Intelligent Surfaces
Authors:
S. Zargari,
C. Tellambura,
S. Herath
Abstract:
We investigate a wireless power transfer (WPT)-based backscatter-mobile edge computing (MEC) network with a {reconfigurable intelligent surface (RIS)}.In this network, wireless devices (WDs) offload task bits and harvest energy, and they can switch between backscatter communication (BC) and active transmission (AT) modes. We exploit the RIS to maximize energy efficiency (EE). To this end, we optim…
▽ More
We investigate a wireless power transfer (WPT)-based backscatter-mobile edge computing (MEC) network with a {reconfigurable intelligent surface (RIS)}.In this network, wireless devices (WDs) offload task bits and harvest energy, and they can switch between backscatter communication (BC) and active transmission (AT) modes. We exploit the RIS to maximize energy efficiency (EE). To this end, we optimize the time/power allocations, local computing frequencies, execution times, backscattering coefficients, and RIS phase shifts.} This goal results in a multi-objective optimization problem (MOOP) with conflicting objectives. Thus, we simultaneously maximize system throughput and minimize energy consumption via the Tchebycheff method, transforming into two single-objective optimization problems (SOOPs). For throughput maximization, we exploit alternating optimization (AO) to yield two sub-problems. For the first one, we derive closed-form resource allocations. For the second one, we design the RIS phase shifts via semi-definite relaxation, a difference of convex functions programming, majorization minimization techniques, and a penalty function for enforcing a rank-one solution. For energy minimization, we derive closed-form resource allocations. We demonstrate the gains over several benchmarks. For instance, with a $20$-element RIS, EE can be as high as 3 (Mbits/Joule), a 150\% improvement over the no-RIS case (achieving only 2 (Mbits/Joule)).
△ Less
Submitted 1 June, 2022;
originally announced June 2022.
-
Neural Inertial Localization
Authors:
Sachini Herath,
David Caruso,
Chen Liu,
Yufan Chen,
Yasutaka Furukawa
Abstract:
This paper proposes the inertial localization problem, the task of estimating the absolute location from a sequence of inertial sensor measurements. This is an exciting and unexplored area of indoor localization research, where we present a rich dataset with 53 hours of inertial sensor data and the associated ground truth locations. We developed a solution, dubbed neural inertial localization (NIL…
▽ More
This paper proposes the inertial localization problem, the task of estimating the absolute location from a sequence of inertial sensor measurements. This is an exciting and unexplored area of indoor localization research, where we present a rich dataset with 53 hours of inertial sensor data and the associated ground truth locations. We developed a solution, dubbed neural inertial localization (NILoc) which 1) uses a neural inertial navigation technique to turn inertial sensor history to a sequence of velocity vectors; then 2) employs a transformer-based neural architecture to find the device location from the sequence of velocities. We only use an IMU sensor, which is energy efficient and privacy preserving compared to WiFi, cameras, and other data sources. Our approach is significantly faster and achieves competitive results even compared with state-of-the-art methods that require a floorplan and run 20 to 30 times slower. We share our code, model and data at https://sachini.github.io/niloc.
△ Less
Submitted 29 March, 2022;
originally announced March 2022.
-
IoT Smart Plant Monitoring, Watering and Security System
Authors:
U. H. D. Thinura Nethpiya Ariyaratne,
V. Diyon Yasaswin Vitharana,
L. H. Don Ranul Deelaka,
H. M. Sumudu Maduranga Herath
Abstract:
Interest in home gardening has burgeoned since governments around the world-imposed lockdowns to suppress the spread of COVID-19. Nowadays, most families start to do gardening during this lockdown season because they can grow vegetables and fruits or any other plants that they want in their day-to-day life. So, they can survive without spending money on online grocery shop** for fruits and veget…
▽ More
Interest in home gardening has burgeoned since governments around the world-imposed lockdowns to suppress the spread of COVID-19. Nowadays, most families start to do gardening during this lockdown season because they can grow vegetables and fruits or any other plants that they want in their day-to-day life. So, they can survive without spending money on online grocery shop** for fruits and vegetables during this lockdown season. In Sri Lanka, home gardening was a trend during the past couple of months due to this pandemic. Most of the families were trying to do gardening for their needs. But the problem is, nowadays the government is trying to release those restrictions to start day-to-day work in Sri Lanka. With this situation, people are starting to do their jobs and they do not have time to spend in their gardens continuing their gardening. We thought about this problem and tried to find a solution to continue the gardening work while doing their jobs. The major concern is people cannot monitor their plants every time and protect their garden. So, we decided to automate the garden work. With our new solution, gardeners can monitor some important factors like the plant's healthiness, soil moisture level, air humidity level, and the surrounding temperature and water their garden from anywhere in the world at any time by using our app. Plant health has a significant impact on plant development, production, and quality of agricultural goods. The goal of this study is to create an automated system that can identify the presence of illness in plants based on variations in plant leaf health state is created utilizing sensors such as temperature, humidity, and color....
△ Less
Submitted 16 February, 2022;
originally announced February 2022.
-
Em-K Indexing for Approximate Query Matching in Large-scale ER
Authors:
Samudra Herath,
Matthew Roughan,
Gary Glonek
Abstract:
Accurate and efficient entity resolution (ER) is a significant challenge in many data mining and analysis projects requiring integrating and processing massive data collections. It is becoming increasingly important in real-world applications to develop ER solutions that produce prompt responses for entity queries on large-scale databases. Some of these applications demand entity query matching ag…
▽ More
Accurate and efficient entity resolution (ER) is a significant challenge in many data mining and analysis projects requiring integrating and processing massive data collections. It is becoming increasingly important in real-world applications to develop ER solutions that produce prompt responses for entity queries on large-scale databases. Some of these applications demand entity query matching against large-scale reference databases within a short time. We define this as the query matching problem in ER in this work. Indexing or blocking techniques reduce the search space and execution time in the ER process. However, approximate indexing techniques that scale to very large-scale datasets remain open to research. In this paper, we investigate the query matching problem in ER to propose an indexing method suitable for approximate and efficient query matching.
We first use spatial map**s to embed records in a multidimensional Euclidean space that preserves the domain-specific similarity. Among the various map** techniques, we choose multidimensional scaling. Then using a Kd-tree and the nearest neighbour search, the method returns a block of records that includes potential matches for a query. Our method can process queries against a large-scale dataset using only a fraction of the data $L$ (given the dataset size is $N$), with a $O(L^2)$ complexity where $L \ll N$. The experiments conducted on several datasets showed the effectiveness of the proposed method.
△ Less
Submitted 7 November, 2021;
originally announced November 2021.
-
High Performance Out-of-sample Embedding Techniques for Multidimensional Scaling
Authors:
Samudra Herath,
Matthew Roughan,
Gary Glonek
Abstract:
The recent rapid growth of the dimension of many datasets means that many approaches to dimension reduction (DR) have gained significant attention. High-performance DR algorithms are required to make data analysis feasible for big and fast data sets. However, many traditional DR techniques are challenged by truly large data sets. In particular multidimensional scaling (MDS) does not scale well. MD…
▽ More
The recent rapid growth of the dimension of many datasets means that many approaches to dimension reduction (DR) have gained significant attention. High-performance DR algorithms are required to make data analysis feasible for big and fast data sets. However, many traditional DR techniques are challenged by truly large data sets. In particular multidimensional scaling (MDS) does not scale well. MDS is a popular group of DR techniques because it can perform DR on data where the only input is a dissimilarity function. However, common approaches are at least quadratic in memory and computation and, hence, prohibitive for large-scale data.
We propose an out-of-sample embedding (OSE) solution to extend the MDS algorithm for large-scale data utilising the embedding of only a subset of the given data. We present two OSE techniques: the first based on an optimisation approach and the second based on a neural network model. With a minor trade-off in the approximation, the out-of-sample techniques can process large-scale data with reasonable computation and memory requirements. While both methods perform well, the neural network model outperforms the optimisation approach of the OSE solution in terms of efficiency. OSE has the dual benefit that it allows fast DR on streaming datasets as well as static databases.
△ Less
Submitted 7 November, 2021;
originally announced November 2021.
-
Single-target mineral detection with site-specific endmember extraction for survey points identification: A case study of Jaffna, Sri Lanka
Authors:
D. Y. L. Ranasinghe,
H. M. H. K. Weerasooriya,
S. Herath,
H. M. V. R. Herath,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
A. Senaratne,
S. L. P. Yasakethu
Abstract:
As field surveys used for manual lithological map** are costly and time-consuming, digital lithological map** (DLM) that utilizes remotely sensed spectral imaging provides a viable and economical alternative. Generally, DLM has been performed using spectral imaging with the use of laboratory-generated generic endmember signatures. To that end, this paper proposes generating a single-target abu…
▽ More
As field surveys used for manual lithological map** are costly and time-consuming, digital lithological map** (DLM) that utilizes remotely sensed spectral imaging provides a viable and economical alternative. Generally, DLM has been performed using spectral imaging with the use of laboratory-generated generic endmember signatures. To that end, this paper proposes generating a single-target abundance mineral map for DLM, where the generated map can further be used as a guide for the selection or avoidance of a field survey. For that, a stochastic cancellation-based methodology was used to generate a site-specific endemic signature for the mineral in concern to reduce the inclusive nature otherwise present in DLM. Furthermore, a soil pixel alignment strategy to visualize the relative purity level of the target mineral has been introduced in the proposed work. Then, for the method validation, map** of limestone deposits in the Jaffna peninsula of Sri Lanka was conducted as the case study using satellite-based spectral imaging as the input. It was observed that despite the low signal-to-noise ratio of the input hyperspectral data the proposed methodology was able to robustly extract the rich information contained in the input data. Further, a field survey was conducted to collect soil samples of four sites chosen by the proposed DLM from the Jaffna peninsula as an algorithm validation and to demonstrate the application of the proposed solution. The proposed abundance threshold of 0.1 coincided with the industrial standard X-ray diffraction (XRD) threshold of 5% for the mineral presence. The results of the XRD test validated the use of the algorithm in the selection of sites to be surveyed, hence could avoid conducting a costly field survey on the assumption of the existence of a mineral.
△ Less
Submitted 6 September, 2021;
originally announced September 2021.
-
Transmittance Multispectral Imaging for Reheated Coconut Oil Differentiation
Authors:
D. Y. L. Ranasinghe,
H. M. H. K. Weerasooriya,
S. Herath,
M. P. B. Ekanayake,
H. M. V. R. Herath,
G. M. R. I. Godaliyadda,
T. Madhujith
Abstract:
Oil reheating has a significant impact on global health due to its extensive consumption, especially in South Asia, and severe health risks. Nevertheless, food image analysis using multispectral imaging systems(MISs) has not been applied to oil reheating analysis despite their vast application in rapid food quality screening. To that end, the paper discusses the application of a low-cost MSI to es…
▽ More
Oil reheating has a significant impact on global health due to its extensive consumption, especially in South Asia, and severe health risks. Nevertheless, food image analysis using multispectral imaging systems(MISs) has not been applied to oil reheating analysis despite their vast application in rapid food quality screening. To that end, the paper discusses the application of a low-cost MSI to estimate the 'reheat cycle count classes' (number of times an oil sample is recursively heated) and identify 'critical classes' at which substantial changes in the oil sample have materialized. Firstly, the reheat cycle count class is estimated with Bhattacharyya distance between the reheated and a pure oil sample as the input. The classification was performed using a support vector machine classifier that resulted in an accuracy of 83.34 % for reheat cycle count identification. Subsequently, an unsupervised clustering procedure was introduced using a modified spectral clustering (SC) algorithm to distinguish critical classes under reheating. In addition, laboratory experiments were performed to ascertain the ramifications of the reheating process with a chemical analysis. The chemical analysis of the coconut oil samples used in the experiment coincided with the chemical analysis results and was statistically significant (p < 0.05). Accordingly, the proposed work closes the gap for using multispectral imaging for oil reheating and proposes a novel algorithm for unsupervised detection of critical property changes in the oil. Hence, the proposed research work is significant in its practical implications, contribution to food image analysis, and unsupervised classification mechanisms.
△ Less
Submitted 5 January, 2022; v1 submitted 28 August, 2021;
originally announced August 2021.
-
Computational modelling and data-driven homogenisation of knitted membranes
Authors:
Sumudu Herath,
Xiao Xiao,
Fehmi Cirak
Abstract:
Knitting is an effective technique for producing complex three-dimensional surfaces owing to the inherent flexibility of interlooped yarns and recent advances in manufacturing providing better control of local stitch patterns. Fully yarn-level modelling of large-scale knitted membranes is not feasible. Therefore, we use a two-scale homogenisation approach and model the membrane as a Kirchhoff-Love…
▽ More
Knitting is an effective technique for producing complex three-dimensional surfaces owing to the inherent flexibility of interlooped yarns and recent advances in manufacturing providing better control of local stitch patterns. Fully yarn-level modelling of large-scale knitted membranes is not feasible. Therefore, we use a two-scale homogenisation approach and model the membrane as a Kirchhoff-Love shell on the macroscale and as Euler-Bernoulli rods on the microscale. The governing equations for both the shell and the rod are discretised with cubic B-spline basis functions. For homogenisation we consider only the in-plane response of the membrane. The solution of the nonlinear microscale problem requires a significant amount of time due to the large deformations and the enforcement of contact constraints, rendering conventional online computational homogenisation approaches infeasible. To sidestep this problem, we use a pre-trained statistical Gaussian Process Regression (GPR) model to map the macroscale deformations to macroscale stresses. During the offline learning phase, the GPR model is trained by solving the microscale problem for a sufficiently rich set of deformation states obtained by either uniform or Sobol sampling. The trained GPR model encodes the nonlinearities and anisotropies present in the microscale and serves as a material model for the membrane response of the macroscale shell. The bending response can be chosen in dependence of the mesh size to penalise the fine out-of-plane wrinkling of the membrane. After verifying and validating the different components of the proposed approach, we introduce several examples involving membranes subjected to tension and shear to demonstrate its versatility and good performance.
△ Less
Submitted 9 November, 2021; v1 submitted 12 July, 2021;
originally announced July 2021.
-
Anticipating human actions by correlating past with the future with Jaccard similarity measures
Authors:
Basura Fernando,
Samitha Herath
Abstract:
We propose a framework for early action recognition and anticipation by correlating past features with the future using three novel similarity measures called Jaccard vector similarity, Jaccard cross-correlation and Jaccard Frobenius inner product over covariances. Using these combinations of novel losses and using our framework, we obtain state-of-the-art results for early action recognition in U…
▽ More
We propose a framework for early action recognition and anticipation by correlating past features with the future using three novel similarity measures called Jaccard vector similarity, Jaccard cross-correlation and Jaccard Frobenius inner product over covariances. Using these combinations of novel losses and using our framework, we obtain state-of-the-art results for early action recognition in UCF101 and JHMDB datasets by obtaining 91.7 % and 83.5 % accuracy respectively for an observation percentage of 20. Similarly, we obtain state-of-the-art results for Epic-Kitchen55 and Breakfast datasets for action anticipation by obtaining 20.35 and 41.8 top-1 accuracy respectively.
△ Less
Submitted 26 May, 2021;
originally announced May 2021.
-
Fusion-DHL: WiFi, IMU, and Floorplan Fusion for Dense History of Locations in Indoor Environments
Authors:
Sachini Herath,
Saghar Irandoust,
Bowen Chen,
Yiming Qian,
Pyo** Kim,
Yasutaka Furukawa
Abstract:
The paper proposes a multi-modal sensor fusion algorithm that fuses WiFi, IMU, and floorplan information to infer an accurate and dense location history in indoor environments. The algorithm uses 1) an inertial navigation algorithm to estimate a relative motion trajectory from IMU sensor data; 2) a WiFi-based localization API in industry to obtain positional constraints and geo-localize the trajec…
▽ More
The paper proposes a multi-modal sensor fusion algorithm that fuses WiFi, IMU, and floorplan information to infer an accurate and dense location history in indoor environments. The algorithm uses 1) an inertial navigation algorithm to estimate a relative motion trajectory from IMU sensor data; 2) a WiFi-based localization API in industry to obtain positional constraints and geo-localize the trajectory; and 3) a convolutional neural network to refine the location history to be consistent with the floorplan.
We have developed a data acquisition app to build a new dataset with WiFi, IMU, and floorplan data with ground-truth positions at 4 university buildings and 3 shop** malls. Our qualitative and quantitative evaluations demonstrate that the proposed system is able to produce twice as accurate and a few orders of magnitude denser location history than the current standard, while requiring minimal additional energy consumption. We will publicly share our code, data and models.
△ Less
Submitted 18 May, 2021;
originally announced May 2021.
-
All Labels Are Not Created Equal: Enhancing Semi-supervision via Label Grou** and Co-training
Authors:
Islam Nassar,
Samitha Herath,
Ehsan Abbasnejad,
Wray Buntine,
Gholamreza Haffari
Abstract:
Pseudo-labeling is a key component in semi-supervised learning (SSL). It relies on iteratively using the model to generate artificial labels for the unlabeled data to train against. A common property among its various methods is that they only rely on the model's prediction to make labeling decisions without considering any prior knowledge about the visual similarity among the classes. In this pap…
▽ More
Pseudo-labeling is a key component in semi-supervised learning (SSL). It relies on iteratively using the model to generate artificial labels for the unlabeled data to train against. A common property among its various methods is that they only rely on the model's prediction to make labeling decisions without considering any prior knowledge about the visual similarity among the classes. In this paper, we demonstrate that this degrades the quality of pseudo-labeling as it poorly represents visually similar classes in the pool of pseudo-labeled data. We propose SemCo, a method which leverages label semantics and co-training to address this problem. We train two classifiers with two different views of the class labels: one classifier uses the one-hot view of the labels and disregards any potential similarity among the classes, while the other uses a distributed view of the labels and groups potentially similar classes together. We then co-train the two classifiers to learn based on their disagreements. We show that our method achieves state-of-the-art performance across various SSL tasks including 5.6% accuracy improvement on Mini-ImageNet dataset with 1000 labeled examples. We also show that our method requires smaller batch size and fewer training iterations to reach its best performance. We make our code available at https://github.com/islam-nassar/semco.
△ Less
Submitted 12 April, 2021;
originally announced April 2021.
-
Quantitative Assessment of Adulteration and Reuse of Coconut Oil Using Transmittance Multispectral Imaging
Authors:
S. Herath,
H. K. Weerasooriya,
D. Y. L. Ranasinghe,
W. G. C. Bandara,
H. M. V. R. Herath,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
Terrence Madhujith
Abstract:
Coconut oil known for its wide range of uses is often adulterated with other edible oils. Repeated use of coconut oil in food preparation could lead to many health issues. Existing methods available for evaluating quality of oil are laborious and time consuming. Therefore, we propose an imaging system hardware and image processing-based algorithm to estimate the adulteration of coconut oil with pa…
▽ More
Coconut oil known for its wide range of uses is often adulterated with other edible oils. Repeated use of coconut oil in food preparation could lead to many health issues. Existing methods available for evaluating quality of oil are laborious and time consuming. Therefore, we propose an imaging system hardware and image processing-based algorithm to estimate the adulteration of coconut oil with palm oil as the adulterant. A clear functional relationship between adulteration level and Bhattacharyya distance was observed as R2 = 0.9876 on the training samples. Thereafter, another algorithm is proposed to develop a spectral-clustering based classifier to determine the effect of reheat and reuse of coconut oil. Distinct clusters were obtained for different levels of reheated oil classes and the classification was performed with an accuracy of 0.983 on training samples. Further, the input images for the proposed algorithms were generated using an in-house developed transmittance based multispectral imaging system.
△ Less
Submitted 30 November, 2020;
originally announced November 2020.
-
Convolutional Autoencoder for Blind Hyperspectral Image Unmixing
Authors:
Yasiru Ranasinghe,
Sanjaya Herath,
Kavinga Weerasooriya,
Mevan Ekanayake,
Roshan Godaliyadda,
Parakrama Ekanayake,
Vijitha Herath
Abstract:
In the remote sensing context spectral unmixing is a technique to decompose a mixed pixel into two fundamental representatives: endmembers and abundances. In this paper, a novel architecture is proposed to perform blind unmixing on hyperspectral images. The proposed architecture consists of convolutional layers followed by an autoencoder. The encoder transforms the feature space produced through c…
▽ More
In the remote sensing context spectral unmixing is a technique to decompose a mixed pixel into two fundamental representatives: endmembers and abundances. In this paper, a novel architecture is proposed to perform blind unmixing on hyperspectral images. The proposed architecture consists of convolutional layers followed by an autoencoder. The encoder transforms the feature space produced through convolutional layers to a latent space representation. Then, from these latent characteristics the decoder reconstructs the roll-out image of the monochrome image which is at the input of the architecture; and each single-band image is fed sequentially. Experimental results on real hyperspectral data concludes that the proposed algorithm outperforms existing unmixing methods at abundance estimation and generates competitive results for endmember extraction with RMSE and SAD as the metrics, respectively.
△ Less
Submitted 18 November, 2020;
originally announced November 2020.
-
Simulating Name-like Vectors for Testing Large-scale Entity Resolution
Authors:
Samudra Herath,
Matthew Roughan,
Gary Glonek
Abstract:
Accurate and efficient entity resolution (ER) has been a problem in data analysis and data mining projects for decades. In our work, we are interested in develo** ER methods to handle big data. Good public datasets are restricted in this area and usually small in size. Simulation is one technique for generating datasets for testing. Existing simulation tools have problems of complexity, scalabil…
▽ More
Accurate and efficient entity resolution (ER) has been a problem in data analysis and data mining projects for decades. In our work, we are interested in develo** ER methods to handle big data. Good public datasets are restricted in this area and usually small in size. Simulation is one technique for generating datasets for testing. Existing simulation tools have problems of complexity, scalability and limitations of resampling. We address these problems by introducing a better way of simulating testing data for big data ER. Our proposed simulation model is simple, inexpensive and fast. We focus on avoiding the detail-level simulation of records using a simple vector representation. In this paper, we will discuss how to simulate simple vectors that approximate the properties of names (commonly used as identification keys).
△ Less
Submitted 7 September, 2020;
originally announced September 2020.
-
Constrained Nonnegative Matrix Factorization for Blind Hyperspectral Unmixing incorporating Endmember Independence
Authors:
E. M. M. B. Ekanayake,
H. M. H. K. Weerasooriya,
D. Y. L. Ranasinghe,
S. Herath,
B. Rathnayake,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
H. M. V. R. Herath
Abstract:
Hyperspectral unmixing (HU) has become an important technique in exploiting hyperspectral data since it decomposes a mixed pixel into a collection of endmembers weighted by fractional abundances. The endmembers of a hyperspectral image (HSI) are more likely to be generated by independent sources and be mixed in a macroscopic degree before arriving at the sensor element of the imaging spectrometer…
▽ More
Hyperspectral unmixing (HU) has become an important technique in exploiting hyperspectral data since it decomposes a mixed pixel into a collection of endmembers weighted by fractional abundances. The endmembers of a hyperspectral image (HSI) are more likely to be generated by independent sources and be mixed in a macroscopic degree before arriving at the sensor element of the imaging spectrometer as mixed spectra. Over the past few decades, many attempts have focused on imposing auxiliary constraints on the conventional nonnegative matrix factorization (NMF) framework in order to effectively unmix these mixed spectra. As a promising step toward finding an optimum constraint to extract endmembers, this paper presents a novel blind HU algorithm, referred to as Kurtosis-based Smooth Nonnegative Matrix Factorization (KbSNMF) which incorporates a novel constraint based on the statistical independence of the probability density functions of endmember spectra. Imposing this constraint on the conventional NMF framework promotes the extraction of independent endmembers while further enhancing the parts-based representation of data. Experiments conducted on diverse synthetic HSI datasets (with numerous numbers of endmembers, spectral bands, pixels, and noise levels) and three standard real HSI datasets demonstrate the validity of the proposed KbSNMF algorithm compared to several state-of-the-art NMF-based HU baselines. The proposed algorithm exhibits superior performance especially in terms of extracting endmember spectra from hyperspectral data; therefore, it could uplift the performance of recent deep learning HU methods which utilize the endmember spectra as supervisory input data for abundance extraction.
△ Less
Submitted 7 August, 2021; v1 submitted 2 March, 2020;
originally announced March 2020.
-
RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methods
Authors:
Hang Yan,
Sachini Herath,
Yasutaka Furukawa
Abstract:
This paper sets a new foundation for data-driven inertial navigation research, where the task is the estimation of positions and orientations of a moving subject from a sequence of IMU sensor measurements. More concretely, the paper presents 1) a new benchmark containing more than 40 hours of IMU sensor data from 100 human subjects with ground-truth 3D trajectories under natural human motions; 2)…
▽ More
This paper sets a new foundation for data-driven inertial navigation research, where the task is the estimation of positions and orientations of a moving subject from a sequence of IMU sensor measurements. More concretely, the paper presents 1) a new benchmark containing more than 40 hours of IMU sensor data from 100 human subjects with ground-truth 3D trajectories under natural human motions; 2) novel neural inertial navigation architectures, making significant improvements for challenging motion cases; and 3) qualitative and quantitative evaluations of the competing methods over three inertial navigation benchmarks. We will share the code and data to promote further research.
△ Less
Submitted 30 May, 2019;
originally announced May 2019.
-
Learning an Invariant Hilbert Space for Domain Adaptation
Authors:
Samitha Herath,
Mehrtash Harandi,
Fatih Porikli
Abstract:
This paper introduces a learning scheme to construct a Hilbert space (i.e., a vector space along its inner product) to address both unsupervised and semi-supervised domain adaptation problems. This is achieved by learning projections from each domain to a latent space along the Mahalanobis metric of the latent space to simultaneously minimizing a notion of domain variance while maximizing a measur…
▽ More
This paper introduces a learning scheme to construct a Hilbert space (i.e., a vector space along its inner product) to address both unsupervised and semi-supervised domain adaptation problems. This is achieved by learning projections from each domain to a latent space along the Mahalanobis metric of the latent space to simultaneously minimizing a notion of domain variance while maximizing a measure of discriminatory power. In particular, we make use of the Riemannian optimization techniques to match statistical properties (e.g., first and second order statistics) between samples projected into the latent space from different domains. Upon availability of class labels, we further deem samples sharing the same label to form more compact clusters while pulling away samples coming from different classes.We extensively evaluate and contrast our proposal against state-of-the-art methods for the task of visual domain adaptation using both handcrafted and deep-net features. Our experiments show that even with a simple nearest neighbor classifier, the proposed method can outperform several state-of-the-art methods benefitting from more involved classification schemes.
△ Less
Submitted 17 April, 2017; v1 submitted 24 November, 2016;
originally announced November 2016.
-
Going Deeper into Action Recognition: A Survey
Authors:
Samitha Herath,
Mehrtash Harandi,
Fatih Porikli
Abstract:
Understanding human actions in visual data is tied to advances in complementary research areas including object recognition, human dynamics, domain adaptation and semantic segmentation. Over the last decade, human action analysis evolved from earlier schemes that are often limited to controlled environments to nowadays advanced solutions that can learn from millions of videos and apply to almost a…
▽ More
Understanding human actions in visual data is tied to advances in complementary research areas including object recognition, human dynamics, domain adaptation and semantic segmentation. Over the last decade, human action analysis evolved from earlier schemes that are often limited to controlled environments to nowadays advanced solutions that can learn from millions of videos and apply to almost all daily activities. Given the broad range of applications from video surveillance to human-computer interaction, scientific milestones in action recognition are achieved more rapidly, eventually leading to the demise of what used to be good in a short time. This motivated us to provide a comprehensive review of the notable steps taken towards recognizing human actions. To this end, we start our discussion with the pioneering methods that use handcrafted representations, and then, navigate into the realm of deep learning based approaches. We aim to remain objective throughout this survey, touching upon encouraging improvements as well as inevitable fallbacks, in the hope of raising fresh questions and motivating new research directions for the reader.
△ Less
Submitted 31 January, 2017; v1 submitted 16 May, 2016;
originally announced May 2016.
-
Impacts of Regional Trade Agreements(RTAs) on Food Security: A Case of ASEAN Free Trade Agreement
Authors:
H. M. S. P. Herath,
Cao Liang,
Chen Yongbing
Abstract:
Discriminatory trade liberalization policies are becoming more popular among world economies. Countries are motivated to enter for regional trade agreements to capture faster economic growth for alleviating poverty. In develo** economies like most of the member countries of the Association of South East Asian Nations (ASEAN), a sizeable portion of people are suffering from poverty by exposing th…
▽ More
Discriminatory trade liberalization policies are becoming more popular among world economies. Countries are motivated to enter for regional trade agreements to capture faster economic growth for alleviating poverty. In develo** economies like most of the member countries of the Association of South East Asian Nations (ASEAN), a sizeable portion of people are suffering from poverty by exposing them to food insecurity. Low level of income and low productivity of agricultural sector have augmented the severity of food insecurity of those people. Discriminatory trade liberalization policies are expected to reduce poverty and strengthen the food security. The objective of this paper is to examine the effect of ASEAN Free Trade Agreement (AFTA) on food security of its member countries. The multiple regression analysis in panel data was employed to disentangle the impacts of trade liberalization on food securit y with use of regional trade agreement dummy variable. The finding of the study supports that AFTA has influenced positively on food security of its member nations. After the formation of AFTA, the level of per-capita daily dietary energy supply of the member countries has been increased moderately over time.
△ Less
Submitted 9 July, 2014;
originally announced July 2014.
