-
Motion-adaptive Separable Collaborative Filters for Blind Motion Deblurring
Authors:
Chengxu Liu,
Xuan Wang,
Xiangyu Xu,
Ruhao Tian,
Shuai Li,
Xueming Qian,
Ming-Hsuan Yang
Abstract:
Eliminating image blur produced by various kinds of motion has been a challenging problem. Dominant approaches rely heavily on model capacity to remove blurring by reconstructing residual from blurry observation in feature space. These practices not only prevent the capture of spatially variable motion in the real world but also ignore the tailored handling of various motions in image space. In th…
▽ More
Eliminating image blur produced by various kinds of motion has been a challenging problem. Dominant approaches rely heavily on model capacity to remove blurring by reconstructing residual from blurry observation in feature space. These practices not only prevent the capture of spatially variable motion in the real world but also ignore the tailored handling of various motions in image space. In this paper, we propose a novel real-world deblurring filtering model called the Motion-adaptive Separable Collaborative (MISC) Filter. In particular, we use a motion estimation network to capture motion information from neighborhoods, thereby adaptively estimating spatially-variant motion flow, mask, kernels, weights, and offsets to obtain the MISC Filter. The MISC Filter first aligns the motion-induced blurring patterns to the motion middle along the predicted flow direction, and then collaboratively filters the aligned image through the predicted kernels, weights, and offsets to generate the output. This design can handle more generalized and complex motion in a spatially differentiated manner. Furthermore, we analyze the relationships between the motion estimation network and the residual reconstruction network. Extensive experiments on four widely used benchmarks demonstrate that our method provides an effective solution for real-world motion blur removal and achieves state-of-the-art performance. Code is available at https://github.com/ChengxuLiu/MISCFilter
△ Less
Submitted 19 April, 2024;
originally announced April 2024.
-
An Efficient Probabilistic Solution to Map** Errors in LiDAR-Camera Fusion for Autonomous Vehicles
Authors:
Dan Shen,
Zhengming Zhang,
Renran Tian,
Yaobin Chen,
Rini Sherony
Abstract:
LiDAR-camera fusion is one of the core processes for the perception system of current automated driving systems. The typical sensor fusion process includes a list of coordinate transformation operations following system calibration. Although a significant amount of research has been done to improve the fusion accuracy, there are still inherent data map** errors in practice related to system sync…
▽ More
LiDAR-camera fusion is one of the core processes for the perception system of current automated driving systems. The typical sensor fusion process includes a list of coordinate transformation operations following system calibration. Although a significant amount of research has been done to improve the fusion accuracy, there are still inherent data map** errors in practice related to system synchronization offsets, vehicle vibrations, the small size of the target, and fast relative moving speeds. Moreover, more and more complicated algorithms to improve fusion accuracy can overwhelm the onboard computational resources, limiting the actual implementation. This study proposes a novel and low-cost probabilistic LiDAR-Camera fusion method to alleviate these inherent map** errors in scene reconstruction. By calculating shape similarity using KL-divergence and applying RANSAC-regression-based trajectory smoother, the effects of LiDAR-camera map** errors are minimized in object localization and distance estimation. Designed experiments are conducted to prove the robustness and effectiveness of the proposed strategy.
△ Less
Submitted 7 November, 2023;
originally announced November 2023.
-
A Practical Large-Scale Roadside Multi-View Multi-Sensor Spatial Synchronization Framework for Intelligent Transportation Systems
Authors:
Yong Li,
Zhiguo Zhao,
Yunli Chen,
Rui Tian
Abstract:
Spatial synchronization in roadside scenarios is essential for integrating data from multiple sensors at different locations. Current methods using cascading spatial transformation (CST) often lead to cumulative errors in large-scale deployments. Manual camera calibration is insufficient and requires extensive manual work, and existing methods are limited to controlled or single-view scenarios. To…
▽ More
Spatial synchronization in roadside scenarios is essential for integrating data from multiple sensors at different locations. Current methods using cascading spatial transformation (CST) often lead to cumulative errors in large-scale deployments. Manual camera calibration is insufficient and requires extensive manual work, and existing methods are limited to controlled or single-view scenarios. To address these challenges, our research introduces a parallel spatial transformation (PST)-based framework for large-scale, multi-view, multi-sensor scenarios. PST parallelizes sensor coordinate system transformation, reducing cumulative errors. We incorporate deep learning for precise roadside monocular global localization, reducing manual work. Additionally, we use geolocation cues and an optimization algorithm for improved synchronization accuracy. Our framework has been tested in real-world scenarios, outperforming CST-based methods. It significantly enhances large-scale roadside multi-perspective, multi-sensor spatial synchronization, reducing deployment costs.
△ Less
Submitted 4 November, 2023;
originally announced November 2023.
-
Risk assessment and mitigation of e-scooter crashes with naturalistic driving data
Authors:
Avinash Prabu,
Zhengming Zhang,
Renran Tian,
Stanley Chien,
Lingxi Li,
Yaobin Chen,
Rini Sherony
Abstract:
Recently, e-scooter-involved crashes have increased significantly but little information is available about the behaviors of on-road e-scooter riders. Most existing e-scooter crash research was based on retrospectively descriptive media reports, emergency room patient records, and crash reports. This paper presents a naturalistic driving study with a focus on e-scooter and vehicle encounters. The…
▽ More
Recently, e-scooter-involved crashes have increased significantly but little information is available about the behaviors of on-road e-scooter riders. Most existing e-scooter crash research was based on retrospectively descriptive media reports, emergency room patient records, and crash reports. This paper presents a naturalistic driving study with a focus on e-scooter and vehicle encounters. The goal is to quantitatively measure the behaviors of e-scooter riders in different encounters to help facilitate crash scenario modeling, baseline behavior modeling, and the potential future development of in-vehicle mitigation algorithms. The data was collected using an instrumented vehicle and an e-scooter rider wearable system, respectively. A three-step data analysis process is developed. First, semi-automatic data labeling extracts e-scooter rider images and non-rider human images in similar environments to train an e-scooter-rider classifier. Then, a multi-step scene reconstruction pipeline generates vehicle and e-scooter trajectories in all encounters. The final step is to model e-scooter rider behaviors and e-scooter-vehicle encounter scenarios. A total of 500 vehicle to e-scooter interactions are analyzed. The variables pertaining to the same are also discussed in this paper.
△ Less
Submitted 15 January, 2023; v1 submitted 24 December, 2022;
originally announced December 2022.
-
SceNDD: A Scenario-based Naturalistic Driving Dataset
Authors:
Avinash Prabu,
Nitya Ranjan,
Lingxi Li,
Renran Tian,
Stanley Chien,
Yaobin Chen,
Rini Sherony
Abstract:
In this paper, we propose SceNDD: a scenario-based naturalistic driving dataset that is built upon data collected from an instrumented vehicle in downtown Indianapolis. The data collection was completed in 68 driving sessions with different drivers, where each session lasted about 20--40 minutes. The main goal of creating this dataset is to provide the research community with real driving scenario…
▽ More
In this paper, we propose SceNDD: a scenario-based naturalistic driving dataset that is built upon data collected from an instrumented vehicle in downtown Indianapolis. The data collection was completed in 68 driving sessions with different drivers, where each session lasted about 20--40 minutes. The main goal of creating this dataset is to provide the research community with real driving scenarios that have diverse trajectories and driving behaviors. The dataset contains ego-vehicle's waypoints, velocity, yaw angle, as well as non-ego actor's waypoints, velocity, yaw angle, entry-time, and exit-time. Certain flexibility is provided to users so that actors, sensors, lanes, roads, and obstacles can be added to the existing scenarios. We used a Joint Probabilistic Data Association (JPDA) tracker to detect non-ego vehicles on the road. We present some preliminary results of the proposed dataset and a few applications associated with it. The complete dataset is expected to be released by early 2023.
△ Less
Submitted 22 December, 2022;
originally announced December 2022.
-
A Wearable Data Collection System for Studying Micro-Level E-Scooter Behavior in Naturalistic Road Environment
Authors:
Avinash Prabu,
Dan Shen,
Renran Tian,
Stanley Chien,
Lingxi Li,
Yaobin Chen,
Rini Sherony
Abstract:
As one of the most popular micro-mobility options, e-scooters are spreading in hundreds of big cities and college towns in the US and worldwide. In the meantime, e-scooters are also posing new challenges to traffic safety. In general, e-scooters are suggested to be ridden in bike lanes/sidewalks or share the road with cars at the maximum speed of about 15-20 mph, which is more flexible and much fa…
▽ More
As one of the most popular micro-mobility options, e-scooters are spreading in hundreds of big cities and college towns in the US and worldwide. In the meantime, e-scooters are also posing new challenges to traffic safety. In general, e-scooters are suggested to be ridden in bike lanes/sidewalks or share the road with cars at the maximum speed of about 15-20 mph, which is more flexible and much faster than the pedestrains and bicyclists. These features make e-scooters challenging for human drivers, pedestrians, vehicle active safety modules, and self-driving modules to see and interact. To study this new mobility option and address e-scooter riders' and other road users' safety concerns, this paper proposes a wearable data collection system for investigating the micro-level e-Scooter motion behavior in a Naturalistic road environment. An e-Scooter-based data acquisition system has been developed by integrating LiDAR, cameras, and GPS using the robot operating system (ROS). Software frameworks are developed to support hardware interfaces, sensor operation, sensor synchronization, and data saving. The integrated system can collect data continuously for hours, meeting all the requirements including calibration accuracy and capability of collecting the vehicle and e-Scooter encountering data.
△ Less
Submitted 22 December, 2022;
originally announced December 2022.
-
Peek into the Future Camera-based Occupant Sensing in Configurable Cabins for Autonomous Vehicles
Authors:
Avinash Prabu,
Renran Tian,
Lingxi Li,
Jialiang Le,
Srinivasan Sundararajan,
Saeed Barbat
Abstract:
The development of fully autonomous vehicles (AVs) can potentially eliminate drivers and introduce unprecedented seating design. However, highly flexible seat configurations may lead to occupants' unconventional poses and actions. Understanding occupant behaviors and prioritize safety features become eye-catching topics in the AV research frontier. Visual sensors have the advantages of cost-effici…
▽ More
The development of fully autonomous vehicles (AVs) can potentially eliminate drivers and introduce unprecedented seating design. However, highly flexible seat configurations may lead to occupants' unconventional poses and actions. Understanding occupant behaviors and prioritize safety features become eye-catching topics in the AV research frontier. Visual sensors have the advantages of cost-efficiency and high-fidelity imaging and become more widely applied for in-car sensing purposes. Occlusion is one big concern for this type of system in crowded car cabins. It is important but largely unknown about how a visual-sensing framework will look like to support 2-D and 3-D human pose tracking towards highly configurable seats. As one of the first studies to touch this topic, we peek into the future camera-based sensing framework via a simulation experiment. Constructed representative car-cabin, seat layouts, and occupant sizes, camera coverage from different angles and positions is simulated and calculated. The comprehensive coverage data are synthesized through an optimization process to determine the camera layout and overall occupant coverage. The results show the needs and design of a different number of cameras to fully or partially cover all the occupants with changeable configurations of up to six seats.
△ Less
Submitted 22 December, 2022;
originally announced December 2022.
-
Multi-Phase Locking Value: A Generalized Method for Determining Instantaneous Multi-frequency Phase Coupling
Authors:
Bhavya Vasudeva,
Runfeng Tian,
Dee H. Wu,
Shirley A. James,
Hazem H. Refai,
Fei He,
Yuan Yang
Abstract:
Many physical, biological and neural systems behave as coupled oscillators, with characteristic phase coupling across different frequencies. Methods such as $n:m$ phase locking value and bi-phase locking value have previously been proposed to quantify phase coupling between two resonant frequencies (e.g. $f$, $2f/3$) and across three frequencies (e.g. $f_1$, $f_2$, $f_1+f_2$), respectively. Howeve…
▽ More
Many physical, biological and neural systems behave as coupled oscillators, with characteristic phase coupling across different frequencies. Methods such as $n:m$ phase locking value and bi-phase locking value have previously been proposed to quantify phase coupling between two resonant frequencies (e.g. $f$, $2f/3$) and across three frequencies (e.g. $f_1$, $f_2$, $f_1+f_2$), respectively. However, the existing phase coupling metrics have their limitations and limited applications. They cannot be used to detect or quantify phase coupling across multiple frequencies (e.g. $f_1$, $f_2$, $f_3$, $f_4$, $f_1+f_2+f_3-f_4$), or coupling that involves non-integer multiples of the frequencies (e.g. $f_1$, $f_2$, $2f_1/3+f_2/3$). To address the gap, this paper proposes a generalized approach, named multi-phase locking value (M-PLV), for the quantification of various types of instantaneous multi-frequency phase coupling. Different from most instantaneous phase coupling metrics that measure the simultaneous phase coupling, the proposed M-PLV method also allows the detection of delayed phase coupling and the associated time lag between coupled oscillators. The M-PLV has been tested on cases where synthetic coupled signals are generated using white Gaussian signals, and a system comprised of multiple coupled Rössler oscillators. Results indicate that the M-PLV can provide a reliable estimation of the time window and frequency combination where the phase coupling is significant, as well as a precise determination of time lag in the case of delayed coupling. This method has the potential to become a powerful new tool for exploring phase coupling in complex nonlinear dynamic systems.
△ Less
Submitted 2 January, 2022; v1 submitted 20 February, 2021;
originally announced February 2021.
-
Empirical Evaluation of a 28 GHz Antenna Array on a 5G Mobile Phone Using a Body Phantom
Authors:
Lauri Vähä-Savo,
Christian Cziezerski,
Mikko Heino,
Katsuyuki Haneda,
Clemens Icheln,
Ali Hazmi,
Ruiyuan Tian
Abstract:
Implementation of an antenna array on a 5G mobile phone chassis is crucial in ensuring the radio link quality especially at millimeter-waves. However, we generally lack the ability to design antennas under practical operational conditions involving body effects of a mobile user in a repeatable manner. We developed numerical and physical phantoms of a human body for evaluation of mobile handset ant…
▽ More
Implementation of an antenna array on a 5G mobile phone chassis is crucial in ensuring the radio link quality especially at millimeter-waves. However, we generally lack the ability to design antennas under practical operational conditions involving body effects of a mobile user in a repeatable manner. We developed numerical and physical phantoms of a human body for evaluation of mobile handset antennas at 28 GHz. While the numerical phantom retains a realistic and accurate body shape, our physical phantom has much simpler hexagonal cross-section to represent a body. Gains of the phased antenna array configuration on a mobile phone chassis, called co-located array is numerically and experimentally evaluated. The array is formed by placing two sets of 4-element dual-polarized patch antenna arrays, called two modules, at two locations of a mobile phone chassis. Modules are intended to collect the maximum amount of energy to the single transceiver chain. Spherical coverage of the realized gain by the array shows that the experimental statistics of the realized gains across entire solid angles agree with numerical simulations. We thereby demonstrate that our antenna evaluation method reproduces the reality and our phantom serves repeatable tests of antenna array prototypes at 28 GHz.
△ Less
Submitted 16 March, 2021; v1 submitted 14 September, 2020;
originally announced September 2020.
-
Three-Dimensional Dynamic Modeling and Motion Analysis for an Active-Tail-Actuated Robotic Fish with Barycentre Regulating Mechanism
Authors:
Xingwen Zheng,
Minglei Xiong,
Junzheng Zheng,
Manyi Wang,
Runyu Tian,
Guangming Xie
Abstract:
Dynamic modeling has been capturing attention for its fundamentality in precise locomotion analyses and control of underwater robots. However, the existing researches have mainly focused on investigating two-dimensional motion of underwater robots, and little attention has been paid to three-dimensional dynamic modeling, which is just what we focus on. In this article, a three-dimensional dynamic…
▽ More
Dynamic modeling has been capturing attention for its fundamentality in precise locomotion analyses and control of underwater robots. However, the existing researches have mainly focused on investigating two-dimensional motion of underwater robots, and little attention has been paid to three-dimensional dynamic modeling, which is just what we focus on. In this article, a three-dimensional dynamic model of an active-tail-actuated robotic fish with a barycentre regulating mechanism is built by combining Newton's second law for linear motion and Euler's equation for angular motion. The model parameters are determined by three-dimensional computer-aided design (CAD) software SolidWorks, HyperFlow-based computational fluid dynamics (CFD) simulation, and grey-box model estimation method. Both kinematic experiments with a prototype and numerical simulations are applied to validate the accuracy of the dynamic model mutually. Based on the dynamic model, multiple three-dimensional motions, including rectilinear motion, turning motion, gliding motion, and spiral motion, are analyzed. The experimental and simulation results demonstrate the effectiveness of the proposed model in evaluating the trajectory, attitude, and motion parameters, including the velocity, turning radius, angular velocity, etc., of the robotic fish.
△ Less
Submitted 22 May, 2021; v1 submitted 23 June, 2020;
originally announced June 2020.
-
Game-theoretic Modeling of Traffic in Unsignalized Intersection Network for Autonomous Vehicle Control Verification and Validation
Authors:
Ran Tian,
Nan Li,
Ilya Kolmanovsky,
Yildiray Yildiz,
Anouck Girard
Abstract:
For a foreseeable future, autonomous vehicles (AVs) will operate in traffic together with human-driven vehicles. Their planning and control systems need extensive testing, including early-stage testing in simulations where the interactions among autonomous/human-driven vehicles are represented. Motivated by the need for such simulation tools, we propose a game-theoretic approach to modeling vehicl…
▽ More
For a foreseeable future, autonomous vehicles (AVs) will operate in traffic together with human-driven vehicles. Their planning and control systems need extensive testing, including early-stage testing in simulations where the interactions among autonomous/human-driven vehicles are represented. Motivated by the need for such simulation tools, we propose a game-theoretic approach to modeling vehicle interactions, in particular, for urban traffic environments with unsignalized intersections. We develop traffic models with heterogeneous (in terms of their driving styles) and interactive vehicles based on our proposed approach, and use them for virtual testing, evaluation, and calibration of AV control systems. For illustration, we consider two AV control approaches, analyze their characteristics and performance based on the simulation results with our developed traffic models, and optimize the parameters of one of them.
△ Less
Submitted 17 July, 2020; v1 submitted 15 October, 2019;
originally announced October 2019.
-
Detecting gasoline in small public places based on wireless sensor network
Authors:
Rui Tian
Abstract:
Fire accidents often cause unpredictable catastrophic losses. At present, existing fire prevention measures in public places are mostly based on the emergency treatments after the fire, which have limited protection capability when the fire spreads rapidly, especially for the flammable liquid explosion accident. Based on the gas sensor network, this paper proposes a detection framework as well as…
▽ More
Fire accidents often cause unpredictable catastrophic losses. At present, existing fire prevention measures in public places are mostly based on the emergency treatments after the fire, which have limited protection capability when the fire spreads rapidly, especially for the flammable liquid explosion accident. Based on the gas sensor network, this paper proposes a detection framework as well as detail technologies to detect flammable liquid existing in small spaces. We propose to use sensor network to detect the flammable liquids through monitoring the concentrations of the target liquid vapor diffused in the air. Experiment results show that, the proposed surveillant system can detect the gasoline components in small space with high sensitivity while maintaining very low false detection rates to external interferences.
△ Less
Submitted 9 July, 2018;
originally announced July 2018.
