-
A Method for Target Detection Based on Mmw Radar and Vision Fusion
Authors:
Ming Zong,
Jiaying Wu,
Zhanyu Zhu,
**gen Ni
Abstract:
An efficient and accurate traffic monitoring system often takes advantages of multi-sensor detection to ensure the safety of urban traffic, promoting the accuracy and robustness of target detection and tracking. A method for target detection using Radar-Vision Fusion Path Aggregation Fully Convolutional One-Stage Network (RV-PAFCOS) is proposed in this paper, which is extended from Fully Convoluti…
▽ More
An efficient and accurate traffic monitoring system often takes advantages of multi-sensor detection to ensure the safety of urban traffic, promoting the accuracy and robustness of target detection and tracking. A method for target detection using Radar-Vision Fusion Path Aggregation Fully Convolutional One-Stage Network (RV-PAFCOS) is proposed in this paper, which is extended from Fully Convolutional One-Stage Network (FCOS) by introducing the modules of radar image processing branches, radar-vision fusion and path aggregation. The radar image processing branch mainly focuses on the image modeling based on the spatiotemporal calibration of millimeter-wave (mmw) radar and cameras, taking the conversion of radar point clouds to radar images. The fusion module extracts features of radar and optical images based on the principle of spatial attention stitching criterion. The path aggregation module enhances the reuse of feature layers, combining the positional information of shallow feature maps with deep semantic information, to obtain better detection performance for both large and small targets. Through the experimental analysis, the method proposed in this paper can effectively fuse the mmw radar and vision perceptions, showing good performance in traffic target detection.
△ Less
Submitted 25 March, 2024;
originally announced March 2024.
-
Can an LLM-Powered Socially Assistive Robot Effectively and Safely Deliver Cognitive Behavioral Therapy? A Study With University Students
Authors:
Mina J. Kian,
Mingyu Zong,
Katrin Fischer,
Abhyuday Singh,
Anna-Maria Velentza,
Pau Sang,
Shriya Upadhyay,
Anika Gupta,
Misha A. Faruki,
Wallace Browning,
Sebastien M. R. Arnold,
Bhaskar Krishnamachari,
Maja J. Mataric
Abstract:
Cognitive behavioral therapy (CBT) is a widely used therapeutic method for guiding individuals toward restructuring their thinking patterns as a means of addressing anxiety, depression, and other challenges. We developed a large language model (LLM)-powered prompt-engineered socially assistive robot (SAR) that guides participants through interactive CBT at-home exercises. We evaluated the performa…
▽ More
Cognitive behavioral therapy (CBT) is a widely used therapeutic method for guiding individuals toward restructuring their thinking patterns as a means of addressing anxiety, depression, and other challenges. We developed a large language model (LLM)-powered prompt-engineered socially assistive robot (SAR) that guides participants through interactive CBT at-home exercises. We evaluated the performance of the SAR through a 15-day study with 38 university students randomly assigned to interact daily with the robot or a chatbot (using the same LLM), or complete traditional CBT worksheets throughout the duration of the study. We measured weekly therapeutic outcomes, changes in pre-/post-session anxiety measures, and adherence to completing CBT exercises. We found that self-reported measures of general psychological distress significantly decreased over the study period in the robot and worksheet conditions but not the chatbot condition. Furthermore, the SAR enabled significant single-session improvements for more sessions than the other two conditions combined. Our findings suggest that SAR-guided LLM-powered CBT may be as effective as traditional worksheet methods in supporting therapeutic progress from the beginning to the end of the study and superior in decreasing user anxiety immediately after completing the CBT exercise.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
IoT in the Era of Generative AI: Vision and Challenges
Authors:
Xin Wang,
Zhongwei Wan,
Arvin Hekmati,
Mingyu Zong,
Samiul Alam,
Mi Zhang,
Bhaskar Krishnamachari
Abstract:
Equipped with sensing, networking, and computing capabilities, Internet of Things (IoT) such as smartphones, wearables, smart speakers, and household robots have been seamlessly weaved into our daily lives. Recent advancements in Generative AI exemplified by GPT, LLaMA, DALL-E, and Stable Difussion hold immense promise to push IoT to the next level. In this article, we share our vision and views o…
▽ More
Equipped with sensing, networking, and computing capabilities, Internet of Things (IoT) such as smartphones, wearables, smart speakers, and household robots have been seamlessly weaved into our daily lives. Recent advancements in Generative AI exemplified by GPT, LLaMA, DALL-E, and Stable Difussion hold immense promise to push IoT to the next level. In this article, we share our vision and views on the benefits that Generative AI brings to IoT, and discuss some of the most important applications of Generative AI in IoT-related domains. Fully harnessing Generative AI in IoT is a complex challenge. We identify some of the most critical challenges including high resource demands of the Generative AI models, prompt engineering, on-device inference, offloading, on-device fine-tuning, federated learning, security, as well as development tools and benchmarks, and discuss current gaps as well as promising opportunities on enabling Generative AI for IoT. We hope this article can inspire new research on IoT in the era of Generative AI.
△ Less
Submitted 5 January, 2024; v1 submitted 3 January, 2024;
originally announced January 2024.
-
Machine learning assisted phase and size-controlled synthesis of iron oxides
Authors:
Jue**g Liu,
Zimeng Zhang,
Xiaoxu Li,
Meirong Zong,
Yining Wang,
Suyun Wang,
** Chen,
Zaoyan Wan,
yatong Zhao,
Lili Liu,
Yangang Liang,
Wei Wang,
Zheming Wang,
Shiren Wang,
Xiaofeng Guo,
Emily G. Saldanha,
Kevin M. Rosso,
Xin Zhang
Abstract:
The controllable synthesis of iron oxides particles is a critical issue for materials science, energy storage, biomedical applications, environmental science, and earth science. However, synthesis of iron oxides with desired phase and size are still a time-consuming and trial-and-error process. This study presents solutions for two fundamental challenges in materials synthesis: predicting the outc…
▽ More
The controllable synthesis of iron oxides particles is a critical issue for materials science, energy storage, biomedical applications, environmental science, and earth science. However, synthesis of iron oxides with desired phase and size are still a time-consuming and trial-and-error process. This study presents solutions for two fundamental challenges in materials synthesis: predicting the outcome of a synthesis from specified reaction parameters and correlating sets of parameters to obtain products with desired outcomes. Four machine learning algorithms, including random forest, logistic regression, support vector machine, and k-nearest neighbor, were trained to predict the phase and particle size of iron oxide based on experimental conditions. Among the models, random forest exhibited the best performance, achieving 96% and 81% accuracy when predicting the phase and size of iron oxides in the test dataset. Premutation feature importance analysis shows that most models (except logistic regression) rely on known features such as precursor concentration, pH, and temperature to predict the phases from synthesis conditions. The robustness of the random forest models was further verified by comparing prediction and experimental results based on 24 randomly generated methods in additive and non-additive systems not included in the datasets. The predictions of product phase and particle size from the models are in good agreement with the experimental results. Additionally, a searching and ranking algorithm was developed to recommend potential synthesis parameters for obtaining iron oxide products with desired phase and particle size from previous studies in the dataset.
△ Less
Submitted 20 March, 2023;
originally announced March 2023.
-
a survey on GPT-3
Authors:
Mingyu Zong,
Bhaskar Krishnamachari
Abstract:
This paper provides an introductory survey to GPT-3. We cover some of the historical development behind this technology, some of the key features of GPT-3, and discuss the machine learning model and the datasets used. We survey both academic and commercial efforts applying GPT-3 in diverse domains such as develo** conversational AI chatbots, software development, creative work, domain knowledge,…
▽ More
This paper provides an introductory survey to GPT-3. We cover some of the historical development behind this technology, some of the key features of GPT-3, and discuss the machine learning model and the datasets used. We survey both academic and commercial efforts applying GPT-3 in diverse domains such as develo** conversational AI chatbots, software development, creative work, domain knowledge, and business productivity. We discuss some of the challenges that GPT-3 faces such as the problems of training complexity, bias, and hallucination/incorrect answers. We also discuss the future research opportunities in this area.
△ Less
Submitted 1 December, 2022;
originally announced December 2022.
-
A Simulation Method for MMW Radar Sensing in Traffic Intersection Based on BART Algorithm
Authors:
Ming Zong,
Zhanyu Zhu
Abstract:
Millimeter-wave (mmw) radar is indispensable for Intelligent Transportation Systems (ITS), which can monitor traffic conditions in all weathers. An end-to-end simulation method for mmw radar monitoring and identification at traffic intersections is proposed in this paper. In this method, a virtual intersection scenario model is constructed, and the scattering coefficient of the target is calculate…
▽ More
Millimeter-wave (mmw) radar is indispensable for Intelligent Transportation Systems (ITS), which can monitor traffic conditions in all weathers. An end-to-end simulation method for mmw radar monitoring and identification at traffic intersections is proposed in this paper. In this method, a virtual intersection scenario model is constructed, and the scattering coefficient of the target is calculated using the Bidirectional Analytical Ray Tracing (BART) algorithm. Combined with the generation of time-domain waveforms, the operation of frequency-domain convolution is simplified by inverse Fourier transform, and the echo signals received by the sparse array are simulated. After raw signal processing, point cloud images containing target position information and Range-Doppler Map (RDM) containing target state feature are obtained. The performance of mmw radar in detecting the specific location information of the target is evaluated by analyzing point cloud images. In addition, a self-defined convolutional neural network is introduced in this paper to evaluate the object recognition performance of the RDM. After the training of the neural network, the classification accuracy of this method for four types of vehicle targets can reach 92%.
△ Less
Submitted 28 August, 2022; v1 submitted 23 August, 2022;
originally announced August 2022.
-
Short-step Methods Are Not Strongly Polynomial-Time
Authors:
Manru Zong,
Yin Tat Lee,
Man-Chung Yue
Abstract:
Short-step methods are an important class of algorithms for solving convex constrained optimization problems. In this short paper, we show that under very mild assumptions on the self-concordant barrier and the width of the $\ell_2$-neighbourhood, any short-step interior-point method is not strongly polynomial-time.
Short-step methods are an important class of algorithms for solving convex constrained optimization problems. In this short paper, we show that under very mild assumptions on the self-concordant barrier and the width of the $\ell_2$-neighbourhood, any short-step interior-point method is not strongly polynomial-time.
△ Less
Submitted 8 January, 2022;
originally announced January 2022.
