-
MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detection
Authors:
Zhuoxiao Chen,
Junjie Meng,
Mahsa Baktashmotlagh,
Zi Huang,
Yadan Luo
Abstract:
LiDAR-based 3D object detection is pivotal across many applications, yet the performance of such detection systems often degrades after deployment, especially when faced with unseen test point clouds originating from diverse locations or subjected to corruption. In this work, we introduce a new online adaptation framework for detectors named Model Synergy (MOS). Specifically, MOS dynamically assem…
▽ More
LiDAR-based 3D object detection is pivotal across many applications, yet the performance of such detection systems often degrades after deployment, especially when faced with unseen test point clouds originating from diverse locations or subjected to corruption. In this work, we introduce a new online adaptation framework for detectors named Model Synergy (MOS). Specifically, MOS dynamically assembles best-fit supermodels for each test batch from a bank of historical checkpoints, leveraging long-term knowledge to guide model updates without forgetting. The model assembly is directed by the proposed synergy weights (SW), employed for weighted averaging of the selected checkpoints to minimize redundancy in the composite supermodel. These weights are calculated by evaluating the similarity of predicted bounding boxes on test data and the feature independence among model pairs in the bank. To maintain an informative yet compact model bank, we pop out checkpoints with the lowest average SW scores and insert newly updated model weights. Our method was rigorously tested against prior test-time domain adaptation strategies on three datasets and under eight types of corruptions, demonstrating its superior adaptability to changing scenes and conditions. Remarkably, our approach achieved a 67.3% increase in performance in a complex "cross-corruption" scenario, which involves cross-dataset inconsistencies and real-world scene corruptions, providing a more realistic testbed of adaptation capabilities. The code is available at https://github.com/zhuoxiao-chen/MOS.
△ Less
Submitted 21 June, 2024;
originally announced June 2024.
-
Interpretable Small Training Set Image Segmentation Network Originated from Multi-Grid Variational Model
Authors:
Junying Meng,
Weihong Guo,
Jun Liu,
Mingrui Yang
Abstract:
The main objective of image segmentation is to divide an image into homogeneous regions for further analysis. This is a significant and crucial task in many applications such as medical imaging. Deep learning (DL) methods have been proposed and widely used for image segmentation. However, these methods usually require a large amount of manually segmented data as training data and suffer from poor…
▽ More
The main objective of image segmentation is to divide an image into homogeneous regions for further analysis. This is a significant and crucial task in many applications such as medical imaging. Deep learning (DL) methods have been proposed and widely used for image segmentation. However, these methods usually require a large amount of manually segmented data as training data and suffer from poor interpretability (known as the black box problem). The classical Mumford-Shah (MS) model is effective for segmentation and provides a piece-wise smooth approximation of the original image. In this paper, we replace the hand-crafted regularity term in the MS model with a data adaptive generalized learnable regularity term and use a multi-grid framework to unroll the MS model and obtain a variational model-based segmentation network with better generalizability and interpretability. This approach allows for the incorporation of learnable prior information into the network structure design. Moreover, the multi-grid framework enables multi-scale feature extraction and offers a mathematical explanation for the effectiveness of the U-shaped network structure in producing good image segmentation results. Due to the proposed network originates from a variational model, it can also handle small training sizes. Our experiments on the REFUGE dataset, the White Blood Cell image dataset, and 3D thigh muscle magnetic resonance (MR) images demonstrate that even with smaller training datasets, our method yields better segmentation results compared to related state of the art segmentation methods.
△ Less
Submitted 24 June, 2023;
originally announced June 2023.
-
Output Voltage Response Improvement and Ripple Reduction Control for Input-parallel Output-parallel High-Power DC Supply
Authors:
Jianhui Meng,
Xiaolong Wu,
Tairan Ye,
**gsen Yu,
Likang Gu,
Zili Zhang,
Yang Li
Abstract:
A three-phase isolated AC-DC-DC power supply is widely used in the industrial field due to its attractive features such as high-power density, modularity for easy expansion and electrical isolation. In high-power application scenarios, it can be realized by multiple AC-DC-DC modules with Input-Parallel Output-Parallel (IPOP) mode. However, it has the problems of slow output voltage response and la…
▽ More
A three-phase isolated AC-DC-DC power supply is widely used in the industrial field due to its attractive features such as high-power density, modularity for easy expansion and electrical isolation. In high-power application scenarios, it can be realized by multiple AC-DC-DC modules with Input-Parallel Output-Parallel (IPOP) mode. However, it has the problems of slow output voltage response and large ripple in some special applications, such as electrophoresis and electroplating. This paper investigates an improved Adaptive Linear Active Disturbance Rejection Control (A-LADRC) with flexible adjustment capability of the bandwidth parameter value for the high-power DC supply to improve the output voltage response speed. To reduce the DC supply ripple, a control strategy is designed for a single module to adaptively adjust the duty cycle compensation according to the output feedback value. When multiple modules are connected in parallel, a Hierarchical Delay Current Sharing Control (HDCSC) strategy for centralized controllers is proposed to make the peaks and valleys of different modules offset each other. Finally, the proposed method is verified by designing a 42V/12000A high-power DC supply, and the results demonstrate that the proposed method is effective in improving the system output voltage response speed and reducing the voltage ripple, which has significant practical engineering application value.
△ Less
Submitted 16 June, 2023;
originally announced June 2023.
-
GPS Alignment from Multiple Sources to Extract Aircraft Bearing in Aerial Surveys
Authors:
Joshua Power,
Derek Jacoby,
Marc-Antoine Drouin,
Guillaume Durand,
Yvonne Coady,
Julian Meng
Abstract:
Methodical aerial population surveys monitoring critically endangered species in Canadian North Atlantic waters are instrumental in influencing government policies both in economic and conservational efforts. The primary factor hindering the success of these missions is poor visibility caused by glare. This paper builds off our foundational paper [1] and pushes the envelope toward a data-driven gl…
▽ More
Methodical aerial population surveys monitoring critically endangered species in Canadian North Atlantic waters are instrumental in influencing government policies both in economic and conservational efforts. The primary factor hindering the success of these missions is poor visibility caused by glare. This paper builds off our foundational paper [1] and pushes the envelope toward a data-driven glare modelling system. Said data-driven system makes use of meteorological and astronomical data to assist aircraft in navigating in order to mitigate acquisition errors and optimize the quality of acquired data. It is found that reliably extracting aircraft orientation is critical to our approach, to that end, we present a GPS alignment methodology which makes use of the fusion of two GPS signals. Using the complementary strengths and weaknesses of these two signals a synthetic interpolation of fused data is used to generate more reliable flight tracks, substantially improving glare modelling. This methodology could be applied to any other applications with similar signal restrictions.
△ Less
Submitted 10 May, 2023;
originally announced May 2023.
-
Stepwise Feature Fusion: Local Guides Global
Authors:
**feng Wang,
Qiming Huang,
Feilong Tang,
Jia Meng,
Jionglong Su,
Sifan Song
Abstract:
Colonoscopy, currently the most efficient and recognized colon polyp detection technology, is necessary for early screening and prevention of colorectal cancer. However, due to the varying size and complex morphological features of colonic polyps as well as the indistinct boundary between polyps and mucosa, accurate segmentation of polyps is still challenging. Deep learning has become popular for…
▽ More
Colonoscopy, currently the most efficient and recognized colon polyp detection technology, is necessary for early screening and prevention of colorectal cancer. However, due to the varying size and complex morphological features of colonic polyps as well as the indistinct boundary between polyps and mucosa, accurate segmentation of polyps is still challenging. Deep learning has become popular for accurate polyp segmentation tasks with excellent results. However, due to the structure of polyps image and the varying shapes of polyps, it easy for existing deep learning models to overfitting the current dataset. As a result, the model may not process unseen colonoscopy data. To address this, we propose a new State-Of-The-Art model for medical image segmentation, the SSFormer, which uses a pyramid Transformer encoder to improve the generalization ability of models. Specifically, our proposed Progressive Locality Decoder can be adapted to the pyramid Transformer backbone to emphasize local features and restrict attention dispersion. The SSFormer achieves statet-of-the-art performance in both learning and generalization assessment.
△ Less
Submitted 27 June, 2022; v1 submitted 7 March, 2022;
originally announced March 2022.
-
Scenario Forecast of Cross-border Electric Interconnection towards Renewables in South America
Authors:
Wenhao Wang,
**g Meng,
Duan Chen,
Wei Cong
Abstract:
Cross-border Electric Interconnection towards renewables is a promising solution for electric sector under the UN 2030 sustainable development goals which is widely promoted in emerging economies. This paper comprehensively investigates state of art in renewable resources and cross-border electric interconnection in South America. Based on the raw data collected from typical countries, a long-term…
▽ More
Cross-border Electric Interconnection towards renewables is a promising solution for electric sector under the UN 2030 sustainable development goals which is widely promoted in emerging economies. This paper comprehensively investigates state of art in renewable resources and cross-border electric interconnection in South America. Based on the raw data collected from typical countries, a long-term scenario forecast methodology is applied to estimate key indicators of electric sector in target years, comparing the prospects of active promoting cross-border Interconnections Towards Renewables (ITR) scenario with Business as Usual (BAU) scenario in South America region. Key indicators including peak load, installed capacity, investment, and generation cost are forecasted and comparative analyzed by year 2035 and 2050. The comparative data analysis shows that by promoting cross-border interconnection towards renewables in South America, renewable resources can be highly utilized for energy supply, energy matrix can be optimized balanced, economics can be obviously driven and generation cost can be greatly reduced.
△ Less
Submitted 27 January, 2021; v1 submitted 10 September, 2020;
originally announced September 2020.
-
Electronic Bottleneck Suppression in Next-generation Networks with Integrated Photonic Digital-to-analog Converters
Authors:
Jiawei Meng,
Mario Miscuglio,
Jonathan K. George,
Aydin Babakhani,
Volker J. Sorger
Abstract:
Digital-to-analog converters (DAC) are indispensable functional units in signal processing instrumentation and wide-band telecommunication links for both civil and military applications. Since photonic systems are capable of high data throughput and low latency, an increasingly found system limitation stems from the required domain-crossing such as digital-to-analog, and electronic-to-optical. A p…
▽ More
Digital-to-analog converters (DAC) are indispensable functional units in signal processing instrumentation and wide-band telecommunication links for both civil and military applications. Since photonic systems are capable of high data throughput and low latency, an increasingly found system limitation stems from the required domain-crossing such as digital-to-analog, and electronic-to-optical. A photonic DAC implementation, in contrast, enables a seamless signal conversion with respect to both energy efficiency and short signal delay, often require bulky discrete optical components and electric-optic transformation hence introducing inefficiencies. Here, we introduce a novel coherent parallel photonic DAC concept along with an experimental demonstration capable of performing this digital-to-analog conversion without optic-electric-optic domain crossing. This design hence guarantees a linear intensity weighting among bits operating at high sampling rates, yet at a reduced footprint and power consumption compared to other photonic alternatives. Importantly, this photonic DAC could create seamless interfaces of next-generation data processing hardware for data-centers, task-specific compute accelerators such as neuromorphic engines, and network edge processing applications.
△ Less
Submitted 22 December, 2019; v1 submitted 3 November, 2019;
originally announced November 2019.
