-
Benchmarking Cross-Domain Audio-Visual Deception Detection
Authors:
Xiaobao Guo,
Zitong Yu,
Nithish Muthuchamy Selvaraj,
Bingquan Shen,
Adams Wai-Kin Kong,
Alex C. Kot
Abstract:
Automated deception detection is crucial for assisting humans in accurately assessing truthfulness and identifying deceptive behavior. Conventional contact-based techniques, like polygraph devices, rely on physiological signals to determine the authenticity of an individual's statements. Nevertheless, recent developments in automated deception detection have demonstrated that multimodal features d…
▽ More
Automated deception detection is crucial for assisting humans in accurately assessing truthfulness and identifying deceptive behavior. Conventional contact-based techniques, like polygraph devices, rely on physiological signals to determine the authenticity of an individual's statements. Nevertheless, recent developments in automated deception detection have demonstrated that multimodal features derived from both audio and video modalities may outperform human observers on publicly available datasets. Despite these positive findings, the generalizability of existing audio-visual deception detection approaches across different scenarios remains largely unexplored. To close this gap, we present the first cross-domain audio-visual deception detection benchmark, that enables us to assess how well these methods generalize for use in real-world scenarios. We used widely adopted audio and visual features and different architectures for benchmarking, comparing single-to-single and multi-to-single domain generalization performance. To further exploit the impacts using data from multiple source domains for training, we investigate three types of domain sampling strategies, including domain-simultaneous, domain-alternating, and domain-by-domain for multi-to-single domain generalization evaluation. Furthermore, we proposed the Attention-Mixer fusion method to improve performance, and we believe that this new cross-domain benchmark will facilitate future research in audio-visual deception detection. Protocols and source code are available at \href{https://github.com/Redaimao/cross_domain_DD}{https://github.com/Redaimao/cross\_domain\_DD}.
△ Less
Submitted 11 May, 2024;
originally announced May 2024.
-
DA-TransUNet: Integrating Spatial and Channel Dual Attention with Transformer U-Net for Medical Image Segmentation
Authors:
Guanqun Sun,
Yizhi Pan,
Weikun Kong,
Zichang Xu,
Jianhua Ma,
Teeradaj Racharak,
Le-Minh Nguyen,
Junyi Xin
Abstract:
Accurate medical image segmentation is critical for disease quantification and treatment evaluation. While traditional Unet architectures and their transformer-integrated variants excel in automated segmentation tasks. However, they lack the ability to harness the intrinsic position and channel features of image. Existing models also struggle with parameter efficiency and computational complexity,…
▽ More
Accurate medical image segmentation is critical for disease quantification and treatment evaluation. While traditional Unet architectures and their transformer-integrated variants excel in automated segmentation tasks. However, they lack the ability to harness the intrinsic position and channel features of image. Existing models also struggle with parameter efficiency and computational complexity, often due to the extensive use of Transformers. To address these issues, this study proposes a novel deep medical image segmentation framework, called DA-TransUNet, aiming to integrate the Transformer and dual attention block(DA-Block) into the traditional U-shaped architecture. Unlike earlier transformer-based U-net models, DA-TransUNet utilizes Transformers and DA-Block to integrate not only global and local features, but also image-specific positional and channel features, improving the performance of medical image segmentation. By incorporating a DA-Block at the embedding layer and within each skip connection layer, we substantially enhance feature extraction capabilities and improve the efficiency of the encoder-decoder structure. DA-TransUNet demonstrates superior performance in medical image segmentation tasks, consistently outperforming state-of-the-art techniques across multiple datasets. In summary, DA-TransUNet offers a significant advancement in medical image segmentation, providing an effective and powerful alternative to existing techniques. Our architecture stands out for its ability to improve segmentation accuracy, thereby advancing the field of automated medical image diagnostics. The codes and parameters of our model will be publicly available at https://github.com/SUN-1024/DA-TransUnet.
△ Less
Submitted 14 November, 2023; v1 submitted 19 October, 2023;
originally announced October 2023.
-
Interpreting the Value of Flexibility in AC Security-Constrained Transmission Expansion Planning via a Cooperative Game Framework
Authors:
Andrey Churkin,
Wangwei Kong,
Mohammad Iman Alizadeh,
Florin Capitanescu,
Pierluigi Mancarella,
Eduardo A. Martínez Ceseña
Abstract:
Security-constrained transmission expansion planning (SCTEP) is an inherently complex problem that requires simultaneously solving multiple contingency states of the system (usually corresponding to N-1 security criterion). Existing studies focus on effectively finding optimal solutions; however, single optimal solutions are not sufficient to interpret the value of flexibility (e.g., from energy s…
▽ More
Security-constrained transmission expansion planning (SCTEP) is an inherently complex problem that requires simultaneously solving multiple contingency states of the system (usually corresponding to N-1 security criterion). Existing studies focus on effectively finding optimal solutions; however, single optimal solutions are not sufficient to interpret the value of flexibility (e.g., from energy storage systems) and support system planners in well-informed decision making. In view of planning uncertainties, it is necessary to estimate the contributions of flexibility to various objectives and prioritise the most effective investments. In this regard, this work introduces a SCTEP tool that enables interpreting the value of flexibility in terms of contributions to avoided load curtailment and total expected system cost reduction. Inspired by cooperative game theory, the tool ranks the contributions of flexibility providers and compares them against traditional line reinforcements. This information can be used by system planners to prioritise investments with higher contributions and synergistic capabilities.
△ Less
Submitted 14 March, 2024; v1 submitted 5 October, 2023;
originally announced October 2023.
-
Tracing, Ranking and Valuation of Aggregated DER Flexibility in Active Distribution Networks
Authors:
Andrey Churkin,
Wangwei Kong,
Jose N. Melchor Gutierrez,
Eduardo A. Martínez Ceseña,
Pierluigi Mancarella
Abstract:
The integration of distributed energy resources (DER) makes active distribution networks (ADNs) natural providers of flexibility services. However, the optimal operation of flexible units in ADNs is highly complex, which poses challenges for distribution system operators (DSOs) in aggregating DER flexibility. For example, to maximise the provision of services, flexible units must be strongly coord…
▽ More
The integration of distributed energy resources (DER) makes active distribution networks (ADNs) natural providers of flexibility services. However, the optimal operation of flexible units in ADNs is highly complex, which poses challenges for distribution system operators (DSOs) in aggregating DER flexibility. For example, to maximise the provision of services, flexible units must be strongly coordinated to manage network constraints, e.g., perform power swaps. Furthermore, due to the nonlinearities of aggregated DER flexibility provision, some units may need to rapidly change their outputs to enable the services. To address these challenges, this paper brings together exact AC optimal power flow (OPF) models and a cooperative game formulation and presents a new framework for tracing, ranking, and valuation of aggregated DER flexibility in ADNs. Extensive tests and simulations performed for the 33-bus radial distribution network demonstrate that the framework enables translating complex DER interactions into useful information for DSOs by ranking the criticality of flexible units and performing flexibility valuation based on its cost or economic surplus. Additionally, the framework proposes no-swap constraints and a nonlinearity metric which can be used by DSOs to identify unreliable operating regions with power swaps or rapid changes in flexible unit dispatch.
△ Less
Submitted 26 May, 2023; v1 submitted 7 October, 2022;
originally announced October 2022.
-
An Extendable Maneuver Management Framework with Fault-Tolerant Mechanism for Vehicle Platoon Control System in Highway Scenario
Authors:
Chang Liu,
Yugong Luo,
Pengfei Li,
Chunhui Xing,
Weiwei Kong
Abstract:
Vehicle platoon often face the problem of lack of scalability of maneuvers in practical applications. Once a new scenario is added, the original program may no longer be available. To deal with this problem, this paper introduces a two-dimensional maneuver management framework with a fault-tolerant mechanism on the basis of the proposed hierarchical architecture for the platoon control system. Man…
▽ More
Vehicle platoon often face the problem of lack of scalability of maneuvers in practical applications. Once a new scenario is added, the original program may no longer be available. To deal with this problem, this paper introduces a two-dimensional maneuver management framework with a fault-tolerant mechanism on the basis of the proposed hierarchical architecture for the platoon control system. Maneuvers and roles are two dimensions, based on which the management strategies are decoupled. This makes each vehicle in the platoon has the ability to execute management strategies of various maneuvers and the new maneuver could be extended without revising the existing part. The fault-tolerant mechanism is designed as a maneuver triggered by hardware failures to keep safe before taking over. Furthermore, three typical maneuvers are selected for case studies to illustrate how the management strategies in this framework work. Finally, a comprehensive simulation scenario integrating different maneuvers is designed and a real-world implementation using micro-vehicles is conducted. Results show that the propose two-dimensional framework could effectively deal with various maneuvers and satisfy the computational real-time requirements
△ Less
Submitted 3 July, 2022;
originally announced July 2022.
-
Aerosense: A Self-Sustainable And Long-Range Bluetooth Wireless Sensor Node for Aerodynamic and Aeroacoustic Monitoring on Wind Turbines
Authors:
Tommaso Polonelli,
Hanna Müller,
Weikang Kong,
Raphael Fischer,
Luca Benini,
Michele Magno
Abstract:
This paper presents a low-power, self-sustainable, and modular wireless sensor node for aerodynamic and acoustic measurements on wind turbines and other industrial structures. It includes 40 high-accuracy barometers, 10 microphones, 5 differential pressure sensors, and implements a lossy and a lossless on-board data compression algorithm to decrease the transmission energy cost. The wireless trans…
▽ More
This paper presents a low-power, self-sustainable, and modular wireless sensor node for aerodynamic and acoustic measurements on wind turbines and other industrial structures. It includes 40 high-accuracy barometers, 10 microphones, 5 differential pressure sensors, and implements a lossy and a lossless on-board data compression algorithm to decrease the transmission energy cost. The wireless transmitter is based on Bluetooth Low Energy 5.1 tuned for long-range and high throughput while maintaining adequate per-bit energy efficiency (80 nJ). Moreover, we field-assessed the node capability to collect precise and accurate aerodynamic data. Outdoor experimental tests revealed that the system can acquire and sustain a data rate of 850 kbps over 438 m. The power consumption while collecting and streaming all measured data is 120 mW, enabling self-sustainability and long-term in-situ monitoring with a 111 cm^2 photovoltaic panel.
△ Less
Submitted 24 May, 2022;
originally announced May 2022.
-
Assessing Distribution Network Flexibility via Reliability-based P-Q Area Segmentation
Authors:
Andrey Churkin,
Wangwei Kong,
Jose N. Melchor Gutierrez,
Pierluigi Mancarella,
Eduardo A. Martinez Cesena
Abstract:
This paper proposes a framework to assess the flexibility of active distribution networks (ADNs) via P-Q area segmentation, considering the reliability of flexible units (FUs). A mixed-integer quadratically constrained programming (MIQCP) model is formulated to analyse flexible active and reactive power support at the interface with transmission networks, explicitly capturing the contributions and…
▽ More
This paper proposes a framework to assess the flexibility of active distribution networks (ADNs) via P-Q area segmentation, considering the reliability of flexible units (FUs). A mixed-integer quadratically constrained programming (MIQCP) model is formulated to analyse flexible active and reactive power support at the interface with transmission networks, explicitly capturing the contributions and reliability of FUs that provide flexibility services within an ADN. The numerical simulations performed for a real 124-bus UK distribution network demonstrate the optimal flexibility provision by different FUs, as well as the corresponding reliability and the impact of network reconfiguration. Distribution system operators (DSOs) can use the proposed framework to identify critical units, select an adequate combination of flexibility volumes, and manage its reliability.
△ Less
Submitted 17 April, 2023; v1 submitted 3 October, 2021;
originally announced October 2021.
-
TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation
Authors:
Bingzhi Chen,
Yishu Liu,
Zheng Zhang,
Guangming Lu,
Adams Wai Kin Kong
Abstract:
Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of automatic medical image segmentation. Due to the inherent bias in the convolution operations, prior models mainly focus on local visual cues formed by the neigh…
▽ More
Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of automatic medical image segmentation. Due to the inherent bias in the convolution operations, prior models mainly focus on local visual cues formed by the neighboring pixels, but fail to fully model the long-range contextual dependencies. In this paper, we propose a novel Transformer-based Attention Guided Network called TransAttUnet, in which the multi-level guided attention and multi-scale skip connection are designed to jointly enhance the performance of the semantical segmentation architecture. Inspired by Transformer, the self-aware attention (SAA) module with Transformer Self Attention (TSA) and Global Spatial Attention (GSA) is incorporated into TransAttUnet to effectively learn the non-local interactions among encoder features. Moreover, we also use additional multi-scale skip connections between decoder blocks to aggregate the upsampled features with different semantic scales. In this way, the representation ability of multi-scale context information is strengthened to generate discriminative features. Benefitting from these complementary components, the proposed TransAttUnet can effectively alleviate the loss of fine details caused by the stacking of convolution layers and the consecutive sampling operations, finally improving the segmentation quality of medical images. Extensive experiments on multiple medical image segmentation datasets from different imaging modalities demonstrate that the proposed method consistently outperforms the state-of-the-art baselines. Our code and pre-trained models are available at: https://github.com/YishuLiu/TransAttUnet.
△ Less
Submitted 8 July, 2022; v1 submitted 12 July, 2021;
originally announced July 2021.
-
Transfer Learning for Motor Imagery Based Brain-Computer Interfaces: A Complete Pipeline
Authors:
Dongrui Wu,
Xue Jiang,
Ruimin Peng,
Wanzeng Kong,
Jian Huang,
Zhigang Zeng
Abstract:
Transfer learning (TL) has been widely used in motor imagery (MI) based brain-computer interfaces (BCIs) to reduce the calibration effort for a new subject, and demonstrated promising performance. While a closed-loop MI-based BCI system, after electroencephalogram (EEG) signal acquisition and temporal filtering, includes spatial filtering, feature engineering, and classification blocks before send…
▽ More
Transfer learning (TL) has been widely used in motor imagery (MI) based brain-computer interfaces (BCIs) to reduce the calibration effort for a new subject, and demonstrated promising performance. While a closed-loop MI-based BCI system, after electroencephalogram (EEG) signal acquisition and temporal filtering, includes spatial filtering, feature engineering, and classification blocks before sending out the control signal to an external device, previous approaches only considered TL in one or two such components. This paper proposes that TL could be considered in all three components (spatial filtering, feature engineering, and classification) of MI-based BCIs. Furthermore, it is also very important to specifically add a data alignment component before spatial filtering to make the data from different subjects more consistent, and hence to facilitate subsequential TL. Offline calibration experiments on two MI datasets verified our proposal. Especially, integrating data alignment and sophisticated TL approaches can significantly improve the classification performance, and hence greatly reduces the calibration effort.
△ Less
Submitted 22 January, 2021; v1 submitted 3 July, 2020;
originally announced July 2020.
-
Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks
Authors:
Wanyue Li,
Wen Kong,
Yiwei Chen,
**g Wang,
Yi He,
Guohua Shi,
Guohua Deng
Abstract:
Fluorescein angiography can provide a map of retinal vascular structure and function, which is commonly used in ophthalmology diagnosis, however, this imaging modality may pose risks of harm to the patients. To help physicians reduce the potential risks of diagnosis, an image translation method is adopted. In this work, we proposed a conditional generative adversarial network(GAN) - based method t…
▽ More
Fluorescein angiography can provide a map of retinal vascular structure and function, which is commonly used in ophthalmology diagnosis, however, this imaging modality may pose risks of harm to the patients. To help physicians reduce the potential risks of diagnosis, an image translation method is adopted. In this work, we proposed a conditional generative adversarial network(GAN) - based method to directly learn the map** relationship between structure fundus images and fundus fluorescence angiography images. Moreover, local saliency maps, which define each pixel's importance, are used to define a novel saliency loss in the GAN cost function. This facilitates more accurate learning of small-vessel and fluorescein leakage features.
△ Less
Submitted 17 June, 2020;
originally announced June 2020.