Contrastive-Adversarial and Diffusion: Exploring pre-training and fine-tuning strategies for sulcal identification
Authors:
Michail Mamalakis,
Héloïse de Vareilles,
Shun-Chin Jim Wu,
Ingrid Agartz,
Lynn Egeland Mørch-Johnsen,
Jane Garrison,
Jon Simons,
Pietro Lio,
John Suckling,
Graham Murray
Abstract:
In the last decade, computer vision has witnessed the establishment of various training and learning approaches. Techniques like adversarial learning, contrastive learning, diffusion denoising learning, and ordinary reconstruction learning have become standard, representing state-of-the-art methods extensively employed for fully training or pre-training networks across various vision tasks. The ex…
▽ More
In the last decade, computer vision has witnessed the establishment of various training and learning approaches. Techniques like adversarial learning, contrastive learning, diffusion denoising learning, and ordinary reconstruction learning have become standard, representing state-of-the-art methods extensively employed for fully training or pre-training networks across various vision tasks. The exploration of fine-tuning approaches has emerged as a current focal point, addressing the need for efficient model tuning with reduced GPU memory usage and time costs while enhancing overall performance, as exemplified by methodologies like low-rank adaptation (LoRA). Key questions arise: which pre-training technique yields optimal results - adversarial, contrastive, reconstruction, or diffusion denoising? How does the performance of these approaches vary as the complexity of fine-tuning is adjusted? This study aims to elucidate the advantages of pre-training techniques and fine-tuning strategies to enhance the learning process of neural networks in independent identical distribution (IID) cohorts. We underscore the significance of fine-tuning by examining various cases, including full tuning, decoder tuning, top-level tuning, and fine-tuning of linear parameters using LoRA. Systematic summaries of model performance and efficiency are presented, leveraging metrics such as accuracy, time cost, and memory efficiency. To empirically demonstrate our findings, we focus on a multi-task segmentation-classification challenge involving the paracingulate sulcus (PCS) using different 3D Convolutional Neural Network (CNN) architectures by using the TOP-OSLO cohort comprising 596 subjects.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
Compressive single-pixel read-out of single-photon quantum walks on a polymer photonic chip
Authors:
Aveek Chandra,
Shuin Jian Wu,
Angelina Frank,
James A. Grieve
Abstract:
Quantum photonic devices operating in the single photon regime require the detection and characterization of quantum states of light. Chip-scale, waveguide-based devices are a key enabling technology for increasing the scale and complexity of such systems. Collecting single photons from multiple outputs at the end-face of such a chip is a core task that is frequently non-trivial, especially when o…
▽ More
Quantum photonic devices operating in the single photon regime require the detection and characterization of quantum states of light. Chip-scale, waveguide-based devices are a key enabling technology for increasing the scale and complexity of such systems. Collecting single photons from multiple outputs at the end-face of such a chip is a core task that is frequently non-trivial, especially when output ports are densely spaced. We demonstrate a novel, inexpensive method to efficiently image and route individual output modes of a polymer photonic chip, where single photons undergo a quantum walk. The method makes use of single-pixel imaging (SPI) with a digital micromirror device (DMD). By implementing a series of masks on the DMD and collecting the reflected signal into single-photon detectors, the spatial distribution of the single photons can be reconstructed with high accuracy. We also demonstrate the feasibility of optimization strategies based on compressive sensing.
△ Less
Submitted 11 July, 2023;
originally announced July 2023.
