-
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation
Authors:
Jun Wang,
Yuzhe Qin,
Kaiming Kuang,
Yigit Korkmaz,
Akhilan Gurumoorthy,
Hao Su,
Xiaolong Wang
Abstract:
We introduce CyberDemo, a novel approach to robotic imitation learning that leverages simulated human demonstrations for real-world tasks. By incorporating extensive data augmentation in a simulated environment, CyberDemo outperforms traditional in-domain real-world demonstrations when transferred to the real world, handling diverse physical and visual conditions. Regardless of its affordability a…
▽ More
We introduce CyberDemo, a novel approach to robotic imitation learning that leverages simulated human demonstrations for real-world tasks. By incorporating extensive data augmentation in a simulated environment, CyberDemo outperforms traditional in-domain real-world demonstrations when transferred to the real world, handling diverse physical and visual conditions. Regardless of its affordability and convenience in data collection, CyberDemo outperforms baseline methods in terms of success rates across various tasks and exhibits generalizability with previously unseen objects. For example, it can rotate novel tetra-valve and penta-valve, despite human demonstrations only involving tri-valves. Our research demonstrates the significant potential of simulated human demonstrations for real-world dexterous manipulation tasks. More details can be found at https://cyber-demo.github.io
△ Less
Submitted 1 March, 2024; v1 submitted 22 February, 2024;
originally announced February 2024.
-
Learning Fourier-Constrained Diffusion Bridges for MRI Reconstruction
Authors:
Muhammad U. Mirza,
Onat Dalmaz,
Hasan A. Bedel,
Gokberk Elmas,
Yilmaz Korkmaz,
Alper Gungor,
Salman UH Dar,
Tolga Çukur
Abstract:
Deep generative models have gained recent traction in accelerated MRI reconstruction. Diffusion priors are particularly promising given their representational fidelity. Instead of the target transformation from undersampled to fully-sampled data required for MRI reconstruction, common diffusion priors are trained to learn a task-agnostic transformation from an asymptotic start-point of Gaussian no…
▽ More
Deep generative models have gained recent traction in accelerated MRI reconstruction. Diffusion priors are particularly promising given their representational fidelity. Instead of the target transformation from undersampled to fully-sampled data required for MRI reconstruction, common diffusion priors are trained to learn a task-agnostic transformation from an asymptotic start-point of Gaussian noise onto the finite end-point of fully-sampled data. During inference, data-consistency projections are injected in between reverse diffusion steps to reach a compromise solution within the span of both the trained diffusion prior and the imaging operator for an accelerated MRI acquisition. Unfortunately, performance losses can occur due to the discrepancy between target and learned transformations given the asymptotic normality assumption in diffusion priors. To address this discrepancy, here we introduce a novel Fourier-constrained diffusion bridge (FDB) for MRI reconstruction that transforms between a finite start-point of moderately undersampled data and an end-point of fully-sampled data. We derive the theoretical formulation of FDB as a generalized diffusion process based on a stochastic degradation operator that performs random spatial-frequency removal. We propose an enhanced sampling algorithm with a learned correction term for soft dealiasing across reverse diffusion steps. Demonstrations on brain MRI indicate that FDB outperforms state-of-the-art methods including non-diffusion and diffusion priors.
△ Less
Submitted 16 December, 2023; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Self-Supervised MRI Reconstruction with Unrolled Diffusion Models
Authors:
Yilmaz Korkmaz,
Tolga Cukur,
Vishal M. Patel
Abstract:
Magnetic Resonance Imaging (MRI) produces excellent soft tissue contrast, albeit it is an inherently slow imaging modality. Promising deep learning methods have recently been proposed to reconstruct accelerated MRI scans. However, existing methods still suffer from various limitations regarding image fidelity, contextual sensitivity, and reliance on fully-sampled acquisitions for model training. T…
▽ More
Magnetic Resonance Imaging (MRI) produces excellent soft tissue contrast, albeit it is an inherently slow imaging modality. Promising deep learning methods have recently been proposed to reconstruct accelerated MRI scans. However, existing methods still suffer from various limitations regarding image fidelity, contextual sensitivity, and reliance on fully-sampled acquisitions for model training. To comprehensively address these limitations, we propose a novel self-supervised deep reconstruction model, named Self-Supervised Diffusion Reconstruction (SSDiffRecon). SSDiffRecon expresses a conditional diffusion process as an unrolled architecture that interleaves cross-attention transformers for reverse diffusion steps with data-consistency blocks for physics-driven processing. Unlike recent diffusion methods for MRI reconstruction, a self-supervision strategy is adopted to train SSDiffRecon using only undersampled k-space data. Comprehensive experiments on public brain MR datasets demonstrates the superiority of SSDiffRecon against state-of-the-art supervised, and self-supervised baselines in terms of reconstruction speed and quality. Implementation will be available at https://github.com/yilmazkorkmaz1/SSDiffRecon.
△ Less
Submitted 15 April, 2024; v1 submitted 28 June, 2023;
originally announced June 2023.
-
Adaptive Diffusion Priors for Accelerated MRI Reconstruction
Authors:
Alper Güngör,
Salman UH Dar,
Şaban Öztürk,
Yilmaz Korkmaz,
Gokberk Elmas,
Muzaffer Özbey,
Tolga Çukur
Abstract:
Deep MRI reconstruction is commonly performed with conditional models that de-alias undersampled acquisitions to recover images consistent with fully-sampled data. Since conditional models are trained with knowledge of the imaging operator, they can show poor generalization across variable operators. Unconditional models instead learn generative image priors decoupled from the operator to improve…
▽ More
Deep MRI reconstruction is commonly performed with conditional models that de-alias undersampled acquisitions to recover images consistent with fully-sampled data. Since conditional models are trained with knowledge of the imaging operator, they can show poor generalization across variable operators. Unconditional models instead learn generative image priors decoupled from the operator to improve reliability against domain shifts related to the imaging operator. Recent diffusion models are particularly promising given their high sample fidelity. Nevertheless, inference with a static image prior can perform suboptimally. Here we propose the first adaptive diffusion prior for MRI reconstruction, AdaDiff, to improve performance and reliability against domain shifts. AdaDiff leverages an efficient diffusion prior trained via adversarial map** over large reverse diffusion steps. A two-phase reconstruction is executed following training: a rapid-diffusion phase that produces an initial reconstruction with the trained prior, and an adaptation phase that further refines the result by updating the prior to minimize data-consistency loss. Demonstrations on multi-contrast brain MRI clearly indicate that AdaDiff outperforms competing conditional and unconditional methods under domain shifts, and achieves superior or on par within-domain performance.
△ Less
Submitted 17 September, 2023; v1 submitted 12 July, 2022;
originally announced July 2022.
-
Federated Learning of Generative Image Priors for MRI Reconstruction
Authors:
Gokberk Elmas,
Salman UH Dar,
Yilmaz Korkmaz,
Emir Ceyani,
Burak Susam,
Muzaffer Özbey,
Salman Avestimehr,
Tolga Çukur
Abstract:
Multi-institutional efforts can facilitate training of deep MRI reconstruction models, albeit privacy risks arise during cross-site sharing of imaging data. Federated learning (FL) has recently been introduced to address privacy concerns by enabling distributed training without transfer of imaging data. Existing FL methods for MRI reconstruction employ conditional models to map from undersampled t…
▽ More
Multi-institutional efforts can facilitate training of deep MRI reconstruction models, albeit privacy risks arise during cross-site sharing of imaging data. Federated learning (FL) has recently been introduced to address privacy concerns by enabling distributed training without transfer of imaging data. Existing FL methods for MRI reconstruction employ conditional models to map from undersampled to fully-sampled acquisitions via explicit knowledge of the imaging operator. Since conditional models generalize poorly across different acceleration rates or sampling densities, imaging operators must be fixed between training and testing, and they are typically matched across sites. To improve generalization and flexibility in multi-institutional collaborations, here we introduce a novel method for MRI reconstruction based on Federated learning of Generative IMage Priors (FedGIMP). FedGIMP leverages a two-stage approach: cross-site learning of a generative MRI prior, and subject-specific injection of the imaging operator. The global MRI prior is learned via an unconditional adversarial model that synthesizes high-quality MR images based on latent variables. Specificity in the prior is preserved via a mapper subnetwork that produces site-specific latents. During inference, the prior is combined with subject-specific imaging operators to enable reconstruction, and further adapted to individual test samples by minimizing data-consistency loss. Comprehensive experiments on multi-institutional datasets clearly demonstrate enhanced generalization performance of FedGIMP against site-specific and federated methods based on conditional models, as well as traditional reconstruction methods.
△ Less
Submitted 6 April, 2022; v1 submitted 8 February, 2022;
originally announced February 2022.
-
Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers
Authors:
Yilmaz Korkmaz,
Salman UH Dar,
Mahmut Yurt,
Muzaffer Özbey,
Tolga Çukur
Abstract:
Supervised reconstruction models are characteristically trained on matched pairs of undersampled and fully-sampled data to capture an MRI prior, along with supervision regarding the imaging operator to enforce data consistency. To reduce supervision requirements, the recent deep image prior framework instead conjoins untrained MRI priors with the imaging operator during inference. Yet, canonical c…
▽ More
Supervised reconstruction models are characteristically trained on matched pairs of undersampled and fully-sampled data to capture an MRI prior, along with supervision regarding the imaging operator to enforce data consistency. To reduce supervision requirements, the recent deep image prior framework instead conjoins untrained MRI priors with the imaging operator during inference. Yet, canonical convolutional architectures are suboptimal in capturing long-range relationships, and priors based on randomly initialized networks may yield suboptimal performance. To address these limitations, here we introduce a novel unsupervised MRI reconstruction method based on zero-Shot Learned Adversarial TransformERs (SLATER). SLATER embodies a deep adversarial network with cross-attention transformers to map noise and latent variables onto coil-combined MR images. During pre-training, this unconditional network learns a high-quality MRI prior in an unsupervised generative modeling task. During inference, a zero-shot reconstruction is then performed by incorporating the imaging operator and optimizing the prior to maximize consistency to undersampled data. Comprehensive experiments on brain MRI datasets clearly demonstrate the superior performance of SLATER against state-of-the-art unsupervised methods.
△ Less
Submitted 16 January, 2022; v1 submitted 14 May, 2021;
originally announced May 2021.
-
Comparing of switching frequency on vector controlled asynchronous motor
Authors:
Yılmaz Korkmaz,
Fatih Korkmaz,
İsmail Topaloglu,
Hayati Mamur
Abstract:
Nowadays, asynchronous motors have wide range use in many industrial applications. Field oriented control (FOC) and direct torque control (DTC) are commonly used methods in high performance vector control for asynchronous motors. Therefore, it is very important to identify clearly advantages and disadvantages of both systems in the selection of appropriate control methods for many industrial appli…
▽ More
Nowadays, asynchronous motors have wide range use in many industrial applications. Field oriented control (FOC) and direct torque control (DTC) are commonly used methods in high performance vector control for asynchronous motors. Therefore, it is very important to identify clearly advantages and disadvantages of both systems in the selection of appropriate control methods for many industrial applications. This paper aims to present a new and different perspective regarding the comparison of the switching behaviours on the FOC and the DTC drivers. For this purpose, the experimental studies have been carried out to compare the inverter switching frequencies and torque responses of the asynchronous motor in the FOC and the DTC systems under different working conditions. The dSPACE 1103 controller board was programmed with Matlab/Simulink software. As expected, the experimental studies showed that the FOC controlled motors has a lessened torque ripple. On the other hand, the FOC controlled motor switching frequency has about 65-75% more than the DTC controlled under both loaded and unloaded working conditions.
△ Less
Submitted 24 January, 2016;
originally announced October 2016.
-
Nuclear spin squeezing via electric quadrupole interaction
Authors:
Yağmur Aksu Korkmaz,
Ceyhun Bulutay
Abstract:
Control over nuclear spin fluctuations is essential for processes that rely on preserving the quantum state of an embedded system. For this purpose, squeezing is a viable alternative, so far that has not been properly exploited for the nuclear spins. Of particular relevance in solids is the electric quadrupole interaction (QI), which operates on nuclei having spin higher than 1/2. In its general f…
▽ More
Control over nuclear spin fluctuations is essential for processes that rely on preserving the quantum state of an embedded system. For this purpose, squeezing is a viable alternative, so far that has not been properly exploited for the nuclear spins. Of particular relevance in solids is the electric quadrupole interaction (QI), which operates on nuclei having spin higher than 1/2. In its general form, QI involves an electric field gradient (EFG) biaxiality term. Here, we show that as this EFG biaxiality increases, it enables continuous tuning of single-particle squeezing from the one-axis twisting to the two-axis countertwisting limits. A detailed analysis of QI squeezing is provided, exhibiting the intricate consequences of EFG biaxiality. The initial states over the Bloch sphere are mapped out to identify those favorable for fast initial squeezing, or for prolonged squeezings. Furthermore, the evolution of squeezing in the presence of a phase-dam** channel and an external magnetic field are investigated. We observe that dephasing drives toward an anti-squeezed terminal state, the degree of which increases with the spin angular momentum. Finally, QI squeezing in the limiting case of a two-dimensional EFG with a perpendicular magnetic field is discussed, which is of importance for two-dimensional materials, and the associated beat patterns in squeezing are revealed.
△ Less
Submitted 13 January, 2016; v1 submitted 11 November, 2015;
originally announced November 2015.
-
Fuzzy Based Stator Flux Optimizer Design For Direct Torque Control
Authors:
Fatih Korkmaz,
M. Faruk Cakir,
Yilmaz Korkmaz,
Ismail Topaloglu
Abstract:
Direct Torque Control (DTC) is well known as an effective control technique for high performance drives in a wide variety of industrial applications and conventional DTC technique uses two constant reference value: torque and stator flux. In this paper, a new fuzzy based stator flux optimizer has been proposed for DTC controlled induction motor drivers and simulation studies have been carried out…
▽ More
Direct Torque Control (DTC) is well known as an effective control technique for high performance drives in a wide variety of industrial applications and conventional DTC technique uses two constant reference value: torque and stator flux. In this paper, a new fuzzy based stator flux optimizer has been proposed for DTC controlled induction motor drivers and simulation studies have been carried out with Matlab/Simulink to compare the proposed system behaviours at vary load conditions. The most important feature of the proposed fuzzy logic based stator flux optimizer that it self-regulates the stator flux reference value using the motor load situation without need of any motor parameters. Simulation results show that the performance of the proposed DTC technique has been improved and especially at low-load conditions torque ripples are greatly reduced with respect to the conventional DTC.
△ Less
Submitted 1 December, 2012;
originally announced December 2012.
-
Stator flux optimization on direct torque control with fuzzy logic
Authors:
Fatih Korkmaz,
M. Faruk Cakir,
Yilmaz Korkmaz,
Ismail Topaloglu
Abstract:
The Direct Torque Control (DTC) is well known as an effective control technique for high performance drives in a wide variety of industrial applications and conventional DTC technique uses two constant reference value: torque and stator flux. In this paper, fuzzy logic based stator flux optimization technique for DTC drives that has been proposed. The proposed fuzzy logic based stator flux optimiz…
▽ More
The Direct Torque Control (DTC) is well known as an effective control technique for high performance drives in a wide variety of industrial applications and conventional DTC technique uses two constant reference value: torque and stator flux. In this paper, fuzzy logic based stator flux optimization technique for DTC drives that has been proposed. The proposed fuzzy logic based stator flux optimizer self-regulates the stator flux reference using induction motor load situation without need of any motor parameters. Simulation studies have been carried out with Matlab/Simulink to compare the proposed system behaviors at vary load conditions. Simulation results show that the performance of the proposed DTC technique has been improved and especially at low-load conditions torque ripple are greatly reduced with respect to the conventional DTC.
△ Less
Submitted 21 July, 2012;
originally announced July 2012.