Showing 1–50 of 193 results for author: Sohail

AMD: Automatic Multi-step Distillation of Large-scale Vision Models

Authors: Cheng Han, Qifan Wang, Sohail A. Dianat, Majid Rabbani, Raghuveer M. Rao, Yi Fang, Qiang Guan, Lifu Huang, Dongfang Liu

Abstract: Transformer-based architectures have become the de-facto standard models for diverse vision tasks owing to their superior performance. As the size of the models continues to scale up, model distillation becomes extremely important in various real applications, particularly on devices limited by computational resources. However, prevailing knowledge distillation methods exhibit diminished efficacy… ▽ More Transformer-based architectures have become the de-facto standard models for diverse vision tasks owing to their superior performance. As the size of the models continues to scale up, model distillation becomes extremely important in various real applications, particularly on devices limited by computational resources. However, prevailing knowledge distillation methods exhibit diminished efficacy when confronted with a large capacity gap between the teacher and the student, e.g, 10x compression rate. In this paper, we present a novel approach named Automatic Multi-step Distillation (AMD) for large-scale vision model compression. In particular, our distillation process unfolds across multiple steps. Initially, the teacher undergoes distillation to form an intermediate teacher-assistant model, which is subsequently distilled further to the student. An efficient and effective optimization framework is introduced to automatically identify the optimal teacher-assistant that leads to the maximal student performance. We conduct extensive experiments on multiple image classification datasets, including CIFAR-10, CIFAR-100, and ImageNet. The findings consistently reveal that our approach outperforms several established baselines, paving a path for future knowledge distillation methods on large-scale vision models. △ Less

Submitted 4 July, 2024; originally announced July 2024.

Comments: 19 pages, 5 figures

Amalgamating inverse semigroups over ample semigroups

Authors: Nasir Sohail

Abstract: A semigroup amalgam (S; T1, T2) is known to be non-embeddable if T1 and T2 are both groups (completely regular semigroups, Clifford semigroups) but S is not such. We prove some non-embeddability conditions for semigroup amalgams (S; T1, T2) in which T1 and T2 are inverse semigroups but S is not such. We also introduce some sufficient conditions that make the inverse hulls of the copies of S in T1… ▽ More A semigroup amalgam (S; T1, T2) is known to be non-embeddable if T1 and T2 are both groups (completely regular semigroups, Clifford semigroups) but S is not such. We prove some non-embeddability conditions for semigroup amalgams (S; T1, T2) in which T1 and T2 are inverse semigroups but S is not such. We also introduce some sufficient conditions that make the inverse hulls of the copies of S in T1 and T2 isomorphic; making, in turn, the amalgam (S; T1, T2) weakly embeddable. △ Less

Submitted 9 June, 2024; originally announced June 2024.

MSC Class: 20M18; 20M15; 20M10

Beyond Data, Towards Sustainability: A Sydney Case Study on Urban Digital Twins

Authors: Ammar Sohail, Bojie Shen, Muhammad Aamir Cheema, Mohammed Eunus Ali, Anwaar Ulhaq, Muhammad Ali Babar, Asama Qureshi

Abstract: As urban areas grapple with unprecedented challenges stemming from population growth and climate change, the emergence of urban digital twins offers a promising solution. This paper presents a case study focusing on Sydney's urban digital twin, a virtual replica integrating diverse real-time and historical data, including weather, crime, emissions, and traffic. Through advanced visualization and d… ▽ More As urban areas grapple with unprecedented challenges stemming from population growth and climate change, the emergence of urban digital twins offers a promising solution. This paper presents a case study focusing on Sydney's urban digital twin, a virtual replica integrating diverse real-time and historical data, including weather, crime, emissions, and traffic. Through advanced visualization and data analysis techniques, the study explores some applications of this digital twin in urban sustainability, such as spatial ranking of suburbs and automatic identification of correlations between variables. Additionally, the research delves into predictive modeling, employing machine learning to forecast traffic crash risks using environmental data, showcasing the potential for proactive interventions. The contributions of this work lie in the comprehensive exploration of a city-scale digital twin for sustainable urban planning, offering a multifaceted approach to data-driven decision-making. △ Less

Submitted 7 June, 2024; originally announced June 2024.

Prototypical Transformer as Unified Motion Learners

Authors: Cheng Han, Yawen Lu, Guohao Sun, James C. Liang, Zhiwen Cao, Qifan Wang, Qiang Guan, Sohail A. Dianat, Raghuveer M. Rao, Tong Geng, Zhiqiang Tao, Dongfang Liu

Abstract: In this work, we introduce the Prototypical Transformer (ProtoFormer), a general and unified framework that approaches various motion tasks from a prototype perspective. ProtoFormer seamlessly integrates prototype learning with Transformer by thoughtfully considering motion dynamics, introducing two innovative designs. First, Cross-Attention Prototy** discovers prototypes based on signature moti… ▽ More In this work, we introduce the Prototypical Transformer (ProtoFormer), a general and unified framework that approaches various motion tasks from a prototype perspective. ProtoFormer seamlessly integrates prototype learning with Transformer by thoughtfully considering motion dynamics, introducing two innovative designs. First, Cross-Attention Prototy** discovers prototypes based on signature motion patterns, providing transparency in understanding motion scenes. Second, Latent Synchronization guides feature representation learning via prototypes, effectively mitigating the problem of motion uncertainty. Empirical results demonstrate that our approach achieves competitive performance on popular motion tasks such as optical flow and scene depth. Furthermore, it exhibits generality across various downstream tasks, including object tracking and video stabilization. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 21 pages, 10 figures

L2R-CIPU: Efficient CNN Computation with Left-to-Right Composite Inner Product Units

Authors: Malik Zohaib Nisar, Mohammad Sohail Ibrahim, Muhammad Usman, Jeong-A Lee

Abstract: This paper proposes a composite inner-product computation unit based on left-to-right (LR) arithmetic for the acceleration of convolution neural networks (CNN) on hardware. The efficacy of the proposed L2R-CIPU method has been shown on the VGG-16 network, and assessment is done on various performance metrics. The L2R-CIPU design achieves 1.06x to 6.22x greater performance, 4.8x to 15x more TOPS/W,… ▽ More This paper proposes a composite inner-product computation unit based on left-to-right (LR) arithmetic for the acceleration of convolution neural networks (CNN) on hardware. The efficacy of the proposed L2R-CIPU method has been shown on the VGG-16 network, and assessment is done on various performance metrics. The L2R-CIPU design achieves 1.06x to 6.22x greater performance, 4.8x to 15x more TOPS/W, and 4.51x to 53.45x higher TOPS/mm2 than prior architectures. △ Less

Submitted 8 July, 2024; v1 submitted 1 June, 2024; originally announced June 2024.

Nonreciprocal Multipartite Entanglement in a two-cavity magnomechanical system

Authors: Rizwan Ahmed, Hazrat Ali, Aamir Shehzad, S K Singh, Amjad Sohail, Marcos Céesar de Oliveira

Abstract: We propose a scheme for the generation of nonreciprocal multipartite entanglement in a two-mode cavity magnomechanical system, consisting of two cross microwave (MW) cavities having an yttrium iron garnet (YIG) sphere, which is coupled through magnetic dipole interaction. Our results show that the magnon self-Kerr effect can significantly enhance bipartite entanglement, which turns out to be non-r… ▽ More We propose a scheme for the generation of nonreciprocal multipartite entanglement in a two-mode cavity magnomechanical system, consisting of two cross microwave (MW) cavities having an yttrium iron garnet (YIG) sphere, which is coupled through magnetic dipole interaction. Our results show that the magnon self-Kerr effect can significantly enhance bipartite entanglement, which turns out to be non-reciprocal when the magetic field is tuned along the crystallographic axis [110]. This is due to the frequency shift on the magnons (YIG sphere), which depends upon the direction of magnetic field. Interestingly, the degree of nonreciprocity of entanglement depends upon a careful optimal choice of system parameters like normalizd cavity detunings, bipartite nonlinear index $ΔE_{K}$, self-Kerr coefficient and effective magnomechanical coupling rate $G$. In addition to bipartite entanglement, we also explored the nonreciprocity in tripartite entanglement. Our present theoretical proposal for nonreciprocity in multipartite entanglement may find applications in diverse engineering nonreciprocal devices. △ Less

Submitted 25 May, 2024; originally announced May 2024.

Comments: 11 pages, 7figures

Improving Single Domain-Generalized Object Detection: A Focus on Diversification and Alignment

Authors: Muhammad Sohail Danish, Muhammad Haris Khan, Muhammad Akhtar Munir, M. Saquib Sarfraz, Mohsen Ali

Abstract: In this work, we tackle the problem of domain generalization for object detection, specifically focusing on the scenario where only a single source domain is available. We propose an effective approach that involves two key steps: diversifying the source domain and aligning detections based on class prediction confidence and localization. Firstly, we demonstrate that by carefully selecting a set o… ▽ More In this work, we tackle the problem of domain generalization for object detection, specifically focusing on the scenario where only a single source domain is available. We propose an effective approach that involves two key steps: diversifying the source domain and aligning detections based on class prediction confidence and localization. Firstly, we demonstrate that by carefully selecting a set of augmentations, a base detector can outperform existing methods for single domain generalization by a good margin. This highlights the importance of domain diversification in improving the performance of object detectors. Secondly, we introduce a method to align detections from multiple views, considering both classification and localization outputs. This alignment procedure leads to better generalized and well-calibrated object detector models, which are crucial for accurate decision-making in safety-critical applications. Our approach is detector-agnostic and can be seamlessly applied to both single-stage and two-stage detectors. To validate the effectiveness of our proposed methods, we conduct extensive experiments and ablations on challenging domain-shift scenarios. The results consistently demonstrate the superiority of our approach compared to existing methods. Our code and models are available at: https://github.com/msohaildanish/DivAlign △ Less

Submitted 23 May, 2024; originally announced May 2024.

Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models

Authors: Sohail Reddy, Hillary Fairbanks

Abstract: This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian inference often substitute computationally expensive high-fidelity models with machine learning models, thereby introducing approximation errors, our approach offers… ▽ More This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian inference often substitute computationally expensive high-fidelity models with machine learning models, thereby introducing approximation errors, our approach offers a computationally efficient alternative by augmenting high-fidelity models with low-fidelity ones within a hierarchical framework. The multilevel approach utilizes the low-fidelity machine learning model (MLM) for inexpensive evaluation of proposed samples thereby improving the acceptance of samples by the high-fidelity model. The hierarchy in our multilevel algorithm is derived from geometric multigrid hierarchy. We utilize an MLM to acclerate the coarse level sampling. Training machine learning model for the coarsest level significantly reduces the computational cost associated with generating training data and training the model. We present an MCMC algorithm to accelerate the coarsest level sampling using MLM and account for the approximation error introduced. We provide theoretical proofs of detailed balance and demonstrate that our multilevel approach constitutes a consistent MCMC algorithm. Additionally, we derive conditions on the accuracy of the machine learning model to facilitate more efficient hierarchical sampling. Our technique is demonstrated on a standard benchmark inference problem in groundwater flow, where we estimate the probability density of a quantity of interest using a four-level MCMC algorithm. Our proposed algorithm accelerates multilevel sampling by a factor of two while achieving similar accuracy compared to sampling using the standard multilevel algorithm. △ Less

Submitted 18 May, 2024; originally announced May 2024.

Report number: LLNL-JRNL-862759

Nanomechanically induced transparency in $\mathcal{PT}$-symmetric optical cavities

Authors: Amjad Sohail, Rizwan Ahmed, Hazrat Ali

Abstract: In this paper, we analytically present the phenomena of nanomechanically induced transparency (NMIT) and transmission rate in a parity-time-symmetric ($\mathcal{PT}$-symmetric) opto-nanomechanical system (ONMS) where a levitated dielectric nanospheres is trapped near the antinodes closest to right mirror of passive cavity which further coupled to an active cavity via ho** factor. We find that th… ▽ More In this paper, we analytically present the phenomena of nanomechanically induced transparency (NMIT) and transmission rate in a parity-time-symmetric ($\mathcal{PT}$-symmetric) opto-nanomechanical system (ONMS) where a levitated dielectric nanospheres is trapped near the antinodes closest to right mirror of passive cavity which further coupled to an active cavity via ho** factor. We find that the phenomenon of NMIT may be generated from the output probe field in the presence of an effective opto-nanomechanical coupling between the cavity field and the nanosphere, whose steady-state position is influenced by the Coulomb interaction between the cavity mirror and the nanosphere. In addition, the width and height of the transparency window can be controlled through the effective optomechanical coupling, which is readily adjusted by altering changing the nanosphere's radius and the Coulomb interaction. One of the most interesting result is the transition NMIT behavior in $\mathcal{PT}$-symmetric and broken $\mathcal{PT}$-symmetric regime. We show that the presence of nanosphere in the passive cavity enhances the width and transmission rate of NMIT window in passive-passive regime and in passive-active regime, a notable decrease of sideband amplification has been observed. These results show that our scheme may find some potential applications for optical signal processing an and quantum information processing. △ Less

Submitted 16 May, 2024; originally announced May 2024.

Comments: 7 pages, 6 figures

Uniform vector-valued pointwise ergodic theorems for operators

Authors: Micky Barthmann, Sohail Farhangi

Abstract: We prove a uniform vector-valued Wiener-Wintner Theorem for a class of operators that includes compositions of ergodic Koopman operators with contractive multiplication operators, and even some operators that are not $L^1$-contractions. Our methods are general enough to apply to situations in which our operator is ergodic, weakly mixing, mildly mixing, or strongly mixing. This allows to obtain uni… ▽ More We prove a uniform vector-valued Wiener-Wintner Theorem for a class of operators that includes compositions of ergodic Koopman operators with contractive multiplication operators, and even some operators that are not $L^1$-contractions. Our methods are general enough to apply to situations in which our operator is ergodic, weakly mixing, mildly mixing, or strongly mixing. This allows to obtain uniform pointwise ergodic theorems for operators that are ergodic or mildly mixing, which are new even for Koopman operators. Our method of proof is to view $ξ:= (T^nf(x))_{n = 1}^\infty$ as an element of a Cesàro sequence space, which we then map into a subspace of an ultraproduct space that possesses a natural shift operator $S$. Weighted pointwise ergodic theorems then correspond to dual pairings $\langle ξ,g^\prime\rangle = 0$, where we have, for example, that $ξ$ is weakly mixing with respect to $S$ and $g^\prime$ is compact with respect to $S^*$. △ Less

Submitted 8 April, 2024; originally announced April 2024.

MSC Class: 37A25; 47A35; 28B05; 46M07

Photon bunching in high-harmonic emission controlled by quantum light

Authors: Samuel Lemieux, Sohail A. Jalil, David Purschke, Neda Boroumand, David Villeneuve, Andrei Naumov, Thomas Brabec, Giulio Vampa

Abstract: Attosecond spectroscopy comprises several techniques to probe matter through electrons and photons. One frontier of attosecond methods is to reveal complex phenomena arising from quantum-mechanical correlations in the matter system, in the photon fields and among them. Recent theories have laid the groundwork for understanding how quantum-optical properties affect high-field photonics, such as str… ▽ More Attosecond spectroscopy comprises several techniques to probe matter through electrons and photons. One frontier of attosecond methods is to reveal complex phenomena arising from quantum-mechanical correlations in the matter system, in the photon fields and among them. Recent theories have laid the groundwork for understanding how quantum-optical properties affect high-field photonics, such as strong-field ionization and acceleration of electrons in quantum-optical fields, and how entanglement between the field modes arises during the interaction. Here we demonstrate a new experimental approach that transduces some properties of a quantum-optical state through a strong-field nonlinearity. We perturb high-harmonic emission from a semiconductor with a bright squeezed vacuum field resulting in the emission of sidebands of the high-harmonics with super-Poissonian statistics, indicating that the emitted photons are bunched. Our results suggest that perturbing strong-field dynamics with quantum-optical states is a viable way to coherently control the generation of these states at short wavelengths, such as extreme ultraviolet or soft X-rays. Quantum correlations will be instrumental to advance attosecond spectroscopy and imaging beyond the classical limits. △ Less

Submitted 8 April, 2024; originally announced April 2024.

Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval

Authors: Jiamian Wang, Guohao Sun, Pichao Wang, Dongfang Liu, Sohail Dianat, Majid Rabbani, Raghuveer Rao, Zhiqiang Tao

Abstract: The increasing prevalence of video clips has sparked growing interest in text-video retrieval. Recent advances focus on establishing a joint embedding space for text and video, relying on consistent embedding representations to compute similarity. However, the text content in existing datasets is generally short and concise, making it hard to fully describe the redundant semantics of a video. Corr… ▽ More The increasing prevalence of video clips has sparked growing interest in text-video retrieval. Recent advances focus on establishing a joint embedding space for text and video, relying on consistent embedding representations to compute similarity. However, the text content in existing datasets is generally short and concise, making it hard to fully describe the redundant semantics of a video. Correspondingly, a single text embedding may be less expressive to capture the video embedding and empower the retrieval. In this study, we propose a new stochastic text modeling method T-MASS, i.e., text is modeled as a stochastic embedding, to enrich text embedding with a flexible and resilient semantic range, yielding a text mass. To be specific, we introduce a similarity-aware radius module to adapt the scale of the text mass upon the given text-video pairs. Plus, we design and develop a support text regularization to further control the text mass during the training. The inference pipeline is also tailored to fully exploit the text mass for accurate retrieval. Empirical evidence suggests that T-MASS not only effectively attracts relevant text-video pairs while distancing irrelevant ones, but also enables the determination of precise text embeddings for relevant pairs. Our experimental results show a substantial improvement of T-MASS over baseline (3% to 6.3% by R@1). Also, T-MASS achieves state-of-the-art performance on five benchmark datasets, including MSRVTT, LSMDC, DiDeMo, VATEX, and Charades. △ Less

Submitted 26 March, 2024; originally announced March 2024.

Comments: Accepted by CVPR 2024, code and model are available at https://github.com/Jiamian-Wang/T-MASS-text-video-retrieval

Fundamental limitations on the recoverability of quantum processes

Authors: Sohail, Vivek Pandey, Uttam Singh, Siddhartha Das

Abstract: Quantum information processing and computing tasks can be understood as quantum networks, comprising quantum states and channels and possible physical transformations on them. It is hence pertinent to estimate the change in informational content of quantum processes due to physical transformations they undergo. The physical transformations of quantum states are described by quantum channels, while… ▽ More Quantum information processing and computing tasks can be understood as quantum networks, comprising quantum states and channels and possible physical transformations on them. It is hence pertinent to estimate the change in informational content of quantum processes due to physical transformations they undergo. The physical transformations of quantum states are described by quantum channels, while the transformations of quantum channels are described by quantum superchannels. In this work, we determine fundamental limitations on how well can the physical transformation on quantum channels be undone or reversed, which are of crucial interest to design and benchmark quantum information and computation devices. In particular, we refine the quantum data processing inequality for quantum channels by strengthening the monotonicity inequality of quantum relative entropy of quantum channels under the action of an arbitrary quantum superchannel. We identify a class of quantum superchannels, which appears to be quantum superchannel analogue of quantum subunital channels, under the action of which the entropy of an arbitrary quantum channel is nondecreasing. △ Less

Submitted 19 March, 2024; originally announced March 2024.

Comments: 30+20 pages

Enhancement of Entanglement via Josephson Parametric Amplifier in a Dual Cavity-Magnon System

Authors: Abdelkader Hidki, Abderrahim Lakhfif, Mostafa Nassik, Rizwan Ahmed, Amjad Sohail

Abstract: In the two microwave (MW) cross-shaped cavity magnon system, we describe a method to produce multipartite entanglement and quantum steering. To achieve squeezed states of the magnons, a Josephson parametric amplifier (JPA) creates a squeezed vacuum field that drives the two cavities. We theoretically demonstrate that the cavity-cavity entanglement can be generated at the resonance point, however,… ▽ More In the two microwave (MW) cross-shaped cavity magnon system, we describe a method to produce multipartite entanglement and quantum steering. To achieve squeezed states of the magnons, a Josephson parametric amplifier (JPA) creates a squeezed vacuum field that drives the two cavities. We theoretically demonstrate that the cavity-cavity entanglement can be generated at the resonance point, however, increasing the cavity and magnon decay rates generate the cavity-magnon entanglement. By changing the squeezing parameter and increasing the decay rates, we can transfer the cavity-cavity entanglement to cavity-magnon entanglement. Furthermore, the cavity-cavity entanglement (survive up to 2.8K) not only found to be much stronger but also more robust as compared to cavity-magnon entanglement (survive up to 0.4K). More importantly, the genuine photon-magnon-photon tripartite entanglement could be achieved, which is robust against the thermal fluctuations and depends strongly on squeezing parameter. Furthermore, for current dual cavity-magnon system, two-way quantum steering is found when the optomagnonical couplings are equal. The current study offers a straightforward and practical method for achieving multipartite quantum correlations. △ Less

Submitted 25 February, 2024; originally announced February 2024.

Comments: 12 pages, 8 figures

CLIP** the Deception: Adapting Vision-Language Models for Universal Deepfake Detection

Authors: Sohail Ahmed Khan, Duc-Tien Dang-Nguyen

Abstract: The recent advancements in Generative Adversarial Networks (GANs) and the emergence of Diffusion models have significantly streamlined the production of highly realistic and widely accessible synthetic content. As a result, there is a pressing need for effective general purpose detection mechanisms to mitigate the potential risks posed by deepfakes. In this paper, we explore the effectiveness of p… ▽ More The recent advancements in Generative Adversarial Networks (GANs) and the emergence of Diffusion models have significantly streamlined the production of highly realistic and widely accessible synthetic content. As a result, there is a pressing need for effective general purpose detection mechanisms to mitigate the potential risks posed by deepfakes. In this paper, we explore the effectiveness of pre-trained vision-language models (VLMs) when paired with recent adaptation methods for universal deepfake detection. Following previous studies in this domain, we employ only a single dataset (ProGAN) in order to adapt CLIP for deepfake detection. However, in contrast to prior research, which rely solely on the visual part of CLIP while ignoring its textual component, our analysis reveals that retaining the text part is crucial. Consequently, the simple and lightweight Prompt Tuning based adaptation strategy that we employ outperforms the previous SOTA approach by 5.01% mAP and 6.61% accuracy while utilizing less than one third of the training data (200k images as compared to 720k). To assess the real-world applicability of our proposed models, we conduct a comprehensive evaluation across various scenarios. This involves rigorous testing on images sourced from 21 distinct datasets, including those generated by GANs-based, Diffusion-based and Commercial tools. △ Less

Submitted 20 February, 2024; originally announced February 2024.

A Multichain based marketplace Architecture

Authors: Muhammad Shoaib Farooq, Hamza Jamil, Hafiz Sohail Riaz

Abstract: ]A multichain non-fungible tokens (NFTs) marketplace is a decentralized platform where users can buy, sell, and trade NFTs across multiple blockchain networks by using cross communication bridge. In past most of NFT marketplace was based on singlechain in which NFTs have been bought, sold, and traded on a same blockchain network without the need for any external platform. The singlechain based mar… ▽ More ]A multichain non-fungible tokens (NFTs) marketplace is a decentralized platform where users can buy, sell, and trade NFTs across multiple blockchain networks by using cross communication bridge. In past most of NFT marketplace was based on singlechain in which NFTs have been bought, sold, and traded on a same blockchain network without the need for any external platform. The singlechain based marketplace have faced number of issues such as performance, scalability, flexibility and limited transaction throughput consequently long confirmation times and high transaction fees during high network usage. Firstly, this paper provides the comprehensive overview about NFT Multichain architecture and explore the challenges and opportunities of designing and implementation phase of multichain NFT marketplace to overcome the issue of single chain-based architecture. NFT multichain marketplace architecture includes different blockchain networks that communicate with each other. Secondly, this paper discusses the concept of mainchain interacting with sidechains which refers to multi blockchain architecture where multiple blockchain networks are connected to each other in a hierarchical structure and identifies key challenges related to interoperability, security, scalability, and user adoption. Finally, we proposed a novel architecture for a multichain NFT marketplace, which leverages the benefits of multiple blockchain networks and marketplaces to overcome these key challenges. Moreover, proposed architecture is evaluated through a case study, demonstrating its ability to support efficient and secure transactions across multiple blockchain networks and highlighting the future trends NFTs and marketplaces and comprehensive discussion about the technology. △ Less

Submitted 20 January, 2024; originally announced February 2024.

Comments: 15

Data-Driven Characterization of Latent Dynamics on Quantum Testbeds

Authors: Sohail Reddy, Stefanie Guenther, Yu** Cho

Abstract: This paper presents a data-driven approach to learn latent dynamics in superconducting quantum computing hardware. To this end, we augment the dynamical equation of quantum systems described by the Lindblad master equation with a parameterized source term that is trained from experimental data to capture unknown system dynamics, such as environmental interactions and system noise. We consider a st… ▽ More This paper presents a data-driven approach to learn latent dynamics in superconducting quantum computing hardware. To this end, we augment the dynamical equation of quantum systems described by the Lindblad master equation with a parameterized source term that is trained from experimental data to capture unknown system dynamics, such as environmental interactions and system noise. We consider a structure preserving augmentation that learns and distinguishes unitary from dissipative latent dynamics parameterized by a basis of linear operators, as well as an augmentation given by a nonlinear feed-forward neural network. Numerical results are presented using data from two different quantum processing units (QPU) at Lawrence Livermore National Laboratory's Quantum Device and Integration Testbed. We demonstrate that our interpretable, structure preserving, and nonlinear models are able to improve the prediction accuracy of the Lindblad master equation and accurately model the latent dynamics of the QPUs. △ Less

Submitted 1 February, 2024; v1 submitted 18 January, 2024; originally announced January 2024.

Report number: LLNL-JRNL-858483

Image Translation as Diffusion Visual Programmers

Authors: Cheng Han, James C. Liang, Qifan Wang, Majid Rabbani, Sohail Dianat, Raghuveer Rao, Ying Nian Wu, Dongfang Liu

Abstract: We introduce the novel Diffusion Visual Programmer (DVP), a neuro-symbolic image translation framework. Our proposed DVP seamlessly embeds a condition-flexible diffusion model within the GPT architecture, orchestrating a coherent sequence of visual programs (i.e., computer vision models) for various pro-symbolic steps, which span RoI identification, style transfer, and position manipulation, facil… ▽ More We introduce the novel Diffusion Visual Programmer (DVP), a neuro-symbolic image translation framework. Our proposed DVP seamlessly embeds a condition-flexible diffusion model within the GPT architecture, orchestrating a coherent sequence of visual programs (i.e., computer vision models) for various pro-symbolic steps, which span RoI identification, style transfer, and position manipulation, facilitating transparent and controllable image translation processes. Extensive experiments demonstrate DVP's remarkable performance, surpassing concurrent arts. This success can be attributed to several key features of DVP: First, DVP achieves condition-flexible translation via instance normalization, enabling the model to eliminate sensitivity caused by the manual guidance and optimally focus on textual descriptions for high-quality content generation. Second, the framework enhances in-context reasoning by deciphering intricate high-dimensional concepts in feature spaces into more accessible low-dimensional symbols (e.g., [Prompt], [RoI object]), allowing for localized, context-free editing while maintaining overall coherence. Last but not least, DVP improves systemic controllability and explainability by offering explicit symbolic representations at each programming stage, empowering users to intuitively interpret and modify results. Our research marks a substantial step towards harmonizing artificial image translation processes with cognitive intelligence, promising broader applications. △ Less

Submitted 30 January, 2024; v1 submitted 18 January, 2024; originally announced January 2024.

Comments: 25 pages, 20 figures

Interferometric Single-Shot Parity Measurement in an InAs-Al Hybrid Device

Authors: Morteza Aghaee, Alejandro Alcaraz Ramirez, Zulfi Alam, Rizwan Ali, Mariusz Andrzejczuk, Andrey Antipov, Mikhail Astafev, Amin Barzegar, Bela Bauer, Jonathan Becker, Umesh Kumar Bhaskar, Alex Bocharov, Srini Boddapati, David Bohn, Jouri Bommer, Leo Bourdet, Arnaud Bousquet, Samuel Boutin, Lucas Casparis, Benjamin James Chapman, Sohail Chatoor, Anna Wulff Christensen, Cassandra Chua, Patrick Codd, William Cole , et al. (137 additional authors not shown)

Abstract: The fusion of non-Abelian anyons or topological defects is a fundamental operation in measurement-only topological quantum computation. In topological superconductors, this operation amounts to a determination of the shared fermion parity of Majorana zero modes. As a step towards this, we implement a single-shot interferometric measurement of fermion parity in indium arsenide-aluminum heterostruct… ▽ More The fusion of non-Abelian anyons or topological defects is a fundamental operation in measurement-only topological quantum computation. In topological superconductors, this operation amounts to a determination of the shared fermion parity of Majorana zero modes. As a step towards this, we implement a single-shot interferometric measurement of fermion parity in indium arsenide-aluminum heterostructures with a gate-defined nanowire. The interferometer is formed by tunnel-coupling the proximitized nanowire to quantum dots. The nanowire causes a state-dependent shift of these quantum dots' quantum capacitance of up to 1 fF. Our quantum capacitance measurements show flux h/2e-periodic bimodality with a signal-to-noise ratio of 1 in 3.7 $μ$s at optimal flux values. From the time traces of the quantum capacitance measurements, we extract a dwell time in the two associated states that is longer than 1 ms at in-plane magnetic fields of approximately 2 T. These results are consistent with a measurement of the fermion parity encoded in a pair of Majorana zero modes that are separated by approximately 3 $μ$m and subjected to a low rate of poisoning by non-equilibrium quasiparticles. The large capacitance shift and long poisoning time enable a parity measurement error probability of 1%. △ Less

Submitted 2 April, 2024; v1 submitted 17 January, 2024; originally announced January 2024.

Comments: Added data on a second measurement of device A and a measurement of device B, expanded discussion of a trivial scenario. Refs added, author list updated

Observation of the Magnonic Dicke Superradiant Phase Transition

Authors: Dasom Kim, Sohail Dasgupta, Xiaoxuan Ma, Joong-Mok Park, Hao-Tian Wei, Liang Luo, Jacques Doumani, Xinwei Li, Wanting Yang, Di Cheng, Richard H. J. Kim, Henry O. Everitt, Shojiro Kimura, Hiroyuki Nojiri, Jigang Wang, Shixun Cao, Motoaki Bamba, Kaden R. A. Hazzard, Junichiro Kono

Abstract: Two-level atoms coupled with single-mode cavity photons are predicted to exhibit a quantum phase transition when the coupling strength exceeds a critical value, entering a phase in which atomic polarization and photonic field are finite even at zero temperature and without external driving. However, this phenomenon, the superradiant phase transition (SRPT), is forbidden by a no-go theorem due to t… ▽ More Two-level atoms coupled with single-mode cavity photons are predicted to exhibit a quantum phase transition when the coupling strength exceeds a critical value, entering a phase in which atomic polarization and photonic field are finite even at zero temperature and without external driving. However, this phenomenon, the superradiant phase transition (SRPT), is forbidden by a no-go theorem due to the existence of the diamagnetic term in the Hamiltonian. Here, we present spectroscopic evidence for a magnonic SRPT in ErFeO$_3$, where the role of the photonic mode (two-level atoms) in the photonic SRPT is played by an Fe$^{3+}$ magnon mode (Er$^{3+}$ spins). The absence of the diamagnetic term in the Fe$^{3+}$-Er$^{3+}$ exchange coupling ensures that the no-go theorem does not apply. Terahertz and gigahertz magnetospectroscopy experiments revealed the signatures of the SRPT -- a kink and a softening, respectively, of two spin-magnon hybridized modes at the critical point. △ Less

Submitted 3 January, 2024; originally announced January 2024.

A study of the magnetocaloric behavior of Dy-substituted YMn$_2$O$_5$ compounds

Authors: H. Chouaibi, S. Mansouri, S. Aitjmal, M. Balli, O. Chdil, M. Abbasi Eskandari, S. H. Bukhari, P. Fournier

Abstract: In this paper, we report on the magnetic and magnetocaloric features of Dy-substituted YMn$_2$O$_5$ (Y$_{1-x}$Dy$_x$Mn$_2$O$_5$) with $x=$ 0.6, 0.8, and 1 series elaborated by sol-gel method. X-ray diffraction and Raman measurements attest well the high quality of our polycrystalline samples that crystallize in an orthorhombic structure with the Pbam space group. The Raman phonon frequencies were… ▽ More In this paper, we report on the magnetic and magnetocaloric features of Dy-substituted YMn$_2$O$_5$ (Y$_{1-x}$Dy$_x$Mn$_2$O$_5$) with $x=$ 0.6, 0.8, and 1 series elaborated by sol-gel method. X-ray diffraction and Raman measurements attest well the high quality of our polycrystalline samples that crystallize in an orthorhombic structure with the Pbam space group. The Raman phonon frequencies were carried out and compared with the lattice dynamics calculations to identify the vibrational properties of all detected modes at room temperature. As expected, our magnetic study reveals that the magnetization was enhanced by the substitution of Y$^{3+}$ by Dy$^{3+}$. The Dy-substituted YMn$_2$O$_5$ sets the Néel transition [TN (Mn)] in the temperature range going from 40 to 45 K favoring the emergence of a transition at a very low temperature due to the long-range ordering of the Dy3+ magnetic moments below 13K [TN (Dy)]. Dual peaks in the magnetic entropy change curve are also observed being in good agreement with magnetization data, which enlarges the range of application of these materials. On the other hand, a large magnetocaloric effect is observed close to 13 K which is mainly due the ordering of Dy$^{3+}$ magnetic moments. Also, the incommensurate antiferromagnetic transition of Mn magnetic moment taking place around 40 K affects slightly the entropy change. Our refrigerant capacity (RC) findings are higher compared to the average of RC for a, b, c axis of single crystal samples as HoMn$_2$O$_5$ and TbMn$_2$O$_5$, which confirms that our polycrystalline materials stand for promising magnetic refrigerant candidates that can be invested in space technology, hydrogen and helium liquefaction at cryogenic temperature. △ Less

Submitted 2 January, 2024; originally announced January 2024.

Monogamy and tradeoff relations for wave-particle duality information

Authors: Shailja Kapoor, Sohail, Gautam Sharma, Arun K. Pati

Abstract: The notions of predictability and visibility are essential in the mathematical formulation of wave particle duality. The work of Jakob and Bergou [Phys. Rev. A 76, 052107] generalises these notions for higher-dimensional quantum systems, which were initially defined for qubits, and subsequently proves a complementarity relation between predictability and visibility. By defining the single-party in… ▽ More The notions of predictability and visibility are essential in the mathematical formulation of wave particle duality. The work of Jakob and Bergou [Phys. Rev. A 76, 052107] generalises these notions for higher-dimensional quantum systems, which were initially defined for qubits, and subsequently proves a complementarity relation between predictability and visibility. By defining the single-party information content of a quantum system as the addition of predictability and visibility, and assuming that entanglement in a bipartite system in the form of concurrence mutually excludes the single-party information, the authors have proposed a complementarity relation between the concurrence and the single-party information content. We show that the information content of a quantum system defined by Jakob and Bergou is nothing but the Hilbert-Schmidt distance between the state of the quantum system of our consideration and the maximally mixed state. Motivated by the fact that the trace distance is a good measure of distance as compared to the Hilbert-Schmidt distance from the information theoretic point of view, we, in this work, define the information content of a quantum system as the trace distance between the quantum state and the maximally mixed state. We then employ the quantum Pinsker's inequality and the reverse Pinsker's inequality to derive a new complementarity and a reverse complementarity relation between the single-party information content and the entanglement present in a bipartite quantum system in a pure state. As a consequence of our findings, we show that for a bipartite system in a pure state, its entanglement and the predictabilities and visibilities associated with the subsystems cannot be arbitrarily small as well as arbitrarily large. △ Less

Submitted 2 January, 2024; originally announced January 2024.

Comments: 9 pages, no figures

HENO-MAC: Hybrid Energy Harvesting-based Energy Neutral Operation MAC Protocol for Delay-Sensitive IoT Applications

Authors: Sohail Sarang, Goran M Stojanović, Micheal Drieberg, Varun Jeoti, Mikko Valkama

Abstract: The Internet of Things (IoT) technology uses small and cost-effective sensors for various applications, such as Industrial IoT. However, these sensor nodes are powered by fixed-size batteries, which creates a trade-off between network performance and long-term sustainability. Moreover, some applications require the network to provide a certain level of service, such as a lower delay for critical d… ▽ More The Internet of Things (IoT) technology uses small and cost-effective sensors for various applications, such as Industrial IoT. However, these sensor nodes are powered by fixed-size batteries, which creates a trade-off between network performance and long-term sustainability. Moreover, some applications require the network to provide a certain level of service, such as a lower delay for critical data, while ensuring the operational reliability of sensor nodes. To address this energy challenge, external energy harvesting sources, such as solar and wind, offer promising and eco-friendly solutions. However, the available energy from a single energy source is insufficient to meet these requirements. This drives the utilization of a hybrid energy harvesting approach, such as the integration of solar and wind energy harvesters, to increase the amount of harvested energy. Nevertheless, to fully utilize the available energy, which is dynamic in nature, the sensor node must adapt its operation to ensure sustainable operation and enhanced network performance. Therefore, this paper proposes a hybrid energy harvesting-based energy neutral operation (ENO) medium access control (MAC) protocol, called HENO-MAC, that allows the receiver node to harvest energy from the solar-wind harvesters and adapt its duty cycle accordingly. The performance of the proposed HENO-MAC was evaluated using the latest realistic solar and wind data for two consecutive days in GreenCastalia. The simulation results demonstrate that the duty cycle mechanism of HENO-MAC effectively utilizes the harvested energy to achieve ENO and uses the available energy resources efficiently to reduce the packet delay for all packets and the highest priority packet by up to 28.5% and 27.3%, respectively, when compared with other existing MAC protocols. △ Less

Submitted 1 January, 2024; originally announced January 2024.

Comments: This paper has been accepted for presentation at the IEEE Wireless Communications and Networking Conference (WCNC) 2024

Identifiability and Characterization of Transmon Qutrits Through Bayesian Experimental Design

Authors: Sohail Reddy

Abstract: Robust control of a quantum system is essential to utilize the current noisy quantum hardware to their full potential, such as quantum algorithms. To achieve such a goal, systematic search for an optimal control for any given experiment is essential. Design of optimal control pulses require accurate numerical models, and therefore, accurate characterization of the system parameters. We present an… ▽ More Robust control of a quantum system is essential to utilize the current noisy quantum hardware to their full potential, such as quantum algorithms. To achieve such a goal, systematic search for an optimal control for any given experiment is essential. Design of optimal control pulses require accurate numerical models, and therefore, accurate characterization of the system parameters. We present an online, Bayesian approach for quantum characterization of qutrit systems which automatically and systematically identifies the optimal experiments that provide maximum information on the system parameters, thereby greatly reducing the number of experiments that need to be performed on the quantum testbed. Unlike most characterization protocols that provide point-estimates of the parameters, the proposed approach is able to estimate their probability distribution. The applicability of the Bayesian experimental design technique was demonstrated on test problems where each experiment was defined by a parameterized control pulse. In addition to this, we also presented an approach for iterative pulse extension which is robust under uncertainties in transition frequencies and coherence times, and shot noise, despite being initialized with wide uninformative priors. Furthermore, we provide a mathematical proof of the theoretical identifiability of the model parameters and present conditions on the quantum state under which the parameters are identifiable. The proof and conditions for identifiability are presented for both closed and open quantum systems using the Schroedinger equation and the Lindblad master equation respectively. △ Less

Submitted 13 April, 2024; v1 submitted 15 December, 2023; originally announced December 2023.

Report number: LLNL-JRNL-858102

LayerCollapse: Adaptive compression of neural networks

Authors: Soheil Zibakhsh Shabgahi, Mohammad Sohail Shariff, Farinaz Koushanfar

Abstract: Handling the ever-increasing scale of contemporary deep learning and transformer-based models poses a significant challenge. Overparameterized Transformer networks outperform prior art in Natural Language processing and Computer Vision. These models contain hundreds of millions of parameters, demanding significant computational resources and making them prone to overfitting. In this work we presen… ▽ More Handling the ever-increasing scale of contemporary deep learning and transformer-based models poses a significant challenge. Overparameterized Transformer networks outperform prior art in Natural Language processing and Computer Vision. These models contain hundreds of millions of parameters, demanding significant computational resources and making them prone to overfitting. In this work we present LayerCollapse, a form of structured pruning to reduce the depth of fully connected layers. We develop a novel regularizer allowing for post-training compression without finetuning, while having limited impact on performance. LayerCollapse controls model expressiveness with regularization on the activations between fully connected layers, modulating the linearity of activation functions. A linear activation function reduces the rank of the transformation to the rank of the corresponding linear transformation. We demonstrate the effectiveness of LayerCollapse by showing its compression capabilities in sentimental analysis and image classification benchmarks. Moreover we show LayerCollapse is an effective compression aware regularization method in a language modeling benchmark. △ Less

Submitted 8 February, 2024; v1 submitted 28 November, 2023; originally announced November 2023.

Reconstruction of symmteric teleparallel gravity with energy conditions

Authors: Irfan Mahmood, Hira Sohail, Allah Ditta, S. H. Shekh, Anil Kumar Yadav

Abstract: This research investigates the impact of modified gravity on cosmic scales, focusing on $f(Q)$ cosmology. By applying energy conditions, the study reconstructs various $f(Q)$ models, considering an accelerating Universe, quintessence, and a cosmological constant $Λ$. Using up-to-date observational data, including the Supernova Pantheon sample and cosmic chronometer data, Hubble constants $H_0$ are… ▽ More This research investigates the impact of modified gravity on cosmic scales, focusing on $f(Q)$ cosmology. By applying energy conditions, the study reconstructs various $f(Q)$ models, considering an accelerating Universe, quintessence, and a cosmological constant $Λ$. Using up-to-date observational data, including the Supernova Pantheon sample and cosmic chronometer data, Hubble constants $H_0$ are estimated as $70.37^{+0.84}_{-0.92}$ km/sec/Mpc (from $H(z)$ data) and $70.02^{+0.44}_{-0.25}$ km/sec/Mpc (from pantheon compilation of SN Ia data). The matter energy density parameter ($Ω_{0m}$) is calculated as $0.26^{0.015}_{-0.010}$(OHD) and $0.27^{0.025}_{-0.014}$(SN Ia). Furthermore, as a function of redshift $z$, explicit expressions of $f(Q)$ and the EOS parameter $ω$ are produced, and their graphical analysis describes the late time acceleration of the Universe without the usage of dark energy. △ Less

Submitted 28 November, 2023; originally announced November 2023.

Comments: 11 pages, 7 Figures

GeoChat: Grounded Large Vision-Language Model for Remote Sensing

Authors: Kartik Kuckreja, Muhammad Sohail Danish, Muzammal Naseer, Abhijit Das, Salman Khan, Fahad Shahbaz Khan

Abstract: Recent advancements in Large Vision-Language Models (VLMs) have shown great promise in natural image domains, allowing users to hold a dialogue about given visual content. However, such general-domain VLMs perform poorly for Remote Sensing (RS) scenarios, leading to inaccurate or fabricated information when presented with RS domain-specific queries. Such a behavior emerges due to the unique challe… ▽ More Recent advancements in Large Vision-Language Models (VLMs) have shown great promise in natural image domains, allowing users to hold a dialogue about given visual content. However, such general-domain VLMs perform poorly for Remote Sensing (RS) scenarios, leading to inaccurate or fabricated information when presented with RS domain-specific queries. Such a behavior emerges due to the unique challenges introduced by RS imagery. For example, to handle high-resolution RS imagery with diverse scale changes across categories and many small objects, region-level reasoning is necessary alongside holistic scene interpretation. Furthermore, the lack of domain-specific multimodal instruction following data as well as strong backbone models for RS make it hard for the models to align their behavior with user queries. To address these limitations, we propose GeoChat - the first versatile remote sensing VLM that offers multitask conversational capabilities with high-resolution RS images. Specifically, GeoChat can not only answer image-level queries but also accepts region inputs to hold region-specific dialogue. Furthermore, it can visually ground objects in its responses by referring to their spatial coordinates. To address the lack of domain-specific datasets, we generate a novel RS multimodal instruction-following dataset by extending image-text pairs from existing diverse RS datasets. We establish a comprehensive benchmark for RS multitask conversations and compare with a number of baseline methods. GeoChat demonstrates robust zero-shot performance on various RS tasks, e.g., image and region captioning, visual question answering, scene classification, visually grounded conversations and referring detection. Our code is available at https://github.com/mbzuai-oryx/geochat. △ Less

Submitted 24 November, 2023; originally announced November 2023.

Comments: 10 pages, 4 figures

Koopman representations for positive definite functions

Authors: Sohail Farhangi

Abstract: We show that for any locally compact second countable group $G$ and any continuous positive definite function $φ:G\rightarrow\mathbb{C}$, there exists an ergodic measure preserving system $(X,\mathscr{B},μ,\{T_g\}_{g \in G})$ and a function $f \in L^2(X,μ)$ for which $φ(g) = \langle T_gf,f\rangle$. We also show that if $G$ is a countably infinite abelian group, then there exists a (not necessarily… ▽ More We show that for any locally compact second countable group $G$ and any continuous positive definite function $φ:G\rightarrow\mathbb{C}$, there exists an ergodic measure preserving system $(X,\mathscr{B},μ,\{T_g\}_{g \in G})$ and a function $f \in L^2(X,μ)$ for which $φ(g) = \langle T_gf,f\rangle$. We also show that if $G$ is a countably infinite abelian group, then there exists a (not necessarily ergodic) measure preserving system $(X,\mathscr{B},μ,\{T_g\}_{g \in G})$ and a function $f \in L^2(X,μ)$ with $|f| = φ(0)$ and $φ(g) = \langle T_gf,f\rangle$. △ Less

Submitted 30 October, 2023; originally announced October 2023.

Comments: 13 pages

MSC Class: 43A35

Online Multimedia Verification with Computational Tools and OSINT: Russia-Ukraine Conflict Case Studies

Authors: Sohail Ahmed Khan, Jan Gunnar Furuly, Henrik Brattli Vold, Rano Tahseen, Duc-Tien Dang-Nguyen

Abstract: This paper investigates the use of computational tools and Open-Source Intelligence (OSINT) techniques for verifying online multimedia content, with a specific focus on real-world cases from the Russia-Ukraine conflict. Over a nine-month period from April to December 2022, we examine verification workflows, tools, and case studies published by \faktiskbar. Our study showcases the effectiveness of… ▽ More This paper investigates the use of computational tools and Open-Source Intelligence (OSINT) techniques for verifying online multimedia content, with a specific focus on real-world cases from the Russia-Ukraine conflict. Over a nine-month period from April to December 2022, we examine verification workflows, tools, and case studies published by \faktiskbar. Our study showcases the effectiveness of diverse resources, including AI tools, geolocation tools, internet archives, and social media monitoring platforms, in enabling journalists and fact-checkers to efficiently process and corroborate evidence, ensuring the dissemination of accurate information. This research underscores the vital role of computational tools and OSINT techniques in promoting evidence-based reporting and combatting misinformation. We also touch on the current limitations of available tools and prospects for future developments in multimedia verification. △ Less

Submitted 3 October, 2023; originally announced October 2023.

Comments: 18 pages

Models of f(Q) gravity with electromagnetic field

Authors: S. H. Shekh, Hira Sohail, Irfan Mahmood, Allah Ditta, Anil Kumar Yadav

Abstract: There are so many ideas that potentially explain the dark energy phenomenon, current research is focusing on a more in-depth analysis of the potential effects of modified gravity on both local and cosmic scales. In this paper we have investigated some cosmic reconstructions in $f (Q)$ cosmology where $Q$ is the non-metricity corresponding to the evolution background in the Friedmann-Lamatre-Robert… ▽ More There are so many ideas that potentially explain the dark energy phenomenon, current research is focusing on a more in-depth analysis of the potential effects of modified gravity on both local and cosmic scales. In this paper we have investigated some cosmic reconstructions in $f (Q)$ cosmology where $Q$ is the non-metricity corresponding to the evolution background in the Friedmann-Lamatre-Robertson-Walker $(FLRW)$ universe. This allows us to determine how any $FLRW$ cosmology can emerge from a particular $f (Q)$ theory. We employ the reconstruction technique to generate explicit formulations of the $f (Q)$ Lagrangian for several types of matter sources like perfect fluid, dust like fluid, stiff fluid and the binary mixture of two fluids. Furthermore, we computed the field equations and equation of state (EoS) parameter $ω$ for two different reconstructed $f(Q)$ models with the variation of the involved constants, which gives the scenario of accelerating universe, quintessence region and cosmological constant. We also observed that the time dependence of $ω$ admits cosmic acceleration. These new $f(Q)$ gravity inspired models may have an impact on gravitational phenomena at other cosmological scales. △ Less

Submitted 31 August, 2023; originally announced September 2023.

Comments: pages-16, Figures-0,

DSLOT-NN: Digit-Serial Left-to-Right Neural Network Accelerator

Authors: Muhammad Sohail Ibrahim, Muhammad Usman, Malik Zohaib Nisar, Jeong-A Lee

Abstract: We propose a Digit-Serial Left-tO-righT (DSLOT) arithmetic based processing technique called DSLOT-NN with aim to accelerate inference of the convolution operation in the deep neural networks (DNNs). The proposed work has the ability to assess and terminate the ineffective convolutions which results in massive power and energy savings. The processing engine is comprised of low-latency most-signifi… ▽ More We propose a Digit-Serial Left-tO-righT (DSLOT) arithmetic based processing technique called DSLOT-NN with aim to accelerate inference of the convolution operation in the deep neural networks (DNNs). The proposed work has the ability to assess and terminate the ineffective convolutions which results in massive power and energy savings. The processing engine is comprised of low-latency most-significant-digit-first (MSDF) (also called online) multipliers and adders that processes data from left-to-right, allowing the execution of subsequent operations in digit-pipelined manner. Use of online operators eliminates the need for the development of complex mechanism of identifying the negative activation, as the output with highest weight value is generated first, and the sign of the result can be identified as soon as first non-zero digit is generated. The precision of the online operators can be tuned at run-time, making them extremely useful in situations where accuracy can be compromised for power and energy savings. The proposed design has been implemented on Xilinx Virtex-7 FPGA and is compared with state-of-the-art Stripes on various performance metrics. The results show the proposed design presents power savings, has shorter cycle time, and approximately 50% higher OPS per watt. △ Less

Submitted 21 September, 2023; v1 submitted 12 September, 2023; originally announced September 2023.

Comments: Presented at 2023 26th Euromicro Conference on Digital System Design (DSD)

Detecting Out-of-Context Image-Caption Pairs in News: A Counter-Intuitive Method

Authors: Eivind Moholdt, Sohail Ahmed Khan, Duc-Tien Dang-Nguyen

Abstract: The growth of misinformation and re-contextualized media in social media and news leads to an increasing need for fact-checking methods. Concurrently, the advancement in generative models makes cheapfakes and deepfakes both easier to make and harder to detect. In this paper, we present a novel approach using generative image models to our advantage for detecting Out-of-Context (OOC) use of images-… ▽ More The growth of misinformation and re-contextualized media in social media and news leads to an increasing need for fact-checking methods. Concurrently, the advancement in generative models makes cheapfakes and deepfakes both easier to make and harder to detect. In this paper, we present a novel approach using generative image models to our advantage for detecting Out-of-Context (OOC) use of images-caption pairs in news. We present two new datasets with a total of $6800$ images generated using two different generative models including (1) DALL-E 2, and (2) Stable-Diffusion. We are confident that the method proposed in this paper can further research on generative models in the field of cheapfake detection, and that the resulting datasets can be used to train and evaluate new models aimed at detecting cheapfakes. We run a preliminary qualitative and quantitative analysis to evaluate the performance of each image generation model for this task, and evaluate a handful of methods for computing image similarity. △ Less

Submitted 31 August, 2023; originally announced August 2023.

Comments: ACM International Conference on Content-Based Multimedia Indexing (CBMI '23)

Hydrogen jet diffusion modeling by using physics-informed graph neural network and sparsely-distributed sensor data

Authors: Xinqi Zhang, Jihao Shi, Junjie Li, Xinyan Huang, Fu Xiao, Qiliang Wang, Asif Sohail Usmani, Guoming Chen

Abstract: Efficient modeling of jet diffusion during accidental release is critical for operation and maintenance management of hydrogen facilities. Deep learning has proven effective for concentration prediction in gas jet diffusion scenarios. Nonetheless, its reliance on extensive simulations as training data and its potential disregard for physical laws limit its applicability to unseen accidental scenar… ▽ More Efficient modeling of jet diffusion during accidental release is critical for operation and maintenance management of hydrogen facilities. Deep learning has proven effective for concentration prediction in gas jet diffusion scenarios. Nonetheless, its reliance on extensive simulations as training data and its potential disregard for physical laws limit its applicability to unseen accidental scenarios. Recently, physics-informed neural networks (PINNs) have emerged to reconstruct spatial information by using data from sparsely-distributed sensors which are easily collected in real-world applications. However, prevailing approaches use the fully-connected neural network as the backbone without considering the spatial dependency of sensor data, which reduces the accuracy of concentration prediction. This study introduces the physics-informed graph deep learning approach (Physic_GNN) for efficient and accurate hydrogen jet diffusion prediction by using sparsely-distributed sensor data. Graph neural network (GNN) is used to model the spatial dependency of such sensor data by using graph nodes at which governing equations describing the physical law of hydrogen jet diffusion are immediately solved. The computed residuals are then applied to constrain the training process. Public experimental data of hydrogen jet is used to compare the accuracy and efficiency between our proposed approach Physic_GNN and state-of-the-art PINN. The results demonstrate our Physic_GNN exhibits higher accuracy and physical consistency of centerline concentration prediction given sparse concentration compared to PINN and more efficient compared to OpenFOAM. The proposed approach enables accurate and robust real-time spatial consequence reconstruction and underlying physical mechanisms analysis by using sparse sensor data. △ Less

Submitted 5 September, 2023; v1 submitted 24 August, 2023; originally announced August 2023.

Van der Corput's difference theorem for amenable groups and the left regular representation

Authors: Sohail Farhangi

Abstract: We establish a connection between two variants of van der Corput's Difference Theorem (vdCDT) for second countable amenable groups $G$ and the ergodic hierarchy of mixing properties of a unitary representation $U$ of $G$. In particular, we show that one variant of vdCDT corresponds to subrepresentations of the left regular representation, and another variant of vdCDT corresponds to the absence of… ▽ More We establish a connection between two variants of van der Corput's Difference Theorem (vdCDT) for second countable amenable groups $G$ and the ergodic hierarchy of mixing properties of a unitary representation $U$ of $G$. In particular, we show that one variant of vdCDT corresponds to subrepresentations of the left regular representation, and another variant of vdCDT corresponds to the absence of finite dimensional subrepresentations. We then obtain applications for measure preserving actions of countable abelian groups. △ Less

Submitted 10 August, 2023; originally announced August 2023.

Comments: 24 pages

MSC Class: 22D40; 37A30; 22D10; 37A46; 37A25

Deepfake Detection: A Comparative Analysis

Authors: Sohail Ahmed Khan, Duc-Tien Dang-Nguyen

Abstract: This paper present a comprehensive comparative analysis of supervised and self-supervised models for deepfake detection. We evaluate eight supervised deep learning architectures and two transformer-based models pre-trained using self-supervised strategies (DINO, CLIP) on four benchmarks (FakeAVCeleb, CelebDF-V2, DFDC, and FaceForensics++). Our analysis includes intra-dataset and inter-dataset eval… ▽ More This paper present a comprehensive comparative analysis of supervised and self-supervised models for deepfake detection. We evaluate eight supervised deep learning architectures and two transformer-based models pre-trained using self-supervised strategies (DINO, CLIP) on four benchmarks (FakeAVCeleb, CelebDF-V2, DFDC, and FaceForensics++). Our analysis includes intra-dataset and inter-dataset evaluations, examining the best performing models, generalisation capabilities, and impact of augmentations. We also investigate the trade-off between model size and performance. Our main goal is to provide insights into the effectiveness of different deep learning architectures (transformers, CNNs), training strategies (supervised, self-supervised), and deepfake detection benchmarks. These insights can help guide the development of more accurate and reliable deepfake detection systems, which are crucial in mitigating the harmful impact of deepfakes on individuals and society. △ Less

Submitted 7 August, 2023; originally announced August 2023.

Finite-Temperature Quantum Matter with Rydberg or Molecule Synthetic Dimensions

Authors: Sohail Dasgupta, Chunhan Feng, Bryce Gadway, Richard T. Scalettar, Kaden R. A. Hazzard

Abstract: Synthetic dimension platforms offer unique pathways for engineering quantum matter. We compute the phase diagram of a many-body system of ultracold atoms (or polar molecules) with a set of Rydberg states (or rotational states) as a synthetic dimension, where the particles are arranged in real space in optical microtrap arrays and interact via dipole-dipole exchange interaction. Using mean-field th… ▽ More Synthetic dimension platforms offer unique pathways for engineering quantum matter. We compute the phase diagram of a many-body system of ultracold atoms (or polar molecules) with a set of Rydberg states (or rotational states) as a synthetic dimension, where the particles are arranged in real space in optical microtrap arrays and interact via dipole-dipole exchange interaction. Using mean-field theory, we find three ordered phases - two are localized in the synthetic dimension, predicted as zero-temperature ground states in Refs. [Sci. Rep., 8, 1 (2018) and Phys. Rev. A 99, 013624 (2019)], and a delocalized phase. We characterize them by identifying the spontaneously broken discrete symmetries of the Hamiltonian. We also compute the phase diagram as a function of temperature and interaction strength, for both signs of the interaction. For system sizes with more than six synthetic sites and attractive interactions, we find that the thermal phase transitions can be first or second order, which leads to a tri-critical point on the phase boundary. By examining the dependence of the tri-critical point and other special points of the phase boundary on the synthetic dimension size, we shed light on the physics for thermodynamically large synthetic dimension. △ Less

Submitted 30 July, 2023; originally announced July 2023.

Comments: 9 pages, 3 figures

Decoding ChatGPT: A Taxonomy of Existing Research, Current Challenges, and Possible Future Directions

Authors: Shahab Saquib Sohail, Faiza Farhat, Yassine Himeur, Mohammad Nadeem, Dag Øivind Madsen, Yashbir Singh, Shadi Atalla, Wathiq Mansoor

Abstract: Chat Generative Pre-trained Transformer (ChatGPT) has gained significant interest and attention since its launch in November 2022. It has shown impressive performance in various domains, including passing exams and creative writing. However, challenges and concerns related to biases and trust persist. In this work, we present a comprehensive review of over 100 Scopus-indexed publications on ChatGP… ▽ More Chat Generative Pre-trained Transformer (ChatGPT) has gained significant interest and attention since its launch in November 2022. It has shown impressive performance in various domains, including passing exams and creative writing. However, challenges and concerns related to biases and trust persist. In this work, we present a comprehensive review of over 100 Scopus-indexed publications on ChatGPT, aiming to provide a taxonomy of ChatGPT research and explore its applications. We critically analyze the existing literature, identifying common approaches employed in the studies. Additionally, we investigate diverse application areas where ChatGPT has found utility, such as healthcare, marketing and financial services, software engineering, academic and scientific writing, research and education, environmental science, and natural language processing. Through examining these applications, we gain valuable insights into the potential of ChatGPT in addressing real-world challenges. We also discuss crucial issues related to ChatGPT, including biases and trustworthiness, emphasizing the need for further research and development in these areas. Furthermore, we identify potential future directions for ChatGPT research, proposing solutions to current challenges and speculating on expected advancements. By fully leveraging the capabilities of ChatGPT, we can unlock its potential across various domains, leading to advancements in conversational AI and transformative impacts in society. △ Less

Submitted 25 August, 2023; v1 submitted 26 July, 2023; originally announced July 2023.

Comments: 31 pages. 8 figures and 3 tables

Journal ref: Journal of King Saud University - Computer and Information Science 2023

Quantum Painlevé II Lax Pair and Quantum (Matrix) Analogues of Classical Painlevé II equation

Authors: Muhammad Waseem, Irfan Mahmood, Hira Sohail

Abstract: In this article, we present a new quantum Painlevé II Lax pair which explicitly involves the Planck constant $ \hbar $ and an arbitrary field variable $v$ so these two objects make this new pair different from Flaschka-Newell Painlevé II Lax pair and that pair appears as particular case of our's pair which consolidates the Painlevé II equation from quantum mechanical point of view. It is shown tha… ▽ More In this article, we present a new quantum Painlevé II Lax pair which explicitly involves the Planck constant $ \hbar $ and an arbitrary field variable $v$ so these two objects make this new pair different from Flaschka-Newell Painlevé II Lax pair and that pair appears as particular case of our's pair which consolidates the Painlevé II equation from quantum mechanical point of view. It is shown that the compatibility of quantum Painlevé II Lax pair simultaneously yields a quantum Painlevé II equation and a quantum commutation relation between field variable $v $ and independent variable $z$. We manifest that with the different choices of arbitrary field variable system reduces to its classical version, matrix Painlevé II equation and derivative matrix Painlevé II equation. Further, we construct the gauge equivalence of quantum Painlevé II Lax pair whose compatibility condition gives rise to quantum p34 equation that involves $\hbar $ with power $+1$ which makes our system more quantized as compared to the existed one that carries $\hbar $ with power $+2$. △ Less

Submitted 15 August, 2023; v1 submitted 26 July, 2023; originally announced July 2023.

Distant entanglement via photon hop** in a coupled magnomechanical system

Authors: Amjad Sohail, Jia-Xin Peng, Abdelkader Hidki, S. K. Singh

Abstract: We theoretically propose a scheme to generate distant bipartite entanglement between various subsystems in coupled magnomechanical systems where both the microwave cavities are coupled through single photon hop** parameter. Each cavity also contains a magnon mode and phonon mode and this gives five excitation modes in our model Hamiltonian which are cavity-1 photons, cavity-2 photons, magnon, an… ▽ More We theoretically propose a scheme to generate distant bipartite entanglement between various subsystems in coupled magnomechanical systems where both the microwave cavities are coupled through single photon hop** parameter. Each cavity also contains a magnon mode and phonon mode and this gives five excitation modes in our model Hamiltonian which are cavity-1 photons, cavity-2 photons, magnon, and phonon modes in both YIG spheres. We found that significant bipartite entanglement exists between indirectly coupled subsystems in coupled microwave cavities for an appropriate set of parameters regime. Moreover, we also obtain suitable cavity and magnon detuning parameters for a significant distant bipartite entanglement in different bipartitions. In addition, it can be seen that a single photon hop** parameter significantly affects both the degree as well as the transfer of quantum entanglement between various bipartitions. Hence, our present study related to coupled microwave cavity magnomechanical configuration will open new perspectives in coherent control of various quantum correlations including quantum state transfer among macroscopic quantum systems △ Less

Submitted 18 July, 2023; originally announced July 2023.

Engineering Optical and Mirror Bi-stability Mechanically

Authors: Sohail Ahmed, Asma Javaid, Hui **g, Farhan Saif

Abstract: We explain optical and mirrors displacement bistability in a hybrid optomechanical system in the presence of a strong laser driving field and a weak probe field. External modulating fields are applied selectively on movable mirrors. We show that the optomechanical coupling, electromechanical Coulomb coupling and, amplitude & phase of external modulating fields are important parameters to control t… ▽ More We explain optical and mirrors displacement bistability in a hybrid optomechanical system in the presence of a strong laser driving field and a weak probe field. External modulating fields are applied selectively on movable mirrors. We show that the optomechanical coupling, electromechanical Coulomb coupling and, amplitude & phase of external modulating fields are important parameters to control the optical and mirror displacement bistable behaviour. The parameters values are taken according to presently available experiments. The study may be applied to the realization of a tunable electro opto mechanical switch depending on the optomechanical and Coulomb coupling, frequencies, threshold power, and the amplitude and phase of external mechanical pumps. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Filter Bubbles in Recommender Systems: Fact or Fallacy -- A Systematic Review

Authors: Qazi Mohammad Areeb, Mohammad Nadeem, Shahab Saquib Sohail, Raza Imam, Faiyaz Doctor, Yassine Himeur, Amir Hussain, Abbes Amira

Abstract: A filter bubble refers to the phenomenon where Internet customization effectively isolates individuals from diverse opinions or materials, resulting in their exposure to only a select set of content. This can lead to the reinforcement of existing attitudes, beliefs, or conditions. In this study, our primary focus is to investigate the impact of filter bubbles in recommender systems. This pioneerin… ▽ More A filter bubble refers to the phenomenon where Internet customization effectively isolates individuals from diverse opinions or materials, resulting in their exposure to only a select set of content. This can lead to the reinforcement of existing attitudes, beliefs, or conditions. In this study, our primary focus is to investigate the impact of filter bubbles in recommender systems. This pioneering research aims to uncover the reasons behind this problem, explore potential solutions, and propose an integrated tool to help users avoid filter bubbles in recommender systems. To achieve this objective, we conduct a systematic literature review on the topic of filter bubbles in recommender systems. The reviewed articles are carefully analyzed and classified, providing valuable insights that inform the development of an integrated approach. Notably, our review reveals evidence of filter bubbles in recommendation systems, highlighting several biases that contribute to their existence. Moreover, we propose mechanisms to mitigate the impact of filter bubbles and demonstrate that incorporating diversity into recommendations can potentially help alleviate this issue. The findings of this timely review will serve as a benchmark for researchers working in interdisciplinary fields such as privacy, artificial intelligence ethics, and recommendation systems. Furthermore, it will open new avenues for future research in related domains, prompting further exploration and advancement in this critical area. △ Less

Submitted 2 July, 2023; originally announced July 2023.

Comments: 21 pages, 10 figures and 5 tables

Duality between quantum channels and super-channels is basis-dependent

Authors: Sohail, Sahil, Ritabrata Sengupta, Ujjwal Sen

Abstract: The complete positivity vs positivity correspondence in the Choi-Jamiołkowski-Kraus-Sudarshan quantum channel-state isomorphism depends on the choice of basis. Instead of the "canonical" basis, if we use, e.g., the Pauli spin matrices along with the identity as the basis for the space of bounded operators on the two-dimensional complex Hilbert space, this correspondence breaks down. A sufficient c… ▽ More The complete positivity vs positivity correspondence in the Choi-Jamiołkowski-Kraus-Sudarshan quantum channel-state isomorphism depends on the choice of basis. Instead of the "canonical" basis, if we use, e.g., the Pauli spin matrices along with the identity as the basis for the space of bounded operators on the two-dimensional complex Hilbert space, this correspondence breaks down. A sufficient condition on the basis for validity of this correspondence is provided in the work of Paulsen and Shult~\cite{Paulsen}, which was later proven to be necessary by Kye~\cite{Kye}. A correspondence is also present between the space of super-maps and the tensor product of the spaces of the inputs and outputs of the same. In particular, a super-map is completely CP-preserving if and only if its Choi-type representation is completely positive (CP). This correspondence also depends on a specific choice of basis. In this work, we find the necessary and sufficient condition on a basis such that this correspondence holds true. △ Less

Submitted 23 August, 2023; v1 submitted 28 June, 2023; originally announced June 2023.

Comments: 17 pages, two new examples added

Equation of State and Thermometry of the 2D SU($N$) Fermi-Hubbard Model

Authors: Giulio Pasqualetti, Oscar Bettermann, Nelson Darkwah Oppong, Eduardo Ibarra-García-Padilla, Sohail Dasgupta, Richard T. Scalettar, Kaden R. A. Hazzard, Immanuel Bloch, Simon Fölling

Abstract: We characterize the equation of state (EoS) of the SU($N>2$) Fermi-Hubbard Model (FHM) in a two-dimensional single-layer square optical lattice. We probe the density and the site occupation probabilities as functions of interaction strength and temperature for $N = 3, 4$ and 6. Our measurements are used as a benchmark for state-of-the-art numerical methods including determinantal quantum Monte Car… ▽ More We characterize the equation of state (EoS) of the SU($N>2$) Fermi-Hubbard Model (FHM) in a two-dimensional single-layer square optical lattice. We probe the density and the site occupation probabilities as functions of interaction strength and temperature for $N = 3, 4$ and 6. Our measurements are used as a benchmark for state-of-the-art numerical methods including determinantal quantum Monte Carlo (DQMC) and numerical linked cluster expansion (NLCE). By probing the density fluctuations, we compare temperatures determined in a model-independent way by fitting measurements to numerically calculated EoS results, making this a particularly interesting new step in the exploration and characterization of the SU($N$) FHM. △ Less

Submitted 30 May, 2023; originally announced May 2023.

Comments: 8 pages, 3 figures; Supplemental Material

Journal ref: Phys. Rev. Lett. 132, 083401 (2024)

A survey of the Vision Transformers and its CNN-Transformer based Variants

Authors: Asifullah Khan, Zunaira Rauf, Anabia Sohail, Abdul Rehman, Hifsa Asif, Aqsa Asif, Umair Farooq

Abstract: Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationships in images, offer large learning capacity. However, they may suffer from limited generalization as they do not tend to model local correlation in images. Recently, in vision tra… ▽ More Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationships in images, offer large learning capacity. However, they may suffer from limited generalization as they do not tend to model local correlation in images. Recently, in vision transformers hybridization of both the convolution operation and self-attention mechanism has emerged, to exploit both the local and global image representations. These hybrid vision transformers, also referred to as CNN-Transformer architectures, have demonstrated remarkable results in vision applications. Given the rapidly growing number of hybrid vision transformers, it has become necessary to provide a taxonomy and explanation of these hybrid architectures. This survey presents a taxonomy of the recent vision transformer architectures and more specifically that of the hybrid vision transformers. Additionally, the key features of these architectures such as the attention mechanisms, positional embeddings, multi-scale processing, and convolution are also discussed. In contrast to the previous survey papers that are primarily focused on individual vision transformer architectures or CNNs, this survey uniquely emphasizes the emerging trend of hybrid vision transformers. By showcasing the potential of hybrid vision transformers to deliver exceptional performance across a range of computer vision tasks, this survey sheds light on the future directions of this rapidly evolving architecture. △ Less

Submitted 8 August, 2023; v1 submitted 16 May, 2023; originally announced May 2023.

Comments: Pages: 58, Figures: 14

Journal ref: Artificial Intelligence Review (2023): 1-54

Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clients

Authors: Victoria Huang, Shaleeza Sohail, Michael Mayo, Tania Lorido Botran, Mark Rodrigues, Chris Anderson, Melanie Ooi

Abstract: Federated learning (FL), as an emerging artificial intelligence (AI) approach, enables decentralized model training across multiple devices without exposing their local training data. FL has been increasingly gaining popularity in both academia and industry. While research works have been proposed to improve the fault tolerance of FL, the real impact of unreliable devices (e.g., drop** out, misc… ▽ More Federated learning (FL), as an emerging artificial intelligence (AI) approach, enables decentralized model training across multiple devices without exposing their local training data. FL has been increasingly gaining popularity in both academia and industry. While research works have been proposed to improve the fault tolerance of FL, the real impact of unreliable devices (e.g., drop** out, misconfiguration, poor data quality) in real-world applications is not fully investigated. We carefully chose two representative, real-world classification problems with a limited numbers of clients to better analyze FL fault tolerance. Contrary to the intuition, simple FL algorithms can perform surprisingly well in the presence of unreliable clients. △ Less

Submitted 16 May, 2023; originally announced May 2023.

CB-HVTNet: A channel-boosted hybrid vision transformer network for lymphocyte assessment in histopathological images

Authors: Momina Liaqat Ali, Zunaira Rauf, Asifullah Khan, Anabia Sohail, Rafi Ullah, Jeonghwan Gwak

Abstract: Transformers, due to their ability to learn long range dependencies, have overcome the shortcomings of convolutional neural networks (CNNs) for global perspective learning. Therefore, they have gained the focus of researchers for several vision related tasks including medical diagnosis. However, their multi-head attention module only captures global level feature representations, which is insuffic… ▽ More Transformers, due to their ability to learn long range dependencies, have overcome the shortcomings of convolutional neural networks (CNNs) for global perspective learning. Therefore, they have gained the focus of researchers for several vision related tasks including medical diagnosis. However, their multi-head attention module only captures global level feature representations, which is insufficient for medical images. To address this issue, we propose a Channel Boosted Hybrid Vision Transformer (CB HVT) that uses transfer learning to generate boosted channels and employs both transformers and CNNs to analyse lymphocytes in histopathological images. The proposed CB HVT comprises five modules, including a channel generation module, channel exploitation module, channel merging module, region-aware module, and a detection and segmentation head, which work together to effectively identify lymphocytes. The channel generation module uses the idea of channel boosting through transfer learning to extract diverse channels from different auxiliary learners. In the CB HVT, these boosted channels are first concatenated and ranked using an attention mechanism in the channel exploitation module. A fusion block is then utilized in the channel merging module for a gradual and systematic merging of the diverse boosted channels to improve the network's learning representations. The CB HVT also employs a proposal network in its region aware module and a head to effectively identify objects, even in overlap** regions and with artifacts. We evaluated the proposed CB HVT on two publicly available datasets for lymphocyte assessment in histopathological images. The results show that CB HVT outperformed other state of the art detection models, and has good generalization ability, demonstrating its value as a tool for pathologists. △ Less

Submitted 19 July, 2023; v1 submitted 16 May, 2023; originally announced May 2023.

Comments: IEEE Access (2023)

Coronal Heating as Determined by the Solar Flare Frequency Distribution Obtained by Aggregating Case Studies

Authors: James Paul Mason, Alexandra Werth, Colin G. West, Allison A. Youngblood, Donald L. Woodraska, Courtney Peck, Kevin Lacjak, Florian G. Frick, Moutamen Gabir, Reema A. Alsinan, Thomas Jacobsen, Mohammad Alrubaie, Kayla M. Chizmar, Benjamin P. Lau, Lizbeth Montoya Dominguez, David Price, Dylan R. Butler, Connor J. Biron, Nikita Feoktistov, Kai Dewey, N. E. Loomis, Michal Bodzianowski, Connor Kuybus, Henry Dietrick, Aubrey M. Wolfe , et al. (977 additional authors not shown)

Abstract: Flare frequency distributions represent a key approach to addressing one of the largest problems in solar and stellar physics: determining the mechanism that counter-intuitively heats coronae to temperatures that are orders of magnitude hotter than the corresponding photospheres. It is widely accepted that the magnetic field is responsible for the heating, but there are two competing mechanisms th… ▽ More Flare frequency distributions represent a key approach to addressing one of the largest problems in solar and stellar physics: determining the mechanism that counter-intuitively heats coronae to temperatures that are orders of magnitude hotter than the corresponding photospheres. It is widely accepted that the magnetic field is responsible for the heating, but there are two competing mechanisms that could explain it: nanoflares or Alfvén waves. To date, neither can be directly observed. Nanoflares are, by definition, extremely small, but their aggregate energy release could represent a substantial heating mechanism, presuming they are sufficiently abundant. One way to test this presumption is via the flare frequency distribution, which describes how often flares of various energies occur. If the slope of the power law fitting the flare frequency distribution is above a critical threshold, $α=2$ as established in prior literature, then there should be a sufficient abundance of nanoflares to explain coronal heating. We performed $>$600 case studies of solar flares, made possible by an unprecedented number of data analysts via three semesters of an undergraduate physics laboratory course. This allowed us to include two crucial, but nontrivial, analysis methods: pre-flare baseline subtraction and computation of the flare energy, which requires determining flare start and stop times. We aggregated the results of these analyses into a statistical study to determine that $α= 1.63 \pm 0.03$. This is below the critical threshold, suggesting that Alfvén waves are an important driver of coronal heating. △ Less

Submitted 9 May, 2023; originally announced May 2023.

Comments: 1,002 authors, 14 pages, 4 figures, 3 tables, published by The Astrophysical Journal on 2023-05-09, volume 948, page 71

Analyzing the Knock-on Impacts of 2022 Floods on Rabi 2023 Using Remote Sensing and Field Surveys

Authors: Mohammad Sohail, Usman Nazir, Jawairia Ahmad, Abubakr Muhammad, Murtaza Taj, Ritvik Sahajpal

Abstract: While the world's attention is focused on immediate relief and rescue operations for the affectees of the current floods in Pakistan, knock-on effects are expected to play further havoc with the country's economy and food security in the coming months. Significant crop yield losses had already occurred for Winter (Rabi) 2021-22 due to a heatwave earlier in the year and estimates for the Summer (Kh… ▽ More While the world's attention is focused on immediate relief and rescue operations for the affectees of the current floods in Pakistan, knock-on effects are expected to play further havoc with the country's economy and food security in the coming months. Significant crop yield losses had already occurred for Winter (Rabi) 2021-22 due to a heatwave earlier in the year and estimates for the Summer (Kharif) 2022 crop damage due to flood inundation have already been determined to be very high. With the next sowing season already upon the flood affectees, there is a big question mark over the resumption of agricultural activity in disaster-struck districts. This study is aimed at analyzing the range of influences of the 2022 floods on the upcoming winter (Rabi) crop. Satellite-based remote sensing data, state-of-the-art Earth system models, and field observations will be leveraged to estimate the impacts of the flood on the resumption of agricultural activity in the most impacted districts of Southern Punjab, Sindh, and Baluchistan. The field surveys are conducted during multiple visits to the study area to maximize the monitoring of on-ground conditions and provide a larger validation dataset for the satellite-based inundation and crop classification maps. The project leverages on the expertise and previous experiences of the LUMS team in performing satellite-based land/crop classification, estimation of soil moisture levels for irrigation activity, and determining changes in land-use patterns for detecting key agricultural activities. Delays in the sowing of the winter crop and its effects on crop-yield were analyzed through this study. △ Less

Submitted 17 May, 2023; v1 submitted 21 March, 2023; originally announced April 2023.

Comments: The paper writing and analysis need further work. I believe it has not reached a sufficiently developed state to be disseminated among the global community

Journal ref: International Conference on Integrated Flood Management under Changing Climate Scenario (IFMCC), 2023

Grand Challenge On Detecting Cheapfakes

Authors: Duc-Tien Dang-Nguyen, Sohail Ahmed Khan, Cise Midoglu, Michael Riegler, Pål Halvorsen, Minh-Son Dao

Abstract: Cheapfake is a recently coined term that encompasses non-AI ("cheap") manipulations of multimedia content. Cheapfakes are known to be more prevalent than deepfakes. Cheapfake media can be created using editing software for image/video manipulations, or even without using any software, by simply altering the context of an image/video by sharing the media alongside misleading claims. This alteration… ▽ More Cheapfake is a recently coined term that encompasses non-AI ("cheap") manipulations of multimedia content. Cheapfakes are known to be more prevalent than deepfakes. Cheapfake media can be created using editing software for image/video manipulations, or even without using any software, by simply altering the context of an image/video by sharing the media alongside misleading claims. This alteration of context is referred to as out-of-context (OOC) misuse of media. OOC media is much harder to detect than fake media, since the images and videos are not tampered. In this challenge, we focus on detecting OOC images, and more specifically the misuse of real photographs with conflicting image captions in news items. The aim of this challenge is to develop and benchmark models that can be used to detect whether given samples (news image and associated captions) are OOC, based on the recently compiled COSMOS dataset. △ Less

Submitted 3 April, 2023; originally announced April 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2207.14534

Controllable Fano-type optical response and four-wave mixing via magnetoelastic coupling in a opto-magnomechanical system

Authors: Amjad Sohail, Rizwan Ahmed, Jia-Xin Peng, Aamir Shahzad, Tariq Munir, S. K. Singh, Marcos Cesar de Oliveira

Abstract: We analytically investigate the Fano-type optical response and four-wave mixing (FWM) process by exploiting the magnetoelasticity of a ferromagnetic material. The deformation of the ferromagnetic material plays the role of mechanical displacement, which is simultaneously coupled to both optical and magnon modes. We report that the magnetostrictively induced displacement demonstrates Fano profiles,… ▽ More We analytically investigate the Fano-type optical response and four-wave mixing (FWM) process by exploiting the magnetoelasticity of a ferromagnetic material. The deformation of the ferromagnetic material plays the role of mechanical displacement, which is simultaneously coupled to both optical and magnon modes. We report that the magnetostrictively induced displacement demonstrates Fano profiles, in the output field, which is well-tuned by adjusting the system parameters, like effective magnomechanical coupling, magnon detuning, and cavity detuning. It is found that the magnetoelastic interaction also gives rise to the FWM phenomenon. The number of the FWM signals mainly depends upon the effective magnomechanical coupling and the magnon detuning. Moreover, the FWM spectrum exhibits suppressive behavior upon increasing (decreasing) the magnon (cavity) decay rate. The present scheme will open new perspectives in highly sensitive detection and quantum information processing. △ Less

Submitted 1 April, 2023; originally announced April 2023.

Comments: 12 pages, 7 figures