Showing 1–50 of 179 results for author: Hussain, M

YOLOv5, YOLOv8 and YOLOv10: The Go-To Detectors for Real-time Vision

Authors: Muhammad Hussain

Abstract: This paper presents a comprehensive review of the evolution of the YOLO (You Only Look Once) object detection algorithm, focusing on YOLOv5, YOLOv8, and YOLOv10. We analyze the architectural advancements, performance improvements, and suitability for edge deployment across these versions. YOLOv5 introduced significant innovations such as the CSPDarknet backbone and Mosaic Augmentation, balancing s… ▽ More This paper presents a comprehensive review of the evolution of the YOLO (You Only Look Once) object detection algorithm, focusing on YOLOv5, YOLOv8, and YOLOv10. We analyze the architectural advancements, performance improvements, and suitability for edge deployment across these versions. YOLOv5 introduced significant innovations such as the CSPDarknet backbone and Mosaic Augmentation, balancing speed and accuracy. YOLOv8 built upon this foundation with enhanced feature extraction and anchor-free detection, improving versatility and performance. YOLOv10 represents a leap forward with NMS-free training, spatial-channel decoupled downsampling, and large-kernel convolutions, achieving state-of-the-art performance with reduced computational overhead. Our findings highlight the progressive enhancements in accuracy, efficiency, and real-time performance, particularly emphasizing their applicability in resource-constrained environments. This review provides insights into the trade-offs between model complexity and detection accuracy, offering guidance for selecting the most appropriate YOLO version for specific edge computing applications. △ Less

Submitted 3 July, 2024; originally announced July 2024.

YOLOv1 to YOLOv10: A comprehensive review of YOLO variants and their application in the agricultural domain

Authors: Mujadded Al Rabbani Alif, Muhammad Hussain

Abstract: This survey investigates the transformative potential of various YOLO variants, from YOLOv1 to the state-of-the-art YOLOv10, in the context of agricultural advancements. The primary objective is to elucidate how these cutting-edge object detection models can re-energise and optimize diverse aspects of agriculture, ranging from crop monitoring to livestock management. It aims to achieve key objecti… ▽ More This survey investigates the transformative potential of various YOLO variants, from YOLOv1 to the state-of-the-art YOLOv10, in the context of agricultural advancements. The primary objective is to elucidate how these cutting-edge object detection models can re-energise and optimize diverse aspects of agriculture, ranging from crop monitoring to livestock management. It aims to achieve key objectives, including the identification of contemporary challenges in agriculture, a detailed assessment of YOLO's incremental advancements, and an exploration of its specific applications in agriculture. This is one of the first surveys to include the latest YOLOv10, offering a fresh perspective on its implications for precision farming and sustainable agricultural practices in the era of Artificial Intelligence and automation. Further, the survey undertakes a critical analysis of YOLO's performance, synthesizes existing research, and projects future trends. By scrutinizing the unique capabilities packed in YOLO variants and their real-world applications, this survey provides valuable insights into the evolving relationship between YOLO variants and agriculture. The findings contribute towards a nuanced understanding of the potential for precision farming and sustainable agricultural practices, marking a significant step forward in the integration of advanced object detection technologies within the agricultural sector. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Comments: 31 pages

Initial measurement of reactor antineutrino oscillation at SNO+

Authors: SNO+ Collaboration, :, A. Allega, M. R. Anderson, S. Andringa, M. Askins, D. J. Auty, A. Bacon, J. Baker, F. Barão, N. Barros, R. Bayes, E. W. Beier, T. S. Bezerra, A. Bialek, S. D. Biller, E. Blucher, E. Caden, E. J. Callaghan, M. Chen, S. Cheng, B. Cleveland, D. Cookman, J. Corning, M. A. Cox , et al. (96 additional authors not shown)

Abstract: The SNO+ collaboration reports its first spectral analysis of long-baseline reactor antineutrino oscillation using 114 tonne-years of data. Fitting the neutrino oscillation probability to the observed energy spectrum yields constraints on the neutrino mass-squared difference $Δm^2_{21}$. In the ranges allowed by previous measurements, the best-fit $Δm^2_{21}$ is (8.85$^{+1.10}_{-1.33}$) $\times$ 1… ▽ More The SNO+ collaboration reports its first spectral analysis of long-baseline reactor antineutrino oscillation using 114 tonne-years of data. Fitting the neutrino oscillation probability to the observed energy spectrum yields constraints on the neutrino mass-squared difference $Δm^2_{21}$. In the ranges allowed by previous measurements, the best-fit $Δm^2_{21}$ is (8.85$^{+1.10}_{-1.33}$) $\times$ 10$^{-5}$ eV$^2$. This measurement is continuing in the next phases of SNO+ and is expected to surpass the present global precision on $Δm^2_{21}$ with about three years of data. △ Less

Submitted 30 May, 2024; originally announced May 2024.

Measure theoretic properties of large products of consecutive partial quotients

Authors: Adam Brown-Sarre, Gerardo González Robert, Mumtaz Hussain

Abstract: The theory of uniform approximation of real numbers motivates the study of products of consecutive partial quotients in regular continued fractions. For any non-decreasing positive function $\varphi:\mathbb{N}\to\mathbb{R}_{>0}$ and $\ell\in \mathbb{N}$, we determine the Lebesgue measure and Hausdorff dimension of the set $\mathcal{F}_{\ell}(\varphi)$ of irrational numbers $x$ whose regular contin… ▽ More The theory of uniform approximation of real numbers motivates the study of products of consecutive partial quotients in regular continued fractions. For any non-decreasing positive function $\varphi:\mathbb{N}\to\mathbb{R}_{>0}$ and $\ell\in \mathbb{N}$, we determine the Lebesgue measure and Hausdorff dimension of the set $\mathcal{F}_{\ell}(\varphi)$ of irrational numbers $x$ whose regular continued fraction $x~=~[a_1(x),a_2(x),\ldots]$ is such that for infinitely many $n\in\mathbb{N}$ there are two numbers $1\leq j<k \leq n$ satisfying \[ a_{k}(x)\cdots a_{k+\ell-1}(x)\geq \varphi(n), \; a_{j}(x)\cdots a_{j+\ell-1}(x)\geq \varphi(n). \] One of the consequences of the results is that the strong law of large numbers for products of $\ell$ consecutive partial quotients is impossible even if the block with the largest product is removed. △ Less

Submitted 17 May, 2024; originally announced May 2024.

Comments: 26 pages

MSC Class: 11K55 (Primary) 11J83; 28A80 (Secondary)

Enhancing Data Integrity and Traceability in Industry Cyber Physical Systems (ICPS) through Blockchain Technology: A Comprehensive Approach

Authors: Mohammad Ikbal Hossain, Dr. Tanja Steigner, Muhammad Imam Hussain, Afroja Akther

Abstract: Blockchain technology, heralded as a transformative innovation, has far-reaching implications beyond its initial application in cryptocurrencies. This study explores the potential of blockchain in enhancing data integrity and traceability within Industry Cyber-Physical Systems (ICPS), a crucial aspect in the era of Industry 4.0. ICPS, integrating computational and physical components, is pivotal i… ▽ More Blockchain technology, heralded as a transformative innovation, has far-reaching implications beyond its initial application in cryptocurrencies. This study explores the potential of blockchain in enhancing data integrity and traceability within Industry Cyber-Physical Systems (ICPS), a crucial aspect in the era of Industry 4.0. ICPS, integrating computational and physical components, is pivotal in managing critical infrastructure like manufacturing, power grids, and transportation networks. However, they face challenges in security, privacy, and reliability. With its inherent immutability, transparency, and distributed consensus, blockchain presents a groundbreaking approach to address these challenges. It ensures robust data reliability and traceability across ICPS, enhancing transaction transparency and facilitating secure data sharing. This research unearths various blockchain applications in ICPS, including supply chain management, quality control, contract management, and data sharing. Each application demonstrates blockchain's capacity to streamline processes, reduce fraud, and enhance system efficiency. In supply chain management, blockchain provides real-time auditing and compliance. For quality control, it establishes tamper-proof records, boosting consumer confidence. In contract management, smart contracts automate execution, enhancing efficiency. Blockchain also fosters secure collaboration in ICPS, which is crucial for system stability and safety. This study emphasizes the need for further research on blockchain's practical implementation in ICPS, focusing on challenges like scalability, system integration, and security vulnerabilities. It also suggests examining blockchain's economic and organizational impacts in ICPS to understand its feasibility and long-term advantages. △ Less

Submitted 8 May, 2024; originally announced May 2024.

S-box Security Analysis of NIST Lightweight Cryptography Candidates: A Critical Empirical Study

Authors: Mahnoor Naseer, Sundas Tariq, Naveed Riaz, Naveed Ahmed, Mureed Hussain

Abstract: In the resource-constrained world of the digital landscape, lightweight cryptography plays a critical role in safeguarding information and ensuring the security of various systems, devices, and communication channels. Its efficient and resource-friendly nature makes it the ideal solution for applications where computational power is limited. In response to the growing need for platform-specific im… ▽ More In the resource-constrained world of the digital landscape, lightweight cryptography plays a critical role in safeguarding information and ensuring the security of various systems, devices, and communication channels. Its efficient and resource-friendly nature makes it the ideal solution for applications where computational power is limited. In response to the growing need for platform-specific implementations, NIST issued a call for standardization of Lightweight cryptography algorithms in 2018. Ascon emerged as the winner of this competition. NIST initially established general evaluation criteria for a standard lightweight scheme including security strength, mitigation against side-channel and fault-injection attacks, and implementation efficiency. To verify the security claims, evaluating the individual components used in any cryptographic algorithm is a crucial step. The quality of a substitution box (S-box) significantly impacts the overall security of a cryptographic primitive. This paper analyzes the S-boxes of six finalists in the NIST Lightweight Cryptography (LWC) standardization process. We evaluate them based on well-established cryptographic properties. Our analysis explores how these properties influence the S-boxes' resistance against known cryptanalytic attacks and potential implementation-specific vulnerabilities, thus reflecting on their compliance with NIST's security requirements. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Towards Automated Generation of Smart Grid Cyber Range for Cybersecurity Experiments and Training

Authors: Daisuke Mashima, Muhammad M. Roomi, Bennet Ng, Zbigniew Kalbarczyk, S. M. Suhail Hussain, Ee-chien Chang

Abstract: Assurance of cybersecurity is crucial to ensure dependability and resilience of smart power grid systems. In order to evaluate the impact of potential cyber attacks, to assess deployability and effectiveness of cybersecurity measures, and to enable hands-on exercise and training of personals, an interactive, virtual environment that emulates the behaviour of a smart grid system, namely smart grid… ▽ More Assurance of cybersecurity is crucial to ensure dependability and resilience of smart power grid systems. In order to evaluate the impact of potential cyber attacks, to assess deployability and effectiveness of cybersecurity measures, and to enable hands-on exercise and training of personals, an interactive, virtual environment that emulates the behaviour of a smart grid system, namely smart grid cyber range, has been demanded by industry players as well as academia. A smart grid cyber range is typically implemented as a combination of cyber system emulation, which allows interactivity, and physical system (i.e., power grid) simulation that are tightly coupled for consistent cyber and physical behaviours. However, its design and implementation require intensive expertise and efforts in cyber and physical aspects of smart power systems as well as software/system engineering. While many industry players, including power grid operators, device vendors, research and education sectors are interested, availability of the smart grid cyber range is limited to a small number of research labs. To address this challenge, we have developed a framework for modelling a smart grid cyber range using an XML-based language, called SG-ML, and for "compiling" the model into an operational cyber range with minimal engineering efforts. The modelling language includes standardized schema from IEC 61850 and IEC 61131, which allows industry players to utilize their existing configurations. The SG-ML framework aims at making a smart grid cyber range available to broader user bases to facilitate cybersecurity R\&D and hands-on exercises. △ Less

Submitted 31 March, 2024; originally announced April 2024.

Comments: Published at DSN 2023 Industry Track

On the Folklore set and Dirichlet spectrum for matrices

Authors: Mumtaz Hussain, Johannes Schleischitz, Benjamin Ward

Abstract: We study the Folklore set of Dirichlet improvable matrices in $\mathbb R^{m\times n}$ which are neither singular nor badly approximable. We prove the non-emptiness for all positive integer pairs $m,n$ apart from $\{m,n\}=\{ 1,1\}$ and $\{m,n\}=\{ 2,3\}$ in a constructive way. For a wide range of integer pairs $(m,n)$ we construct subsets of the Folklore set with an exact prescribed Dirichlet const… ▽ More We study the Folklore set of Dirichlet improvable matrices in $\mathbb R^{m\times n}$ which are neither singular nor badly approximable. We prove the non-emptiness for all positive integer pairs $m,n$ apart from $\{m,n\}=\{ 1,1\}$ and $\{m,n\}=\{ 2,3\}$ in a constructive way. For a wide range of integer pairs $(m,n)$ we construct subsets of the Folklore set with an exact prescribed Dirichlet constant (in some right neighbourhood of $0$). This enables us to provide information on the Dirichlet Spectrum of matrices. The key technique of our construction is to build certain $2$-dimensional simultaneously approximable very singular vectors, and then `lift' these vectors to higher dimensions by `glueing' them to a large set of well-behaved matrices. Our technique is also applicable to arbitrary norms. As a corollary, we obtain lower bounds on the Hausdorff dimension of these sets. These statements complement previous results of the middle-named author (Selecta Math. 2023), Beresnevich et. al. (Adv. Math. 2023), and Das et. al. (Adv. Math. 2024). △ Less

Submitted 30 April, 2024; v1 submitted 20 February, 2024; originally announced February 2024.

Comments: 43 pages, 1 figure, comments welcome. The main results are strengthened and new results have been added

A Novel Technique to Parameterize Congestion Control in 6TiSCH IIoT Networks

Authors: Kushal Chakraborty, Aritra Kumar Dutta, Mohammad Avesh Hussain, Syed Raafay Mohiuddin, Nikumani Choudhury, Rakesh Matam, Mithun Mukherjee

Abstract: The Industrial Internet of Things (IIoT) refers to the use of interconnected smart devices, sensors, and other technologies to create a network of intelligent systems that can monitor and manage industrial processes. 6TiSCH (IPv6 over the Time Slotted Channel Hop** mode of IEEE 802.15.4e) as an enabling technology facilitates low-power and low-latency communication between IoT devices in industr… ▽ More The Industrial Internet of Things (IIoT) refers to the use of interconnected smart devices, sensors, and other technologies to create a network of intelligent systems that can monitor and manage industrial processes. 6TiSCH (IPv6 over the Time Slotted Channel Hop** mode of IEEE 802.15.4e) as an enabling technology facilitates low-power and low-latency communication between IoT devices in industrial environments. The Routing Protocol for Low power and lossy networks (RPL), which is used as the de-facto routing protocol for 6TiSCH networks is observed to suffer from several limitations, especially during congestion in the network. Therefore, there is an immediate need for some modifications to the RPL to deal with this problem. Under traffic load which keeps on changing continuously at different instants of time, the proposed mechanism aims at finding the appropriate parent for a node that can forward the packet to the destination through the least congested path with minimal packet loss. This facilitates congestion management under dynamic traffic loads. For this, a new metric for routing using the concept of exponential weighting has been proposed, which takes the number of packets present in the queue of the node into account when choosing the parent at a particular instance of time. Additionally, the paper proposes a parent selection and swap** mechanism for congested networks. Performance evaluations are carried out in order to validate the proposed work. The results show an improvement in the performance of RPL under heavy and dynamic traffic loads. △ Less

Submitted 11 February, 2024; originally announced February 2024.

Comments: The paper has been submitted, accepted, and presented at the 2023 IEEE Global Communications Conference: Next-Generation Networking and Internet, with plans for publication. It was delivered during the IEEE Global Communications Conference held on December 6th, 2023, in Kuala Lumpur, Malaysia

Triplet Interaction Improves Graph Transformers: Accurate Molecular Graph Learning with Triplet Graph Transformers

Authors: Md Shamim Hussain, Mohammed J. Zaki, Dharmashankar Subramanian

Abstract: Graph transformers typically lack third-order interactions, limiting their geometric understanding which is crucial for tasks like molecular geometry prediction. We propose the Triplet Graph Transformer (TGT) that enables direct communication between pairs within a 3-tuple of nodes via novel triplet attention and aggregation mechanisms. TGT is applied to molecular property prediction by first pred… ▽ More Graph transformers typically lack third-order interactions, limiting their geometric understanding which is crucial for tasks like molecular geometry prediction. We propose the Triplet Graph Transformer (TGT) that enables direct communication between pairs within a 3-tuple of nodes via novel triplet attention and aggregation mechanisms. TGT is applied to molecular property prediction by first predicting interatomic distances from 2D graphs and then using these distances for downstream tasks. A novel three-stage training procedure and stochastic inference further improve training efficiency and model performance. Our model achieves new state-of-the-art (SOTA) results on open challenge benchmarks PCQM4Mv2 and OC20 IS2RE. We also obtain SOTA results on QM9, MOLPCBA, and LIT-PCBA molecular property prediction benchmarks via transfer learning. We also demonstrate the generality of TGT with SOTA results on the traveling salesman problem (TSP). △ Less

Submitted 9 June, 2024; v1 submitted 6 February, 2024; originally announced February 2024.

Comments: ICML'24 Accepted Version, 25 pages, 10 figures, 18 tables

Restricted slowly growing digits for infinite iterated function systems

Authors: Gerardo González Robert, Mumtaz Hussain, Nikita Shulga, Hiroki Takahasi

Abstract: For an infinite iterated function system $\mathbf{f}$ on $[0,1]$ with an attractor $Λ(\mathbf{f})$ and for an infinite subset $D\subseteq \mathbb{N}$, consider the set \[ \mathbb E(\mathbf{f},D)= \{ x \in Λ(\mathbf{f}): a_n(x)\in D \text{ for all }n\in\mathbb N \text{ and }\lim_{n\to\infty} a_n=\infty\}. \] For a function $\varphi:\mathbb{N}\to [\min D, \infty)$ such that $\varphi(n)\to\infty$ as… ▽ More For an infinite iterated function system $\mathbf{f}$ on $[0,1]$ with an attractor $Λ(\mathbf{f})$ and for an infinite subset $D\subseteq \mathbb{N}$, consider the set \[ \mathbb E(\mathbf{f},D)= \{ x \in Λ(\mathbf{f}): a_n(x)\in D \text{ for all }n\in\mathbb N \text{ and }\lim_{n\to\infty} a_n=\infty\}. \] For a function $\varphi:\mathbb{N}\to [\min D, \infty)$ such that $\varphi(n)\to\infty$ as $n\to\infty$, we compute the Hausdorff dimension of the set $$ S(\mathbf{f},D,\varphi) = \left\{ x\in \E(\mathbf{f},D) : a_n(x)\leq \varphi(n) \text{ for all } n\in\mathbb N \right\}. $$ We prove that the Hausdorff dimension stays the same no matter how slowly the function $\varphi$ grows. One of the consequences of our result is the recent work of Takahasi (2023), which only dealt with regular continued fraction expansions. We further extend our result to slowly growing products of (not necessarily consecutive) digits. △ Less

Submitted 28 December, 2023; originally announced December 2023.

Comments: 14 pages, 2 figures

BANSpEmo: A Bangla Emotional Speech Recognition Dataset

Authors: Md Gulzar Hussain, Mahmuda Rahman, Babe Sultana, Ye Shiren

Abstract: In the field of audio and speech analysis, the ability to identify emotions from acoustic signals is essential. Human-computer interaction (HCI) and behavioural analysis are only a few of the many areas where the capacity to distinguish emotions from speech signals has an extensive range of applications. Here, we are introducing BanSpEmo, a corpus of emotional speech that only consists of audio re… ▽ More In the field of audio and speech analysis, the ability to identify emotions from acoustic signals is essential. Human-computer interaction (HCI) and behavioural analysis are only a few of the many areas where the capacity to distinguish emotions from speech signals has an extensive range of applications. Here, we are introducing BanSpEmo, a corpus of emotional speech that only consists of audio recordings and has been created specifically for the Bangla language. This corpus contains 792 audio recordings over a duration of more than 1 hour and 23 minutes. 22 native speakers took part in the recording of two sets of sentences that represent the six desired emotions. The data set consists of 12 Bangla sentences which are uttered in 6 emotions as Disgust, Happy, Sad, Surprised, Anger, and Fear. This corpus is not also gender balanced. Ten individuals who either have experience in related field or have acting experience took part in the assessment of this corpus. It has a balanced number of audio recordings in each emotion class. BanSpEmo can be considered as a useful resource to promote emotion and speech recognition research and related applications in the Bangla language. The dataset can be found here: https://data.mendeley.com/datasets/rdwn4bs5ky and might be employed for academic research. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Single-ion optical autocorrelator

Authors: M. I. Hussain, M. Guevara-Bertsch, E. Torrontegui, J. J. Garcıa-Ripoll, R. Blatt, C. F. Roos

Abstract: Well isolated quantum systems are exquisite sensors of electromagnetic fields. In this work, we use a single trapped ion for characterizing chirped ultraviolet (UV) picosecond laser pulses. The frequency swept pulses resonantly drive a strong dipole transition via rapid adiabatic passage, resulting in near deterministic population exchange caused by absorption or stimulated emission of photons. Wh… ▽ More Well isolated quantum systems are exquisite sensors of electromagnetic fields. In this work, we use a single trapped ion for characterizing chirped ultraviolet (UV) picosecond laser pulses. The frequency swept pulses resonantly drive a strong dipole transition via rapid adiabatic passage, resulting in near deterministic population exchange caused by absorption or stimulated emission of photons. When subjecting an ion to counterpropagating pulse pairs, we observe the loss and revival of atomic coherence as a function of the pulse pair spatial overlap enabling quantification of the temporal pulse broadening caused by a frequency chirp in shaped UV pulses with a very low peak power. We find good agreement between measured and applied chirp. The ultrafast population exchange imparts an impulsive force where the estimated change in the mean phonon numbers of 0.5 is measured for two pairs of pulses. The resonant ultrafast kicks could be applied to matter wave interferometry experiments and present a step towards ultrafast entanglement operations in trapped ions. △ Less

Submitted 6 December, 2023; originally announced December 2023.

Adaptive Confidence Threshold for ByteTrack in Multi-Object Tracking

Authors: Linh Van Ma, Muhammad Ishfaq Hussain, JongHyun Park, Jeongbae Kim, Moongu Jeon

Abstract: We investigate the application of ByteTrack in the realm of multiple object tracking. ByteTrack, a simple tracking algorithm, enables the simultaneous tracking of multiple objects by strategically incorporating detections with a low confidence threshold. Conventionally, objects are initially associated with high confidence threshold detections. When the association between objects and detections b… ▽ More We investigate the application of ByteTrack in the realm of multiple object tracking. ByteTrack, a simple tracking algorithm, enables the simultaneous tracking of multiple objects by strategically incorporating detections with a low confidence threshold. Conventionally, objects are initially associated with high confidence threshold detections. When the association between objects and detections becomes ambiguous, ByteTrack extends the association to lower confidence threshold detections. One notable drawback of the existing ByteTrack approach is its reliance on a fixed threshold to differentiate between high and low-confidence detections. In response to this limitation, we introduce a novel and adaptive approach. Our proposed method entails a dynamic adjustment of the confidence threshold, leveraging insights derived from overall detections. Through experimentation, we demonstrate the effectiveness of our adaptive confidence threshold technique while maintaining running time compared to ByteTrack. △ Less

Submitted 5 December, 2023; v1 submitted 4 December, 2023; originally announced December 2023.

Comments: The 12th International Conference on Control, Automation and Information Sciences (ICCAIS 2023), November 27th to 29th, 2023 in Hanoi

Journal ref: The 12th International Conference on Control, Automation and Information Sciences (ICCAIS 2023)

Isospin Decomposition of D Mesons

Authors: Shakeel Mahmood, Mudassir Hussain, Abrar Ahmad

Abstract: This work focuses on decomposition of isospin amplitude of D meson non-leptonic decays. Isospin vector algebra is used to show the equivalency of two amplitude decompositions. We restrict to the transitions involving only Del I = 1 and Del I = 0: The isospin symmetry is relating charge channel (D+ -> K+,Pi+ Pi-; D+ -> K+, Pi0, Pi0 and D+-> K0, Pi0,Pi+); and neutral channel (D0 -> K0,Pi+,Pi- D0 ->… ▽ More This work focuses on decomposition of isospin amplitude of D meson non-leptonic decays. Isospin vector algebra is used to show the equivalency of two amplitude decompositions. We restrict to the transitions involving only Del I = 1 and Del I = 0: The isospin symmetry is relating charge channel (D+ -> K+,Pi+ Pi-; D+ -> K+, Pi0, Pi0 and D+-> K0, Pi0,Pi+); and neutral channel (D0 -> K0,Pi+,Pi- D0 -> K0, Pi0, Pi0 and D0 -> K+, Pi0, Pi-) with each other. Equivalent triangle relations are obtained for both channels. △ Less

Submitted 24 November, 2023; originally announced November 2023.

Comments: 9 Pages , 5 Figures

Identifying Alzheimer Disease Dementia Levels Using Machine Learning Methods

Authors: Md Gulzar Hussain, Ye Shiren

Abstract: Dementia, a prevalent neurodegenerative condition, is a major manifestation of Alzheimer's disease (AD). As the condition progresses from mild to severe, it significantly impairs the individual's ability to perform daily tasks independently, necessitating the need for timely and accurate AD classification. Machine learning or deep learning models have emerged as effective tools for this purpose. I… ▽ More Dementia, a prevalent neurodegenerative condition, is a major manifestation of Alzheimer's disease (AD). As the condition progresses from mild to severe, it significantly impairs the individual's ability to perform daily tasks independently, necessitating the need for timely and accurate AD classification. Machine learning or deep learning models have emerged as effective tools for this purpose. In this study, we suggested an approach for classifying the four stages of dementia using RF, SVM, and CNN algorithms, augmented with watershed segmentation for feature extraction from MRI images. Our results reveal that SVM with watershed features achieves an impressive accuracy of 96.25%, surpassing other classification methods. The ADNI dataset is utilized to evaluate the effectiveness of our method, and we observed that the inclusion of watershed segmentation contributes to the enhanced performance of the models. △ Less

Submitted 2 November, 2023; originally announced November 2023.

Transcendence and Normality of Complex Numbers

Authors: Felipe García-Ramos, Gerardo González Robert, Mumtaz Hussain

Abstract: Hurwitz continued fractions associate an infinite sequence of Gaussian integers to every complex number which is not a Gaussian rational. However, the resulting space of sequences of Gaussian integers $Ω$ is not closed. In this paper, we show that $Ω$ contains a natural subset whose closure $\overline{\mathsf{R}}$ encodes continued fraction expansions of complex non-Gaussian rationals. Furthermore… ▽ More Hurwitz continued fractions associate an infinite sequence of Gaussian integers to every complex number which is not a Gaussian rational. However, the resulting space of sequences of Gaussian integers $Ω$ is not closed. In this paper, we show that $Ω$ contains a natural subset whose closure $\overline{\mathsf{R}}$ encodes continued fraction expansions of complex non-Gaussian rationals. Furthermore, by means of an algorithm that we develop, we exhibit for each complex non-Gaussian rational $z$ a sequence belonging to $\overline{\mathsf{R}}$ giving a continued fraction expansion of $z$. We also prove that $(\overline{\mathsf{R}}, σ)$ is a subshift with a feeble specification property. As an application, we determine the rank in the Borel hierarchy of the set of Hurwitz normal numbers with respect to the complex Gauss measure. More precisely, we prove that it is a $Π_0^3$-complete set. As a second application, we construct a family of complex transcendental numbers with bounded partial quotients. △ Less

Submitted 30 October, 2023; originally announced October 2023.

Comments: 32 pages, 7 figures and an algorithm, any comments will be appreciated

Complex numbers with a prescribed order of approximation and Zaremba's conjecture

Authors: Gerardo González Robert, Mumtaz Hussain, Nikita Shulga

Abstract: Given $b=-A\pm i$ with $A$ being a positive integer, we can represent any complex number as a power series in $b$ with coefficients in $\mathcal A=\{0,1,\ldots, A^2\}$. We prove that, for any real $τ\geq 2$ and any non-empty proper subset $J(b)$ of $\mathcal A$, there are uncountably many complex numbers (including transcendental numbers) that can be expressed as a power series in $b$ with coeffic… ▽ More Given $b=-A\pm i$ with $A$ being a positive integer, we can represent any complex number as a power series in $b$ with coefficients in $\mathcal A=\{0,1,\ldots, A^2\}$. We prove that, for any real $τ\geq 2$ and any non-empty proper subset $J(b)$ of $\mathcal A$, there are uncountably many complex numbers (including transcendental numbers) that can be expressed as a power series in $b$ with coefficients in $J(b)$ and with the irrationality exponent (in terms of Gaussian integers) equal to $τ$. One of the key ingredients in our construction is the `Folding Lemma' applied to Hurwitz continued fractions. This motivates a Hurwitz continued fraction analogue of the well-known Zaremba's conjecture. We prove several results in support of this conjecture. △ Less

Submitted 18 October, 2023; originally announced October 2023.

Comments: 15 pages

Liminf approximation sets for abstract rationals

Authors: Mumtaz Hussain, Ben Ward

Abstract: The Jarník-Besicovitch theorem is a fundamental result in metric number theory which concerns the Hausdorff dimension for certain limsup sets. We discuss the analogous problem for liminf sets. Consider an infinite sequence of positive integers, $S=\{q_{n}\}_{n\in\mathbb{N}}$, exhibiting exponential growth. For a given $n$-tuple of functions denoted as $Ψ:=~(ψ_1, \ldots,ψ_n)$, each of the form… ▽ More The Jarník-Besicovitch theorem is a fundamental result in metric number theory which concerns the Hausdorff dimension for certain limsup sets. We discuss the analogous problem for liminf sets. Consider an infinite sequence of positive integers, $S=\{q_{n}\}_{n\in\mathbb{N}}$, exhibiting exponential growth. For a given $n$-tuple of functions denoted as $Ψ:=~(ψ_1, \ldots,ψ_n)$, each of the form $ψ_{i}(q)=q^{-τ_{i}}$ for $(τ_{1},\dots,τ_{n})\in\mathbb{R}^{n}_{+}$, we calculate the Hausdorff dimension of the set of points that can be $Ψ$-approximated for all sufficiently large $q\in S$. We prove this result in the generalised setting of approximation by abstract rationals as recently introduced by Koivusalo, Fraser, and Ramirez (LMS, 2023). Some of the examples of this setting include the real weighted inhomogeneous approximation, $p$-adic weighted approximation, Diophantine approximation over complex numbers, and approximation on missing digit sets. △ Less

Submitted 23 September, 2023; originally announced September 2023.

Comments: 24 pages

MSC Class: 11J13; 11J83

Metrical properties of exponentially growing partial quotients

Authors: Mumtaz Hussain, Nikita Shulga

Abstract: A fundamental challenge within the metric theory of continued fractions involves quantifying sets of real numbers, when represented using continued fractions, exhibit partial quotients that grow at specific rates. For any positive function $Φ$, Wang-Wu theorem (2008) comprehensively describes the Hausdorff dimension of the set \begin{equation*} \EE_1(Φ):=\left\{x\in [0, 1): a_n(x)\geq Φ(n) \ {\rm… ▽ More A fundamental challenge within the metric theory of continued fractions involves quantifying sets of real numbers, when represented using continued fractions, exhibit partial quotients that grow at specific rates. For any positive function $Φ$, Wang-Wu theorem (2008) comprehensively describes the Hausdorff dimension of the set \begin{equation*} \EE_1(Φ):=\left\{x\in [0, 1): a_n(x)\geq Φ(n) \ {\rm for \ infinitely \ many} \ n\in \N\right\}. \end{equation*} Various generalisations of this set exist, such as substituting one partial quotient with the product of consecutive partial quotients in the aforementioned set which has connections with the improvements to Dirichlet's theorem, and many other sets of similar nature. Establishing the upper bound of the Hausdorff dimension of such sets is significantly easier than proving the lower bound. In this paper, we present a unified approach to get an optimal lower bound for many known setups, including results by Wang-Wu [Adv. Math., 2008], Huang-Wu-Xu [Israel J. Math. 2020], Bakhtawar-Bos-Hussain [Nonlinearity 2020], and several others, and also provide a new theorem derived as an application of our main result. We do this by finding an exact Hausdorff dimension of the set $$S_m(A_0,\ldots,A_{m-1}) \defeq \left\{ x\in[0,1): \, c_i A_i^n \le a_{n+i}(x) < 2c_i A_i^n,0 \le i \le m-1 \ \text{for infinitely many } n\in\N \right\},$$ where each partial quotient grows exponentially and the base is given by a parameter $A_i>1$. For proper choices of $A_i$'s, this set serves as a subset for sets under consideration, providing an optimal lower bound of Hausdorff dimension in all of them. The crux of the proof lies in introducing of multiple probability measures consistently distributed over the Cantor-type subset of $S_m(A_0,\ldots,A_{m-1})$. △ Less

Submitted 19 September, 2023; originally announced September 2023.

Comments: 22

Event-by-Event Direction Reconstruction of Solar Neutrinos in a High Light-Yield Liquid Scintillator

Authors: A. Allega, M. R. Anderson, S. Andringa, J. Antunes, M. Askins, D. J. Auty, A. Bacon, J. Baker, N. Barros, F. Barão, R. Bayes, E. W. Beier, T. S. Bezerra, A. Bialek, S. D. Biller, E. Blucher, E. Caden, E. J. Callaghan, M. Chen, S. Cheng, B. Cleveland, D. Cookman, J. Corning, M. A. Cox, R. Dehghani , et al. (94 additional authors not shown)

Abstract: The direction of individual $^8$B solar neutrinos has been reconstructed using the SNO+ liquid scintillator detector. Prompt, directional Cherenkov light was separated from the slower, isotropic scintillation light using time information, and a maximum likelihood method was used to reconstruct the direction of individual scattered electrons. A clear directional signal was observed, correlated with… ▽ More The direction of individual $^8$B solar neutrinos has been reconstructed using the SNO+ liquid scintillator detector. Prompt, directional Cherenkov light was separated from the slower, isotropic scintillation light using time information, and a maximum likelihood method was used to reconstruct the direction of individual scattered electrons. A clear directional signal was observed, correlated with the solar angle. The observation was aided by a period of low primary fluor concentration that resulted in a slower scintillator decay time. This is the first time that event-by-event direction reconstruction in high light-yield liquid scintillator has been demonstrated in a large-scale detector. △ Less

Submitted 10 April, 2024; v1 submitted 12 September, 2023; originally announced September 2023.

Comments: 6 pages, 6 figures. Accepted manuscript by PRD

Advancements in Upper Body Exoskeleton: Implementing Active Gravity Compensation with a Feedforward Controller

Authors: Muhammad Ayaz Hussain, Ioannis Iossifidis

Abstract: In this study, we present a feedforward control system designed for active gravity compensation on an upper body exoskeleton. The system utilizes only positional data from internal motor sensors to calculate torque, employing analytical control equations based on Newton-Euler Inverse Dynamics. Compared to feedback control systems, the feedforward approach offers several advantages. It eliminates t… ▽ More In this study, we present a feedforward control system designed for active gravity compensation on an upper body exoskeleton. The system utilizes only positional data from internal motor sensors to calculate torque, employing analytical control equations based on Newton-Euler Inverse Dynamics. Compared to feedback control systems, the feedforward approach offers several advantages. It eliminates the need for external torque sensors, resulting in reduced hardware complexity and weight. Moreover, the feedforward control exhibits a more proactive response, leading to enhanced performance. The exoskeleton used in the experiments is lightweight and comprises 4 Degrees of Freedom, closely mimicking human upper body kinematics and three-dimensional range of motion. We conducted tests on both hardware and simulations of the exoskeleton, demonstrating stable performance. The system maintained its position over an extended period, exhibiting minimal friction and avoiding undesired slewing. △ Less

Submitted 9 September, 2023; originally announced September 2023.

ACM Class: B.m; B.1; I.6

Metrical properties of finite product of partial quotients in arithmetic progressions

Authors: Mumtaz Hussain, Nikita Shulga

Abstract: We investigate the dynamics of continued fractions and explore the ergodic behaviour of the products of mixed partial quotients in continued fractions of real numbers. For any function $Φ:\mathbb N\to [2,+\infty)$ and any integer $d\geq 1$, we determine the Lebesgue measure and Hausdorff dimension of the set of real numbers for which the product of partial quotients in arithmetic progressions sati… ▽ More We investigate the dynamics of continued fractions and explore the ergodic behaviour of the products of mixed partial quotients in continued fractions of real numbers. For any function $Φ:\mathbb N\to [2,+\infty)$ and any integer $d\geq 1$, we determine the Lebesgue measure and Hausdorff dimension of the set of real numbers for which the product of partial quotients in arithmetic progressions satisfy $a_n(x)a_{2n}(x)\cdots a_{dn}(x)\geq Φ(n)$ for infinitely many positive integers $n$. Our findings shed light on the size of the set of exceptions to Bourgain's (1988) and Host and Kra's (2005) theorems concerning the convergence of multiple ergodic averages for Gauss dynamical systems. By exploring the Hausdorff dimension of these sets, we gain valuable insights into the behaviour of such exceptions. Overall, our research contributes to a deeper understanding of the dynamics of continued fractions and their connection to the convergence properties of ergodic averages in Gauss dynamical systems. △ Less

Submitted 26 February, 2024; v1 submitted 2 September, 2023; originally announced September 2023.

Comments: 29 pages, To appear: Annali della Scuola Normale Superiore di Pisa, Classe di Scienze

Metrical properties of the product of partial quotients with geometric mean in continued fractions

Authors: Mumtaz Hussain, Bixuan Li, Nikita Shulga

Abstract: The theory of uniform Diophantine approximation concerns the study of Dirichlet improvable numbers and the metrical aspect of this theory leads to the study of the product of consecutive partial quotients in continued fractions. It is known that the dimension of the set of Dirichlet non-improvable numbers depends upon the number of partial quotients in the product string. However, one can see that… ▽ More The theory of uniform Diophantine approximation concerns the study of Dirichlet improvable numbers and the metrical aspect of this theory leads to the study of the product of consecutive partial quotients in continued fractions. It is known that the dimension of the set of Dirichlet non-improvable numbers depends upon the number of partial quotients in the product string. However, one can see that the Hausdorff dimension is the same for any number of consecutive partial quotients with a constant gap. This paper is aimed at a detailed analysis on how the Hausdorff dimension changes when there is a linear gap in indices and the number of partial quotients in the product grows. More precisely, let $d\in \N_{\ge 1}, t\in\Z_{\geq 0}$ and $f(n)=dn+t$, we present the detailed Hausdorff dimension analysis of the set\begin{equation*} E_{f}(ψ):=\left\{x\in [0, 1): \sqrt[n]{a_{f(n)}(x)a_{2f(n)}(x)\cdots a_{nf(n)}(x)}\geq ψ(n) \ {\rm for \ infinitely \ many} \ n\in \N\right\}. \end{equation*} It is seen that the dimension is larger if $d$ is larger and $t$ has no contribution to the dimension. △ Less

Submitted 1 September, 2023; originally announced September 2023.

Comments: 28 pages, comments welcome

Weighted approximation for limsup sets

Authors: Gerardo González Robert, Mumtaz Hussain, Nikita Shulga, Benjamin Ward

Abstract: Theorems of Khintchine, Groshev, Jarník, and Besicovitch in Diophantine approximation are fundamental results on the metric properties of $Ψ$-well approximable sets. These foundational results have since been generalised to the framework of weighted Diophantine approximation for systems of real linear forms (matrices). In this article, we prove analogues of these weighted results in a range of set… ▽ More Theorems of Khintchine, Groshev, Jarník, and Besicovitch in Diophantine approximation are fundamental results on the metric properties of $Ψ$-well approximable sets. These foundational results have since been generalised to the framework of weighted Diophantine approximation for systems of real linear forms (matrices). In this article, we prove analogues of these weighted results in a range of settings including the $p$-adics (Theorems 7 and 8), complex numbers (Theorems 9 and 10), quaternions (Theorems 11 and 12), and formal power series (Theorems 13 and 14). We also consider approximation by uniformly distributed sequences. Under some assumptions on the approximation functions, we prove a 0-1 dichotomy law (Theorem 15). We obtain divergence results for any approximation function under some natural restrictions on the discrepancy (Theorems 16, 17, and 19). The key tools in proving the main parts of these results are the weighted ubiquitous systems and weighted mass transference principle introduced recently by Kleinbock and Wang [Adv. Math. 428 (2023), Paper No. 109154], and Wang and Wu [Math. Ann. 381 (2021), no. 1-2, 243--317] respectively. △ Less

Submitted 7 December, 2023; v1 submitted 31 August, 2023; originally announced August 2023.

Comments: 74 pages, Some minor typos have been fixed

Dual $p$-adic Diophantine approximation on manifolds

Authors: Mumtaz Hussain, Johannes Schleischitz, Benjamin Ward

Abstract: The Generalised Baker-Schmidt Problem (1970) concerns the Hausdorff measure of the set of $ψ$-approximable points on a nondegenerate manifold. Beresnevich-Dickinson-Velani (in 2006, for the homogeneous setting) and Badziahin-Beresnevich-Velani (in 2013, for the inhomogeneous setting) proved the divergence part of this problem for dual approximation on arbitrary nondegenerate manifolds. The diverge… ▽ More The Generalised Baker-Schmidt Problem (1970) concerns the Hausdorff measure of the set of $ψ$-approximable points on a nondegenerate manifold. Beresnevich-Dickinson-Velani (in 2006, for the homogeneous setting) and Badziahin-Beresnevich-Velani (in 2013, for the inhomogeneous setting) proved the divergence part of this problem for dual approximation on arbitrary nondegenerate manifolds. The divergence part has also been resolved for the $p$-adic setting by Datta-Ghosh in 2022 for the inhomogeneous setting. The corresponding convergence counterpart represents a challenging open problem. In this paper, we prove the homogeneous $p$-adic convergence result for hypersurfaces of dimension at least three with some mild regularity condition, as well as for some other classes of manifolds satisfying certain conditions. We provide similar, slightly weaker results for the inhomogeneous setting. We do not restrict to monotonic approximation functions. △ Less

Submitted 28 August, 2023; originally announced August 2023.

Comments: 19 pages, comments welcome

Switched auxiliary loss for robust training of transformer models for histopathological image segmentation

Authors: Mustaffa Hussain, Saharsh Barve

Abstract: Functional tissue Units (FTUs) are cell population neighborhoods local to a particular organ performing its main function. The FTUs provide crucial information to the pathologist in understanding the disease affecting a particular organ by providing information at the cellular level. In our research, we have developed a model to segment multi-organ FTUs across 5 organs namely: the kidney, large in… ▽ More Functional tissue Units (FTUs) are cell population neighborhoods local to a particular organ performing its main function. The FTUs provide crucial information to the pathologist in understanding the disease affecting a particular organ by providing information at the cellular level. In our research, we have developed a model to segment multi-organ FTUs across 5 organs namely: the kidney, large intestine, lung, prostate and spleen by utilizing the HuBMAP + HPA - Hacking the Human Body competition dataset. We propose adding shifted auxiliary loss for training models like the transformers to overcome the diminishing gradient problem which poses a challenge towards optimal training of deep models. Overall, our model achieved a dice score of 0.793 on the public dataset and 0.778 on the private dataset and shows a 1% improvement with the use of the proposed method. The findings also bolster the use of transformers models for dense prediction tasks in the field of medical image analysis. The study assists in understanding the relationships between cell and tissue organization thereby providing a useful medium to look at the impact of cellular functions on human health. △ Less

Submitted 21 August, 2023; originally announced August 2023.

Weighted twisted inhomogeneous Diophantine approximation

Authors: Mumtaz Hussain, Benjamin Ward

Abstract: We prove a multidimensional weighted analogue of the well-known theorem of Kurzweil (1955) in the metric theory of inhomogeneous Diophantine approximation. Let $A$ be matrix of real numbers, $Ψ$ an $n$-tuple of monotonic decreasing functions, and let $W_{A}(Ψ)$ be the set of points that infinitely often lie in a $Ψ(q)$-neighbourhood of the sequence $\{Aq\}_{q\in\mathbb{N}}$. We prove that the set… ▽ More We prove a multidimensional weighted analogue of the well-known theorem of Kurzweil (1955) in the metric theory of inhomogeneous Diophantine approximation. Let $A$ be matrix of real numbers, $Ψ$ an $n$-tuple of monotonic decreasing functions, and let $W_{A}(Ψ)$ be the set of points that infinitely often lie in a $Ψ(q)$-neighbourhood of the sequence $\{Aq\}_{q\in\mathbb{N}}$. We prove that the set $ W_{A}(Ψ)$ has zero-full Lebesgue measure under convergent-divergent sum conditions with some mild assumptions on $A$ and the approximating functions $Ψ$. We also prove the Hausdorff dimension results for this set. Along with some geometric arguments, the main ingredients are weighted ubiquity and weighted mass transference principle introduced recently by Kleinbock & Wang (Adv. Math. 2023), and Wang & Wu (Math. Ann. 2021) respectively. △ Less

Submitted 24 July, 2023; originally announced July 2023.

Comments: 17 pages

MSC Class: 11J13; 11J83; 11J71

Metrical properties of Hurwitz Continued Fractions

Authors: Yann Bugeaud, Gerardo Gonzalez Robert, Mumtaz Hussain

Abstract: We develop the geometry of Hurwitz continued fractions -- a major tool in understanding the approximation properties of complex numbers by ratios of Gaussian integers. We obtain a detailed description of the shift space associated with Hurwitz continued fractions and, as a consequence, we contribute significantly in establishing the metrical theory of Hurwitz continued fractions, analogous to the… ▽ More We develop the geometry of Hurwitz continued fractions -- a major tool in understanding the approximation properties of complex numbers by ratios of Gaussian integers. We obtain a detailed description of the shift space associated with Hurwitz continued fractions and, as a consequence, we contribute significantly in establishing the metrical theory of Hurwitz continued fractions, analogous to the well-established theory of regular continued fractions for real numbers. Let $Φ:\mathbb N\to \mathbb R_{>0}$ be any function and $a_n(z)$ denote the $n$th partial quotient in the Hurwitz continued fraction of a complex number $z$. The main result of the paper is the Hausdorff dimension analysis of the set \[E(Φ) \colon= \left\{ z\in \mathbb C: |a_n(z)|\geq Φ(n) \text{ for infinitely many }n\in\mathbb{N} \right\}. \] This study is the complex analogue of a well-known result of Wang and Wu [Adv. Math. 218 (2008), no. 5, 1319--1339]. △ Less

Submitted 14 June, 2023; originally announced June 2023.

Comments: 80 pages, 11 figures, comments for improvement are appreciated

Metrical properties of weighted products of consecutive Lüroth digits

Authors: Adam Brown-Sarre, Gerardo González Robert, Mumtaz Hussain

Abstract: The Lüroth expansion of a real number $x\in (0,1]$ is the series \[ x= \frac{1}{d_1} + \frac{1}{d_1(d_1-1)d_2} + \frac{1}{d_1(d_1-1)d_2(d_2-1)d_3} + \cdots, \] with $d_j\in\mathbb{N}_{\geq 2}$ for all $j\in\mathbb{N}$. Given $m\in \mathbb{N}$, $\mathbf{t}=(t_0,\ldots, t_{m-1})\in\mathbb{R}_{>0}^{m-1}$ and any function $Ψ:\mathbb{N}\to (1,\infty)$, define \[ \mathcal{E}_{\mathbf{t}}(Ψ)\colon= \left… ▽ More The Lüroth expansion of a real number $x\in (0,1]$ is the series \[ x= \frac{1}{d_1} + \frac{1}{d_1(d_1-1)d_2} + \frac{1}{d_1(d_1-1)d_2(d_2-1)d_3} + \cdots, \] with $d_j\in\mathbb{N}_{\geq 2}$ for all $j\in\mathbb{N}$. Given $m\in \mathbb{N}$, $\mathbf{t}=(t_0,\ldots, t_{m-1})\in\mathbb{R}_{>0}^{m-1}$ and any function $Ψ:\mathbb{N}\to (1,\infty)$, define \[ \mathcal{E}_{\mathbf{t}}(Ψ)\colon= \left\{ x\in (0,1]: d_n^{t_0} \cdots d_{n+m}^{t_{m-1}}\geq Ψ(n) \text{ for infinitely many} \ n \in\mathbb{N} \right\}. \] We establish a Lebesgue measure dichotomy statement (a zero-one law) for $\mathcal{E}_{\mathbf{t}}(Ψ)$ under a natural non-removable condition $\liminf_{n\to\infty} Ψ(n)>~1$. Let $B$ be given by \[ \log B \colon= \liminf_{n\to\infty} \frac{\log(Ψ(n))}{n}. \] For any $m\in\mathbb{N}$, we compute the Hausdorff dimension of $\mathcal{E}_{\mathbf{t}}(Ψ)$ when either $B=1$ or $B=\infty$. We also compute the Hausdorff dimension of $\mathcal{E}_{\mathbf{t}}(Ψ)$ when $1<B< \infty$ for $m=2$. △ Less

Submitted 12 June, 2023; originally announced June 2023.

Comments: 24 pages. Working paper. We will keep updating by adding new related results

MSC Class: 11J70; 11J83

The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles

Authors: Md Shamim Hussain, Mohammed J. Zaki, Dharmashankar Subramanian

Abstract: Transformers use the dense self-attention mechanism which gives a lot of flexibility for long-range connectivity. Over multiple layers of a deep transformer, the number of possible connectivity patterns increases exponentially. However, very few of these contribute to the performance of the network, and even fewer are essential. We hypothesize that there are sparsely connected sub-networks within… ▽ More Transformers use the dense self-attention mechanism which gives a lot of flexibility for long-range connectivity. Over multiple layers of a deep transformer, the number of possible connectivity patterns increases exponentially. However, very few of these contribute to the performance of the network, and even fewer are essential. We hypothesize that there are sparsely connected sub-networks within a transformer, called information pathways which can be trained independently. However, the dynamic (i.e., input-dependent) nature of these pathways makes it difficult to prune dense self-attention during training. But the overall distribution of these pathways is often predictable. We take advantage of this fact to propose Stochastically Subsampled self-Attention (SSA) - a general-purpose training strategy for transformers that can reduce both the memory and computational cost of self-attention by 4 to 8 times during training while also serving as a regularization method - improving generalization over dense training. We show that an ensemble of sub-models can be formed from the subsampled pathways within a network, which can achieve better performance than its densely attended counterpart. We perform experiments on a variety of NLP, computer vision and graph learning tasks in both generative and discriminative settings to provide empirical evidence for our claims and show the effectiveness of the proposed method. △ Less

Submitted 2 June, 2023; originally announced June 2023.

Comments: KDD23 preprint, 12 pages, 7 figures, 10 tables

Securing Safety in Collaborative Cyber-Physical Systems through Fault Criticality Analysis

Authors: Manzoor Hussain, Nazakat Ali, Jang-Eui Hong

Abstract: Collaborative Cyber-Physical Systems (CCPS) are systems that contain tightly coupled physical and cyber components, massively interconnected subsystems, and collaborate to achieve a common goal. The safety of a single Cyber-Physical System (CPS) can be achieved by following the safety standards such as ISO 26262 and IEC 61508 or by applying hazard analysis techniques. However, due to the complex,… ▽ More Collaborative Cyber-Physical Systems (CCPS) are systems that contain tightly coupled physical and cyber components, massively interconnected subsystems, and collaborate to achieve a common goal. The safety of a single Cyber-Physical System (CPS) can be achieved by following the safety standards such as ISO 26262 and IEC 61508 or by applying hazard analysis techniques. However, due to the complex, highly interconnected, heterogeneous, and collaborative nature of CCPS, a fault in one CPS's components can trigger many other faults in other collaborating CPSs. Therefore, a safety assurance technique based on fault criticality analysis would require to ensure safety in CCPS. This paper presents a Fault Criticality Matrix (FCM) implemented in our tool called CPSTracer, which contains several data such as identified fault, fault criticality, safety guard, etc. The proposed FCM is based on composite hazard analysis and content-based relationships among the hazard analysis artifacts, and ensures that the safety guard controls the identified faults at design time; thus, we can effectively manage and control the fault at the design phase to ensure the safe development of CPSs. To validate our approach, we introduce a case study on the Platooning system (a collaborative CPS). We perform the criticality analysis of the Platooning system using FCM in our developed tool. After the detailed fault criticality analysis, we investigate the results to check the appropriateness and effectiveness with two research questions. Also, by performing simulation for the Platooning, we showed that the rate of collision of the Platooning system without using FCM was quite high as compared to the rate of collisions of the system after analyzing the fault criticality using FCM. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Comments: This paper is an extended version of an article submitted to KCSE-2021

Journal ref: KIPS Transactions on Software and Data Engineering, vol. 10, no. 8, pp. 287-300, 2021

An exponentially shrinking problem

Authors: Mumtaz Hussain, Junjie Shi

Abstract: The Jarník-Besicovitch theorem is a fundamental result in metric number theory which gives the Hausdorff dimension for limsup sets. We investigate a related problem of estimating the Hausdorff dimension of a liminf set. Let $h>0, τ\geq 1$, and for any $j\geq 1$ define the integer sequence $q_{j+1}=q_j^h$. We prove the Hausdorff dimension of the set… ▽ More The Jarník-Besicovitch theorem is a fundamental result in metric number theory which gives the Hausdorff dimension for limsup sets. We investigate a related problem of estimating the Hausdorff dimension of a liminf set. Let $h>0, τ\geq 1$, and for any $j\geq 1$ define the integer sequence $q_{j+1}=q_j^h$. We prove the Hausdorff dimension of the set $$Λ^\bftheta_d(τ)=\left\{\xx\in[0, 1)^d: \|q_jx_i-θ_i\|<q_j^{-τ} \ \text{for all } j\geq 1, i=1,2,\cdots,d\right\},$$ where $\left\|\star\right\|$ denotes the distance to the nearest integer and $\bftheta\in [0, 1)^d$ is fixed. We also give some heuristics for the Hausdorff dimension of the corresponding multiplicative set $$\MM_d^\bftheta(τ)=\left\{\xx\in[0, 1)^d:\prod_{i=1}^d \|q_jx_i-θ_i\|<q_j^{-τ} \ \text{for all } j\geq 1\right\}.$$ △ Less

Submitted 18 May, 2023; v1 submitted 20 February, 2023; originally announced February 2023.

Comments: 8 pages, any comments for improvement will be appreciated

The Baker-Schmidt problem for dual approximation and some classes of functions

Authors: Mumtaz Hussain, Johannes Schleischitz

Abstract: The Generalised Baker-Schmidt Problem (1970) concerns the Hausdorff $f$-measure of the set of $Ψ$-approximable points on a nondegenerate manifold. We refine and extend our previous work [Int. Math. Res. Not. IMRN 2021, no. 12, 8845--8867] in which we settled the problem (for dual approximation) for hypersurfaces. We verify the GBSP for certain classes of nondegenerate submanifolds of codimension g… ▽ More The Generalised Baker-Schmidt Problem (1970) concerns the Hausdorff $f$-measure of the set of $Ψ$-approximable points on a nondegenerate manifold. We refine and extend our previous work [Int. Math. Res. Not. IMRN 2021, no. 12, 8845--8867] in which we settled the problem (for dual approximation) for hypersurfaces. We verify the GBSP for certain classes of nondegenerate submanifolds of codimension greater than $1$. Concretely, for codimension two or three, we provide examples of manifolds where the dependent variables can be chosen as quadratic forms. Our method requires the manifold to have even dimension at least the minimum of four and half the dimension of the ambient space. We conjecture that these restrictions on the dimension of the manifold are sufficient to provide similar examples in general. △ Less

Submitted 20 February, 2023; originally announced February 2023.

Comments: 12 pages, any comments for improvement will be appreciated

Neuro-Symbolic World Models for Adapting to Open World Novelty

Authors: Jonathan Balloch, Zhiyu Lin, Robert Wright, Xiangyu Peng, Mustafa Hussain, Aarun Srinivas, Julia Kim, Mark O. Riedl

Abstract: Open-world novelty--a sudden change in the mechanics or properties of an environment--is a common occurrence in the real world. Novelty adaptation is an agent's ability to improve its policy performance post-novelty. Most reinforcement learning (RL) methods assume that the world is a closed, fixed process. Consequentially, RL policies adapt inefficiently to novelties. To address this, we introduce… ▽ More Open-world novelty--a sudden change in the mechanics or properties of an environment--is a common occurrence in the real world. Novelty adaptation is an agent's ability to improve its policy performance post-novelty. Most reinforcement learning (RL) methods assume that the world is a closed, fixed process. Consequentially, RL policies adapt inefficiently to novelties. To address this, we introduce WorldCloner, an end-to-end trainable neuro-symbolic world model for rapid novelty adaptation. WorldCloner learns an efficient symbolic representation of the pre-novelty environment transitions, and uses this transition model to detect novelty and efficiently adapt to novelty in a single-shot fashion. Additionally, WorldCloner augments the policy learning process using imagination-based adaptation, where the world model simulates transitions of the post-novelty environment to help the policy adapt. By blending ''imagined'' transitions with interactions in the post-novelty environment, performance can be recovered with fewer total environment interactions. Using environments designed for studying novelty in sequential decision-making problems, we show that the symbolic world model helps its neural policy adapt more efficiently than model-based and model-based neural-only reinforcement learning methods. △ Less

Submitted 16 January, 2023; originally announced January 2023.

Comments: 9 pages, 8 figures, Extended Abstract accepted for presentation at AAMAS 2023

Biomedical image analysis competitions: The state of current participation practice

Authors: Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu Dietlinde Tizabi, Fabian Isensee, Tim J. Adler, Patrick Godau, Veronika Cheplygina, Michal Kozubek, Sharib Ali, Anubha Gupta, Jan Kybic, Alison Noble, Carlos Ortiz de Solórzano, Samiksha Pachade, Caroline Petitjean, Daniel Sage, Donglai Wei, Elizabeth Wilden, Deepak Alapatt, Vincent Andrearczyk, Ujjwal Baid, Spyridon Bakas, Niranjan Balu, Sophia Bano , et al. (331 additional authors not shown)

Abstract: The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis,… ▽ More The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis, we designed an international survey that was issued to all participants of challenges conducted in conjunction with the IEEE ISBI 2021 and MICCAI 2021 conferences (80 competitions in total). The survey covered participants' expertise and working environments, their chosen strategies, as well as algorithm characteristics. A median of 72% challenge participants took part in the survey. According to our results, knowledge exchange was the primary incentive (70%) for participation, while the reception of prize money played only a minor role (16%). While a median of 80 working hours was spent on method development, a large portion of participants stated that they did not have enough time for method development (32%). 25% perceived the infrastructure to be a bottleneck. Overall, 94% of all solutions were deep learning-based. Of these, 84% were based on standard architectures. 43% of the respondents reported that the data samples (e.g., images) were too large to be processed at once. This was most commonly addressed by patch-based training (69%), downsampling (37%), and solving 3D analysis tasks as a series of 2D tasks. K-fold cross-validation on the training set was performed by only 37% of the participants and only 50% of the participants performed ensembling based on multiple identical models (61%) or heterogeneous models (39%). 48% of the respondents applied postprocessing steps. △ Less

Submitted 12 September, 2023; v1 submitted 16 December, 2022; originally announced December 2022.

Evidence of Antineutrinos from Distant Reactors using Pure Water at SNO+

Authors: SNO+ Collaboration, :, A. Allega, M. R. Anderson, S. Andringa, J. Antunes, M. Askins, D. J. Auty, A. Bacon, N. Barros, F. Barao, R. Bayes, E. W. Beier, T. S. Bezerra, A. Bialek, S. D. Biller, E. Blucher, E. Caden, E. J. Callaghan, S. Cheng, M. Chen, B. Cleveland, D. Cookman, J. Corning, M. A. Cox , et al. (92 additional authors not shown)

Abstract: The SNO+ Collaboration reports the first evidence of reactor antineutrinos in a Cherenkov detector. The nearest nuclear reactors are located 240~km away in Ontario, Canada. This analysis uses events with energies lower than in any previous analysis with a large water Cherenkov detector. Two analytical methods are used to distinguish reactor antineutrinos from background events in 190 days of data… ▽ More The SNO+ Collaboration reports the first evidence of reactor antineutrinos in a Cherenkov detector. The nearest nuclear reactors are located 240~km away in Ontario, Canada. This analysis uses events with energies lower than in any previous analysis with a large water Cherenkov detector. Two analytical methods are used to distinguish reactor antineutrinos from background events in 190 days of data and yield consistent evidence for antineutrinos with a combined significance of 3.5$σ$. △ Less

Submitted 28 March, 2023; v1 submitted 25 October, 2022; originally announced October 2022.

Comments: v2: add missing author, add link to supplemental material v3: minor updates to match PRL publication

Journal ref: Phys.Rev.Lett. 130 (2023) 9, 091801

A Hausdorff dimension analysis of sets with the product of consecutive vs single partial quotients in continued fractions

Authors: Mumtaz Hussain, Bixuan Li, Nikita Shulga

Abstract: We present a detailed Hausdorff dimension analysis of the set of real numbers where the product of consecutive partial quotients in their continued fraction expansion grow at a certain rate but the growth of the single partial quotient is at a different rate. We consider the set \begin{equation*} \FF(Φ_1,Φ_2) \defeq \EE(Φ_1) \backslash \EE(Φ_2)=\left\{x\in[0,1): \begin{split} a_n(x)a_{n+1}(x) &… ▽ More We present a detailed Hausdorff dimension analysis of the set of real numbers where the product of consecutive partial quotients in their continued fraction expansion grow at a certain rate but the growth of the single partial quotient is at a different rate. We consider the set \begin{equation*} \FF(Φ_1,Φ_2) \defeq \EE(Φ_1) \backslash \EE(Φ_2)=\left\{x\in[0,1): \begin{split} a_n(x)a_{n+1}(x) & \geqΦ_1(n) \text{\,\, for infinitely many } n\in\N a_{n+1}(x) & <Φ_2(n) \text{\,\, for all sufficiently large } n\in\N \end{split} \right\}, \end{equation*} where $Φ_i:\N\to(0,\infty)$ are any functions such that $\lim\limits_{n\to\infty} Φ_i(n)=\infty$. We obtain some surprising results including the situations when $\FF(Φ_1,Φ_2)$ is empty for various non-trivial choices of $Φ_i$'s. Our results contribute to the metrical theory of continued fractions by generalising several known results including the main result of [Nonlinearity, 33(6):2615--2639, 2020]. To obtain some of the results, we consider an alternate generalised set, which may be of independent interest, and calculate its Hausdorff dimension. One of the main ingredients is in the usage of the classical mass distribution principle; specifically a careful distribution of the mass on the Cantor subset by introducing a new idea of two different types of probability measures. △ Less

Submitted 18 August, 2022; originally announced August 2022.

Comments: 26 pages, any comments for improvement are appreciated

MSC Class: 11K50; 11A55; 11J83; 28A78; 28A80

Self-probed ptychography from semiconductor high-harmonic generation

Authors: Sven Fröhlich, Xu Liu, Aimrane Hamdou, Alric Meunier, Mukhtar Hussain, Mathieu Carole, Shatha Kaassamani, Marie Froidevaux, Laure Lavoute, Dmitry Gaponov, Nicolas Ducros, Sebastien Fevrier, Philippe Zeitoun, Milutin Kovacev, Marta Fajardo, Willem Boutu, David Gauthier, Hamed Merdji

Abstract: We demonstrate a method to image an object using a self-probing approach based on semiconductor high-harmonic generation. On one hand, ptychography enables high-resolution imaging from the coherent light diffracted by an object. On the other hand, high-harmonic generation from crystals is emerging as a new source of extreme-ultraviolet ultrafast coherent light. We combine these two techniques by p… ▽ More We demonstrate a method to image an object using a self-probing approach based on semiconductor high-harmonic generation. On one hand, ptychography enables high-resolution imaging from the coherent light diffracted by an object. On the other hand, high-harmonic generation from crystals is emerging as a new source of extreme-ultraviolet ultrafast coherent light. We combine these two techniques by performing ptychography measurements with nano-patterned crystals serving as the object as well as the generation medium of the harmonics. We demonstrate that this strong field in situ approach can provide structural information about the object. With the future developments of crystal high harmonics as a compact short-wavelength light source, our demonstration can be an innovative approach for nanoscale imaging of photonic and electronic devices in research and industry. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Improved search for invisible modes of nucleon decay in water with the SNO+ detector

Authors: SNO+ Collaboration, :, A. Allega, M. R. Anderson, S. Andringa, M. Askins, D. J. Auty, A. Bacon, N. Barros, F. Barão, R. Bayes, E. W. Beier, T. S. Bezerra, A. Bialek, S. D. Biller, E. Blucher, E. Caden, E. J. Callaghan, S. Cheng, M. Chen, O. Chkvorets, B. Cleveland, D. Cookman, J. Corning, M. A. Cox , et al. (94 additional authors not shown)

Abstract: This paper reports results from a search for single and multi-nucleon disappearance from the $^{16}$O nucleus in water within the \snoplus{} detector using all of the available data. These so-called "invisible" decays do not directly deposit energy within the detector but are instead detected through their subsequent nuclear de-excitation and gamma-ray emission. New limits are given for the partia… ▽ More This paper reports results from a search for single and multi-nucleon disappearance from the $^{16}$O nucleus in water within the \snoplus{} detector using all of the available data. These so-called "invisible" decays do not directly deposit energy within the detector but are instead detected through their subsequent nuclear de-excitation and gamma-ray emission. New limits are given for the partial lifetimes: $τ(n\rightarrow inv) > 9.0\times10^{29}$ years, $τ(p\rightarrow inv) > 9.6\times10^{29}$ years, $τ(nn\rightarrow inv) > 1.5\times10^{28}$ years, $τ(np\rightarrow inv) > 6.0\times10^{28}$ years, and $τ(pp\rightarrow inv) > 1.1\times10^{29}$ years at 90\% Bayesian credibility level (with a prior uniform in rate). All but the ($nn\rightarrow inv$) results improve on existing limits by a factor of about 3. △ Less

Submitted 28 June, 2022; v1 submitted 12 May, 2022; originally announced May 2022.

Journal ref: Phys. Rev. D 105, 112012 (2022)

Prospective pathways of green graphene-based lab-on-chip devices: the pursuit toward sustainability

Authors: Joydip Sengupta, Chaudhery Mustansar Hussain

Abstract: At present, analytical lab-on-chip devices find their usage in different facets of chemical analysis, biological analysis, point of care analysis, biosensors, etc. In addition, graphene has already established itself as an essential component of advanced lab-on-chip devices. Graphene-based lab-on-chip devices have achieved appreciable admiration because of their peerless performance in comparison… ▽ More At present, analytical lab-on-chip devices find their usage in different facets of chemical analysis, biological analysis, point of care analysis, biosensors, etc. In addition, graphene has already established itself as an essential component of advanced lab-on-chip devices. Graphene-based lab-on-chip devices have achieved appreciable admiration because of their peerless performance in comparison to others. However, to accomplish a sustainable future a device must undergo Green-Screening to check its environmental compatibility. Thus, extensive research is carried out globally to make the graphene-based lab-on-chip green, though it is yet to be achieved. Nevertheless, as a ray of hope, there are few existing strategies that can be stitched together for feasible fabrication of environment-friendly green graphene-based analytical lab-on-chip, and those prospective pathways are reviewed in this paper. △ Less

Submitted 6 April, 2022; originally announced April 2022.

Comments: Lab-on-chip (LOC), Biodegradable material, Graphene, Green technology, Sustainability, Commercialization

Journal ref: Microchimica Acta (2022) 189, 177

NovGrid: A Flexible Grid World for Evaluating Agent Response to Novelty

Authors: Jonathan Balloch, Zhiyu Lin, Mustafa Hussain, Aarun Srinivas, Robert Wright, Xiangyu Peng, Julia Kim, Mark Riedl

Abstract: A robust body of reinforcement learning techniques have been developed to solve complex sequential decision making problems. However, these methods assume that train and evaluation tasks come from similarly or identically distributed environments. This assumption does not hold in real life where small novel changes to the environment can make a previously learned policy fail or introduce simpler s… ▽ More A robust body of reinforcement learning techniques have been developed to solve complex sequential decision making problems. However, these methods assume that train and evaluation tasks come from similarly or identically distributed environments. This assumption does not hold in real life where small novel changes to the environment can make a previously learned policy fail or introduce simpler solutions that might never be found. To that end we explore the concept of {\em novelty}, defined in this work as the sudden change to the mechanics or properties of environment. We provide an ontology of for novelties most relevant to sequential decision making, which distinguishes between novelties that affect objects versus actions, unary properties versus non-unary relations, and the distribution of solutions to a task. We introduce NovGrid, a novelty generation framework built on MiniGrid, acting as a toolkit for rapidly develo** and evaluating novelty-adaptation-enabled reinforcement learning techniques. Along with the core NovGrid we provide exemplar novelties aligned with our ontology and instantiate them as novelty templates that can be applied to many MiniGrid-compliant environments. Finally, we present a set of metrics built into our framework for the evaluation of novelty-adaptation-enabled machine-learning techniques, and show characteristics of a baseline RL model using these metrics. △ Less

Submitted 22 March, 2022; originally announced March 2022.

Comments: 7 pages, 4 figures, AAAI Spring Symposium 2022 on Designing Artificial Intelligence for Open Worlds (Long Oral)

Measurement of double-$β$ decay of $^{150}$Nd to the 0$^+_1$ excited state of $^{150}$Sm in NEMO-3

Authors: NEMO-3 Collaboration, :, X. Aguerre, R. Arnold, C. Augier, A. S. Barabash, A. Basharina-Freshville, S. Blondel, S. Blot, M. Bongrand, R. Breier, V. Brudanin, J. Busto, A. Bystryakov, A. J. Caffrey, C. Cerna, J. P. Cesar, M. Ceschia, E. Chauveau, A. Chopra, L. Dawson, D. Duchesneau, D. Durand, J. J. Evans, R. Flack , et al. (72 additional authors not shown)

Abstract: The NEMO-3 results for the double-$β$ decay of $^{150}$Nd to the 0$^+_1$ and 2$^+_1$ excited states of $^{150}$Sm are reported. The data recorded during 5.25 yr with 36.6 g of the isotope $^{150}$Nd are used in the analysis. For the first time, the signal of the $2νββ$ transition to the 0$^+_1$ excited state is detected with a statistical significance exceeding 5$σ$. The half-life is measured to b… ▽ More The NEMO-3 results for the double-$β$ decay of $^{150}$Nd to the 0$^+_1$ and 2$^+_1$ excited states of $^{150}$Sm are reported. The data recorded during 5.25 yr with 36.6 g of the isotope $^{150}$Nd are used in the analysis. For the first time, the signal of the $2νββ$ transition to the 0$^+_1$ excited state is detected with a statistical significance exceeding 5$σ$. The half-life is measured to be $T_{1/2}^{2νββ}(0^+_1) = \left[ 1.11 ^{+0.19}_{-0.14} \,\left(\mbox{stat}\right) ^{+0.17}_{-0.15}\, \left(\mbox{syst}\right) \right] \times10^{20}\,\mbox{yr}$. The limits are set on the $2νββ$ decay to the 2$^+_1$ level and on the $0νββ$ decay to the 0$^+_1$ and 2$^+_1$ levels of $^{150}$Sm. △ Less

Submitted 29 August, 2023; v1 submitted 7 March, 2022; originally announced March 2022.

Comments: Minor corrections

Metrical theorems for unconventional height functions

Authors: Mumtaz Hussain

Abstract: In this paper, we consider the simultaneous approximation of real points by rational points with the error of approximation given by the functions of `non-standard' heights. We prove analogues of Khintchine and Jarník-Besicovitch theorems for this setting, thus answering some questions raised by Fishman and Simmons (2017). In this paper, we consider the simultaneous approximation of real points by rational points with the error of approximation given by the functions of `non-standard' heights. We prove analogues of Khintchine and Jarník-Besicovitch theorems for this setting, thus answering some questions raised by Fishman and Simmons (2017). △ Less

Submitted 23 February, 2022; originally announced February 2022.

Comments: 6 pages, comments welcome

Journal ref: J. Math. Anal. Appl. 515 (2022), no. 2, Paper No. 126454

Metrical properties for the weighted products of multiple partial quotients in continued fractions

Authors: Ayreena Bakhtawar, Mumtaz Hussain, Dmitry Kleinbock, Bao-Wei Wang

Abstract: The classical Khintchine and Jarník theorems, generalizations of a consequence of Dirichlet's theorem, are fundamental results in the theory of Diophantine approximation. These theorems are concerned with the size of the set of real numbers for which the partial quotients in their continued fraction expansions grows with a certain rate. Recently it was observed that the growth of product of pairs… ▽ More The classical Khintchine and Jarník theorems, generalizations of a consequence of Dirichlet's theorem, are fundamental results in the theory of Diophantine approximation. These theorems are concerned with the size of the set of real numbers for which the partial quotients in their continued fraction expansions grows with a certain rate. Recently it was observed that the growth of product of pairs of consecutive partial quotients in the continued fraction expansion of a real number is associated with improvements to Dirichlet's theorem. In this paper we consider the products of several consecutive partial quotients raised to different powers. Namely, we find the Lebesgue measure and the Hausdorff dimension of the following set: $$ {\D_{\mathbf t}}(ψ):=\left\{x\in[0, 1): \prod\limits_{i=0}^{m-1}{a^{t_i}_{n+i}(x)} \ge Ψ(n)\ {\text{for infinitely many}} \ n\in \N \right\}, $$ where $t_i\in\mathbb R_+$ for all ${0\leq i\leq m-1}$, and $Ψ:\N\to\R_{\ge 1}$ is a positive function. △ Less

Submitted 22 February, 2022; originally announced February 2022.

Comments: 27 pages

Parallel Algorithms for Adding a Collection of Sparse Matrices

Authors: Md Taufique Hussain, Guttu Sai Abhishek, Aydin Buluç, Ariful Azad

Abstract: We develop a family of parallel algorithms for the SpKAdd operation that adds a collection of k sparse matrices. SpKAdd is a much needed operation in many applications including distributed memory sparse matrix-matrix multiplication (SpGEMM), streaming accumulations of graphs, and algorithmic sparsification of the gradient updates in deep learning. While adding two sparse matrices is a common oper… ▽ More We develop a family of parallel algorithms for the SpKAdd operation that adds a collection of k sparse matrices. SpKAdd is a much needed operation in many applications including distributed memory sparse matrix-matrix multiplication (SpGEMM), streaming accumulations of graphs, and algorithmic sparsification of the gradient updates in deep learning. While adding two sparse matrices is a common operation in Matlab, Python, Intel MKL, and various GraphBLAS libraries, these implementations do not perform well when adding a large collection of sparse matrices. We develop a series of algorithms using tree merging, heap, sparse accumulator, hash table, and sliding hash table data structures. Among them, hash-based algorithms attain the theoretical lower bounds both on the computational and I/O complexities and perform the best in practice. The newly-developed hash SpKAdd makes the computation of a distributed-memory SpGEMM algorithm at least 2x faster than that the previous state-of-the-art algorithms. △ Less

Submitted 19 December, 2021; originally announced December 2021.

DeepGuard: A Framework for Safeguarding Autonomous Driving Systems from Inconsistent Behavior

Authors: Manzoor Hussain, Nazakat Ali, Jang-Eui Hong

Abstract: The deep neural networks (DNNs)based autonomous driving systems (ADSs) are expected to reduce road accidents and improve safety in the transportation domain as it removes the factor of human error from driving tasks. The DNN based ADS sometimes may exhibit erroneous or unexpected behaviors due to unexpected driving conditions which may cause accidents. It is not possible to generalize the DNN mode… ▽ More The deep neural networks (DNNs)based autonomous driving systems (ADSs) are expected to reduce road accidents and improve safety in the transportation domain as it removes the factor of human error from driving tasks. The DNN based ADS sometimes may exhibit erroneous or unexpected behaviors due to unexpected driving conditions which may cause accidents. It is not possible to generalize the DNN model performance for all driving conditions. Therefore, the driving conditions that were not considered during the training of the ADS may lead to unpredictable consequences for the safety of autonomous vehicles. This study proposes an autoencoder and time series analysis based anomaly detection system to prevent the safety critical inconsistent behavior of autonomous vehicles at runtime. Our approach called DeepGuard consists of two components. The first component, the inconsistent behavior predictor, is based on an autoencoder and time series analysis to reconstruct the driving scenarios. Based on reconstruction error and threshold it determines the normal and unexpected driving scenarios and predicts potential inconsistent behavior. The second component provides on the fly safety guards, that is, it automatically activates healing strategies to prevent inconsistencies in the behavior. We evaluated the performance of DeepGuard in predicting the injected anomalous driving scenarios using already available open sourced DNN based ADSs in the Udacity simulator. Our simulation results show that the best variant of DeepGuard can predict up to 93 percent on the CHAUFFEUR ADS, 83 percent on DAVE2 ADS, and 80 percent of inconsistent behavior on the EPOCH ADS model, outperforming SELFORACLE and DeepRoad. Overall, DeepGuard can prevent up to 89 percent of all predicted inconsistent behaviors of ADS by executing predefined safety guards. △ Less

Submitted 5 April, 2022; v1 submitted 18 November, 2021; originally announced November 2021.

Comments: 22 pages

Limit theorems for sums of products of consecutive partial quotients of continued fractions

Authors: Hui Hu, Mumtaz Hussain, Yueli Yu

Abstract: Let $[a_1(x),a_2(x),\ldots, a_n(x), \ldots]$ be the continued fraction expansion of an irrational number $x\in (0, 1)$. The study of the growth rate of the product of consecutive partial quotients $a_n(x)a_{n+1}(x)$ is associated with the improvements to Dirichlet's theorem (1842). We establish both the weak and strong laws of large numbers for the partial sums… ▽ More Let $[a_1(x),a_2(x),\ldots, a_n(x), \ldots]$ be the continued fraction expansion of an irrational number $x\in (0, 1)$. The study of the growth rate of the product of consecutive partial quotients $a_n(x)a_{n+1}(x)$ is associated with the improvements to Dirichlet's theorem (1842). We establish both the weak and strong laws of large numbers for the partial sums $S_n(x)= \sum_{i=1}^n a_i(x)a_{i+1}(x)$ as well as, from a multifractal analysis point of view, investigate its increasing rate. Specifically, we prove the following results: \medskip \begin{itemize} \item For any $ε>0$, the Lebesgue measure of the set $$\left\{x\in(0, 1): \left|\frac{ S_n(x)}{n\log^2 n}-\frac1{2\log2}\right|\geq ε\right\}$$tends to zero as $n$ to infinity. \item For Lebesgue almost all $x\in (0,1)$, $$\lim\limits_{n\rightarrow \infty} \frac{S_n(x)-\max\limits_{1\leq i \leq n}a_i(x)a_{i+1}(x)}{n\log^2n}=\frac{1}{2\log2}.$$ \item The Hausdorff dimension of the set $$E(φ):=\left\{x\in(0,1):\lim\limits_{n\rightarrow \infty}\frac{S_n(x)}{φ(n)}=1\right\}$$ is determined for a range of increasing functions $φ: \mathbb N\to \mathbb R^+$. \end{itemize} △ Less

Submitted 23 February, 2022; v1 submitted 24 October, 2021; originally announced October 2021.

Comments: 27 pages

Journal ref: Nonlinearity 34 (2021), no. 12, 8143--8173

Designing the Architecture of a Convolutional Neural Network Automatically for Diabetic Retinopathy Diagnosis

Authors: Fahman Saeed, Muhammad Hussain, Hatim A Aboalsamh, Fadwa Al Adel, Adi Mohammed Al Owaifeer

Abstract: The prevalence of diabetic retinopathy (DR) has reached 34.6% worldwide and is a major cause of blindness among middle-aged diabetic patients. Regular DR screening using fundus photography helps detect its complications and prevent its progression to advanced levels. As manual screening is time-consuming and subjective, machine learning (ML) and deep learning (DL) have been employed to aid graders… ▽ More The prevalence of diabetic retinopathy (DR) has reached 34.6% worldwide and is a major cause of blindness among middle-aged diabetic patients. Regular DR screening using fundus photography helps detect its complications and prevent its progression to advanced levels. As manual screening is time-consuming and subjective, machine learning (ML) and deep learning (DL) have been employed to aid graders. However, the existing CNN-based methods use either pre-trained CNN models or a brute force approach to design new CNN models, which are not customized to the complexity of fundus images. To overcome this issue, we introduce an approach for custom-design of CNN models, whose architectures are adapted to the structural patterns of fundus images and better represent the DR-relevant features. It takes the leverage of k-medoid clustering, principal component analysis (PCA), and inter-class and intra-class variations to automatically determine the depth and width of a CNN model. The designed models are lightweight, adapted to the internal structures of fundus images, and encode the discriminative patterns of DR lesions. The technique is validated on a local dataset from King Saud University Medical City, Saudi Arabia, and two challenging benchmark datasets from Kaggle: EyePACS and APTOS2019. The custom-designed models outperform the famous pre-trained CNN models like ResNet152, Densnet121, and ResNeSt50 with a significant decrease in the number of parameters and compete well with the state-of-the-art CNN-based DR screening methods. The proposed approach is helpful for DR screening under diverse clinical settings and referring the patients who may need further assessment and treatment to expert ophthalmologists. △ Less

Submitted 7 November, 2022; v1 submitted 7 October, 2021; originally announced October 2021.

Comments: 20 pages, 6 figures

Robust Multi-Domain Mitosis Detection

Authors: Mustaffa Hussain, Ritesh Gangnani, Sasidhar Kadiyala

Abstract: Domain variability is a common bottle neck in develo** generalisable algorithms for various medical applications. Motivated by the observation that the domain variability of the medical images is to some extent compact, we propose to learn a target representative feature space through unpaired image to image translation (CycleGAN). We comprehensively evaluate the performanceand usefulness by uti… ▽ More Domain variability is a common bottle neck in develo** generalisable algorithms for various medical applications. Motivated by the observation that the domain variability of the medical images is to some extent compact, we propose to learn a target representative feature space through unpaired image to image translation (CycleGAN). We comprehensively evaluate the performanceand usefulness by utilising the transformation to mitosis detection with candidate proposal and classification. This work presents a simple yet effective multi-step mitotic figure detection algorithm developed as a baseline for the MIDOG challenge. On the preliminary test set, the algorithm scoresan F1 score of 0.52. △ Less

Submitted 13 September, 2021; originally announced September 2021.

Comments: 3 pages, 2 figures