Showing 1–50 of 111 results for author: Jaiswal, S

DataFreeShield: Defending Adversarial Attacks without Training Data

Authors: Hyeyoon Lee, Kanghyun Choi, Dain Kwon, Sunjong Park, Mayoore Selvarasa Jaiswal, Noseong Park, Jonghyun Choi, **ho Lee

Abstract: Recent advances in adversarial robustness rely on an abundant set of training data, where using external or additional datasets has become a common setting. However, in real life, the training data is often kept private for security and privacy issues, while only the pretrained weight is available to the public. In such scenarios, existing methods that assume accessibility to the original data bec… ▽ More Recent advances in adversarial robustness rely on an abundant set of training data, where using external or additional datasets has become a common setting. However, in real life, the training data is often kept private for security and privacy issues, while only the pretrained weight is available to the public. In such scenarios, existing methods that assume accessibility to the original data become inapplicable. Thus we investigate the pivotal problem of data-free adversarial robustness, where we try to achieve adversarial robustness without accessing any real data. Through a preliminary study, we highlight the severity of the problem by showing that robustness without the original dataset is difficult to achieve, even with similar domain datasets. To address this issue, we propose DataFreeShield, which tackles the problem from two perspectives: surrogate dataset generation and adversarial training using the generated data. Through extensive validation, we show that DataFreeShield outperforms baselines, demonstrating that the proposed method sets the first entirely data-free solution for the adversarial robustness problem. △ Less

Submitted 21 June, 2024; originally announced June 2024.

Comments: ICML 2024

Eye in the Sky: Detection and Compliance Monitoring of Brick Kilns using Satellite Imagery

Authors: Rishabh Mondal, Shataxi Dubey, Vannsh Jani, Shrimay Shah, Suraj Jaiswal, Zeel B Patel, Nipun Batra

Abstract: Air pollution kills 7 million people annually. The brick manufacturing industry accounts for 8%-14% of air pollution in the densely populated Indo-Gangetic plain. Due to the unorganized nature of brick kilns, policy violation detection, such as proximity to human habitats, remains challenging. While previous studies have utilized computer vision-based machine learning methods for brick kiln detect… ▽ More Air pollution kills 7 million people annually. The brick manufacturing industry accounts for 8%-14% of air pollution in the densely populated Indo-Gangetic plain. Due to the unorganized nature of brick kilns, policy violation detection, such as proximity to human habitats, remains challenging. While previous studies have utilized computer vision-based machine learning methods for brick kiln detection from satellite imagery, they utilize proprietary satellite data and rarely focus on compliance with government policies. In this research, we introduce a scalable framework for brick kiln detection and automatic compliance monitoring. We use Google Maps Static API to download the satellite imagery followed by the YOLOv8x model for detection. We identified and hand-verified 19579 new brick kilns across 9 states within the Indo-Gangetic plain. Furthermore, we automate and test the compliance to the policies affecting human habitats, rivers and hospitals. Our results show that a substantial number of brick kilns do not meet the compliance requirements. Our framework offers a valuable tool for governments worldwide to automate and enforce policy regulations for brick kilns, addressing critical environmental and public health concerns. △ Less

Submitted 23 June, 2024; v1 submitted 15 June, 2024; originally announced June 2024.

Comments: The PI was not in favour of making the work public on arXiv as the content is not yet ready to be released

Diffusiophoretic Brownian dynamics: characterization of hydrodynamic effects for an active chemoattractive polymer

Authors: Surabhi Jaiswal, Marisol Ripoll, Snigdha Thakur

Abstract: The phoretic Brownian dynamics method is shown here to be an effective approach to simulate the properties of colloidal chemophoretic based systems. The method is then optimized to allow for the comparison with results from multiparticle collision dynamics, a hydrodynamic method with explicit solvent, which can also be employed in the case of chemoattractive polymers. In order to obtain a good mat… ▽ More The phoretic Brownian dynamics method is shown here to be an effective approach to simulate the properties of colloidal chemophoretic based systems. The method is then optimized to allow for the comparison with results from multiparticle collision dynamics, a hydrodynamic method with explicit solvent, which can also be employed in the case of chemoattractive polymers. In order to obtain a good match of the conformational equilibrium properties of the models without and with explicit solvent, we propose a modified version of the phoretic Brownian dynamics accounting for the explicit solvent induced swelling. In the presence of activity, chemoattractive polymers show a transition to a compact globular state and hydrodynamics have a non-trivial influence in the polymer collapse times. The phoretic Brownian method can then be applied to much longer polymers, which allows the observation of a non-monotonous growth of both, the radius of gyration and the relaxation time with polymer length, for such chemoattractive active polymers. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Comments: 10 pages, 8 figures

Inverse Cluster Magnification Problem and Cluster Towers

Authors: Shubham Jaiswal

Abstract: Inspired from the work of M Krithika and P Vanchinathan on Cluster Magnification, we state the Inverse Cluster Magnification Problem in this article and establish an equivalent criterion for that. We provide an important example answering a question about Cluster Towers. We also provide some generalisations and alternate proofs of results of Perlis and results of Krithika and Vanchinathan on Clust… ▽ More Inspired from the work of M Krithika and P Vanchinathan on Cluster Magnification, we state the Inverse Cluster Magnification Problem in this article and establish an equivalent criterion for that. We provide an important example answering a question about Cluster Towers. We also provide some generalisations and alternate proofs of results of Perlis and results of Krithika and Vanchinathan on Cluster Size. △ Less

Submitted 10 May, 2024; originally announced May 2024.

Comments: 9 pages

MSC Class: 11R32; 12F05; 12F10

Asymptotic behaviour of the Bergman invariant and Kobayashi metric on exponentially flat infinite type domains

Authors: Ravi Shankar Jaiswal

Abstract: We prove the nontangential asymptotic limits of the Bergman canonical invariant, Ricci and Scalar curvatures of the Bergman metric, as well as the Kobayashi--Fuks metric, at exponentially flat infinite type boundary points of smooth bounded pseudoconvex domains in $\mathbb{C}^{n + 1}, \, n \in \mathbb{N}$. Additionally, we establish the nontangential asymptotic limit of the Kobayashi metric at exp… ▽ More We prove the nontangential asymptotic limits of the Bergman canonical invariant, Ricci and Scalar curvatures of the Bergman metric, as well as the Kobayashi--Fuks metric, at exponentially flat infinite type boundary points of smooth bounded pseudoconvex domains in $\mathbb{C}^{n + 1}, \, n \in \mathbb{N}$. Additionally, we establish the nontangential asymptotic limit of the Kobayashi metric at exponentially flat infinite type boundary points of smooth bounded domains in $\mathbb{C}^{n + 1}, \, n \in \mathbb{N}$. We first show that these objects satisfy appropriate localizations and then utilize the method of scaling to complete the proofs. △ Less

Submitted 2 April, 2024; v1 submitted 7 March, 2024; originally announced March 2024.

Comments: 23 pages, comments welcome

MSC Class: 32A36; 32F45 (Primary); 32T27 (Secondary)

Right Splitting, Galois Correspondence, Galois Representations and Inverse Galois Problem

Authors: Chandrasheel Bhagwat, Shubham Jaiswal

Abstract: In this article, we realize some groups as Galois groups over rational numbers and finite extension of rational numbers by studying right splitting of some exact sequences, Galois correspondence and algebraic operations on Galois representations. In this article, we realize some groups as Galois groups over rational numbers and finite extension of rational numbers by studying right splitting of some exact sequences, Galois correspondence and algebraic operations on Galois representations. △ Less

Submitted 21 March, 2024; originally announced March 2024.

Comments: 21 pages

MSC Class: 11R32; 12F12; 11F80

Mask-up: Investigating Biases in Face Re-identification for Masked Faces

Authors: Siddharth D Jaiswal, Ankit Kr. Verma, Animesh Mukherjee

Abstract: AI based Face Recognition Systems (FRSs) are now widely distributed and deployed as MLaaS solutions all over the world, moreso since the COVID-19 pandemic for tasks ranging from validating individuals' faces while buying SIM cards to surveillance of citizens. Extensive biases have been reported against marginalized groups in these systems and have led to highly discriminatory outcomes. The post-pa… ▽ More AI based Face Recognition Systems (FRSs) are now widely distributed and deployed as MLaaS solutions all over the world, moreso since the COVID-19 pandemic for tasks ranging from validating individuals' faces while buying SIM cards to surveillance of citizens. Extensive biases have been reported against marginalized groups in these systems and have led to highly discriminatory outcomes. The post-pandemic world has normalized wearing face masks but FRSs have not kept up with the changing times. As a result, these systems are susceptible to mask based face occlusion. In this study, we audit four commercial and nine open-source FRSs for the task of face re-identification between different varieties of masked and unmasked images across five benchmark datasets (total 14,722 images). These simulate a realistic validation/surveillance task as deployed in all major countries around the world. Three of the commercial and five of the open-source FRSs are highly inaccurate; they further perpetuate biases against non-White individuals, with the lowest accuracy being 0%. A survey for the same task with 85 human participants also results in a low accuracy of 40%. Thus a human-in-the-loop moderation in the pipeline does not alleviate the concerns, as has been frequently hypothesized in literature. Our large-scale study shows that developers, lawmakers and users of such services need to rethink the design principles behind FRSs, especially for the task of face re-identification, taking cognizance of observed biases. △ Less

Submitted 21 February, 2024; originally announced February 2024.

Comments: This work has been submitted to the IEEE for possible publication

A Machine Learning made Catalog of FR-II Radio Galaxies from the FIRST Survey

Authors: Bao-Qiang Lao, Xiao-Long Yang, Sumit Jaiswal, Prashanth Mohan, Xiao-Hui Sun, Sheng-Li Qin, Ru-Shuang Zhao

Abstract: We present an independent catalog (FRIIRGcat) of 45,241 Fanaroff-Riley Type II (FR-II) radio galaxies compiled from the Very Large Array Faint Images of the Radio Sky at Twenty-centimeters (FIRST) survey and employed the deep learning method. Among them, optical and/or infrared counterparts are identified for 41,425 FR-IIs. This catalog spans luminosities… ▽ More We present an independent catalog (FRIIRGcat) of 45,241 Fanaroff-Riley Type II (FR-II) radio galaxies compiled from the Very Large Array Faint Images of the Radio Sky at Twenty-centimeters (FIRST) survey and employed the deep learning method. Among them, optical and/or infrared counterparts are identified for 41,425 FR-IIs. This catalog spans luminosities $2.63\times10^{22}\leq L_{\rm rad}\leq6.76\times10^{29}\,{\rm W}\,{\rm Hz}^{-1}$ and redshifts up to $z=5.01$. The spectroscopic classification indicates that there are 1431 low-excitation radio galaxies and 260 high-excitation radio galaxies. Among the spectroscopically identified sources, black hole masses are estimated for 4837 FR-IIs, which are in $10^{7.5}\lesssim M_{\rm BH}\lesssim 10^{9.5}$ $M_{\odot}$. Interestingly, this catalog reveals a couple of giant radio galaxies (GRGs), which are already in the existing GRG catalog, confirming the efficiency of this FR-II catalog. Furthermore, 284 new GRGs are unveiled in this new FR-II sample; they have the largest projected sizes ranging from 701 to 1209 kpc and are located at redshifts $0.31<z<2.42$. Finally, we explore the distribution of the jet position angle and it shows that the faint Images of the FIRST images are significantly affected by the systematic effect (the observing beams). The method presented in this work is expected to be applicable to the radio sky surveys that are currently being conducted because they have finely refined telescope arrays. On the other hand, we are expecting that further new methods will be dedicated to solving this problem. △ Less

Submitted 6 March, 2024; v1 submitted 15 January, 2024; originally announced January 2024.

Comments: 24 pages, 17 figures, Accepted by Research in Astronomy and Astrophysics

Journal ref: 2024, Research in Astronomy and Astrophysics Volume 24, Pages 035021

Boundary behaviour of the Bergman and Szegő kernels on generalized decoupled domains

Authors: Ravi Shankar Jaiswal

Abstract: We prove optimal estimates of the Bergman and Szegő kernels on the diagonal, and the Bergman metric near the boundary of bounded smooth generalized decoupled pseudoconvex domains in $\mathbb{C}^n$. The generalized decoupled domains we consider allow the following possibilities: (a) complex tangential directions need not be decoupled separately, and (b) boundary points could have both finite and in… ▽ More We prove optimal estimates of the Bergman and Szegő kernels on the diagonal, and the Bergman metric near the boundary of bounded smooth generalized decoupled pseudoconvex domains in $\mathbb{C}^n$. The generalized decoupled domains we consider allow the following possibilities: (a) complex tangential directions need not be decoupled separately, and (b) boundary points could have both finite and infinite type directions. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Comments: 23 pages, comments welcome

MSC Class: 32A25; 32W10 (Primary); 32A36 (Secondary)

Why are hydrodynamic theories applicable beyond the hydrodynamic regime?

Authors: Sunil Jaiswal, Jean-Paul Blaizot, Rajeev S. Bhalerao, Zenan Chen, Amaresh Jaiswal, Li Yan

Abstract: We present an alternative approach to deriving second-order non-conformal hydrodynamics from the relativistic Boltzmann equation. We demonstrate how constitutive relations for shear and bulk stresses can be transformed into dynamical evolution equations, resulting in Israel-Stewart-like (ISL) hydrodynamics. To understand the far-from-equilibrium applicability of such ISL theories, we investigate t… ▽ More We present an alternative approach to deriving second-order non-conformal hydrodynamics from the relativistic Boltzmann equation. We demonstrate how constitutive relations for shear and bulk stresses can be transformed into dynamical evolution equations, resulting in Israel-Stewart-like (ISL) hydrodynamics. To understand the far-from-equilibrium applicability of such ISL theories, we investigate the one-dimensional boost-invariant Boltzmann equation using special moments of the distribution function for a system with finite particle mass. Our analysis reveals that the mathematical structure of the ISL equations is akin to that of moment equations, enabling them to approximately replicate even the collisionless dynamics. We conclude that this particular feature is important in extending the applicability of ISL theories beyond the hydrodynamic regime. △ Less

Submitted 15 December, 2023; originally announced December 2023.

Comments: Contribution to Quark Matter 2023 (4 pages)

Asymptotic behaviour of the Bergman kernel and metric

Authors: Ravi Shankar Jaiswal

Abstract: We prove nontangential asymptotic limits of the Bergman kernel on the diagonal, and the Bergman metric and its holomorphic sectional curvature at exponentially flat infinite type boundary points of smooth bounded pseudoconvex domains in $\mathbb{C}^{n+1}$, $n\in\mathbb{N}$. We first show that these objects satisfy appropriate localizations and then use the method of scaling to complete the proof. We prove nontangential asymptotic limits of the Bergman kernel on the diagonal, and the Bergman metric and its holomorphic sectional curvature at exponentially flat infinite type boundary points of smooth bounded pseudoconvex domains in $\mathbb{C}^{n+1}$, $n\in\mathbb{N}$. We first show that these objects satisfy appropriate localizations and then use the method of scaling to complete the proof. △ Less

Submitted 2 November, 2023; originally announced November 2023.

Comments: 17 pages, comments welcome

MSC Class: 32A36 (Primary); 32A25 (Secondary)

Auditing Gender Analyzers on Text Data

Authors: Siddharth D Jaiswal, Ankit Kumar Verma, Animesh Mukherjee

Abstract: AI models have become extremely popular and accessible to the general public. However, they are continuously under the scanner due to their demonstrable biases toward various sections of the society like people of color and non-binary people. In this study, we audit three existing gender analyzers -- uClassify, Readable and HackerFactor, for biases against non-binary individuals. These tools are d… ▽ More AI models have become extremely popular and accessible to the general public. However, they are continuously under the scanner due to their demonstrable biases toward various sections of the society like people of color and non-binary people. In this study, we audit three existing gender analyzers -- uClassify, Readable and HackerFactor, for biases against non-binary individuals. These tools are designed to predict only the cisgender binary labels, which leads to discrimination against non-binary members of the society. We curate two datasets -- Reddit comments (660k) and, Tumblr posts (2.05M) and our experimental evaluation shows that the tools are highly inaccurate with the overall accuracy being ~50% on all platforms. Predictions for non-binary comments on all platforms are mostly female, thus propagating the societal bias that non-binary individuals are effeminate. To address this, we fine-tune a BERT multi-label classifier on the two datasets in multiple combinations, observe an overall performance of ~77% on the most realistically deployable setting and a surprisingly higher performance of 90% for the non-binary class. We also audit ChatGPT using zero-shot prompts on a small dataset (due to high pricing) and observe an average accuracy of 58% for Reddit and Tumblr combined (with overall better results for Reddit). Thus, we show that existing systems, including highly advanced ones like ChatGPT are biased, and need better audits and moderation and, that such societal biases can be addressed and alleviated through simple off-the-shelf models like BERT trained on more gender inclusive datasets. △ Less

Submitted 9 October, 2023; originally announced October 2023.

Comments: This work has been accepted at IEEE/ACM ASONAM 2023. Please cite the version appearing in the ASONAM proceedings

INVALS: An Efficient Forward Looking Inventory Allocation System

Authors: Shiv Krishna Jaiswal, Karthik S. Gurumoorthy, Etika Agarwal, Shantala Manchenahally

Abstract: We design an Inventory Allocation System (INVALS) that, for each item-store combination, plans the quantity to be allocated from a warehouse replenishing multiple stores using trailers, while respecting the typical supply-chain constraints. We formulate a linear objective function which when maximised computes the allocation by considering not only the immediate store needs, but also its future ex… ▽ More We design an Inventory Allocation System (INVALS) that, for each item-store combination, plans the quantity to be allocated from a warehouse replenishing multiple stores using trailers, while respecting the typical supply-chain constraints. We formulate a linear objective function which when maximised computes the allocation by considering not only the immediate store needs, but also its future expected demand. Such forward-looking allocation significantly improves the labour and trailer utilisation at the warehouse. To reduce overstocking, we adapt from our objective to prioritise allocating those items in excess which are sold faster at the stores, kee** the days of supply (DOS) to a minimum. For the proposed formulation, which is an instance of Mixed Integer Linear Programming (MILP), we present a scalable algorithm using the concepts of submodularity and optimal transport theory by: (i) sequentially adding trailers to stores based on maximum incremental gain, (ii) transforming the resultant linear program (LP) instance to an instance of capacity constrained optimal transport (COT), solvable using double entropic regularization and incurring the same computational complexity as the Sinkhorn algorithm. When compared against the planning engine that does the allocation only for immediate store needs, INVALS increases on an average the labour utilization by 34.70 and item occupancy in trailers by 37.08. The DOS distribution is also skewed to the left indicating that higher demand items are allocated in excess, reducing the days they are stocked. We empirically observed that for ~ 90% of replenishment cycles, the allocation results from INVALS are identical to the globally optimal MILP solution. △ Less

Submitted 6 October, 2023; originally announced October 2023.

Structural transformation of dusty plasma crystal in DC discharge plasma by changing confinement ring bias

Authors: S. Jaiswal, Connor Belt, Anton Kananovich, E. M. Aguirre

Abstract: We report the experimental study of the structural transition of a stable complex plasma crystal to a solid-liquid phase coexistence by the controlled adjustment of the confinement potential, while kee** all other parameters constant. The experiments are carried out in a tabletop Linear Dusty Plasma Experimental (LDPEx) device which consists of a circular powered electrode and an extended ground… ▽ More We report the experimental study of the structural transition of a stable complex plasma crystal to a solid-liquid phase coexistence by the controlled adjustment of the confinement potential, while kee** all other parameters constant. The experiments are carried out in a tabletop Linear Dusty Plasma Experimental (LDPEx) device which consists of a circular powered electrode and an extended grounded cathode plate. A stationary crystal of melamine formaldehyde particles is formed in a background of Argon plasma inside a confining ring that is isolated to the cathode by a ceramic cover. The stable crystal structure breaks in the core region and transitions to a coexistent state by carefully changing the confining potential, thereby modifying the sheath structure. The transition is confirmed by evaluating the variation in different characteristic parameters such as the pair correlation function, local bond order parameter, and dust kinetic temperature as a function of confining bias potential. It is found that melting in the core is due to the onset of dust fluctuations in the layers beneath the topmost layer, which grow in amplitude as the confining bias potential is reduced below a threshold value. The present technique of changing confinement provides a unique feature to study structural transitions of plasma crystals without affecting the overall plasma parameters. △ Less

Submitted 5 October, 2023; originally announced October 2023.

Comments: 11 pages, 12 figures

Kinetic Modeling Analysis of Ar Addition to Atmospheric Pressure N2-H2 Plasma for Plasma-Assisted Catalytic Synthesis of NH3

Authors: Zihan Lin, Shota Abe, Zhe Chen, Surabhi Jaiswal, Bruce E. Koel

Abstract: Zero-dimensional kinetic modeling of atmospheric pressure Ar-N2-H2 nonthermal plasma was carried out to gain mechanistic insights into ammonia formation during plasma-assisted catalysis of ammonia synthesis. The kinetic model was developed for a coaxial dielectric barrier discharge (DBD) quartz wool-packed bed reactor operating at near room temperature using a kHz-frequency plasma source. With 30%… ▽ More Zero-dimensional kinetic modeling of atmospheric pressure Ar-N2-H2 nonthermal plasma was carried out to gain mechanistic insights into ammonia formation during plasma-assisted catalysis of ammonia synthesis. The kinetic model was developed for a coaxial dielectric barrier discharge (DBD) quartz wool-packed bed reactor operating at near room temperature using a kHz-frequency plasma source. With 30% Ar mixed in a 1:1 N2-H2 plasma at 760 Torr, we find that NH3 production is dominated by Eley-Rideal (E-R) surface reactions, which heavily involve surface NHx species derived from N and H radicals in the gas phase, while the influence of excited N2 molecules is negligible. This is contrary to the commonly proposed mechanism that excited N2 molecules created by Penning excitation of N2 by Ar (4s) and Ar(4p) plays a significant role in assisting NH3 formation. Our model shows that the enhanced NH3 formation upon Ar dilution is unlikely due to the interactions between Ar and H species, as excited Ar atoms have a weak effect on H radical formation through H2 dissociation compared to electrons. We find that excited Ar atoms contribute to 28% of the N radical production in the gas phase via N2 dissociation, while the rest is dominated by electron-impact dissociation. Furthermore, Ar species play a negligible role in the product NH3 dissociation. N2 conversion sensitivity analyses were carried out for electron density (ne) and reduced electric field (E/N), and contributions from Ar to gas-phase N radical production were quantified. The model can provide guidance on potential reasons for observing enhanced NH3 formation upon Ar dilution in N2-H2 plasmas beyond changes to the discharge characteristics. △ Less

Submitted 5 October, 2023; originally announced October 2023.

Comments: 5 figures, 3 tables

Diversify and Conquer: Bandits and Diversity for an Enhanced E-commerce Homepage Experience

Authors: Sangeet Jaiswal, Korah T Malayil, Saif Jawaid, Sreekanth Vempati

Abstract: In the realm of e-commerce, popular platforms utilize widgets to recommend advertisements and products to their users. However, the prevalence of mobile device usage on these platforms introduces a unique challenge due to the limited screen real estate available. Consequently, the positioning of relevant widgets becomes pivotal in capturing and maintaining customer engagement. Given the restricted… ▽ More In the realm of e-commerce, popular platforms utilize widgets to recommend advertisements and products to their users. However, the prevalence of mobile device usage on these platforms introduces a unique challenge due to the limited screen real estate available. Consequently, the positioning of relevant widgets becomes pivotal in capturing and maintaining customer engagement. Given the restricted screen size of mobile devices, widgets placed at the top of the interface are more prominently displayed and thus attract greater user attention. Conversely, widgets positioned further down the page require users to scroll, resulting in reduced visibility and subsequent lower impression rates. Therefore it becomes imperative to place relevant widgets on top. However, selecting relevant widgets to display is a challenging task as the widgets can be heterogeneous, widgets can be introduced or removed at any given time from the platform. In this work, we model the vertical widget reordering as a contextual multi-arm bandit problem with delayed batch feedback. The objective is to rank the vertical widgets in a personalized manner. We present a two-stage ranking framework that combines contextual bandits with a diversity layer to improve the overall ranking. We demonstrate its effectiveness through offline and online A/B results, conducted on proprietary data from Myntra, a major fashion e-commerce platform in India. △ Less

Submitted 25 September, 2023; originally announced September 2023.

Comments: Accepted in Proceedings of Fashionxrecys Workshop, 17th ACM Conference on Recommender Systems, 2023

Linearized partial data Calderón problem for Biharmonic operators

Authors: Divyansh Agrawal, Ravi Shankar Jaiswal, Suman Kumar Sahoo

Abstract: We consider a linearized partial data Calderón problem for biharmonic operators extending the analogous result for harmonic operators. We construct special solutions and utilize Segal-Bargmann transform to recover lower order perturbations. We consider a linearized partial data Calderón problem for biharmonic operators extending the analogous result for harmonic operators. We construct special solutions and utilize Segal-Bargmann transform to recover lower order perturbations. △ Less

Submitted 29 August, 2023; originally announced August 2023.

MSC Class: 35R30; 31B20; 31B30; 35J40

Product Review Image Ranking for Fashion E-commerce

Authors: Sangeet Jaiswal, Dhruv Patel, Sreekanth Vempati, Konduru Saiswaroop

Abstract: In a fashion e-commerce platform where customers can't physically examine the products on their own, being able to see other customers' text and image reviews of the product is critical while making purchase decisions. Given the high reliance on these reviews, over the years we have observed customers proactively sharing their reviews. With an increase in the coverage of User Generated Content (UG… ▽ More In a fashion e-commerce platform where customers can't physically examine the products on their own, being able to see other customers' text and image reviews of the product is critical while making purchase decisions. Given the high reliance on these reviews, over the years we have observed customers proactively sharing their reviews. With an increase in the coverage of User Generated Content (UGC), there has been a corresponding increase in the number of customer images. It is thus imperative to display the most relevant images on top as it may influence users' online shop** choices and behavior. In this paper, we propose a simple yet effective training procedure for ranking customer images. We created a dataset consisting of Myntra (A Major Indian Fashion e-commerce company) studio posts and highly engaged (upvotes/downvotes) UGC images as our starting point and used selected distortion techniques on the images of the above dataset to bring their quality at par with those of bad UGC images. We train our network to rank bad-quality images lower than high-quality ones. Our proposed method outperforms the baseline models on two metrics, namely correlation coefficient, and accuracy, by substantial margins. △ Less

Submitted 10 August, 2023; originally announced August 2023.

Comments: Accepted in Proceedings of ACM SIGIR Workshop on eCommerce (SIGIR eCom'22)

A Deep Dive into the Disparity of Word Error Rates Across Thousands of NPTEL MOOC Videos

Authors: Anand Kumar Rai, Siddharth D Jaiswal, Animesh Mukherjee

Abstract: Automatic speech recognition (ASR) systems are designed to transcribe spoken language into written text and find utility in a variety of applications including voice assistants and transcription services. However, it has been observed that state-of-the-art ASR systems which deliver impressive benchmark results, struggle with speakers of certain regions or demographics due to variation in their spe… ▽ More Automatic speech recognition (ASR) systems are designed to transcribe spoken language into written text and find utility in a variety of applications including voice assistants and transcription services. However, it has been observed that state-of-the-art ASR systems which deliver impressive benchmark results, struggle with speakers of certain regions or demographics due to variation in their speech properties. In this work, we describe the curation of a massive speech dataset of 8740 hours consisting of $\sim9.8$K technical lectures in the English language along with their transcripts delivered by instructors representing various parts of Indian demography. The dataset is sourced from the very popular NPTEL MOOC platform. We use the curated dataset to measure the existing disparity in YouTube Automatic Captions and OpenAI Whisper model performance across the diverse demographic traits of speakers in India. While there exists disparity due to gender, native region, age and speech rate of speakers, disparity based on caste is non-existent. We also observe statistically significant disparity across the disciplines of the lectures. These results indicate the need of more inclusive and robust ASR systems and more representational datasets for disparity evaluation in them. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Relativistic second-order viscous hydrodynamics from kinetic theory with extended relaxation-time approximation

Authors: Dipika Dash, Sunil Jaiswal, Samapan Bhadury, Amaresh Jaiswal

Abstract: We use the extended relaxation time approximation for the collision kernel, which incorporates a particle-energy dependent relaxation time, to derive second-order viscous hydrodynamics from the Boltzmann equation for a system of massless particles. The resulting transport coefficients are found to be sensitive to the energy dependence of the relaxation time and have significant influence on the fl… ▽ More We use the extended relaxation time approximation for the collision kernel, which incorporates a particle-energy dependent relaxation time, to derive second-order viscous hydrodynamics from the Boltzmann equation for a system of massless particles. The resulting transport coefficients are found to be sensitive to the energy dependence of the relaxation time and have significant influence on the fluid's evolution. Using the derived hydrodynamic equations, we study the evolution of a fluid undergoing (0+1)-dimensional expansion with Bjorken symmetry and investigate the fixed point structure inherent in the equations. Further, by employing a power law parametrization to describe the energy dependence of the relaxation time, we successfully reproduce the stable free-streaming fixed point for a specific power of the energy dependence. The impact of the energy-dependent relaxation time on the processes of isotropization and thermalization of an expanding plasma is discussed. △ Less

Submitted 27 December, 2023; v1 submitted 12 July, 2023; originally announced July 2023.

Comments: 14 pages, 4 figure. Matches published version

Dissecting Multimodality in VideoQA Transformer Models by Impairing Modality Fusion

Authors: Ishaan Singh Rawal, Alexander Matyasko, Shantanu Jaiswal, Basura Fernando, Cheston Tan

Abstract: While VideoQA Transformer models demonstrate competitive performance on standard benchmarks, the reasons behind their success are not fully understood. Do these models capture the rich multimodal structures and dynamics from video and text jointly? Or are they achieving high scores by exploiting biases and spurious features? Hence, to provide insights, we design $\textit{QUAG}$ (QUadrant AveraGe),… ▽ More While VideoQA Transformer models demonstrate competitive performance on standard benchmarks, the reasons behind their success are not fully understood. Do these models capture the rich multimodal structures and dynamics from video and text jointly? Or are they achieving high scores by exploiting biases and spurious features? Hence, to provide insights, we design $\textit{QUAG}$ (QUadrant AveraGe), a lightweight and non-parametric probe, to conduct dataset-model combined representation analysis by impairing modality fusion. We find that the models achieve high performance on many datasets without leveraging multimodal representations. To validate QUAG further, we design $\textit{QUAG-attention}$, a less-expressive replacement of self-attention with restricted token interactions. Models with QUAG-attention achieve similar performance with significantly fewer multiplication operations without any finetuning. Our findings raise doubts about the current models' abilities to learn highly-coupled multimodal representations. Hence, we design the $\textit{CLAVI}$ (Complements in LAnguage and VIdeo) dataset, a stress-test dataset curated by augmenting real-world videos to have high modality coupling. Consistent with the findings of QUAG, we find that most of the models achieve near-trivial performance on CLAVI. This reasserts the limitations of current models for learning highly-coupled multimodal representations, that is not evaluated by the current datasets (project page: https://dissect-videoqa.github.io ). △ Less

Submitted 7 June, 2024; v1 submitted 15 June, 2023; originally announced June 2023.

Comments: Accepted at ICML 2024

Radio Sources Segmentation and Classification with Deep Learning

Authors: Baoqiang Lao, Sumit Jaiswal, Zhen Zhao, Le** Lin, Junyi Wang, Xiaohui Sun, Shengli Qin

Abstract: Modern large radio continuum surveys have high sensitivity and resolution, and can resolve previously undetected extended and diffuse emissions, which brings great challenges for the detection and morphological classification of extended sources. We present HeTu-v2, a deep learning-based source detector that uses the combined networks of Mask Region-based Convolutional Neural Networks (Mask R-CNN)… ▽ More Modern large radio continuum surveys have high sensitivity and resolution, and can resolve previously undetected extended and diffuse emissions, which brings great challenges for the detection and morphological classification of extended sources. We present HeTu-v2, a deep learning-based source detector that uses the combined networks of Mask Region-based Convolutional Neural Networks (Mask R-CNN) and a Transformer block to achieve high-quality radio sources segmentation and classification. The sources are classified into 5 categories: Compact or point-like sources (CS), Fanaroff-Riley Type I (FRI), Fanaroff-Riley Type II (FRII), Head-Tail (HT), and Core-Jet (CJ) sources. HeTu-v2 has been trained and validated with the data from the Faint Images of the Radio Sky at Twenty-one centimeters (FIRST). We found that HeTu-v2 has a high accuracy with a mean average precision ($AP_{\rm @50:5:95}$) of 77.8%, which is 15.6 points and 11.3 points higher than that of HeTu-v1 and the original Mask R-CNN respectively. We produced a FIRST morphological catalog (FIRST-HeTu) using HeTu-v2, which contains 835,435 sources and achieves 98.6% of completeness and up to 98.5% of accuracy compared to the latest 2014 data release of the FIRST survey. HeTu-v2 could also be employed for other astronomical tasks like building sky models, associating radio components, and classifying radio galaxies. △ Less

Submitted 5 June, 2023; v1 submitted 2 June, 2023; originally announced June 2023.

Comments: 20 pages, 15 figures, Accepted by Astronomy and Computing

Journal ref: 2023, Astronomy and Computing Volume 44, Pages 100728

Expanding Synthetic Real-World Degradations for Blind Video Super Resolution

Authors: Mehran Jeelani, Sadbhawna, Noshaba Cheema, Klaus Illgner-Fehns, Philipp Slusallek, Sunil Jaiswal

Abstract: Video super-resolution (VSR) techniques, especially deep-learning-based algorithms, have drastically improved over the last few years and shown impressive performance on synthetic data. However, their performance on real-world video data suffers because of the complexity of real-world degradations and misaligned video frames. Since obtaining a synthetic dataset consisting of low-resolution (LR) an… ▽ More Video super-resolution (VSR) techniques, especially deep-learning-based algorithms, have drastically improved over the last few years and shown impressive performance on synthetic data. However, their performance on real-world video data suffers because of the complexity of real-world degradations and misaligned video frames. Since obtaining a synthetic dataset consisting of low-resolution (LR) and high-resolution (HR) frames are easier than obtaining real-world LR and HR images, in this paper, we propose synthesizing real-world degradations on synthetic training datasets. The proposed synthetic real-world degradations (SRWD) include a combination of the blur, noise, downsampling, pixel binning, and image and video compression artifacts. We then propose using a random shuffling-based strategy to simulate these degradations on the training datasets and train a single end-to-end deep neural network (DNN) on the proposed larger variation of realistic synthesized training data. Our quantitative and qualitative comparative analysis shows that the proposed training strategy using diverse realistic degradations improves the performance by 7.1 % in terms of NRQM compared to RealBasicVSR and by 3.34 % compared to BSRGAN on the VideoLQ dataset. We also introduce a new dataset that contains high-resolution real-world videos that can serve as a common ground for bench-marking. △ Less

Submitted 4 May, 2023; originally announced May 2023.

Edge-aware Consistent Stereo Video Depth Estimation

Authors: Elena Kosheleva, Sunil Jaiswal, Faranak Shamsafar, Noshaba Cheema, Klaus Illgner-Fehns, Philipp Slusallek

Abstract: Video depth estimation is crucial in various applications, such as scene reconstruction and augmented reality. In contrast to the naive method of estimating depths from images, a more sophisticated approach uses temporal information, thereby eliminating flickering and geometrical inconsistencies. We propose a consistent method for dense video depth estimation; however, unlike the existing monocula… ▽ More Video depth estimation is crucial in various applications, such as scene reconstruction and augmented reality. In contrast to the naive method of estimating depths from images, a more sophisticated approach uses temporal information, thereby eliminating flickering and geometrical inconsistencies. We propose a consistent method for dense video depth estimation; however, unlike the existing monocular methods, ours relates to stereo videos. This technique overcomes the limitations arising from the monocular input. As a benefit of using stereo inputs, a left-right consistency loss is introduced to improve the performance. Besides, we use SLAM-based camera pose estimation in the process. To address the problem of depth blurriness during test-time training (TTT), we present an edge-preserving loss function that improves the visibility of fine details while preserving geometrical consistency. We show that our edge-aware stereo video model can accurately estimate the dense depth maps. △ Less

Submitted 4 May, 2023; originally announced May 2023.

High-Resolution Synthetic RGB-D Datasets for Monocular Depth Estimation

Authors: Aakash Rajpal, Noshaba Cheema, Klaus Illgner-Fehns, Philipp Slusallek, Sunil Jaiswal

Abstract: Accurate depth maps are essential in various applications, such as autonomous driving, scene reconstruction, point-cloud creation, etc. However, monocular-depth estimation (MDE) algorithms often fail to provide enough texture & sharpness, and also are inconsistent for homogeneous scenes. These algorithms mostly use CNN or vision transformer-based architectures requiring large datasets for supervis… ▽ More Accurate depth maps are essential in various applications, such as autonomous driving, scene reconstruction, point-cloud creation, etc. However, monocular-depth estimation (MDE) algorithms often fail to provide enough texture & sharpness, and also are inconsistent for homogeneous scenes. These algorithms mostly use CNN or vision transformer-based architectures requiring large datasets for supervised training. But, MDE algorithms trained on available depth datasets do not generalize well and hence fail to perform accurately in diverse real-world scenes. Moreover, the ground-truth depth maps are either lower resolution or sparse leading to relatively inconsistent depth maps. In general, acquiring a high-resolution ground truth dataset with pixel-level precision for accurate depth prediction is an expensive, and time-consuming challenge. In this paper, we generate a high-resolution synthetic depth dataset (HRSD) of dimension 1920 X 1080 from Grand Theft Auto (GTA-V), which contains 100,000 color images and corresponding dense ground truth depth maps. The generated datasets are diverse and have scenes from indoors to outdoors, from homogeneous surfaces to textures. For experiments and analysis, we train the DPT algorithm, a state-of-the-art transformer-based MDE algorithm on the proposed synthetic dataset, which significantly increases the accuracy of depth maps on different scenes by 9 %. Since the synthetic datasets are of higher resolution, we propose adding a feature extraction module in the transformer encoder and incorporating an attention-based loss, further improving the accuracy by 15 %. △ Less

Submitted 2 May, 2023; originally announced May 2023.

Leveraging Multi-view Data for Improved Detection Performance: An Industrial Use Case

Authors: Faranak Shamsafar, Sunil Jaiswal, Benjamin Kelkel, Kireeti Bodduna, Klaus Illgner-Fehns

Abstract: Printed circuit boards (PCBs) are essential components of electronic devices, and ensuring their quality is crucial in their production. However, the vast variety of components and PCBs manufactured by different companies makes it challenging to adapt to production lines with speed demands. To address this challenge, we present a multi-view object detection framework that offers a fast and precise… ▽ More Printed circuit boards (PCBs) are essential components of electronic devices, and ensuring their quality is crucial in their production. However, the vast variety of components and PCBs manufactured by different companies makes it challenging to adapt to production lines with speed demands. To address this challenge, we present a multi-view object detection framework that offers a fast and precise solution. We introduce a novel multi-view dataset with semi-automatic ground-truth data, which results in significant labeling resource savings. Labeling PCB boards for object detection is a challenging task due to the high density of components and the small size of the objects, which makes it difficult to identify and label them accurately. By training an object detector model with multi-view data, we achieve improved performance over single-view images. To further enhance the accuracy, we develop a multi-view inference method that aggregates results from different viewpoints. Our experiments demonstrate a 15% improvement in mAP for detecting components that range in size from 0.5 to 27.0 mm. △ Less

Submitted 17 April, 2023; originally announced April 2023.

SKA Science Data Challenge 2: analysis and results

Authors: P. Hartley, A. Bonaldi, R. Braun, J. N. H. S. Aditya, S. Aicardi, L. Alegre, A. Chakraborty, X. Chen, S. Choudhuri, A. O. Clarke, J. Coles, J. S. Collinson, D. Cornu, L. Darriba, M. Delli Veneri, J. Forbrich, B. Fraga, A. Galan, J. Garrido, F. Gubanov, H. Håkansson, M. J. Hardcastle, C. Heneka, D. Herranz, K. M. Hess , et al. (83 additional authors not shown)

Abstract: The Square Kilometre Array Observatory (SKAO) will explore the radio sky to new depths in order to conduct transformational science. SKAO data products made available to astronomers will be correspondingly large and complex, requiring the application of advanced analysis techniques to extract key science findings. To this end, SKAO is conducting a series of Science Data Challenges, each designed t… ▽ More The Square Kilometre Array Observatory (SKAO) will explore the radio sky to new depths in order to conduct transformational science. SKAO data products made available to astronomers will be correspondingly large and complex, requiring the application of advanced analysis techniques to extract key science findings. To this end, SKAO is conducting a series of Science Data Challenges, each designed to familiarise the scientific community with SKAO data and to drive the development of new analysis techniques. We present the results from Science Data Challenge 2 (SDC2), which invited participants to find and characterise 233245 neutral hydrogen (Hi) sources in a simulated data product representing a 2000~h SKA MID spectral line observation from redshifts 0.25 to 0.5. Through the generous support of eight international supercomputing facilities, participants were able to undertake the Challenge using dedicated computational resources. Alongside the main challenge, `reproducibility awards' were made in recognition of those pipelines which demonstrated Open Science best practice. The Challenge saw over 100 participants develop a range of new and existing techniques, with results that highlight the strengths of multidisciplinary and collaborative effort. The winning strategy -- which combined predictions from two independent machine learning techniques to yield a 20 percent improvement in overall performance -- underscores one of the main Challenge outcomes: that of method complementarity. It is likely that the combination of methods in a so-called ensemble approach will be key to exploiting very large astronomical datasets. △ Less

Submitted 14 March, 2023; originally announced March 2023.

Comments: Under review by MNRAS; 28 pages, 16 figures

High-Frequency and High-Resolution VLBI Observations of GHz Peaked Spectrum Objects

Authors: Xiaopeng Cheng, Tao An, Ailing Wang, Sumit Jaiswal

Abstract: Observational studies of GHz peaked spectrum (GPS) sources contribute to the understanding of the radiative properties and interstellar environment of host galaxies. We present the results from the multi-frequency high-resolution VLBI observations of a sample of nine GPS sources at 8, 15, and 43 GHz. All sources show a core-jet structure. Four sources show relativistic jets with Doppler boosting f… ▽ More Observational studies of GHz peaked spectrum (GPS) sources contribute to the understanding of the radiative properties and interstellar environment of host galaxies. We present the results from the multi-frequency high-resolution VLBI observations of a sample of nine GPS sources at 8, 15, and 43 GHz. All sources show a core-jet structure. Four sources show relativistic jets with Doppler boosting factors ranging from 2.0 to 5.0 and a jet viewing angle between 10° and 30°. The core brightness temperatures of the other five sources are below the equipartition brightness temperature limit with their jet viewing angles in the range of 13.6° degrees to 71.9°, which are systematically larger than those of relativistic jets in this sample. The sources show diverse variability properties, with variability levels ranging from 0.11 to 0.56. The measured turnover frequency in the radio spectrum ranges from 6.2 and 31.8 GHz. We estimate the equipartition magnetic field strength to be between 9 and 48 mG. These results strongly support the notion that these GPS sources are young radio sources in the very early stage of their evolution. △ Less

Submitted 6 March, 2023; originally announced March 2023.

Comments: 12 pages, 2 figures, 3 tables, published in Galaxies

mlpack 4: a fast, header-only C++ machine learning library

Authors: Ryan R. Curtin, Marcus Edel, Omar Shrit, Shubham Agrawal, Suryoday Basak, James J. Balamuta, Ryan Birmingham, Kartik Dutt, Dirk Eddelbuettel, Rishabh Garg, Shikhar Jaiswal, Aakash Kaushik, Sangyeon Kim, Anjishnu Mukherjee, Nanubala Gnana Sai, Nippun Sharma, Yashwant Singh Parihar, Roshan Swain, Conrad Sanderson

Abstract: For over 15 years, the mlpack machine learning library has served as a "swiss army knife" for C++-based machine learning. Its efficient implementations of common and cutting-edge machine learning algorithms have been used in a wide variety of scientific and industrial applications. This paper overviews mlpack 4, a significant upgrade over its predecessor. The library has been significantly refacto… ▽ More For over 15 years, the mlpack machine learning library has served as a "swiss army knife" for C++-based machine learning. Its efficient implementations of common and cutting-edge machine learning algorithms have been used in a wide variety of scientific and industrial applications. This paper overviews mlpack 4, a significant upgrade over its predecessor. The library has been significantly refactored and redesigned to facilitate an easier prototy**-to-deployment pipeline, including bindings to other languages (Python, Julia, R, Go, and the command line) that allow prototy** to be seamlessly performed in environments other than C++. mlpack is open-source software, distributed under the permissive 3-clause BSD license; it can be obtained at https://mlpack.org △ Less

Submitted 1 February, 2023; originally announced February 2023.

Journal ref: Journal of Open Source Software, Vol. 8, No. 82, 2023

Interactions between the jet and disk wind in a nearby radio intermediate quasar III Zw 2

Authors: Ailing Wang, Tao An, Shaoguang Guo, Prashanth Mohan, Wara Chamani, Willem A. Baan, Talvikki Hovatta, Heino Falcke, Tim J. Galvin, Natasha Hurley-Walker, Sumit Jaiswal, Anne Lahteenmaki, Baoqiang Lao, Weijia Lv, Merja Tornikoski, Yingkang Zhang

Abstract: Disk winds and jets are ubiquitous in active galactic nuclei (AGN), and how these two components interact remains an open question. We study the radio properties of a radio-intermediate quasar III Zw 2. We detect two jet knots J1 and J2 on parsec scales, which move at a mildly apparent superluminal speed of $1.35\,c$. Two $γ$-ray flares were detected in III Zw 2 in 2009--2010, corresponding to the… ▽ More Disk winds and jets are ubiquitous in active galactic nuclei (AGN), and how these two components interact remains an open question. We study the radio properties of a radio-intermediate quasar III Zw 2. We detect two jet knots J1 and J2 on parsec scales, which move at a mildly apparent superluminal speed of $1.35\,c$. Two $γ$-ray flares were detected in III Zw 2 in 2009--2010, corresponding to the primary radio flare in late 2009 and the secondary radio flare in early 2010. The primary 2009 flare was found to be associated with the ejection of J2. The secondary 2010 flare occurred at a distance of $\sim$0.3 parsec from the central engine, probably resulting from the collision of the jet with the accretion disk wind. The variability characteristics of III Zw 2 (periodic radio flares, unstable periodicity, multiple quasi-periodic signals and possible harmonic relations between them) can be explained by the global instabilities of the accretion disk. These instabilities originating from the outer part of the warped disk propagate inwards and can lead to modulation of the accretion rate and consequent jet ejection. At the same time, the wobbling of the outer disk may also lead to oscillations of the boundary between the disk wind and the jet tunnel, resulting in changes in the jet-wind collision site. III Zw 2 is one of the few cases observed with jet-wind interactions, and the study in this paper is of general interest for gaining insight into the dynamic processes in the nuclear regions of AGN. △ Less

Submitted 28 December, 2022; originally announced December 2022.

Comments: accepted by ApJ

Is the X-ray bright z = 5.5 quasar SRGE J170245.3+130104 a blazar?

Authors: Tao An, Ailing Wang, Yuanqi Liu, Yulia Sotnikova, Yingkang Zhang, J. N. H. S. Aditya, Sumit Jaiswal, George Khorunzhev, Baoqiang Lao, Ruqiu Lin, Alexander Mikhailov, Marat Mingaliev, Timur Mufakharov, Sergey Sazonov

Abstract: Jets may have contributed to promoting the growth of seed black holes in the early Universe, and thus observations of radio-loud high-redshift quasars are crucial to understanding the growth and evolution of the early supermassive black holes. Here we report the radio properties of an X-ray bright $z=5.5$ quasar, SRGE J170245.3+130104 (J1702+1301). Our high-resolution radio images reveal the radio… ▽ More Jets may have contributed to promoting the growth of seed black holes in the early Universe, and thus observations of radio-loud high-redshift quasars are crucial to understanding the growth and evolution of the early supermassive black holes. Here we report the radio properties of an X-ray bright $z=5.5$ quasar, SRGE J170245.3+130104 (J1702+1301). Our high-resolution radio images reveal the radio counterpart at the optical position of J1702+1301, while another radio component is also detected at $\sim$23.5\arcsec\ to the southwest. Our analysis suggests that this southwest component is associated with a foreground galaxy at $z\approx 0.677$, which is mixed with J1702+1301 in low-frequency low-resolution radio images. After removing the contamination from this foreground source, we recalculated the radio loudness of J1702+1301 to be $R>$1100, consistent with those of blazars. J1702+1301 exhibits a flat radio spectrum ($α= -0.17 \pm 0.05$, $S \propto ν^α$) between 0.15 and 5 GHz; above 5 GHz, it shows a rising spectrum shape, and the spectral index $α^{8.2}_{4.7}$ appears to be correlated with the variation of the flux density: in burst states, $α^{8.2}_{4.7}$ becomes larger. J1702+1301 displays distinct radio variability on timescales from weeks to years in the source's rest frame. These radio properties, including high radio loudness, rising spectrum, and rapid variability, tend to support it as a blazar. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Comments: accepted for publication in Monthly Notices of the Royal Astronomical Society

Improving trajectory localization accuracy via direction-of-arrival derivative estimation

Authors: Ruchi Pandey, Shreyas Jaiswal, Huy Phan, Santosh Nannuru

Abstract: Sound source localization is crucial in acoustic sensing and monitoring-related applications. In this paper, we do a comprehensive analysis of improvement in sound source localization by combining the direction of arrivals (DOAs) with their derivatives which quantify the changes in the positions of sources over time. This study uses the SALSA-Lite feature with a convolutional recurrent neural netw… ▽ More Sound source localization is crucial in acoustic sensing and monitoring-related applications. In this paper, we do a comprehensive analysis of improvement in sound source localization by combining the direction of arrivals (DOAs) with their derivatives which quantify the changes in the positions of sources over time. This study uses the SALSA-Lite feature with a convolutional recurrent neural network (CRNN) model for predicting DOAs and their first-order derivatives. An update rule is introduced to combine the predicted DOAs with the estimated derivatives to obtain the final DOAs. The experimental validation is done using TAU-NIGENS Spatial Sound Events (TNSSE) 2021 dataset. We compare the performance of the networks predicting DOAs with derivative vs. the one predicting only the DOAs at low SNR levels. The results show that combining the derivatives with the DOAs improves the localization accuracy of moving sources. △ Less

Submitted 10 December, 2022; v1 submitted 7 December, 2022; originally announced December 2022.

Metric anisotropies and nonequilibrium attractor for expanding plasma

Authors: Nisarg Vyas, Sunil Jaiswal, Amaresh Jaiswal

Abstract: We consider the evolution of a system of chargeless and massless particles in an anisotropic space-time given by the Bianchi type I metric. Specializing to the axis-symmetric case, we derive the framework of anisotropic hydrodynamics from the Boltzmann equation in the relaxation-time approximation. We consider the case of the axis-symmetric Kasner metric and study the approach to the emergent attr… ▽ More We consider the evolution of a system of chargeless and massless particles in an anisotropic space-time given by the Bianchi type I metric. Specializing to the axis-symmetric case, we derive the framework of anisotropic hydrodynamics from the Boltzmann equation in the relaxation-time approximation. We consider the case of the axis-symmetric Kasner metric and study the approach to the emergent attractor in near and far-off-equilibrium regimes. Further, by relaxing the Kasner conditions on metric coefficients, we study the effect of expansion geometries on the far-off-equilibrium attractor and discuss its implications in the context of relativistic heavy-ion collisions. △ Less

Submitted 6 May, 2023; v1 submitted 5 December, 2022; originally announced December 2022.

Comments: 9 pages, 6 figures. Published version

Journal ref: Phys. Lett. B 841, 137943 (2023)

A Probabilistic-Logic based Commonsense Representation Framework for Modelling Inferences with Multiple Antecedents and Varying Likelihoods

Authors: Shantanu Jaiswal, Liu Yan, Dongkyu Choi, Kenneth Kwok

Abstract: Commonsense knowledge-graphs (CKGs) are important resources towards building machines that can 'reason' on text or environmental inputs and make inferences beyond perception. While current CKGs encode world knowledge for a large number of concepts and have been effectively utilized for incorporating commonsense in neural models, they primarily encode declarative or single-condition inferential kno… ▽ More Commonsense knowledge-graphs (CKGs) are important resources towards building machines that can 'reason' on text or environmental inputs and make inferences beyond perception. While current CKGs encode world knowledge for a large number of concepts and have been effectively utilized for incorporating commonsense in neural models, they primarily encode declarative or single-condition inferential knowledge and assume all conceptual beliefs to have the same likelihood. Further, these CKGs utilize a limited set of relations shared across concepts and lack a coherent knowledge organization structure resulting in redundancies as well as sparsity across the larger knowledge graph. Consequently, today's CKGs, while useful for a first level of reasoning, do not adequately capture deeper human-level commonsense inferences which can be more nuanced and influenced by multiple contextual or situational factors. Accordingly, in this work, we study how commonsense knowledge can be better represented by -- (i) utilizing a probabilistic logic representation scheme to model composite inferential knowledge and represent conceptual beliefs with varying likelihoods and (ii) incorporating a hierarchical conceptual ontology to identify salient concept-relevant relations and organize beliefs at different conceptual levels. Our resulting knowledge representation framework can encode a wider variety of world knowledge and represent beliefs flexibly using grounded concepts as well as free-text phrases. As a result, the framework can be utilized as both a traditional free-text knowledge graph and a grounded logic-based inference system more suitable for neuro-symbolic applications. We describe how we extend the PrimeNet knowledge base with our framework through crowd-sourcing and expert-annotation, and demonstrate its application for more interpretable passage-based semantic parsing and question answering. △ Less

Submitted 15 December, 2022; v1 submitted 30 November, 2022; originally announced November 2022.

OOD-DiskANN: Efficient and Scalable Graph ANNS for Out-of-Distribution Queries

Authors: Shikhar Jaiswal, Ravishankar Krishnaswamy, Ankit Garg, Harsha Vardhan Simhadri, Sheshansh Agrawal

Abstract: State-of-the-art algorithms for Approximate Nearest Neighbor Search (ANNS) such as DiskANN, FAISS-IVF, and HNSW build data dependent indices that offer substantially better accuracy and search efficiency over data-agnostic indices by overfitting to the index data distribution. When the query data is drawn from a different distribution - e.g., when index represents image embeddings and query repres… ▽ More State-of-the-art algorithms for Approximate Nearest Neighbor Search (ANNS) such as DiskANN, FAISS-IVF, and HNSW build data dependent indices that offer substantially better accuracy and search efficiency over data-agnostic indices by overfitting to the index data distribution. When the query data is drawn from a different distribution - e.g., when index represents image embeddings and query represents textual embeddings - such algorithms lose much of this performance advantage. On a variety of datasets, for a fixed recall target, latency is worse by an order of magnitude or more for Out-Of-Distribution (OOD) queries as compared to In-Distribution (ID) queries. The question we address in this work is whether ANNS algorithms can be made efficient for OOD queries if the index construction is given access to a small sample set of these queries. We answer positively by presenting OOD-DiskANN, which uses a sparing sample (1% of index set size) of OOD queries, and provides up to 40% improvement in mean query latency over SoTA algorithms of a similar memory footprint. OOD-DiskANN is scalable and has the efficiency of graph-based ANNS indices. Some of our contributions can improve query efficiency for ID queries as well. △ Less

Submitted 30 November, 2022; v1 submitted 22 October, 2022; originally announced November 2022.

Using Signal Processing in Tandem With Adapted Mixture Models for Classifying Genomic Signals

Authors: Saish Jaiswal, Shreya Nema, Hema A Murthy, Manikandan Narayanan

Abstract: Genomic signal processing has been used successfully in bioinformatics to analyze biomolecular sequences and gain varied insights into DNA structure, gene organization, protein binding, sequence evolution, etc. But challenges remain in finding the appropriate spectral representation of a biomolecular sequence, especially when multiple variable-length sequences need to be handled consistently. In t… ▽ More Genomic signal processing has been used successfully in bioinformatics to analyze biomolecular sequences and gain varied insights into DNA structure, gene organization, protein binding, sequence evolution, etc. But challenges remain in finding the appropriate spectral representation of a biomolecular sequence, especially when multiple variable-length sequences need to be handled consistently. In this study, we address this challenge in the context of the well-studied problem of classifying genomic sequences into different taxonomic units (strain, phyla, order, etc.). We propose a novel technique that employs signal processing in tandem with Gaussian mixture models to improve the spectral representation of a sequence and subsequently the taxonomic classification accuracies. The sequences are first transformed into spectra, and projected to a subspace, where sequences belonging to different taxons are better distinguishable. Our method outperforms a similar state-of-the-art method on established benchmark datasets by an absolute margin of 6.06% accuracy. △ Less

Submitted 3 November, 2022; originally announced November 2022.

Radio observations of four active galactic nuclei hosting intermediate-mass black hole candidates: studying the outflow activity and evolution

Authors: Xiaolong Yang, Prashanth Mohan, Jun Yang, Luis C. Ho, J. N. H. S. Aditya, Shaohua Zhang, Sumit Jaiswal, Xiaofeng Yang

Abstract: Observational searches for intermediate-mass black holes (IMBHs; $10^2 - 10^6$ $M_\odot$) include relatively isolated dwarf galaxies. For those that host active galactic nuclei (AGNs), the IMBH nature may be discerned through the accretion - jet activity. We present radio observations of four AGN-hosting dwarf galaxies (which potentially harbor IMBHs). Very large array (VLA) observations indicate… ▽ More Observational searches for intermediate-mass black holes (IMBHs; $10^2 - 10^6$ $M_\odot$) include relatively isolated dwarf galaxies. For those that host active galactic nuclei (AGNs), the IMBH nature may be discerned through the accretion - jet activity. We present radio observations of four AGN-hosting dwarf galaxies (which potentially harbor IMBHs). Very large array (VLA) observations indicate steep spectra (indices of $-$0.63 to $-$1.05) between 1.4 and 9 GHz. A comparison with the 9 GHz in-band spectral index however shows a steepening for GH047 and GH158 (implying older/relic emission) and flattening for GH106 and GH163 (implying recent activity). Overlap** emission regions in the VLA 1.4 GHz and our very long baseline array (VLBA) 1.5 GHz observations, and possibly symmetric pc-scale extensions are consistent with recent activity in the latter two. Using the compact VLBA radio luminosity, X-ray luminosity (probing the accretion activity) and the black hole masses, all AGNs are found to lie on the empirical fundamental plane relation. The four AGN are radio quiet with relatively higher Eddington ratios ($0.04 - 0.32$) and resemble the X-ray binaries during spectral state transitions that entail an outflow ejection. Furthermore, the radio to X-ray luminosity ratio $\log{R_\mathrm{X}}$ of $-3.9$ to $-5.6$ in these four sources support the scenarios including corona mass ejection from accretion disk and wind activity. The growth to kpc-scales likely proceeds along a trajectory similar to young AGNs and peaked spectrum sources. The above complex clues can thus aid in the detection and monitoring of IMBHs in the nearby Universe. △ Less

Submitted 31 October, 2022; originally announced November 2022.

Comments: 21 pages, 3 figures, 5 tabels, accepted for publication in ApJ

MinUn: Accurate ML Inference on Microcontrollers

Authors: Shikhar Jaiswal, Rahul Kiran Kranti Goli, Aayan Kumar, Vivek Seshadri, Rahul Sharma

Abstract: Running machine learning inference on tiny devices, known as TinyML, is an emerging research area. This task requires generating inference code that uses memory frugally, a task that standard ML frameworks are ill-suited for. A deployment framework for TinyML must be a) parametric in the number representation to take advantage of the emerging representations like posits, b) carefully assign high-p… ▽ More Running machine learning inference on tiny devices, known as TinyML, is an emerging research area. This task requires generating inference code that uses memory frugally, a task that standard ML frameworks are ill-suited for. A deployment framework for TinyML must be a) parametric in the number representation to take advantage of the emerging representations like posits, b) carefully assign high-precision to a few tensors so that most tensors can be kept in low-precision while still maintaining model accuracy, and c) avoid memory fragmentation. We describe MinUn, the first TinyML framework that holistically addresses these issues to generate efficient code for ARM microcontrollers (e.g., Arduino Uno, Due and STM32H747) that outperforms the prior TinyML frameworks. △ Less

Submitted 30 November, 2022; v1 submitted 29 October, 2022; originally announced October 2022.

Dynamics of Hot QCD Matter -- Current Status and Developments

Authors: Santosh K. Das, Prabhakar Palni, Jhuma Sannigrahi, Jan-e Alam, Cho Win Aung, Yoshini Bailung, Debjani Banerjee, Gergely Gábor Barnaföldi, Subash Chandra Behera, Partha Pratim Bhaduri, Samapan Bhadury, Rajesh Biswas, Pritam Chakraborty, Vinod Chandra, Prottoy Das, Sadhana Dash, Saumen Datta, Sudipan De, Vaishnavi Desai, Suman Deb, Debarshi Dey, Jayanta Dey, Sabyasachi Ghosh, Najmul Haque, Mujeeb Hasan , et al. (42 additional authors not shown)

Abstract: The discovery and characterization of hot and dense QCD matter, known as Quark Gluon Plasma (QGP), remains the most international collaborative effort and synergy between theorists and experimentalists in modern nuclear physics to date. The experimentalists around the world not only collect an unprecedented amount of data in heavy-ion collisions, at Relativistic Heavy Ion Collider (RHIC), at Brook… ▽ More The discovery and characterization of hot and dense QCD matter, known as Quark Gluon Plasma (QGP), remains the most international collaborative effort and synergy between theorists and experimentalists in modern nuclear physics to date. The experimentalists around the world not only collect an unprecedented amount of data in heavy-ion collisions, at Relativistic Heavy Ion Collider (RHIC), at Brookhaven National Laboratory (BNL) in New York, USA, and the Large Hadron Collider (LHC), at CERN in Geneva, Switzerland but also analyze these data to unravel the mystery of this new phase of matter that filled a few microseconds old universe, just after the Big Bang. In the meantime, advancements in theoretical works and computing capability extend our wisdom about the hot-dense QCD matter and its dynamics through mathematical equations. The exchange of ideas between experimentalists and theoreticians is crucial for the progress of our knowledge. The motivation of this first conference named "HOT QCD Matter 2022" is to bring the community together to have a discourse on this topic. In this article, there are 36 sections discussing various topics in the field of relativistic heavy-ion collisions and related phenomena that cover a snapshot of the current experimental observations and theoretical progress. This article begins with the theoretical overview of relativistic spin-hydrodynamics in the presence of the external magnetic field, followed by the Lattice QCD results on heavy quarks in QGP, and finally, it ends with an overview of experiment results. △ Less

Submitted 29 August, 2022; originally announced August 2022.

Comments: Compilation of the contributions (148 pages) as presented in the `Hot QCD Matter 2022 conference', held from May 12 to 14, 2022, jointly organized by IIT Goa & Goa University, Goa, India

Journal ref: Int.J.Mod.Phys.E 31 (2022) 12, 2250097

From moments of the distribution function to hydrodynamics: The non-conformal case

Authors: Sunil Jaiswal, Jean-Paul Blaizot, Rajeev S. Bhalerao, Zenan Chen, Amaresh Jaiswal, Li Yan

Abstract: We study the one-dimensional boost-invariant Boltzmann equation in the relaxation-time approximation using special moments of the distribution function for a system with a finite particle mass. The infinite hierarchy of moments can be truncated by kee** only the three lowest moments that correspond to the three independent components of the energy-momentum tensor. We show that such a three-momen… ▽ More We study the one-dimensional boost-invariant Boltzmann equation in the relaxation-time approximation using special moments of the distribution function for a system with a finite particle mass. The infinite hierarchy of moments can be truncated by kee** only the three lowest moments that correspond to the three independent components of the energy-momentum tensor. We show that such a three-moment truncation reproduces accurately the exact solution of the kinetic equation after a simple renormalization that takes into account the effects of the neglected higher moments. We derive second-order Israel-Stewart hydrodynamic equations from the three-moment equations, and show that, for most physically relevant initial conditions, these equations yield results comparable to those of the three-moment truncation, albeit less accurate. We attribute this feature to the fact that the structure of Israel-Stewart equations is similar to that of the three-moment truncation. In particular, the presence of the relaxation term in the Israel-Stewart equations, yields an early-time regime that mimics approximately the collisionless regime. A detailed comparison of the three-moment truncation with second-order non-conformal hydrodynamics reveals ambiguities in the definition of second-order transport coefficients. These ambiguities affect the ability of Israel-Stewart hydrodynamics to reproduce results of kinetic theory. △ Less

Submitted 6 November, 2022; v1 submitted 4 August, 2022; originally announced August 2022.

Comments: 26 pages, 11 figures (manuscript now in PRC format)

Journal ref: Phys. Rev. C 106 (2022) no.4, 044912

Far-from-equilibrium attractor in non-conformal plasmas

Authors: Sunil Jaiswal, Subrata Pal, Chandrodoy Chattopadhyay, Lipei Du, Ulrich Heinz

Abstract: We study the far-off-equilibrium dynamics of a Bjorken expanding non-conformal system within kinetic theory and hydrodynamics. We show that, in contrast to the conformal case, neither shear nor bulk viscous pressure relax quickly to a non-equilibrium attractor. In kinetic theory an early-time, far-from-equilibrium attractor exists for the scaled longitudinal pressure, driven by the rapid longitudi… ▽ More We study the far-off-equilibrium dynamics of a Bjorken expanding non-conformal system within kinetic theory and hydrodynamics. We show that, in contrast to the conformal case, neither shear nor bulk viscous pressure relax quickly to a non-equilibrium attractor. In kinetic theory an early-time, far-from-equilibrium attractor exists for the scaled longitudinal pressure, driven by the rapid longitudinal expansion of the medium. Second-order dissipative hydrodynamics fails to accurately describe this attractor, but a modified anisotropic hydrodynamic formulation reproduces it and provides excellent agreement with kinetic theory. △ Less

Submitted 1 August, 2022; originally announced August 2022.

Comments: Contribution to the proceedings of Quark Matter 2022. 6 pages, 3 figures

Enriching and Characterizing T-Cell Repertoires from 3' Barcoded Single-Cell Whole Transcriptome Amplification Products

Authors: Tasneem Jivanjee, Samira Ibrahim, Sarah K. Nyquist, G. James Gatter, Joshua D. Bromley, Swati Jaiswal, Bonnie Berger, Samuel M. Behar, J. Christopher Love, Alex K. Shalek

Abstract: Antigen-specific T cells play an essential role in immunoregulation and diseases such as cancer. Characterizing the T cell receptor (TCR) sequences that encode T cell specificity is critical for elucidating the antigenic determinants of immunological diseases and designing therapeutic remedies. However, methods of obtaining single-cell TCR sequencing data are labor and cost intensive, requiring ce… ▽ More Antigen-specific T cells play an essential role in immunoregulation and diseases such as cancer. Characterizing the T cell receptor (TCR) sequences that encode T cell specificity is critical for elucidating the antigenic determinants of immunological diseases and designing therapeutic remedies. However, methods of obtaining single-cell TCR sequencing data are labor and cost intensive, requiring cell sorting and full length single-cell RNA-sequencing (scRNA-seq). New high-throughput 3' cell-barcoding scRNA-seq methods can simplify and scale this process; however, they do not routinely capture TCR sequences during library preparation and sequencing. While 5' cell-barcoding scRNA-seq methods can be used to examine TCR repertoire at single-cell resolution, it requires specialized reagents which cannot be applied to samples previously processed using 3' cell-barcoding methods. Here, we outline a method for sequencing TCR$α$ and TCR$β$ transcripts from samples already processed using 3' cell-barcoding scRNA-seq platforms, ensuring TCR recovery at a single-cell resolution. In short, a fraction of the 3' barcoded whole transcriptome amplification (WTA) product typically used to generate a massively parallel 3' scRNA-seq library is enriched for TCR transcripts using biotinylated probes, and further amplified using the same universal primer sequence from WTA. Primer extension using TCR V-region primers and targeted PCR amplification results in a 3' barcoded single-cell CDR3-enriched library that can be sequenced with custom sequencing primers. Coupled with 3' scRNA-seq of the same WTA, this method enables simultaneous analysis of single-cell transcriptomes and TCR sequences which can help interpret inherent heterogeneity among antigen-specific T cells and salient disease biology. This method can be adapted to enrich other transcripts of interest from 3' and 5' barcoded WTA libraries. △ Less

Submitted 21 March, 2022; originally announced March 2022.

Comments: 57 pages excluding supplementary figures, 7 figures, 8 tables, 5 supplementary figures

Extended relaxation time approximation and relativistic dissipative hydrodynamics

Authors: Dipika Dash, Samapan Bhadury, Sunil Jaiswal, Amaresh Jaiswal

Abstract: Development of a new framework for derivation of order-by-order hydrodynamics from Boltzmann equation is necessary as the widely used Anderson-Witting formalism leads to violation of fundamental conservation laws when the relaxation-time depends on particle energy, or in a hydrodynamic frame other than the Landau frame. We generalize an existing framework for consistent derivation of relativistic… ▽ More Development of a new framework for derivation of order-by-order hydrodynamics from Boltzmann equation is necessary as the widely used Anderson-Witting formalism leads to violation of fundamental conservation laws when the relaxation-time depends on particle energy, or in a hydrodynamic frame other than the Landau frame. We generalize an existing framework for consistent derivation of relativistic dissipative hydrodynamics from the Boltzmann equation with a energy-dependent relaxation-time by extending the Anderson-Witting relaxation-time approximation. We argue that the present framework is compatible with conservation laws and derive first-order hydrodynamic equations in landau frame. Further, we show that the transport coefficients, such as shear and bulk viscosity as well as charge and heat diffusion currents, have corrections due to the energy dependence of relaxation time compared to what one obtains from the Anderson-Witting approximation of the collision term. The ratio of these transport coefficients are studied using a parametrized relaxation-time, and several interesting scaling features are reported. △ Less

Submitted 6 June, 2022; v1 submitted 29 December, 2021; originally announced December 2021.

Comments: 9 pages, 6 figures, published version

Journal ref: Phys.Lett.B 831 (2022) 137202

Marching with the Pink Parade: Evaluating Visual Search Recommendations for Non-binary Clothing Items

Authors: Siddharth D Jaiswal, Animesh Mukherjee

Abstract: Fashion, a highly subjective topic is interpreted differently by all individuals. E-commerce platforms, despite these diverse requirements, tend to cater to the average buyer instead of focusing on edge cases like non-binary shoppers. This case study, through participant surveys, shows that visual search on e-commerce platforms like Amazon, Beagle.Vision and Lykdat, is particularly poor for non-bi… ▽ More Fashion, a highly subjective topic is interpreted differently by all individuals. E-commerce platforms, despite these diverse requirements, tend to cater to the average buyer instead of focusing on edge cases like non-binary shoppers. This case study, through participant surveys, shows that visual search on e-commerce platforms like Amazon, Beagle.Vision and Lykdat, is particularly poor for non-binary clothing items. Our comprehensive quantitative analysis shows that these platforms are more robust to binary clothing inputs. The non-binary clothing items are recommended in a haphazard manner, as observed through negative correlation coefficients of the ranking order. The participants also rate the non-binary recommendations lower than the binary ones. Another intriguing observation is that male raters are more inclined to make binary judgements compared to female raters. Thus it is clear that these systems are not inclusive to the minority, disadvantaged communities of society, like LGBTQ+ people. We conclude with a call to action for the e-commerce platforms to take cognizance of our results and be more inclusive. △ Less

Submitted 4 December, 2021; originally announced December 2021.

Comments: This work has been accepted for publication at ACM CHI 2022 (Case Studies) as an Extended Abstract

TDAM: Top-Down Attention Module for Contextually Guided Feature Selection in CNNs

Authors: Shantanu Jaiswal, Basura Fernando, Cheston Tan

Abstract: Attention modules for Convolutional Neural Networks (CNNs) are an effective method to enhance performance on multiple computer-vision tasks. While existing methods appropriately model channel-, spatial- and self-attention, they primarily operate in a feedforward bottom-up manner. Consequently, the attention mechanism strongly depends on the local information of a single input feature map and does… ▽ More Attention modules for Convolutional Neural Networks (CNNs) are an effective method to enhance performance on multiple computer-vision tasks. While existing methods appropriately model channel-, spatial- and self-attention, they primarily operate in a feedforward bottom-up manner. Consequently, the attention mechanism strongly depends on the local information of a single input feature map and does not incorporate relatively semantically-richer contextual information available at higher layers that can specify "what and where to look" in lower-level feature maps through top-down information flow. Accordingly, in this work, we propose a lightweight top-down attention module (TDAM) that iteratively generates a "visual searchlight" to perform channel and spatial modulation of its inputs and outputs more contextually-relevant feature maps at each computation step. Our experiments indicate that TDAM enhances the performance of CNNs across multiple object-recognition benchmarks and outperforms prominent attention modules while being more parameter and memory efficient. Further, TDAM-based models learn to "shift attention" by localizing individual objects or features at each computation step without any explicit supervision resulting in a 5% improvement for ResNet50 on weakly-supervised object localization. Source code and models are publicly available at: https://github.com/shantanuj/TDAM_Top_down_attention_module . △ Less

Submitted 21 October, 2022; v1 submitted 26 November, 2021; originally announced November 2021.

Comments: ECCV 2022 Camera Ready

Two-Face: Adversarial Audit of Commercial Face Recognition Systems

Authors: Siddharth D Jaiswal, Karthikeya Duggirala, Abhisek Dash, Animesh Mukherjee

Abstract: Computer vision applications like automated face detection are used for a variety of purposes ranging from unlocking smart devices to tracking potential persons of interest for surveillance. Audits of these applications have revealed that they tend to be biased against minority groups which result in unfair and concerning societal and political outcomes. Despite multiple studies over time, these b… ▽ More Computer vision applications like automated face detection are used for a variety of purposes ranging from unlocking smart devices to tracking potential persons of interest for surveillance. Audits of these applications have revealed that they tend to be biased against minority groups which result in unfair and concerning societal and political outcomes. Despite multiple studies over time, these biases have not been mitigated completely and have in fact increased for certain tasks like age prediction. While such systems are audited over benchmark datasets, it becomes necessary to evaluate their robustness for adversarial inputs. In this work, we perform an extensive adversarial audit on multiple systems and datasets, making a number of concerning observations - there has been a drop in accuracy for some tasks on CELEBSET dataset since a previous audit. While there still exists a bias in accuracy against individuals from minority groups for multiple datasets, a more worrying observation is that these biases tend to get exorbitantly pronounced with adversarial inputs toward the minority group. We conclude with a discussion on the broader societal impacts in light of these observations and a few suggestions on how to collectively deal with this issue. △ Less

Submitted 17 November, 2021; originally announced November 2021.

Comments: This work has been accepted for publication at ICWSM 2022

Effect of surface porosity of catalytic supports on plasma-assisted catalysis for ammonia synthesis

Authors: S. Jaiswal, Zhe Chen, Sankaran Sundaresan, Bruce E Koel, Ahmed Diallo

Abstract: A fundamental understanding of plasma-catalyst interactions is important for understanding reaction mechanisms, optimizing the catalyst, and increasing the efficiency of plasma-assisted catalytic process for ammonia (\ce{NH3}) synthesis. We report on the effect of the surface porosity of the catalyst support on this reaction carried out in a coaxial dielectric barrier discharge (DBD) plasma reacto… ▽ More A fundamental understanding of plasma-catalyst interactions is important for understanding reaction mechanisms, optimizing the catalyst, and increasing the efficiency of plasma-assisted catalytic process for ammonia (\ce{NH3}) synthesis. We report on the effect of the surface porosity of the catalyst support on this reaction carried out in a coaxial dielectric barrier discharge (DBD) plasma reactor. The discharge was created using a variable AC applied voltage at room temperature and near atmospheric pressure (550 Torr). Two catalyst supports were compared: porous silica (\ce{SiO2}) ceramic beads and smooth, non-porous soda lime glass beads of almost equal diameter ($\sim$1.5 mm) were used. \ce{N2} conversion and the \ce{NH3} synthesis rate was increased with increasing voltage for both supports, but the energy yield for \ce{NH3} production increased for the \ce{SiO2} beads and decreased for the glass beads. All three of these parameters were always higher when using the \ce{SiO2} beads, which suggests that porosity can be a small advantage for plasma assisted \ce{NH3} synthesis. Discharge and plasma properties were estimated from Lissajous plots and using calculations with the BOLSIG+ software. The effect of different catalyst supports on the physical properties of the discharge was negligible. High resolution optical emission spectra (OES) were used to explore the evolution of gas phase active species, \ce{N2+}, atomic N, electronically excited \ce{N2}, and atomic H (H$_α$, H$_β$), in the plasma in the presence of both supports. The relative concentration of these species was lower in the case of the porous \ce{SiO2} beads for all applied voltages, which suggests that surface reactions are more significant than gas phase reactions for the formation of \ce{NH3} in plasma assisted \ce{NH3} synthesis. △ Less

Submitted 6 November, 2021; originally announced November 2021.

Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognition

Authors: Siyang Song, Zilong Shao, Shashank Jaiswal, Linlin Shen, Michel Valstar, Hatice Gunes

Abstract: This approach builds on two following findings in cognitive science: (i) human cognition partially determines expressed behaviour and is directly linked to true personality traits; and (ii) in dyadic interactions individuals' nonverbal behaviours are influenced by their conversational partner behaviours. In this context, we hypothesise that during a dyadic interaction, a target subject's facial re… ▽ More This approach builds on two following findings in cognitive science: (i) human cognition partially determines expressed behaviour and is directly linked to true personality traits; and (ii) in dyadic interactions individuals' nonverbal behaviours are influenced by their conversational partner behaviours. In this context, we hypothesise that during a dyadic interaction, a target subject's facial reactions are driven by two main factors, i.e. their internal (person-specific) cognitive process, and the externalised nonverbal behaviours of their conversational partner. Consequently, we propose to represent the target subjects (defined as the listener) person-specific cognition in the form of a person-specific CNN architecture that has unique architectural parameters and depth, which takes audio-visual non-verbal cues displayed by the conversational partner (defined as the speaker) as input, and is able to reproduce the target subject's facial reactions. Each person-specific CNN is explored by the Neural Architecture Search (NAS) and a novel adaptive loss function, which is then represented as a graph representation for recognising the target subject's true personality. Experimental results not only show that the produced graph representations are well associated with target subjects' personality traits in both human-human and human-machine interaction scenarios, and outperform the existing approaches with significant advantages, but also demonstrate that the proposed novel strategies such as adaptive loss, and the end-to-end vertices/edges feature learning, help the proposed approach in learning more reliable personality representations. △ Less

Submitted 27 October, 2021; v1 submitted 26 October, 2021; originally announced October 2021.

Comments: Submitted to IJCV

MSC Class: 68T40 ACM Class: I.2.1

VLBI properties of compact interplanetary scintillators detected by the Murchison Widefield Array

Authors: Sumit Jaiswal, Tao An, Ailing Wang, Steven Tingay

Abstract: Interplanetary scintillation (IPS) provides an approach for identifying the presence of sub-arcsec structures in radio sources, and very long baseline interferometry (VLBI) technique can help verify whether the IPS sources have fine structures on milli-arcsec (mas) scales. We searched the available VLBI archive for the 244 IPS sources detected by the Murchison Widefield Array at 162~MHz and found… ▽ More Interplanetary scintillation (IPS) provides an approach for identifying the presence of sub-arcsec structures in radio sources, and very long baseline interferometry (VLBI) technique can help verify whether the IPS sources have fine structures on milli-arcsec (mas) scales. We searched the available VLBI archive for the 244 IPS sources detected by the Murchison Widefield Array at 162~MHz and found 63 cross-matches. We analysed the VLBI data of the 63 sources and characterised the compactness index in terms of the ratio $R$ of the VLBI-measured flux density at 4.3~GHz to the flux density estimated using the Very Large Array Sky Survey (VLASS) at 3~GHz and NRAO VLA Sky Survey (NVSS) at 1.4~GHz ($S_{\rm VLBI}/S_{\rm SA}$). Eleven sources are identified as blazars according to their flat spectra and strong variability. They show high compactness indices with $R>0.4$, compact core-jet structure, and a broad distribution of normalised scintillation index (NSI). Other sources show diverse morphologies (compact core, core and one-sided jet, core and two-sided jets), but there is a correlation between $R$ and NSI with a correlation coefficient $r=0.47$. A similar $R$--NSI correlation is found in sources showing single steep power-law or convex spectra. After excluding blazars (which are already known to be compact sources) from the VLBI-detected IPS sources, a strong correlation is found between the compactness and scintillation index of the remaining samples, indicating that stronger scintillating sources are more compact. This pilot study shows that IPS offers a convenient method to identify compact radio sources without the need to invoke high-resolution imaging observations, which often require significant observational time. △ Less

Submitted 14 October, 2021; originally announced October 2021.

Comments: 28 pages, 7 figures, 4 tables, Accepted for publication in MNRAS

On non-conformal kinetic theory and hydrodynamics for Bjorken flow

Authors: Sunil Jaiswal, Chandrodoy Chattopadhyay, Lipei Du, Ulrich Heinz, Subrata Pal

Abstract: Using and comparing kinetic theory and second-order Chapman-Enskog hydrodynamics, we study the non-conformal dynamics of a system undergoing Bjorken expansion. We use the concept of `free-streaming fixed lines' for scaled shear and bulk stresses in non-conformal kinetic theory and hydrodynamics, and show that these `fixed lines' behave as early-time attractors and repellors of the evolution. In th… ▽ More Using and comparing kinetic theory and second-order Chapman-Enskog hydrodynamics, we study the non-conformal dynamics of a system undergoing Bjorken expansion. We use the concept of `free-streaming fixed lines' for scaled shear and bulk stresses in non-conformal kinetic theory and hydrodynamics, and show that these `fixed lines' behave as early-time attractors and repellors of the evolution. In the conformal limit, the free-streaming fixed lines reduce to the well-known fixed points of conformal Bjorken dynamics. A new fixed point in the free streaming regime is identified which lies at the intersection of these fixed lines. Contrary to the conformal scenario, both kinetic theory and hydrodynamics predict the absence of attractor behavior in the normalised shear stress channel. In kinetic theory a far-off-equilibrium attractor is found for the normalised effective longitudinal pressure, driven by rapid longitudinal expansion. Second-order viscous hydrodynamics fails to accurately describe this attractor. From a thorough analysis of the free-streaming dynamics in Chapman-Enskog hydrodynamics we conclude that this failure results from an inaccurate approximation of the fixed lines and a related incorrect description of the nature of the fixed point. A modified anisotropic hydrodynamic description is presented that provides excellent agreement with kinetic theory results and reproduces the far-from-equilibrium attractor for the scaled longitudinal pressure. △ Less

Submitted 21 July, 2021; originally announced July 2021.

Comments: 28 pages, 22 figures