-
Deep Learning Fusion For Effective Malware Detection: Leveraging Visual Features
Authors:
Jahez Abraham Johny,
Vinod P.,
Asmitha K. A.,
G. Radhamani,
Rafidha Rehiman K. A.,
Mauro Conti
Abstract:
Malware has become a formidable threat as it has been growing exponentially in number and sophistication, thus, it is imperative to have a solution that is easy to implement, reliable, and effective. While recent research has introduced deep learning multi-feature fusion algorithms, they lack a proper explanation. In this work, we investigate the power of fusing Convolutional Neural Network models…
▽ More
Malware has become a formidable threat as it has been growing exponentially in number and sophistication, thus, it is imperative to have a solution that is easy to implement, reliable, and effective. While recent research has introduced deep learning multi-feature fusion algorithms, they lack a proper explanation. In this work, we investigate the power of fusing Convolutional Neural Network models trained on different modalities of a malware executable. We are proposing a novel multimodal fusion algorithm, leveraging three different visual malware features: Grayscale Image, Entropy Graph, and SimHash Image, with which we conducted exhaustive experiments independently on each feature and combinations of all three of them using fusion operators such as average, maximum, add, and concatenate for effective malware detection and classification. The proposed strategy has a detection rate of 1.00 (on a scale of 0-1) in identifying malware in the given dataset. We explained its interpretability with visualization techniques such as t-SNE and Grad-CAM. Experimental results show the model works even for a highly imbalanced dataset. We also assessed the effectiveness of the proposed method on obfuscated malware and achieved state-of-the-art results. The proposed methodology is more reliable as our findings prove VGG16 model can detect and classify malware in a matter of seconds in real-time.
△ Less
Submitted 23 May, 2024;
originally announced May 2024.
-
Enhanced Bayesian Optimization via Preferential Modeling of Abstract Properties
Authors:
Arun Kumar A V,
Alistair Shilton,
Sunil Gupta,
Santu Rana,
Stewart Greenhill,
Svetha Venkatesh
Abstract:
Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian optimization is a principled data-driven approach to experimental optimization, it learns everything from scratch and could greatly benefit from the expertise…
▽ More
Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian optimization is a principled data-driven approach to experimental optimization, it learns everything from scratch and could greatly benefit from the expertise of its human (domain) experts who often reason about systems at different abstraction levels using physical properties that are not necessarily directly measured (or measurable). In this paper, we propose a human-AI collaborative Bayesian framework to incorporate expert preferences about unmeasured abstract properties into the surrogate modeling to further boost the performance of BO. We provide an efficient strategy that can also handle any incorrect/misleading expert bias in preferential judgments. We discuss the convergence behavior of our proposed framework. Our experimental results involving synthetic functions and real-world datasets show the superiority of our method against the baselines.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
Sample-Efficient Co-Design of Robotic Agents Using Multi-fidelity Training on Universal Policy Network
Authors:
Kishan R. Nagiredla,
Buddhika L. Semage,
Thommen G. Karimpanal,
Arun Kumar A. V,
Santu Rana
Abstract:
Co-design involves simultaneously optimizing the controller and agents physical design. Its inherent bi-level optimization formulation necessitates an outer loop design optimization driven by an inner loop control optimization. This can be challenging when the design space is large and each design evaluation involves data-intensive reinforcement learning process for control optimization. To improv…
▽ More
Co-design involves simultaneously optimizing the controller and agents physical design. Its inherent bi-level optimization formulation necessitates an outer loop design optimization driven by an inner loop control optimization. This can be challenging when the design space is large and each design evaluation involves data-intensive reinforcement learning process for control optimization. To improve the sample-efficiency we propose a multi-fidelity-based design exploration strategy based on Hyperband where we tie the controllers learnt across the design spaces through a universal policy learner for warm-starting the subsequent controller learning problems. Further, we recommend a particular way of traversing the Hyperband generated design matrix that ensures that the stochasticity of the Hyperband is reduced the most with the increasing warm starting effect of the universal policy learner as it is strengthened with each new design evaluation. Experiments performed on a wide range of agent design problems demonstrate the superiority of our method compared to the baselines. Additionally, analysis of the optimized designs shows interesting design alterations including design simplifications and non-intuitive alterations that have emerged in the biological world.
△ Less
Submitted 7 September, 2023;
originally announced September 2023.
-
Automated Speckle Interferometry of Known Binaries
Authors:
Nick Hardy,
Leon Bewersdorff,
David Rowe,
Russell Genet,
Rick Wasson,
James Armstrong,
Scott Dixon,
Mark Harris,
Tom Smith,
Rachel Freed,
Paul McCudden,
S. Stephen Rajkumar Inbanathan,
Marie Davis,
Christopher Giavarini,
Ronald Snyder,
Roger Wholly,
Maaike Calvin,
Sumner Cotton,
Julia Carter,
Mario Terrazas,
Shane Christopher R.,
Arun Kumar A.,
Sithara Naskath H.,
Mariam Ronald Rabin A
Abstract:
Astronomers have been measuring the separations and position angles between the two components of binary stars since William Herschel began his observations in 1781. In 1970, Anton Labeyrie pioneered a method, speckle interferometry, that overcomes the usual resolution limits induced by atmospheric turbulence by taking hundreds or thousands of short exposures and reducing them in Fourier space. Ou…
▽ More
Astronomers have been measuring the separations and position angles between the two components of binary stars since William Herschel began his observations in 1781. In 1970, Anton Labeyrie pioneered a method, speckle interferometry, that overcomes the usual resolution limits induced by atmospheric turbulence by taking hundreds or thousands of short exposures and reducing them in Fourier space. Our 2022 automation of speckle interferometry allowed us to use a fully robotic 1.0-meter PlaneWave Instruments telescope, located at the El Sauce Observatory in the Atacama Desert of Chile, to obtain observations of many known binaries with established orbits. The long-term objective of these observations is to establish the precision, accuracy, and limitations of this telescope's automated speckle interferometry measurements. This paper provides an early overview of the Known Binaries Project and provide example results on a small-separation (0.27") binary, WDS 12274-2843 B 228.
△ Less
Submitted 27 March, 2023;
originally announced March 2023.
-
BO-Muse: A human expert and AI teaming framework for accelerated experimental design
Authors:
Sunil Gupta,
Alistair Shilton,
Arun Kumar A V,
Shannon Ryan,
Majid Abdolshah,
Hung Le,
Santu Rana,
Julian Berk,
Mahad Rashid,
Svetha Venkatesh
Abstract:
In this paper we introduce BO-Muse, a new approach to human-AI teaming for the optimization of expensive black-box functions. Inspired by the intrinsic difficulty of extracting expert knowledge and distilling it back into AI models and by observations of human behavior in real-world experimental design, our algorithm lets the human expert take the lead in the experimental process. The human expert…
▽ More
In this paper we introduce BO-Muse, a new approach to human-AI teaming for the optimization of expensive black-box functions. Inspired by the intrinsic difficulty of extracting expert knowledge and distilling it back into AI models and by observations of human behavior in real-world experimental design, our algorithm lets the human expert take the lead in the experimental process. The human expert can use their domain expertise to its full potential, while the AI plays the role of a muse, injecting novelty and searching for areas of weakness to break the human out of over-exploitation induced by cognitive entrenchment. With mild assumptions, we show that our algorithm converges sub-linearly, at a rate faster than the AI or human alone. We validate our algorithm using synthetic data and with human experts performing real-world experiments.
△ Less
Submitted 30 March, 2023; v1 submitted 2 March, 2023;
originally announced March 2023.
-
Dual Script E2E framework for Multilingual and Code-Switching ASR
Authors:
Mari Ganesh Kumar,
Jom Kuriakose,
Anand Thyagachandran,
Arun Kumar A,
Ashish Seth,
Lodagala Durga Prasad,
Saish Jaiswal,
Anusha Prakash,
Hema Murthy
Abstract:
India is home to multiple languages, and training automatic speech recognition (ASR) systems for languages is challenging. Over time, each language has adopted words from other languages, such as English, leading to code-mixing. Most Indian languages also have their own unique scripts, which poses a major limitation in training multilingual and code-switching ASR systems.
Inspired by results in…
▽ More
India is home to multiple languages, and training automatic speech recognition (ASR) systems for languages is challenging. Over time, each language has adopted words from other languages, such as English, leading to code-mixing. Most Indian languages also have their own unique scripts, which poses a major limitation in training multilingual and code-switching ASR systems.
Inspired by results in text-to-speech synthesis, in this work, we use an in-house rule-based phoneme-level common label set (CLS) representation to train multilingual and code-switching ASR for Indian languages. We propose two end-to-end (E2E) ASR systems. In the first system, the E2E model is trained on the CLS representation, and we use a novel data-driven back-end to recover the native language script. In the second system, we propose a modification to the E2E model, wherein the CLS representation and the native language characters are used simultaneously for training. We show our results on the multilingual and code-switching tasks of the Indic ASR Challenge 2021. Our best results achieve 6% and 5% improvement (approx) in word error rate over the baseline system for the multilingual and code-switching tasks, respectively, on the challenge development data.
△ Less
Submitted 2 June, 2021;
originally announced June 2021.
-
Bandlimiting Neural Networks Against Adversarial Attacks
Authors:
Yu** Lin,
Kasra Ahmadi K. A.,
Hui Jiang
Abstract:
In this paper, we study the adversarial attack and defence problem in deep learning from the perspective of Fourier analysis. We first explicitly compute the Fourier transform of deep ReLU neural networks and show that there exist decaying but non-zero high frequency components in the Fourier spectrum of neural networks. We demonstrate that the vulnerability of neural networks towards adversarial…
▽ More
In this paper, we study the adversarial attack and defence problem in deep learning from the perspective of Fourier analysis. We first explicitly compute the Fourier transform of deep ReLU neural networks and show that there exist decaying but non-zero high frequency components in the Fourier spectrum of neural networks. We demonstrate that the vulnerability of neural networks towards adversarial samples can be attributed to these insignificant but non-zero high frequency components. Based on this analysis, we propose to use a simple post-averaging technique to smooth out these high frequency components to improve the robustness of neural networks against adversarial attacks. Experimental results on the ImageNet dataset have shown that our proposed method is universally effective to defend many existing adversarial attacking methods proposed in the literature, including FGSM, PGD, DeepFool and C&W attacks. Our post-averaging method is simple since it does not require any re-training, and meanwhile it can successfully defend over 95% of the adversarial samples generated by these methods without introducing any significant performance degradation (less than 1%) on the original clean images.
△ Less
Submitted 29 May, 2019;
originally announced May 2019.
-
Mueller matrix spectroscopy of Fano resonance in Plasmonic Oligomers
Authors:
Shubham Chandel,
Ankit K Singh,
Aman Agrawal,
Aneeth K A,
Angad Gupta,
Achanta Venugopal,
Nirmalya Ghosh
Abstract:
Fano resonance in plasmonic oligomers originating from the interference of a spectrally broad superradiant mode and a discrete subradiant mode is under intensive recent investigations due to numerous potential applications. In this regard, development of experimental means to understand and control the complex Fano interference process and to modulate the resulting asymmetric Fano spectral line sh…
▽ More
Fano resonance in plasmonic oligomers originating from the interference of a spectrally broad superradiant mode and a discrete subradiant mode is under intensive recent investigations due to numerous potential applications. In this regard, development of experimental means to understand and control the complex Fano interference process and to modulate the resulting asymmetric Fano spectral line shape is highly sought after. Here we present a polarization Mueller matrix measurement and inverse analysis approach for quantitative understanding and interpretation of the complex interference process that lead to Fano resonance in symmetry broken plasmonic oligomers. The spectral Mueller matrices of the plasmonic oligomers were recorded using a custom designed dark-field Mueller matrix spectroscopy system. These were subsequently analyzed using differential Mueller matrix decomposition technique to yield the quantitative sample polarimetry characteristics, namely, polarization diattenuation (d) and linear retardance (δ) parameters. The unique signature of the interference of the superradiant dipolar plasmon mode and the subradiant quadrupolar mode of the symmetry broken plasmonic oligomers manifested as rapid spectral variation of the diattenuation and the linear retardance parameters across the Fano spectral dip. The polarization information contained in the Mueller matrix was further utilized to desirably control the Fano spectral line shape. The experimental Mueller matrix analysis was complemented with finite element based numerical simulations, which enabled quantitative understanding of the interference of the superradiant and the subradiant plasmon modes and its link with the polarization diattenuation and retardance parameters.
△ Less
Submitted 30 April, 2018;
originally announced April 2018.
-
In-orbit Performance of UVIT and First Results
Authors:
S. N. Tandon,
J. B. Hutchings,
S. K. Ghosh,
A. Subramaniam,
G. Koshy,
V. Girish V,
P. U. Kamath,
s. Kathiravan,
A. Kumar,
J. P. Lancelot,
P. K. Mahesh,
R. Mohan,
J. Murthy,
S. Nagabhushana,
A. K. Pati A,
J. Postma,
N. Kameswara Rao,
K. Sankarasubramanian,
P. Sreekumar,
S. Sriram,
C. S. Stalin,
F. Sutaria,
Y. H. Sreedhar,
I. V. Barve,
C. Mondal
, et al. (1 additional authors not shown)
Abstract:
The performance of the ultraviolet telescope (UVIT) on-board ASTROSAT is reported. The performance in orbit is also compared with estimates made from the calibrations done on the ground. The sensitivity is found to be within ~15% of the estimates, and the spatial resolution in the NUV is found to exceed significantly the design value of 1.8 arcsec and it is marginally better in the FUV. Images obt…
▽ More
The performance of the ultraviolet telescope (UVIT) on-board ASTROSAT is reported. The performance in orbit is also compared with estimates made from the calibrations done on the ground. The sensitivity is found to be within ~15% of the estimates, and the spatial resolution in the NUV is found to exceed significantly the design value of 1.8 arcsec and it is marginally better in the FUV. Images obtained from UVIT are presented to illustrate the details revealed by the high spatial resolution. The potential of multi-band observations in the ultraviolet with high spatial resolution is illustrated by some results.
△ Less
Submitted 2 December, 2016;
originally announced December 2016.
-
New Superconductor (Na0.25K0.45) Ba3Bi4O12: A First-principles Study
Authors:
Ali M. S.,
Aftabuzzaman M.,
Roknuzzaman M.,
Rayhan M. A.,
Parvin F.,
Ali M. M.,
Rubel M. H. K.,
Islam A. K. M. A
Abstract:
A new superconductor (Na0.25K0.45)Ba3Bi4O12, having an A-site-ordered double perovskite structure, with a maximum Tc ~ 27 K has very recently been discovered through hydrothermal synthesis at 593 K. The structural, elastic, electronic, and thermal properties of the new synthesized compound have been investigated theoretically. Here we have employed the pseudo-potential plane-wave (PP-PW) approach…
▽ More
A new superconductor (Na0.25K0.45)Ba3Bi4O12, having an A-site-ordered double perovskite structure, with a maximum Tc ~ 27 K has very recently been discovered through hydrothermal synthesis at 593 K. The structural, elastic, electronic, and thermal properties of the new synthesized compound have been investigated theoretically. Here we have employed the pseudo-potential plane-wave (PP-PW) approach based on the density functional (DFT) theory, within the generalized gradient approximation (GGA). The elastic constants (Cij), Pugh`s ratio, Cauchy`s pressure and other elastic parameters are derived and analyzed using energy strain method for the first time. We have discussed the bonding nature in the light of the electronic valence charge density. Both electron and hole-like Fermi surfaces are present in the compound under study which indicate the multiple-band nature of (Na0.25K0.45)Ba3Bi4O12. The compound is indicated to be a strongly coupled superconductor which is based on the estimated e-ph coupling constant. The thermodynamic properties such as bulk modulus, Debye temperature, heat capacities and volume thermal expansion coefficient at elevated temperature and pressure are calculated and analyzed for the first time by using quasi-harmonic model.
Key words: double perovskite, superconductor, elastic properties, electronic properties, thermal properties
△ Less
Submitted 22 July, 2014;
originally announced July 2014.
-
A Wavelet Based Algorithm for the Identification of Oscillatory Event-Related Potential Components
Authors:
Arun Kumar A,
Ninan Sajeeth Philip,
Vincent J Samar,
James A Desjardins,
Sidney J Segalowitz
Abstract:
Event Related Potentials (ERPs) are very feeble alterations in the ongoing Electroencephalogram (EEG) and their detection is a challenging problem. Based on the unique time-based parameters derived from wavelet coefficients and the asymmetry property of wavelets a novel algorithm to separate ERP components in single-trial EEG data is described. Though illustrated as a specific application to N170…
▽ More
Event Related Potentials (ERPs) are very feeble alterations in the ongoing Electroencephalogram (EEG) and their detection is a challenging problem. Based on the unique time-based parameters derived from wavelet coefficients and the asymmetry property of wavelets a novel algorithm to separate ERP components in single-trial EEG data is described. Though illustrated as a specific application to N170 ERP detection, the algorithm is a generalized approach that can be easily adapted to isolate different kinds of ERP components. The algorithm detected the N170 ERP component with a high level of accuracy. We demonstrate that the asymmetry method is more accurate than the matching wavelet algorithm and t-CWT method by 48.67 and 8.03 percent respectively. This paper provides an off-line demonstration of the algorithm and considers issues related to the extension of the algorithm to real-time applications.
△ Less
Submitted 20 June, 2014;
originally announced July 2014.
-
Feature Selection Strategies for Classifying High Dimensional Astronomical Data Sets
Authors:
Ciro Donalek,
Arun Kumar A.,
S. G. Djorgovski,
Ashish A. Mahabal,
Matthew J. Graham,
Thomas J. Fuchs,
Michael J. Turmon,
N. Sajeeth Philip,
Michael Ting-Chang Yang,
Giuseppe Longo
Abstract:
The amount of collected data in many scientific fields is increasing, all of them requiring a common task: extract knowledge from massive, multi parametric data sets, as rapidly and efficiently possible. This is especially true in astronomy where synoptic sky surveys are enabling new research frontiers in the time domain astronomy and posing several new object classification challenges in multi di…
▽ More
The amount of collected data in many scientific fields is increasing, all of them requiring a common task: extract knowledge from massive, multi parametric data sets, as rapidly and efficiently possible. This is especially true in astronomy where synoptic sky surveys are enabling new research frontiers in the time domain astronomy and posing several new object classification challenges in multi dimensional spaces; given the high number of parameters available for each object, feature selection is quickly becoming a crucial task in analyzing astronomical data sets. Using data sets extracted from the ongoing Catalina Real-Time Transient Surveys (CRTS) and the Kepler Mission we illustrate a variety of feature selection strategies used to identify the subsets that give the most information and the results achieved applying these techniques to three major astronomical problems.
△ Less
Submitted 7 October, 2013;
originally announced October 2013.
