-
GAURA: Generalizable Approach for Unified Restoration and Rendering of Arbitrary Views
Authors:
Vinayak Gupta,
Rongali Simhachala Venkata Girish,
Mukund Varma T,
Ayush Tewari,
Kaushik Mitra
Abstract:
Neural rendering methods can achieve near-photorealistic image synthesis of scenes from posed input images. However, when the images are imperfect, e.g., captured in very low-light conditions, state-of-the-art methods fail to reconstruct high-quality 3D scenes. Recent approaches have tried to address this limitation by modeling various degradation processes in the image formation model; however, t…
▽ More
Neural rendering methods can achieve near-photorealistic image synthesis of scenes from posed input images. However, when the images are imperfect, e.g., captured in very low-light conditions, state-of-the-art methods fail to reconstruct high-quality 3D scenes. Recent approaches have tried to address this limitation by modeling various degradation processes in the image formation model; however, this limits them to specific image degradations. In this paper, we propose a generalizable neural rendering method that can perform high-fidelity novel view synthesis under several degradations. Our method, GAURA, is learning-based and does not require any test-time scene-specific optimization. It is trained on a synthetic dataset that includes several degradation types. GAURA outperforms state-of-the-art methods on several benchmarks for low-light enhancement, dehazing, deraining, and on-par for motion deblurring. Further, our model can be efficiently fine-tuned to any new incoming degradation using minimal data. We thus demonstrate adaptation results on two unseen degradations, desnowing and removing defocus blur. Code and video results are available at vinayak-vg.github.io/GAURA.
△ Less
Submitted 11 July, 2024;
originally announced July 2024.
-
Unified formalism for the emergence of space in non-equilibrium description
Authors:
Hassan Basari V. T.
Abstract:
Previous studies indicate that the expansion law in emergence of space can be derived from the first law f thermodynamics. It has been proposed a unified formulation for the expansion law applicable to a general set of gravity theories in equilibrium description. In that formulation, which is based on the first law of thermodynamics, the non-equilibrium terms are ignored. Additionally, the structu…
▽ More
Previous studies indicate that the expansion law in emergence of space can be derived from the first law f thermodynamics. It has been proposed a unified formulation for the expansion law applicable to a general set of gravity theories in equilibrium description. In that formulation, which is based on the first law of thermodynamics, the non-equilibrium terms are ignored. Additionally, the structure of surface degrees of freedom in that formulation deviates from the standard notion, where $N_{sur} \ne 4S$ in general theories of gravity. This motivates us to develop a new unified formulation for the expansion law by incorporating non-equilibrium terms into the first law of thermodynamics. In this work, we formulate a unified expansion law in a non-equilibrium context, utilizing the first law of thermodynamics along with the definition of an effective Misner-Sharp energy. Compared to previous generalizations of the expansion law, our formulation reconciles the basic definition of surface degrees of freedom $N_{sur} = 4S$ for a general set of gravity theories. The unified expansion law in non-equilibrium not only highlights the direct relationship between the rate of areal volume and the difference in degrees of freedom between the surface and bulk $(N_{sur}-N_{bulk})$, but also reveals an inverse correlation with the density of surface degrees of freedom. We also demonstrate that the unified expansion law is instrumental in deriving the expansion law for a general set of gravity theories, including those with higher-order curvature corrections such as $f(R)$ theories of gravity, which require a non-equilibrium description.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
A Construct-Optimize Approach to Sparse View Synthesis without Camera Pose
Authors:
Kaiwen Jiang,
Yang Fu,
Mukund Varma T,
Yash Belhe,
Xiaolong Wang,
Hao Su,
Ravi Ramamoorthi
Abstract:
Novel view synthesis from a sparse set of input images is a challenging problem of great practical interest, especially when camera poses are absent or inaccurate. Direct optimization of camera poses and usage of estimated depths in neural radiance field algorithms usually do not produce good results because of the coupling between poses and depths, and inaccuracies in monocular depth estimation.…
▽ More
Novel view synthesis from a sparse set of input images is a challenging problem of great practical interest, especially when camera poses are absent or inaccurate. Direct optimization of camera poses and usage of estimated depths in neural radiance field algorithms usually do not produce good results because of the coupling between poses and depths, and inaccuracies in monocular depth estimation. In this paper, we leverage the recent 3D Gaussian splatting method to develop a novel construct-and-optimize method for sparse view synthesis without camera poses. Specifically, we construct a solution progressively by using monocular depth and projecting pixels back into the 3D world. During construction, we optimize the solution by detecting 2D correspondences between training views and the corresponding rendered images. We develop a unified differentiable pipeline for camera registration and adjustment of both camera poses and depths, followed by back-projection. We also introduce a novel notion of an expected surface in Gaussian splatting, which is critical to our optimization. These steps enable a coarse solution, which can then be low-pass filtered and refined using standard optimization methods. We demonstrate results on the Tanks and Temples and Static Hikes datasets with as few as three widely-spaced views, showing significantly better quality than competing methods, including those with approximate camera pose information. Moreover, our results improve with more views and outperform previous InstantNGP and Gaussian Splatting algorithms even when using half the dataset. Project page: https://raymondjiangkw.github.io/cogs.github.io/
△ Less
Submitted 10 June, 2024; v1 submitted 6 May, 2024;
originally announced May 2024.
-
Lift3D: Zero-Shot Lifting of Any 2D Vision Model to 3D
Authors:
Mukund Varma T,
Peihao Wang,
Zhiwen Fan,
Zhangyang Wang,
Hao Su,
Ravi Ramamoorthi
Abstract:
In recent years, there has been an explosion of 2D vision models for numerous tasks such as semantic segmentation, style transfer or scene editing, enabled by large-scale 2D image datasets. At the same time, there has been renewed interest in 3D scene representations such as neural radiance fields from multi-view images. However, the availability of 3D or multiview data is still substantially limi…
▽ More
In recent years, there has been an explosion of 2D vision models for numerous tasks such as semantic segmentation, style transfer or scene editing, enabled by large-scale 2D image datasets. At the same time, there has been renewed interest in 3D scene representations such as neural radiance fields from multi-view images. However, the availability of 3D or multiview data is still substantially limited compared to 2D image datasets, making extending 2D vision models to 3D data highly desirable but also very challenging. Indeed, extending a single 2D vision operator like scene editing to 3D typically requires a highly creative method specialized to that task and often requires per-scene optimization. In this paper, we ask the question of whether any 2D vision model can be lifted to make 3D consistent predictions. We answer this question in the affirmative; our new Lift3D method trains to predict unseen views on feature spaces generated by a few visual models (i.e. DINO and CLIP), but then generalizes to novel vision operators and tasks, such as style transfer, super-resolution, open vocabulary segmentation and image colorization; for some of these tasks, there is no comparable previous 3D method. In many cases, we even outperform state-of-the-art methods specialized for the task in question. Moreover, Lift3D is a zero-shot method, in the sense that it requires no task-specific training, nor scene-specific optimization.
△ Less
Submitted 27 March, 2024;
originally announced March 2024.
-
Calibration of VELC detectors on-board Aditya-L1 mission
Authors:
Shalabh Mishra,
K. Sasikumar Raja,
Sanal Krishnan V U,
Venkata Suresh Narra,
Bhavana Hegde S,
Utkarsha D.,
Muthu Priyal V,
Pawan Kumar S,
Natarajan V,
Raghavendra Prasad B,
Jagdev Singh,
Umesh Kamath P,
Kathiravan S,
Vishnu T,
Suresha,
Savarimuthu P,
Jalshri H Desai,
Rajiv Kumaran,
Shiv Sagar,
Sumit Kumar,
Inderjeet Singh Bamrah,
Amit Kumar
Abstract:
Aditya-L1 is the first Indian space mission to explore the Sun and solar atmosphere with seven multi-wavelength payloads, with Visible Emission Line Coronagraph (VELC) being the prime payload. It is an internally occulted coronagraph with four channels to image the Sun at 5000 Å~ in the field of view 1.05 - 3 \rsun, and to pursue spectroscopy at 5303 Å, 7892 Å~ and 10747 Å~ channels in the FOV (1.…
▽ More
Aditya-L1 is the first Indian space mission to explore the Sun and solar atmosphere with seven multi-wavelength payloads, with Visible Emission Line Coronagraph (VELC) being the prime payload. It is an internally occulted coronagraph with four channels to image the Sun at 5000 Å~ in the field of view 1.05 - 3 \rsun, and to pursue spectroscopy at 5303 Å, 7892 Å~ and 10747 Å~ channels in the FOV (1.05 - 1.5 \rsun). In addition, spectropolarimetry is planned at 10747 Å~ channel. Therefore, VELC has three sCMOS detectors and one InGaAs detector. In this article, we aim to describe the technical details and specifications of the detectors achieved by way of thermo-vacuum calibration at the CREST campus of the Indian Institute of Astrophysics, Bangalore, India. Furthermore, we report the estimated conversion gain, full-well capacity, and readout noise at different temperatures. Based on the numbers, it is thus concluded that it is essential to operate the sCMOS detectors and InGaAs detectors at $-5^{\circ}$ and $-17^{\circ}$ C, respectively, at the spacecraft level.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization
Authors:
Minghua Liu,
Chao Xu,
Haian **,
Linghao Chen,
Mukund Varma T,
Zexiang Xu,
Hao Su
Abstract:
Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion models but suffer from lengthy optimization time, 3D inconsistency results, and poor geometry. In this work, we propose a novel method that takes a single image o…
▽ More
Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion models but suffer from lengthy optimization time, 3D inconsistency results, and poor geometry. In this work, we propose a novel method that takes a single image of any object as input and generates a full 360-degree 3D textured mesh in a single feed-forward pass. Given a single image, we first use a view-conditioned 2D diffusion model, Zero123, to generate multi-view images for the input view, and then aim to lift them up to 3D space. Since traditional reconstruction methods struggle with inconsistent multi-view predictions, we build our 3D reconstruction module upon an SDF-based generalizable neural surface reconstruction method and propose several critical training strategies to enable the reconstruction of 360-degree meshes. Without costly optimizations, our method reconstructs 3D shapes in significantly less time than existing methods. Moreover, our method favors better geometry, generates more 3D consistent results, and adheres more closely to the input image. We evaluate our approach on both synthetic data and in-the-wild images and demonstrate its superiority in terms of both mesh quality and runtime. In addition, our approach can seamlessly support the text-to-3D task by integrating with off-the-shelf text-to-image diffusion models.
△ Less
Submitted 29 June, 2023;
originally announced June 2023.
-
Distribution Preserving Source Separation With Time Frequency Predictive Models
Authors:
Pedro J. Villasana T.,
Janusz Klejsa,
Lars Villemoes,
Per Hedelin
Abstract:
We provide an example of a distribution preserving source separation method, which aims at addressing perceptual shortcomings of state-of-the-art methods. Our approach uses unconditioned generative models of signal sources. Reconstruction is achieved by means of mix-consistent sampling from a distribution conditioned on a realization of a mix. The separated signals follow their respective source d…
▽ More
We provide an example of a distribution preserving source separation method, which aims at addressing perceptual shortcomings of state-of-the-art methods. Our approach uses unconditioned generative models of signal sources. Reconstruction is achieved by means of mix-consistent sampling from a distribution conditioned on a realization of a mix. The separated signals follow their respective source distributions, which provides an advantage when separation results are evaluated in a listening test.
△ Less
Submitted 10 March, 2023;
originally announced March 2023.
-
The total neutron production from the alpha induced reaction on natural Zirconium
Authors:
Vafiya Thaslim T T,
M M Musthafa,
Midhun C V,
S. Ghugre,
Gokul Das H,
Swapna B,
Najmunnisa T,
F S Shana,
Ri** N T,
S Dasgupta,
J Datta
Abstract:
A significant amount of alpha particles, upto $\sim$ 35 MeV are produced in the reactor environment. Alpha induced reaction on natural Zirconium, a reactor component, upto 40 MeV has been measured using stacked foil activation technique. The total neutron production cross section from all possible channels for $α$ energies upto 35 MeV is also estimated using TALYS 1.96. The isomeric cross section…
▽ More
A significant amount of alpha particles, upto $\sim$ 35 MeV are produced in the reactor environment. Alpha induced reaction on natural Zirconium, a reactor component, upto 40 MeV has been measured using stacked foil activation technique. The total neutron production cross section from all possible channels for $α$ energies upto 35 MeV is also estimated using TALYS 1.96. The isomeric cross section ratio for the production of the radionuclide $^{95}Nb$ has been measured and reported for the first time.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
Emergence of cosmic space in Tsallis modified gravity from equilibrium and non-equilibrium thermodynamic perspective
Authors:
M. Dheepika,
Hassan Basari V. T.,
Titus K. Mathew
Abstract:
In this paper, we obtain the law of emergence with Tsallis entropy from the thermodynamic laws. We first derive the law of emergence from the equilibrium description of the unified first law and Clausius relation. However, it has been shown that considering Tsallis entropy as the horizon entropy, the Clausius relation $δQ=T dS$ does not hold due to non-equilibrium thermodynamics and is replaced by…
▽ More
In this paper, we obtain the law of emergence with Tsallis entropy from the thermodynamic laws. We first derive the law of emergence from the equilibrium description of the unified first law and Clausius relation. However, it has been shown that considering Tsallis entropy as the horizon entropy, the Clausius relation $δQ=T dS$ does not hold due to non-equilibrium thermodynamics and is replaced by the entropy-balance relation $dS=\frac{δQ}{T}+d_{i}S$, where $d_iS$ is the additional entropy produced due to the irreversible thermodynamic process. Hence, we derive the law of emergence from the non-equilibrium description of thermodynamic laws. The comparison between the law of emergence in both cases shows that the law of emergence from the non-equilibrium approach describes the expansion of the universe in terms of the areal volume, unlike the effective volume in the equilibrium case. We have further shown that the law of emergence also satisfies the condition of the maximization of entropy for a de Sitter universe; thus, the entropy of the universe evolves to a bounded value in the asymptotic future.
△ Less
Submitted 30 December, 2022; v1 submitted 25 November, 2022;
originally announced November 2022.
-
Modified expansion law with Kodama-Hayward temperature for the horizon
Authors:
Muhsinath. M,
Hassan Basari V. T.,
Titus K. Mathew
Abstract:
The expansion law proposed by Padmanabhan suggests that the evolution of the volume of the horizon is due to the difference between the degrees of freedom on the horizon and the degrees of freedom in the bulk enclosed by the horizon. In formulating this law, Padmanabhan used the temperature, $T=H/2π$, for a dynamical expansion. In this work, we modified the expansion law using Kodama-Hayward tempe…
▽ More
The expansion law proposed by Padmanabhan suggests that the evolution of the volume of the horizon is due to the difference between the degrees of freedom on the horizon and the degrees of freedom in the bulk enclosed by the horizon. In formulating this law, Padmanabhan used the temperature, $T=H/2π$, for a dynamical expansion. In this work, we modified the expansion law using Kodama-Hayward temperature, the dynamical temperature, for the horizon, first in (3+1) Einstein's gravity and extended it to higher order gravity theories such as (n+1) Einstein gravity, Gauss-Bonnet gravity, and more general Lovelock gravity. Contrary to the conventional approach, we expressed degrees of freedom of the horizon in terms of the surface energy of the horizon. Also, we have expressed modified expansion law in terms of cosmic components. It then turns out that it is possible to express the modified expansion law in a form as if $T=H/2π$ is the temperature of the dynamical horizon.
△ Less
Submitted 3 November, 2022;
originally announced November 2022.
-
Unified formalism for the emergence of space from the first law of thermodynamics
Authors:
Hassan Basari V. T.,
P. B. Krishna,
Titus K. Mathew
Abstract:
We derive a unified expansion law for our universe from the first law of thermodynamics on the apparent horizon, where entropic evolution depicts the emergence of cosmic space. The derivation advances a general form for degrees of freedom on the surface and bulk, which provides a natural generalization for the expansion law proposed by Padmanabhan. The general expression for the surface degrees of…
▽ More
We derive a unified expansion law for our universe from the first law of thermodynamics on the apparent horizon, where entropic evolution depicts the emergence of cosmic space. The derivation advances a general form for degrees of freedom on the surface and bulk, which provides a natural generalization for the expansion law proposed by Padmanabhan. The general expression for the surface degrees of freedom differs from the natural expectation, $ N_{sur }= 4S $ in the emergent gravity paradigm for general theories of gravity. The derivation also provides justification for the selection of Gibbons-Hawking temperature in the original expansion law and for the use of areal volume in the non-flat FRW universe. Since the unified expansion law exclusively depends on the form of entropy, the method is applicable to obtain the expansion law in any gravity theory without any additional ad hoc assumptions. From the general expansion law, we have obtained the expansion law corresponding to different theories of gravity like (n+1) Einstein, Gauss-Bonnet, Lovelock, and Horava-Lifshitz. We also obtained the expansion law for non-extensive entropy like Tsallis entropy from the unified expansion law.
△ Less
Submitted 21 February, 2023; v1 submitted 1 September, 2022;
originally announced September 2022.
-
Is Attention All That NeRF Needs?
Authors:
Mukund Varma T,
Peihao Wang,
Xuxi Chen,
Tianlong Chen,
Subhashini Venugopalan,
Zhangyang Wang
Abstract:
We present Generalizable NeRF Transformer (GNT), a transformer-based architecture that reconstructs Neural Radiance Fields (NeRFs) and learns to renders novel views on the fly from source views. While prior works on NeRFs optimize a scene representation by inverting a handcrafted rendering equation, GNT achieves neural representation and rendering that generalizes across scenes using transformers…
▽ More
We present Generalizable NeRF Transformer (GNT), a transformer-based architecture that reconstructs Neural Radiance Fields (NeRFs) and learns to renders novel views on the fly from source views. While prior works on NeRFs optimize a scene representation by inverting a handcrafted rendering equation, GNT achieves neural representation and rendering that generalizes across scenes using transformers at two stages. (1) The view transformer leverages multi-view geometry as an inductive bias for attention-based scene representation, and predicts coordinate-aligned features by aggregating information from epipolar lines on the neighboring views. (2) The ray transformer renders novel views using attention to decode the features from the view transformer along the sampled points during ray marching. Our experiments demonstrate that when optimized on a single scene, GNT can successfully reconstruct NeRF without an explicit rendering formula due to the learned ray renderer. When trained on multiple scenes, GNT consistently achieves state-of-the-art performance when transferring to unseen scenes and outperform all other methods by ~10% on average. Our analysis of the learned attention maps to infer depth and occlusion indicate that attention enables learning a physically-grounded rendering. Our results show the promise of transformers as a universal modeling tool for graphics. Please refer to our project page for video results: https://vita-group.github.io/GNT/.
△ Less
Submitted 1 March, 2023; v1 submitted 27 July, 2022;
originally announced July 2022.
-
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Authors:
Aarohi Srivastava,
Abhinav Rastogi,
Abhishek Rao,
Abu Awal Md Shoeb,
Abubakar Abid,
Adam Fisch,
Adam R. Brown,
Adam Santoro,
Aditya Gupta,
Adrià Garriga-Alonso,
Agnieszka Kluska,
Aitor Lewkowycz,
Akshat Agarwal,
Alethea Power,
Alex Ray,
Alex Warstadt,
Alexander W. Kocurek,
Ali Safaya,
Ali Tazarv,
Alice Xiang,
Alicia Parrish,
Allen Nie,
Aman Hussain,
Amanda Askell,
Amanda Dsouza
, et al. (426 additional authors not shown)
Abstract:
Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-futur…
▽ More
Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-future capabilities and limitations of language models. To address this challenge, we introduce the Beyond the Imitation Game benchmark (BIG-bench). BIG-bench currently consists of 204 tasks, contributed by 450 authors across 132 institutions. Task topics are diverse, drawing problems from linguistics, childhood development, math, common-sense reasoning, biology, physics, social bias, software development, and beyond. BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models. We evaluate the behavior of OpenAI's GPT models, Google-internal dense transformer architectures, and Switch-style sparse transformers on BIG-bench, across model sizes spanning millions to hundreds of billions of parameters. In addition, a team of human expert raters performed all tasks in order to provide a strong baseline. Findings include: model performance and calibration both improve with scale, but are poor in absolute terms (and when compared with rater performance); performance is remarkably similar across model classes, though with benefits from sparsity; tasks that improve gradually and predictably commonly involve a large knowledge or memorization component, whereas tasks that exhibit "breakthrough" behavior at a critical scale often involve multiple steps or components, or brittle metrics; social bias typically increases with scale in settings with ambiguous context, but this can be improved with prompting.
△ Less
Submitted 12 June, 2023; v1 submitted 9 June, 2022;
originally announced June 2022.
-
Emergence of cosmic space and its connection with thermodynamic principles
Authors:
P. B. Krishna,
Hassan Basari V. T.,
Titus K Mathew
Abstract:
The recent research on the connection between gravity and thermodynamics suggests that gravity could be an emergent phenomenon. Following this, Padmanabhan proposed a novel idea that the expansion of the universe can be interpreted as equivalent to the emergence of space with the progress of cosmic time. In this approach, the expansion of the universe is described by what is known as the law of em…
▽ More
The recent research on the connection between gravity and thermodynamics suggests that gravity could be an emergent phenomenon. Following this, Padmanabhan proposed a novel idea that the expansion of the universe can be interpreted as equivalent to the emergence of space with the progress of cosmic time. In this approach, the expansion of the universe is described by what is known as the law of emergence, which states that the expansion of the universe is driven by the difference between the number of bulk and surface degrees of freedom in a region bounded by the Hubble radius. This principle correctly reproduces the standard evolution of a Friedmann universe. We establish the connection of the law of emergence, which is conceptually different from the conventional paradigm to describe cosmology, with other well-established results in thermodynamics. It has been shown that the law of emergence can be derived from the unified first law of thermodynamics, which can then be considered as the backbone of the law. However, the law of emergence is rich in structure than implied by the First law thermodynamics alone. It further explains the evolution of the universe towards a state of maximum horizon entropy. Following this, it can be considered that the first law of thermodynamics, along with the additional constraints imposed by the maximisation of the horizon entropy, can together lead to the law of emergence. In the present article, we first make a brief review of Padmanabhan's proposal and then studies its connection with the thermodynamics of the horizon in the context of Einstein's, Gauss-Bonnet, and more general Lovelock gravity theories.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation
Authors:
Kaustubh D. Dhole,
Varun Gangal,
Sebastian Gehrmann,
Aadesh Gupta,
Zhenhao Li,
Saad Mahamood,
Abinaya Mahendiran,
Simon Mille,
Ashish Shrivastava,
Samson Tan,
Tongshuang Wu,
Jascha Sohl-Dickstein,
**ho D. Choi,
Eduard Hovy,
Ondrej Dusek,
Sebastian Ruder,
Sajant Anand,
Nagender Aneja,
Rabin Banjade,
Lisa Barthe,
Hanna Behnke,
Ian Berlot-Attwell,
Connor Boyle,
Caroline Brun,
Marco Antonio Sobrevilla Cabezudo
, et al. (101 additional authors not shown)
Abstract:
Data augmentation is an important component in the robustness evaluation of models in natural language processing (NLP) and in enhancing the diversity of the data they are trained on. In this paper, we present NL-Augmenter, a new participatory Python-based natural language augmentation framework which supports the creation of both transformations (modifications to the data) and filters (data split…
▽ More
Data augmentation is an important component in the robustness evaluation of models in natural language processing (NLP) and in enhancing the diversity of the data they are trained on. In this paper, we present NL-Augmenter, a new participatory Python-based natural language augmentation framework which supports the creation of both transformations (modifications to the data) and filters (data splits according to specific features). We describe the framework and an initial set of 117 transformations and 23 filters for a variety of natural language tasks. We demonstrate the efficacy of NL-Augmenter by using several of its transformations to analyze the robustness of popular natural language models. The infrastructure, datacards and robustness analysis results are available publicly on the NL-Augmenter repository (https://github.com/GEM-benchmark/NL-Augmenter).
△ Less
Submitted 11 October, 2022; v1 submitted 5 December, 2021;
originally announced December 2021.
-
Emergence of space from non-equilibrium thermodynamics in f(R) gravity
Authors:
Hassan Basari V. T.,
P. B. Krishna,
Titus K. Mathew
Abstract:
It has shown that the accelerated expansion of the FRW Universe can be explained as the quest towards the holographic equipartition ($N_{sur} = N_{bulk}$), satisfies the expansion law $\frac{dV}{dt} = l_{P}^{2} \left( N_{sur} - εN_{bulk} \right)$, from which one can derive the Friedmann equation of the FRW Universe in Einstein gravity \cite{paddy2012jun}. We introduce a generic derivation of the e…
▽ More
It has shown that the accelerated expansion of the FRW Universe can be explained as the quest towards the holographic equipartition ($N_{sur} = N_{bulk}$), satisfies the expansion law $\frac{dV}{dt} = l_{P}^{2} \left( N_{sur} - εN_{bulk} \right)$, from which one can derive the Friedmann equation of the FRW Universe in Einstein gravity \cite{paddy2012jun}. We introduce a generic derivation of the expansion law from the generalized first law of thermodynamics $-dE=TdS$ and $dE=TdS + WdV$. The generic derivation provides an expression for $N_{sur}$ in terms of entropy $S$ and the expansion law consistent with gravity theories having different entropy $S$, like Gauss-Bonnet and more general Lovelock gravity. We extended the same idea to the non-equilibrium situation and obtained the expansion law in f(R) gravity as a specific case. For this, we used the first law of thermodynamics in non-equilibrium description having the extra entropy production term $Td_{i}S.$
△ Less
Submitted 20 November, 2021; v1 submitted 1 November, 2021;
originally announced November 2021.
-
The academic motherload: Models of parenting engagement and the effect on academic productivity and performance
Authors:
Derrick G. E.,
Chen P-Y.,
van Leeuwen T.,
Lariviere V.,
Sugimoto C. R
Abstract:
Gender differences in research productivity are well documented, and have been mostly explained by access parental leave and child-related responsibilities. Those explanations are based on the assumption that women take on the majority of childcare responsibilities, and take the same level of leave at the birth of a child. Changing social dynamics around parenting has seen fathers increasingly tak…
▽ More
Gender differences in research productivity are well documented, and have been mostly explained by access parental leave and child-related responsibilities. Those explanations are based on the assumption that women take on the majority of childcare responsibilities, and take the same level of leave at the birth of a child. Changing social dynamics around parenting has seen fathers increasingly take an active role in parenting. This demands a more nuanced approach to understanding how parenting affects both men and women. Using a global survey of 11,226 academic parents, this study investigates the effect of parental engagement (Lead, Dual (shared), and Satellite parenting), and partner type, on measures of research productivity and impact for men and for women. It also analyzes the effect of different levels of parental leave on academic productivity. Results show that the parenting penalty for men and women is a function of the level of engagement in parenting activities. Men who serve in lead roles suffer similar penalties, but women are more likely to serve in lead parenting roles and to be more engaged across time and tasks. Taking a period of parental leave is associated with higher levels of productivity, however the productivity advantage is lost for the US-sample at 6 months, and at 12-months for the non-US sample. These results suggest that parental engagement is a more powerful variable to explain gender differences in academic productivity than the mere existence of children, and that policies should that factor into account.
△ Less
Submitted 11 August, 2021;
originally announced August 2021.
-
Point Transformer for Shape Classification and Retrieval of 3D and ALS Roof PointClouds
Authors:
Dimple A Shajahan,
Mukund Varma T,
Ramanathan Muthuganapathy
Abstract:
The success of deep learning methods led to significant breakthroughs in 3-D point cloud processing tasks with applications in remote sensing. Existing methods utilize convolutions that have some limitations, as they assume a uniform input distribution and cannot learn long-range dependencies. Recent works have shown that adding attention in conjunction with these methods improves performance. Thi…
▽ More
The success of deep learning methods led to significant breakthroughs in 3-D point cloud processing tasks with applications in remote sensing. Existing methods utilize convolutions that have some limitations, as they assume a uniform input distribution and cannot learn long-range dependencies. Recent works have shown that adding attention in conjunction with these methods improves performance. This raises a question: can attention layers completely replace convolutions? This paper proposes a fully attentional model - {\em Point Transformer}, for deriving a rich point cloud representation. The model's shape classification and retrieval performance are evaluated on a large-scale urban dataset - RoofN3D and a standard benchmark dataset ModelNet40. Extensive experiments are conducted to test the model's robustness to unseen point corruptions for analyzing its effectiveness on real datasets. The proposed method outperforms other state-of-the-art models in the RoofN3D dataset, gives competitive results in the ModelNet40 benchmark, and showcases high robustness to various unseen point corruptions. Furthermore, the model is highly memory and space efficient when compared to other methods.
△ Less
Submitted 20 February, 2021; v1 submitted 8 November, 2020;
originally announced November 2020.
-
Offensive Language Detection: A Comparative Analysis
Authors:
Vyshnav M T,
Sachin Kumar S,
Soman K P
Abstract:
Offensive behaviour has become pervasive in the Internet community. Individuals take the advantage of anonymity in the cyber world and indulge in offensive communications which they may not consider in the real life. Governments, online communities, companies etc are investing into prevention of offensive behaviour content in social media. One of the most effective solution for tacking this enigma…
▽ More
Offensive behaviour has become pervasive in the Internet community. Individuals take the advantage of anonymity in the cyber world and indulge in offensive communications which they may not consider in the real life. Governments, online communities, companies etc are investing into prevention of offensive behaviour content in social media. One of the most effective solution for tacking this enigmatic problem is the use of computational techniques to identify offensive content and take action. The current work focuses on detecting offensive language in English tweets. The dataset used for the experiment is obtained from SemEval-2019 Task 6 on Identifying and Categorizing Offensive Language in Social Media (OffensEval). The dataset contains 14,460 annotated English tweets. The present paper provides a comparative analysis and Random kitchen sink (RKS) based approach for offensive language detection. We explore the effectiveness of Google sentence encoder, Fasttext, Dynamic mode decomposition (DMD) based features and Random kitchen sink (RKS) method for offensive language detection. From the experiments and evaluation we observed that RKS with fastetxt achieved competing results. The evaluation measures used are accuracy, precision, recall, f1-score.
△ Less
Submitted 9 January, 2020;
originally announced January 2020.
-
Emergence of space and expansion of universe
Authors:
Hassan Basari V. T.,
Krishna P. B.,
Priyesh K. V.,
Titus K. Mathew
Abstract:
According to the principle of emergence, the expansion of the universe can be explained as the emergence of space with the progress of cosmic time. We have analytically solved the equation of emergence proposed by Padmanabhan by assuming the Komar energy density $ρ+3P$ as a function of the Hubble parameter. The resulting model describes the evolution of the universe, which proceeds towards a final…
▽ More
According to the principle of emergence, the expansion of the universe can be explained as the emergence of space with the progress of cosmic time. We have analytically solved the equation of emergence proposed by Padmanabhan by assuming the Komar energy density $ρ+3P$ as a function of the Hubble parameter. The resulting model describes the evolution of the universe, which proceeds towards a final de Sitter state. Model parameters have been extracted using the cosmological observational data. Further, the horizon entropy evolution of the model has been studied. The model predicts a universe having a transition from a prior decelerated epoch to a late accelerated epoch and reasonably predicts the cosmological constant.
△ Less
Submitted 23 July, 2022; v1 submitted 9 May, 2019;
originally announced May 2019.
-
Exact multiplicative updates for convolutional $β$-NMF in 2D
Authors:
Pedro J. Villasana T.,
Stanislaw Gorlow
Abstract:
In this paper, we extend the $β$-CNMF to two dimensions and derive exact multiplicative updates for its factors. The new updates generalize and correct the nonnegative matrix factor deconvolution previously proposed by Schmidt and Mørup. We show by simulation that the updates lead to a monotonically decreasing $β$-divergence in terms of the mean and the standard deviation and that the correspondin…
▽ More
In this paper, we extend the $β$-CNMF to two dimensions and derive exact multiplicative updates for its factors. The new updates generalize and correct the nonnegative matrix factor deconvolution previously proposed by Schmidt and Mørup. We show by simulation that the updates lead to a monotonically decreasing $β$-divergence in terms of the mean and the standard deviation and that the corresponding convergence curves are consistent across the most common values for $β$.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
Multiplicative Updates for Convolutional NMF Under $β$-Divergence
Authors:
Pedro J. Villasana T.,
Stanislaw Gorlow,
Arvind T. Hariraman
Abstract:
In this letter, we generalize the convolutional NMF by taking the $β$-divergence as the contrast function and present the correct multiplicative updates for its factors in closed form. The new updates unify the $β$-NMF and the convolutional NMF. We state why almost all of the existing updates are inexact and approximative w.r.t. the convolutional data model. We show that our updates are stable and…
▽ More
In this letter, we generalize the convolutional NMF by taking the $β$-divergence as the contrast function and present the correct multiplicative updates for its factors in closed form. The new updates unify the $β$-NMF and the convolutional NMF. We state why almost all of the existing updates are inexact and approximative w.r.t. the convolutional data model. We show that our updates are stable and that their convergence performance is consistent across the most common values of $β$.
△ Less
Submitted 15 May, 2018; v1 submitted 14 March, 2018;
originally announced March 2018.
-
Cast and Self Shadow Segmentation in Video Sequences using Interval based Eigen Value Representation
Authors:
Chandrajit M,
Girisha R,
Vasudev T,
Ashok C B
Abstract:
Tracking of motion objects in the surveillance videos is useful for the monitoring and analysis. The performance of the surveillance system will deteriorate when shadows are detected as moving objects. Therefore, shadow detection and elimination usually benefits the next stages. To overcome this issue, a method for detection and elimination of shadows is proposed. This paper presents a method for…
▽ More
Tracking of motion objects in the surveillance videos is useful for the monitoring and analysis. The performance of the surveillance system will deteriorate when shadows are detected as moving objects. Therefore, shadow detection and elimination usually benefits the next stages. To overcome this issue, a method for detection and elimination of shadows is proposed. This paper presents a method for segmenting moving objects in video sequences based on determining the Euclidian distance between two pixels considering neighborhood values in temporal domain. Further, a method that segments cast and self shadows in video sequences by computing the Eigen values for the neighborhood of each pixel is proposed. The dual-map for cast and self shadow pixels is represented based on the interval of Eigen values. The proposed methods are tested on the benchmark IEEE CHANGE DETECTION 2014 dataset.
△ Less
Submitted 28 August, 2016;
originally announced August 2016.
-
Multiple objects tracking in surveillance video using color and Hu moments
Authors:
Chandrajit M,
Girisha R,
Vasudev T
Abstract:
Multiple objects tracking finds its applications in many high level vision analysis like object behaviour interpretation and gait recognition. In this paper, a feature based method to track the multiple moving objects in surveillance video sequence is proposed. Object tracking is done by extracting the color and Hu moments features from the motion segmented object blob and establishing the associa…
▽ More
Multiple objects tracking finds its applications in many high level vision analysis like object behaviour interpretation and gait recognition. In this paper, a feature based method to track the multiple moving objects in surveillance video sequence is proposed. Object tracking is done by extracting the color and Hu moments features from the motion segmented object blob and establishing the association of objects in the successive frames of the video sequence based on Chi-Square dissimilarity measure and nearest neighbor classifier. The benchmark IEEE PETS and IEEE Change Detection datasets has been used to show the robustness of the proposed method. The proposed method is assessed quantitatively using the precision and recall accuracy metrics. Further, comparative evaluation with related works has been carried out to exhibit the efficacy of the proposed method.
△ Less
Submitted 28 August, 2016; v1 submitted 22 August, 2016;
originally announced August 2016.
-
Everyday Radio Telescope
Authors:
Pranshu Mandal,
Devansh Agarwal,
Pratik Kumar,
Anjali Yelikar,
Kanchan Soni,
Vineeth Krishna T
Abstract:
We have developed an affordable, portable college level radio telescope for amateur radio astronomy which can be used to provide hands-on experience with the fundamentals of a radio telescope and an insight into the realm of radio astronomy. With our set-up one can measure brightness temperature and flux of the Sun at 11.2 GHz and calculate the beam width of the antenna. The set-up uses commercial…
▽ More
We have developed an affordable, portable college level radio telescope for amateur radio astronomy which can be used to provide hands-on experience with the fundamentals of a radio telescope and an insight into the realm of radio astronomy. With our set-up one can measure brightness temperature and flux of the Sun at 11.2 GHz and calculate the beam width of the antenna. The set-up uses commercially available satellite television receiving system and parabolic dish antenna. We report the detection of point sources like Saturn and extended sources like the galactic arm of the Milky way. We have also developed python pipeline, which are available for free download, for data acquisition and visualization.
△ Less
Submitted 12 January, 2016;
originally announced January 2016.
-
A novel statistical fusion rule for image fusion and its comparison in non subsampled contourlet transform domain and wavelet domain
Authors:
Manu V T,
Philomina Simon
Abstract:
Image fusion produces a single fused image from a set of input images. A new method for image fusion is proposed based on Weighted Average Merging Method (WAMM) in the NonSubsampled Contourlet Transform (NSCT) domain. A performance analysis on various statistical fusion rules are also analysed both in NSCT and Wavelet domain. Analysis has been made on medical images, remote sensing images and mult…
▽ More
Image fusion produces a single fused image from a set of input images. A new method for image fusion is proposed based on Weighted Average Merging Method (WAMM) in the NonSubsampled Contourlet Transform (NSCT) domain. A performance analysis on various statistical fusion rules are also analysed both in NSCT and Wavelet domain. Analysis has been made on medical images, remote sensing images and multi focus images. Experimental results shows that the proposed method, WAMM obtained better results in NSCT domain than the wavelet domain as it preserves more edges and keeps the visual quality intact in the fused image.
△ Less
Submitted 8 May, 2012;
originally announced May 2012.
-
Lossless Compression and Complexity of Chaotic Sequences
Authors:
Nithin Nagaraj,
Mathew Shaji Kavalekalam,
Arjun Venugopal T.,
Nithin Krishnan
Abstract:
We investigate the complexity of short symbolic sequences of chaotic dynamical systems by using lossless compression algorithms. In particular, we study Non-Sequential Recursive Pair Substitution (NSRPS), a lossless compression algorithm first proposed by W. Ebeling et al. [Math. Biosc. 52, 1980] and Jiménez-Montaño et al. [arXiv:cond-mat/0204134, 2002]) which was subsequently shown to be optimal.…
▽ More
We investigate the complexity of short symbolic sequences of chaotic dynamical systems by using lossless compression algorithms. In particular, we study Non-Sequential Recursive Pair Substitution (NSRPS), a lossless compression algorithm first proposed by W. Ebeling et al. [Math. Biosc. 52, 1980] and Jiménez-Montaño et al. [arXiv:cond-mat/0204134, 2002]) which was subsequently shown to be optimal. NSPRS has also been used to estimate Entropy of written English (P. Grassberger [arXiv:physics/0207023, 2002]). We propose a new measure of complexity - defined as the number of iterations of NSRPS required to transform the input sequence into a constant sequence. We test this measure on symbolic sequences of the Logistic map for various values of the bifurcation parameter. The proposed measure of complexity is easy to compute and is observed to be highly correlated with the Lyapunov exponent of the original non-linear time series, even for very short symbolic sequences (as short as 50 samples). Finally, we construct symbolic sequences from the Skew-Tent map which are incompressible by popular compression algorithms like WinZip, WinRAR and 7-Zip, but compressible by NSRPS.
△ Less
Submitted 22 January, 2011;
originally announced January 2011.
