Showing 1–4 of 4 results for author: Pervez, A

Mechanistic Neural Networks for Scientific Machine Learning

Authors: Adeel Pervez, Francesco Locatello, Efstratios Gavves

Abstract: This paper presents Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences. It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential equations as representations, revealing the underlying dynamics of data and enhancing interpretability and efficiency in data modeling. Central to our approach is a no… ▽ More This paper presents Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences. It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential equations as representations, revealing the underlying dynamics of data and enhancing interpretability and efficiency in data modeling. Central to our approach is a novel Relaxed Linear Programming Solver (NeuRLP) inspired by a technique that reduces solving linear ODEs to solving linear programs. This integrates well with neural networks and surpasses the limitations of traditional ODE solvers enabling scalable GPU parallel processing. Overall, Mechanistic Neural Networks demonstrate their versatility for scientific machine learning applications, adeptly managing tasks from equation discovery to dynamic systems modeling. We prove their comprehensive capabilities in analyzing and interpreting complex scientific data across various applications, showing significant performance against specialized state-of-the-art methods. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Implementing Sustainable Tourism practices in luxury resorts of Maldives: Sustainability principles & Tripple Bottomline Approach

Authors: Dr Mir Hasan Naqvi, Asnan Ahmed, Dr Asif Pervez

Abstract: The aim of the research paper is to understand the sustainability challenges faced by resorts mainly luxury in Maldives and to implement the sustainable tourism practices. The Maldives economy is dependent mostly on the fishing, boat building, boat repairing and tourism. Over recent years there is a drastic change that has took place in Maldives in tourism industry. Maldives has progressed to be t… ▽ More The aim of the research paper is to understand the sustainability challenges faced by resorts mainly luxury in Maldives and to implement the sustainable tourism practices. The Maldives economy is dependent mostly on the fishing, boat building, boat repairing and tourism. Over recent years there is a drastic change that has took place in Maldives in tourism industry. Maldives has progressed to be the upper middle-income country and luxury resorts are the reason for increased GDP in the country. Although there are some practices associated with the luxury resorts to follow in terms of environmental concerns. Present study focuses on the triple bottom line approach and the 12 major Sustainable Tourism Principles as a framework for sustainability practices and its implementation including the challenges associated in Maldives. The paper suggests some recommendations on several paradigm of enforcing laws and regulations, waste management facilities, fostering collaboration along with promoting local agriculture. The study also contemplates on several other areas such as on the impact of sustainability initiatives, coral restoration, and the use of sustainable supply chains. The intent of the current research is to suggest methods to promote the sustainable practices in luxury resort in Maldives. △ Less

Submitted 30 November, 2023; originally announced November 2023.

Differentiable Mathematical Programming for Object-Centric Representation Learning

Authors: Adeel Pervez, Phillip Lippe, Efstratios Gavves

Abstract: We propose topology-aware feature partitioning into $k$ disjoint partitions for given scene features as a method for object-centric representation learning. To this end, we propose to use minimum $s$-$t$ graph cuts as a partitioning method which is represented as a linear program. The method is topologically aware since it explicitly encodes neighborhood relationships in the image graph. To solve… ▽ More We propose topology-aware feature partitioning into $k$ disjoint partitions for given scene features as a method for object-centric representation learning. To this end, we propose to use minimum $s$-$t$ graph cuts as a partitioning method which is represented as a linear program. The method is topologically aware since it explicitly encodes neighborhood relationships in the image graph. To solve the graph cuts our solution relies on an efficient, scalable, and differentiable quadratic programming approximation. Optimizations specific to cut problems allow us to solve the quadratic programs and compute their gradients significantly more efficiently compared with the general quadratic programming approach. Our results show that our approach is scalable and outperforms existing methods on object discovery tasks with textured scenes and objects. △ Less

Submitted 5 October, 2022; originally announced October 2022.

A Fourier View of REINFORCE

Authors: Adeel Pervez

Abstract: We show a connection between the Fourier spectrum of Boolean functions and the REINFORCE gradient estimator for binary latent variable models. We show that REINFORCE estimates (up to a factor) the degree-1 Fourier coefficients of a Boolean function. Using this connection we offer a new perspective on variance reduction in gradient estimation for latent variable models: namely, that variance reduct… ▽ More We show a connection between the Fourier spectrum of Boolean functions and the REINFORCE gradient estimator for binary latent variable models. We show that REINFORCE estimates (up to a factor) the degree-1 Fourier coefficients of a Boolean function. Using this connection we offer a new perspective on variance reduction in gradient estimation for latent variable models: namely, that variance reduction involves eliminating or reducing Fourier coefficients that do not have degree 1. We then use this connection to develop low-variance unbiased gradient estimators for binary latent variable models such as sigmoid belief networks. The estimator is based upon properties of the noise operator from Boolean Fourier theory and involves a sample-dependent baseline added to the REINFORCE estimator in a way that keeps the estimator unbiased. The baseline can be plugged into existing gradient estimators for further variance reduction. △ Less

Submitted 12 August, 2018; originally announced August 2018.