Showing 1–10 of 10 results for author: Siddique, U

Nanoscale Patterning of Surface Nanobubbles

Authors: Anayet Ullah Siddique, Rui Xie, Danielle Horlacher, Roseanne Warren

Abstract: Surface nanobubbles forming on hydrophobic surfaces in water present an exciting opportunity as potential agents of top-down, bottom-up nanopatterning. The formation and characteristics of surface nanobubbles are strongly influenced by the physical and chemical properties of the substrate. In this study, focused ion beam (FIB) milling is used for the first time to spatially control the nucleation… ▽ More Surface nanobubbles forming on hydrophobic surfaces in water present an exciting opportunity as potential agents of top-down, bottom-up nanopatterning. The formation and characteristics of surface nanobubbles are strongly influenced by the physical and chemical properties of the substrate. In this study, focused ion beam (FIB) milling is used for the first time to spatially control the nucleation of surface nanobubbles with 75 nm precision. The spontaneous formation of nanobubbles on alternating lines of a self-assembled monolayer (octadecyl trichlorosilane) patterned by FIB is detected by atomic force microscopy. The effect of chemical vs. topographical surface heterogeneity on the formation of nanobubbles is investigated by comparing samples with OTS coating applied pre- vs. post-FIB patterning. The results confirm that nanoscale FIB-based patterning can effectively control surface nanobubble position by means of chemical heterogeneity. The effect of FIB milling on nanobubble morphology and properties, including contact angle and gas oversaturation, is also reported. Molecular dynamics simulations provide further insight into the effects of FIB amorphization on surface nanobubble formation. Combined, experimental and simulation investigations offer insights to guide future nanobubble-based patterning using FIB milling. △ Less

Submitted 23 September, 2023; originally announced September 2023.

Fairness in Preference-based Reinforcement Learning

Authors: Umer Siddique, Abhinav Sinha, Yongcan Cao

Abstract: In this paper, we address the issue of fairness in preference-based reinforcement learning (PbRL) in the presence of multiple objectives. The main objective is to design control policies that can optimize multiple objectives while treating each objective fairly. Toward this objective, we design a new fairness-induced preference-based reinforcement learning or FPbRL. The main idea of FPbRL is to le… ▽ More In this paper, we address the issue of fairness in preference-based reinforcement learning (PbRL) in the presence of multiple objectives. The main objective is to design control policies that can optimize multiple objectives while treating each objective fairly. Toward this objective, we design a new fairness-induced preference-based reinforcement learning or FPbRL. The main idea of FPbRL is to learn vector reward functions associated with multiple objectives via new welfare-based preferences rather than reward-based preference in PbRL, coupled with policy learning via maximizing a generalized Gini welfare function. Finally, we provide experiment studies on three different environments to show that the proposed FPbRL approach can achieve both efficiency and equity for learning effective and fair policies. △ Less

Submitted 1 September, 2023; v1 submitted 16 June, 2023; originally announced June 2023.

Comments: Accepted to The Many Facets of Preference Learning Workshop at the International Conference on Machine Learning (ICML)

Learning Fair Policies in Decentralized Cooperative Multi-Agent Reinforcement Learning

Authors: Matthieu Zimmer, Claire Glanois, Umer Siddique, Paul Weng

Abstract: We consider the problem of learning fair policies in (deep) cooperative multi-agent reinforcement learning (MARL). We formalize it in a principled way as the problem of optimizing a welfare function that explicitly encodes two important aspects of fairness: efficiency and equity. As a solution method, we propose a novel neural network architecture, which is composed of two sub-networks specificall… ▽ More We consider the problem of learning fair policies in (deep) cooperative multi-agent reinforcement learning (MARL). We formalize it in a principled way as the problem of optimizing a welfare function that explicitly encodes two important aspects of fairness: efficiency and equity. As a solution method, we propose a novel neural network architecture, which is composed of two sub-networks specifically designed for taking into account the two aspects of fairness. In experiments, we demonstrate the importance of the two sub-networks for fair optimization. Our overall approach is general as it can accommodate any (sub)differentiable welfare function. Therefore, it is compatible with various notions of fairness that have been proposed in the literature (e.g., lexicographic maximin, generalized Gini social welfare function, proportional fairness). Our solution method is generic and can be implemented in various MARL settings: centralized training and decentralized execution, or fully decentralized. Finally, we experimentally validate our approach in various domains and show that it can perform much better than previous methods. △ Less

Submitted 22 June, 2021; v1 submitted 17 December, 2020; originally announced December 2020.

Comments: International Conference on Machine Learning

Learning Fair Policies in Multiobjective (Deep) Reinforcement Learning with Average and Discounted Rewards

Authors: Umer Siddique, Paul Weng, Matthieu Zimmer

Abstract: As the operations of autonomous systems generally affect simultaneously several users, it is crucial that their designs account for fairness considerations. In contrast to standard (deep) reinforcement learning (RL), we investigate the problem of learning a policy that treats its users equitably. In this paper, we formulate this novel RL problem, in which an objective function, which encodes a not… ▽ More As the operations of autonomous systems generally affect simultaneously several users, it is crucial that their designs account for fairness considerations. In contrast to standard (deep) reinforcement learning (RL), we investigate the problem of learning a policy that treats its users equitably. In this paper, we formulate this novel RL problem, in which an objective function, which encodes a notion of fairness that we formally define, is optimized. For this problem, we provide a theoretical discussion where we examine the case of discounted rewards and that of average rewards. During this analysis, we notably derive a new result in the standard RL setting, which is of independent interest: it states a novel bound on the approximation error with respect to the optimal average reward of that of a policy optimal for the discounted reward. Since learning with discounted rewards is generally easier, this discussion further justifies finding a fair policy for the average reward by learning a fair policy for the discounted reward. Thus, we describe how several classic deep RL algorithms can be adapted to our fair optimization problem, and we validate our approach with extensive experiments in three different domains. △ Less

Submitted 18 August, 2020; originally announced August 2020.

SafetyOps

Authors: Umair Siddique

Abstract: Safety assurance is a paramount factor in the large-scale deployment of various autonomous systems (e.g., self-driving vehicles). However, the execution of safety engineering practices and processes have been challenged by an increasing complexity of modern safety-critical systems. This attribute has become more critical for autonomous systems that involve artificial intelligence (AI) and data-dri… ▽ More Safety assurance is a paramount factor in the large-scale deployment of various autonomous systems (e.g., self-driving vehicles). However, the execution of safety engineering practices and processes have been challenged by an increasing complexity of modern safety-critical systems. This attribute has become more critical for autonomous systems that involve artificial intelligence (AI) and data-driven techniques along with the complex interactions of the physical world and digital computing platforms. In this position paper, we highlight some challenges of applying current safety processes to modern autonomous systems. Then, we introduce the concept of SafetyOps - a set of practices, which combines DevOps, TestOps, DataOps, and MLOps to provide an efficient, continuous and traceable system safety lifecycle. We believe that SafetyOps can play a significant role in scalable integration and adaptation of safety engineering into various industries relying on AI and data. △ Less

Submitted 10 August, 2020; originally announced August 2020.

Formal Verification of Cyber-Physical Systems using Theorem Proving (Invited Paper)

Authors: Adnan Rashid, Umair Siddique, Sofiene Tahar

Abstract: Due to major breakthroughs in software and engineering technologies, embedded systems are increasingly being utilized in areas ranging from aerospace and next-generation transportation systems, to smart grid and smart cities, to health care systems, and broadly speaking to what is known as Cyber-Physical Systems (CPS). A CPS is primarily composed of several electronic, communication and controller… ▽ More Due to major breakthroughs in software and engineering technologies, embedded systems are increasingly being utilized in areas ranging from aerospace and next-generation transportation systems, to smart grid and smart cities, to health care systems, and broadly speaking to what is known as Cyber-Physical Systems (CPS). A CPS is primarily composed of several electronic, communication and controller modules and some actuators and sensors. The mix of heterogeneous underlying smart technologies poses a number of technical challenges to the design and more severely to the verification of such complex infrastructure. In fact, a CPS shall adhere to strict safety, reliability, performance and security requirements, where one needs to capture both physical and random aspects of the various CPS modules and then analyze their interrelationship across interlinked continuous and discrete dynamics. Often times however, system bugs remain uncaught during the analysis and in turn cause unwanted scenarios that may have serious consequences in safety-critical applications. In this paper, we introduce some of the challenges surrounding the design and verification of contemporary CPS with the advent of smart technologies. In particular, we survey recent developments in the use of theorem proving, a formal method, for the modeling, analysis and verification of CPS, and overview some real world CPS case studies from the automotive, avionics and healthtech domains from system level to physical components. △ Less

Submitted 8 March, 2020; originally announced March 2020.

Comments: 15 Pages, Seventh International Workshop on Formal Techniques for Safety-Critical Systems, Shenzhen, China

Formal Verification of Platoon Control Strategies

Authors: Adnan Rashid, Umair Siddique, Osman Hasan

Abstract: Recent developments in autonomous driving, vehicle-to-vehicle communication and smart traffic controllers have provided a hope to realize platoon formation of vehicles. The main benefits of vehicle platooning include improved safety, enhanced highway utility, efficient fuel consumption and reduced highway accidents. One of the central components of reliable and efficient platoon formation is the u… ▽ More Recent developments in autonomous driving, vehicle-to-vehicle communication and smart traffic controllers have provided a hope to realize platoon formation of vehicles. The main benefits of vehicle platooning include improved safety, enhanced highway utility, efficient fuel consumption and reduced highway accidents. One of the central components of reliable and efficient platoon formation is the underlying control strategies, e.g., constant spacing, variable spacing and dynamic headway. In this paper, we provide a generic formalization of platoon control strategies in higher-order logic. In particular, we formally verify the stability constraints of various strategies using the libraries of multivariate calculus and Laplace transform within the sound core of HOL Light proof assistant. We also illustrate the use of verified stability theorems to develop runtime monitors for each controller, which can be used to automatically detect the violation of stability constraints in a runtime execution or a logged trace of the platoon controller. Our proposed formalization has two main advantages: 1) it provides a framework to combine both static (theorem proving) and dynamic (runtime) verification approaches for platoon controllers, and 2) it is inline with the industrial standards, which explicitly recommend the use of formal methods for functional safety, e.g., automotive ISO 26262. △ Less

Submitted 21 April, 2018; originally announced April 2018.

Comments: 15 pages, Software Engineering and Formal Methods (SEFM-2018)

Towards the Formalization of Fractional Calculus in Higher-Order Logic

Authors: Umair Siddique, Osman Hasan, Sofiène Tahar

Abstract: Fractional calculus is a generalization of classical theories of integration and differentiation to arbitrary order (i.e., real or complex numbers). In the last two decades, this new mathematical modeling approach has been widely used to analyze a wide class of physical systems in various fields of science and engineering. In this paper, we describe an ongoing project which aims at formalizing the… ▽ More Fractional calculus is a generalization of classical theories of integration and differentiation to arbitrary order (i.e., real or complex numbers). In the last two decades, this new mathematical modeling approach has been widely used to analyze a wide class of physical systems in various fields of science and engineering. In this paper, we describe an ongoing project which aims at formalizing the basic theories of fractional calculus in the HOL Light theorem prover. Mainly, we present the motivation and application of such formalization efforts, a roadmap to achieve our goals, current status of the project and future milestones. △ Less

Submitted 8 May, 2015; originally announced May 2015.

Comments: 9 pages

Formal Analysis of Optical Systems

Authors: Sanaz Khan-Afshar, Umair Siddique, Mohamed Yousri Mahmoud, Vincent Aravantinos, Ons Seddiki, Osman Hasan, Sofiene Tahar

Abstract: Optical systems are becoming increasingly important by resolving many bottlenecks in today's communication, electronics, and biomedical systems. However, given the continuous nature of optics, the inability to efficiently analyze optical system models using traditional paper-and-pencil and computer simulation approaches sets limits especially in safety-critical applications. In order to overcome t… ▽ More Optical systems are becoming increasingly important by resolving many bottlenecks in today's communication, electronics, and biomedical systems. However, given the continuous nature of optics, the inability to efficiently analyze optical system models using traditional paper-and-pencil and computer simulation approaches sets limits especially in safety-critical applications. In order to overcome these limitations, we propose to employ higher-order-logic theorem proving as a complement to computational and numerical approaches to improve optical model analysis in a comprehensive framework. The proposed framework allows formal analysis of optical systems at four abstraction levels, i.e., ray, wave, electromagnetic, and quantum. △ Less

Submitted 11 March, 2014; originally announced March 2014.

Cellular Downlink Performance with Base Station Slee**, User Association, and Scheduling

Authors: Hina Tabassum, Uzma Siddique, Ekram Hossain, Md. Jahangir Hossain

Abstract: Base station (BS) slee** has emerged as a viable solution to enhance the overall network energy efficiency by inactivating the underutilized BSs. However, it affects the performance of users in slee** cells depending on their BS association criteria, their channel conditions towards the active BSs, and scheduling criteria and traffic loads at the active BSs. This paper characterizes the perfor… ▽ More Base station (BS) slee** has emerged as a viable solution to enhance the overall network energy efficiency by inactivating the underutilized BSs. However, it affects the performance of users in slee** cells depending on their BS association criteria, their channel conditions towards the active BSs, and scheduling criteria and traffic loads at the active BSs. This paper characterizes the performance of cellular systems with BS slee** by develo** a systematic framework to derive the spectral efficiency and outage probability of downlink transmission to the slee** cell users taking into account the aforementioned factors. In this context, we develop a user association scheme in which a typical user in a slee** cell selects a BS with \textbf{M}aximum best-case \textbf{M}ean channel \textbf{A}ccess \textbf{P}robability (MMAP) which is calculated by all active BSs based on their existing traffic loads. We consider both greedy and round-robin schemes at active BSs for scheduling users in a channel. Once the association is performed, the exact access probability for a typical slee** cell user and the statistics of its received signal and interference powers are derived to evaluate the spectral and energy efficiencies of transmission. For the slee** cell users, we also consider the conventional \textbf{M}aximum \textbf{R}eceived \textbf{S}ignal \textbf{P}ower (MRSP)-based user association scheme along with greedy and round-robin schemes at the BSs. The impact of cell-zooming is incorporated in the derivations to analyze its feasibility in reducing the coverage holes created by BS slee**. Numerical results show the trade-offs between spectral efficiency and energy efficiency in various network scenarios. The accuracy of the analysis is verified through Monte-Carlo simulations. △ Less

Submitted 28 January, 2014; originally announced January 2014.

Comments: Submitted to IEEE Transactions on Wireless Communications