-
Optimal Service Placement, Request Routing and CPU Sizing in Cooperative Mobile Edge Computing Networks for Delay-Sensitive Applications
Authors:
Naeimeh Omidvar,
Mahdieh Ahmadi,
Seyed Mohammad Hosseini
Abstract:
We study joint optimization of service placement, request routing, and CPU sizing in a cooperative MEC system. The problem is considered from the perspective of the service provider (SP), which delivers heterogeneous MEC-enabled delay-sensitive services, and needs to pay for the used resources to the mobile network operators and the cloud provider, while earning revenue from the served requests. W…
▽ More
We study joint optimization of service placement, request routing, and CPU sizing in a cooperative MEC system. The problem is considered from the perspective of the service provider (SP), which delivers heterogeneous MEC-enabled delay-sensitive services, and needs to pay for the used resources to the mobile network operators and the cloud provider, while earning revenue from the served requests. We formulate the problem of maximizing the SP's total profit subject to the computation, storage, and communication constraints of each edge node and end-to-end delay requirements of the services as a mixed-integer non-convex optimization problem, and prove it to be NP-hard.
To tackle the challenges in solving the problem, we first introduce a design trade-off parameter for different delay requirements of each service, which maintains flexibility in prioritizing them, and transform the original optimization problem by the new delay constraints. Then, by exploiting a hidden convexity, we reformulate the delay constraints into an equivalent form. Next, to handle the challenge of the complicating (integer) variables, using primal decomposition, we decompose the problem into an equivalent form of master and inner sub-problems over the mixed and real variables, respectively. We then employ a cutting-plane approach for building up adequate representations of the extremal value of the inner problem as a function of the complicating variables and the set of values of the complicating variables for which the inner problem is feasible. Finally, we propose a solution strategy based on generalized Benders decomposition and prove its convergence to the optimal solution within a limited number of iterations. Extensive simulation results demonstrate that the proposed scheme significantly outperforms the existing mechanisms in terms of the SP's profit, cache hit ratio, running time, and end-to-end delay.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
Clustering in Dynamic Environments: A Framework for Benchmark Dataset Generation With Heterogeneous Changes
Authors:
Danial Yazdani,
Juergen Branke,
Mohammad Sadegh Khorshidi,
Mohammad Nabi Omidvar,
Xiaodong Li,
Amir H. Gandomi,
Xin Yao
Abstract:
Clustering in dynamic environments is of increasing importance, with broad applications ranging from real-time data analysis and online unsupervised learning to dynamic facility location problems. While meta-heuristics have shown promising effectiveness in static clustering tasks, their application for tracking optimal clustering solutions or robust clustering over time in dynamic environments rem…
▽ More
Clustering in dynamic environments is of increasing importance, with broad applications ranging from real-time data analysis and online unsupervised learning to dynamic facility location problems. While meta-heuristics have shown promising effectiveness in static clustering tasks, their application for tracking optimal clustering solutions or robust clustering over time in dynamic environments remains largely underexplored. This is partly due to a lack of dynamic datasets with diverse, controllable, and realistic dynamic characteristics, hindering systematic performance evaluations of clustering algorithms in various dynamic scenarios. This deficiency leads to a gap in our understanding and capability to effectively design algorithms for clustering in dynamic environments. To bridge this gap, this paper introduces the Dynamic Dataset Generator (DDG). DDG features multiple dynamic Gaussian components integrated with a range of heterogeneous, local, and global changes. These changes vary in spatial and temporal severity, patterns, and domain of influence, providing a comprehensive tool for simulating a wide range of dynamic scenarios.
△ Less
Submitted 9 April, 2024; v1 submitted 24 February, 2024;
originally announced February 2024.
-
GNBG: A Generalized and Configurable Benchmark Generator for Continuous Numerical Optimization
Authors:
Danial Yazdani,
Mohammad Nabi Omidvar,
Delaram Yazdani,
Kalyanmoy Deb,
Amir H. Gandomi
Abstract:
As optimization challenges continue to evolve, so too must our tools and understanding. To effectively assess, validate, and compare optimization algorithms, it is crucial to use a benchmark test suite that encompasses a diverse range of problem instances with various characteristics. Traditional benchmark suites often consist of numerous fixed test functions, making it challenging to align these…
▽ More
As optimization challenges continue to evolve, so too must our tools and understanding. To effectively assess, validate, and compare optimization algorithms, it is crucial to use a benchmark test suite that encompasses a diverse range of problem instances with various characteristics. Traditional benchmark suites often consist of numerous fixed test functions, making it challenging to align these with specific research objectives, such as the systematic evaluation of algorithms under controllable conditions. This paper introduces the Generalized Numerical Benchmark Generator (GNBG) for single-objective, box-constrained, continuous numerical optimization. Unlike existing approaches that rely on multiple baseline functions and transformations, GNBG utilizes a single, parametric, and configurable baseline function. This design allows for control over various problem characteristics. Researchers using GNBG can generate instances that cover a broad array of morphological features, from unimodal to highly multimodal functions, various local optima patterns, and symmetric to highly asymmetric structures. The generated problems can also vary in separability, variable interaction structures, dimensionality, conditioning, and basin shapes. These customizable features enable the systematic evaluation and comparison of optimization algorithms, allowing researchers to probe their strengths and weaknesses under diverse and controllable conditions.
△ Less
Submitted 12 December, 2023;
originally announced December 2023.
-
GNBG-Generated Test Suite for Box-Constrained Numerical Global Optimization
Authors:
Amir H. Gandomi,
Danial Yazdani,
Mohammad Nabi Omidvar,
Kalyanmoy Deb
Abstract:
This document introduces a set of 24 box-constrained numerical global optimization problem instances, systematically constructed using the Generalized Numerical Benchmark Generator (GNBG). These instances cover a broad spectrum of problem features, including varying degrees of modality, ruggedness, symmetry, conditioning, variable interaction structures, basin linearity, and deceptiveness. Purpose…
▽ More
This document introduces a set of 24 box-constrained numerical global optimization problem instances, systematically constructed using the Generalized Numerical Benchmark Generator (GNBG). These instances cover a broad spectrum of problem features, including varying degrees of modality, ruggedness, symmetry, conditioning, variable interaction structures, basin linearity, and deceptiveness. Purposefully designed, this test suite offers varying difficulty levels and problem characteristics, facilitating rigorous evaluation and comparative analysis of optimization algorithms. By presenting these problems, we aim to provide researchers with a structured platform to assess the strengths and weaknesses of their algorithms against challenges with known, controlled characteristics. For reproducibility, the MATLAB source code for this test suite is publicly available.
△ Less
Submitted 12 December, 2023;
originally announced December 2023.
-
Variable Functioning and Its Application to Large Scale Steel Frame Design Optimization
Authors:
Amir H Gandomi,
Kalyanmoy Deb,
Ronald C Averill,
Shahryar Rahnamayan,
Mohammad Nabi Omidvar
Abstract:
To solve complex real-world problems, heuristics and concept-based approaches can be used in order to incorporate information into the problem. In this study, a concept-based approach called variable functioning Fx is introduced to reduce the optimization variables and narrow down the search space. In this method, the relationships among one or more subset of variables are defined with functions u…
▽ More
To solve complex real-world problems, heuristics and concept-based approaches can be used in order to incorporate information into the problem. In this study, a concept-based approach called variable functioning Fx is introduced to reduce the optimization variables and narrow down the search space. In this method, the relationships among one or more subset of variables are defined with functions using information prior to optimization; thus, instead of modifying the variables in the search process, the function variables are optimized. By using problem structure analysis technique and engineering expert knowledge, the $Fx$ method is used to enhance the steel frame design optimization process as a complex real-world problem. The proposed approach is coupled with particle swarm optimization and differential evolution algorithms and used for three case studies. The algorithms are applied to optimize the case studies by considering the relationships among column cross-section areas. The results show that $Fx$ can significantly improve both the convergence rate and the final design of a frame structure, even if it is only used for seeding.
△ Less
Submitted 15 May, 2022;
originally announced May 2022.
-
Generating Large-scale Dynamic Optimization Problem Instances Using the Generalized Moving Peaks Benchmark
Authors:
Mohammad Nabi Omidvar,
Danial Yazdani,
Juergen Branke,
Xiaodong Li,
Shengxiang Yang,
Xin Yao
Abstract:
This document describes the generalized moving peaks benchmark (GMPB) and how it can be used to generate problem instances for continuous large-scale dynamic optimization problems. It presents a set of 15 benchmark problems, the relevant source code, and a performance indicator, designed for comparative studies and competitions in large-scale dynamic optimization. Although its primary purpose is t…
▽ More
This document describes the generalized moving peaks benchmark (GMPB) and how it can be used to generate problem instances for continuous large-scale dynamic optimization problems. It presents a set of 15 benchmark problems, the relevant source code, and a performance indicator, designed for comparative studies and competitions in large-scale dynamic optimization. Although its primary purpose is to provide a coherent basis for running competitions, its generality allows the interested reader to use this document as a guide to design customized problem instances to investigate issues beyond the scope of the presented benchmark suite. To this end, we explain the modular structure of the GMPB and how its constituents can be assembled to form problem instances with a variety of controllable characteristics ranging from unimodal to highly multimodal, symmetric to highly asymmetric, smooth to highly irregular, and various degrees of variable interaction and ill-conditioning.
△ Less
Submitted 22 July, 2021;
originally announced July 2021.
-
Competition on Dynamic Optimization Problems Generated by Generalized Moving Peaks Benchmark (GMPB)
Authors:
Danial Yazdani,
Michalis Mavrovouniotis,
Changhe Li,
Wenjian Luo,
Mohammad Nabi Omidvar,
Amir H. Gandomi,
Trung Thanh Nguyen,
Juergen Branke,
Xiaodong Li,
Shengxiang Yang,
Xin Yao
Abstract:
This document introduces the Generalized Moving Peaks Benchmark (GMPB), a tool for generating continuous dynamic optimization problem instances that is used for the CEC 2024 Competition on Dynamic Optimization. GMPB is adept at generating landscapes with a broad spectrum of characteristics, offering everything from unimodal to highly multimodal landscapes and ranging from symmetric to highly asymm…
▽ More
This document introduces the Generalized Moving Peaks Benchmark (GMPB), a tool for generating continuous dynamic optimization problem instances that is used for the CEC 2024 Competition on Dynamic Optimization. GMPB is adept at generating landscapes with a broad spectrum of characteristics, offering everything from unimodal to highly multimodal landscapes and ranging from symmetric to highly asymmetric configurations. The landscapes also vary in texture, from smooth to highly irregular surfaces, encompassing diverse degrees of variable interaction and conditioning. This document delves into the intricacies of GMPB, detailing the myriad ways in which its parameters can be tuned to produce these diverse landscape characteristics. GMPB's MATLAB implementation is available on the EDOLAB Platform.
△ Less
Submitted 13 December, 2023; v1 submitted 11 June, 2021;
originally announced June 2021.
-
Intelligent Reflecting Surfaces for Compute-and-Forward
Authors:
Mahdi Jafari Siavoshani,
Seyed Pooya Shariatpanahi,
Naeimeh Omidvar
Abstract:
Compute-and-forward is a promising strategy to tackle interference and obtain high rates between the transmitting users in a wireless network. However, the quality of the wireless channels between the users substantially limits the achievable computation rate in such systems. In this paper, we introduce the idea of using intelligent reflecting surfaces (IRSs) to enhance the computing capability of…
▽ More
Compute-and-forward is a promising strategy to tackle interference and obtain high rates between the transmitting users in a wireless network. However, the quality of the wireless channels between the users substantially limits the achievable computation rate in such systems. In this paper, we introduce the idea of using intelligent reflecting surfaces (IRSs) to enhance the computing capability of the compute-and-forward systems. For this purpose, we consider a multiple access channel(MAC) where a number of users aim to send data to a base station (BS) in a wireless network, where the BS is interested in decoding a linear combination of the data from different users in the corresponding finite field. Considering the compute-and-forward framework, we show that through carefully designing the IRS parameters, such a scenario's computation rate can be significantly improved. More specifically, we formulate an optimization problem which aims to maximize the computation rate of the system through optimizing the IRS phase shift parameters. We then propose an alternating optimization (AO) approach to solve the formulated problem with low complexity. Finally, via various numerical results, we demonstrate the effectiveness of the IRS technology for enhancing the performance of the compute-and-forward systems, which indicates its great potential for future wireless networks with massive computation requirements, such as 6G.
△ Less
Submitted 24 June, 2021; v1 submitted 14 January, 2021;
originally announced January 2021.
-
A Hybrid-Order Distributed SGD Method for Non-Convex Optimization to Balance Communication Overhead, Computational Complexity, and Convergence Rate
Authors:
Naeimeh Omidvar,
Mohammad Ali Maddah-Ali,
Hamed Mahdavi
Abstract:
In this paper, we propose a method of distributed stochastic gradient descent (SGD), with low communication load and computational complexity, and still fast convergence. To reduce the communication load, at each iteration of the algorithm, the worker nodes calculate and communicate some scalers, that are the directional derivatives of the sample functions in some \emph{pre-shared directions}. How…
▽ More
In this paper, we propose a method of distributed stochastic gradient descent (SGD), with low communication load and computational complexity, and still fast convergence. To reduce the communication load, at each iteration of the algorithm, the worker nodes calculate and communicate some scalers, that are the directional derivatives of the sample functions in some \emph{pre-shared directions}. However, to maintain accuracy, after every specific number of iterations, they communicate the vectors of stochastic gradients. To reduce the computational complexity in each iteration, the worker nodes approximate the directional derivatives with zeroth-order stochastic gradient estimation, by performing just two function evaluations rather than computing a first-order gradient vector. The proposed method highly improves the convergence rate of the zeroth-order methods, guaranteeing order-wise faster convergence. Moreover, compared to the famous communication-efficient methods of model averaging (that perform local model updates and periodic communication of the gradients to synchronize the local models), we prove that for the general class of non-convex stochastic problems and with reasonable choice of parameters, the proposed method guarantees the same orders of communication load and convergence rate, while having order-wise less computational complexity. Experimental results on various learning problems in neural networks applications demonstrate the effectiveness of the proposed approach compared to various state-of-the-art distributed SGD methods.
△ Less
Submitted 27 March, 2020;
originally announced March 2020.
-
Parallel Stochastic Optimization Framework for Large-Scale Non-Convex Stochastic Problems
Authors:
Naeimeh Omidvar,
An Liu,
Vincent Lau,
Danny H. K. Tsang,
Mohammad Reza Pakravan
Abstract:
In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed is critical for many emerging applications, most existing stochastic optimization methods suffer from slow convergence. Furthermore, the emerging technology of p…
▽ More
In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed is critical for many emerging applications, most existing stochastic optimization methods suffer from slow convergence. Furthermore, the emerging technology of parallel computing has motivated an increasing demand for designing new stochastic optimization schemes that can handle parallel optimization for implementation in distributed systems. We propose a fast parallel stochastic optimization framework that can solve a large class of possibly non-convex stochastic optimization problems that may arise in applications with multi-agent systems. In the proposed method, each agent updates its control variable in parallel, by solving a convex quadratic subproblem independently. The convergence of the proposed method to the optimal solution for convex problems and to a stationary point for general non-convex problems is established. The proposed algorithm can be applied to solve a large class of optimization problems arising in important applications from various fields, such as machine learning and wireless networks. As a representative application of our proposed stochastic optimization framework, we focus on large-scale support vector machines and demonstrate how our algorithm can efficiently solve this problem, especially in modern applications with huge datasets. Using popular real-world datasets, we present experimental results to demonstrate the merits of our proposed framework by comparing its performance to the state-of-the-art in the literature. Numerical results show that the proposed method can significantly outperform the state-of-the-art methods in terms of the convergence speed while having the same or lower complexity and storage requirement.
△ Less
Submitted 22 October, 2019;
originally announced October 2019.
-
Efficient, Fair and QoS-Aware Policies for Wirelessly Powered Communication Networks
Authors:
Roohollah Rezaei,
Naeimeh Omidvar,
Mohammad Movahednasab,
Mohammad Reza Pakravan,
Sumei Sun,
Yong Liang Guan
Abstract:
Wireless power transfer (WPT) is a viable source of energy for wirelessly powered communication networks (WPCNs). In this paper, we first consider WPT from an energy access point (E-AP) to multiple energy receivers (E-Rs) to obtain the optimal policy that maximizes the WPT efficiency. For this purpose, we formulate the problem of maximizing the total average received power of the E-Rs subject to t…
▽ More
Wireless power transfer (WPT) is a viable source of energy for wirelessly powered communication networks (WPCNs). In this paper, we first consider WPT from an energy access point (E-AP) to multiple energy receivers (E-Rs) to obtain the optimal policy that maximizes the WPT efficiency. For this purpose, we formulate the problem of maximizing the total average received power of the E-Rs subject to the average and peak power level constraints of the E-AP. The formulated problem is a non-convex stochastic optimization problem. Using some stochastic optimization techniques, we tackle the challenges of this problem and derive a closed-form expression for the optimal solution, which requires the explicit knowledge of the distribution of channel state information (CSI) in the network. We then propose a near-optimal algorithm that does not require any explicit knowledge of the CSI distribution and prove that the proposed algorithm attains a near-optimal solution within a guaranteed gap to the optimal solution. We next consider fairness among the E-Rs and propose a quality of service (QoS) aware fair policy that maximizes a generic network utility function while guaranteeing the required QoS of each E-R. Finally, we study a practical wirelessly powered communication scenario in which the E-Rs utilize their energy harvested through WPT to transmit information to the E-AP. We optimize the received information at the E-AP under its average and peak transmission power constraints and the fairness constraints of the E-Rs. Numerical results show the significant performance of our proposed solutions compared to the state-of-the-art baselines.
△ Less
Submitted 17 September, 2019;
originally announced September 2019.
-
An Energy-Efficient Controller for Wirelessly-Powered Communication Networks
Authors:
Mohammad Movahednasab,
Behrooz Makki,
Naeimeh Omidvar,
Mohammad Reza Pakravan,
Tommy Svensson,
Michele Zorzi
Abstract:
In a wirelessly-powered communication network (WPCN), an energy access point (E-AP) supplies the energy needs of the network nodes through radio frequency wave transmission, and the nodes store their received energy in their batteries for possible data transmission. In this paper, we propose an online control policy for energy transfer from the E-AP to the wireless nodes and for data transfer amon…
▽ More
In a wirelessly-powered communication network (WPCN), an energy access point (E-AP) supplies the energy needs of the network nodes through radio frequency wave transmission, and the nodes store their received energy in their batteries for possible data transmission. In this paper, we propose an online control policy for energy transfer from the E-AP to the wireless nodes and for data transfer among the nodes. With our proposed control policy, all data queues of the nodes are stable, while the average energy consumption of the network is shown to be within a bounded gap of the minimum energy required for stabilizing the network. Our proposed policy is designed using a quadratic Lyapunov function to capture the limitations on the energy consumption of the nodes imposed by their battery levels. We show that under the proposed control policy, the backlog level in the data queues and the stored energy level in the batteries fluctuate in small intervals around some constant levels. Consequently, by imposing negligible average data drop rate, the data buffer size and the battery capacity of the nodes can be significantly reduced.
△ Less
Submitted 15 May, 2019;
originally announced May 2019.
-
Optimal and Near-Optimal Policies for Wireless Power Transfer in Energy-Limited and Power-Limited Scenarios
Authors:
Roohollah Rezaei,
Mohammad Movahednasab,
Naeimeh Omidvar,
Mohammad Reza Pakravan
Abstract:
Radio frequency wireless power transfer (RF-WPT) is an emerging technology that enables transferring energy from an energy access point (E-AP) to multiple energy receivers (E-Rs), in a wireless manner. In practice, there are some restrictions on the power level or the amount of energy that the E-AP can transfer, which need to be considered in order to determine a proper power transfer policy for t…
▽ More
Radio frequency wireless power transfer (RF-WPT) is an emerging technology that enables transferring energy from an energy access point (E-AP) to multiple energy receivers (E-Rs), in a wireless manner. In practice, there are some restrictions on the power level or the amount of energy that the E-AP can transfer, which need to be considered in order to determine a proper power transfer policy for the E-AP. In this paper, we formulate the problem of finding the optimal policy for two practical scenarios of powerlimited and energy-limited E-APs. The formulated problems are non-convex stochastic optimization problems that are very challenging to solve. We propose optimal and near-optimal policies for the power transfer of the E-AP to the E-Rs, where the optimal solutions require statistical information of the channel states, while the near-optimal solutions do not require such information and perform well in practice. Furthermore, to ensure fairness among E-Rs, we propose two fair policies, namely Max- Min Fair policy and quality-of-service-aware Proportional Fair policy. MMF policy targets maximizing the minimum received power among the E-Rs, and QPF policy maximizes the total received power of the E-Rs, while guaranteeing the required minimum QoS for each E-R. Various numerical results demonstrate the significant performance of the proposed policies.
△ Less
Submitted 16 April, 2018;
originally announced April 2018.
-
Optimal Hierarchical Radio Resource Management for HetNets with Flexible Backhaul
Authors:
Naeimeh Omidvar,
An Liu,
Vincent Lau,
Fan Zhang,
Danny H. K. Tsang,
Mohammad Reza Pakravan
Abstract:
Providing backhaul connectivity for macro and pico base stations (BSs) constitutes a significant share of infrastructure costs in future heterogeneous networks (HetNets). To address this issue, the emerging idea of flexible backhaul is proposed. Under this architecture, not all the pico BSs are connected to the backhaul, resulting in a significant reduction in the infrastructure costs. In this reg…
▽ More
Providing backhaul connectivity for macro and pico base stations (BSs) constitutes a significant share of infrastructure costs in future heterogeneous networks (HetNets). To address this issue, the emerging idea of flexible backhaul is proposed. Under this architecture, not all the pico BSs are connected to the backhaul, resulting in a significant reduction in the infrastructure costs. In this regard, pico BSs without backhaul connectivity need to communicate with their nearby BSs in order to have indirect accessibility to the backhaul. This makes the radio resource management (RRM) in such networks more complex and challenging. In this paper, we address the problem of cross-layer RRM in HetNets with flexible backhaul. We formulate this problem as a two-timescale non-convex stochastic optimization which jointly optimizes flow control, routing, interference mitigation and link scheduling in order to maximize a generic network utility. By exploiting a hidden convexity of this non-convex problem, we propose an iterative algorithm which converges to the global optimal solution. The proposed algorithm benefits from low complexity and low signalling, which makes it scalable. Moreover, due to the proposed two-timescale design, it is robust to the backhaul signalling latency as well. Simulation results demonstrate the significant performance gain of the proposed solution over various baselines.
△ Less
Submitted 27 August, 2020; v1 submitted 15 April, 2015;
originally announced April 2015.