-
Network-Controlled Repeater -- An Introduction
Authors:
Fco. Italo G. Carvalho,
Raul Victor de O. Paiva,
Tarcisio F. Maciel,
Victor F. Monteiro,
Fco. Rafael M. Lima,
Darlan C. Moreira,
Diego A. Sousa,
Behrooz Makki,
Magnus Astrom,
Lei Bao
Abstract:
In fifth generation (5G) wireless cellular networks, millimeter wave spectrum opens room for several potential improvements in throughput, reliability, latency, among other aspects. However, it also brings challenges, such as a higher influence of blockage which may significantly limit the coverage. In this context, network-controlled repeaters (NCRs) are network nodes with low complexity that rep…
▽ More
In fifth generation (5G) wireless cellular networks, millimeter wave spectrum opens room for several potential improvements in throughput, reliability, latency, among other aspects. However, it also brings challenges, such as a higher influence of blockage which may significantly limit the coverage. In this context, network-controlled repeaters (NCRs) are network nodes with low complexity that represent a technique to overcome coverage problems. In this paper, we introduce the NCR concept and study its performance gains and deployment options. Particularly, presenting the main specifications of NCR as agreed in 3rd generation partnership project (3GPP) Rel-18, we analyze different NCR deployments in an urban scenario and compare its performance with alternative deployments. As demonstrated, with a proper network planning and beamforming design, NCR is an attractive solution to cover blind spots the base stations (BSs) may have.
△ Less
Submitted 14 March, 2024;
originally announced March 2024.
-
LearnedSort as a learning-augmented SampleSort: Analysis and Parallelization
Authors:
Ivan Carvalho,
Ramon Lawrence
Abstract:
This work analyzes and parallelizes LearnedSort, the novel algorithm that sorts using machine learning models based on the cumulative distribution function. LearnedSort is analyzed under the lens of algorithms with predictions, and it is argued that LearnedSort is a learning-augmented SampleSort. A parallel LearnedSort algorithm is developed combining LearnedSort with the state-of-the-art SampleSo…
▽ More
This work analyzes and parallelizes LearnedSort, the novel algorithm that sorts using machine learning models based on the cumulative distribution function. LearnedSort is analyzed under the lens of algorithms with predictions, and it is argued that LearnedSort is a learning-augmented SampleSort. A parallel LearnedSort algorithm is developed combining LearnedSort with the state-of-the-art SampleSort implementation, IPS4o. Benchmarks on synthetic and real-world datasets demonstrate improved parallel performance for parallel LearnedSort compared to IPS4o and other sorting algorithms.
△ Less
Submitted 17 July, 2023;
originally announced July 2023.
-
Using Learned Indexes to Improve Time Series Indexing Performance on Embedded Sensor Devices
Authors:
David Ding,
Ivan Carvalho,
Ramon Lawrence
Abstract:
Efficiently querying data on embedded sensor and IoT devices is challenging given the very limited memory and CPU resources. With the increasing volumes of collected data, it is critical to process, filter, and manipulate data on the edge devices where it is collected to improve efficiency and reduce network transmissions. Existing embedded index structures do not adapt to the data distribution an…
▽ More
Efficiently querying data on embedded sensor and IoT devices is challenging given the very limited memory and CPU resources. With the increasing volumes of collected data, it is critical to process, filter, and manipulate data on the edge devices where it is collected to improve efficiency and reduce network transmissions. Existing embedded index structures do not adapt to the data distribution and characteristics. This paper demonstrates how applying learned indexes that develop space efficient summaries of the data can dramatically improve the query performance and predictability. Learned indexes based on linear approximations can reduce the query I/O by 50 to 90% and improve query throughput by a factor of 2 to 5, while only requiring a few kilobytes of RAM. Experimental results on a variety of time series data sets demonstrate the advantages of learned indexes that considerably improve over the state-of-the-art index algorithms.
△ Less
Submitted 6 February, 2023;
originally announced February 2023.
-
QUBO formulations for NP-Hard spanning tree problems
Authors:
Ivan Carvalho
Abstract:
We introduce a novel Quadratic Unconstrained Binary Optimization (QUBO) formulation method for spanning tree problems. Instead of encoding the presence of edges in the tree individually, we opt to encode spanning trees as a permutation problem. We apply our method to four NP-hard spanning tree variants, namely the k-minimum spanning tree, degree-constrained minimum spanning tree, minimum leaf span…
▽ More
We introduce a novel Quadratic Unconstrained Binary Optimization (QUBO) formulation method for spanning tree problems. Instead of encoding the presence of edges in the tree individually, we opt to encode spanning trees as a permutation problem. We apply our method to four NP-hard spanning tree variants, namely the k-minimum spanning tree, degree-constrained minimum spanning tree, minimum leaf spanning tree, and maximum leaf spanning tree. Our main result is a formulation with $\mathcal{O}(|V|k)$ variables for the k-minimum spanning tree problem, beating related strategies that need $\mathcal{O}(|V|^{2})$ variables.
△ Less
Submitted 12 September, 2022;
originally announced September 2022.
-
Towards Parallel Learned Sorting
Authors:
Ivan Carvalho
Abstract:
We introduce a new sorting algorithm that is the combination of ML-enhanced sorting with the In-place Super Scalar Sample Sort (IPS4o). The main contribution of our work is to achieve parallel ML-enhanced sorting, as previous algorithms were limited to sequential implementations. We introduce the In-Place Parallel Learned Sort (IPLS) algorithm and compare it extensively against other sorting appro…
▽ More
We introduce a new sorting algorithm that is the combination of ML-enhanced sorting with the In-place Super Scalar Sample Sort (IPS4o). The main contribution of our work is to achieve parallel ML-enhanced sorting, as previous algorithms were limited to sequential implementations. We introduce the In-Place Parallel Learned Sort (IPLS) algorithm and compare it extensively against other sorting approaches. IPLS combines the IPS4o framework with linear models trained using the Fastest Minimum Conflict Degree algorithm to partition data. The experimental results do not crown IPLS as the fastest algorithm. However, they do show that IPLS is competitive among its peers and that using the IPS4o framework is a promising approach towards parallel learned sorting.
△ Less
Submitted 14 August, 2022;
originally announced August 2022.
-
rustworkx: A High-Performance Graph Library for Python
Authors:
Matthew Treinish,
Ivan Carvalho,
Georgios Tsilimigkounakis,
Nahum Sá
Abstract:
In rustworkx, we provide a high-performance, flexible graph library for Python. rustworkx is inspired by NetworkX but addresses many performance concerns of the latter. rustworkx is written in Rust and is particularly suited for performance-sensitive applications that use graph representations.
In rustworkx, we provide a high-performance, flexible graph library for Python. rustworkx is inspired by NetworkX but addresses many performance concerns of the latter. rustworkx is written in Rust and is particularly suited for performance-sensitive applications that use graph representations.
△ Less
Submitted 1 November, 2022; v1 submitted 28 October, 2021;
originally announced October 2021.
-
Contextual-Lexicon Approach for Abusive Language Detection
Authors:
Francielle Vargas,
Fabiana Rodrigues de Góes,
Isabelle Carvalho,
Fabrício Benevenuto,
Thiago Alexandre Salgueiro Pardo
Abstract:
Since a lexicon-based approach is more elegant scientifically, explaining the solution components and being easier to generalize to other applications, this paper provides a new approach for offensive language and hate speech detection on social media. Our approach embodies a lexicon of implicit and explicit offensive and swearing expressions annotated with contextual information. Due to the sever…
▽ More
Since a lexicon-based approach is more elegant scientifically, explaining the solution components and being easier to generalize to other applications, this paper provides a new approach for offensive language and hate speech detection on social media. Our approach embodies a lexicon of implicit and explicit offensive and swearing expressions annotated with contextual information. Due to the severity of the social media abusive comments in Brazil, and the lack of research in Portuguese, Brazilian Portuguese is the language used to validate the models. Nevertheless, our method may be applied to any other language. The conducted experiments show the effectiveness of the proposed approach, outperforming the current baseline methods for the Portuguese language.
△ Less
Submitted 20 December, 2022; v1 submitted 25 April, 2021;
originally announced April 2021.
-
Identifying Offensive Expressions of Opinion in Context
Authors:
Francielle Alves Vargas,
Isabelle Carvalho,
Fabiana Rodrigues de Góes
Abstract:
Classic information extraction techniques consist in building questions and answers about the facts. Indeed, it is still a challenge to subjective information extraction systems to identify opinions and feelings in context. In sentiment-based NLP tasks, there are few resources to information extraction, above all offensive or hateful opinions in context. To fill this important gap, this short pape…
▽ More
Classic information extraction techniques consist in building questions and answers about the facts. Indeed, it is still a challenge to subjective information extraction systems to identify opinions and feelings in context. In sentiment-based NLP tasks, there are few resources to information extraction, above all offensive or hateful opinions in context. To fill this important gap, this short paper provides a new cross-lingual and contextual offensive lexicon, which consists of explicit and implicit offensive and swearing expressions of opinion, which were annotated in two different classes: context dependent and context-independent offensive. In addition, we provide markers to identify hate speech. Annotation approach was evaluated at the expression-level and achieves high human inter-annotator agreement. The provided offensive lexicon is available in Portuguese and English languages.
△ Less
Submitted 21 September, 2022; v1 submitted 25 April, 2021;
originally announced April 2021.
-
HateBR: A Large Expert Annotated Corpus of Brazilian Instagram Comments for Offensive Language and Hate Speech Detection
Authors:
Francielle Alves Vargas,
Isabelle Carvalho,
Fabiana Rodrigues de Góes,
Fabrício Benevenuto,
Thiago Alexandre Salgueiro Pardo
Abstract:
Due to the severity of the social media offensive and hateful comments in Brazil, and the lack of research in Portuguese, this paper provides the first large-scale expert annotated corpus of Brazilian Instagram comments for hate speech and offensive language detection. The HateBR corpus was collected from the comment section of Brazilian politicians' accounts on Instagram and manually annotated by…
▽ More
Due to the severity of the social media offensive and hateful comments in Brazil, and the lack of research in Portuguese, this paper provides the first large-scale expert annotated corpus of Brazilian Instagram comments for hate speech and offensive language detection. The HateBR corpus was collected from the comment section of Brazilian politicians' accounts on Instagram and manually annotated by specialists, reaching a high inter-annotator agreement. The corpus consists of 7,000 documents annotated according to three different layers: a binary classification (offensive versus non-offensive comments), offensiveness-level classification (highly, moderately, and slightly offensive), and nine hate speech groups (xenophobia, racism, homophobia, sexism, religious intolerance, partyism, apology for the dictatorship, antisemitism, and fatphobia). We also implemented baseline experiments for offensive language and hate speech detection and compared them with a literature baseline. Results show that the baseline experiments on our corpus outperform the current state-of-the-art for the Portuguese language.
△ Less
Submitted 27 December, 2022; v1 submitted 27 March, 2021;
originally announced March 2021.
-
Leveraging Context-awareness to Better Support the IoT Cloud-Edge Continuum
Authors:
Liliana I. Carvalho,
Daniel. M. Silva,
R. C. Sofia
Abstract:
Novel Internet of Things (IoT) requirements derived from a broader interconnection of heterogeneous devices have pushed the horizons of Cloud computing and are giving rise to a wider decentralisation of applications and data centers. An answer to the underlying network concerns, such as the need to lower the resulting latency due to heavy computation needs,or safety aspects, gave rise to Edge/Fog…
▽ More
Novel Internet of Things (IoT) requirements derived from a broader interconnection of heterogeneous devices have pushed the horizons of Cloud computing and are giving rise to a wider decentralisation of applications and data centers. An answer to the underlying network concerns, such as the need to lower the resulting latency due to heavy computation needs,or safety aspects, gave rise to Edge/Fog computing, where IoT functionality can be also supported closer to data sources. While it is today feasible to perform some IoT functionality on the Edge, the orchestration of operations between Edge and Cloud requires an automated support, where context-awareness plays a key role in assisting the network in deciding when and whereto store data and to perform computation. This work is focused on the application of context-awareness to support a smoother operation of the Edge to Cloud operation, aiming at lowering latency, in particular when real-time or close-to-real-time data exchange is present.
△ Less
Submitted 30 April, 2020;
originally announced May 2020.
-
Application of Progressive Hedging to Var Expansion Planning Under Uncertainty
Authors:
Igor Carvalho,
Tiago Andrade,
Joaquim Dias Garcia,
Maria de Lujan Latorre
Abstract:
This paper describes the application of a Progressive Hedging (PH) algorithm to the least-cost var planning under uncertainty. The method PH is a scenario-based decomposition technique for solving stochastic programs, i.e., it decomposes a large scale stochastic problem into s deterministic subproblems and couples the decision from the s subproblems to form a solution for the original stochastic p…
▽ More
This paper describes the application of a Progressive Hedging (PH) algorithm to the least-cost var planning under uncertainty. The method PH is a scenario-based decomposition technique for solving stochastic programs, i.e., it decomposes a large scale stochastic problem into s deterministic subproblems and couples the decision from the s subproblems to form a solution for the original stochastic problem. The effectiveness and computational performance of the proposed methodology will be illustrated with var planning studies for the IEEE 24-bus system (5 operating scenarios), the 200-bus Bolivian system (1,152 operating scenarios) and the 1,600-bus Colombian system (180 scenarios).
△ Less
Submitted 17 April, 2020;
originally announced April 2020.
-
Algorithms the min-max regret 0-1 Integer Linear Programming Problem with Interval Data
Authors:
Iago A. Carvalho,
Thiago F. Noronha,
Christophe Duhamel
Abstract:
We address the Interval Data Min-Max Regret 0-1 Integer Linear Programming problem (MMR-ILP), a variant of the 0-1 Integer Linear Programming problem where the objective function coefficients are uncertain. We solve MMR-ILP using a Benders-like Decomposition Algorithm and two metaheuristics for min-max regret problems with interval data. Computational experiments developed on variations of MIPLIB…
▽ More
We address the Interval Data Min-Max Regret 0-1 Integer Linear Programming problem (MMR-ILP), a variant of the 0-1 Integer Linear Programming problem where the objective function coefficients are uncertain. We solve MMR-ILP using a Benders-like Decomposition Algorithm and two metaheuristics for min-max regret problems with interval data. Computational experiments developed on variations of MIPLIB instances show that the heuristics obtain good results in a reasonable computational time when compared to the Benders-like Decomposition algorithm.
△ Less
Submitted 14 August, 2019;
originally announced August 2019.
-
An Efficient Algorithm for the Fast Delivery Problem
Authors:
Iago A. Carvalho,
Thomas Erlebach,
Kleitos Papadopoulos
Abstract:
We study a problem where k autonomous mobile agents are initially located on distinct nodes of a weighted graph (with n nodes and m edges). Each autonomous mobile agent has a predefined velocity and is only allowed to move along the edges of the graph. We are interested in delivering a package, initially positioned in a source node s, to a destination node y. The delivery is achieved by the collec…
▽ More
We study a problem where k autonomous mobile agents are initially located on distinct nodes of a weighted graph (with n nodes and m edges). Each autonomous mobile agent has a predefined velocity and is only allowed to move along the edges of the graph. We are interested in delivering a package, initially positioned in a source node s, to a destination node y. The delivery is achieved by the collective effort of the autonomous mobile agents, which can carry and exchange the package among them. The objective is to compute a delivery schedule that minimizes the delivery time of the package. In this paper, we propose an O(kn log n + km) time algorithm for this problem. This improves the previous state-of-the-art O(k^2 m + k n^2 + APSP) time algorithm for this problem, where APSP stands for the running-time of an algorithm for the All-Pairs Shortest Paths problem.
△ Less
Submitted 19 August, 2019; v1 submitted 19 April, 2019;
originally announced April 2019.
-
On the statistical evaluation of algorithmic's computational experimentation with infeasible solutions
Authors:
Iago A Carvalho
Abstract:
The experimental evaluation of algorithms results in a large set of data which generally do not follow a normal distribution or are not heteroscedastic. Besides, some of its entries may be missing, due to the inability of an algorithm to find a feasible solution until a time limit is met. Those characteristics restrict the statistical evaluation of computational experiments. This work proposes a b…
▽ More
The experimental evaluation of algorithms results in a large set of data which generally do not follow a normal distribution or are not heteroscedastic. Besides, some of its entries may be missing, due to the inability of an algorithm to find a feasible solution until a time limit is met. Those characteristics restrict the statistical evaluation of computational experiments. This work proposes a bi-objective lexicographical ranking scheme to evaluate datasets with such characteristics. The output ranking can be used as input to any desired statistical test. We used the proposed ranking scheme to assess the results obtained by the Iterative Rounding heuristic (IR). A Friedman's test and a subsequent post-hoc test carried out on the ranked data demonstrated that IR performed significantly better than the Feasibility Pump heuristic when solving 152 benchmark problems of Nonconvex Mixed-Integer Nonlinear Problems. However, is also showed that the RECIPE heuristic was significantly better than IR when solving the same benchmark problems.
△ Less
Submitted 31 January, 2019;
originally announced February 2019.
