-
Identifying Systems with Symmetries using Equivariant Autoregressive Reservoir Computers
Authors:
Fredy Vides,
Idelfonso B. R. Nogueira,
Lendy Banegas,
Evelyn Flores
Abstract:
The investigation reported in this document focuses on identifying systems with symmetries using equivariant autoregressive reservoir computers. General results in structured matrix approximation theory are presented, exploring a two-fold approach. Firstly, a comprehensive examination of generic symmetry-preserving nonlinear time delay embedding is conducted. This involves analyzing time series da…
▽ More
The investigation reported in this document focuses on identifying systems with symmetries using equivariant autoregressive reservoir computers. General results in structured matrix approximation theory are presented, exploring a two-fold approach. Firstly, a comprehensive examination of generic symmetry-preserving nonlinear time delay embedding is conducted. This involves analyzing time series data sampled from an equivariant system under study. Secondly, sparse least-squares methods are applied to discern approximate representations of the output coupling matrices. These matrices play a pivotal role in determining the nonlinear autoregressive representation of an equivariant system. The structural characteristics of these matrices are dictated by the set of symmetries inherent in the system. The document outlines prototypical algorithms derived from the described techniques, offering insight into their practical applications. Emphasis is placed on their effectiveness in the identification and predictive simulation of equivariant nonlinear systems, regardless of whether such systems exhibit chaotic behavior.
△ Less
Submitted 28 November, 2023; v1 submitted 15 November, 2023;
originally announced November 2023.
-
Dynamic financial processes identification using sparse regressive reservoir computers
Authors:
Fredy Vides,
Idelfonso B. R. Nogueira,
Lendy Banegas,
Evelyn Flores
Abstract:
In this document, we present key findings in structured matrix approximation theory, with applications to the regressive representation of dynamic financial processes. Initially, we explore a comprehensive approach involving generic nonlinear time delay embedding for time series data extracted from a financial or economic system under examination. Subsequently, we employ sparse least-squares and s…
▽ More
In this document, we present key findings in structured matrix approximation theory, with applications to the regressive representation of dynamic financial processes. Initially, we explore a comprehensive approach involving generic nonlinear time delay embedding for time series data extracted from a financial or economic system under examination. Subsequently, we employ sparse least-squares and structured matrix approximation methods to discern approximate representations of the output coupling matrices. These representations play a pivotal role in establishing the regressive models corresponding to the recursive structures inherent in a given financial system. The document further introduces prototypical algorithms that leverage the aforementioned techniques. These algorithms are demonstrated through applications in approximate identification and predictive simulation of dynamic financial and economic processes, encompassing scenarios that may or may not exhibit chaotic behavior.
△ Less
Submitted 18 October, 2023;
originally announced October 2023.
-
An experiment on an automated literature survey of data-driven speech enhancement methods
Authors:
Arthur dos Santos,
Jayr Pereira,
Rodrigo Nogueira,
Bruno Masiero,
Shiva Sander-Tavallaey,
Elias Zea
Abstract:
The increasing number of scientific publications in acoustics, in general, presents difficulties in conducting traditional literature surveys. This work explores the use of a generative pre-trained transformer (GPT) model to automate a literature survey of 116 articles on data-driven speech enhancement methods. The main objective is to evaluate the capabilities and limitations of the model in prov…
▽ More
The increasing number of scientific publications in acoustics, in general, presents difficulties in conducting traditional literature surveys. This work explores the use of a generative pre-trained transformer (GPT) model to automate a literature survey of 116 articles on data-driven speech enhancement methods. The main objective is to evaluate the capabilities and limitations of the model in providing accurate responses to specific queries about the papers selected from a reference human-based survey. While we see great potential to automate literature surveys in acoustics, improvements are needed to address technical questions more clearly and accurately.
△ Less
Submitted 9 October, 2023;
originally announced October 2023.
-
Detection and Mitigation of Corrupted Information in Distributed Model Predictive Control Based on Resource Allocation
Authors:
Rafael Accácio Nogueira,
Romain Bourdais,
Hervé Guéguen
Abstract:
In distributed predictive control structures, communication among agents is required to achieve a consensus and approach an optimal global behavior. Such negotiation mechanisms are sensitive to attacks on these exchanges. This paper proposes a monitoring scheme that detects and mitigates these attacks' effects in a resource allocation framework. The performance of the proposed method is illustrate…
▽ More
In distributed predictive control structures, communication among agents is required to achieve a consensus and approach an optimal global behavior. Such negotiation mechanisms are sensitive to attacks on these exchanges. This paper proposes a monitoring scheme that detects and mitigates these attacks' effects in a resource allocation framework. The performance of the proposed method is illustrated through simulations of the temperature control of multiple rooms under power scarcity.
△ Less
Submitted 21 July, 2022;
originally announced July 2022.
-
Expectation-Maximization Based Defense Mechanism for Distributed Model Predictive Control
Authors:
Rafael Accácio Nogueira,
Romain Bourdais,
Simon Leglaive,
Hervé Guéguen
Abstract:
Controlling large-scale systems sometimes requires decentralized computation. Communication among agents is crucial to achieving consensus and optimal global behavior. These negotiation mechanisms are sensitive to attacks on those exchanges. This paper proposes an algorithm based on Expectation Maximization to mitigate the effects of attacks in a resource allocation based distributed model predict…
▽ More
Controlling large-scale systems sometimes requires decentralized computation. Communication among agents is crucial to achieving consensus and optimal global behavior. These negotiation mechanisms are sensitive to attacks on those exchanges. This paper proposes an algorithm based on Expectation Maximization to mitigate the effects of attacks in a resource allocation based distributed model predictive control. The performance is assessed through an academic example of the temperature control of multiple rooms under input power constraints.
△ Less
Submitted 17 July, 2022;
originally announced July 2022.
-
Electricity Theft Detection with self-attention
Authors:
Paulo Finardi,
Israel Campiotti,
Gustavo Plensack,
Rafael Derradi de Souza,
Rodrigo Nogueira,
Gustavo Pinheiro,
Roberto Lotufo
Abstract:
In this work we propose a novel self-attention mechanism model to address electricity theft detection on an imbalanced realistic dataset that presents a daily electricity consumption provided by State Grid Corporation of China. Our key contribution is the introduction of a multi-head self-attention mechanism concatenated with dilated convolutions and unified by a convolution of kernel size $1$. Mo…
▽ More
In this work we propose a novel self-attention mechanism model to address electricity theft detection on an imbalanced realistic dataset that presents a daily electricity consumption provided by State Grid Corporation of China. Our key contribution is the introduction of a multi-head self-attention mechanism concatenated with dilated convolutions and unified by a convolution of kernel size $1$. Moreover, we introduce a binary input channel (Binary Mask) to identify the position of the missing values, allowing the network to learn how to deal with these values. Our model achieves an AUC of $0.926$ which is an improvement in more than $17\%$ with respect to previous baseline work. The code is available on GitHub at https://github.com/neuralmind-ai/electricity-theft-detection-with-self-attention.
△ Less
Submitted 14 February, 2020;
originally announced February 2020.