-
Lattice Lipschitz superposition operators on Banach function spaces
Authors:
Roger Arnau,
Jose M. Calabuig,
Ezgi Erdoğan,
Enrique A. Sánchez Pérez
Abstract:
We analyse and characterise the notion of lattice Lipschitz operator (a class of superposition operators, diagonal Lipschitz maps) when defined between Banach function spaces. After showing some general results, we restrict our attention to the case of those Lipschitz operators which are representable by pointwise composition with a strongly measurable function. Mimicking the classical definition…
▽ More
We analyse and characterise the notion of lattice Lipschitz operator (a class of superposition operators, diagonal Lipschitz maps) when defined between Banach function spaces. After showing some general results, we restrict our attention to the case of those Lipschitz operators which are representable by pointwise composition with a strongly measurable function. Mimicking the classical definition and characterizations of (linear) multiplication operators between Banach function spaces, we show that under certain conditions the requirement for a diagonal Lipschitz operator to be well-defined between two such spaces $X(μ)$ and $Y(μ)$ is that it can be represented by a strongly measurable function which belongs to the Bochner space $\mathcal M(X,Y) \big(μ, Lip_0(\mathbb R) \big). $ Here, $\mathcal M(X,Y) $ is the space of multiplication operators between $X(μ)$ and $Y(μ),$ and $Lip_0(\mathbb R)$ is the space of real-valued Lipschitz maps with real variable that are equal to $0$ in $0. $ This opens the door to a better understanding of these maps, as well as finding the relation of these operators to some normed tensor products and other classes of maps.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
Moduli of Continuity in Metric Models and Extension of Liveability Indices
Authors:
R. Arnau,
J. M. Calabuig,
Álvaro González,
Enrique A. Sánchez Pérez
Abstract:
Index spaces serve as valuable metric models for studying properties relevant to various applications, such as social science or economics. These properties are represented by real Lipschitz functions that describe the degree of association with each element within the underlying metric space. After determining the index value within a given sample subset, the classic McShane and Whitney formulas…
▽ More
Index spaces serve as valuable metric models for studying properties relevant to various applications, such as social science or economics. These properties are represented by real Lipschitz functions that describe the degree of association with each element within the underlying metric space. After determining the index value within a given sample subset, the classic McShane and Whitney formulas allow a Lipschitz regression procedure to be performed to extend the index values over the entire metric space. To improve the adaptability of the metric model to specific scenarios, this paper introduces the concept of a composition metric, which involves composing a metric with an increasing, positive and subadditive function $φ$. The results presented here extend well-established results for Lipschitz indices on metric spaces to composition metrics. In addition, we establish the corresponding approximation properties that facilitate the use of this functional structure. To illustrate the power and simplicity of this mathematical framework, we provide a concrete application involving the modelling of livability indices in North American cities.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
Easy attention: A simple attention mechanism for temporal predictions with transformers
Authors:
Marcial Sanchis-Agudo,
Yuning Wang,
Roger Arnau,
Luca Guastoni,
Jasmin Lim,
Karthik Duraisamy,
Ricardo Vinuesa
Abstract:
To improve the robustness of transformer neural networks used for temporal-dynamics prediction of chaotic systems, we propose a novel attention mechanism called easy attention which we demonstrate in time-series reconstruction and prediction. While the standard self attention only makes use of the inner product of queries and keys, it is demonstrated that the keys, queries and softmax are not nece…
▽ More
To improve the robustness of transformer neural networks used for temporal-dynamics prediction of chaotic systems, we propose a novel attention mechanism called easy attention which we demonstrate in time-series reconstruction and prediction. While the standard self attention only makes use of the inner product of queries and keys, it is demonstrated that the keys, queries and softmax are not necessary for obtaining the attention score required to capture long-term dependencies in temporal sequences. Through the singular-value decomposition (SVD) on the softmax attention score, we further observe that self attention compresses the contributions from both queries and keys in the space spanned by the attention score. Therefore, our proposed easy-attention method directly treats the attention scores as learnable parameters. This approach produces excellent results when reconstructing and predicting the temporal dynamics of chaotic systems exhibiting more robustness and less complexity than self attention or the widely-used long short-term memory (LSTM) network. We show the improved performance of the easy-attention method in the Lorenz system, a turbulence shear flow and a model of a nuclear reactor.
△ Less
Submitted 15 May, 2024; v1 submitted 24 August, 2023;
originally announced August 2023.
-
Approximation of almost diagonal non-linear maps by lattice Lipschitz operators
Authors:
Roger Arnau,
Jose M. Calabuig,
Ezgi Erdoğan,
Enrique A. Sánchez Pérez
Abstract:
Lattice Lipschitz operators define a new class of nonlinear Banach-lattice-valued maps that can be written as diagonal functions with respect to a certain basis. In the $n-$dimensional case, such a map can be represented as a vector of size $n$ of real-valued functions of one variable. In this paper we develop a method to approximate almost diagonal maps by means of lattice Lipschitz operators. Th…
▽ More
Lattice Lipschitz operators define a new class of nonlinear Banach-lattice-valued maps that can be written as diagonal functions with respect to a certain basis. In the $n-$dimensional case, such a map can be represented as a vector of size $n$ of real-valued functions of one variable. In this paper we develop a method to approximate almost diagonal maps by means of lattice Lipschitz operators. The proposed technique is based on the approximation properties and error bounds obtained for these operators, together with a pointwise version of the interpolation of McShane and Whitney extension maps that can be applied to almost diagonal functions. In order to get the desired approximation, it is necessary to previously obtain an approximation to the set of eigenvectors of the original function. We focus on the explicit computation of error formulas and on illustrative examples to present our construction.
△ Less
Submitted 3 July, 2023;
originally announced July 2023.
