Showing 1–16 of 16 results for author: Konarovskyi, V

Dean-Kawasaki equation with initial condition in the space of positive distributions

Authors: Vitalii Konarovskyi, Fenna Müller

Abstract: We show that the Dean--Kawasaki equation does not admit nontrivial solutions in the space of tempered measures. More specifically, we consider martingale solutions taking values, and with initial conditions, in the subspace of measures admitting infinite mass and satisfying some integrability conditions. Following work by the first author, Lehmann and von Renesse [arXiv:1806.05018], we show that t… ▽ More We show that the Dean--Kawasaki equation does not admit nontrivial solutions in the space of tempered measures. More specifically, we consider martingale solutions taking values, and with initial conditions, in the subspace of measures admitting infinite mass and satisfying some integrability conditions. Following work by the first author, Lehmann and von Renesse [arXiv:1806.05018], we show that the equation only admits solutions if the initial measure is a discrete measure. Our result extends the previously mentioned works by allowing measures with infinite mass. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Comments: 17 pages

MSC Class: 60G57; 60H15; 60K35

Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent

Authors: Benjamin Gess, Sebastian Kassing, Vitalii Konarovskyi

Abstract: We propose new limiting dynamics for stochastic gradient descent in the small learning rate regime called stochastic modified flows. These SDEs are driven by a cylindrical Brownian motion and improve the so-called stochastic modified equations by having regular diffusion coefficients and by matching the multi-point statistics. As a second contribution, we introduce distribution dependent stochasti… ▽ More We propose new limiting dynamics for stochastic gradient descent in the small learning rate regime called stochastic modified flows. These SDEs are driven by a cylindrical Brownian motion and improve the so-called stochastic modified equations by having regular diffusion coefficients and by matching the multi-point statistics. As a second contribution, we introduce distribution dependent stochastic modified flows which we prove to describe the fluctuating limiting dynamics of stochastic gradient descent in the small learning rate - infinite width scaling regime. △ Less

Submitted 14 February, 2023; originally announced February 2023.

Comments: 24 pages

MSC Class: Primary 60J05; 60H15; 68T07; Secondary 60G46; 60G57; 46G05

Conservative SPDEs as fluctuating mean field limits of stochastic gradient descent

Authors: Benjamin Gess, Rishabh S. Gvalani, Vitalii Konarovskyi

Abstract: The convergence of stochastic interacting particle systems in the mean-field limit to solutions of conservative stochastic partial differential equations is established, with optimal rate of convergence. As a second main result, a quantitative central limit theorem for such SPDEs is derived, again, with optimal rate of convergence. The results apply, in particular, to the convergence in the mean… ▽ More The convergence of stochastic interacting particle systems in the mean-field limit to solutions of conservative stochastic partial differential equations is established, with optimal rate of convergence. As a second main result, a quantitative central limit theorem for such SPDEs is derived, again, with optimal rate of convergence. The results apply, in particular, to the convergence in the mean-field scaling of stochastic gradient descent dynamics in overparametrized, shallow neural networks to solutions of SPDEs. It is shown that the inclusion of fluctuations in the limiting SPDE improves the rate of convergence, and retains information about the fluctuations of stochastic gradient descent in the continuum limit. △ Less

Submitted 14 December, 2022; v1 submitted 12 July, 2022; originally announced July 2022.

Comments: 65 pages

MSC Class: 60H15; 60F05; 68T07; 60G46; 60G57

On Moments of Multiplicative Coalescents

Authors: Vitalii Konarovskyi, Vlada Limic

Abstract: We prove existence of all moments of the multiplicative coalescent at all times. We obtain as byproducts a number of related results which could be of general interest. In particular, we show the finiteness of the second moment of the $l^2$ norm for any extremal eternal version of multiplicative coalescent. Our techniques are in part inspired by percolation, and in part are based on tools from sto… ▽ More We prove existence of all moments of the multiplicative coalescent at all times. We obtain as byproducts a number of related results which could be of general interest. In particular, we show the finiteness of the second moment of the $l^2$ norm for any extremal eternal version of multiplicative coalescent. Our techniques are in part inspired by percolation, and in part are based on tools from stochastic analysis, notably the semi-martingale and the excursion theory. △ Less

Submitted 19 January, 2022; v1 submitted 26 August, 2021; originally announced August 2021.

Comments: 23 pages, 2 figures

MSC Class: 60J90; 05C80; 60J75; 60G51; 60K35

Spectral gap estimates for Brownian motion on domains with sticky-reflecting boundary diffusion

Authors: Vitalii Konarovskyi, Victor Marx, Max von Renesse

Abstract: Introducing an interpolation method we estimate the spectral gap for Brownian motion on general domains with sticky-reflecting boundary diffusion associated to the first nontrivial eigenvalue for the Laplace operator with corresponding Wentzell-type boundary condition. In the manifold case our proofs involve novel applications of the celebrated Reilly formula. Introducing an interpolation method we estimate the spectral gap for Brownian motion on general domains with sticky-reflecting boundary diffusion associated to the first nontrivial eigenvalue for the Laplace operator with corresponding Wentzell-type boundary condition. In the manifold case our proofs involve novel applications of the celebrated Reilly formula. △ Less

Submitted 31 May, 2021; originally announced June 2021.

MSC Class: Primary 26D10; 35A23; 34K08; Secondary 46E35; 53B25; 60J60; 47D07

On Number of Particles in Coalescing-Fragmentating Wasserstein Dynamics

Authors: Vitalii Konarovskyi

Abstract: We consider the system of sticky-reflected Brownian particles on the real line proposed in [arXiv:1711.03011]. The model is a modification of the Howitt-Warren flow but now the diffusion rate of particles is inversely proportional to the mass which they transfer. It is known that the system consists of a finite number of distinct particles for almost all times. In this paper, we show that the syst… ▽ More We consider the system of sticky-reflected Brownian particles on the real line proposed in [arXiv:1711.03011]. The model is a modification of the Howitt-Warren flow but now the diffusion rate of particles is inversely proportional to the mass which they transfer. It is known that the system consists of a finite number of distinct particles for almost all times. In this paper, we show that the system also admits an infinite number of distinct particles on a dense subset of the time interval if and only if the function responsible for the splitting of particles takes an infinite number of values. △ Less

Submitted 29 April, 2021; v1 submitted 22 February, 2021; originally announced February 2021.

MSC Class: 60K35; 60H05; 60H05; 60G44

On Conditioning Brownian Particles to Coalesce

Authors: Vitalii Konarovskyi, Victor Marx

Abstract: We introduce the notion of a conditional distribution to a zero-probability event in a given direction of approximation, and prove that the conditional distribution of a family of independent Brownian particles to the event that their paths coalesce after the meeting coincides with the law of a modified massive Arratia flow, defined in [arXiv:1408.0628]. We introduce the notion of a conditional distribution to a zero-probability event in a given direction of approximation, and prove that the conditional distribution of a family of independent Brownian particles to the event that their paths coalesce after the meeting coincides with the law of a modified massive Arratia flow, defined in [arXiv:1408.0628]. △ Less

Submitted 22 March, 2023; v1 submitted 6 August, 2020; originally announced August 2020.

Comments: 38 pages

MSC Class: Primary 60E05; 60J90; Secondary 60G15; 60G44; 60K35

Sticky-Reflected Stochastic Heat Equation Driven by Colored Noise

Authors: Vitalii Konarovskyi

Abstract: We prove the existence of a sticky-reflected solution to the heat equation on the spatial interval $[0,1]$ driven by colored noise. The process can be interpreted as an infinite-dimensional analog of the sticky-reflected Brownian motion on the real line, but now the solution obeys the usual stochastic heat equation except points where it reaches zero. At zero the solution has no noise and a drift… ▽ More We prove the existence of a sticky-reflected solution to the heat equation on the spatial interval $[0,1]$ driven by colored noise. The process can be interpreted as an infinite-dimensional analog of the sticky-reflected Brownian motion on the real line, but now the solution obeys the usual stochastic heat equation except points where it reaches zero. At zero the solution has no noise and a drift pushes it to stay positive. The proof is based on a new approach that can also be applied to other types of SPDEs with discontinuous coefficients. △ Less

Submitted 24 May, 2020; originally announced May 2020.

Comments: 37 pages

MSC Class: 60H15; 35R05; 35R60; 60G44

Stochastic Block Model in a new critical regime and the Interacting Multiplicative Coalescent

Authors: Vitalii Konarovskyi, Vlada Limic

Abstract: This work exhibits a novel phase transition for the classical stochastic block model (SBM). In addition we study the SBM in the corresponding near-critical regime, and find the scaling limit for the component sizes. The two-parameter stochastic process arising in the scaling limit, an analogue of the standard Aldous' multiplicative coalescent, is interesting in its own right. We name it the (stand… ▽ More This work exhibits a novel phase transition for the classical stochastic block model (SBM). In addition we study the SBM in the corresponding near-critical regime, and find the scaling limit for the component sizes. The two-parameter stochastic process arising in the scaling limit, an analogue of the standard Aldous' multiplicative coalescent, is interesting in its own right. We name it the (standard) Interacting Multiplicative Coalescent. To the best of our knowledge, this object has not yet appeared in the literature. △ Less

Submitted 30 August, 2021; v1 submitted 24 March, 2020; originally announced March 2020.

Comments: 23 pages, 4 figures

MSC Class: 60J75; 60K35; 60B12; 05C80

On Dean-Kawasaki Dynamics with Smooth Drift Potential

Authors: Vitalii Konarovskyi, Tobias Lehmann, Max von Renesse

Abstract: We consider the Dean-Kawasaki equation with smooth drift interaction potential and show that measure valued solutions exist only in certain parameter regimes in which case they are given by finite Langevin particle systems with mean field interaction. We consider the Dean-Kawasaki equation with smooth drift interaction potential and show that measure valued solutions exist only in certain parameter regimes in which case they are given by finite Langevin particle systems with mean field interaction. △ Less

Submitted 27 January, 2019; v1 submitted 28 December, 2018; originally announced December 2018.

Comments: 17 pages

MSC Class: 60H15; 60K35; 82C22; 60G57; 82C31

Journal ref: J. Stat. Phys. Volume 178, Number 3 (2020), 666-681

Dean-Kawasaki Dynamics: Ill-posedness vs. Triviality

Authors: Tobias Lehmann, Vitalii Konarovskyi, Max-K. von Renesse

Abstract: We prove that the Dean-Kawasaki SPDE admits a solution only in integer parameter regimes, in which case the solution is given in terms of non-interacting particles. We prove that the Dean-Kawasaki SPDE admits a solution only in integer parameter regimes, in which case the solution is given in terms of non-interacting particles. △ Less

Submitted 13 June, 2018; originally announced June 2018.

Coalescing-fragmentating Wasserstein dynamics: particle approach

Authors: Vitalii Konarovskyi

Abstract: We construct a family of semimartingales that describes the behavior of a particle system with sticky-reflecting interaction. The model is a physical improvement of the Howitt-Warren flow, an infinite system of diffusion particles on the real line that sticky-reflect from each other. But now particles have masses obeying the conservation law and the diffusion rate of each particle depends on its m… ▽ More We construct a family of semimartingales that describes the behavior of a particle system with sticky-reflecting interaction. The model is a physical improvement of the Howitt-Warren flow, an infinite system of diffusion particles on the real line that sticky-reflect from each other. But now particles have masses obeying the conservation law and the diffusion rate of each particle depends on its mass. The equation which describes the evolution of the particle system is a new type of equations in infinite-dimensional space and can be interpreted as an infinite-dimensional analog of the equation for sticky-reflected Brownian motion. The particle model appears as a particular solution to the corrected version of the Dean-Kawasaki equation. △ Less

Submitted 29 April, 2022; v1 submitted 8 November, 2017; originally announced November 2017.

Comments: 44 pages

MSC Class: 60K35; 60B12 (Primary); 60J60; 60G44; 82B21 (Secondary)

Reversible Coalescing-Fragmentating Wasserstein Dynamics on the Real Line

Authors: Vitalii Konarovskyi, Max von Renesse

Abstract: We introduce a family of reversible fragmentating-coagulating processes of particles of varying size-scaled diffusivity with strictly local interaction on the real line as mathematically rigorous description of colloidal motion of fluids. The associated measure-valued process provides a weak solution to a corrected Dean-Kawasaki equation for supercooled liquids without dissipation. Our constructio… ▽ More We introduce a family of reversible fragmentating-coagulating processes of particles of varying size-scaled diffusivity with strictly local interaction on the real line as mathematically rigorous description of colloidal motion of fluids. The associated measure-valued process provides a weak solution to a corrected Dean-Kawasaki equation for supercooled liquids without dissipation. Our construction is based on the introduction and analysis of a fundamentally new family of equilibrium measures for the associated dynamics and their Dirichlet forms. We identify the intrinsic metric as the quadratic Wasserstein distance, which makes the process a non-trivial example of Wasserstein diffusion. △ Less

Submitted 20 September, 2022; v1 submitted 8 September, 2017; originally announced September 2017.

Comments: 45 pages

MSC Class: Primary 60J46; 60H15; 82C22; Secondary 47D07; 60J60

On asymptotic behavior of the modified Arratia flow

Authors: Vitalii Konarovskyi

Abstract: We study asymptotic properties of the system of interacting diffusion particles on the real line which transfer a mass [arXiv:1408.0628]. The system is a natural generalization of the coalescing Brownian motions. The main difference is that diffusion particles coalesce summing their mass and changing their diffusion rate inversely proportional to the mass. First we construct the system in the case… ▽ More We study asymptotic properties of the system of interacting diffusion particles on the real line which transfer a mass [arXiv:1408.0628]. The system is a natural generalization of the coalescing Brownian motions. The main difference is that diffusion particles coalesce summing their mass and changing their diffusion rate inversely proportional to the mass. First we construct the system in the case where the initial mass distribution has the moment of the order greater then two as an $L_2$-valued martingale with a suitable quadratic variation. Then we find the relationship between the asymptotic behavior of the particles and local properties of the mass distribution at the initial time. △ Less

Submitted 20 February, 2017; v1 submitted 8 July, 2016; originally announced July 2016.

MSC Class: 82B21; 60K35 (Primary); 60D05 (Secondary)

Journal ref: Electronic Journal of Probability, Volume 22, no. 19, 31 pp (2017)

Modified Massive Arratia flow and Wasserstein diffusion

Authors: Vitalii Konarovskyi, Max von Renesse

Abstract: Extending previous work [arXiv:1408.0628] by the first author we present a variant of the Arratia flow, which consists of a collection of coalescing Brownian motions starting from every point of the unit interval. The important new feature of the model is that individual particles carry mass which aggregates upon coalescence and which scales the diffusivity of each particle in an inverse proportio… ▽ More Extending previous work [arXiv:1408.0628] by the first author we present a variant of the Arratia flow, which consists of a collection of coalescing Brownian motions starting from every point of the unit interval. The important new feature of the model is that individual particles carry mass which aggregates upon coalescence and which scales the diffusivity of each particle in an inverse proportional way. In this work we relate the induced measure valued process to the Wasserstein diffusion of [arXiv:0704.0704]. First, we present the process as a martingale solution to a SPDE similar to [arXiv:0704.0704]. Second, as our main result we show a Varadhan formula for short times which is governed by the quadratic Wasserstein distance. △ Less

Submitted 6 July, 2017; v1 submitted 2 April, 2015; originally announced April 2015.

Comments: 40 pages

MSC Class: 60K35; 60J60; 60F10 (Primary); 60H05; 60G44 (Secondary)

Journal ref: Communications on Pure and Applied Mathematics. Vol. 72 (2019), no. 4, 764-800

A system of coalescing heavy diffusion particles on the real line

Authors: Vitalii Konarovskyi

Abstract: We construct a modified Arratia flow with mass and energy conservation. We suppose that particles have a mass obeying the conservation law, and their diffusion is inversely proportional to the mass. Our main result asserts that such a system exists under the assumption of the uniform mass distribution on an interval at the starting moment. We introduce a stochastic integral with respect to such a… ▽ More We construct a modified Arratia flow with mass and energy conservation. We suppose that particles have a mass obeying the conservation law, and their diffusion is inversely proportional to the mass. Our main result asserts that such a system exists under the assumption of the uniform mass distribution on an interval at the starting moment. We introduce a stochastic integral with respect to such a flow and obtain the total local time as the density of the occupation measure for all particles. △ Less

Submitted 25 July, 2016; v1 submitted 4 August, 2014; originally announced August 2014.

Comments: 47 pages

MSC Class: Primary 60K35; 82B21; secondary 60H05; 60J55

Journal ref: Ann. Probab. Volume 45, Number 5 (2017), 3293-3335