-
EE3P: Event-based Estimation of Periodic Phenomena Properties
Authors:
Jakub Kolář,
Radim Špetlík,
Jiří Matas
Abstract:
We introduce a novel method for measuring properties of periodic phenomena with an event camera, a device asynchronously reporting brightness changes at independently operating pixels. The approach assumes that for fast periodic phenomena, in any spatial window where it occurs, a very similar set of events is generated at the time difference corresponding to the frequency of the motion. To estimat…
▽ More
We introduce a novel method for measuring properties of periodic phenomena with an event camera, a device asynchronously reporting brightness changes at independently operating pixels. The approach assumes that for fast periodic phenomena, in any spatial window where it occurs, a very similar set of events is generated at the time difference corresponding to the frequency of the motion. To estimate the frequency, we compute correlations of spatio-temporal windows in the event space. The period is calculated from the time differences between the peaks of the correlation responses. The method is contactless, eliminating the need for markers, and does not need distinguishable landmarks. We evaluate the proposed method on three instances of periodic phenomena: (i) light flashes, (ii) vibration, and (iii) rotational speed. In all experiments, our method achieves a relative error lower than 0.04%, which is within the error margin of ground truth measurements.
△ Less
Submitted 22 February, 2024;
originally announced February 2024.
-
Betweenness isomorphism classes of circles with finitely many points inside
Authors:
Martin Doležal,
Jan Kolář,
Janusz Morawiec
Abstract:
We give a necessary and sufficient condition for two circles, each with finitely many points added inside, to be betweenness isomorphic. We fully characterize the betweenness isomorphism classes in the family consisting of all circles with three collinear points inside.
We give a necessary and sufficient condition for two circles, each with finitely many points added inside, to be betweenness isomorphic. We fully characterize the betweenness isomorphism classes in the family consisting of all circles with three collinear points inside.
△ Less
Submitted 9 January, 2024; v1 submitted 9 October, 2023;
originally announced October 2023.
-
Science with a small two-band UV-photometry mission II: Observations of stars and stellar systems
Authors:
J. Krtička,
J. Benáček,
J. Budaj,
D. Korčáková,
A. Pál,
M. Piecka,
M. Zejda,
V. Bakış,
M. Brož,
Hsiang-Kuang Chang,
N. Faltová,
R. Gális,
D. Jadlovský,
J. Janík,
J. Kára,
J. Kolář,
I. Krtičková,
J. Kubát,
B. Kubátová,
P. Kurfürst,
M. Labaj,
J. Merc,
Z. Mikulášek,
F. Münz,
E. Paunzen
, et al. (10 additional authors not shown)
Abstract:
We outline the impact of a small two-band UV-photometry satellite mission on the field of stellar physics, magnetospheres of stars, binaries, stellar clusters, interstellar matter, and exoplanets. On specific examples of different types of stars and stellar systems, we discuss particular requirements for such satellite missions in terms of specific mission parameters such as bandpass, precision, c…
▽ More
We outline the impact of a small two-band UV-photometry satellite mission on the field of stellar physics, magnetospheres of stars, binaries, stellar clusters, interstellar matter, and exoplanets. On specific examples of different types of stars and stellar systems, we discuss particular requirements for such satellite missions in terms of specific mission parameters such as bandpass, precision, cadence, and mission duration. We show that such a mission may provide crucial data not only for hot stars that emit most of their light in UV, but also for cool stars, where UV traces their activity. This is important, for instance, for exoplanetary studies, because the level of stellar activity influences habitability. While the main asset of the two-band UV mission rests in time-domain astronomy, an example of open clusters proves that such a mission would be important also for the study of stellar populations. Properties of the interstellar dust are best explored when combining optical and IR information with observations in UV. It is well known that dust absorbs UV radiation efficiently. Consequently, we outline how such a UV mission can be used to detect eclipses of sufficiently hot stars by various dusty objects and study disks, rings, clouds, disintegrating exoplanets or exoasteroids. Furthermore, UV radiation can be used to study the cooling of neutron stars providing information about the extreme states of matter in the interiors of neutron stars and used for map** heated spots on their surfaces.
△ Less
Submitted 21 February, 2024; v1 submitted 26 June, 2023;
originally announced June 2023.
-
SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision
Authors:
Xubo Liu,
Egor Lakomkin,
Konstantinos Vougioukas,
**chuan Ma,
Honglie Chen,
Ruiming Xie,
Morrie Doulaty,
Niko Moritz,
Jáchym Kolář,
Stavros Petridis,
Maja Pantic,
Christian Fuegen
Abstract:
Recently reported state-of-the-art results in visual speech recognition (VSR) often rely on increasingly large amounts of video data, while the publicly available transcribed video datasets are limited in size. In this paper, for the first time, we study the potential of leveraging synthetic visual data for VSR. Our method, termed SynthVSR, substantially improves the performance of VSR systems wit…
▽ More
Recently reported state-of-the-art results in visual speech recognition (VSR) often rely on increasingly large amounts of video data, while the publicly available transcribed video datasets are limited in size. In this paper, for the first time, we study the potential of leveraging synthetic visual data for VSR. Our method, termed SynthVSR, substantially improves the performance of VSR systems with synthetic lip movements. The key idea behind SynthVSR is to leverage a speech-driven lip animation model that generates lip movements conditioned on the input speech. The speech-driven lip animation model is trained on an unlabeled audio-visual dataset and could be further optimized towards a pre-trained VSR model when labeled videos are available. As plenty of transcribed acoustic data and face images are available, we are able to generate large-scale synthetic data using the proposed lip animation model for semi-supervised VSR training. We evaluate the performance of our approach on the largest public VSR benchmark - Lip Reading Sentences 3 (LRS3). SynthVSR achieves a WER of 43.3% with only 30 hours of real labeled data, outperforming off-the-shelf approaches using thousands of hours of video. The WER is further reduced to 27.9% when using all 438 hours of labeled data from LRS3, which is on par with the state-of-the-art self-supervised AV-HuBERT method. Furthermore, when combined with large-scale pseudo-labeled audio-visual data SynthVSR yields a new state-of-the-art VSR WER of 16.9% using publicly available data only, surpassing the recent state-of-the-art approaches trained with 29 times more non-public machine-transcribed video data (90,000 hours). Finally, we perform extensive ablation studies to understand the effect of each component in our proposed method.
△ Less
Submitted 3 April, 2023; v1 submitted 30 March, 2023;
originally announced March 2023.
-
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Authors:
Kristen Grauman,
Andrew Westbury,
Eugene Byrne,
Zachary Chavis,
Antonino Furnari,
Rohit Girdhar,
Jackson Hamburger,
Hao Jiang,
Miao Liu,
Xingyu Liu,
Miguel Martin,
Tushar Nagarajan,
Ilija Radosavovic,
Santhosh Kumar Ramakrishnan,
Fiona Ryan,
Jayant Sharma,
Michael Wray,
Mengmeng Xu,
Eric Zhongcong Xu,
Chen Zhao,
Siddhant Bansal,
Dhruv Batra,
Vincent Cartillier,
Sean Crane,
Tien Do
, et al. (60 additional authors not shown)
Abstract:
We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household, outdoor, workplace, leisure, etc.) captured by 931 unique camera wearers from 74 worldwide locations and 9 different countries. The approach to collection is designed to uphold rigorous privacy and ethics standards with cons…
▽ More
We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household, outdoor, workplace, leisure, etc.) captured by 931 unique camera wearers from 74 worldwide locations and 9 different countries. The approach to collection is designed to uphold rigorous privacy and ethics standards with consenting participants and robust de-identification procedures where relevant. Ego4D dramatically expands the volume of diverse egocentric video footage publicly available to the research community. Portions of the video are accompanied by audio, 3D meshes of the environment, eye gaze, stereo, and/or synchronized videos from multiple egocentric cameras at the same event. Furthermore, we present a host of new benchmark challenges centered around understanding the first-person visual experience in the past (querying an episodic memory), present (analyzing hand-object manipulation, audio-visual conversation, and social interactions), and future (forecasting activities). By publicly sharing this massive annotated dataset and benchmark suite, we aim to push the frontier of first-person perception. Project page: https://ego4d-data.org/
△ Less
Submitted 11 March, 2022; v1 submitted 13 October, 2021;
originally announced October 2021.
-
Towards Key Performance Indicators of Research Infrastructures
Authors:
Jana Kolar,
Marjan Cugmas,
Anuška Ferligoj
Abstract:
In 2018, the European Strategic Forum for research infrastructures (ESFRI) was tasked by the Competitiveness Council, a configuration of the Council of the EU, to develop a common approach for monitoring of Research Infrastructures' performance. To this end, ESFRI established a working group, which has proposed 21 Key Performance Indicators (KPIs) to monitor the progress of the Research Infrastruc…
▽ More
In 2018, the European Strategic Forum for research infrastructures (ESFRI) was tasked by the Competitiveness Council, a configuration of the Council of the EU, to develop a common approach for monitoring of Research Infrastructures' performance. To this end, ESFRI established a working group, which has proposed 21 Key Performance Indicators (KPIs) to monitor the progress of the Research Infrastructures (RIs) addressed towards their objectives. The RIs were then asked to assess their relevance for their institution. The paper aims to identify the relevance of certain indicators for particular groups of RIs by using cluster and discriminant analysis. This could contribute to development of a monitoring system, tailored to particular RIs.
To obtain a typology of the RIs, we first performed cluster analysis of the RIs according to their properties, which revealed clusters of RIs with similar characteristics, based on to the domain of operation, such as food, environment or engineering. Then, discriminant analysis was used to study how the relevance of the KPIs differs among the obtained clusters. This analysis revealed that the percentage of RIs correctly classified into five clusters, using the KPIs, is 80%. Such a high percentage indicates that there are significant differences in the relevance of certain indicators, depending on the ESFRI domain of the RI. The indicators therefore need to be adapted to the type of infrastructure. It is therefore proposed that the Strategic Working Groups of ESFRI addressing specific domains should be involved in the tailored development of the monitoring of pan-European RIs.
△ Less
Submitted 1 October, 2019;
originally announced October 2019.
-
A Turán-type theorem for large-distance graphs in Euclidean spaces, and related isodiametric problems
Authors:
Martin Doležal,
Jan Hladký,
Jan Kolář,
Themis Mitsis,
Christos Pelekis,
Václav Vlasák
Abstract:
Given a measurable set $A\subset \mathbb R^d$ we consider the "large-distance graph" $\mathcal{G}_A$, on the ground set $A$, in which each pair of points from $A$ whose distance is bigger than 2 forms an edge. We consider the problems of maximizing the $2d$-dimensional Lebesgue measure of the edge set as well as the $d$-dimensional Lebesgue measure of the vertex set of a large-distance graph in th…
▽ More
Given a measurable set $A\subset \mathbb R^d$ we consider the "large-distance graph" $\mathcal{G}_A$, on the ground set $A$, in which each pair of points from $A$ whose distance is bigger than 2 forms an edge. We consider the problems of maximizing the $2d$-dimensional Lebesgue measure of the edge set as well as the $d$-dimensional Lebesgue measure of the vertex set of a large-distance graph in the $d$-dimensional Euclidean space that contains no copies of a complete graph on $k$ vertices. The former problem may be seen as a continuous analogue of Turán's classical graph theorem, and the latter as a graph-theoretic analogue of the classical isodiametric problem. Our main result yields an analogue of Mantel's theorem for large-distance graphs. Our approach employs an isodiametric inequality in an annulus, which might be of independent interest.
△ Less
Submitted 8 January, 2020; v1 submitted 16 April, 2019;
originally announced April 2019.
-
Extensions of vector-valued functions with preservation of derivatives
Authors:
Martin Koc,
Jan Kolář
Abstract:
Let $X$ and $Y$ be Banach or normed linear spaces and $F\subset X$ a closed set. We apply our recent extension theorem for vector-valued Baire one functions arXiv:1512.03717 to obtain an extension theorem for vector-valued functions $f\colon F\to Y$ with pre-assigned derivatives, with preservation of differentiability (at every point where the pre-assigned derivative is actually a derivative), pre…
▽ More
Let $X$ and $Y$ be Banach or normed linear spaces and $F\subset X$ a closed set. We apply our recent extension theorem for vector-valued Baire one functions arXiv:1512.03717 to obtain an extension theorem for vector-valued functions $f\colon F\to Y$ with pre-assigned derivatives, with preservation of differentiability (at every point where the pre-assigned derivative is actually a derivative), preservation of continuity, preservation of (pointwise) Lipschitz property and (for finite dimensional domain $X$) preservation of strict differentiability and global (eventually local) Lipschitz continuity.
△ Less
Submitted 20 September, 2016; v1 submitted 18 February, 2016;
originally announced February 2016.
-
Extensions of vector-valued Baire one functions with preservation of points of continuity
Authors:
Jan Kolář,
Martin Koc
Abstract:
We prove an extension theorem (with non-tangential limits) for vector-valued Baire one functions. Moreover, at every point where the function is continuous (or bounded), the continuity (or boundedness) is preserved. More precisely: Let $H$ be a closed subset of a metric space $X$ and let $Z$ be a normed vector space. Let $f: H\to Z$ be a Baire one function. We show that there is a continuous funct…
▽ More
We prove an extension theorem (with non-tangential limits) for vector-valued Baire one functions. Moreover, at every point where the function is continuous (or bounded), the continuity (or boundedness) is preserved. More precisely: Let $H$ be a closed subset of a metric space $X$ and let $Z$ be a normed vector space. Let $f: H\to Z$ be a Baire one function. We show that there is a continuous function $g: (X\setminus H) \to Z$ such that, for every $a\in \partial H$, the non-tangential limit of $g$ at a equals $f(a)$ and, moreover, if $f$ is continuous at $a\in H$ (respectively bounded in a neighborhood of $a\in H$) then the extension $F=f\cup g$ is continuous at $a$ (respectively bounded in a neighborhood of $a$).
We also prove a result on pointwise approximation of vector-valued Baire one functions by a sequence of locally Lipschitz functions that converges "uniformly" (or, "continuously") at points where the approximated function is continuous.
In an accompanying paper (Extensions of vector-valued functions with preservation of derivatives), the main result is applied to extensions of vector-valued functions defined on a closed subset of Euclidean or Banach space with preservation of differentiability, continuity and (pointwise) Lipschitz property.
△ Less
Submitted 3 December, 2015;
originally announced December 2015.
-
Silver environment and covalent network rearrangement in GeS3-Ag glasses
Authors:
László Rátkai,
Ivan Kaban,
Tomáš Wágner,
Jakub Kolář,
Silviya Valková,
Iva Voleská,
Brigitte Beuneu,
Pál Jóvári
Abstract:
The structure of Ag-doped GeS3 glasses (0, 15, 20, 25 at.% Ag) was investigated by diffraction techniques and extended x-ray absorption fine structure measurements. Structural models were obtained by fitting the experimental datasets simultaneously by the reverse Monte Carlo simulation technique. It is observed that Ge has mostly S neighbours in GeS3, but Ge-Ge bonds appear already at 15% Ag conte…
▽ More
The structure of Ag-doped GeS3 glasses (0, 15, 20, 25 at.% Ag) was investigated by diffraction techniques and extended x-ray absorption fine structure measurements. Structural models were obtained by fitting the experimental datasets simultaneously by the reverse Monte Carlo simulation technique. It is observed that Ge has mostly S neighbours in GeS3, but Ge-Ge bonds appear already at 15% Ag content. Sulfur has ~2 S/Ge neighbours over the whole concentration range, while the S-Ag coordination number increases with increasing Ag content. Ag-Ag pairs can already be found at 15% Ag. The Ag-S mean coordination number changes from 2.17 +/- 0.2 to 2.86 +/- 0.2 between 15% and 25% Ag content. Unlike the As-S network in AsS2-25Ag glass, the Ge-S network is not fragmented upon Ag-do** of GeS3 glass.
△ Less
Submitted 2 August, 2014;
originally announced August 2014.
-
Non-unique conical and non-conical tangents to rectifiable stationary varifolds in R^4
Authors:
Jan Kolář
Abstract:
We construct a rectifiable stationary 2-varifold in R^4 with non-conical, and hence non-unique, tangent varifold at a point. This answers a question of L. Simon (Lectures on geometric measure theory, 1983, p. 243) and provides a new example for a related question of W.K. Allard (On the first variation of a varifold, Ann. of Math., 1972, p. 460).
There is also a (rectifiable) stationary 2-varifol…
▽ More
We construct a rectifiable stationary 2-varifold in R^4 with non-conical, and hence non-unique, tangent varifold at a point. This answers a question of L. Simon (Lectures on geometric measure theory, 1983, p. 243) and provides a new example for a related question of W.K. Allard (On the first variation of a varifold, Ann. of Math., 1972, p. 460).
There is also a (rectifiable) stationary 2-varifold in R^4 that has more than one conical tangent varifold at a point.
keywords: stationary varifold, varifold tangent, tangent cone, non-unique, non-conical, minimal surface, regularity
△ Less
Submitted 15 May, 2014; v1 submitted 15 March, 2013;
originally announced March 2013.
