Showing 1–35 of 35 results for author: Steinberger, M

Taming 3DGS: High-Quality Radiance Fields with Limited Resources

Authors: Saswat Subhajyoti Mallick, Rahul Goel, Bernhard Kerbl, Francisco Vicente Carrasco, Markus Steinberger, Fernando De La Torre

Abstract: 3D Gaussian Splatting (3DGS) has transformed novel-view synthesis with its fast, interpretable, and high-fidelity rendering. However, its resource requirements limit its usability. Especially on constrained devices, training performance degrades quickly and often cannot complete due to excessive memory consumption of the model. The method converges with an indefinite number of Gaussians -- many of… ▽ More 3D Gaussian Splatting (3DGS) has transformed novel-view synthesis with its fast, interpretable, and high-fidelity rendering. However, its resource requirements limit its usability. Especially on constrained devices, training performance degrades quickly and often cannot complete due to excessive memory consumption of the model. The method converges with an indefinite number of Gaussians -- many of them redundant -- making rendering unnecessarily slow and preventing its usage in downstream tasks that expect fixed-size inputs. To address these issues, we tackle the challenges of training and rendering 3DGS models on a budget. We use a guided, purely constructive densification process that steers densification toward Gaussians that raise the reconstruction quality. Model size continuously increases in a controlled manner towards an exact budget, using score-based densification of Gaussians with training-time priors that measure their contribution. We further address training speed obstacles: following a careful analysis of 3DGS' original pipeline, we derive faster, numerically equivalent solutions for gradient computation and attribute updates, including an alternative parallelization for efficient backpropagation. We also propose quality-preserving approximations where suitable to reduce training time even further. Taken together, these enhancements yield a robust, scalable solution with reduced training times, lower compute and memory requirements, and high quality. Our evaluation shows that in a budgeted setting, we obtain competitive quality metrics with 3DGS while achieving a 4--5x reduction in both model size and training time. With more generous budgets, our measured quality surpasses theirs. These advances open the door for novel-view synthesis in constrained environments, e.g., mobile devices. △ Less

Submitted 21 June, 2024; originally announced June 2024.

HIP 41378 observed by CHEOPS: Where is planet d?

Authors: S. Sulis, L. Borsato, S. Grouffal, H. P. Osborn, A. Santerne, A. Brandeker, M. N. Günther, A. Heitzmann, M. Lendl, M. Fridlund, D. Gandolfi, Y. Alibert, R. Alonso, T. Bárczy, D. Barrado Navascues, S. C. Barros, W. Baumjohann, T. Beck, W. Benz, M. Bergomi, N. Billot, A. Bonfanti, C. Broeg, A. Collier Cameron, C. Corral van Damme , et al. (62 additional authors not shown)

Abstract: HIP 41378 d is a long-period planet that has only been observed to transit twice, three years apart, with K2. According to stability considerations and a partial detection of the Rossiter-McLaughlin effect, $P_\mathrm{d} = 278.36$ d has been determined to be the most likely orbital period. We targeted HIP 41378 d with CHEOPS at the predicted transit timing based on $P_\mathrm{d}= 278.36$ d, but th… ▽ More HIP 41378 d is a long-period planet that has only been observed to transit twice, three years apart, with K2. According to stability considerations and a partial detection of the Rossiter-McLaughlin effect, $P_\mathrm{d} = 278.36$ d has been determined to be the most likely orbital period. We targeted HIP 41378 d with CHEOPS at the predicted transit timing based on $P_\mathrm{d}= 278.36$ d, but the observations show no transit. We find that large ($>22.4$ hours) transit timing variations (TTVs) could explain this non-detection during the CHEOPS observation window. We also investigated the possibility of an incorrect orbital solution, which would have major implications for our knowledge of this system. If $P_\mathrm{d} \neq 278.36$ d, the periods that minimize the eccentricity would be $101.22$ d and $371.14$ d. The shortest orbital period will be tested by TESS, which will observe HIP 41378 in Sector 88 starting in January 2025. Our study shows the importance of a mission like CHEOPS, which today is the only mission able to make long observations (i.e., from space) to track the ephemeris of long-period planets possibly affected by large TTVs. △ Less

Submitted 30 May, 2024; originally announced May 2024.

Comments: Accepted for publication in Astronomy and Astrophysics

Journal ref: A&A 686, L18 (2024)

StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Rendering

Authors: Lukas Radl, Michael Steiner, Mathias Parger, Alexander Weinrauch, Bernhard Kerbl, Markus Steinberger

Abstract: Gaussian Splatting has emerged as a prominent model for constructing 3D representations from images across diverse domains. However, the efficiency of the 3D Gaussian Splatting rendering pipeline relies on several simplifications. Notably, reducing Gaussian to 2D splats with a single view-space depth introduces pop** and blending artifacts during view rotation. Addressing this issue requires acc… ▽ More Gaussian Splatting has emerged as a prominent model for constructing 3D representations from images across diverse domains. However, the efficiency of the 3D Gaussian Splatting rendering pipeline relies on several simplifications. Notably, reducing Gaussian to 2D splats with a single view-space depth introduces pop** and blending artifacts during view rotation. Addressing this issue requires accurate per-pixel depth computation, yet a full per-pixel sort proves excessively costly compared to a global sort operation. In this paper, we present a novel hierarchical rasterization approach that systematically resorts and culls splats with minimal processing overhead. Our software rasterizer effectively eliminates pop** artifacts and view inconsistencies, as demonstrated through both quantitative and qualitative measurements. Simultaneously, our method mitigates the potential for cheating view-dependent effects with pop**, ensuring a more authentic representation. Despite the elimination of cheating, our approach achieves comparable quantitative results for test images, while increasing the consistency for novel view synthesis in motion. Due to its design, our hierarchical approach is only 4% slower on average than the original Gaussian Splatting. Notably, enforcing consistency enables a reduction in the number of Gaussians by approximately half with nearly identical quality and view-consistency. Consequently, rendering performance is nearly doubled, making our approach 1.6x faster than the original Gaussian Splatting, with a 50% reduction in memory requirements. △ Less

Submitted 24 May, 2024; v1 submitted 1 February, 2024; originally announced February 2024.

Comments: SIGGRAPH 2024 (Journal Track); Project Page: https://r4dl.github.io/StopThePop/

All Inkjet-printed Organic Solar Cells on 3D Objects

Authors: Marc Steinberger, Andreas Distler, Johannes Hörber, Kai Cheong Tam, Christoph J. Brabec, Hans-Joachim Egelhaaf

Abstract: Drop-on-demand inkjet printing is a promising and commercially relevant technology for producing organic electronic devices of arbitrary shape on a wide variety of different substrates. In this work we transfer the inkjet printing process of organic photovoltaic devices from 2D to 3D substrates, using a 5-axis robot system equipped with a multi nozzle inkjet printing unit. We present a ready-to-us… ▽ More Drop-on-demand inkjet printing is a promising and commercially relevant technology for producing organic electronic devices of arbitrary shape on a wide variety of different substrates. In this work we transfer the inkjet printing process of organic photovoltaic devices from 2D to 3D substrates, using a 5-axis robot system equipped with a multi nozzle inkjet printing unit. We present a ready-to-use 3D printing system for industrial application, using a 5-axis motion system controlled by commercial 3D motion software, combined with a commonly used multi-nozzle inkjet print head controlled by the corresponding printing software. The very first time inkjet-printed solar cells on glass/ITO with power conversion efficiencies (PCE) of up to 7% are realized on a 3D object with surfaces tilted by angles of up to 60° against the horizontal direction. Undesired ink flow during deposition of the inkjet-printed layers was avoided by proper ink formulation. In order to be able to print organic (opto-)electronic devices also on substrates without sputtered indium tin oxide bottom electrode, the bottom electrode was inkjet-printed from silver nanoparticle (AgNP) ink, resulting in the first all inkjet-printed (i.e., including bottom electrode) solar cell on a 3D object ever with a record PCE of 2.5%. This work paves the way for functionalizing even complex objects, such as cars, mobile phones, or Internet of Things (IoT) applications with inkjet-printed (opto-)electronic devices. △ Less

Submitted 22 January, 2024; originally announced January 2024.

Comments: Preprint of manuscript in review process

LAENeRF: Local Appearance Editing for Neural Radiance Fields

Authors: Lukas Radl, Michael Steiner, Andreas Kurz, Markus Steinberger

Abstract: Due to the omnipresence of Neural Radiance Fields (NeRFs), the interest towards editable implicit 3D representations has surged over the last years. However, editing implicit or hybrid representations as used for NeRFs is difficult due to the entanglement of appearance and geometry encoded in the model parameters. Despite these challenges, recent research has shown first promising steps towards ph… ▽ More Due to the omnipresence of Neural Radiance Fields (NeRFs), the interest towards editable implicit 3D representations has surged over the last years. However, editing implicit or hybrid representations as used for NeRFs is difficult due to the entanglement of appearance and geometry encoded in the model parameters. Despite these challenges, recent research has shown first promising steps towards photorealistic and non-photorealistic appearance edits. The main open issues of related work include limited interactivity, a lack of support for local edits and large memory requirements, rendering them less useful in practice. We address these limitations with LAENeRF, a unified framework for photorealistic and non-photorealistic appearance editing of NeRFs. To tackle local editing, we leverage a voxel grid as starting point for region selection. We learn a map** from expected ray terminations to final output color, which can optionally be supervised by a style loss, resulting in a framework which can perform photorealistic and non-photorealistic appearance editing of selected regions. Relying on a single point per ray for our map**, we limit memory requirements and enable fast optimization. To guarantee interactivity, we compose the output color using a set of learned, modifiable base colors, composed with additive layer mixing. Compared to concurrent work, LAENeRF enables recoloring and stylization while kee** processing time low. Furthermore, we demonstrate that our approach surpasses baseline methods both quantitatively and qualitatively. △ Less

Submitted 25 March, 2024; v1 submitted 15 December, 2023; originally announced December 2023.

Comments: Accepted to CVPR 2024! Project website: https://r4dl.github.io/LAENeRF/

Characterising TOI-732 b and c: New insights into the M-dwarf radius and density valley

Authors: A. Bonfanti, M. Brady, T. G. Wilson, J. Venturini, J. A. Egger, A. Brandeker, S. G. Sousa, M. Lendl, A. E. Simon, D. Queloz, G. Olofsson, V. Adibekyan, Y. Alibert, L. Fossati, M. J. Hooton, D. Kubyshkina, R. Luque, F. Murgas, A. J. Mustill, N. C. Santos, V. Van Grootel, R. Alonso, J. Asquier, T. Bandy, T. Bárczy , et al. (66 additional authors not shown)

Abstract: TOI-732 is an M dwarf hosting two transiting planets that are located on the two opposite sides of the radius valley. By doubling the number of available space-based observations and increasing the number of radial velocity (RV) measurements, we aim at refining the parameters of TOI-732 b and c. We also use the results to study the slope of the radius valley and the density valley for a well-chara… ▽ More TOI-732 is an M dwarf hosting two transiting planets that are located on the two opposite sides of the radius valley. By doubling the number of available space-based observations and increasing the number of radial velocity (RV) measurements, we aim at refining the parameters of TOI-732 b and c. We also use the results to study the slope of the radius valley and the density valley for a well-characterised sample of M-dwarf exoplanets. We performed a global MCMC analysis by jointly modelling ground-based light curves and CHEOPS and TESS observations, along with RV time series both taken from the literature and obtained with the MAROON-X spectrograph. The slopes of the M-dwarf valleys were quantified via a Support Vector Machine (SVM) procedure. TOI-732 b is an ultrashort-period planet ($P\sim0.77$ d) with a radius $R_b=1.325_{-0.058}^{+0.057}$ $R_{\oplus}$ and a mass $M_b=2.46\pm0.19$ $M_{\oplus}$ (mean density $ρ_b=5.8_{-0.8}^{+1.0}$ g cm$^{-3}$), while the outer planet at $P\sim12.25$ d has $R_c=2.39_{-0.11}^{+0.10}$ $R_{\oplus}$, $M_c=8.04_{-0.48}^{+0.50}$ $M_{\oplus}$, and thus $ρ_c=3.24_{-0.43}^{+0.55}$ g cm$^{-3}$. Also taking into account our interior structure calculations, TOI-732 b is a super-Earth and TOI-732 c is a mini-Neptune. Following the SVM approach, we quantified $\mathrm{d}\log{R_{p,{\mathrm{valley}}}}/\mathrm{d}\log{P}=-0.065_{-0.013}^{+0.024}$, which is flatter than for Sun-like stars. In line with former analyses, we note that the radius valley for M-dwarf planets is more densely populated, and we further quantify the slope of the density valley as $\mathrm{d}\log{\hatρ_{\mathrm{valley}}}/\mathrm{d}\log{P}=-0.02_{-0.04}^{+0.12}$. Compared to FGK stars, the weaker dependence of the position of the radius valley on the orbital period might indicate that the formation shapes the radius valley around M dwarfs more strongly than the evolution mechanisms. △ Less

Submitted 30 November, 2023; v1 submitted 21 November, 2023; originally announced November 2023.

Comments: 28 pages (17 in the main text), 18 figures (9 in the main text), 11 tables (7 in the main text). Accepted for publication in A&A

CHEOPS observations of KELT-20 b/MASCARA-2 b: An aligned orbit and signs of variability from a reflective dayside

Authors: V. Singh, G. Scandariato, A. M. S. Smith, P. E. Cubillos, M. Lendl, N. Billot, A. Fortier, D. Queloz, S. G. Sousa, Sz. Csizmadia, A. Brandeker, L. Carone, T. G. Wilson, B. Akinsanmi, J. A. Patel, A. Krenn, O. D. S. Demangeon, G. Bruno, I. Pagano, M. J. Hooton, J. Cabrera, N. C. Santos, Y. Alibert, R. Alonso, J. Asquier , et al. (65 additional authors not shown)

Abstract: Occultations are windows of opportunity to indirectly peek into the dayside atmosphere of exoplanets. High-precision transit events provide information on the spin-orbit alignment of exoplanets around fast-rotating hosts. We aim to precisely measure the planetary radius and geometric albedo of the ultra-hot Jupiter (UHJ) KELT-20 b as well as the system's spin-orbit alignment. We obtained optical h… ▽ More Occultations are windows of opportunity to indirectly peek into the dayside atmosphere of exoplanets. High-precision transit events provide information on the spin-orbit alignment of exoplanets around fast-rotating hosts. We aim to precisely measure the planetary radius and geometric albedo of the ultra-hot Jupiter (UHJ) KELT-20 b as well as the system's spin-orbit alignment. We obtained optical high-precision transits and occultations of KELT-20 b using CHEOPS observations in conjunction with the simultaneous TESS observations. We interpreted the occultation measurements together with archival infrared observations to measure the planetary geometric albedo and dayside temperatures. We further used the host star's gravity-darkened nature to measure the system's obliquity. We present a time-averaged precise occultation depth of 82(6) ppm measured with seven CHEOPS visits and 131(+8/-7) ppm from the analysis of all available TESS photometry. Using these measurements, we precisely constrain the geometric albedo of KELT-20 b to 0.26(0.04) and the brightness temperature of the dayside hemisphere to 2566(+77/-80) K. Assuming Lambertian scattering law, we constrain the Bond albedo to 0.36(+0.04/-0.05) along with a minimal heat transfer to the night side. Furthermore, using five transit observations we provide stricter constraints of 3.9(1.1) degrees on the sky-projected obliquity of the system. The aligned orbit of KELT-20 b is in contrast to previous CHEOPS studies that have found strongly inclined orbits for planets orbiting other A-type stars. The comparably high planetary geometric albedo of KELT-20 b corroborates a known trend of strongly irradiated planets being more reflective. Finally, we tentatively detect signs of temporal variability in the occultation depths, which might indicate variable cloud cover advecting onto the planetary day side. △ Less

Submitted 29 November, 2023; v1 submitted 6 November, 2023; originally announced November 2023.

Comments: 27 pages, 15 figures, Accepted for publication in Astronomy & Astrophysics

Stochastic Model Predictive Control for Networked Systems with Random Delays and Packet Losses in All Channels

Authors: Marijan Palmisano, Martin Steinberger, Martin Horn

Abstract: A stochastic Model Predictive Control strategy for control systems with communication networks between the sensor node and the controller and between the controller and the actuator node is proposed. Data packets are subject to random delays and packet loss is possible; acknowledgments for received packets are not provided. The expected value of a quadratic cost is minimized subject to linear cons… ▽ More A stochastic Model Predictive Control strategy for control systems with communication networks between the sensor node and the controller and between the controller and the actuator node is proposed. Data packets are subject to random delays and packet loss is possible; acknowledgments for received packets are not provided. The expected value of a quadratic cost is minimized subject to linear constraints; the set of all initial states for which the resulting optimization problem is guaranteed to be feasible is provided. The state vector of the controlled plant is shown to converge to zero with probability one. △ Less

Submitted 4 September, 2023; originally announced September 2023.

Analyzing the Internals of Neural Radiance Fields

Authors: Lukas Radl, Andreas Kurz, Michael Steiner, Markus Steinberger

Abstract: Modern Neural Radiance Fields (NeRFs) learn a map** from position to volumetric density leveraging proposal network samplers. In contrast to the coarse-to-fine sampling approach with two NeRFs, this offers significant potential for acceleration using lower network capacity. Given that NeRFs utilize most of their network capacity to estimate radiance, they could store valuable density information… ▽ More Modern Neural Radiance Fields (NeRFs) learn a map** from position to volumetric density leveraging proposal network samplers. In contrast to the coarse-to-fine sampling approach with two NeRFs, this offers significant potential for acceleration using lower network capacity. Given that NeRFs utilize most of their network capacity to estimate radiance, they could store valuable density information in their parameters or their deep features. To investigate this proposition, we take one step back and analyze large, trained ReLU-MLPs used in coarse-to-fine sampling. Building on our novel activation visualization method, we find that trained NeRFs, Mip-NeRFs and proposal network samplers map samples with high density to local minima along a ray in activation feature space. We show how these large MLPs can be accelerated by transforming intermediate activations to a weight estimate, without any modifications to the training protocol or the network architecture. With our approach, we can reduce the computational requirements of trained NeRFs by up to 50% with only a slight hit in rendering quality. Extensive experimental evaluation on a variety of datasets and architectures demonstrates the effectiveness of our approach. Consequently, our methodology provides valuable insight into the inner workings of NeRFs. △ Less

Submitted 11 April, 2024; v1 submitted 1 June, 2023; originally announced June 2023.

Comments: Accepted to CVPRW'24! Project Page: https://r4dl.github.io/nerfinternals/

Switched Lyapunov Function based Controller Synthesis for Networked Control Systems: A Computationally Inexpensive Approach

Authors: Katarina Stanojevic, Martin Steinberger, Martin Horn

Abstract: This paper presents a Lyapunov function based control strategy for networked control systems (NCS) affected by variable time delays and data loss. A special focus is put on the reduction of the computational complexity. A specific buffering mechanism is defined first, such that it adds an additional delay up to one sampling period. The resulting buffered NCS can then be formulated as a switched sy… ▽ More This paper presents a Lyapunov function based control strategy for networked control systems (NCS) affected by variable time delays and data loss. A special focus is put on the reduction of the computational complexity. A specific buffering mechanism is defined first, such that it adds an additional delay up to one sampling period. The resulting buffered NCS can then be formulated as a switched system which leads to the significant simplification of the NCS model and subsequent controller synthesis. The novel approach does not only circumvent the need for any over-approximation technique, since the switched NCS model can be used for stability analysis directly, but also reduces the infinite set of allowable values of the dynamic matrix to a small finite set. The proposed strategy leads hereby to a strongly decreased number of optimization variables and linear matrix inequalities (LMIs) which allows greater flexibility with respect to additional degrees of freedom affecting the transient behavior. The performance and computational efficiency of the control strategy are demonstrated by means of simulation example. △ Less

Submitted 2 March, 2023; originally announced March 2023.

Journal ref: IEEE Control Systems Letters, 2023

A full transit of $ν^2$ Lupi d and the search for an exomoon in its Hill sphere with CHEOPS

Authors: D. Ehrenreich, L. Delrez, B. Akinsanmi, T. G. Wilson, A. Bonfanti, M. Beck, W. Benz, S. Hoyer, D. Queloz, Y. Alibert, S. Charnoz, A. Collier Cameron, A. Deline, M. Hooton, M. Lendl, G. Olofsson, S. G. Sousa, V. Adibekyan, R. Alonso, G. Anglada, D. Barrado, S. C. C. Barros, W. Baumjohann, T. Beck, A. Bekkelien , et al. (68 additional authors not shown)

Abstract: The planetary system around the naked-eye star $ν^2$ Lupi (HD 136352; TOI-2011) is composed of three exoplanets with masses of 4.7, 11.2, and 8.6 Earth masses. The TESS and CHEOPS missions revealed that all three planets are transiting and have radii straddling the radius gap separating volatile-rich and volatile-poor super-earths. Only a partial transit of planet d had been covered so we re-obser… ▽ More The planetary system around the naked-eye star $ν^2$ Lupi (HD 136352; TOI-2011) is composed of three exoplanets with masses of 4.7, 11.2, and 8.6 Earth masses. The TESS and CHEOPS missions revealed that all three planets are transiting and have radii straddling the radius gap separating volatile-rich and volatile-poor super-earths. Only a partial transit of planet d had been covered so we re-observed an inferior conjunction of the long-period 8.6 Earth-mass exoplanet $ν^2$ Lup d with the CHEOPS space telescope. We confirmed its transiting nature by covering its whole 9.1 h transit for the first time. We refined the planet transit ephemeris to P = 107.1361 (+0.0019/-0.0022) days and Tc = 2,459,009.7759 (+0.0101/-0.0096) BJD_TDB, improving by ~40 times on the previously reported transit timing uncertainty. This refined ephemeris will enable further follow-up of this outstanding long-period transiting planet to search for atmospheric signatures or explore the planet's Hill sphere in search for an exomoon. In fact, the CHEOPS observations also cover the transit of a large fraction of the planet's Hill sphere, which is as large as the Earth's, opening the tantalising possibility of catching transiting exomoons. We conducted a search for exomoon signals in this single-epoch light curve but found no conclusive photometric signature of additional transiting bodies larger than Mars. Yet, only a sustained follow-up of $ν^2$ Lup d transits will warrant a comprehensive search for a moon around this outstanding exoplanet. △ Less

Submitted 3 February, 2023; originally announced February 2023.

Comments: 16 pages, 9 figures. Accepted for publication in Astronomy & Astrophysics

Journal ref: A&A 671, A154 (2023)

A new dynamical modeling of the WASP-47 system with CHEOPS observations

Authors: V. Nascimbeni, L. Borsato, T. Zingales, G. Piotto, I. Pagano, M. Beck, C. Broeg, D. Ehrenreich, S. Hoyer, F. Z. Majidi, V. Granata, S. G. Sousa, T. G. Wilson, V. Van Grootel, A. Bonfanti, S. Salmon, A. J. Mustill, L. Delrez, Y. Alibert, R. Alonso, G. Anglada, T. Bárczy, D. Barrado, S. C. C. Barros, W. Baumjohann , et al. (58 additional authors not shown)

Abstract: Among the hundreds of known hot Jupiters (HJs), only five have been found to have companions on short-period orbits. Within this rare class of multiple planetary systems, the architecture of WASP-47 is unique, hosting an HJ (planet -b) with both an inner and an outer sub-Neptunian mass companion (-e and -d, respectively) as well as an additional non-transiting, long-period giant (-c). The small pe… ▽ More Among the hundreds of known hot Jupiters (HJs), only five have been found to have companions on short-period orbits. Within this rare class of multiple planetary systems, the architecture of WASP-47 is unique, hosting an HJ (planet -b) with both an inner and an outer sub-Neptunian mass companion (-e and -d, respectively) as well as an additional non-transiting, long-period giant (-c). The small period ratio between planets -b and -d boosts the transit time variation (TTV) signal, making it possible to reliably measure the masses of these planets in synergy with the radial velocity (RV) technique. In this paper, we present new space- and ground-based photometric data of WASP-47b and WASP-47-d, including 11 unpublished light curves from the ESA mission CHEOPS. We analyzed the light curves in a homogeneous way together with all the publicly available data to carry out a global $N$-body dynamical modeling of the TTV and RV signals. We retrieved, among other parameters, a mass and density for planet -d of $M_\mathrm{d}=15.5\pm 0.8$ $M_\oplus$ and $ρ_\mathrm{d}=1.69\pm 0.22$ g\,cm$^{-3}$, which is in good agreement with the literature and consistent with a Neptune-like composition. For the inner planet (-e), we found a mass and density of $M_\mathrm{e}=9.0\pm 0.5$ $M_\oplus$ and $ρ_\mathrm{e}=8.1\pm 0.5$ g\,cm$^{-3}$, suggesting an Earth-like composition close to other ultra-hot planets at similar irradiation levels. Though this result is in agreement with previous RV+TTV studies, it is not in agreement with the most recent RV analysis (at 2.8$σ$), which yielded a lower density compatible with a pure silicate composition. This discrepancy highlights the still unresolved issue of suspected systematic offsets between RV and TTV measurements. In this paper, we also significantly improve the orbital ephemerides of all transiting planets, which will be crucial for any future follow-up. △ Less

Submitted 2 March, 2023; v1 submitted 2 February, 2023; originally announced February 2023.

Comments: 17 pages, 8 figures, 10 tables, A&A in press. Typos corrected

Connecting photometric and spectroscopic granulation signals with CHEOPS and ESPRESSO

Authors: S. Sulis, M. Lendl, H. Cegla, L. F. Rodriguez Diaz, L. Bigot, V. Van Grootel, A. Bekkelien, A. Collier Cameron, P. F. L. Maxted, A. E. Simon, C. Lovis, G. Scandariato, G. Bruno, D. Nardiello, A. Bonfanti, M. Fridlund, C. M. Persson, S. Salmon, S. G. Sousa, T. G. Wilson, A. Krenn, S. Hoyer, A. Santerne, D. Ehrenreich, Y. Alibert , et al. (61 additional authors not shown)

Abstract: Stellar granulation generates fluctuations in photometric and spectroscopic data whose properties depend on the stellar type, composition, and evolutionary state. In this study, we aim to detect the signatures of stellar granulation, link spectroscopic and photometric signatures of convection for main-sequence stars, and test predictions from 3D hydrodynamic models. For the first time, we observed… ▽ More Stellar granulation generates fluctuations in photometric and spectroscopic data whose properties depend on the stellar type, composition, and evolutionary state. In this study, we aim to detect the signatures of stellar granulation, link spectroscopic and photometric signatures of convection for main-sequence stars, and test predictions from 3D hydrodynamic models. For the first time, we observed two bright stars (Teff = 5833 K and 6205 K) with high-precision observations taken simultaneously with CHEOPS and ESPRESSO. We analyzed the properties of the stellar granulation signal in each individual data set. We compared them to Kepler observations and 3D hydrodynamic models. While isolating the granulation-induced changes by attenuating the p-mode oscillation signals, we studied the relationship between photometric and spectroscopic observables. The signature of stellar granulation is detected and precisely characterized for the hotter F star in the CHEOPS and ESPRESSO observations. For the cooler G star, we obtain a clear detection in the CHEOPS dataset only. The TESS observations are blind to this stellar signal. Based on CHEOPS observations, we show that the inferred properties of stellar granulation are in agreement with both Kepler observations and hydrodynamic models. Comparing their periodograms, we observe a strong link between spectroscopic and photometric observables. Correlations of this stellar signal in the time domain (flux vs RV) and with specific spectroscopic observables (shape of the cross-correlation functions) are however difficult to isolate due to signal-to-noise dependent variations. In the context of the upcoming PLATO mission and the extreme precision RV surveys, a thorough understanding of the properties of the stellar granulation signal is needed. The CHEOPS and ESPRESSO observations pave the way for detailed analyses of this stellar process. △ Less

Submitted 6 January, 2023; v1 submitted 25 November, 2022; originally announced November 2022.

Comments: Accepted to A&A, 30 pages, 21 figures, 10 tables (one online)

Journal ref: A&A 670, A24 (2023)

Gradient-based Weight Density Balancing for Robust Dynamic Sparse Training

Authors: Mathias Parger, Alexander Ertl, Paul Eibensteiner, Joerg H. Mueller, Martin Winter, Markus Steinberger

Abstract: Training a sparse neural network from scratch requires optimizing connections at the same time as the weights themselves. Typically, the weights are redistributed after a predefined number of weight updates, removing a fraction of the parameters of each layer and inserting them at different locations in the same layers. The density of each layer is determined using heuristics, often purely based o… ▽ More Training a sparse neural network from scratch requires optimizing connections at the same time as the weights themselves. Typically, the weights are redistributed after a predefined number of weight updates, removing a fraction of the parameters of each layer and inserting them at different locations in the same layers. The density of each layer is determined using heuristics, often purely based on the size of the parameter tensor. While the connections per layer are optimized multiple times during training, the density of each layer remains constant. This leaves great unrealized potential, especially in scenarios with a high sparsity of 90% and more. We propose Global Gradient-based Redistribution, a technique which distributes weights across all layers - adding more weights to the layers that need them most. Our evaluation shows that our approach is less prone to unbalanced weight distribution at initialization than previous work and that it is able to find better performing sparse subnetworks at very high sparsity levels. △ Less

Submitted 3 November, 2022; v1 submitted 25 October, 2022; originally announced October 2022.

MotionDeltaCNN: Sparse CNN Inference of Frame Differences in Moving Camera Videos

Authors: Mathias Parger, Chengcheng Tang, Thomas Neff, Christopher D. Twigg, Cem Keskin, Robert Wang, Markus Steinberger

Abstract: Convolutional neural network inference on video input is computationally expensive and requires high memory bandwidth. Recently, DeltaCNN managed to reduce the cost by only processing pixels with significant updates over the previous frame. However, DeltaCNN relies on static camera input. Moving cameras add new challenges in how to fuse newly unveiled image regions with already processed regions e… ▽ More Convolutional neural network inference on video input is computationally expensive and requires high memory bandwidth. Recently, DeltaCNN managed to reduce the cost by only processing pixels with significant updates over the previous frame. However, DeltaCNN relies on static camera input. Moving cameras add new challenges in how to fuse newly unveiled image regions with already processed regions efficiently to minimize the update rate - without increasing memory overhead and without knowing the camera extrinsics of future frames. In this work, we propose MotionDeltaCNN, a sparse CNN inference framework that supports moving cameras. We introduce spherical buffers and padded convolutions to enable seamless fusion of newly unveiled regions and previously processed regions -- without increasing memory footprint. Our evaluation shows that we outperform DeltaCNN by up to 90% for moving camera videos. △ Less

Submitted 14 August, 2023; v1 submitted 18 October, 2022; originally announced October 2022.

AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fields

Authors: Andreas Kurz, Thomas Neff, Zhaoyang Lv, Michael Zollhöfer, Markus Steinberger

Abstract: Novel view synthesis has recently been revolutionized by learning neural radiance fields directly from sparse observations. However, rendering images with this new paradigm is slow due to the fact that an accurate quadrature of the volume rendering equation requires a large number of samples for each ray. Previous work has mainly focused on speeding up the network evaluations that are associated w… ▽ More Novel view synthesis has recently been revolutionized by learning neural radiance fields directly from sparse observations. However, rendering images with this new paradigm is slow due to the fact that an accurate quadrature of the volume rendering equation requires a large number of samples for each ray. Previous work has mainly focused on speeding up the network evaluations that are associated with each sample point, e.g., via caching of radiance values into explicit spatial data structures, but this comes at the expense of model compactness. In this paper, we propose a novel dual-network architecture that takes an orthogonal direction by learning how to best reduce the number of required sample points. To this end, we split our network into a sampling and shading network that are jointly trained. Our training scheme employs fixed sample positions along each ray, and incrementally introduces sparsity throughout training to achieve high quality even at low sample counts. After fine-tuning with the target number of samples, the resulting compact neural representation can be rendered in real-time. Our experiments demonstrate that our approach outperforms concurrent compact neural representations in terms of quality and frame rate and performs on par with highly efficient hybrid representations. Code and supplementary material is available at https://thomasneff.github.io/adanerf. △ Less

Submitted 28 July, 2022; v1 submitted 21 July, 2022; originally announced July 2022.

Comments: ECCV 2022. Project page: https://thomasneff.github.io/adanerf

Fundamental effective temperature measurements for eclipsing binary stars -- III. SPIRou near-infrared spectroscopy and CHEOPS photometry of the benchmark G0V star EBLM J0113+31

Authors: P. F. L. Maxted, N. J. Miller, S. Hoyer, V. Adibekyan, S. G. Sousa, N. Billot, A. Fortier, A. E. Simon, A. Collier Cameron, M. I. Sawyne, P. Gutermann, A. H. M. J. Triaud, J. Southworth, Y. Alibert, R. Alonso, G. Anglada, T. Bárczy, D. Barrado y Navascues, S. C. C. Barros, W. Baumjohann, M. Beck, T. Beck, W. Benz, X. Bonfils, A. Brandeker , et al. (52 additional authors not shown)

Abstract: EBLM J0113+31 is moderately bright (V=10.1), metal-poor ([Fe/H]$\approx-0.3$) G0V star with a much fainter M dwarf companion on a wide, eccentric orbit (=14.3 d). We have used near-infrared spectroscopy obtained with the SPIRou spectrograph to measure the semi-amplitude of the M dwarf's spectroscopic orbit, and high-precision photometry of the eclipse and transit from the CHEOPS and TESS space mis… ▽ More EBLM J0113+31 is moderately bright (V=10.1), metal-poor ([Fe/H]$\approx-0.3$) G0V star with a much fainter M dwarf companion on a wide, eccentric orbit (=14.3 d). We have used near-infrared spectroscopy obtained with the SPIRou spectrograph to measure the semi-amplitude of the M dwarf's spectroscopic orbit, and high-precision photometry of the eclipse and transit from the CHEOPS and TESS space missions to measure the geometry of this binary system. From the combined analysis of these data together with previously published observations we obtain the following model-independent masses and radii: $M_1 = 1.029 \pm 0.025 M_{\odot}$, $M_2 = 0.197 \pm 0.003 M_{\odot}$, $R_1 = 1.417 \pm 0.014 R_{\odot}$, $R_2 = 0.215 \pm 0.002 R_{\odot}$. Using $R_1$ and the parallax from Gaia EDR3 we find that this star's angular diameter is $θ= 0.0745 \pm 0.0007$ mas. The apparent bolometric flux of the G0V star corrected for both extinction and the contribution from the M dwarf ($<0.2$ per cent) is ${\mathcal F}_{\oplus,0} = (2.62\pm 0.05)\times10^{-9}$ erg.cm$^{-2}$.s$^{-1}$. Hence, this G0V star has an effective temperature $T_{\rm eff,1} = 6124{\rm\,K} \pm 40{\rm \,K\,(rnd.)} \pm 10 {\rm \,K\,(sys.)}$. EBLM J0113+31 is an ideal benchmark star that can be used for "end-to-end" tests of the stellar parameters measured by large-scale spectroscopic surveys, or stellar parameters derived from asteroseismology with PLATO. The techniques developed here can be applied to many other eclipsing binaries in order to create a network of such benchmark stars. △ Less

Submitted 6 May, 2022; v1 submitted 3 May, 2022; originally announced May 2022.

Comments: Accepted for publication in MNRAS. 15 pages, 9 figures

DeltaCNN: End-to-End CNN Inference of Sparse Frame Differences in Videos

Authors: Mathias Parger, Chengcheng Tang, Christopher D. Twigg, Cem Keskin, Robert Wang, Markus Steinberger

Abstract: Convolutional neural network inference on video data requires powerful hardware for real-time processing. Given the inherent coherence across consecutive frames, large parts of a video typically change little. By skip** identical image regions and truncating insignificant pixel updates, computational redundancy can in theory be reduced significantly. However, these theoretical savings have been… ▽ More Convolutional neural network inference on video data requires powerful hardware for real-time processing. Given the inherent coherence across consecutive frames, large parts of a video typically change little. By skip** identical image regions and truncating insignificant pixel updates, computational redundancy can in theory be reduced significantly. However, these theoretical savings have been difficult to translate into practice, as sparse updates hamper computational consistency and memory access coherence; which are key for efficiency on real hardware. With DeltaCNN, we present a sparse convolutional neural network framework that enables sparse frame-by-frame updates to accelerate video inference in practice. We provide sparse implementations for all typical CNN layers and propagate sparse feature updates end-to-end - without accumulating errors over time. DeltaCNN is applicable to all convolutional neural networks without retraining. To the best of our knowledge, we are the first to significantly outperform the dense reference, cuDNN, in practical settings, achieving speedups of up to 7x with only marginal differences in accuracy. △ Less

Submitted 2 September, 2023; v1 submitted 8 March, 2022; originally announced March 2022.

Comments: CVPR 2022

Investigating the architecture and internal structure of the TOI-561 system planets with CHEOPS, HARPS-N and TESS

Authors: G. Lacedelli, T. G. Wilson, L. Malavolta, M. J. Hooton, A. Collier Cameron, Y. Alibert, A. Mortier, A. Bonfanti, R. D. Haywood, S. Hoyer, G. Piotto, A. Bekkelien, A. M. Vanderburg, W. Benz, X. Dumusque, A. Deline, M. López-Morales, L. Borsato, K. Rice, L. Fossati, D. W. Latham, A. Brandeker, E. Poretti, S. G. Sousa, A. Sozzetti , et al. (93 additional authors not shown)

Abstract: We present a precise characterization of the TOI-561 planetary system obtained by combining previously published data with TESS and CHEOPS photometry, and a new set of $62$ HARPS-N radial velocities (RVs). Our joint analysis confirms the presence of four transiting planets, namely TOI-561 b ($P = 0.45$ d, $R = 1.42$ R$_\oplus$, $M = 2.0$ M$_\oplus$), c ($P = 10.78$ d, $R = 2.91$ R$_\oplus$,… ▽ More We present a precise characterization of the TOI-561 planetary system obtained by combining previously published data with TESS and CHEOPS photometry, and a new set of $62$ HARPS-N radial velocities (RVs). Our joint analysis confirms the presence of four transiting planets, namely TOI-561 b ($P = 0.45$ d, $R = 1.42$ R$_\oplus$, $M = 2.0$ M$_\oplus$), c ($P = 10.78$ d, $R = 2.91$ R$_\oplus$, $M = 5.4$ M$_\oplus$), d ($P = 25.7$ d, $R = 2.82$ R$_\oplus$, $M = 13.2$ M$_\oplus$) and e ($P = 77$ d, $R = 2.55$ R$_\oplus$, $M = 12.6$ M$_\oplus$). Moreover, we identify an additional, long-period signal ($>450$ d) in the RVs, which could be due to either an external planetary companion or to stellar magnetic activity. The precise masses and radii obtained for the four planets allowed us to conduct interior structure and atmospheric escape modelling. TOI-561 b is confirmed to be the lowest density ($ρ_{\rm b} = 3.8 \pm 0.5$ g cm$^{-3}$) ultra-short period (USP) planet known to date, and the low metallicity of the host star makes it consistent with the general bulk density-stellar metallicity trend. According to our interior structure modelling, planet b has basically no gas envelope, and it could host a certain amount of water. In contrast, TOI-561 c, d, and e likely retained an H/He envelope, in addition to a possibly large water layer. The inferred planetary compositions suggest different atmospheric evolutionary paths, with planets b and c having experienced significant gas loss, and planets d and e showing an atmospheric content consistent with the original one. The uniqueness of the USP planet, the presence of the long-period planet TOI-561 e, and the complex architecture make this system an appealing target for follow-up studies. △ Less

Submitted 19 January, 2022; originally announced January 2022.

Comments: 22 pages, 19 figures. Accepted for publication in MNRAS

Detectability Conditions and State Estimation for Linear Time-Varying and Nonlinear Systems

Authors: Markus Tranninger, Richard Seeber, Martin Steinberger, Martin Horn, Christian Pötzsche

Abstract: This work proposes a detectability condition for linear time-varying systems based on the exponential dichotomy spectrum. The condition guarantees the existence of an observer, whose gain is determined only by the unstable modes of the system. This allows for an observer design with low computational complexity compared to classical estimation approaches. An extension of this observer design to a… ▽ More This work proposes a detectability condition for linear time-varying systems based on the exponential dichotomy spectrum. The condition guarantees the existence of an observer, whose gain is determined only by the unstable modes of the system. This allows for an observer design with low computational complexity compared to classical estimation approaches. An extension of this observer design to a class of nonlinear systems is proposed and local convergence of the corresponding estimation error dynamics is proven. Numerical results show the efficacy of the proposed observer design technique. △ Less

Submitted 19 April, 2022; v1 submitted 25 June, 2021; originally announced June 2021.

MSC Class: 93B07; 34D08; 34D09

The EBLM project -- VIII. First results for M-dwarf mass, radius and effective temperature measurements using CHEOPS light curves

Authors: M. I. Swayne, P. F. L. Maxted, A. H. M. J. Triaud, S. G. Sousa, C. Broeg, H. -G. Florén, P. Guterman, A. E. Simon, I. Boisse, A. Bonfanti, D. Martin, A. Santerne, S. Salmon, M. R. Standing, V. Van Grootel, T. G. Wilson, Y. Alibert, R. Alonso, G. Anglada Escudé, J. Asquier, T. Bárczy, D. Barrado, S. C. C. Barros, M. Battley, W. Baumjohann , et al. (71 additional authors not shown)

Abstract: The accuracy of theoretical mass, radius and effective temperature values for M-dwarf stars is an active topic of debate. Differences between observed and theoretical values have raised the possibility that current theoretical stellar structure and evolution models are inaccurate towards the low-mass end of the main sequence. To explore this issue we use the CHEOPS satellite to obtain high-precisi… ▽ More The accuracy of theoretical mass, radius and effective temperature values for M-dwarf stars is an active topic of debate. Differences between observed and theoretical values have raised the possibility that current theoretical stellar structure and evolution models are inaccurate towards the low-mass end of the main sequence. To explore this issue we use the CHEOPS satellite to obtain high-precision light curves of eclipsing binaries with low mass stellar companions. We use these light curves combined with the spectroscopic orbit for the solar-type companion to measure the mass, radius and effective temperature of the M-dwarf star. Here we present the analysis of three eclipsing binaries. We use the pycheops data analysis software to fit the observed transit and eclipse events of each system. Two of our systems were also observed by the TESS satellite -- we similarly analyse these light curves for comparison. We find consistent results between CHEOPS and TESS, presenting three stellar radii and two stellar effective temperature values of low-mass stellar objects. These initial results from our on-going observing programme with CHEOPS show that we can expect to have ~24 new mass, radius and effective temperature measurements for very low mass stars within the next few years. △ Less

Submitted 14 June, 2021; originally announced June 2021.

Comments: 12 pages, 8 figures, accepted for publication in MNRAS

Journal ref: MNRAS 506 (2021) 306-322

A Variational Loop Shrinking Analogy for Handle and Tunnel Detection and Reeb Graph Construction on Surfaces

Authors: Alexander Weinrauch, Hans-Peter Seidel, Daniel Mlakar, Markus Steinberger, Rhaleb Zayer

Abstract: The humble loop shrinking property played a central role in the inception of modern topology but it has been eclipsed by more abstract algebraic formalism. This is particularly true in the context of detecting relevant non-contractible loops on surfaces where elaborate homological and/or graph theoretical constructs are favored in algorithmic solutions. In this work, we devise a variational analog… ▽ More The humble loop shrinking property played a central role in the inception of modern topology but it has been eclipsed by more abstract algebraic formalism. This is particularly true in the context of detecting relevant non-contractible loops on surfaces where elaborate homological and/or graph theoretical constructs are favored in algorithmic solutions. In this work, we devise a variational analogy to the loop shrinking property and show that it yields a simple, intuitive, yet powerful solution allowing a streamlined treatment of the problem of handle and tunnel loop detection. Our formalization tracks the evolution of a diffusion front randomly initiated on a single location on the surface. Capitalizing on a diffuse interface representation combined with a set of rules for concurrent front interactions, we develop a dynamic data structure for tracking the evolution on the surface encoded as a sparse matrix which serves for performing both diffusion numerics and loop detection and acts as the workhorse of our fully parallel implementation. The substantiated results suggest our approach outperforms state of the art and robustly copes with highly detailed geometric models. As a byproduct, our approach can be used to construct Reeb graphs by diffusion thus avoiding commonly encountered issues when using Morse functions. △ Less

Submitted 27 May, 2021; originally announced May 2021.

A Non-Conservative Stability Criterion for Networked Control Systems with time-varying Packet Delays

Authors: Martin Steinberger, Martin Horn

Abstract: A networked output feedback loop subject to packetized transmissions of the output signal is considered. Based on the small gain theorem, an easy-to-use stability criterion covering two important cases is presented. In the first case a packet numbering mechanism is employed whereas in the second case neither packet numbering nor synchronization between sender and receiver is assumed. The analysis… ▽ More A networked output feedback loop subject to packetized transmissions of the output signal is considered. Based on the small gain theorem, an easy-to-use stability criterion covering two important cases is presented. In the first case a packet numbering mechanism is employed whereas in the second case neither packet numbering nor synchronization between sender and receiver is assumed. The analysis makes use of acausal subsystems and deduces the optimal constant time delay that should be used in a nominal controller design such that additional packet delay variations introduced by the network are maximized. A simulation example of a networked control system with a filtered Smith predictor illustrates the application of the proposed criterion and compares the results to different approaches from literature. △ Less

Submitted 30 March, 2021; originally announced March 2021.

Journal ref: IET Control Theory & Applications, 2021

DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks

Authors: Thomas Neff, Pascal Stadlbauer, Mathias Parger, Andreas Kurz, Joerg H. Mueller, Chakravarty R. Alla Chaitanya, Anton Kaplanyan, Markus Steinberger

Abstract: The recent research explosion around implicit neural representations, such as NeRF, shows that there is immense potential for implicitly storing high-quality scene and lighting information in compact neural networks. However, one major limitation preventing the use of NeRF in real-time rendering applications is the prohibitive computational cost of excessive network evaluations along each view ray… ▽ More The recent research explosion around implicit neural representations, such as NeRF, shows that there is immense potential for implicitly storing high-quality scene and lighting information in compact neural networks. However, one major limitation preventing the use of NeRF in real-time rendering applications is the prohibitive computational cost of excessive network evaluations along each view ray, requiring dozens of petaFLOPS. In this work, we bring compact neural representations closer to practical rendering of synthetic content in real-time applications, such as games and virtual reality. We show that the number of samples required for each view ray can be significantly reduced when samples are placed around surfaces in the scene without compromising image quality. To this end, we propose a depth oracle network that predicts ray sample locations for each view ray with a single network evaluation. We show that using a classification network around logarithmically discretized and spherically warped depth values is essential to encode surface locations rather than directly estimating depth. The combination of these techniques leads to DONeRF, our compact dual network design with a depth oracle network as its first step and a locally sampled shading network for ray accumulation. With DONeRF, we reduce the inference costs by up to 48x compared to NeRF when conditioning on available ground truth depth information. Compared to concurrent acceleration methods for raymarching-based neural representations, DONeRF does not require additional memory for explicit caching or acceleration structures, and can render interactively (20 frames per second) on a single GPU. △ Less

Submitted 25 June, 2021; v1 submitted 4 March, 2021; originally announced March 2021.

Comments: Accepted to EGSR 2021 in the CGF track; Project website: https://depthoraclenerf.github.io/

Journal ref: Computer Graphics Forum Volume 40, Issue 4, 2021

UNOC: Understanding Occlusion for Embodied Presence in Virtual Reality

Authors: Mathias Parger, Chengcheng Tang, Yuanlu Xu, Christopher Twigg, Lingling Tao, Yi**g Li, Robert Wang, Markus Steinberger

Abstract: Tracking body and hand motions in the 3D space is essential for social and self-presence in augmented and virtual environments. Unlike the popular 3D pose estimation setting, the problem is often formulated as inside-out tracking based on embodied perception (e.g., egocentric cameras, handheld sensors). In this paper, we propose a new data-driven framework for inside-out body tracking, targeting c… ▽ More Tracking body and hand motions in the 3D space is essential for social and self-presence in augmented and virtual environments. Unlike the popular 3D pose estimation setting, the problem is often formulated as inside-out tracking based on embodied perception (e.g., egocentric cameras, handheld sensors). In this paper, we propose a new data-driven framework for inside-out body tracking, targeting challenges of omnipresent occlusions in optimization-based methods (e.g., inverse kinematics solvers). We first collect a large-scale motion capture dataset with both body and finger motions using optical markers and inertial sensors. This dataset focuses on social scenarios and captures ground truth poses under self-occlusions and body-hand interactions. We then simulate the occlusion patterns in head-mounted camera views on the captured ground truth using a ray casting algorithm and learn a deep neural network to infer the occluded body parts. In the experiments, we show that our method is able to generate high-fidelity embodied poses by applying the proposed method on the task of real-time inside-out body tracking, finger motion synthesis, and 3-point inverse kinematics. △ Less

Submitted 12 November, 2020; originally announced December 2020.

From classical to Networked Control: Retrofitting the Concept of Smith Predictors

Authors: Martin Steinberger, Martin Horn

Abstract: Filtered Smith predictors are well established for controlling linear plants with constant time delays. Apart from this classical application scenario, they are also employed within networked control loops, where the measurements are sent in separate packets over a transmission channel that is subject to time-varying delays. However, no stability guarantees can be given in this case. The present… ▽ More Filtered Smith predictors are well established for controlling linear plants with constant time delays. Apart from this classical application scenario, they are also employed within networked control loops, where the measurements are sent in separate packets over a transmission channel that is subject to time-varying delays. However, no stability guarantees can be given in this case. The present paper illustrates that the time-varying delays as well as the packetized character of the transmissions have to be taken into account for stability analysis. Hence, three network protocols, which use different packet selection and hold mechanisms, are considered. Criteria for robust stability of the networked feedback loop are given. They are based on the small gain theorem and allow a computationally inexpensive way to check stability for the case with bounded packet delays. Simulation examples provide insight into the presented approach and show why the inclusion of the time-varying packetized character of the network transmissions is vital for stability analysis. △ Less

Submitted 12 October, 2020; originally announced October 2020.

Journal ref: Journal of Process Control, 2022

Uniform Detectability of Linear Time Varying Systems with Exponential Dichotomy

Authors: Markus Tranninger, Richard Seeber, Martin Steinberger, Martin Horn

Abstract: Exponential dichotomies play a central role in stability theory for dynamical systems. They allow to split the state space into two subspaces, where all trajectories in one subspace decay whereas all trajectories in the other subspace grow, uniformly and exponentially. This paper studies uniform detectability and observability notions for linear time varying systems, which admit an exponential dic… ▽ More Exponential dichotomies play a central role in stability theory for dynamical systems. They allow to split the state space into two subspaces, where all trajectories in one subspace decay whereas all trajectories in the other subspace grow, uniformly and exponentially. This paper studies uniform detectability and observability notions for linear time varying systems, which admit an exponential dichotomy. The main contributions are necessary and sufficient detectability conditions for this class of systems. △ Less

Submitted 22 April, 2020; originally announced April 2020.

Finite-horizon Linear Quadratic Control for Networked Control Systems with non-distributed plants

Authors: Marijan Palmisano, Martin Steinberger, Martin Horn

Abstract: An optimal control law for networked control systems with a discrete-time linear time-invariant (LTI) system as plant and networks between sensor and controller as well as between controller and actuator is proposed. This controller is designed by solving an optimization problem that is a generalization of the optimization problem used to obtain the Linear Quadratic Regulator (LQR) for determinist… ▽ More An optimal control law for networked control systems with a discrete-time linear time-invariant (LTI) system as plant and networks between sensor and controller as well as between controller and actuator is proposed. This controller is designed by solving an optimization problem that is a generalization of the optimization problem used to obtain the Linear Quadratic Regulator (LQR) for deterministic discrete-time LTI systems. The networks are represented by random delays and drop outs of transmitted data packets. △ Less

Submitted 13 May, 2020; v1 submitted 28 February, 2020; originally announced March 2020.

Journal ref: IEEE Control Systems Letters (Volume: 5, Issue: 1, Jan. 2021)

Pipe Roughness Identification of Water Distribution Networks: A Tensor Method

Authors: Stefan Kaltenbacher, Martin Steinberger, Martin Horn

Abstract: The identification of pipe roughnesses in a water distribution network is formulated as nonlinear system of algebraic equations which turns out to be demanding to solve under real-world circumstances. This paper proposes an enhanced technique to numerically solve this identification problem, extending the conventional Newton-Raphson approach with second-order derivatives in the determination of th… ▽ More The identification of pipe roughnesses in a water distribution network is formulated as nonlinear system of algebraic equations which turns out to be demanding to solve under real-world circumstances. This paper proposes an enhanced technique to numerically solve this identification problem, extending the conventional Newton-Raphson approach with second-order derivatives in the determination of the search direction. Enabled through some interesting mathematical findings, the resulting formulation can be represented compactly and thus facilitates the development of an efficient and more robust solving-technique. Algorithms on the basis of this more enhanced solving method are then compared to a customized Newton-Raphson approach in simulation examples. △ Less

Submitted 4 November, 2019; v1 submitted 29 October, 2019; originally announced October 2019.

Pipe Roughness Identification of Water Distribution Networks: The Full Turbulent Case

Authors: Stefan Kaltenbacher, Martin Steinberger, Martin Horn

Abstract: This paper proposes a technique to identify individual pipe roughness parameters in a water distribution network by means of the inversion of the steady-state hydraulic network equations. By enabling the reconstruction of these hydraulic friction parameters to be reliable, this technique improves the conventional model's accuracy and thereby promises to enhance model-based leakage detection and lo… ▽ More This paper proposes a technique to identify individual pipe roughness parameters in a water distribution network by means of the inversion of the steady-state hydraulic network equations. By enabling the reconstruction of these hydraulic friction parameters to be reliable, this technique improves the conventional model's accuracy and thereby promises to enhance model-based leakage detection and localization. As it is the case in so-called fireflow tests, this methodology is founded on the premise to measure the pressure distributed at a subset of nodes in the network's graph while assuming the nodal consumption to be known. Beside of the proposed problem formulation, which is restricted to only allow turbulent flow in each of the network's pipes initially, developed algorithms are presented and evaluated using simulation examples. △ Less

Submitted 12 November, 2019; v1 submitted 21 August, 2019; originally announced August 2019.

Journal ref: Journal of Applied Mathematical Modelling, 2019, ISSN 0307-904X, (https://www.sciencedirect.com/science/article/pii/S0307904X19306766?via%3Dihub)

Non-Uniform Stability, Detectability, and, Sliding Mode Observer Design for Time Varying Systems with Unknown Inputs

Authors: Markus Tranninger, Sergiy Zhuk, Martin Steinberger, Leonid Fridman, Martin Horn

Abstract: This paper discusses stability and robustness properties of a recently proposed observer algorithm for linear time varying systems. The observer is based on the approximation and subsequent modification of the non-negative Lyapunov exponents which yields a (non-uniform) exponentially stable error system. Theoretical insights in the construction of the observer are given and the error system is ana… ▽ More This paper discusses stability and robustness properties of a recently proposed observer algorithm for linear time varying systems. The observer is based on the approximation and subsequent modification of the non-negative Lyapunov exponents which yields a (non-uniform) exponentially stable error system. Theoretical insights in the construction of the observer are given and the error system is analyzed with respect to bounded unknown inputs. Therefor, new conditions for bounded input bounded state stability for linear time varying systems are presented. It is shown that for a specific class of linear time varying systems, a cascaded observer based on higher order sliding mode differentiators can be designed to achieve finite time exact reconstruction of the system states despite the unknown input. A numerical simulation example shows the applicability of the proposed approach. △ Less

Submitted 17 September, 2018; originally announced September 2018.

AlSub: Fully Parallel and Modular Subdivision

Authors: Daniel Mlakar, Martin Winter, Hans-Peter Seidel, Markus Steinberger, Rhaleb Zayer

Abstract: In recent years, mesh subdivision---the process of forging smooth free-form surfaces from coarse polygonal meshes---has become an indispensable production instrument. Although subdivision performance is crucial during simulation, animation and rendering, state-of-the-art approaches still rely on serial implementations for complex parts of the subdivision process. Therefore, they often fail to harn… ▽ More In recent years, mesh subdivision---the process of forging smooth free-form surfaces from coarse polygonal meshes---has become an indispensable production instrument. Although subdivision performance is crucial during simulation, animation and rendering, state-of-the-art approaches still rely on serial implementations for complex parts of the subdivision process. Therefore, they often fail to harness the power of modern parallel devices, like the graphics processing unit (GPU), for large parts of the algorithm and must resort to time-consuming serial preprocessing. In this paper, we show that a complete parallelization of the subdivision process for modern architectures is possible. Building on sparse matrix linear algebra, we show how to structure the complete subdivision process into a sequence of algebra operations. By restructuring and grou** these operations, we adapt the process for different use cases, such as regular subdivision of dynamic meshes, uniform subdivision for immutable topology, and feature-adaptive subdivision for efficient rendering of animated models. As the same machinery is used for all use cases, identical subdivision results are achieved in all parts of the production pipeline. As a second contribution, we show how these linear algebra formulations can effectively be translated into efficient GPU kernels. Applying our strategies to $\sqrt{3}$, Loop and Catmull-Clark subdivision shows significant speedups of our approach compared to state-of-the-art solutions, while we completely avoid serial preprocessing. △ Less

Submitted 16 January, 2019; v1 submitted 17 September, 2018; originally announced September 2018.

Comments: Changed structure Added content Improved descriptions

On-the-fly Vertex Reuse for Massively-Parallel Software Geometry Processing

Authors: Michael Kenzel, Bernhard Kerbl, Wolfgang Tatzgern, Elena Ivanchenko, Dieter Schmalstieg, Markus Steinberger

Abstract: Compute-mode rendering is becoming more and more attractive for non-standard rendering applications, due to the high flexibility of compute-mode execution. These newly designed pipelines often include streaming vertex and geometry processing stages. In typical triangle meshes, the same transformed vertex is on average required six times during rendering. To avoid redundant computation, a post-tran… ▽ More Compute-mode rendering is becoming more and more attractive for non-standard rendering applications, due to the high flexibility of compute-mode execution. These newly designed pipelines often include streaming vertex and geometry processing stages. In typical triangle meshes, the same transformed vertex is on average required six times during rendering. To avoid redundant computation, a post-transform cache is traditionally suggested to enable reuse of vertex processing results. However, traditional caching neither scales well as the hardware becomes more parallel, nor can be efficiently implemented in a software design. We investigate alternative strategies to reusing vertex shading results on-the-fly for massively parallel software geometry processing. Forming static and dynamic batching on the data input stream, we analyze the effectiveness of identifying potential local reuse based on sorting, hashing, and efficient intra-thread-group communication. Altogether, we present four vertex reuse strategies, tailored to modern parallel architectures. Our simulations showcase that our batch-based strategies significantly outperform parallel caches in terms of reuse. On actual GPU hardware, our evaluation shows that our strategies not only lead to good reuse of processing results, but also boost performance by $2-3\times$ compared to naïvely ignoring reuse in a variety of practical applications. △ Less

Submitted 22 May, 2018; originally announced May 2018.

Layered Fields for Natural Tessellations on Surfaces

Authors: Rhaleb Zayer, Daniel Mlakar, Markus Steinberger, Hans-Peter Seidel

Abstract: Mimicking natural tessellation patterns is a fascinating multi-disciplinary problem. Geometric methods aiming at reproducing such partitions on surface meshes are commonly based on the Voronoi model and its variants, and are often faced with challenging issues such as metric estimation, geometric, topological complications, and most critically parallelization. In this paper, we introduce an altern… ▽ More Mimicking natural tessellation patterns is a fascinating multi-disciplinary problem. Geometric methods aiming at reproducing such partitions on surface meshes are commonly based on the Voronoi model and its variants, and are often faced with challenging issues such as metric estimation, geometric, topological complications, and most critically parallelization. In this paper, we introduce an alternate model which may be of value for resolving these issues. We drop the assumption that regions need to be separated by lines. Instead, we regard region boundaries as narrow bands and we model the partition as a set of smooth functions layered over the surface. Given an initial set of seeds or regions, the partition emerges as the solution of a time dependent set of partial differential equations describing concurrently evolving fronts on the surface. Our solution does not require geodesic estimation, elaborate numerical solvers, or complicated bookkee** data structures. The cost per time-iteration is dominated by the multiplication and addition of two sparse matrices. Extension of our approach in a Lloyd's algorithm fashion can be easily achieved and the extraction of the dual mesh can be conveniently preformed in parallel through matrix algebra. As our approach relies mainly on basic linear algebra kernels, it lends itself to efficient implementation on modern graphics hardware. △ Less

Submitted 24 April, 2018; originally announced April 2018.

Comments: Natural tessellations, surface fields, Voronoi diagrams, Lloyd's algorithm

Electronic Mathematics Journals

Authors: Mark Steinberger

Abstract: In the Forum section of the November, 1993 Notices of the American Mathematical Society, John Franks discussed the electronic journal of the future. Since then, the New York Journal of Mathematics, the first electronic general mathematics journal, has begun publication. In this article, we explore the issues of electronic journal publishing in the context of this new project. We also discuss fut… ▽ More In the Forum section of the November, 1993 Notices of the American Mathematical Society, John Franks discussed the electronic journal of the future. Since then, the New York Journal of Mathematics, the first electronic general mathematics journal, has begun publication. In this article, we explore the issues of electronic journal publishing in the context of this new project. We also discuss future developments. △ Less

Submitted 25 August, 1997; originally announced August 1997.

Comments: 7 pages, latex, nyj class

Journal ref: Notices of the Amer. Math. Soc. 43 (1996), 13-16