Showing 1–9 of 9 results for author: Marić, A

Energy-based Contact Planning under Uncertainty for Robot Air Hockey

Authors: Julius Jankowski, Ante Marić, Puze Liu, Davide Tateo, Jan Peters, Sylvain Calinon

Abstract: Planning robot contact often requires reasoning over a horizon to anticipate outcomes, making such planning problems computationally expensive. In this letter, we propose a learning framework for efficient contact planning in real-time subject to uncertain contact dynamics. We implement our approach for the example task of robot air hockey. Based on a learned stochastic model of puck dynamics, we… ▽ More Planning robot contact often requires reasoning over a horizon to anticipate outcomes, making such planning problems computationally expensive. In this letter, we propose a learning framework for efficient contact planning in real-time subject to uncertain contact dynamics. We implement our approach for the example task of robot air hockey. Based on a learned stochastic model of puck dynamics, we formulate contact planning for shooting actions as a stochastic optimal control problem with a chance constraint on hitting the goal. To achieve online re-planning capabilities, we propose to train an energy-based model to generate optimal shooting plans in real time. The performance of the trained policy is validated %in experiments both in simulation and on a real-robot setup. Furthermore, our approach was tested in a competitive setting as part of the NeurIPS 2023 Robot Air Hockey Challenge. △ Less

Submitted 4 July, 2024; originally announced July 2024.

Comments: This work has been submitted to the IEEE Robotics & Automation Letters for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

AiRLIHockey: Highly Reactive Contact Control and Stochastic Optimal Shooting

Authors: Julius Jankowski, Ante Marić, Sylvain Calinon

Abstract: Air hockey is a highly reactive game which requires the player to quickly reason over stochastic puck and contact dynamics. We implement a hierarchical framework which combines stochastic optimal control for planning shooting angles and sampling-based model-predictive control for continuously generating constrained mallet trajectories. Our agent was deployed and evaluated in simulation and on a ph… ▽ More Air hockey is a highly reactive game which requires the player to quickly reason over stochastic puck and contact dynamics. We implement a hierarchical framework which combines stochastic optimal control for planning shooting angles and sampling-based model-predictive control for continuously generating constrained mallet trajectories. Our agent was deployed and evaluated in simulation and on a physical setup as part of the Robot Air-Hockey challenge competition at NeurIPS 2023. △ Less

Submitted 26 January, 2024; originally announced January 2024.

Online Learning of Continuous Signed Distance Fields Using Piecewise Polynomials

Authors: Ante Marić, Yiming Li, Sylvain Calinon

Abstract: Reasoning about distance is indispensable for establishing or avoiding contact in manipulation tasks. To this end, we present an online approach for learning implicit representations of signed distance using piecewise polynomial basis functions. Starting from an arbitrary prior shape, our method incrementally constructs a continuous and smooth distance representation from incoming surface points,… ▽ More Reasoning about distance is indispensable for establishing or avoiding contact in manipulation tasks. To this end, we present an online approach for learning implicit representations of signed distance using piecewise polynomial basis functions. Starting from an arbitrary prior shape, our method incrementally constructs a continuous and smooth distance representation from incoming surface points, with analytical access to gradient information. The underlying model does not store training data for prediction, and its performance can be balanced through interpretable hyperparameters such as polynomial degree and number of segments. We assess the accuracy of the incrementally learned model on a set of household objects and compare it to neural network and Gaussian process counterparts. The utility of intermediate results and analytical gradients is further demonstrated in a physical experiment. For code and video, see https://sites.google.com/view/pp-sdf/. △ Less

Submitted 7 May, 2024; v1 submitted 15 January, 2024; originally announced January 2024.

Benchmarking real-time algorithms for in-phase auditory stimulation of low amplitude slow waves with wearable EEG devices during sleep

Authors: Maria Laura Ferster, Giulia Da Poian, Kiran Menachery, Simon J. Schreiner, Caroline Lustenberger, Angelina Maric, Reto Huber, Christian Baumann, Walter Karlen

Abstract: Auditory stimulation of EEG slow waves (SW) during non-rapid eye movement (NREM) sleep has shown to improve cognitive function when it is delivered at the up-phase of SW. SW enhancement is particularly desirable in subjects with low-amplitude SW such as older adults or patients suffering from neurodegeneration such as Parkinson disease (PD). However, existing algorithms to estimate the up-phase su… ▽ More Auditory stimulation of EEG slow waves (SW) during non-rapid eye movement (NREM) sleep has shown to improve cognitive function when it is delivered at the up-phase of SW. SW enhancement is particularly desirable in subjects with low-amplitude SW such as older adults or patients suffering from neurodegeneration such as Parkinson disease (PD). However, existing algorithms to estimate the up-phase suffer from a poor phase accuracy at low EEG amplitudes and when SW frequencies are not constant. We introduce two novel algorithms for real-time EEG phase estimation on autonomous wearable devices. The algorithms were based on a phase-locked loop (PLL) and, for the first time, a phase vocoder (PV). We compared these phase tracking algorithms with a simple amplitude threshold approach. The optimized algorithms were benchmarked for phase accuracy, the capacity to estimate phase at SW amplitudes between 20 and 60 microV, and SW frequencies above 1 Hz on 324 recordings from healthy older adults and PD patients. Furthermore, the algorithms were implemented on a wearable device and the computational efficiency and the performance was evaluated on simulated sleep EEG, as well as prospectively during a recording with a PD patient. All three algorithms delivered more than 70% of the stimulation triggers during the SW up-phase. The PV showed the highest capacity on targeting low-amplitude SW and SW with frequencies above 1 Hz. The testing on real-time hardware revealed that both PV and PLL have marginal impact on microcontroller load, while the efficiency of the PV was 4% lower than the PLL. Active auditory stimulation did not influence the phase tracking. This work demonstrated that phase-accurate auditory stimulation can be delivered during home-based sleep interventions with a wearable device also in populations with low-amplitude SW. △ Less

Submitted 4 March, 2022; originally announced March 2022.

Gamma-Shadowed Two-Ray with Diffuse Power Composite Fading Model

Authors: Pamela Njemcevic, Almir Maric

Abstract: In this paper, a novel gamma-shadowed two-ray with diffuse power (GS-TWDP) composite fading model is proposed. The model is intended for modeling propagation in the emerging wireless networks working at millimeter wave (mmWave) frequencies, and is obtained as a combination of TWDP distribution for description of multipath effects and gamma distribution for modeling variations due to shadowing. Aft… ▽ More In this paper, a novel gamma-shadowed two-ray with diffuse power (GS-TWDP) composite fading model is proposed. The model is intended for modeling propagation in the emerging wireless networks working at millimeter wave (mmWave) frequencies, and is obtained as a combination of TWDP distribution for description of multipath effects and gamma distribution for modeling variations due to shadowing. After derivation of the exact probability density function (PDF), cumulative distribution function (CDF) and moment generating functions (MGF) expressions are obtained. Proposed model is verified by comparing the analytically obtained results with those measured at 28 GHz and reported in literature. Two upper bound average symbol error probability (ASEP) expressions are then derived for M-ary rectangular quadrature amplitude modulation (RQAM) by employing Chernoff and Chiani approximations of Gaussian Q-function, and are used to investigate relationship between GS-TWDP parameters and system performance. All the results are verified by Monte-Carlo simulation. △ Less

Submitted 4 March, 2022; originally announced March 2022.

Error performance analysis of different modulations over TWDP fading channel

Authors: Almir Maric, Pamela Njemcevic

Abstract: Two-wave with diffuse power (TWDP) is one of the most promising distribution for description of a small-scale fading in the emerging mmWave band. However, traditional error performance analysis in these channels faces two fundamental issues. It is mostly based on conventional TWDP parameterization which is not in accordance with the model's underlying physical mechanisms and which hinders accurate… ▽ More Two-wave with diffuse power (TWDP) is one of the most promising distribution for description of a small-scale fading in the emerging mmWave band. However, traditional error performance analysis in these channels faces two fundamental issues. It is mostly based on conventional TWDP parameterization which is not in accordance with the model's underlying physical mechanisms and which hinders accurate observation of the impact of a model parameters on a system's performance metrics. In addition, the existing average bit/symbol error probability (ABEP/ASEP) expressions for most modulations and diversity schemes are available as approximations, which are accurate only for specific combinations of TWDP parameters. Accordingly, in this paper, the exact ASEP expressions are derived for M-ary rectangular quadrature amplitude modulation (RQAM) with coherent detection and for M-ary DPSK modulation, and are given in terms of physically justified parameters. Besides, in order to relax computational complexity of proposed exact ASEPs in high signal-to-noise ratio (SNR) region, their asymptotic counterparts are derived as the simple closed-form expressions, matching the exact ones for SNR>30dB. Results are verified by Monte-Carlo simulation. △ Less

Submitted 13 September, 2021; originally announced September 2021.

Comments: Submitted to IEEE Transactions on Wireless Communications

Moment-based Parameter Estimation for $Γ$-parameterized TWDP Model

Authors: Pamela Njemcevic, Almir Maric, Enio Kaljic

Abstract: In this paper, parameterization of a two-wave with diffuse power (TWDP) fading model is revised. Anomalies caused by using conventional TWDP parameters $K$ and $Δ$ are first identified, indicating that the existing moment-based estimators of a tuple $(K, Δ)$ are not able to provide accurate estimations for various combinations of their values. Therefore, a moment-based estimators for a newly propo… ▽ More In this paper, parameterization of a two-wave with diffuse power (TWDP) fading model is revised. Anomalies caused by using conventional TWDP parameters $K$ and $Δ$ are first identified, indicating that the existing moment-based estimators of a tuple $(K, Δ)$ are not able to provide accurate estimations for various combinations of their values. Therefore, a moment-based estimators for a newly proposed parameters $K$ and $Γ$ are derived and analyzed through asymptotic variance (AsV) and Cramer-Rao bound (CRB) metrics. The results are qualitatively compared to those obtained for a $(K, Δ)$ tuple, showing that moment-based estimators of the improved $Γ$-based parameterization managed to overcome all anomalies observed within the conventional TWDP parameterization. △ Less

Submitted 18 June, 2021; originally announced June 2021.

An Alternative Statistical Characterization of TWDP Fading Model

Authors: A. Maric, P. Njemcevic, E. Kaljic

Abstract: Two-wave with diffuse power (TWDP) is one of the most promising models for description of small-scale fading effects in emerging wireless networks. However, its current statistical characterization has several fundamental issues. Primarily, conventional TWDP parameterization is not in accordance with the model's underlying physical mechanisms. In addition, available TWDP expressions for PDF, CDF,… ▽ More Two-wave with diffuse power (TWDP) is one of the most promising models for description of small-scale fading effects in emerging wireless networks. However, its current statistical characterization has several fundamental issues. Primarily, conventional TWDP parameterization is not in accordance with the model's underlying physical mechanisms. In addition, available TWDP expressions for PDF, CDF, and MGF are given either in integral or approximate forms, or as mathematically untractable closed-form expressions. Consequently, the existing TWDP statistical characterization does not allow accurate evaluation of system performance (such as error and outage probability) in all fading conditions for most modulation and diversity techniques. In this paper, the existing statistical characterization of the TWDP fading model is improved by overcoming some of the noticed issues. In this regard, physically justified TWDP parameterization is proposed and used for further calculations. Additionally, exact infinite-series PDF and CDF are introduced. Based on these expressions, the exact MGF of the SNR is derived in form suitable for mathematical manipulations. The applicability of the proposed MGF for derivation of the exact average symbol error probability (ASEP) is demonstrated with the example of M-ary PSK modulation. Therefore, in this paper, M-ary PSK ASEP is derived as an explicit expression for the first time in the literature. The derived expression is further simplified for large SNR values in order to obtain a closed-form asymptotic ASEP, which is shown to be applicable for SNR > 20 dB. All proposed expressions are verified by Monte Carlo simulation in a variety of TWDP fading conditions. △ Less

Submitted 15 June, 2021; originally announced June 2021.

Comments: Submitted to IEEE Transactions on Wireless Communications

A Survey on Data Plane Flexibility and Programmability in Software-Defined Networking

Authors: Enio Kaljic, Almir Maric, Pamela Njemcevic, Mesud Hadzialic

Abstract: Software-defined networking (SDN) attracts the attention of the research community in recent years, as evidenced by a large number of survey and review papers. The architecture of SDN clearly recognizes three planes: application, control, and data plane. The application plane executes network applications; control plane regulates the rules for the entire network based on the requests generated by… ▽ More Software-defined networking (SDN) attracts the attention of the research community in recent years, as evidenced by a large number of survey and review papers. The architecture of SDN clearly recognizes three planes: application, control, and data plane. The application plane executes network applications; control plane regulates the rules for the entire network based on the requests generated by network applications; and based on the set rules, the controller configures the switches in the data plane. The role of the switch in the data plane is to simply forward packets based on the instructions given by the controller. By analyzing SDN-related research papers, it is observed that research, from the very beginning, is insufficiently focused on the data plane. Therefore, this paper gives a comprehensive overview of the data plane survey with particular emphasis on the problem of programmability and flexibility. The first part of the survey is dedicated to the evaluation of actual data plane architectures through several definitions and aspects of data plane flexibility and programmability. Then, an overview of SDN-related research was presented with the aim of identifying key factors influencing the gradual deviation from the original data plane architectures given with ForCES and OpenFlow specifications, which we called the data plane evolution. By establishing a correlation between the treated problem and the problem-solving approaches, the limitations of ForCES and OpenFlow data plane architectures were identified. Based on identified limitations, a generalization of approaches to addressing the problem of data plane flexibility and programmability is made. By examining generalized approaches, open issues have been identified, establishing the grounds for future research directions proposal. △ Less

Submitted 4 April, 2019; v1 submitted 11 March, 2019; originally announced March 2019.

Comments: Accepted version