Showing 1–26 of 26 results for author: Okhrin, O

An open-source framework for data-driven trajectory extraction from AIS data -- the $α$-method

Authors: Niklas Paulig, Ostap Okhrin

Abstract: Ship trajectories from Automatic Identification System (AIS) messages are important in maritime safety, domain awareness, and algorithmic testing. Although the specifications for transmitting and receiving AIS messages are fixed, it is well known that technical inaccuracies and lacking seafarer compliance lead to severe data quality impairment. This paper proposes an adaptable, data-driven, $α$-qu… ▽ More Ship trajectories from Automatic Identification System (AIS) messages are important in maritime safety, domain awareness, and algorithmic testing. Although the specifications for transmitting and receiving AIS messages are fixed, it is well known that technical inaccuracies and lacking seafarer compliance lead to severe data quality impairment. This paper proposes an adaptable, data-driven, $α$-quantile-based framework for decoding, constructing, splitting, and assessing trajectories from raw AIS records to improve transparency in AIS data mining. Results indicate the proposed filtering algorithm robustly extracts clean, long, and uninterrupted trajectories for further processing. An open-source Python implementation of the framework is provided. △ Less

Submitted 5 July, 2024; originally announced July 2024.

Leader-Follower Identification with Vehicle-Following Calibration for Non-Lane-Based Traffic

Authors: Mihir Mandar Kulkarni, Ankit Anil Chaudhari, Karthik K. Srinivasan, Bhargava Rama Chilukuri, Martin Treiber, Ostap Okhrin

Abstract: Most car-following models were originally developed for lane-based traffic. Over the past two decades, efforts have been made to calibrate car-following models for non-lane-based traffic. However, traffic conditions with varying vehicle dimensions, intermittent following, and multiple leaders often occur and make subjective Leader-Follower (LF) pair identification challenging. In this study, we an… ▽ More Most car-following models were originally developed for lane-based traffic. Over the past two decades, efforts have been made to calibrate car-following models for non-lane-based traffic. However, traffic conditions with varying vehicle dimensions, intermittent following, and multiple leaders often occur and make subjective Leader-Follower (LF) pair identification challenging. In this study, we analyze Vehicle Following (VF) behavior in traffic with a lack of lane discipline using high-resolution microscopic trajectory data collected in Chennai, India. The paper's main contributions are threefold. Firstly, three criteria are used to identify LF pairs from the driver's perspective, taking into account the intermittent following, lack of lane discipline due to consideration of lateral separation, and the presence of in-between vehicles. Second, the psycho-physical concept of the regime in the Wiedemann-99 model is leveraged to determine the traffic-dependent "influence zone" for LF identification. Third, a joint and consistent framework is proposed for identifying LF pairs and estimating VF parameters. The proposed methodology outperforms other heuristic-based LF identification methods from the literature in terms of quantitative and qualitative performance measures. The proposed approach can enable robust and more realistic LF identification and VF parameter calibration with practical applications such as LOS analysis, capacity, and travel time estimation. △ Less

Submitted 17 May, 2024; originally announced May 2024.

Towards Autonomous Driving with Small-Scale Cars: A Survey of Recent Development

Authors: Dianzhao Li, Paul Auerbach, Ostap Okhrin

Abstract: While engaging with the unfolding revolution in autonomous driving, a challenge presents itself, how can we effectively raise awareness within society about this transformative trend? While full-scale autonomous driving vehicles often come with a hefty price tag, the emergence of small-scale car platforms offers a compelling alternative. These platforms not only serve as valuable educational tools… ▽ More While engaging with the unfolding revolution in autonomous driving, a challenge presents itself, how can we effectively raise awareness within society about this transformative trend? While full-scale autonomous driving vehicles often come with a hefty price tag, the emergence of small-scale car platforms offers a compelling alternative. These platforms not only serve as valuable educational tools for the broader public and young generations but also function as robust research platforms, contributing significantly to the ongoing advancements in autonomous driving technology. This survey outlines various small-scale car platforms, categorizing them and detailing the research advancements accomplished through their usage. The conclusion provides proposals for promising future directions in the field. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Self-organized arrival system for urban air mobility

Authors: Martin Waltz, Ostap Okhrin, Michael Schultz

Abstract: Urban air mobility is an innovative mode of transportation in which electric vertical takeoff and landing (eVTOL) vehicles operate between nodes called vertiports. We outline a self-organized vertiport arrival system based on deep reinforcement learning. The airspace around the vertiport is assumed to be circular, and the vehicles can freely operate inside. Each aircraft is considered an individua… ▽ More Urban air mobility is an innovative mode of transportation in which electric vertical takeoff and landing (eVTOL) vehicles operate between nodes called vertiports. We outline a self-organized vertiport arrival system based on deep reinforcement learning. The airspace around the vertiport is assumed to be circular, and the vehicles can freely operate inside. Each aircraft is considered an individual agent and follows a shared policy, resulting in decentralized actions that are based on local information. We investigate the development of the reinforcement learning policy during training and illustrate how the algorithm moves from suboptimal local holding patterns to a safe and efficient final policy. The latter is validated in simulation-based scenarios and also deployed on small-scale unmanned aerial vehicles to showcase its real-world usability. △ Less

Submitted 4 April, 2024; originally announced April 2024.

Two-step dynamic obstacle avoidance

Authors: Fabian Hart, Martin Waltz, Ostap Okhrin

Abstract: Dynamic obstacle avoidance (DOA) is a fundamental challenge for any autonomous vehicle, independent of whether it operates in sea, air, or land. This paper proposes a two-step architecture for handling DOA tasks by combining supervised and reinforcement learning (RL). In the first step, we introduce a data-driven approach to estimate the collision risk of an obstacle using a recurrent neural netwo… ▽ More Dynamic obstacle avoidance (DOA) is a fundamental challenge for any autonomous vehicle, independent of whether it operates in sea, air, or land. This paper proposes a two-step architecture for handling DOA tasks by combining supervised and reinforcement learning (RL). In the first step, we introduce a data-driven approach to estimate the collision risk of an obstacle using a recurrent neural network, which is trained in a supervised fashion and offers robustness to non-linear obstacle movements. In the second step, we include these collision risk estimates into the observation space of an RL agent to increase its situational awareness.~We illustrate the power of our two-step approach by training different RL agents in a challenging environment that requires to navigate amid multiple obstacles. The non-linear movements of obstacles are exemplarily modeled based on stochastic processes and periodic patterns, although our architecture is suitable for any obstacle dynamics. The experiments reveal that integrating our collision risk metrics into the observation space doubles the performance in terms of reward, which is equivalent to halving the number of collisions in the considered environment. Furthermore, we show that the architecture's performance improvement is independent of the applied RL algorithm. △ Less

Submitted 28 November, 2023; originally announced November 2023.

2-Level Reinforcement Learning for Ships on Inland Waterways

Authors: Martin Waltz, Niklas Paulig, Ostap Okhrin

Abstract: This paper proposes a realistic modularized framework for controlling autonomous surface vehicles (ASVs) on inland waterways (IWs) based on deep reinforcement learning (DRL). The framework comprises two levels: a high-level local path planning (LPP) unit and a low-level path following (PF) unit, each consisting of a DRL agent. The LPP agent is responsible for planning a path under consideration of… ▽ More This paper proposes a realistic modularized framework for controlling autonomous surface vehicles (ASVs) on inland waterways (IWs) based on deep reinforcement learning (DRL). The framework comprises two levels: a high-level local path planning (LPP) unit and a low-level path following (PF) unit, each consisting of a DRL agent. The LPP agent is responsible for planning a path under consideration of nearby vessels, traffic rules, and the geometry of the waterway. We thereby transfer a recently proposed spatial-temporal recurrent neural network architecture to continuous action spaces. The LPP agent improves operational safety in comparison to a state-of-the-art artificial potential field method by increasing the minimum distance to other vessels by 65% on average. The PF agent performs low-level actuator control while accounting for shallow water influences and the environmental forces winds, waves, and currents. Compared with a proportional-integral-derivative (PID) controller, the PF agent yields only 61% of the mean cross-track error while significantly reducing control effort in terms of the required absolute rudder angle. Lastly, both agents are jointly validated in simulation, employing the lower Elbe in northern Germany as an example case and using real automatic identification system (AIS) trajectories to model the behavior of other ships. △ Less

Submitted 28 November, 2023; v1 submitted 25 July, 2023; originally announced July 2023.

Vision-based DRL Autonomous Driving Agent with Sim2Real Transfer

Authors: Dianzhao Li, Ostap Okhrin

Abstract: To achieve fully autonomous driving, vehicles must be capable of continuously performing various driving tasks, including lane kee** and car following, both of which are fundamental and well-studied driving ones. However, previous studies have mainly focused on individual tasks, and car following tasks have typically relied on complete leader-follower information to attain optimal performance. T… ▽ More To achieve fully autonomous driving, vehicles must be capable of continuously performing various driving tasks, including lane kee** and car following, both of which are fundamental and well-studied driving ones. However, previous studies have mainly focused on individual tasks, and car following tasks have typically relied on complete leader-follower information to attain optimal performance. To address this limitation, we propose a vision-based deep reinforcement learning (DRL) agent that can simultaneously perform lane kee** and car following maneuvers. To evaluate the performance of our DRL agent, we compare it with a baseline controller and use various performance metrics for quantitative analysis. Furthermore, we conduct a real-world evaluation to demonstrate the Sim2Real transfer capability of the trained DRL agent. To the best of our knowledge, our vision-based car following and lane kee** agent with Sim2Real transfer capability is the first of its kind. △ Less

Submitted 4 October, 2023; v1 submitted 19 May, 2023; originally announced May 2023.

A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer in Autonomous Driving

Authors: Dianzhao Li, Ostap Okhrin

Abstract: Deep Reinforcement Learning (DRL) has shown remarkable success in solving complex tasks across various research fields. However, transferring DRL agents to the real world is still challenging due to the significant discrepancies between simulation and reality. To address this issue, we propose a robust DRL framework that leverages platform-dependent perception modules to extract task-relevant info… ▽ More Deep Reinforcement Learning (DRL) has shown remarkable success in solving complex tasks across various research fields. However, transferring DRL agents to the real world is still challenging due to the significant discrepancies between simulation and reality. To address this issue, we propose a robust DRL framework that leverages platform-dependent perception modules to extract task-relevant information and train a lane-following and overtaking agent in simulation. This framework facilitates the seamless transfer of the DRL agent to new simulated environments and the real world with minimal effort. We evaluate the performance of the agent in various driving scenarios in both simulation and the real world, and compare it to human players and the PID baseline in simulation. Our proposed framework significantly reduces the gaps between different platforms and the Sim2Real gap, enabling the trained agent to achieve similar performance in both simulation and the real world, driving the vehicle effectively. △ Less

Submitted 30 April, 2024; v1 submitted 14 April, 2023; originally announced April 2023.

Robust Path Following on Rivers Using Bootstrapped Reinforcement Learning

Authors: Niklas Paulig, Ostap Okhrin

Abstract: This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges, such as high flow velocities or shallow banks, require controlled and precise movement of the ASV. A state-of-the-art bootstrapped Q-learning algorithm in combination with a vers… ▽ More This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges, such as high flow velocities or shallow banks, require controlled and precise movement of the ASV. A state-of-the-art bootstrapped Q-learning algorithm in combination with a versatile training environment generator leads to a robust and accurate rudder controller. To validate our results, we compare the path-following capabilities of the proposed approach to a vessel-specific PID controller on real-world river data from the lower- and middle Rhine, indicating that the DRL algorithm could effectively prove generalizability even in never-seen scenarios while simultaneously attaining high navigational accuracy. △ Less

Submitted 24 March, 2023; originally announced March 2023.

Adaptive local VAR for dynamic economic policy uncertainty spillover

Authors: Niels Gillmann, Ostap Okhrin

Abstract: The availability of data on economic uncertainty sparked a lot of interest in models that can timely quantify episodes of international spillovers of uncertainty. This challenging task involves trading off estimation accuracy for more timely quantification. This paper develops a local vector autoregressive model (VAR) that allows for adaptive estimation of the time-varying multivariate dependency.… ▽ More The availability of data on economic uncertainty sparked a lot of interest in models that can timely quantify episodes of international spillovers of uncertainty. This challenging task involves trading off estimation accuracy for more timely quantification. This paper develops a local vector autoregressive model (VAR) that allows for adaptive estimation of the time-varying multivariate dependency. Under local, we mean that for each point in time, we simultaneously estimate the longest interval on which the model is constant with the model parameters. The simulation study shows that the model can handle one or multiple sudden breaks as well as a smooth break in the data. The empirical application is done using monthly Economic Policy Uncertainty data. The local model highlights that the empirical data primarily consists of long homogeneous episodes, interrupted by a small number of heterogeneous ones, that correspond to crises. Based on this observation, we create a crisis index, which reflects the homogeneity of the sample over time. Furthermore, the local model shows superiority against the rolling window estimation. △ Less

Submitted 6 February, 2023; originally announced February 2023.

Enhanced method for reinforcement learning based dynamic obstacle avoidance by assessment of collision risk

Authors: Fabian Hart, Ostap Okhrin

Abstract: In the field of autonomous robots, reinforcement learning (RL) is an increasingly used method to solve the task of dynamic obstacle avoidance for mobile robots, autonomous ships, and drones. A common practice to train those agents is to use a training environment with random initialization of agent and obstacles. Such approaches might suffer from a low coverage of high-risk scenarios in training,… ▽ More In the field of autonomous robots, reinforcement learning (RL) is an increasingly used method to solve the task of dynamic obstacle avoidance for mobile robots, autonomous ships, and drones. A common practice to train those agents is to use a training environment with random initialization of agent and obstacles. Such approaches might suffer from a low coverage of high-risk scenarios in training, leading to impaired final performance of obstacle avoidance. This paper proposes a general training environment where we gain control over the difficulty of the obstacle avoidance task by using short training episodes and assessing the difficulty by two metrics: The number of obstacles and a collision risk metric. We found that shifting the training towards a greater task difficulty can massively increase the final performance. A baseline agent, using a traditional training environment based on random initialization of agent and obstacles and longer training episodes, leads to a significantly weaker performance. To prove the generalizability of the proposed approach, we designed two realistic use cases: A mobile robot and a maritime ship under the threat of approaching obstacles. In both applications, the previous results can be confirmed, which emphasizes the general usability of the proposed approach, detached from a specific application context and independent of the agent's dynamics. We further added Gaussian noise to the sensor signals, resulting in only a marginal degradation of performance and thus indicating solid robustness of the trained agent. △ Less

Submitted 8 December, 2022; originally announced December 2022.

Spatial-temporal recurrent reinforcement learning for autonomous ships

Authors: Martin Waltz, Ostap Okhrin

Abstract: This paper proposes a spatial-temporal recurrent neural network architecture for deep $Q$-networks that can be used to steer an autonomous ship. The network design makes it possible to handle an arbitrary number of surrounding target ships while offering robustness to partial observability. Furthermore, a state-of-the-art collision risk metric is proposed to enable an easier assessment of differen… ▽ More This paper proposes a spatial-temporal recurrent neural network architecture for deep $Q$-networks that can be used to steer an autonomous ship. The network design makes it possible to handle an arbitrary number of surrounding target ships while offering robustness to partial observability. Furthermore, a state-of-the-art collision risk metric is proposed to enable an easier assessment of different situations by the agent. The COLREG rules of maritime traffic are explicitly considered in the design of the reward function. The final policy is validated on a custom set of newly created single-ship encounters called `Around the Clock' problems and the commonly used Imazu (1987) problems, which include 18 multi-ship scenarios. Performance comparisons with artificial potential field and velocity obstacle methods demonstrate the potential of the proposed approach for maritime path planning. Furthermore, the new architecture exhibits robustness when it is deployed in multi-agent scenarios and it is compatible with other deep reinforcement learning algorithms, including actor-critic frameworks. △ Less

Submitted 15 May, 2023; v1 submitted 2 November, 2022; originally announced November 2022.

Vessel-following model for inland waterways based on deep reinforcement learning

Authors: Fabian Hart, Ostap Okhrin, Martin Treiber

Abstract: While deep reinforcement learning (RL) has been increasingly applied in designing car-following models in the last years, this study aims at investigating the feasibility of RL-based vehicle-following for complex vehicle dynamics and strong environmental disturbances. As a use case, we developed an inland waterways vessel-following model based on realistic vessel dynamics, which considers environm… ▽ More While deep reinforcement learning (RL) has been increasingly applied in designing car-following models in the last years, this study aims at investigating the feasibility of RL-based vehicle-following for complex vehicle dynamics and strong environmental disturbances. As a use case, we developed an inland waterways vessel-following model based on realistic vessel dynamics, which considers environmental influences, such as varying stream velocity and river profile. We extracted natural vessel behavior from anonymized AIS data to formulate a reward function that reflects a realistic driving style next to comfortable and safe navigation. Aiming at high generalization capabilities, we propose an RL training environment that uses stochastic processes to model leading trajectory and river dynamics. To validate the trained model, we defined different scenarios that have not been seen in training, including realistic vessel-following on the Middle Rhine. Our model demonstrated safe and comfortable driving in all scenarios, proving excellent generalization abilities. Furthermore, traffic oscillations could effectively be dampened by deploying the trained model on a sequence of following vessels. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Vulnerability-CoVaR: Investigating the Crypto-market

Authors: Martin Waltz, Abhay Kumar Singh, Ostap Okhrin

Abstract: This paper proposes an important extension to Conditional Value-at-Risk (CoVaR), the popular systemic risk measure, and investigates its properties on the cryptocurrency market. The proposed Vulnerability-CoVaR (VCoVaR) is defined as the Value-at-Risk (VaR) of a financial system or institution, given that at least one other institution is equal or below its VaR. The VCoVaR relaxes normality assump… ▽ More This paper proposes an important extension to Conditional Value-at-Risk (CoVaR), the popular systemic risk measure, and investigates its properties on the cryptocurrency market. The proposed Vulnerability-CoVaR (VCoVaR) is defined as the Value-at-Risk (VaR) of a financial system or institution, given that at least one other institution is equal or below its VaR. The VCoVaR relaxes normality assumptions and is estimated via copula. While important theoretical findings of the measure are detailed, the empirical study analyzes how different distressing events of the cryptocurrencies impact the risk level of each other. The results show that Litecoin displays the largest impact on Bitcoin and that each cryptocurrency is significantly affected if an event of joint distress among the remaining market participants occurs. The VCoVaR is shown to capture domino effects better than other CoVaR extensions. △ Less

Submitted 21 March, 2022; originally announced March 2022.

Addressing Maximization Bias in Reinforcement Learning with Two-Sample Testing

Authors: Martin Waltz, Ostap Okhrin

Abstract: Value-based reinforcement-learning algorithms have shown strong results in games, robotics, and other real-world applications. Overestimation bias is a known threat to those algorithms and can lead to dramatic performance decreases or even complete algorithmic failure. We frame the bias problem statistically and consider it an instance of estimating the maximum expected value (MEV) of a set of ran… ▽ More Value-based reinforcement-learning algorithms have shown strong results in games, robotics, and other real-world applications. Overestimation bias is a known threat to those algorithms and can lead to dramatic performance decreases or even complete algorithmic failure. We frame the bias problem statistically and consider it an instance of estimating the maximum expected value (MEV) of a set of random variables. We propose the $T$-Estimator (TE) based on two-sample testing for the mean, that flexibly interpolates between over- and underestimation by adjusting the significance level of the underlying hypothesis tests. A generalization, termed $K$-Estimator (KE), obeys the same bias and variance bounds as the TE while relying on a nearly arbitrary kernel function. We introduce modifications of $Q$-Learning and the Bootstrapped Deep $Q$-Network (BDQN) using the TE and the KE, and prove convergence in the tabular setting. Furthermore, we propose an adaptive variant of the TE-based BDQN that dynamically adjusts the significance level to minimize the absolute estimation bias. All proposed estimators and algorithms are thoroughly tested and validated on diverse tasks and environments, illustrating the bias control and performance potential of the TE and KE. △ Less

Submitted 18 October, 2023; v1 submitted 20 January, 2022; originally announced January 2022.

Modified DDPG car-following model with a real-world human driving experience with CARLA simulator

Authors: Dianzhao Li, Ostap Okhrin

Abstract: In the autonomous driving field, fusion of human knowledge into Deep Reinforcement Learning (DRL) is often based on the human demonstration recorded in a simulated environment. This limits the generalization and the feasibility of application in real-world traffic. We propose a two-stage DRL method to train a car-following agent, that modifies the policy by leveraging the real-world human driving… ▽ More In the autonomous driving field, fusion of human knowledge into Deep Reinforcement Learning (DRL) is often based on the human demonstration recorded in a simulated environment. This limits the generalization and the feasibility of application in real-world traffic. We propose a two-stage DRL method to train a car-following agent, that modifies the policy by leveraging the real-world human driving experience and achieves performance superior to the pure DRL agent. Training a DRL agent is done within CARLA framework with Robot Operating System (ROS). For evaluation, we designed different driving scenarios to compare the proposed two-stage DRL car-following agent with other agents. After extracting the "good" behavior from the human driver, the agent becomes more efficient and reasonable, which makes this autonomous agent more suitable for Human-Robot Interaction (HRI) traffic. △ Less

Submitted 19 September, 2022; v1 submitted 29 December, 2021; originally announced December 2021.

Missing Velocity in Dynamic Obstacle Avoidance based on Deep Reinforcement Learning

Authors: Fabian Hart, Martin Waltz, Ostap Okhrin

Abstract: We introduce a novel approach to dynamic obstacle avoidance based on Deep Reinforcement Learning by defining a traffic type independent environment with variable complexity. Filling a gap in the current literature, we thoroughly investigate the effect of missing velocity information on an agent's performance in obstacle avoidance tasks. This is a crucial issue in practice since several sensors yie… ▽ More We introduce a novel approach to dynamic obstacle avoidance based on Deep Reinforcement Learning by defining a traffic type independent environment with variable complexity. Filling a gap in the current literature, we thoroughly investigate the effect of missing velocity information on an agent's performance in obstacle avoidance tasks. This is a crucial issue in practice since several sensors yield only positional information of objects or vehicles. We evaluate frequently-applied approaches in scenarios of partial observability, namely the incorporation of recurrency in the deep neural networks and simple frame-stacking. For our analysis, we rely on state-of-the-art model-free deep RL algorithms. The lack of velocity information is found to significantly impact the performance of an agent. Both approaches - recurrency and frame-stacking - cannot consistently replace missing velocity information in the observation space. However, in simplified scenarios, they can significantly boost performance and stabilize the overall training procedure. △ Less

Submitted 28 December, 2021; v1 submitted 23 December, 2021; originally announced December 2021.

Formulation and validation of a car-following model based on deep reinforcement learning

Authors: Fabian Hart, Ostap Okhrin, Martin Treiber

Abstract: We propose and validate a novel car following model based on deep reinforcement learning. Our model is trained to maximize externally given reward functions for the free and car-following regimes rather than reproducing existing follower trajectories. The parameters of these reward functions such as desired speed, time gap, or accelerations resemble that of traditional models such as the Intellige… ▽ More We propose and validate a novel car following model based on deep reinforcement learning. Our model is trained to maximize externally given reward functions for the free and car-following regimes rather than reproducing existing follower trajectories. The parameters of these reward functions such as desired speed, time gap, or accelerations resemble that of traditional models such as the Intelligent Driver Model (IDM) and allow for explicitly implementing different driving styles. Moreover, they partially lift the black-box nature of conventional neural network models. The model is trained on leading speed profiles governed by a truncated Ornstein-Uhlenbeck process reflecting a realistic leader's kinematics. This allows for arbitrary driving situations and an infinite supply of training data. For various parameterizations of the reward functions, and for a wide variety of artificial and real leader data, the model turned out to be unconditionally string stable, comfortable, and crash-free. String stability has been tested with a platoon of five followers following an artificial and a real leading trajectory. A cross-comparison with the IDM calibrated to the goodness-of-fit of the relative gaps showed a higher reward compared to the traditional model and a better goodness-of-fit. △ Less

Submitted 29 September, 2021; originally announced September 2021.

Outer power transformations of hierarchical Archimedean copulas: Construction, sampling and estimation

Authors: Jan Górecki, Marius Hofert, Ostap Okhrin

Abstract: A large number of commonly used parametric Archimedean copula (AC) families are restricted to a single parameter, connected to a concordance measure such as Kendall's tau. This often leads to poor statistical fits, particularly in the joint tails, and can sometimes even limit the ability to model concordance or tail dependence mathematically. This work suggests outer power (OP) transformations of… ▽ More A large number of commonly used parametric Archimedean copula (AC) families are restricted to a single parameter, connected to a concordance measure such as Kendall's tau. This often leads to poor statistical fits, particularly in the joint tails, and can sometimes even limit the ability to model concordance or tail dependence mathematically. This work suggests outer power (OP) transformations of Archimedean generators to overcome these limitations. The copulas generated by OP-transformed generators can, for example, allow one to capture both a given concordance measure and a tail dependence coefficient simultaneously. For exchangeable OP-transformed ACs, a formula for computing tail dependence coefficients is obtained, as well as two feasible OP AC estimators are proposed and their properties studied by simulation. For hierarchical extensions of OP-transformed ACs, a new construction principle, efficient sampling and parameter estimation are addressed. By simulation, convergence rate and standard errors of the proposed estimator are studied. Excellent tail fitting capabilities of OP-transformed hierarchical AC models are demonstrated in a risk management application. The results show that the OP transformation is able to improve the statistical fit of exchangeable ACs, particularly of those that cannot capture upper tail dependence or strong concordance, as well as the statistical fit of hierarchical ACs, especially in terms of tail dependence and higher dimensions. Given how comparably simple it is to include OP transformations into existing exchangeable and hierarchical AC models, this transformation provides an attractive trade-off between computational effort and statistical improvement. △ Less

Submitted 31 March, 2020; v1 submitted 30 March, 2020; originally announced March 2020.

Comments: 38 pages, 17 figures

MSC Class: 62H99

Infinitely Stochastic Micro Forecasting

Authors: Matúš Maciak, Ostap Okhrin, Michal Pešta

Abstract: Forecasting costs is now a front burner in empirical economics. We propose an unconventional tool for stochastic prediction of future expenses based on the individual (micro) developments of recorded events. Consider a firm, enterprise, institution, or state, which possesses knowledge about particular historical events. For each event, there is a series of several related subevents: payments or lo… ▽ More Forecasting costs is now a front burner in empirical economics. We propose an unconventional tool for stochastic prediction of future expenses based on the individual (micro) developments of recorded events. Consider a firm, enterprise, institution, or state, which possesses knowledge about particular historical events. For each event, there is a series of several related subevents: payments or losses spread over time, which all leads to an infinitely stochastic process at the end. Nevertheless, the issue is that some already occurred events do not have to be necessarily reported. The aim lies in forecasting future subevent flows coming from already reported, occurred but not reported, and yet not occurred events. Our methodology is illustrated on quantitative risk assessment, however, it can be applied to other areas such as startups, epidemics, war damages, advertising and commercials, digital payments, or drug prescription as manifested in the paper. As a theoretical contribution, inference for infinitely stochastic processes is developed. In particular, a non-homogeneous Poisson process with non-homogeneous Poisson processes as marks is used, which includes for instance the Cox process as a special case. △ Less

Submitted 19 September, 2019; v1 submitted 28 August, 2019; originally announced August 2019.

MSC Class: 62F12; 62M20; 60G55; 62P05; 97M30

Dynamic and granular loss reserving with copulae

Authors: Matúš Maciak, Ostap Okhrin, Michal Pešta

Abstract: An intensive research sprang up for stochastic methods in insurance during the past years. To meet all future claims rising from policies, it is requisite to quantify the outstanding loss liabilities. Loss reserving methods based on aggregated data from run-off triangles are predominantly used to calculate the claims reserves. Conventional reserving techniques have some disadvantages: loss of info… ▽ More An intensive research sprang up for stochastic methods in insurance during the past years. To meet all future claims rising from policies, it is requisite to quantify the outstanding loss liabilities. Loss reserving methods based on aggregated data from run-off triangles are predominantly used to calculate the claims reserves. Conventional reserving techniques have some disadvantages: loss of information from the policy and the claim's development due to the aggregation, zero or negative cells in the triangle; usually small number of observations in the triangle; only few observations for recent accident years; and sensitivity to the most recent paid claims. To overcome these dilemmas, granular loss reserving methods for individual claim-by-claim data will be derived. Reserves' estimation is a crucial part of the risk valuation process, which is now a front burner in economics. Since there is a growing demand for prediction of total reserves for different types of claims or even multiple lines of business, a time-varying copula framework for granular reserving will be established. △ Less

Submitted 5 January, 2018; originally announced January 2018.

Index of Environmental Awareness in Russia - MIMIC Approaches for Different Economic Situations

Authors: Dilya Khakimova, Stefanie Lösch, Danny Wende, Hans Wiesmeth, Ostap Okhrin

Abstract: The paper addresses the issue of environmental awareness in the regions of the Russian Federation. Russia provides an important study area to investigate the relationship between economic development and environmental consciousness in general. This paper introduces an index of environmental awareness, which is derived as a latent variable from various categories of search entries in Yandex, the pr… ▽ More The paper addresses the issue of environmental awareness in the regions of the Russian Federation. Russia provides an important study area to investigate the relationship between economic development and environmental consciousness in general. This paper introduces an index of environmental awareness, which is derived as a latent variable from various categories of search entries in Yandex, the prominent Russian search engine, during two periods in years 2014 and 2015. These indicators are presumably dependent on certain causes, which are also integrated into the model. The resulting Multiple Indicators-Multiple Causes model allows to estimate the proposed index of environmental awareness and to rank the Russian regions for each period. Comparing the results of 2014 and 2015 is especially interesting, because of the RUR devaluation at the end of 2014. In additional, we answer the question of the existence of an Environmental Kuznets Curve with respect to environmental understanding. △ Less

Submitted 22 June, 2017; v1 submitted 28 March, 2017; originally announced March 2017.

Comments: We are very grateful to Yandex. Research was supported by RSF grant Nr. 15-18-20029 'Projection of optimal socio-economic systems in turbulence of external and internal environment'. D. Khakimova wishes to acknowledge the support of the Ministry of Education and Science of the Russian Federation, grant No. 14.U04.31.0002, administered through the NES CSDSI

Optimal Shrinkage Estimator for High-Dimensional Mean Vector

Authors: Taras Bodnar, Ostap Okhrin, Nestor Parolya

Abstract: In this paper we derive the optimal linear shrinkage estimator for the high-dimensional mean vector using random matrix theory. The results are obtained under the assumption that both the dimension $p$ and the sample size $n$ tend to infinity in such a way that $p/n \to c\in(0,\infty)$. Under weak conditions imposed on the underlying data generating mechanism, we find the asymptotic equivalents to… ▽ More In this paper we derive the optimal linear shrinkage estimator for the high-dimensional mean vector using random matrix theory. The results are obtained under the assumption that both the dimension $p$ and the sample size $n$ tend to infinity in such a way that $p/n \to c\in(0,\infty)$. Under weak conditions imposed on the underlying data generating mechanism, we find the asymptotic equivalents to the optimal shrinkage intensities and estimate them consistently. The proposed nonparametric estimator for the high-dimensional mean vector has a simple structure and is proven to minimize asymptotically, with probability $1$, the quadratic loss when $c\in(0,1)$. When $c\in(1, \infty)$ we modify the estimator by using a feasible estimator for the precision covariance matrix. To this end, an exhaustive simulation study and an application to real data are provided where the proposed estimator is compared with known benchmarks from the literature. It turns out that the existing estimators of the mean vector, including the new proposal, converge to the sample mean vector when the true mean vector has an unbounded Euclidean norm. △ Less

Submitted 14 July, 2018; v1 submitted 28 October, 2016; originally announced October 2016.

Comments: 20 pages, UPDATE2: revised version of the manuscript accepted for publication in Journal of Multivariate Analysis

Conditional Least Squares and Copulae in Claims Reserving for a Single Line of Business

Authors: Michal Pešta, Ostap Okhrin

Abstract: One of the main goals in non-life insurance is to estimate the claims reserve distribution. A generalized time series model, that allows for modeling the conditional mean and variance of the claim amounts, is proposed for the claims development. On contrary to the classical stochastic reserving techniques, the number of model parameters does not depend on the number of development periods, which l… ▽ More One of the main goals in non-life insurance is to estimate the claims reserve distribution. A generalized time series model, that allows for modeling the conditional mean and variance of the claim amounts, is proposed for the claims development. On contrary to the classical stochastic reserving techniques, the number of model parameters does not depend on the number of development periods, which leads to a more precise forecasting. Moreover, the time series innovations for the consecutive claims are not considered to be independent anymore. Conditional least squares are used for model parameter estimation and consistency of such estimate is proved. Copula approach is used for modeling the dependence structure, which improves the precision of the reserve distribution estimate as well. Real data examples are provided as an illustration of the potential benefits of the presented approach. △ Less

Submitted 19 June, 2013; originally announced June 2013.

Comments: Submitted on June 19, 2013

MSC Class: 60G10; 60G25; 60J20; 62H10; 62H20; 62J02; 62P05

On the Generating Functional of the special case of S-Stopped Branching Processes

Authors: Ostap Okhrin

Abstract: In this paper starting process with the infinite number of types of particles μ(t) generate stopped branching process ξ(t), if by falling of the first one into the non empty set S process stops. Here we consider the generating functional of the upper defined process. In this paper starting process with the infinite number of types of particles μ(t) generate stopped branching process ξ(t), if by falling of the first one into the non empty set S process stops. Here we consider the generating functional of the upper defined process. △ Less

Submitted 8 August, 2011; originally announced August 2011.

Comments: accepted for publication in Visn. L'viv. Univ., Ser. Mekh.-Mat. (Bulletin of the Lviv University, Series in Mechanics and Mathematics)

Asymptotic behaviour of the S-stopped branching processes with countable state space

Authors: Iryna Kyrychynska, Ostap Okhrin, Yaroslav Yeleyko

Abstract: he starting process with countable number of types μ(t) generates a stopped branching process ξ(t). The starting process stops, by falling into the nonempty set S. It is assumed, that the starting process is subcritical, indecomposable and noncyclic. It is proved, that the extinction probability converges to the cyclic function with period 1. he starting process with countable number of types μ(t) generates a stopped branching process ξ(t). The starting process stops, by falling into the nonempty set S. It is assumed, that the starting process is subcritical, indecomposable and noncyclic. It is proved, that the extinction probability converges to the cyclic function with period 1. △ Less

Submitted 6 August, 2011; originally announced August 2011.

MSC Class: 60J80

Journal ref: Visn. L'viv. Univ., Ser. Mekh.-Mat. (Bulletin of the Lviv University), Series in Mechanics and Mathematics Vol.67, pp.119-129 (2007)