Skip to main content

Showing 1–20 of 20 results for author: Ritz, F

.
  1. arXiv:2404.03359  [pdf, other

    cs.LG cs.AI cs.NE

    REACT: Revealing Evolutionary Action Consequence Trajectories for Interpretable Reinforcement Learning

    Authors: Philipp Altmann, Céline Davignon, Maximilian Zorn, Fabian Ritz, Claudia Linnhoff-Popien, Thomas Gabor

    Abstract: To enhance the interpretability of Reinforcement Learning (RL), we propose Revealing Evolutionary Action Consequence Trajectories (REACT). In contrast to the prevalent practice of validating RL models based on their optimal behavior learned during training, we posit that considering a range of edge-case trajectories provides a more comprehensive understanding of their inherent behavior. To induce… ▽ More

    Submitted 4 April, 2024; originally announced April 2024.

    Comments: 12 pages, 12 figures

  2. arXiv:2401.07056  [pdf, other

    cs.AI cs.MA

    Aquarium: A Comprehensive Framework for Exploring Predator-Prey Dynamics through Multi-Agent Reinforcement Learning Algorithms

    Authors: Michael Kölle, Yannick Erpelding, Fabian Ritz, Thomy Phan, Steffen Illium, Claudia Linnhoff-Popien

    Abstract: Recent advances in Multi-Agent Reinforcement Learning have prompted the modeling of intricate interactions between agents in simulated environments. In particular, the predator-prey dynamics have captured substantial interest and various simulations been tailored to unique requirements. To prevent further time-intensive developments, we introduce Aquarium, a comprehensive Multi-Agent Reinforcement… ▽ More

    Submitted 13 January, 2024; originally announced January 2024.

    Comments: Accepted at ICAART

  3. arXiv:2401.07043  [pdf, other

    quant-ph cs.AI cs.LG

    Quantum Advantage Actor-Critic for Reinforcement Learning

    Authors: Michael Kölle, Mohamad Hgog, Fabian Ritz, Philipp Altmann, Maximilian Zorn, Jonas Stein, Claudia Linnhoff-Popien

    Abstract: Quantum computing offers efficient encapsulation of high-dimensional states. In this work, we propose a novel quantum reinforcement learning approach that combines the Advantage Actor-Critic algorithm with variational quantum circuits by substituting parts of the classical components. This approach addresses reinforcement learning's scalability concerns while maintaining high performance. We empir… ▽ More

    Submitted 13 January, 2024; originally announced January 2024.

    Comments: Accepted at ICAART 24

  4. CROP: Towards Distributional-Shift Robust Reinforcement Learning using Compact Reshaped Observation Processing

    Authors: Philipp Altmann, Fabian Ritz, Leonard Feuchtinger, Jonas Nüßlein, Claudia Linnhoff-Popien, Thomy Phan

    Abstract: The safe application of reinforcement learning (RL) requires generalization from limited training data to unseen scenarios. Yet, fulfilling tasks under changing circumstances is a key challenge in RL. Current state-of-the-art approaches for generalization apply data augmentation techniques to increase the diversity of training data. Even though this prevents overfitting to the training environment… ▽ More

    Submitted 5 December, 2023; v1 submitted 26 April, 2023; originally announced April 2023.

    Comments: 9 pages, 5 figures, published at IJCAI 2023

  5. arXiv:2301.07421  [pdf, other

    cs.LG

    DIRECT: Learning from Sparse and Shifting Rewards using Discriminative Reward Co-Training

    Authors: Philipp Altmann, Thomy Phan, Fabian Ritz, Thomas Gabor, Claudia Linnhoff-Popien

    Abstract: We propose discriminative reward co-training (DIRECT) as an extension to deep reinforcement learning algorithms. Building upon the concept of self-imitation learning (SIL), we introduce an imitation buffer to store beneficial trajectories generated by the policy determined by their return. A discriminator network is trained concurrently to the policy to distinguish between trajectories generated b… ▽ More

    Submitted 18 January, 2023; originally announced January 2023.

    Comments: 9 pages, 10 figures, under review

    ACM Class: I.2.6

  6. arXiv:2301.01649  [pdf, other

    cs.MA

    Attention-Based Recurrence for Multi-Agent Reinforcement Learning under Stochastic Partial Observability

    Authors: Thomy Phan, Fabian Ritz, Philipp Altmann, Maximilian Zorn, Jonas Nüßlein, Michael Kölle, Thomas Gabor, Claudia Linnhoff-Popien

    Abstract: Stochastic partial observability poses a major challenge for decentralized coordination in multi-agent reinforcement learning but is largely neglected in state-of-the-art research due to a strong focus on state-based centralized training for decentralized execution (CTDE) and benchmarks that lack sufficient stochasticity like StarCraft Multi-Agent Challenge (SMAC). In this paper, we propose Attent… ▽ More

    Submitted 27 December, 2023; v1 submitted 4 January, 2023; originally announced January 2023.

    Comments: Accepted to ICML 2023

  7. Capturing Dependencies within Machine Learning via a Formal Process Model

    Authors: Fabian Ritz, Thomy Phan, Andreas Sedlmeier, Philipp Altmann, Jan Wieghardt, Reiner Schmid, Horst Sauer, Cornel Klein, Claudia Linnhoff-Popien, Thomas Gabor

    Abstract: The development of Machine Learning (ML) models is more than just a special case of software development (SD): ML models acquire properties and fulfill requirements even without direct human interaction in a seemingly uncontrollable manner. Nonetheless, the underlying processes can be described in a formal way. We define a comprehensive SD process model for ML that encompasses most tasks and artif… ▽ More

    Submitted 10 August, 2022; originally announced August 2022.

    Comments: 10 pages, 5 figures, draft; the final version will appear in the proceedings of the International Symposium on Leveraging Applications of Formal Methods (ISoLA) 2022

    Journal ref: ISoLA 2022: Leveraging Applications of Formal Methods, Verification and Validation. Adaptation and Learning. pp 249-265

  8. SAT-MARL: Specification Aware Training in Multi-Agent Reinforcement Learning

    Authors: Fabian Ritz, Thomy Phan, Robert Müller, Thomas Gabor, Andreas Sedlmeier, Marc Zeller, Jan Wieghardt, Reiner Schmid, Horst Sauer, Cornel Klein, Claudia Linnhoff-Popien

    Abstract: A characteristic of reinforcement learning is the ability to develop unforeseen strategies when solving problems. While such strategies sometimes yield superior performance, they may also result in undesired or even dangerous behavior. In industrial scenarios, a system's behavior also needs to be predictable and lie within defined ranges. To enable the agents to learn (how) to align with a given s… ▽ More

    Submitted 14 December, 2020; originally announced December 2020.

    Comments: 9 pages, 5 figures; accepted as a full paper at ICAART 2021 (http://www.icaart.org/)

    Journal ref: Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, 28-37, 2021

  9. arXiv:2012.06282  [pdf, other

    cs.SD cs.LG eess.AS

    Analysis of Feature Representations for Anomalous Sound Detection

    Authors: Robert Müller, Steffen Illium, Fabian Ritz, Kyrill Schmid

    Abstract: In this work, we thoroughly evaluate the efficacy of pretrained neural networks as feature extractors for anomalous sound detection. In doing so, we leverage the knowledge that is contained in these neural networks to extract semantically rich features (representations) that serve as input to a Gaussian Mixture Model which is used as a density estimator to model normality. We compare feature extra… ▽ More

    Submitted 11 December, 2020; originally announced December 2020.

    Comments: ICAART 2021, 10 pages, 7 figures, 2 tables

  10. arXiv:2012.06280  [pdf, other

    cs.LG cs.SD eess.AS

    Acoustic Leak Detection in Water Networks

    Authors: Robert Müller, Steffen Illium, Fabian Ritz, Tobias Schröder, Christian Platschek, Jörg Ochs, Claudia Linnhoff-Popien

    Abstract: In this work, we present a general procedure for acoustic leak detection in water networks that satisfies multiple real-world constraints such as energy efficiency and ease of deployment. Based on recordings from seven contact microphones attached to the water supply network of a municipal suburb, we trained several shallow and deep anomaly detection models. Inspired by how human experts detect le… ▽ More

    Submitted 5 January, 2021; v1 submitted 11 December, 2020; originally announced December 2020.

    Comments: ICAART 2021, 8 pages, 4 figures, 1 table

  11. arXiv:2006.03429  [pdf, other

    eess.AS cs.CV cs.LG cs.SD

    Acoustic Anomaly Detection for Machine Sounds based on Image Transfer Learning

    Authors: Robert Müller, Fabian Ritz, Steffen Illium, Claudia Linnhoff-Popien

    Abstract: In industrial applications, the early detection of malfunctioning factory machinery is crucial. In this paper, we consider acoustic malfunction detection via transfer learning. Contrary to the majority of current approaches which are based on deep autoencoders, we propose to extract features using neural networks that were pretrained on the task of image classification. We then use these features… ▽ More

    Submitted 11 December, 2020; v1 submitted 5 June, 2020; originally announced June 2020.

    Comments: ICAART 2021, 8 pages, 2 figures, 1 table

  12. arXiv:2004.14035  [pdf, other

    quant-ph cs.AI

    The Holy Grail of Quantum Artificial Intelligence: Major Challenges in Accelerating the Machine Learning Pipeline

    Authors: Thomas Gabor, Leo Sünkel, Fabian Ritz, Thomy Phan, Lenz Belzner, Christoph Roch, Sebastian Feld, Claudia Linnhoff-Popien

    Abstract: We discuss the synergetic connection between quantum computing and artificial intelligence. After surveying current approaches to quantum artificial intelligence and relating them to a formal model for machine learning processes, we deduce four major challenges for the future of quantum artificial intelligence: (i) Replace iterative training with faster quantum algorithms, (ii) distill the experie… ▽ More

    Submitted 29 April, 2020; originally announced April 2020.

    Comments: 6 pages, 4 figures, accepted at the 1st International Workshop on Quantum Software Engineering (Q-SE 2020) at ICSE 2020 and to be published in the corresponding proceedings

  13. Soccer Team Vectors

    Authors: Robert Müller, Stefan Langer, Fabian Ritz, Christoph Roch, Steffen Illium, Claudia Linnhoff-Popien

    Abstract: In this work we present STEVE - Soccer TEam VEctors, a principled approach for learning real valued vectors for soccer teams where similar teams are close to each other in the resulting vector space. STEVE only relies on freely available information about the matches teams played in the past. These vectors can serve as input to various machine learning tasks. Evaluating on the task of team market… ▽ More

    Submitted 31 March, 2020; v1 submitted 30 July, 2019; originally announced August 2019.

    Comments: 11 pages, 1 figure; This paper was presented at the 6th Workshop on Machine Learning and Data Mining for Sports Analytics at ECML/PKDD 2019, Würzburg, Germany, 2019

    Journal ref: Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2019. Communications in Computer and Information Science, vol 1168. Springer, Cham

  14. Deep Neural Baselines for Computational Paralinguistics

    Authors: Daniel Elsner, Stefan Langer, Fabian Ritz, Robert Müller, Steffen Illium

    Abstract: Detecting sleepiness from spoken language is an ambitious task, which is addressed by the Interspeech 2019 Computational Paralinguistics Challenge (ComParE). We propose an end-to-end deep learning approach to detect and classify patterns reflecting sleepiness in the human voice. Our approach is based solely on a moderately complex deep neural network architecture. It may be applied directly on the… ▽ More

    Submitted 5 July, 2019; originally announced July 2019.

    Comments: 5 pages, 3 figures; This paper was accepted at INTERSPEECH 2019, Graz, 15-19th September 2019. DOI will be added after publishment of the accepted paper

    Journal ref: Proc. Interspeech 2019, 2388-2392

  15. The Impact of Uncle Rewards on Selfish Mining in Ethereum

    Authors: Fabian Ritz, Alf Zugenmaier

    Abstract: Many of today's crypto currencies use blockchains as decentralized ledgers and secure them with proof of work. In case of a fork of the chain, Bitcoin's rule for achieving consensus is selecting the longest chain and discarding the other chain as stale. It has been demonstrated that this consensus rule has a weakness against selfish mining in which the selfish miner exploits the variance in block… ▽ More

    Submitted 10 August, 2018; v1 submitted 22 May, 2018; originally announced May 2018.

    Comments: 8 pages, 8 figures

    Journal ref: 2018 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW), London, 2018, pp. 50-57

  16. Two-body effects in coherent eta-meson photoproduction on the deuteron in the region of the S_11(1535) resonance

    Authors: F. Ritz, H. Arenhoevel

    Abstract: Coherent $η$-meson photoproduction on the deuteron has been studied, where the emphasis is on the relative importance of two-body contributions from hadronic rescattering and electromagnetic meson exchange currents besides the impulse approximation. For the elementary photoproduction amplitude a coupled resonance model developed by Bennhold and Tanabe has been used which fits reasonably well the… ▽ More

    Submitted 8 June, 2001; v1 submitted 28 November, 2000; originally announced November 2000.

    Comments: 24 pages of LaTeX using revtex, 23 postscript figures, few clarifying remarks and one figure added, final version accepted for publication in Phys.Rev.C

    Report number: MKPH-T-00-06

    Journal ref: Phys.Rev. C64 (2001) 034005

  17. Elastic electron deuteron scattering with consistent meson exchange and relativistic contributions of leading order

    Authors: Hartmuth Arenhoevel, Frank Ritz, Thomas Wilbois

    Abstract: The influence of relativistic contributions to elastic electron deuteron scattering is studied systematically at low and intermediate momentum transfers ($Q^2\leq 30$ fm$^{-2}$). In a $(p/M)$-expansion, all leading order relativistic $π$-exchange contributions consistent with the Bonn OBEPQ models are included. In addition, static heavy meson exchange currents including boost terms and lowest or… ▽ More

    Submitted 1 December, 1999; v1 submitted 4 October, 1999; originally announced October 1999.

    Comments: 15 pages Latex including 5 figures, final version accepted for publication in Phys.Rev.C Details of changes: (i) The notation of the curves in Figs. 1 and 2 have been clarified with respect to left and right panels. (ii) In Figs. 3 and 4 an experimental point for T_20 has been added and a corresponding reference [48] (iii) At the end of the text we have added a paragraph concerning the quality of the Bonn OBEPQ potentials

    Report number: MKPH-T-99-20

    Journal ref: Phys.Rev. C61 (2000) 034002

  18. Rescattering effects in coherent eta-photoproduction on the deuteron

    Authors: F. Ritz, H. Arenhoevel

    Abstract: Rescattering effects in coherent eta photoproduction on the deuteron are studied in the region of the S_11(1535) resonance. For the elementary reaction mechanism on the nucleon, an effective isobar model with inclusion of resonances and Born terms is used. The resonance parameters are fixed by considering pion photoproduction only. For the coherent eta production on the deuteron we have consider… ▽ More

    Submitted 9 October, 1998; originally announced October 1998.

    Comments: 8 pages LaTeX using revtex, 6 postscript figures (using epsf.sty)

    Report number: MKPH-T-98-17

    Journal ref: Phys.Lett. B447 (1999) 15-22

  19. Relativistic Effects and the Role of Heavy Meson Exchange in Deuteron Photodisintegration

    Authors: F. Ritz, H. Arenhoevel, T. Wilbois

    Abstract: Relativistic effects and the role of heavy meson exchange in deuteron photodisintegration are studied systematically for photon energies below the pion production threshold. In a (p/M)-expansion, all leading order relativistic one-body and pi-exchange as well as all static heavy meson exchange currents consistent with the Bonn OBEPQ model are included. In addition, one- and two-body boost effect… ▽ More

    Submitted 28 July, 1997; originally announced July 1997.

    Comments: 14 pages revtex including 8 postscript figures

    Report number: MKPH-T-97-19

    Journal ref: Few Body Syst. 24 (1998) 123-138

  20. Consistent Treatment of Relativistic Effects in Electrodisintegration of the Deuteron

    Authors: F. Ritz, H. Goeller, T. Wilbois, H. Arenhoevel

    Abstract: The influence of relativistic contributions to deuteron electrodisintegration is systematically studied in various kinematic regions of energy and momentum transfer. As theoretical framework the equation-of-motion and the unitarily equivalent S-matrix approaches are used. In a (p/M)-expansion, all leading order relativistic $π$-exchange contributions consistent with the Bonn OBEPQ model are incl… ▽ More

    Submitted 14 November, 1996; originally announced November 1996.

    Comments: 41 pages revtex including 15 postscript figures

    Report number: MKPH-T-96-29

    Journal ref: Phys.Rev.C55:2214-2233,1997