Showing 1–50 of 276 results for author: Mueller, L

Quantum-Inspired Fluid Simulation of 2D Turbulence with GPU Acceleration

Authors: Leonhard Hölscher, Pooja Rao, Lukas Müller, Johannes Klepsch, Andre Luckow, Tobias Stollenwerk, Frank K. Wilhelm

Abstract: Tensor network algorithms can efficiently simulate complex quantum many-body systems by utilizing knowledge of their structure and entanglement. These methodologies have been adapted recently for solving the Navier-Stokes equations, which describe a spectrum of fluid phenomena, from the aerodynamics of vehicles to weather patterns. Within this quantum-inspired paradigm, velocity is encoded as matr… ▽ More Tensor network algorithms can efficiently simulate complex quantum many-body systems by utilizing knowledge of their structure and entanglement. These methodologies have been adapted recently for solving the Navier-Stokes equations, which describe a spectrum of fluid phenomena, from the aerodynamics of vehicles to weather patterns. Within this quantum-inspired paradigm, velocity is encoded as matrix product states (MPS), effectively harnessing the analogy between interscale correlations of fluid dynamics and entanglement in quantum many-body physics. This particular tensor structure is also called quantics tensor train (QTT). By utilizing NVIDIA's cuQuantum library to perform parallel tensor computations on GPUs, our adaptation speeds up simulations by up to 12.1 times. This allows us to study the algorithm in terms of its applicability, scalability, and performance. By simulating two qualitatively different but commonly encountered 2D flow problems at high Reynolds numbers up to $1\times10^7$ using a fourth-order time step** scheme, we find that the algorithm has a potential advantage over direct numerical simulations in the turbulent regime as the requirements for grid resolution increase drastically. In addition, we derive the scaling $χ=\mathcal{O}(\text{poly}(1/ε))$ for the maximum bond dimension $χ$ of MPS representing turbulent flow fields, with an error $ε$, based on the spectral distribution of turbulent kinetic energy. Our findings motivate further exploration of related quantum algorithms and other tensor network methods. △ Less

Submitted 25 June, 2024; originally announced June 2024.

Categorified Open Topological Field Theories

Authors: Lukas Müller, Lukas Woike

Abstract: In this short note, we classify linear categorified open topological field theories in dimension two by pivotal Grothendieck-Verdier categories. In combination with recently developed string-net techniques, this leads to a new description of the spaces of conformal blocks of Drinfeld centers $Z(\mathcal{C})$ of pivotal finite tensor categories $\mathcal{C}$ in terms of the modular envelope of the… ▽ More In this short note, we classify linear categorified open topological field theories in dimension two by pivotal Grothendieck-Verdier categories. In combination with recently developed string-net techniques, this leads to a new description of the spaces of conformal blocks of Drinfeld centers $Z(\mathcal{C})$ of pivotal finite tensor categories $\mathcal{C}$ in terms of the modular envelope of the cyclic associative operad. If $\mathcal{C}$ is unimodular, we prove that the space of conformal blocks inherits the structure of a module over the algebra of class functions of $\mathcal{C}$ for every free boundary component. As a further application, we prove that the sewing along a boundary circle for the modular functor for $Z(\mathcal{C})$ can be decomposed into a sewing procedure along an interval and the application of the partial trace. Finally, we construct map** class group representations from Grothendieck-Verdier categories that are not necessarily rigid and make precise how these generalize existing constructions. △ Less

Submitted 17 June, 2024; originally announced June 2024.

Comments: 14 pages, some diagrams

Report number: ANR-22-CPJ1-0001-01

Aligning Transformers with Weisfeiler-Leman

Authors: Luis Müller, Christopher Morris

Abstract: Graph neural network architectures aligned with the $k$-dimensional Weisfeiler--Leman ($k$-WL) hierarchy offer theoretically well-understood expressive power. However, these architectures often fail to deliver state-of-the-art predictive performance on real-world graphs, limiting their practical utility. While recent works aligning graph transformer architectures with the $k$-WL hierarchy have sho… ▽ More Graph neural network architectures aligned with the $k$-dimensional Weisfeiler--Leman ($k$-WL) hierarchy offer theoretically well-understood expressive power. However, these architectures often fail to deliver state-of-the-art predictive performance on real-world graphs, limiting their practical utility. While recent works aligning graph transformer architectures with the $k$-WL hierarchy have shown promising empirical results, employing transformers for higher orders of $k$ remains challenging due to a prohibitive runtime and memory complexity of self-attention as well as impractical architectural assumptions, such as an infeasible number of attention heads. Here, we advance the alignment of transformers with the $k$-WL hierarchy, showing stronger expressivity results for each $k$, making them more feasible in practice. In addition, we develop a theoretical framework that allows the study of established positional encodings such as Laplacian PEs and SPE. We evaluate our transformers on the large-scale PCQM4Mv2 dataset, showing competitive predictive performance with the state-of-the-art and demonstrating strong downstream performance when fine-tuning them on small-scale molecular datasets. Our code is available at https://github.com/luis-mueller/wl-transformers. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: Accepted at ICML 2024

Pose Priors from Language Models

Authors: Sanjay Subramanian, Evonne Ng, Lea Müller, Dan Klein, Shiry Ginosar, Trevor Darrell

Abstract: We present a zero-shot pose optimization method that enforces accurate physical contact constraints when estimating the 3D pose of humans. Our central insight is that since language is often used to describe physical interaction, large pretrained text-based models can act as priors on pose estimation. We can thus leverage this insight to improve pose estimation by converting natural language des… ▽ More We present a zero-shot pose optimization method that enforces accurate physical contact constraints when estimating the 3D pose of humans. Our central insight is that since language is often used to describe physical interaction, large pretrained text-based models can act as priors on pose estimation. We can thus leverage this insight to improve pose estimation by converting natural language descriptors, generated by a large multimodal model (LMM), into tractable losses to constrain the 3D pose optimization. Despite its simplicity, our method produces surprisingly compelling pose reconstructions of people in close contact, correctly capturing the semantics of the social and physical interactions. We demonstrate that our method rivals more complex state-of-the-art approaches that require expensive human annotation of contact points and training specialized models. Moreover, unlike previous approaches, our method provides a unified framework for resolving self-contact and person-to-person contact. △ Less

Submitted 6 May, 2024; originally announced May 2024.

TimeFlows: Visualizing Process Chronologies from Vast Collections of Heterogeneous Information Objects

Authors: Max Lonysa Muller, Erik Saaman, Jan Martijn E. M. van der Werf, Charles Jeurgens, Hajo A. Reijers

Abstract: In many fact-finding investigations, notably parliamentary inquiries, process chronologies are created to reconstruct how a controversial policy or decision came into existence. Current approaches, like timelines, lack the expressiveness to represent the variety of relations in which historic events may link to the overall chronology. This obfuscates the nature of the interdependence among the eve… ▽ More In many fact-finding investigations, notably parliamentary inquiries, process chronologies are created to reconstruct how a controversial policy or decision came into existence. Current approaches, like timelines, lack the expressiveness to represent the variety of relations in which historic events may link to the overall chronology. This obfuscates the nature of the interdependence among the events, and the texts from which they are distilled. Based on explorative interviews with expert analysts, we propose an extended, rich set of relationships. We describe how these can be visualized as TimeFlows. We provide an example of such a visualization by illustrating the Childcare Benefits Scandal -- an affair that deeply affected Dutch politics in recent years. This work extends the scope of existing process discovery research into the direction of unveiling non-repetitive processes from unstructured information objects. △ Less

Submitted 2 May, 2024; v1 submitted 10 April, 2024; originally announced April 2024.

Comments: 16 pages, accepted at RCIS 2024

$\texttt{MiniMol}$: A Parameter-Efficient Foundation Model for Molecular Learning

Authors: Kerstin Kläser, Błażej Banaszewski, Samuel Maddrell-Mander, Callum McLean, Luis Müller, Ali Parviz, Shenyang Huang, Andrew Fitzgibbon

Abstract: In biological tasks, data is rarely plentiful as it is generated from hard-to-gather measurements. Therefore, pre-training foundation models on large quantities of available data and then transfer to low-data downstream tasks is a promising direction. However, how to design effective foundation models for molecular learning remains an open question, with existing approaches typically focusing on m… ▽ More In biological tasks, data is rarely plentiful as it is generated from hard-to-gather measurements. Therefore, pre-training foundation models on large quantities of available data and then transfer to low-data downstream tasks is a promising direction. However, how to design effective foundation models for molecular learning remains an open question, with existing approaches typically focusing on models with large parameter capacities. In this work, we propose $\texttt{MiniMol}$, a foundational model for molecular learning with 10 million parameters. $\texttt{MiniMol}$ is pre-trained on a mix of roughly 3300 sparsely defined graph- and node-level tasks of both quantum and biological nature. The pre-training dataset includes approximately 6 million molecules and 500 million labels. To demonstrate the generalizability of $\texttt{MiniMol}$ across tasks, we evaluate it on downstream tasks from the Therapeutic Data Commons (TDC) ADMET group showing significant improvements over the prior state-of-the-art foundation model across 17 tasks. $\texttt{MiniMol}$ will be a public and open-sourced model for future research. △ Less

Submitted 23 April, 2024; originally announced April 2024.

Dagger $n$-categories

Authors: Giovanni Ferrer, Brett Hungar, Theo Johnson-Freyd, Cameron Krulewski, Lukas Müller, Nivedita, David Penneys, David Reutter, Claudia Scheimbauer, Luuk Stehouwer, Chetan Vuppulury

Abstract: We present a coherent definition of dagger $(\infty,n)$-category in terms of equivariance data trivialized on parts of the category. Our main example is the bordism higher category $\mathbf{Bord}_{n}^X$. This allows us to define a reflection-positive topological quantum field theory to be a higher dagger functor from $\mathbf{Bord}_{n}^X$ to some target higher dagger category $\mathcal{C}$. Our de… ▽ More We present a coherent definition of dagger $(\infty,n)$-category in terms of equivariance data trivialized on parts of the category. Our main example is the bordism higher category $\mathbf{Bord}_{n}^X$. This allows us to define a reflection-positive topological quantum field theory to be a higher dagger functor from $\mathbf{Bord}_{n}^X$ to some target higher dagger category $\mathcal{C}$. Our definitions have a tunable parameter: a group $G$ acting on the $(\infty,1)$-category $\mathbf{Cat}_{(\infty,n)}$ of $(\infty,n)$-categories. Different choices for $G$ accommodate different flavours of higher dagger structure; the universal choice is $G = \operatorname{Aut}(\mathbf{Cat}_{(\infty,n)}) = (\mathbb{Z}/2\mathbb{Z})^n$, which implements dagger involutions on all levels of morphisms. The Stratified Cobordism Hypothesis suggests that there should be a map $\mathrm{PL}(n) \to \operatorname{Aut}(\mathbf{AdjCat}_{(\infty,n)})$, where $\mathrm{PL}(n)$ is the group of piecewise-linear automorphisms of $\mathbb{R}^n$ and $\mathbf{AdjCat}_{(\infty,n)}$ the $(\infty,1)$-category of $(\infty,n)$-categories with all adjoints; we conjecture more strongly that $\operatorname{Aut}(\mathbf{AdjCat}_{(\infty,n)}) \cong \mathrm{PL}(n)$. Based on this conjecture we propose a notion of dagger $(\infty,n)$-category with unitary duality or $\mathrm{PL}(n)$-dagger category. We outline how to construct a $\mathrm{PL}(n)$-dagger structure on the fully-extended bordism $(\infty,n)$-category $\mathbf{Bord}_n^X$ for any stable tangential structure $X$; our outline restricts to a rigorous construction of a coherent dagger structure on the unextended bordism $(\infty,1)$-category $\mathbf{Bord}_{n,n-1}^X$. The article is a report on the results of a workshop held in Summer 2023, and is intended as a sketch of the big picture and an invitation for more thorough development. △ Less

Submitted 23 April, 2024; v1 submitted 3 March, 2024; originally announced March 2024.

Comments: 18 pages; v2 corrected definition of dagger $(\infty,n)$-category with unitary duality

Transformers and Cortical Waves: Encoders for Pulling In Context Across Time

Authors: Lyle Muller, Patricia S. Churchland, Terrence J. Sejnowski

Abstract: The capabilities of transformer networks such as ChatGPT and other Large Language Models (LLMs) have captured the world's attention. The crucial computational mechanism underlying their performance relies on transforming a complete input sequence - for example, all the words in a sentence - into a long "encoding vector" that allows transformers to learn long-range temporal dependencies in naturali… ▽ More The capabilities of transformer networks such as ChatGPT and other Large Language Models (LLMs) have captured the world's attention. The crucial computational mechanism underlying their performance relies on transforming a complete input sequence - for example, all the words in a sentence - into a long "encoding vector" that allows transformers to learn long-range temporal dependencies in naturalistic sequences. Specifically, "self-attention" applied to this encoding vector enhances temporal context in transformers by computing associations between pairs of words in the input sequence. We suggest that waves of neural activity traveling across single cortical areas or multiple regions at the whole-brain scale could implement a similar encoding principle. By encapsulating recent input history into a single spatial pattern at each moment in time, cortical waves may enable temporal context to be extracted from sequences of sensory inputs, the same computational principle used in transformers. △ Less

Submitted 2 July, 2024; v1 submitted 25 January, 2024; originally announced January 2024.

Comments: 25 pages, 5 figures

Towards Principled Graph Transformers

Authors: Luis Müller, Daniel Kusuma, Blai Bonet, Christopher Morris

Abstract: Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world tasks, limiting their practical impact. In contrast, global attention-based models such as graph transformers demonstrate strong performance in practice, but com… ▽ More Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world tasks, limiting their practical impact. In contrast, global attention-based models such as graph transformers demonstrate strong performance in practice, but comparing their expressive power with the k-WL hierarchy remains challenging, particularly since these architectures rely on positional or structural encodings for their expressivity and predictive performance. To address this, we show that the recently proposed Edge Transformer, a global attention model operating on node pairs instead of nodes, has at least 3-WL expressive power. Empirically, we demonstrate that the Edge Transformer surpasses other theoretically aligned architectures regarding predictive performance while not relying on positional or structural encodings. Our code is available at https://github.com/luis-mueller/towards-principled-gts △ Less

Submitted 24 May, 2024; v1 submitted 18 January, 2024; originally announced January 2024.

Influence of Core Substitution on the Electronic Structure of Benzobisthiadiazoles

Authors: Mohsen Ajdari, Ronja Pappenberger, Caja Annweiler, Tobias Kaczun, Leon Mueller, Larissa Winkelmann, Lukas Ahrens, Uwe H. F. Bunz, Andreas Dreuw, Petra Tegeder

Abstract: Benzobisthiadiazoles (BBTs) are promising organic semiconductors for applications in field effect transistors and solar cells, since they possess a strong electron-accepting character. Thereby the electronic structure of organic/metal interfaces and within thin films is essential for the performance of organic electronic devices. Here, we study the structural and the electronic properties of two B… ▽ More Benzobisthiadiazoles (BBTs) are promising organic semiconductors for applications in field effect transistors and solar cells, since they possess a strong electron-accepting character. Thereby the electronic structure of organic/metal interfaces and within thin films is essential for the performance of organic electronic devices. Here, we study the structural and the electronic properties of two BBTs, with different core substitution pattern, a phenyl (BBT-Ph) and thiophene (BBT-Th) derivative adsorbed on Au(111) using vibrational and electronic high-resolution electron energy loss spectroscopy in combination with state-of-the-art quantum chemical calculations. In the mono- and multilayer both BBTs adopt a planar adsorption geometry with the molecular backbone as well as the phenyl and thiophene side groups are oriented parallel to the gold substrate. The energies of the lowest excited electronic singlet states and the first triplet state (T1) are determined. The optical gap is found to be 2.2 eV for BBT-Ph and 1.6 eV for BBT-Th. The energy of T1 is identified to be 1.2 eV in BBT-Ph and in the case of BBT-Th 0.7 eV. Thus, both the optical gap size as well as the T1 energy are drastically reduced in BBT-Th compared to BBT-Ph. Based on our quantum chemical calculations this is attributed to the electron-rich nature of the five-membered thiophene rings in conjunction with their preference for planar geometries. Variation of the substitution pattern in BBTs opens the opportunity for tailoring their electronic properties. △ Less

Submitted 8 January, 2024; originally announced January 2024.

Antistatic-antistatic-light-light potentials from lattice QCD

Authors: Lasse Mueller, Pedro Bicudo, Marina Krstic Marinkovic, Marc Wagner

Abstract: We present results for tetraquark potentials of two static anti-quarks $\bar b \bar b$ in the presence of two light quarks $u$ and/or $d$. We improve on existing results by computing the static potential also for off-axis separations, which increases the number of data points significantly. Moreover, we compute for the first time $\bar b \bar b u s$ potentials. We present results for tetraquark potentials of two static anti-quarks $\bar b \bar b$ in the presence of two light quarks $u$ and/or $d$. We improve on existing results by computing the static potential also for off-axis separations, which increases the number of data points significantly. Moreover, we compute for the first time $\bar b \bar b u s$ potentials. △ Less

Submitted 28 December, 2023; originally announced December 2023.

Comments: 8 pages, 3 figures, 1 table, parallel talk given at the 40th International Symposium on Lattice Field Theory (Lattice2023), July 31st - August 4th 2023, Fermi National Accelerator Laboratory, Naperville, Illinois, USA

The Lyubashenko Modular Functor for Drinfeld Centers via Non-Semisimple String-Nets

Authors: Lukas Müller, Christoph Schweigert, Lukas Woike, Yang Yang

Abstract: The Levin-Wen string-nets of a spherical fusion category $\mathcal{C}$ describe, by results of Kirillov and Bartlett, the representations of map** class groups of closed surfaces obtained from the Turaev-Viro construction applied to $\mathcal{C}$. We provide a far-reaching generalization of this statement to arbitrary pivotal finite tensor categories, including non-semisimple or non-spherical on… ▽ More The Levin-Wen string-nets of a spherical fusion category $\mathcal{C}$ describe, by results of Kirillov and Bartlett, the representations of map** class groups of closed surfaces obtained from the Turaev-Viro construction applied to $\mathcal{C}$. We provide a far-reaching generalization of this statement to arbitrary pivotal finite tensor categories, including non-semisimple or non-spherical ones: We show that the finitely cocompleted string-net modular functor built from the projective objects of a pivotal finite tensor category is equivalent to Lyubashenko's modular functor built from the Drinfeld center $Z(\mathcal{C})$. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: v1: 33 pages, 5 figures

Report number: [ZMP-HH/23-23], Hamburger Beitraege zur Mathematik Nr. 955, ANR-22-CPJ1-0001-01

Navigating the Synthetic Realm: Harnessing Diffusion-based Models for Laparoscopic Text-to-Image Generation

Authors: Simeon Allmendinger, Patrick Hemmer, Moritz Queisner, Igor Sauer, Leopold Müller, Johannes Jakubik, Michael Vössing, Niklas Kühl

Abstract: Recent advances in synthetic imaging open up opportunities for obtaining additional data in the field of surgical imaging. This data can provide reliable supplements supporting surgical applications and decision-making through computer vision. Particularly the field of image-guided surgery, such as laparoscopic and robotic-assisted surgery, benefits strongly from synthetic image datasets and virtu… ▽ More Recent advances in synthetic imaging open up opportunities for obtaining additional data in the field of surgical imaging. This data can provide reliable supplements supporting surgical applications and decision-making through computer vision. Particularly the field of image-guided surgery, such as laparoscopic and robotic-assisted surgery, benefits strongly from synthetic image datasets and virtual surgical training methods. Our study presents an intuitive approach for generating synthetic laparoscopic images from short text prompts using diffusion-based generative models. We demonstrate the usage of state-of-the-art text-to-image architectures in the context of laparoscopic imaging with regard to the surgical removal of the gallbladder as an example. Results on fidelity and diversity demonstrate that diffusion-based models can acquire knowledge about the style and semantics in the field of image-guided surgery. A validation study with a human assessment survey underlines the realistic nature of our synthetic data, as medical personnel detects actual images in a pool with generated images causing a false-positive rate of 66%. In addition, the investigation of a state-of-the-art machine learning model to recognize surgical actions indicates enhanced results when trained with additional generated images of up to 5.20%. Overall, the achieved image quality contributes to the usage of computer-generated images in surgical applications and enhances its path to maturity. △ Less

Submitted 5 December, 2023; originally announced December 2023.

THz-Driven Coherent Magnetization Dynamics in a Labyrinth Domain State

Authors: M Riepp, A Philippi-Kobs, L Mueller, R Froemter, W Roseker, R Rysov, M Walther, K Bagschik, M Hennes, D Gupta, S Marotzke, S Bajt, R Pan, T Golz, N Stojanovic, C Boeglin, G Gruebel

Abstract: Terahertz (THz) light pulses can be used for an ultrafast coherent manipulation of the magnetization. Driving the magnetization at THz frequencies is currently the fastest way of writing magnetic information in ferromagnets. Using time-resolved resonant magnetic scattering, we gain new insights to the THz-driven coherent magnetization dynamics on nanometer length scales. We observe ultrafast demag… ▽ More Terahertz (THz) light pulses can be used for an ultrafast coherent manipulation of the magnetization. Driving the magnetization at THz frequencies is currently the fastest way of writing magnetic information in ferromagnets. Using time-resolved resonant magnetic scattering, we gain new insights to the THz-driven coherent magnetization dynamics on nanometer length scales. We observe ultrafast demagnetization and coherent magnetization oscillations that are governed by a time-dependent dam**. This dam** is determined by the interplay of lattice heating and magnetic anisotropy reduction revealing an upper speed limit for THz-induced magnetization switching. We show that in the presence of nanometer-sized magnetic domains, the ultrafast magnetization oscillations are associated with a correlated beating of the domain walls. The overall domain structure thereby remains largely unaffected which highlights the applicability of THz-induced switching on the nanoscale. △ Less

Submitted 5 December, 2023; originally announced December 2023.

Comments: 10 pages, 8 figures and 54 references

Image segmentation with traveling waves in an exactly solvable recurrent neural network

Authors: Luisa H. B. Liboni, Roberto C. Budzinski, Alexandra N. Busch, Sindy Löwe, Thomas A. Keller, Max Welling, Lyle E. Muller

Abstract: We study image segmentation using spatiotemporal dynamics in a recurrent neural network where the state of each unit is given by a complex number. We show that this network generates sophisticated spatiotemporal dynamics that can effectively divide an image into groups according to a scene's structural characteristics. Using an exact solution of the recurrent network's dynamics, we present a preci… ▽ More We study image segmentation using spatiotemporal dynamics in a recurrent neural network where the state of each unit is given by a complex number. We show that this network generates sophisticated spatiotemporal dynamics that can effectively divide an image into groups according to a scene's structural characteristics. Using an exact solution of the recurrent network's dynamics, we present a precise description of the mechanism underlying object segmentation in this network, providing a clear mathematical interpretation of how the network performs this task. We then demonstrate a simple algorithm for object segmentation that generalizes across inputs ranging from simple geometric objects in grayscale images to natural images. Object segmentation across all images is accomplished with one recurrent neural network that has a single, fixed set of weights. This demonstrates the expressive potential of recurrent neural networks when constructed using a mathematical approach that brings together their structure, dynamics, and computation. △ Less

Submitted 28 November, 2023; originally announced November 2023.

An exact mathematical description of computation with transient spatiotemporal dynamics in a complex-valued neural network

Authors: Roberto C. Budzinski, Alexandra N. Busch, Samuel Mestern, Erwan Martin, Luisa H. B. Liboni, Federico W. Pasini, Ján Mináč, Todd Coleman, Wataru Inoue, Lyle E. Muller

Abstract: We study a complex-valued neural network (cv-NN) with linear, time-delayed interactions. We report the cv-NN displays sophisticated spatiotemporal dynamics, including partially synchronized ``chimera'' states. We then use these spatiotemporal dynamics, in combination with a nonlinear readout, for computation. The cv-NN can instantiate dynamics-based logic gates, encode short-term memories, and med… ▽ More We study a complex-valued neural network (cv-NN) with linear, time-delayed interactions. We report the cv-NN displays sophisticated spatiotemporal dynamics, including partially synchronized ``chimera'' states. We then use these spatiotemporal dynamics, in combination with a nonlinear readout, for computation. The cv-NN can instantiate dynamics-based logic gates, encode short-term memories, and mediate secure message passing through a combination of interactions and time delays. The computations in this system can be fully described in an exact, closed-form mathematical expression. Finally, using direct intracellular recordings of neurons in slices from neocortex, we demonstrate that computations in the cv-NN are decodable by living biological neurons. These results demonstrate that complex-valued linear systems can perform sophisticated computations, while also being exactly solvable. Taken together, these results open future avenues for design of highly adaptable, bio-hybrid computing systems that can interface seamlessly with other neural networks. △ Less

Submitted 27 November, 2023; originally announced November 2023.

The Dehn Twist Action for Quantum Representations of Map** Class Groups

Authors: Lukas Müller, Lukas Woike

Abstract: We calculate the Dehn twist action on the spaces of conformal blocks of a not necessarily semisimple modular category. In particular, we give the order of the Dehn twists under the map** class group representations of closed surfaces. For Dehn twists about non-separating simple closed curves, we prove that this order is the order of the ribbon twist, thereby generalizing a result that De Renzi-G… ▽ More We calculate the Dehn twist action on the spaces of conformal blocks of a not necessarily semisimple modular category. In particular, we give the order of the Dehn twists under the map** class group representations of closed surfaces. For Dehn twists about non-separating simple closed curves, we prove that this order is the order of the ribbon twist, thereby generalizing a result that De Renzi-Gainutdinov-Geer-Patureau-Mirand-Runkel obtained for the small quantum group. In the separating case, we express the order using the order of the ribbon twist on monoidal powers of the canonical end. As an application, we prove that the Johnson kernel of the map** class group acts trivially if and only if for the canonical end the ribbon twist and double braiding with itself are trivial. We give a similar result for the visibility of the Torelli group. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 20 pages, 2 figures

Report number: ANR-22-CPJ1-0001-01

Redefining the Laparoscopic Spatial Sense: AI-based Intra- and Postoperative Measurement from Stereoimages

Authors: Leopold Müller, Patrick Hemmer, Moritz Queisner, Igor Sauer, Simeon Allmendinger, Johannes Jakubik, Michael Vössing, Niklas Kühl

Abstract: A significant challenge in image-guided surgery is the accurate measurement task of relevant structures such as vessel segments, resection margins, or bowel lengths. While this task is an essential component of many surgeries, it involves substantial human effort and is prone to inaccuracies. In this paper, we develop a novel human-AI-based method for laparoscopic measurements utilizing stereo vis… ▽ More A significant challenge in image-guided surgery is the accurate measurement task of relevant structures such as vessel segments, resection margins, or bowel lengths. While this task is an essential component of many surgeries, it involves substantial human effort and is prone to inaccuracies. In this paper, we develop a novel human-AI-based method for laparoscopic measurements utilizing stereo vision that has been guided by practicing surgeons. Based on a holistic qualitative requirements analysis, this work proposes a comprehensive measurement method, which comprises state-of-the-art machine learning architectures, such as RAFT-Stereo and YOLOv8. The developed method is assessed in various realistic experimental evaluation environments. Our results outline the potential of our method achieving high accuracies in distance measurements with errors below 1 mm. Furthermore, on-surface measurements demonstrate robustness when applied in challenging environments with textureless regions. Overall, by addressing the inherent challenges of image-guided surgery, we lay the foundation for a more robust and accurate solution for intra- and postoperative measurements, enabling more precise, safe, and efficient surgical procedures. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Comments: 38th AAAI Conference on Artificial Intelligence (AAAI-24)

Theory of transient chimeras in finite Sakaguchi-Kuramoto networks

Authors: Roberto C. Budzinski, James W. C. Graham, Ján Mináč, Lyle E. Muller

Abstract: Chimera states are a phenomenon in which order and disorder can co-exist within a network that is fully homogeneous. Precisely how transient chimeras emerge in finite networks of Kuramoto oscillators with phase-lag remains unclear. Utilizing an operator-based framework to study nonlinear oscillator networks at finite scale, we reveal the spatiotemporal impact of the adjacency matrix eigenvectors o… ▽ More Chimera states are a phenomenon in which order and disorder can co-exist within a network that is fully homogeneous. Precisely how transient chimeras emerge in finite networks of Kuramoto oscillators with phase-lag remains unclear. Utilizing an operator-based framework to study nonlinear oscillator networks at finite scale, we reveal the spatiotemporal impact of the adjacency matrix eigenvectors on the Sakaguchi-Kuramoto dynamics. We identify a specific condition for the emergence of transient chimeras in these finite networks: the eigenvectors of the network adjacency matrix create a combination of a zero phase-offset mode and low spatial frequency waves traveling in opposite directions. This combination of eigenvectors leads directly to the coherent and incoherent clusters in the chimera. This approach provides two specific analytical predictions: (1) a precise formula predicting the combination of connectivity and phase-lag that creates transient chimeras, (2) a mathematical procedure for rewiring arbitrary networks to produce transient chimeras. △ Less

Submitted 2 November, 2023; originally announced November 2023.

Towards Foundational Models for Molecular Learning on Large-Scale Multi-Task Datasets

Authors: Dominique Beaini, Shenyang Huang, Joao Alex Cunha, Zhiyi Li, Gabriela Moisescu-Pareja, Oleksandr Dymov, Samuel Maddrell-Mander, Callum McLean, Frederik Wenkel, Luis Müller, Jama Hussein Mohamud, Ali Parviz, Michael Craig, Michał Koziarski, Jiarui Lu, Zhaocheng Zhu, Cristian Gabellini, Kerstin Klaser, Josef Dean, Cas Wognum, Maciej Sypetkowski, Guillaume Rabusseau, Reihaneh Rabbany, Jian Tang, Christopher Morris , et al. (10 additional authors not shown)

Abstract: Recently, pre-trained foundation models have enabled significant advancements in multiple fields. In molecular machine learning, however, where datasets are often hand-curated, and hence typically small, the lack of datasets with labeled features, and codebases to manage those datasets, has hindered the development of foundation models. In this work, we present seven novel datasets categorized by… ▽ More Recently, pre-trained foundation models have enabled significant advancements in multiple fields. In molecular machine learning, however, where datasets are often hand-curated, and hence typically small, the lack of datasets with labeled features, and codebases to manage those datasets, has hindered the development of foundation models. In this work, we present seven novel datasets categorized by size into three distinct categories: ToyMix, LargeMix and UltraLarge. These datasets push the boundaries in both the scale and the diversity of supervised labels for molecular learning. They cover nearly 100 million molecules and over 3000 sparsely defined tasks, totaling more than 13 billion individual labels of both quantum and biological nature. In comparison, our datasets contain 300 times more data points than the widely used OGB-LSC PCQM4Mv2 dataset, and 13 times more than the quantum-only QM1B dataset. In addition, to support the development of foundational models based on our proposed datasets, we present the Graphium graph machine learning library which simplifies the process of building and training molecular machine learning models for multi-task and multi-level molecular datasets. Finally, we present a range of baseline results as a starting point of multi-task and multi-level training on these datasets. Empirically, we observe that performance on low-resource biological datasets show improvement by also training on large amounts of quantum data. This indicates that there may be potential in multi-task and multi-level training of a foundation model and fine-tuning it to resource-constrained downstream tasks. △ Less

Submitted 18 October, 2023; v1 submitted 6 October, 2023; originally announced October 2023.

RL-based Stateful Neural Adaptive Sampling and Denoising for Real-Time Path Tracing

Authors: Antoine Scardigli, Lukas Cavigelli, Lorenz K. Müller

Abstract: Monte-Carlo path tracing is a powerful technique for realistic image synthesis but suffers from high levels of noise at low sample counts, limiting its use in real-time applications. To address this, we propose a framework with end-to-end training of a sampling importance network, a latent space encoder network, and a denoiser network. Our approach uses reinforcement learning to optimize the sampl… ▽ More Monte-Carlo path tracing is a powerful technique for realistic image synthesis but suffers from high levels of noise at low sample counts, limiting its use in real-time applications. To address this, we propose a framework with end-to-end training of a sampling importance network, a latent space encoder network, and a denoiser network. Our approach uses reinforcement learning to optimize the sampling importance network, thus avoiding explicit numerically approximated gradients. Our method does not aggregate the sampled values per pixel by averaging but keeps all sampled values which are then fed into the latent space encoder. The encoder replaces handcrafted spatiotemporal heuristics by learned representations in a latent space. Finally, a neural denoiser is trained to refine the output image. Our approach increases visual quality on several challenging datasets and reduces rendering times for equal quality by a factor of 1.6x compared to the previous state-of-the-art, making it a promising solution for real-time applications. △ Less

Submitted 5 October, 2023; originally announced October 2023.

Comments: Submitted to NeurIPS. https://openreview.net/forum?id=xNyR7DXUzJ

Traveling Waves Encode the Recent Past and Enhance Sequence Learning

Authors: T. Anderson Keller, Lyle Muller, Terrence Sejnowski, Max Welling

Abstract: Traveling waves of neural activity have been observed throughout the brain at a diversity of regions and scales; however, their precise computational role is still debated. One physically inspired hypothesis suggests that the cortical sheet may act like a wave-propagating system capable of invertibly storing a short-term memory of sequential stimuli through induced waves traveling across the corti… ▽ More Traveling waves of neural activity have been observed throughout the brain at a diversity of regions and scales; however, their precise computational role is still debated. One physically inspired hypothesis suggests that the cortical sheet may act like a wave-propagating system capable of invertibly storing a short-term memory of sequential stimuli through induced waves traveling across the cortical surface, and indeed many experimental results from neuroscience correlate wave activity with memory tasks. To date, however, the computational implications of this idea have remained hypothetical due to the lack of a simple recurrent neural network architecture capable of exhibiting such waves. In this work, we introduce a model to fill this gap, which we denote the Wave-RNN (wRNN), and demonstrate how such an architecture indeed efficiently encodes the recent past through a suite of synthetic memory tasks where wRNNs learn faster and reach significantly lower error than wave-free counterparts. We further explore the implications of this memory storage system on more complex sequence modeling tasks such as sequential image classification and find that wave-based models not only again outperform comparable wave-free RNNs while using significantly fewer parameters, but additionally perform comparably to more complex gated architectures such as LSTMs and GRUs. △ Less

Submitted 14 March, 2024; v1 submitted 3 September, 2023; originally announced September 2023.

Search for UHE Photons from Gravitational Wave Sources with the Pierre Auger Observatory

Authors: The Pierre Auger Collaboration, A. Abdul Halim, P. Abreu, M. Aglietta, I. Allekotte, K. Almeida Cheminant, A. Almela, J. Alvarez-Muñiz, J. Ammerman Yebra, G. A. Anastasi, L. Anchordoqui, B. Andrada, S. Andringa, C. Aramo, P. R. Araújo Ferreira, E. Arnone, J. C. Arteaga Velázquez, H. Asorey, P. Assis, G. Avila, E. Avocone, A. M. Badescu, A. Bakalova, A. Balaceanu, F. Barbato , et al. (346 additional authors not shown)

Abstract: A search for time-directional coincidences of ultra-high-energy (UHE) photons above 10 EeV with gravitational wave (GW) events from the LIGO/Virgo runs O1 to O3 is conducted with the Pierre Auger Observatory. Due to the distinctive properties of photon interactions and to the background expected from hadronic showers, a subset of the most interesting GW events is selected based on their localizati… ▽ More A search for time-directional coincidences of ultra-high-energy (UHE) photons above 10 EeV with gravitational wave (GW) events from the LIGO/Virgo runs O1 to O3 is conducted with the Pierre Auger Observatory. Due to the distinctive properties of photon interactions and to the background expected from hadronic showers, a subset of the most interesting GW events is selected based on their localization quality and distance. Time periods of 1000 s around and 1 day after the GW events are analyzed. No coincidences are observed. Upper limits on the UHE photon fluence from a GW event are derived that are typically at $\sim$7 MeV cm$^{-2}$ (time period 1000~s) and $\sim$35 MeV cm$^{-2}$ (time period 1 day). Due to the proximity of the binary neutron star merger GW170817, the energy of the source transferred into UHE photons above 40 EeV is constrained to be less than 20% of its total gravitational wave energy. These are the first limits on UHE photons from GW sources. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Comments: 15 pages

Journal ref: ApJ 952 (2023) 91

Orbifold completion of 3-categories

Authors: Nils Carqueville, Lukas Müller

Abstract: We develop a general theory of 3-dimensional ``orbifold completion'', to describe (generalised) orbifolds of topological quantum field theories as well as all their defects. Given a semistrict 3-category $\mathcal{T}$ with adjoints for all 1- and 2-morphisms (more precisely, a Gray category with duals), we construct the 3-category $\mathcal{T}_{\textrm{orb}}$ as a Morita category of certain $E_1$-… ▽ More We develop a general theory of 3-dimensional ``orbifold completion'', to describe (generalised) orbifolds of topological quantum field theories as well as all their defects. Given a semistrict 3-category $\mathcal{T}$ with adjoints for all 1- and 2-morphisms (more precisely, a Gray category with duals), we construct the 3-category $\mathcal{T}_{\textrm{orb}}$ as a Morita category of certain $E_1$-algebras in $\mathcal{T}$ which encode triangulation invariance. We prove that in $\mathcal{T}_{\textrm{orb}}$ again all 1- and 2-morphisms have adjoints, that it contains $\mathcal{T}$ as a full subcategory, and we argue, but do not prove, that it satisfies a universal property which implies $(\mathcal{T}_{\textrm{orb}})_{\textrm{orb}} \cong \mathcal{T}_{\textrm{orb}}$. This is a categorification of the work in [CR]. Orbifold completion by design allows us to lift the orbifold construction from closed TQFT to the much richer world of defect TQFTs. We illustrate this by constructing a universal 3-dimensional state sum model with all defects from first principles, and we explain how recent work on defects between Witt equivalent Reshetikhin--Turaev theories naturally appears as a special case of orbifold completion. △ Less

Submitted 25 February, 2024; v1 submitted 12 July, 2023; originally announced July 2023.

Comments: 58 pages, many diagrams and figures, v2: references, clarifications and improvements added

Smoothing the Edges: Smooth Optimization for Sparse Regularization using Hadamard Overparametrization

Authors: Chris Kolb, Christian L. Müller, Bernd Bischl, David Rügamer

Abstract: We present a framework for smooth optimization of explicitly regularized objectives for (structured) sparsity. These non-smooth and possibly non-convex problems typically rely on solvers tailored to specific models and regularizers. In contrast, our method enables fully differentiable and approximation-free optimization and is thus compatible with the ubiquitous gradient descent paradigm in deep l… ▽ More We present a framework for smooth optimization of explicitly regularized objectives for (structured) sparsity. These non-smooth and possibly non-convex problems typically rely on solvers tailored to specific models and regularizers. In contrast, our method enables fully differentiable and approximation-free optimization and is thus compatible with the ubiquitous gradient descent paradigm in deep learning. The proposed optimization transfer comprises an overparameterization of selected parameters and a change of penalties. In the overparametrized problem, smooth surrogate regularization induces non-smooth, sparse regularization in the base parametrization. We prove that the surrogate objective is equivalent in the sense that it not only has identical global minima but also matching local minima, thereby avoiding the introduction of spurious solutions. Additionally, our theory establishes results of independent interest regarding matching local minima for arbitrary, potentially unregularized, objectives. We comprehensively review sparsity-inducing parametrizations across different fields that are covered by our general theory, extend their scope, and propose improvements in several aspects. Numerical experiments further demonstrate the correctness and effectiveness of our approach on several sparse learning problems ranging from high-dimensional regression to sparse neural network training. △ Less

Submitted 26 April, 2024; v1 submitted 7 July, 2023; originally announced July 2023.

Generative Proxemics: A Prior for 3D Social Interaction from Images

Authors: Lea Müller, Vickie Ye, Georgios Pavlakos, Michael Black, Angjoo Kanazawa

Abstract: Social interaction is a fundamental aspect of human behavior and communication. The way individuals position themselves in relation to others, also known as proxemics, conveys social cues and affects the dynamics of social interaction. Reconstructing such interaction from images presents challenges because of mutual occlusion and the limited availability of large training datasets. To address this… ▽ More Social interaction is a fundamental aspect of human behavior and communication. The way individuals position themselves in relation to others, also known as proxemics, conveys social cues and affects the dynamics of social interaction. Reconstructing such interaction from images presents challenges because of mutual occlusion and the limited availability of large training datasets. To address this, we present a novel approach that learns a prior over the 3D proxemics two people in close social interaction and demonstrate its use for single-view 3D reconstruction. We start by creating 3D training data of interacting people using image datasets with contact annotations. We then model the proxemics using a novel denoising diffusion model called BUDDI that learns the joint distribution over the poses of two people in close social interaction. Sampling from our generative proxemics model produces realistic 3D human interactions, which we validate through a perceptual study. We use BUDDI in reconstructing two people in close proximity from a single image without any contact annotation via an optimization approach that uses the diffusion model as a prior. Our approach recovers accurate and plausible 3D social interactions from noisy initial estimates, outperforming state-of-the-art methods. Our code, data, and model are availableat our project website at: muelea.github.io/buddi. △ Less

Submitted 12 December, 2023; v1 submitted 15 June, 2023; originally announced June 2023.

Comments: Project website: muelea.github.io/buddi

Composed solutions of synchronized patterns in multiplex networks of Kuramoto oscillators

Authors: Priya B. Jain, Tung T. Nguyen, Ján Mináč, Lyle E. Muller, Roberto C. Budzinski

Abstract: Networks with different levels of interactions, including multilayer and multiplex networks, can display a rich diversity of dynamical behaviors and can be used to model and study a wide range of systems. Despite numerous efforts to investigate these networks, obtaining mathematical descriptions for the dynamics of multilayer and multiplex systems is still an open problem. Here, we combine ideas a… ▽ More Networks with different levels of interactions, including multilayer and multiplex networks, can display a rich diversity of dynamical behaviors and can be used to model and study a wide range of systems. Despite numerous efforts to investigate these networks, obtaining mathematical descriptions for the dynamics of multilayer and multiplex systems is still an open problem. Here, we combine ideas and concepts from linear algebra and graph theory with nonlinear dynamics to offer a novel approach to study multiplex networks of Kuramoto oscillators. Our approach allows us to study the dynamics of a large, multiplex network by decomposing it into two smaller systems: one representing the connection scheme within layers (intra-layer), and the other representing the connections between layers (inter-layer). Particularly, we use this approach to compose solutions for multiplex networks of Kuramoto oscillators. These solutions are given by a combination of solutions for the smaller systems given by the intra and inter-layer system and, in addition, our approach allows us to study the linear stability of these solutions. △ Less

Submitted 6 October, 2023; v1 submitted 10 June, 2023; originally announced June 2023.

Constraining models for the origin of ultra-high-energy cosmic rays with a novel combined analysis of arrival directions, spectrum, and composition data measured at the Pierre Auger Observatory

Authors: The Pierre Auger Collaboration, A. Abdul Halim, P. Abreu, M. Aglietta, I. Allekotte, K. Almeida Cheminant, A. Almela, R. Aloisio, J. Alvarez-Muñiz, J. Ammerman Yebra, G. A. Anastasi, L. Anchordoqui, B. Andrada, S. Andringa, C. Aramo, P. R. Araújo Ferreira, E. Arnone, J. C. Arteaga Velázquez, H. Asorey, P. Assis, G. Avila, E. Avocone, A. M. Badescu, A. Bakalova, A. Balaceanu , et al. (349 additional authors not shown)

Abstract: The combined fit of the measured energy spectrum and shower maximum depth distributions of ultra-high-energy cosmic rays is known to constrain the parameters of astrophysical models with homogeneous source distributions. Studies of the distribution of the cosmic-ray arrival directions show a better agreement with models in which a fraction of the flux is non-isotropic and associated with the nearb… ▽ More The combined fit of the measured energy spectrum and shower maximum depth distributions of ultra-high-energy cosmic rays is known to constrain the parameters of astrophysical models with homogeneous source distributions. Studies of the distribution of the cosmic-ray arrival directions show a better agreement with models in which a fraction of the flux is non-isotropic and associated with the nearby radio galaxy Centaurus A or with catalogs such as that of starburst galaxies. Here, we present a novel combination of both analyses by a simultaneous fit of arrival directions, energy spectrum, and composition data measured at the Pierre Auger Observatory. We find that a model containing a flux contribution from the starburst galaxy catalog of around 20% at 40 EeV with a magnetic field blurring of around $20^\circ$ for a rigidity of 10 EV provides a fair simultaneous description of all three observables. The starburst galaxy model is favored with a significance of $4.5σ$ (considering experimental systematic effects) compared to a reference model with only homogeneously distributed background sources. By investigating a scenario with Centaurus A as a single source in combination with the homogeneous background, we confirm that this region of the sky provides the dominant contribution to the observed anisotropy signal. Models containing a catalog of jetted active galactic nuclei whose flux scales with the $γ$-ray emission are, however, disfavored as they cannot adequately describe the measured arrival directions. △ Less

Submitted 14 January, 2024; v1 submitted 26 May, 2023; originally announced May 2023.

Journal ref: JCAP01(2024)022

Numerical and Experimental Investigation of A Three-Axis Free Rotation Wind Tunnel Model

Authors: Laurène Muller, Michel Libsig, Bastien Martinez, Denis Bidino, Myriam Bastide, Yannick Bailly, Jean-Claude Roy

Abstract: The current need of improving performance in terms of control and aerodynamic efficiency of ammunitions leads to the necessity of performing accurate flying geometry characterizations. Therefore, new investigation methods are developed in order to increase the aerodynamic knowledge. Free flight measurements experiments are the most common way to obtain dynamic aerodynamic coefficients. However, th… ▽ More The current need of improving performance in terms of control and aerodynamic efficiency of ammunitions leads to the necessity of performing accurate flying geometry characterizations. Therefore, new investigation methods are developed in order to increase the aerodynamic knowledge. Free flight measurements experiments are the most common way to obtain dynamic aerodynamic coefficients. However, they do not always allow neither easy nor perfect measurements conditions. Currently ISL develops a stereovision method based wind-tunnel measurements methodology for investigation of a 3-axis free rotation model. This methods has been applied to the DREV-ISL reference model in order to compare coefficients obtained by this method with numerical results. △ Less

Submitted 15 May, 2023; originally announced May 2023.

Journal ref: 54th 3AF International Conference on Applied Aerodynamics, Association A{é}ronautique et Astronautique de France (3AF), Mar 2019, Paris, France

Dynamical properties and mechanisms of metastability: a perspective in neuroscience

Authors: Kalel L. Rossi, Roberto C. Budzinski, Everton S. Medeiros, Bruno R. R. Boaretto, Lyle Muller, Ulrike Feudel

Abstract: Metastability, characterized by a variability of regimes in time, is a ubiquitous type of neural dynamics. It has been formulated in many different ways in the neuroscience literature, however, which may cause some confusion. In this Perspective, we discuss metastability from the point of view of dynamical systems theory. We extract from the literature a very simple but general definition through… ▽ More Metastability, characterized by a variability of regimes in time, is a ubiquitous type of neural dynamics. It has been formulated in many different ways in the neuroscience literature, however, which may cause some confusion. In this Perspective, we discuss metastability from the point of view of dynamical systems theory. We extract from the literature a very simple but general definition through the concept of metastable regimes as long-lived but transient epochs of activity with unique dynamical properties. This definition serves as an umbrella term that encompasses formulations from other works, and readily connects to concepts from dynamical systems theory. This allows us to examine general dynamical properties of metastable regimes, propose in a didactic manner several dynamics-based mechanisms that generate them, and discuss a theoretical tool to characterize them quantitatively. This perspective leads to insights that help to address issues debated in the literature and also suggest pathways for future research. △ Less

Submitted 21 May, 2024; v1 submitted 9 May, 2023; originally announced May 2023.

Comments: 4 figures

3D Human Pose Estimation via Intuitive Physics

Authors: Shashank Tripathi, Lea Müller, Chun-Hao P. Huang, Omid Taheri, Michael J. Black, Dimitrios Tzionas

Abstract: Estimating 3D humans from images often produces implausible bodies that lean, float, or penetrate the floor. Such methods ignore the fact that bodies are typically supported by the scene. A physics engine can be used to enforce physical plausibility, but these are not differentiable, rely on unrealistic proxy bodies, and are difficult to integrate into existing optimization and learning frameworks… ▽ More Estimating 3D humans from images often produces implausible bodies that lean, float, or penetrate the floor. Such methods ignore the fact that bodies are typically supported by the scene. A physics engine can be used to enforce physical plausibility, but these are not differentiable, rely on unrealistic proxy bodies, and are difficult to integrate into existing optimization and learning frameworks. In contrast, we exploit novel intuitive-physics (IP) terms that can be inferred from a 3D SMPL body interacting with the scene. Inspired by biomechanics, we infer the pressure heatmap on the body, the Center of Pressure (CoP) from the heatmap, and the SMPL body's Center of Mass (CoM). With these, we develop IPMAN, to estimate a 3D body from a color image in a "stable" configuration by encouraging plausible floor contact and overlap** CoP and CoM. Our IP terms are intuitive, easy to implement, fast to compute, differentiable, and can be integrated into existing optimization and regression methods. We evaluate IPMAN on standard datasets and MoYo, a new dataset with synchronized multi-view images, ground-truth 3D bodies with complex poses, body-floor contact, CoM and pressure. IPMAN produces more plausible results than the state of the art, improving accuracy for static poses, while not hurting dynamic ones. Code and data are available for research at https://ipman.is.tue.mpg.de. △ Less

Submitted 24 July, 2023; v1 submitted 31 March, 2023; originally announced March 2023.

Comments: Accepted in CVPR'23. Project page: https://ipman.is.tue.mpg.de

Attending to Graph Transformers

Authors: Luis Müller, Mikhail Galkin, Christopher Morris, Ladislav Rampášek

Abstract: Recently, transformer architectures for graphs emerged as an alternative to established techniques for machine learning with graphs, such as (message-passing) graph neural networks. So far, they have shown promising empirical results, e.g., on molecular prediction datasets, often attributed to their ability to circumvent graph neural networks' shortcomings, such as over-smoothing and over-squashin… ▽ More Recently, transformer architectures for graphs emerged as an alternative to established techniques for machine learning with graphs, such as (message-passing) graph neural networks. So far, they have shown promising empirical results, e.g., on molecular prediction datasets, often attributed to their ability to circumvent graph neural networks' shortcomings, such as over-smoothing and over-squashing. Here, we derive a taxonomy of graph transformer architectures, bringing some order to this emerging field. We overview their theoretical properties, survey structural and positional encodings, and discuss extensions for important graph classes, e.g., 3D molecular graphs. Empirically, we probe how well graph transformers can recover various graph properties, how well they can deal with heterophilic graphs, and to what extent they prevent over-squashing. Further, we outline open challenges and research direction to stimulate future work. Our code is available at https://github.com/luis-mueller/probing-graph-transformers. △ Less

Submitted 28 March, 2024; v1 submitted 8 February, 2023; originally announced February 2023.

Predicting Stellar Mass Accretion: An Optimized Echo State Network Approach in Time Series Modeling

Authors: Gianfranco Bino, Shantanu Basu, Ramit Dey, Sayantan Auddy, Lyle Muller, Eduard I. Vorobyov

Abstract: Modeling the dynamics of the formation and evolution of protostellar disks as well as the history of stellar mass accretion typically involve the numerical solution of complex systems of coupled differential equations. The resulting mass accretion history of protostars is known to be highly episodic due to recurrent instabilities and also exhibits short timescale flickering. By leveraging the stro… ▽ More Modeling the dynamics of the formation and evolution of protostellar disks as well as the history of stellar mass accretion typically involve the numerical solution of complex systems of coupled differential equations. The resulting mass accretion history of protostars is known to be highly episodic due to recurrent instabilities and also exhibits short timescale flickering. By leveraging the strong predictive abilities of neural networks, we extract some of the critical temporal dynamics experienced during the mass accretion including periods of instability. Particularly, we utilize a novel form of the Echo-State Neural Network (ESN), which has been shown to efficiently deal with data having inherent nonlinearity. We introduce the use of Optimized-ESN (Opt-ESN) to make model-independent time series forecasting of mass accretion rate in the evolution of protostellar disks. We apply the network to multiple hydrodynamic simulations with different initial conditions and exhibiting a variety of temporal dynamics to demonstrate the predictability of the Opt-ESN model. The model is trained on simulation data of $\sim 1-2$ Myr, and achieves predictions with a low normalized mean square error ($\sim 10^{-5}$ to $10^{-3}$) for forecasts ranging between 100 and 3800 yr. This result shows the promise of the application of machine learning based models to time-domain astronomy. △ Less

Submitted 13 April, 2023; v1 submitted 7 February, 2023; originally announced February 2023.

Comments: 16 pages, 13 figures

Journal ref: Open Journal of Astrophysics, Vol. 6, 2023

SurgT challenge: Benchmark of Soft-Tissue Trackers for Robotic Surgery

Authors: Joao Cartucho, Alistair Weld, Samyakh Tukra, Haozheng Xu, Hiroki Matsuzaki, Taiyo Ishikawa, Minjun Kwon, Yong Eun Jang, Kwang-Ju Kim, Gwang Lee, Bizhe Bai, Lueder Kahrs, Lars Boecking, Simeon Allmendinger, Leopold Muller, Yitong Zhang, Yueming **, Sophia Bano, Francisco Vasconcelos, Wolfgang Reiter, Jonas Hajek, Bruno Silva, Estevao Lima, Joao L. Vilaca, Sandro Queiros , et al. (1 additional authors not shown)

Abstract: This paper introduces the ``SurgT: Surgical Tracking" challenge which was organised in conjunction with MICCAI 2022. There were two purposes for the creation of this challenge: (1) the establishment of the first standardised benchmark for the research community to assess soft-tissue trackers; and (2) to encourage the development of unsupervised deep learning methods, given the lack of annotated da… ▽ More This paper introduces the ``SurgT: Surgical Tracking" challenge which was organised in conjunction with MICCAI 2022. There were two purposes for the creation of this challenge: (1) the establishment of the first standardised benchmark for the research community to assess soft-tissue trackers; and (2) to encourage the development of unsupervised deep learning methods, given the lack of annotated data in surgery. A dataset of 157 stereo endoscopic videos from 20 clinical cases, along with stereo camera calibration parameters, have been provided. Participants were assigned the task of develo** algorithms to track the movement of soft tissues, represented by bounding boxes, in stereo endoscopic videos. At the end of the challenge, the developed methods were assessed on a previously hidden test subset. This assessment uses benchmarking metrics that were purposely developed for this challenge, to verify the efficacy of unsupervised deep learning algorithms in tracking soft-tissue. The metric used for ranking the methods was the Expected Average Overlap (EAO) score, which measures the average overlap between a tracker's and the ground truth bounding boxes. Coming first in the challenge was the deep learning submission by ICVS-2Ai with a superior EAO score of 0.617. This method employs ARFlow to estimate unsupervised dense optical flow from cropped images, using photometric and regularization losses. Second, Jmees with an EAO of 0.583, uses deep learning for surgical tool segmentation on top of a non-deep learning baseline method: CSRT. CSRT by itself scores a similar EAO of 0.563. The results from this challenge show that currently, non-deep learning methods are still competitive. The dataset and benchmarking tool created for this challenge have been made publicly available at https://surgt.grand-challenge.org/. △ Less

Submitted 30 August, 2023; v1 submitted 6 February, 2023; originally announced February 2023.

Reflection Structures and Spin Statistics in Low Dimensions

Authors: Lukas Müller, Luuk Stehouwer

Abstract: We give a complete classification of topological field theories with reflection structure and spin-statistics in one and two spacetime dimensions. Our answers can be naturally expressed in terms of an internal fermionic symmetry group $G$ which is different from the spacetime structure group. Fermionic groups encode symmetries of systems with fermions and time reversing symmetries. We show that 1-… ▽ More We give a complete classification of topological field theories with reflection structure and spin-statistics in one and two spacetime dimensions. Our answers can be naturally expressed in terms of an internal fermionic symmetry group $G$ which is different from the spacetime structure group. Fermionic groups encode symmetries of systems with fermions and time reversing symmetries. We show that 1-dimensional topological field theories with reflection structure and spin-statistics are classified by finite dimensional hermitian representations of $G$. In spacetime dimension two we give a classification in terms strongly $G$-graded stellar Frobenius algebras. Our proofs are based on the cobordism hypothesis. Along the way, we develop some useful tools for the computation of homotopy fixed points of 2-group actions on bicategories. △ Less

Submitted 16 January, 2023; originally announced January 2023.

Comments: 74+56 pages, 6 figures

Report number: MPIM-Bonn-2023

The distinguished invertible object as ribbon dualizing object in the Drinfeld center

Authors: Lukas Müller, Lukas Woike

Abstract: We prove that the Drinfeld center $Z(\mathcal{C})$ of a pivotal finite tensor category $\mathcal{C}$ comes with the structure of a ribbon Grothendieck-Verdier category in the sense of Boyarchenko-Drinfeld. Phrased operadically, this makes $Z(\mathcal{C})$ into a cyclic algebra over the framed $E_2$-operad. The underlying object of the dualizing object is the distinguished invertible object of… ▽ More We prove that the Drinfeld center $Z(\mathcal{C})$ of a pivotal finite tensor category $\mathcal{C}$ comes with the structure of a ribbon Grothendieck-Verdier category in the sense of Boyarchenko-Drinfeld. Phrased operadically, this makes $Z(\mathcal{C})$ into a cyclic algebra over the framed $E_2$-operad. The underlying object of the dualizing object is the distinguished invertible object of $\mathcal{C}$ appearing in the well-known Radford isomorphism of Etingof-Nikshych-Ostrik. Up to equivalence, this is the unique ribbon Grothendieck-Verdier structure on $Z(\mathcal{C})$ extending the canonical balanced braided structure that $Z(\mathcal{C})$ already comes equipped with. The duality functor of this ribbon Grothendieck-Verdier structure coincides with the rigid duality if and only if $\mathcal{C}$ is spherical in the sense of Douglas-Schommer-Pries-Snyder. The main topological consequence of our algebraic result is that $Z(\mathcal{C})$ gives rise to an ansular functor, in fact even a modular functor regardless of whether $\mathcal{C}$ is spherical or not. In order to prove the aforementioned uniqueness statement for the ribbon Grothendieck-Verdier structure, we derive a seven-term exact sequence characterizing the space of ribbon Grothendieck-Verdier structures on a balanced braided category. This sequence features the Picard group of the balanced version of the Müger center of the balanced braided category. △ Less

Submitted 20 January, 2023; v1 submitted 15 December, 2022; originally announced December 2022.

Comments: 21 pages, diagrams partly in color; v2: minor changes, Cor. 3.1 strengthened

Report number: CPH-GEOTOP-DNRF151 ; ANR-22-CPJ

On the Paley graph of a quadratic character

Authors: Ján Mináč, Lyle Muller, Tung T. Nguyen, Nguyen Duy Tân

Abstract: Paley graphs form a nice link between the distribution of quadratic residues and graph theory. These graphs possess remarkable properties which make them useful in several branches of mathematics. Classically, for each prime number $p$ we can construct the corresponding Paley graph using quadratic and non-quadratic residues modulo $p$. Therefore, Paley graphs are naturally associated with the Lege… ▽ More Paley graphs form a nice link between the distribution of quadratic residues and graph theory. These graphs possess remarkable properties which make them useful in several branches of mathematics. Classically, for each prime number $p$ we can construct the corresponding Paley graph using quadratic and non-quadratic residues modulo $p$. Therefore, Paley graphs are naturally associated with the Legendre symbol at $p$ which is a quadratic Dirichlet character of conductor $p$. In this article, we introduce the generalized Paley graphs. These are graphs that are associated with a general quadratic Dirichlet character. We will then provide some of their basic properties. In particular, we describe their spectrum explicitly. We then use those generalized Paley graphs to construct some new families of Ramanujan graphs. Finally, using special values of $L$-functions, we provide an effective upper bound for their Cheeger number. △ Less

Submitted 6 December, 2023; v1 submitted 4 December, 2022; originally announced December 2022.

Comments: To appear in Mathematica Slovaca

MSC Class: 05C25; 05C50; 11M06

A Catalog of the Highest-Energy Cosmic Rays Recorded During Phase I of Operation of the Pierre Auger Observatory

Authors: The Pierre Auger Collaboration, A. Abdul Halim, P. Abreu, M. Aglietta, I. Allekotte, P. Allison, K. Almeida Cheminant, A. Almela, J. Alvarez-Muñiz, J. Ammerman Yebra, G. A. Anastasi, L. Anchordoqui, B. Andrada, S. Andringa, C. Aramo, P. R. Araújo Ferreira, E. Arnone, J. C. Arteaga Velázquez, H. Asorey, P. Assis, M. Ave, G. Avila, E. Avocone, A. M. Badescu, A. Bakalova , et al. (354 additional authors not shown)

Abstract: A catalog containing details of the highest-energy cosmic rays recorded through the detection of extensive air-showers at the Pierre Auger Observatory is presented with the aim of opening the data to detailed examination. Descriptions of the 100 showers created by the highest-energy particles recorded between 1 January 2004 and 31 December 2020 are given for cosmic rays that have energies in the r… ▽ More A catalog containing details of the highest-energy cosmic rays recorded through the detection of extensive air-showers at the Pierre Auger Observatory is presented with the aim of opening the data to detailed examination. Descriptions of the 100 showers created by the highest-energy particles recorded between 1 January 2004 and 31 December 2020 are given for cosmic rays that have energies in the range 78 EeV to 166 EeV. Details are also given of a further nine very-energetic events that have been used in the calibration procedure adopted to determine the energy of each primary. A sky plot of the arrival directions of the most energetic particles is shown. No interpretations of the data are offered. △ Less

Submitted 29 November, 2022; originally announced November 2022.

Comments: Article accepted for publication in ApJS

Interacting triplons in frustrated spin ladders: Binding and decay in BiCu$_2$PO$_6$

Authors: Leanna B. Müller, Götz S. Uhrig

Abstract: Establishing a comprehensive model of the rich spin dynamics in BiCu$_2$PO$_6$ has been a challenge over the last decade. Inelastic neutron scattering experiments revealed that its elementary triplons are non-degenerate showing the existence of significant anisotropic spin couplings. Evidence for triplon decay into two triplons has been found, but two prominent downturns in the dispersions eluded… ▽ More Establishing a comprehensive model of the rich spin dynamics in BiCu$_2$PO$_6$ has been a challenge over the last decade. Inelastic neutron scattering experiments revealed that its elementary triplons are non-degenerate showing the existence of significant anisotropic spin couplings. Evidence for triplon decay into two triplons has been found, but two prominent downturns in the dispersions eluded an explanation. Level repulsion due to hybridization of single triplons with the continuum of two-triplon scattering states has been proposed as explanation. We show that this concept may explain the weak downturn at higher energies, but fails for the most pronounced downturn at lower energy. In turn, we provide evidence that this downturn is the signature of a two-triplon bound state of essentially singlet character pointing to triplon-triplon interaction as the second crucial ingredient of the spin dynamics in this exemplary system. △ Less

Submitted 15 November, 2022; originally announced November 2022.

Comments: 7 pages including 1 page appendix, 5 figures

Journal ref: Phys. Rev. B 107, L081102 (2023)

An algebraic approach to spike-time neural codes in the hippocampus

Authors: Federico W. Pasini, Alexandra N. Busch, Ján Mináč, Krishnan Padmanabhan, Lyle Muller

Abstract: Although temporal coding through spike-time patterns has long been of interest in neuroscience, the specific structures that could be useful for spike-time codes remain highly unclear. Here, we introduce a new analytical approach, using techniques from discrete mathematics, to study spike-time codes. We focus on the phenomenon of ``phase precession'' in the rodent hippocampus. During navigation an… ▽ More Although temporal coding through spike-time patterns has long been of interest in neuroscience, the specific structures that could be useful for spike-time codes remain highly unclear. Here, we introduce a new analytical approach, using techniques from discrete mathematics, to study spike-time codes. We focus on the phenomenon of ``phase precession'' in the rodent hippocampus. During navigation and learning on a physical track, specific cells in a rodent's brain form a highly structured pattern relative to the oscillation of local population activity. Studies of phase precession largely focus on its well established role in synaptic plasticity and memory formation. Comparatively less attention has been paid to the fact that phase precession represents one of the best candidates for a spike-time neural code. The precise nature of this code remains an open question. Here, we derive an analytical expression for an operator map** points in physical space, through individual spike times, to complex numbers. The properties of this operator highlight a specific relationship between past and future in hippocampal spike patterns. Importantly, this approach generalizes beyond the specific phenomenon studied here, providing a new technique to study the neural codes within spike-time sequences found during sensory coding and motor behavior. We then introduce a novel spike-based decoding algorithm, based on this operator, that successfully decodes a simulated animal's trajectory using only the animal's initial position and a pattern of spike times. This decoder is robust to noise in spike times and works on a timescale almost an order of magnitude shorter than typically used with decoders that work on average firing rate. These results illustrate the utility of a discrete approach, based on the symmetries in spike patterns, to provide insight into the structure and function of neural systems. △ Less

Submitted 12 November, 2022; originally announced November 2022.

Comments: 11 pages, 5 figures

Constraining the sources of ultra-high-energy cosmic rays across and above the ankle with the spectrum and composition data measured at the Pierre Auger Observatory

Authors: The Pierre Auger Collaboration, A. Abdul Halim, P. Abreu, M. Aglietta, I. Allekotte, K. Almeida Cheminant, A. Almela, J. Alvarez-Muñiz, J. Ammerman Yebra, G. A. Anastasi, L. Anchordoqui, B. Andrada, S. Andringa, C. Aramo, P. R. Araújo Ferreira, E. Arnone, J. C. Arteaga Velázquez, H. Asorey, P. Assis, G. Avila, E. Avocone, A. M. Badescu, A. Bakalova, A. Balaceanu, F. Barbato , et al. (343 additional authors not shown)

Abstract: In this work we present the interpretation of the energy spectrum and mass composition data as measured by the Pierre Auger Collaboration above $6 \times 10^{17}$ eV. We use an astrophysical model with two extragalactic source populations to model the hardening of the cosmic-ray flux at around $5\times 10^{18}$ eV (the so-called "ankle" feature) as a transition between these two components. We fin… ▽ More In this work we present the interpretation of the energy spectrum and mass composition data as measured by the Pierre Auger Collaboration above $6 \times 10^{17}$ eV. We use an astrophysical model with two extragalactic source populations to model the hardening of the cosmic-ray flux at around $5\times 10^{18}$ eV (the so-called "ankle" feature) as a transition between these two components. We find our data to be well reproduced if sources above the ankle emit a mixed composition with a hard spectrum and a low rigidity cutoff. The component below the ankle is required to have a very soft spectrum and a mix of protons and intermediate-mass nuclei. The origin of this intermediate-mass component is not well constrained and it could originate from either Galactic or extragalactic sources. To the aim of evaluating our capability to constrain astrophysical models, we discuss the impact on the fit results of the main experimental systematic uncertainties and of the assumptions about quantities affecting the air shower development as well as the propagation and redshift distribution of injected ultra-high-energy cosmic rays (UHECRs). △ Less

Submitted 17 April, 2023; v1 submitted 5 November, 2022; originally announced November 2022.

Comments: Submitted to JCAP

Journal ref: JCAP05(2023)024

Study of $I=0$ bottomonium bound states and resonances based on lattice QCD static potentials

Authors: Pedro Bicudo, Nuno Cardoso, Lasse Mueller, Marc Wagner

Abstract: We investigate $I = 0$ bottomonium bound states and resonances in S, P, D and F waves using lattice QCD static-static-light-light potentials. We consider five coupled channels, one confined quarkonium and four open $B^{(*)}\bar{B}^{(*)}$ and $B^{(*)}_s\bar{B}^{(*)}_s$ meson-meson channels and use the Born-Oppenheimer approximation and the emergent wave method to compute poles of the T matrix. We d… ▽ More We investigate $I = 0$ bottomonium bound states and resonances in S, P, D and F waves using lattice QCD static-static-light-light potentials. We consider five coupled channels, one confined quarkonium and four open $B^{(*)}\bar{B}^{(*)}$ and $B^{(*)}_s\bar{B}^{(*)}_s$ meson-meson channels and use the Born-Oppenheimer approximation and the emergent wave method to compute poles of the T matrix. We discuss results for masses and decay widths and compare them to existing experimental results. Moreover, we determine the quarkonium and meson-meson composition of these states to clarify, whether they are ordinary quarkonium or should rather be interpreted as tetraquarks. △ Less

Submitted 24 October, 2022; originally announced October 2022.

Comments: 9 pages, 3 figures, 1 table, poster presentation given at the 39th International Symposium on Lattice Field Theory (Lattice2022), 8th-13th August 2022, Rheinische Friedrich-Wilhelms-Universität Bonn, Bonn, Germany

Searches for Ultra-High-Energy Photons at the Pierre Auger Observatory

Authors: The Pierre Auger Collaboration, P. Abreu, M. Aglietta, I. Allekotte, K. Almeida Cheminant, A. Almela, J. Alvarez-Muñiz, J. Ammerman Yebra, G. A. Anastasi, L. Anchordoqui, B. Andrada, S. Andringa, C. Aramo, P. R. Araújo Ferreira, E. Arnone, J. C. Arteaga Velázquez, H. Asorey, P. Assis, G. Avila, E. Avocone, A. M. Badescu, A. Bakalova, A. Balaceanu, F. Barbato, J. A. Bellido , et al. (340 additional authors not shown)

Abstract: The Pierre Auger Observatory, being the largest air-shower experiment in the world, offers an unprecedented exposure to neutral particles at the highest energies. Since the start of data taking more than 18 years ago, various searches for ultra-high-energy (UHE, $E\gtrsim10^{17}\,\text{eV}$) photons have been performed: either for a diffuse flux of UHE photons, for point sources of UHE photons or… ▽ More The Pierre Auger Observatory, being the largest air-shower experiment in the world, offers an unprecedented exposure to neutral particles at the highest energies. Since the start of data taking more than 18 years ago, various searches for ultra-high-energy (UHE, $E\gtrsim10^{17}\,\text{eV}$) photons have been performed: either for a diffuse flux of UHE photons, for point sources of UHE photons or for UHE photons associated with transient events like gravitational wave events. In the present paper, we summarize these searches and review the current results obtained using the wealth of data collected by the Pierre Auger Observatory. △ Less

Submitted 24 October, 2022; originally announced October 2022.

Comments: Review article accepted for publication in Universe (special issue on ultra-high energy photons)

Report number: FERMILAB-PUB-22-810-AD-PPD-SCD-TD

Journal ref: Universe 8 (2022) 579

Suppress with a Patch: Revisiting Universal Adversarial Patch Attacks against Object Detection

Authors: Svetlana Pavlitskaya, Jonas Hendl, Sebastian Kleim, Leopold Müller, Fabian Wylczoch, J. Marius Zöllner

Abstract: Adversarial patch-based attacks aim to fool a neural network with an intentionally generated noise, which is concentrated in a particular region of an input image. In this work, we perform an in-depth analysis of different patch generation parameters, including initialization, patch size, and especially positioning a patch in an image during training. We focus on the object vanishing attack and ru… ▽ More Adversarial patch-based attacks aim to fool a neural network with an intentionally generated noise, which is concentrated in a particular region of an input image. In this work, we perform an in-depth analysis of different patch generation parameters, including initialization, patch size, and especially positioning a patch in an image during training. We focus on the object vanishing attack and run experiments with YOLOv3 as a model under attack in a white-box setting and use images from the COCO dataset. Our experiments have shown, that inserting a patch inside a window of increasing size during training leads to a significant increase in attack strength compared to a fixed position. The best results were obtained when a patch was positioned randomly during training, while patch position additionally varied within a batch. △ Less

Submitted 22 December, 2022; v1 submitted 27 September, 2022; originally announced September 2022.

Comments: Accepted for publication at ICECCME 2022

Ferroelectricity and resistive switching in BaTiO$_3$ thin films with liquid electrolyte top contact for bioelectronic devices

Authors: Maximilian T. Becker, Poppy Oldroyd, Nives Strkalj, Moritz L. Müller, George G. Malliaras, Judith L. MacManus-Driscoll

Abstract: We investigate ferroelectric- and resistive switching behavior in 18-nm-thick epitaxial BaTiO$_3$ (BTO) films in a model electrolyte-ferroelectric-semiconductor (EFS) configuration. The system is explored for its potential as a ferroelectric microelectrode in bioelectronics. The BTO films are grown by pulsed laser deposition (PLD) on semiconducting Nb-doped (0.5 wt\%) SrTiO$_{3}$ (Nb:STO) single c… ▽ More We investigate ferroelectric- and resistive switching behavior in 18-nm-thick epitaxial BaTiO$_3$ (BTO) films in a model electrolyte-ferroelectric-semiconductor (EFS) configuration. The system is explored for its potential as a ferroelectric microelectrode in bioelectronics. The BTO films are grown by pulsed laser deposition (PLD) on semiconducting Nb-doped (0.5 wt\%) SrTiO$_{3}$ (Nb:STO) single crystal substrates. The ferroelectric properties of the bare BTO films are demonstrated by piezoresponse force microscopy (PFM) measurements. Cyclic voltammetry (CV) measurements in EFS configuration, with phosphate buffered saline (PBS) acting as the liquid electrolyte top contact, indicate characteristic ferroelectric switching peaks in the bipolar current-voltage loop. The ferroelectric nature of the observed switching peaks is confirmed by analyzing the current response of the EFS devices to unipolar voltage signals. Moreover, electrochemical impedance spectroscopy (EIS) measurements indicate bipolar resisitive switching behavior of the EFS devices, which is controlled by the remanent polarization state of the BTO layer. Our results represent a constitutive step towards the realization of neuroprosthetic implants and hybrid neurocomputational systems based on ferroelectric microelectrodes. △ Less

Submitted 16 September, 2022; originally announced September 2022.

Broadcasting solutions on networked systems of phase oscillators

Authors: Tung T. Nguyen, Roberto C. Budzinski, Federico W. Pasini, Robin Delabays, Ján Mináč, Lyle E. Muller

Abstract: Networked systems have been used to model and investigate the dynamical behavior of a variety of systems. For these systems, different levels of complexity can be considered in the modeling procedure. On one hand, this can offer a more realistic and rich modeling option. On the other hand, it can lead to intrinsic difficulty in analyzing the system. Here, we present an approach to investigate the… ▽ More Networked systems have been used to model and investigate the dynamical behavior of a variety of systems. For these systems, different levels of complexity can be considered in the modeling procedure. On one hand, this can offer a more realistic and rich modeling option. On the other hand, it can lead to intrinsic difficulty in analyzing the system. Here, we present an approach to investigate the dynamics of Kuramoto oscillators on networks with different levels of connections: a network of networks. To do so, we utilize a construction in network theory known as the join of networks, which represents ``intra-area" and ``inter-area" connections. This approach provides a reduced representation of the original, multi-level system, where both systems have equivalent dynamics. Then, we can find solutions for the reduced system and broadcast them to the original network of networks. Moreover, using the same idea we can investigate the stability of these states, where we can obtain information on the Jacobian of the multi-level system by analyzing the reduced one. This approach is general for arbitrary connection schemes between nodes within the same area. Finally, our work opens the possibility of studying the dynamics of networked systems using a simpler representation, thus leading to a better understanding of the dynamical behavior of these systems. △ Less

Submitted 18 January, 2023; v1 submitted 13 September, 2022; originally announced September 2022.

Search for photons above 10$^{19}$ eV with the surface detector of the Pierre Auger Observatory

Authors: The Pierre Auger Collaboration, P. Abreu, M. Aglietta, I. Allekotte, K. Almeida Cheminant, A. Almela, J. Alvarez-Muñiz, J. Ammerman Yebra, G. A. Anastasi, L. Anchordoqui, B. Andrada, S. Andringa, C. Aramo, P. R. Araújo Ferreira, E. Arnone, J. C. Arteaga Velázquez, H. Asorey, P. Assis, G. Avila, E. Avocone, A. M. Badescu, A. Bakalova, A. Balaceanu, F. Barbato, J. A. Bellido , et al. (343 additional authors not shown)

Abstract: We use the surface detector of the Pierre Auger Observatory to search for air showers initiated by photons with an energy above $10^{19}$ eV. Photons in the zenith angle range from 30$^\circ$ to 60$^\circ$ can be identified in the overwhelming background of showers initiated by charged cosmic rays through the broader time structure of the signals induced in the water-Cherenkov detectors of the arr… ▽ More We use the surface detector of the Pierre Auger Observatory to search for air showers initiated by photons with an energy above $10^{19}$ eV. Photons in the zenith angle range from 30$^\circ$ to 60$^\circ$ can be identified in the overwhelming background of showers initiated by charged cosmic rays through the broader time structure of the signals induced in the water-Cherenkov detectors of the array and the steeper lateral distribution of shower particles reaching ground. Applying the search method to data collected between January 2004 and June 2020, upper limits at 95\% CL are set to an $E^{-2}$ diffuse flux of ultra-high energy photons above $10^{19}$ eV, $2{\times}10^{19}$ eV and $4{\times}10^{19}$ eV amounting to $2.11{\times}10^{-3}$, $3.12{\times}10^{-4}$ and $1.72{\times}10^{-4}$ km$^{-2}$ sr$^{-1}$ yr$^{-1}$, respectively. While the sensitivity of the present search around $2 \times 10^{19}$ eV approaches expectations of cosmogenic photon fluxes in the case of a pure-proton composition, it is one order of magnitude above those from more realistic mixed-composition models. The inferred limits have also implications for the search of super-heavy dark matter that are discussed and illustrated. △ Less

Submitted 4 April, 2023; v1 submitted 13 September, 2022; originally announced September 2022.

Comments: 21 pages, 8 figures

On the joins of group rings

Authors: Sunil K. Chebolu, Jonathan L. Merzel, Ján Mináč, Lyle Muller, Tung T. Nguyen, Federico W. Pasini, Nguyen Duy Tân

Abstract: Given a collection $\{ G_i\}_{i=1}^d$ of finite groups and a ring $R$, we define a subring of the ring $M_n(R)$ ($n = \sum_{i=1}^d|G_i|)$ that encompasses all the individual group rings $R[G_i]$ along the diagonal blocks as $G_i$-circulant matrices. The precise definition of this ring was inspired by a construction in graph theory known as the joined union of graphs. We call this ring the join of… ▽ More Given a collection $\{ G_i\}_{i=1}^d$ of finite groups and a ring $R$, we define a subring of the ring $M_n(R)$ ($n = \sum_{i=1}^d|G_i|)$ that encompasses all the individual group rings $R[G_i]$ along the diagonal blocks as $G_i$-circulant matrices. The precise definition of this ring was inspired by a construction in graph theory known as the joined union of graphs. We call this ring the join of group rings and denote it by $\mathcal{J}_{G_1,\dots, G_d}(R)$. In this paper, we present a systematic study of the algebraic structure of $\mathcal{J}_{G_1,\dots, G_d}(R)$. We show that it has a ring structure and characterize its center, group of units, and Jacobson radical. When $R=k$ is an algebraically closed field, we derive a formula for the number of irreducible modules over $\mathcal{J}_{G_1,\dots, G_d}(k)$. We also show how a blockwise extension of the Fourier transform provides both a generalization of the Circulant Diagonalization Theorem to joins of circulant matrices and an explicit isomorphism between the join algebra and its Wedderburn components. △ Less

Submitted 1 April, 2023; v1 submitted 15 August, 2022; originally announced August 2022.

Comments: 33 pages, Accepted for publication in the Journal of Pure and Applied Algebra

MSC Class: 22D20

Cosmological implications of photon-flux upper limits at ultra-high energies in scenarios of Planckian-interacting massive particles for dark matter

Authors: The Pierre Auger Collaboration, P. Abreu, M. Aglietta, J. M. Albury, I. Allekotte, K. Almeida Cheminant, A. Almela, J. Alvarez-Muñiz, R. Alves Batista, J. Ammerman Yebra, G. A. Anastasi, L. Anchordoqui, B. Andrada, S. Andringa, C. Aramo, P. R. Araújo Ferreira, E. Arnone, J. C. Arteaga Velázquez, H. Asorey, P. Assis, G. Avila, E. Avocone, A. M. Badescu, A. Bakalova, A. Balaceanu , et al. (352 additional authors not shown)

Abstract: Using the data of the Pierre Auger Observatory, we report on a search for signatures that would be suggestive of super-heavy particles decaying in the Galactic halo. From the lack of signal, we present upper limits for different energy thresholds above ${\gtrsim}10^8$\,GeV on the secondary by-product fluxes expected from the decay of the particles. Assuming that the energy density of these super-h… ▽ More Using the data of the Pierre Auger Observatory, we report on a search for signatures that would be suggestive of super-heavy particles decaying in the Galactic halo. From the lack of signal, we present upper limits for different energy thresholds above ${\gtrsim}10^8$\,GeV on the secondary by-product fluxes expected from the decay of the particles. Assuming that the energy density of these super-heavy particles matches that of dark matter observed today, we translate the upper bounds on the particle fluxes into tight constraints on the couplings governing the decay process as a function of the particle mass. Instantons, which are non-perturbative solutions to Yang-Mills equations, can give rise to decay channels otherwise forbidden and transform stable particles into meta-stable ones. Assuming such instanton-induced decay processes, we derive a bound on the reduced coupling constant of gauge interactions in the dark sector: $α_X \lesssim 0.09$, for $10^{9} \lesssim M_X/\text{GeV} < 10^{19}$. Conversely, we obtain that, for instance, a reduced coupling constant $α_X = 0.09$ excludes masses $M_X \gtrsim 3\times 10^{13}~$GeV. In the context of dark matter production from gravitational interactions alone during the reheating epoch, we derive constraints on the parameter space that involves, in addition to $M_X$ and $α_X$, the Hubble rate at the end of inflation, the reheating efficiency, and the non-minimal coupling of the Higgs with curvature. △ Less

Submitted 15 December, 2022; v1 submitted 3 August, 2022; originally announced August 2022.

Comments: 15 pages, 8 figures, Accompanying paper of arXiv:2203.08854, accepted for publication in Phys. Rev. D

Journal ref: Phys.Rev.D 107 (2023) 4, 042002

Small changes at single nodes can shift global network dynamics

Authors: Kalel L. Rossi, Roberto C. Budzinski, Bruno R. R. Boaretto, Lyle E. Muller, Ulrike Feudel

Abstract: Understanding the sensitivity of a system's behavior with respect to parameter changes is essential for many applications. This sensitivity may be desired - for instance in the brain, where a large repertoire of different dynamics, particularly different synchronization patterns, is crucial - or may be undesired - for instance in power grids, where disruptions to synchronization may lead to blacko… ▽ More Understanding the sensitivity of a system's behavior with respect to parameter changes is essential for many applications. This sensitivity may be desired - for instance in the brain, where a large repertoire of different dynamics, particularly different synchronization patterns, is crucial - or may be undesired - for instance in power grids, where disruptions to synchronization may lead to blackouts. In this work, we show that the dynamics of networks of phase oscillators can acquire a very large and complex sensitivity to changes made in either their units' parameters or in their connections - even modifications made to a parameter of a single unit can radically alter the global dynamics of the network in an unpredictable manner. As a consequence, each modification leads to a different path to phase synchronization manifested as large fluctuations along that path. This dynamical malleability occurs over a wide parameter region, around the network's two transitions to phase synchronization. One transition is induced by increasing the coupling strength between the units, and another is induced by increasing the prevalence of long-range connections. Specifically, we study Kuramoto phase oscillators connected under either Watts-Strogatz or distance-dependent topologies to analyze the statistical properties of the fluctuations along the paths to phase synchrony. We argue that this increase in the dynamical malleability is a general phenomenon, as suggested by both previous studies and the theory of phase transitions. △ Less

Submitted 3 August, 2022; originally announced August 2022.

Comments: 14 pages, 8 figures