Showing 1–50 of 74 results for author: Richter, F

JIGGLE: An Active Sensing Framework for Boundary Parameters Estimation in Deformable Surgical Environments

Authors: Nikhil Uday Shinde, Xiao Liang, Fei Liu, Yutong Zhang, Florian Richter, Sylvia Herbert, Michael C. Yip

Abstract: Surgical automation can improve the accessibility and consistency of life saving procedures. Most surgeries require separating layers of tissue to access the surgical site, and suturing to reattach incisions. These tasks involve deformable manipulation to safely identify and alter tissue attachment (boundary) topology. Due to poor visual acuity and frequent occlusions, surgeons tend to carefully m… ▽ More Surgical automation can improve the accessibility and consistency of life saving procedures. Most surgeries require separating layers of tissue to access the surgical site, and suturing to reattach incisions. These tasks involve deformable manipulation to safely identify and alter tissue attachment (boundary) topology. Due to poor visual acuity and frequent occlusions, surgeons tend to carefully manipulate the tissue in ways that enable inference of the tissue's attachment points without causing unsafe tearing. In a similar fashion, we propose JIGGLE, a framework for estimation and interactive sensing of unknown boundary parameters in deformable surgical environments. This framework has two key components: (1) a probabilistic estimation to identify the current attachment points, achieved by integrating a differentiable soft-body simulator with an extended Kalman filter (EKF), and (2) an optimization-based active control pipeline that generates actions to maximize information gain of the tissue attachments, while simultaneously minimizing safety costs. The robustness of our estimation approach is demonstrated through experiments with real animal tissue, where we infer sutured attachment points using stereo endoscope observations. We also demonstrate the capabilities of our method in handling complex topological changes such as cutting and suturing. △ Less

Submitted 15 May, 2024; originally announced May 2024.

Comments: Accepted at RSS 2024

SURESTEP: An Uncertainty-Aware Trajectory Optimization Framework to Enhance Visual Tool Tracking for Robust Surgical Automation

Authors: Nikhil U. Shinde, Zih-Yun Chiu, Florian Richter, Jason Lim, Yuheng Zhi, Sylvia Herbert, Michael C. Yip

Abstract: Inaccurate tool localization is one of the main reasons for failures in automating surgical tasks. Imprecise robot kinematics and noisy observations caused by the poor visual acuity of an endoscopic camera make tool tracking challenging. Previous works in surgical automation adopt environment-specific setups or hard-coded strategies instead of explicitly considering motion and observation uncertai… ▽ More Inaccurate tool localization is one of the main reasons for failures in automating surgical tasks. Imprecise robot kinematics and noisy observations caused by the poor visual acuity of an endoscopic camera make tool tracking challenging. Previous works in surgical automation adopt environment-specific setups or hard-coded strategies instead of explicitly considering motion and observation uncertainty of tool tracking in their policies. In this work, we present SURESTEP, an uncertainty-aware trajectory optimization framework for robust surgical automation. We model the uncertainty of tool tracking with the components motivated by the sources of noise in typical surgical scenes. Using a Gaussian assumption to propagate our uncertainty models through a given tool trajectory, SURESTEP provides a general framework that minimizes the upper bound on the entropy of the final estimated tool distribution. We compare SURESTEP with a baseline method on a real-world suture needle regras** task under challenging environmental conditions, such as poor lighting and a moving endoscopic camera. The results over 60 regrasps on the da Vinci Research Kit (dVRK) demonstrate that our optimized trajectories significantly outperform the un-optimized baseline. △ Less

Submitted 29 March, 2024; originally announced April 2024.

HemoSet: The First Blood Segmentation Dataset for Automation of Hemostasis Management

Authors: Albert J. Miao, Shan Lin, **gpei Lu, Florian Richter, Benjamin Ostrander, Emily K. Funk, Ryan K. Orosco, Michael C. Yip

Abstract: Hemorrhaging occurs in surgeries of all types, forcing surgeons to quickly adapt to the visual interference that results from blood rapidly filling the surgical field. Introducing automation into the crucial surgical task of hemostasis management would offload mental and physical tasks from the surgeon and surgical assistants while simultaneously increasing the efficiency and safety of the operati… ▽ More Hemorrhaging occurs in surgeries of all types, forcing surgeons to quickly adapt to the visual interference that results from blood rapidly filling the surgical field. Introducing automation into the crucial surgical task of hemostasis management would offload mental and physical tasks from the surgeon and surgical assistants while simultaneously increasing the efficiency and safety of the operation. The first step in automation of hemostasis management is detection of blood in the surgical field. To propel the development of blood detection algorithms in surgeries, we present HemoSet, the first blood segmentation dataset based on bleeding during a live animal robotic surgery. Our dataset features vessel hemorrhage scenarios where turbulent flow leads to abnormal pooling geometries in surgical fields. These pools are formed in conditions endemic to surgical procedures -- uneven heterogeneous tissue, under glossy lighting conditions and rapid tool movement. We benchmark several state-of-the-art segmentation models and provide insight into the difficulties specific to blood detection. We intend for HemoSet to spur development of autonomous blood suction tools by providing a platform for training and refining blood segmentation models, addressing the precision needed for such robotics. △ Less

Submitted 2 June, 2024; v1 submitted 24 March, 2024; originally announced March 2024.

Robust Surgical Tool Tracking with Pixel-based Probabilities for Projected Geometric Primitives

Authors: Christopher D'Ambrosia, Florian Richter, Zih-Yun Chiu, Nikhil Shinde, Fei Liu, Henrik I. Christensen, Michael C. Yip

Abstract: Controlling robotic manipulators via visual feedback requires a known coordinate frame transformation between the robot and the camera. Uncertainties in mechanical systems as well as camera calibration create errors in this coordinate frame transformation. These errors result in poor localization of robotic manipulators and create a significant challenge for applications that rely on precise inter… ▽ More Controlling robotic manipulators via visual feedback requires a known coordinate frame transformation between the robot and the camera. Uncertainties in mechanical systems as well as camera calibration create errors in this coordinate frame transformation. These errors result in poor localization of robotic manipulators and create a significant challenge for applications that rely on precise interactions between manipulators and the environment. In this work, we estimate the camera-to-base transform and joint angle measurement errors for surgical robotic tools using an image based insertion-shaft detection algorithm and probabilistic models. We apply our proposed approach in both a structured environment as well as an unstructured environment and measure to demonstrate the efficacy of our methods. △ Less

Submitted 7 March, 2024; originally announced March 2024.

Strong-field quantum control by pulse sha** in the extreme ultraviolet domain

Authors: Fabian Richter, Ulf Saalmann, Enrico Allaria, Matthias Wollenhaupt, Benedetto Ardini, Alexander Brynes, Carlo Callegari, Giulio Cerullo, Miltcho Danailov, Alexander Demidovich, Katrin Dulitz, Raimund Feifel, Michele Di Fraia, Sarang Dev Ganeshamandiram, Luca Giannessi, Nicolai Gölz, Sebastian Hartweg, Bernd von Issendorff, Tim Laarmann, Friedemann Landmesser, Yilin Li, Michele Manfredda, Cristian Manzoni, Moritz Michelbach, Arne Morlok , et al. (18 additional authors not shown)

Abstract: Tailored light-matter interactions in the strong coupling regime enable the manipulation and control of quantum systems with up to unit efficiency, with applications ranging from quantum information to photochemistry. While strong light-matter interactions are readily induced at the valence electron level using long-wavelength radiation, comparable phenomena have been only recently observed with s… ▽ More Tailored light-matter interactions in the strong coupling regime enable the manipulation and control of quantum systems with up to unit efficiency, with applications ranging from quantum information to photochemistry. While strong light-matter interactions are readily induced at the valence electron level using long-wavelength radiation, comparable phenomena have been only recently observed with short wavelengths, accessing highly-excited multi-electron and inner-shell electron states. However, the quantum control of strong-field processes at short wavelengths has not been possible, so far, due to the lack of pulse sha** technologies in the extreme ultraviolet (XUV) and X-ray domain. Here, exploiting pulse sha** of the seeded free-electron laser (FEL) FERMI, we demonstrate the strong-field quantum control of ultrafast Rabi dynamics in helium atoms with high fidelity. Our approach unravels the strong-field induced bound-continuum coupling of the electronic states in helium and enables substantial suppression of the ionization rate, with prospective applications in many XUV and X-ray experiments. Leveraging recent advances in intense few-femtosecond to attosecond XUV to X-ray light sources, our results open an avenue to the efficient manipulation and selective control of core electron processes and electron correlation phenomena in real time △ Less

Submitted 4 March, 2024; originally announced March 2024.

Interpolation sets for dynamical systems

Authors: Andreas Koutsogiannis, Anh N. Le, Joel Moreira, Ronnie Pavlov, Florian K. Richter

Abstract: Originating in harmonic analysis, interpolation sets were first studied in dynamics by Glasner and Weiss in the 1980s. A set $S \subset \mathbb{N}$ is an interpolation set for a class of topological dynamical systems $\mathcal{C}$ if any bounded sequence on $S$ can be extended to a sequence that arises from a system in $\mathcal{C}$. In this paper, we provide combinatorial characterizations of int… ▽ More Originating in harmonic analysis, interpolation sets were first studied in dynamics by Glasner and Weiss in the 1980s. A set $S \subset \mathbb{N}$ is an interpolation set for a class of topological dynamical systems $\mathcal{C}$ if any bounded sequence on $S$ can be extended to a sequence that arises from a system in $\mathcal{C}$. In this paper, we provide combinatorial characterizations of interpolation sets for: $\bullet$ (totally) minimal systems; $\bullet$ topologically (weak) mixing systems; $\bullet$ strictly ergodic systems; and $\bullet$ zero entropy systems. Additionally, we prove some results on a slightly different notion, called weak interpolation sets, for several classes of systems. We also answer a question of Host, Kra, and Maass concerning the connection between sets of pointwise recurrence for distal systems and $IP$-sets. △ Less

Submitted 27 January, 2024; originally announced January 2024.

Comments: 30 pages

MSC Class: Primary: 37A46 and 37A44

Classical Invasive Description of Informationally-Complete Quantum Processes

Authors: Moritz F. Richter, Andrea Smirne, Walter T. Strunz, Dario Egloff

Abstract: In classical stochastic theory, the joint probability distributions of a stochastic process obey by definition the Kolmogorov consistency conditions. Interpreting such a process as a sequence of physical measurements with probabilistic outcomes, these conditions reflect that the measurements do not alter the state of the underlying physical system. Prominently, this assumption has to be abandoned… ▽ More In classical stochastic theory, the joint probability distributions of a stochastic process obey by definition the Kolmogorov consistency conditions. Interpreting such a process as a sequence of physical measurements with probabilistic outcomes, these conditions reflect that the measurements do not alter the state of the underlying physical system. Prominently, this assumption has to be abandoned in the context of quantum mechanics, yet there are also classical processes in which measurements influence the measured system. Here, we derive conditions that characterize uniquely classical processes that are probed by a reasonable class of invasive measurements. We then analyse under what circumstances such classical processes can simulate the statistics arising from quantum processes associated with informationally-complete measurements. We expect that our investigation will help build a bridge between two fundamental traits of non-classicality, namely, coherence and contextuality. △ Less

Submitted 11 December, 2023; originally announced December 2023.

Comments: 9+10 pages, 3 figures. Comments are welcome!

MSC Class: 81P16; 81P13; 81P40; 81S05; 62A01

Journal ref: ANNALEN DER PHYSIK 2023, 2300304

Problems on infinite sumset configurations in the integers and beyond

Authors: Bryna Kra, Joel Moreira, Florian K. Richter, Donald Robertson

Abstract: In contrast to finite arithmetic configurations, relatively little is known about which infinite patterns can be found in every set of natural numbers with positive density. Building on recent advances showing infinite sumsets can be found, we explore numerous open problems and obstructions to finding other infinite configurations in every set of natural numbers with positive density. In contrast to finite arithmetic configurations, relatively little is known about which infinite patterns can be found in every set of natural numbers with positive density. Building on recent advances showing infinite sumsets can be found, we explore numerous open problems and obstructions to finding other infinite configurations in every set of natural numbers with positive density. △ Less

Submitted 10 November, 2023; originally announced November 2023.

Comments: 37 pages

MSC Class: 05D10; 11B13; 11B30; 05-02; 11-02; 00A27; 37A05

On the local Fourier uniformity problem for small sets

Authors: Adam Kanigowski, Mariusz Lemańczyk, Florian Karl Richter, Joni Teräväinen

Abstract: We consider vanishing properties of exponential sums of the Liouville function $λ$ of the form $$ \lim_{H\to\infty}\limsup_{X\to\infty}\frac{1}{\log X}\sum_{m\leq X}\frac{1}{m}\sup_{α\in C}\bigg|\frac{1}{H}\sum_{h\leq H}λ(m+h)e^{2πihα}\bigg|=0, $$ where $C\subset\mathbb{T}$. The case $C=\mathbb{T}$ corresponds to the local $1$-Fourier uniformity conjecture of Tao, a central open problem in the stu… ▽ More We consider vanishing properties of exponential sums of the Liouville function $λ$ of the form $$ \lim_{H\to\infty}\limsup_{X\to\infty}\frac{1}{\log X}\sum_{m\leq X}\frac{1}{m}\sup_{α\in C}\bigg|\frac{1}{H}\sum_{h\leq H}λ(m+h)e^{2πihα}\bigg|=0, $$ where $C\subset\mathbb{T}$. The case $C=\mathbb{T}$ corresponds to the local $1$-Fourier uniformity conjecture of Tao, a central open problem in the study of multiplicative functions with far-reaching number-theoretic applications. We show that the above holds for any closed set $C\subset\mathbb{T}$ of zero Lebesgue measure. Moreover, we prove that extending this to any set $C$ with non-empty interior is equivalent to the $C=\mathbb{T}$ case, which shows that our results are essentially optimal without resolving the full conjecture. We also consider higher-order variants. We prove that if the linear phase $e^{2πihα}$ is replaced by a polynomial phase $e^{2πih^tα}$ for $t\geq 2$ then the statement remains true for any set $C$ of upper box-counting dimension $<1/t$. The statement also remains true if the supremum over linear phases is replaced with a supremum over all nilsequences coming form a compact countable ergodic subsets of any $t$-step nilpotent Lie group. Furthermore, we discuss the unweighted version of the local $1$-Fourier uniformity problem, showing its validity for a class of ``rigid'' sets (of full Hausdorff dimension) and proving a density result for all closed subsets of zero Lebesgue measure. △ Less

Submitted 29 May, 2024; v1 submitted 9 October, 2023; originally announced October 2023.

Comments: 25 pages; added Theorems 1.2 and 4.1 on the optimality of results; to appear in IMRN

MSC Class: 37A44; 11N37

NASU -- Novel Actuating Screw Unit: Origami-inspired Screw-based Propulsion on Mobile Ground Robots

Authors: Calvin Joyce, Jason Lim, Roger Nguyen, Michael Owens, Sara Wickenhiser, Elizabeth Peiros, Florian Richter, Michael C. Yip

Abstract: Screw-based locomotion is a robust method of locomotion across a wide range of media including water, sand, and gravel. A challenge with screws is their significant number of impactful design parameters that affect locomotion performance. One crucial parameter is the angle of attack (also called the lead angle), which has been shown to significantly impact the performance of screw propellers in te… ▽ More Screw-based locomotion is a robust method of locomotion across a wide range of media including water, sand, and gravel. A challenge with screws is their significant number of impactful design parameters that affect locomotion performance. One crucial parameter is the angle of attack (also called the lead angle), which has been shown to significantly impact the performance of screw propellers in terms of traveling velocity, force produced, degree of slip, and sinkage. As a result, the optimal design choice may vary significantly depending on application and mission objectives. In this work, we present the Novel Actuating Screw Unit (NASU). It is the first screw-based propulsion design that enables dynamic reconfiguration of the angle of attack for optimized locomotion across multiple media and use cases. The design is inspired by the kresling unit, a mechanism from origami robotics, and the angle of attack is adjusted with a linear actuator. In contrast, the entire unit is spun on its axis to generate propulsion. NASU is integrated into a mobile test bed and experiments are conducted in various media including gravel, grass, and sand. Our experiment results indicate a trade-off between locomotive efficiency and velocity exists regarding angle of attack, and the proposed design is a promising direction for reconfigurable screws by allowing control to optimize for efficiency or velocity. △ Less

Submitted 13 May, 2024; v1 submitted 29 September, 2023; originally announced October 2023.

Comments: 7 pages, 8 Figures, submitted to IROS 2024

Tracking Snake-like Robots in the Wild Using Only a Single Camera

Authors: **gpei Lu, Florian Richter, Shan Lin, Michael C. Yip

Abstract: Robot navigation within complex environments requires precise state estimation and localization to ensure robust and safe operations. For ambulating mobile robots like robot snakes, traditional methods for sensing require multiple embedded sensors or markers, leading to increased complexity, cost, and increased points of failure. Alternatively, deploying an external camera in the environment is ve… ▽ More Robot navigation within complex environments requires precise state estimation and localization to ensure robust and safe operations. For ambulating mobile robots like robot snakes, traditional methods for sensing require multiple embedded sensors or markers, leading to increased complexity, cost, and increased points of failure. Alternatively, deploying an external camera in the environment is very easy to do, and marker-less state estimation of the robot from this camera's images is an ideal solution: both simple and cost-effective. However, the challenge in this process is in tracking the robot under larger environments where the cameras may be moved around without extrinsic calibration, or maybe when in motion (e.g., a drone following the robot). The scenario itself presents a complex challenge: single-image reconstruction of robot poses under noisy observations. In this paper, we address the problem of tracking ambulatory mobile robots from a single camera. The method combines differentiable rendering with the Kalman filter. This synergy allows for simultaneous estimation of the robot's joint angle and pose while also providing state uncertainty which could be used later on for robust control. We demonstrate the efficacy of our approach on a snake-like robot in both stationary and non-stationary (moving) cameras, validating its performance in both structured and unstructured scenarios. The results achieved show an average error of 0.05 m in localizing the robot's base position and 6 degrees in joint state estimation. We believe this novel technique opens up possibilities for enhanced robot mobility and navigation in future exploratory and search-and-rescue missions. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Comments: 8 pages, 5 figures

SuPerPM: A Large Deformation-Robust Surgical Perception Framework Based on Deep Point Matching Learned from Physical Constrained Simulation Data

Authors: Shan Lin, Albert J. Miao, Ali Alabiad, Fei Liu, Kaiyuan Wang, **gpei Lu, Florian Richter, Michael C. Yip

Abstract: Manipulation of tissue with surgical tools often results in large deformations that current methods in tracking and reconstructing algorithms have not effectively addressed. A major source of tracking errors during large deformations stems from wrong data association between observed sensor measurements with previously tracked scene. To mitigate this issue, we present a surgical perception framewo… ▽ More Manipulation of tissue with surgical tools often results in large deformations that current methods in tracking and reconstructing algorithms have not effectively addressed. A major source of tracking errors during large deformations stems from wrong data association between observed sensor measurements with previously tracked scene. To mitigate this issue, we present a surgical perception framework, SuPerPM, that leverages learning-based non-rigid point cloud matching for data association, thus accommodating larger deformations. The learning models typically require training data with ground truth point cloud correspondences, which is challenging or even impractical to collect in surgical environments. Thus, for tuning the learning model, we gather endoscopic data of soft tissue being manipulated by a surgical robot and then establish correspondences between point clouds at different time points to serve as ground truth. This was achieved by employing a position-based dynamics (PBD) simulation to ensure that the correspondences adhered to physical constraints. The proposed framework is demonstrated on several challenging surgical datasets that are characterized by large deformations, achieving superior performance over state-of-the-art surgical scene tracking algorithms. △ Less

Submitted 27 March, 2024; v1 submitted 25 September, 2023; originally announced September 2023.

Spectral tuning of high-harmonic generation with resonance-gradient metasurfaces

Authors: Piyush Jangid, Felix Ulrich Richter, Ming Lun Tseng, Ivan Sinev, Sergey Kruk, Hatice Altug, Yuri Kivshar

Abstract: High-index dielectric subwavelength structures and metasurfaces are capable of enhancing light-matter interaction by orders of magnitude via geometry-dependent optical resonances. This enhancement, however, comes with a fundamental limitation of a narrow spectral range of operation in the vicinity of one or few resonant frequencies. Here we tackle this limitation and introduce an innovative and pr… ▽ More High-index dielectric subwavelength structures and metasurfaces are capable of enhancing light-matter interaction by orders of magnitude via geometry-dependent optical resonances. This enhancement, however, comes with a fundamental limitation of a narrow spectral range of operation in the vicinity of one or few resonant frequencies. Here we tackle this limitation and introduce an innovative and practical approach to achieve spectrally tunable enhancement of light-matter interaction with resonant metasurfaces. We design and fabricate {\it resonance-gradient metasurfaces} with varying geometrical parameters that translate into resonant frequencies dependence on one of the coordinates of the metasurface. The metasurfaces are composed of bone-like nanoresonators which are made of germanium, and they support high-$Q$ optical resonances in the mid-IR spectral range. We apply this general concept to observe the resonant enhancement of the $3^{\text{rd}}$ and $5^{\text{th}}$ harmonics generated from the gradient metasurfaces being used in conjunction with a tunable excitation laser to provide a wide spectral coverage of resonantly-enhanced tunable generation of multiple optical harmonics. △ Less

Submitted 27 July, 2023; originally announced July 2023.

Comments: Main text: 17 pages and 5 figures. Supplementary Information: 5 pages and 2 figures. Conference presentation link: https://doi.org/10.1364/CLEO_FS.2023.FTh4D.7

Journal ref: Adv. Mater. 2023, 2307494

Investigating Low Data, Confidence Aware Image Prediction on Smooth Repetitive Videos using Gaussian Processes

Authors: Nikhil U. Shinde, Xiao Liang, Florian Richter, Michael C. Yip

Abstract: The ability to predict future states is crucial to informed decision-making while interacting with dynamic environments. With cameras providing a prevalent and information-rich sensing modality, the problem of predicting future states from image sequences has garnered a lot of attention. Current state-of-the-art methods typically train large parametric models for their predictions. Though often ab… ▽ More The ability to predict future states is crucial to informed decision-making while interacting with dynamic environments. With cameras providing a prevalent and information-rich sensing modality, the problem of predicting future states from image sequences has garnered a lot of attention. Current state-of-the-art methods typically train large parametric models for their predictions. Though often able to predict with accuracy these models often fail to provide interpretable confidence metrics around their predictions. Additionally these methods are reliant on the availability of large training datasets to converge to useful solutions. In this paper, we focus on the problem of predicting future images of an image sequence with interpretable confidence bounds from very little training data. To approach this problem, we use non-parametric models to take a probabilistic approach to image prediction. We generate probability distributions over sequentially predicted images, and propagate uncertainty through time to generate a confidence metric for our predictions. Gaussian Processes are used for their data efficiency and ability to readily incorporate new training data online. Our methods predictions are evaluated on a smooth fluid simulation environment. We showcase the capabilities of our approach on real world data by predicting pedestrian flows and weather patterns from satellite imagery. △ Less

Submitted 14 April, 2024; v1 submitted 20 July, 2023; originally announced July 2023.

On the maximal spectral type of nilsystems

Authors: Ethan Ackelsberg, Florian K. Richter, Or Shalom

Abstract: Let $(G/Γ,R_a)$ be an ergodic $k$-step nilsystem for $k\geq 2$. We adapt an argument of Parry to show that $L^2(G/Γ)$ decomposes as a sum of a subspace with discrete spectrum and a subspace of Lebesgue spectrum with infinite multiplicity. In particular, we generalize a result previously established by Host, Kra and Maass for $2$-step nilsystems and a result by Stepin for nilsystems $G/Γ$ with conn… ▽ More Let $(G/Γ,R_a)$ be an ergodic $k$-step nilsystem for $k\geq 2$. We adapt an argument of Parry to show that $L^2(G/Γ)$ decomposes as a sum of a subspace with discrete spectrum and a subspace of Lebesgue spectrum with infinite multiplicity. In particular, we generalize a result previously established by Host, Kra and Maass for $2$-step nilsystems and a result by Stepin for nilsystems $G/Γ$ with connected, simply connected $G$. △ Less

Submitted 14 July, 2023; originally announced July 2023.

Comments: 12 pages

Random graphical model of microbiome interactions in related environments

Authors: Veronica Vinciotti, Ernst Wit, Francisco Richter

Abstract: The microbiome constitutes a complex microbial ecology of interacting components that regulates important pathways in the host. Measurements of microbial abundances are key to learning the intricate network of interactions amongst microbes. Microbial communities at various body sites tend to share some overall common structure, while also showing diversity related to the needs of the local environ… ▽ More The microbiome constitutes a complex microbial ecology of interacting components that regulates important pathways in the host. Measurements of microbial abundances are key to learning the intricate network of interactions amongst microbes. Microbial communities at various body sites tend to share some overall common structure, while also showing diversity related to the needs of the local environment. We propose a computational approach for the joint inference of microbiota systems from metagenomic data for a number of body sites. The random graphical model (RGM) allows for heterogeneity across the different environments while quantifying their relatedness at the structural level. In addition, the model allows for the inclusion of external covariates at both the microbial and interaction levels, further adapting to the richness and complexity of microbiome data. Our results show how: the RGM approach is able to capture varying levels of structural similarity across the different body sites and how this is supported by their taxonomical classification; the Bayesian implementation of the RGM fully quantifies parameter uncertainty; the microbiome network posteriors show not only a stable core, but also interesting individual differences between the various body sites, as well as interpretable relationships between various classes of microbes. △ Less

Submitted 4 April, 2023; originally announced April 2023.

Markerless Camera-to-Robot Pose Estimation via Self-supervised Sim-to-Real Transfer

Authors: **gpei Lu, Florian Richter, Michael C. Yip

Abstract: Solving the camera-to-robot pose is a fundamental requirement for vision-based robot control, and is a process that takes considerable effort and cares to make accurate. Traditional approaches require modification of the robot via markers, and subsequent deep learning approaches enabled markerless feature extraction. Mainstream deep learning methods only use synthetic data and rely on Domain Rando… ▽ More Solving the camera-to-robot pose is a fundamental requirement for vision-based robot control, and is a process that takes considerable effort and cares to make accurate. Traditional approaches require modification of the robot via markers, and subsequent deep learning approaches enabled markerless feature extraction. Mainstream deep learning methods only use synthetic data and rely on Domain Randomization to fill the sim-to-real gap, because acquiring the 3D annotation is labor-intensive. In this work, we go beyond the limitation of 3D annotations for real-world data. We propose an end-to-end pose estimation framework that is capable of online camera-to-robot calibration and a self-supervised training method to scale the training to unlabeled real-world data. Our framework combines deep learning and geometric vision for solving the robot pose, and the pipeline is fully differentiable. To train the Camera-to-Robot Pose Estimation Network (CtRNet), we leverage foreground segmentation and differentiable rendering for image-level self-supervision. The pose prediction is visualized through a renderer and the image loss with the input image is back-propagated to train the neural network. Our experimental results on two public real datasets confirm the effectiveness of our approach over existing works. We also integrate our framework into a visual servoing system to demonstrate the promise of real-time precise robot pose estimation for automation tasks. △ Less

Submitted 20 March, 2023; v1 submitted 28 February, 2023; originally announced February 2023.

Comments: 14 pages, 9 figures. Accepted to CVPR 2023

Mobility Analysis of Screw-Based Locomotion and Propulsion in Various Media

Authors: Jason Lim, Calvin Joyce, Elizabeth Peiros, Mingwei Yeoh, Peter V. Gavrilov, Sara G. Wickenhiser, Dimitri A. Schreiber, Florian Richter, Michael C. Yip

Abstract: Robots "in-the-wild" encounter and must traverse widely varying terrain, ranging from solid ground to granular materials like sand to full liquids. Numerous approaches exist, including wheeled and legged robots, each excelling in specific domains. Screw-based locomotion is a promising approach for multi-domain mobility, leveraged in exploratory robotic designs, including amphibious vehicles and sn… ▽ More Robots "in-the-wild" encounter and must traverse widely varying terrain, ranging from solid ground to granular materials like sand to full liquids. Numerous approaches exist, including wheeled and legged robots, each excelling in specific domains. Screw-based locomotion is a promising approach for multi-domain mobility, leveraged in exploratory robotic designs, including amphibious vehicles and snake robotics. However, unlike other forms of locomotion, there is a limited exploration of the models, parameter effects, and efficiency for multi-terrain Archimedes screw locomotion. In this work, we present work towards this missing component in understanding screw-based locomotion: comprehensive experimental results and performance analysis across different media. We designed a mobile test bed for indoor and outdoor experimentation to collect this data. Beyond quantitatively showing the multi-domain mobility of screw-based locomotion, we envision future researchers and engineers using the presented results to design effective screw-based locomotion systems. △ Less

Submitted 7 March, 2023; v1 submitted 25 January, 2023; originally announced January 2023.

Comments: 7 pages, 22 figures, ICRA 2023

Semantic-SuPer: A Semantic-aware Surgical Perception Framework for Endoscopic Tissue Identification, Reconstruction, and Tracking

Authors: Shan Lin, Albert J. Miao, **gpei Lu, Shunkai Yu, Zih-Yun Chiu, Florian Richter, Michael C. Yip

Abstract: Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we propose to also leverage semantic information inferred from the endoscopic video using image segmentation algorithms. In this paper, we present a novel, comprehensiv… ▽ More Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we propose to also leverage semantic information inferred from the endoscopic video using image segmentation algorithms. In this paper, we present a novel, comprehensive surgical perception framework, Semantic-SuPer, that integrates geometric and semantic information to facilitate data association, 3D reconstruction, and tracking of endoscopic scenes, benefiting downstream tasks like surgical navigation. The proposed framework is demonstrated on challenging endoscopic data with deforming tissue, showing its advantages over our baseline and several other state-of the-art approaches. Our code and dataset are available at https://github.com/ucsdarclab/Python-SuPer. △ Less

Submitted 20 February, 2023; v1 submitted 29 October, 2022; originally announced October 2022.

Comments: IEEE International Conference on Robotics and Automation (ICRA) 2023

Real-Time Constrained 6D Object-Pose Tracking of An In-Hand Suture Needle for Minimally Invasive Robotic Surgery

Authors: Zih-Yun Chiu, Florian Richter, Michael C. Yip

Abstract: Autonomous suturing has been a long-sought-after goal for surgical robotics. Outside of staged environments, accurate localization of suture needles is a critical foundation for automating various suture needle manipulation tasks in the real world. When localizing a needle held by a gripper, previous work usually tracks them separately without considering their relationship. Because of the signifi… ▽ More Autonomous suturing has been a long-sought-after goal for surgical robotics. Outside of staged environments, accurate localization of suture needles is a critical foundation for automating various suture needle manipulation tasks in the real world. When localizing a needle held by a gripper, previous work usually tracks them separately without considering their relationship. Because of the significant errors that can arise in the stereo-triangulation of objects and instruments, their reconstructions may often not be consistent. This can lead to unrealistic tool-needle grasp reconstructions that are infeasible. Instead, an obvious strategy to improve localization would be to leverage constraints that arise from contact, thereby constraining reconstructions of objects and instruments into a jointly feasible space. In this work, we consider feasible gras** constraints when tracking the 6D pose of an in-hand suture needle. We propose a reparameterization trick to define a new state space for describing a needle pose, where grasp constraints can be easily defined and satisfied. Our proposed state space and feasible gras** constraints are then incorporated into Bayesian filters for real-time needle localization. In the experiments, we show that our constrained methods outperform previous unconstrained/constrained tracking approaches and demonstrate the importance of incorporating feasible gras** constraints into automating suture needle manipulation tasks. △ Less

Submitted 21 October, 2022; originally announced October 2022.

Witnessing non-Markovianity by Quantum Quasi-Probability Distributions

Authors: Moritz F. Richter, Raphael Wiedenmann, Heinz-Peter Breuer

Abstract: We employ frames consisting of rank-one projectors (i.e. pure quantum states) and their induced informationally complete quantum measurements (IC-POVMs) to represent generally mixed quantum states by quasi-probability distributions. In the case of discrete frames on finite dimensional systems this results in a vector like representation by quasi-probability vectors, while for the continuous frame… ▽ More We employ frames consisting of rank-one projectors (i.e. pure quantum states) and their induced informationally complete quantum measurements (IC-POVMs) to represent generally mixed quantum states by quasi-probability distributions. In the case of discrete frames on finite dimensional systems this results in a vector like representation by quasi-probability vectors, while for the continuous frame of coherent states in continuous variable (CV) systems the approach directly leads to the celebrated representation by Glauber-Sudarshan P-functions and Husimi Q-functions. We explain that the Kolmogorov distances between these quasi-probability distributions lead to upper and lower bounds of the trace distance which measures the distinguishability of quantum states. We apply these results to the dynamics of open quantum systems and construct a non-Markovianity witness based on the Kolmogorov distance of the P- and Q-functions. By means of several examples we discuss the performance of this witness and demonstrate that it is useful in the regime of high entropy states for which a direct evaluation of the trace distance is typically very demanding. For Gaussian dynamics in CV systems we even find a suitable non-Markovianity measure based on the Kolmogorov distance between the P-functions which can alternatively be used as a witness for non-Gaussianity. △ Less

Submitted 12 October, 2022; originally announced October 2022.

A proof of Erdős's $B+B+t$ conjecture

Authors: Bryna Kra, Joel Moreira, Florian K. Richter, Donald Robertson

Abstract: We show that every set $A$ of natural numbers with positive upper density can be shifted to contain the restricted sumset $\{b_1 + b_2 : b_1, b_2\in B \text{ and } b_1 \neq b_2 \}$ for some infinite set $B \subset A$. We show that every set $A$ of natural numbers with positive upper density can be shifted to contain the restricted sumset $\{b_1 + b_2 : b_1, b_2\in B \text{ and } b_1 \neq b_2 \}$ for some infinite set $B \subset A$. △ Less

Submitted 6 November, 2023; v1 submitted 24 June, 2022; originally announced June 2022.

Comments: 14 pages. Changes after referee comments, improved exposition

MSC Class: 05D10; 11B13; 37A05; 11B30

Infinite Sumsets in Sets with Positive Density

Authors: Bryna Kra, Joel Moreira, Florian K. Richter, Donald Robertson

Abstract: Motivated by questions asked by Erdos, we prove that any set $A\subset{\mathbb N}$ with positive upper density contains, for any $k\in{\mathbb N}$, a sumset $B_1+\cdots+B_k$, where $B_1,\dots,B_k\subset{\mathbb N}$ are infinite. Our proof uses ergodic theory and relies on structural results for measure preserving systems. Our techniques are new, even for the previously known case of $k=2$. Motivated by questions asked by Erdos, we prove that any set $A\subset{\mathbb N}$ with positive upper density contains, for any $k\in{\mathbb N}$, a sumset $B_1+\cdots+B_k$, where $B_1,\dots,B_k\subset{\mathbb N}$ are infinite. Our proof uses ergodic theory and relies on structural results for measure preserving systems. Our techniques are new, even for the previously known case of $k=2$. △ Less

Submitted 22 February, 2024; v1 submitted 3 June, 2022; originally announced June 2022.

Comments: 49 Pages

MSC Class: 05D10 11B13 37A05 11B30

Image Based Reconstruction of Liquids from 2D Surface Detections

Authors: Florian Richter, Ryan K. Orosco, Michael C. Yip

Abstract: In this work, we present a solution to the challenging problem of reconstructing liquids from image data. The challenges in reconstructing liquids, which is not faced in previous reconstruction works on rigid and deforming surfaces, lies in the inability to use depth sensing and color features due the variable index of refraction, opacity, and environmental reflections. Therefore, we limit ourselv… ▽ More In this work, we present a solution to the challenging problem of reconstructing liquids from image data. The challenges in reconstructing liquids, which is not faced in previous reconstruction works on rigid and deforming surfaces, lies in the inability to use depth sensing and color features due the variable index of refraction, opacity, and environmental reflections. Therefore, we limit ourselves to only surface detections (i.e. binary mask) of liquids as observations and do not assume any prior knowledge on the liquids properties. A novel optimization problem is posed which reconstructs the liquid as particles by minimizing the error between a rendered surface from the particles and the surface detections while satisfying liquid constraints. Our solvers to this optimization problem are presented and no training data is required to apply them. We also propose a dynamic prediction to seed the reconstruction optimization from the previous time-step. We test our proposed methods in simulation and on two new liquid datasets which we open source so the broader research community can continue develo** in this under explored area. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: 14 pages, 11 figures, 2 tables

Markerless Suture Needle 6D Pose Tracking with Robust Uncertainty Estimation for Autonomous Minimally Invasive Robotic Surgery

Authors: Zih-Yun Chiu, Albert Z Liao, Florian Richter, Bjorn Johnson, Michael C. Yip

Abstract: Suture needle localization is necessary for autonomous suturing. Previous approaches in autonomous suturing often relied on fiducial markers rather than markerless detection schemes for localizing a suture needle due to the inconsistency of markerless detections. However, fiducial markers are not practical for real-world applications and can often be occluded from environmental factors in surgery… ▽ More Suture needle localization is necessary for autonomous suturing. Previous approaches in autonomous suturing often relied on fiducial markers rather than markerless detection schemes for localizing a suture needle due to the inconsistency of markerless detections. However, fiducial markers are not practical for real-world applications and can often be occluded from environmental factors in surgery (e.g., blood). Therefore in this work, we present a robust tracking approach for estimating the 6D pose of a suture needle when using inconsistent detections. We define observation models based on suture needles' geometry that captures the uncertainty of the detections and fuse them temporally in a probabilistic fashion. In our experiments, we compare different permutations of the observation models in the suture needle localization task to show their effectiveness. Our proposed method outperforms previous approaches in localizing a suture needle. We also demonstrate the proposed tracking method in an autonomous suture needle regras** task and ex vivo environments. △ Less

Submitted 4 April, 2022; v1 submitted 26 September, 2021; originally announced September 2021.

From Bench to Bedside: The First Live Robotic Surgery on the dVRK to Enable Remote Telesurgery with Motion Scaling

Authors: Florian Richter, Emily K. Funk, Won Seo Park, Ryan K. Orosco, Michael C. Yip

Abstract: Innovations from surgical robotic research rarely translates to live surgery due to the significant difference between the lab and a live environment. Live environments require considerations that are often overlooked during early stages of research such as surgical staff, surgical procedure, and the challenges of working with live tissue. One such example is the da Vinci Research Kit (dVRK) which… ▽ More Innovations from surgical robotic research rarely translates to live surgery due to the significant difference between the lab and a live environment. Live environments require considerations that are often overlooked during early stages of research such as surgical staff, surgical procedure, and the challenges of working with live tissue. One such example is the da Vinci Research Kit (dVRK) which is used by over 40 robotics research groups and represents an open-sourced version of the da Vinci Surgical System. Despite dVRK being available for nearly a decade and the ideal candidate for translating research to practice on over 5,000 da Vinci Systems used in hospitals around the world, not one live surgery has been conducted with it. In this paper, we address the challenges, considerations, and solutions for translating surgical robotic research from bench-to-bedside. This is explained from the perspective of a remote telesurgery scenario where motion scaling solutions previously experimented in a lab setting are translated to a live pig surgery. This study presents results from the first ever use of a dVRK in a live animal and discusses how the surgical robotics community can approach translating their research to practice. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Comments: 7 pages, 7 figures, presented at ISMR 2021

ARCSnake: Reconfigurable Snake-Like Robot with Archimedean Screw Propulsion for Multi-Domain Mobility

Authors: Florian Richter, Peter V. Gavrilov, Hoi Man Lam, Amir Degani, Michael C. Yip

Abstract: Exploring and navigating in extreme environments, such as caves, oceans, and planetary bodies, are often too hazardous for humans, and as such, robots are possible surrogates. These robots are met with significant locomotion challenges that require traversing a wide range of surface roughnesses and topologies. Previous locomotion strategies, involving wheels or ambulatory motion, such as snake pla… ▽ More Exploring and navigating in extreme environments, such as caves, oceans, and planetary bodies, are often too hazardous for humans, and as such, robots are possible surrogates. These robots are met with significant locomotion challenges that require traversing a wide range of surface roughnesses and topologies. Previous locomotion strategies, involving wheels or ambulatory motion, such as snake platforms, have success on specific surfaces but fail in others which could be detrimental in exploration and navigation missions. In this paper, we present a novel approach that combines snake-like robots with an Archimedean screw locomotion mechanism to provide multiple, effective mobility strategies in a large range of environments, including those that are difficult to traverse for wheeled and ambulatory robots. This work develops a robotic system called ARCSnake to demonstrate this locomotion principle and tested it in a variety of different terrains and environments in order to prove its controllable, multi-domain, navigation capabilities. These tests show a wide breadth of scenarios that ARCSnake can handle, hence demonstrating its ability to traverse through extreme terrains. △ Less

Submitted 30 July, 2021; originally announced July 2021.

Comments: 12 pages, 17 figures

A combinatorial proof of a sumset conjecture of Furstenberg

Authors: Daniel Glasscock, Joel Moreira, Florian K. Richter

Abstract: We give a new proof of a sumset conjecture of Furstenberg that was first proved by Hochman and Shmerkin in 2012: if $\log r / \log s$ is irrational and $X$ and $Y$ are $\times r$- and $\times s$-invariant subsets of $[0,1]$, respectively, then $\dim_\text{H} (X+Y) = \min ( 1, \dim_\text{H} X + \dim_\text{H} Y)$. Our main result yields information on the size of the sumset $λX + ηY$ uniformly acros… ▽ More We give a new proof of a sumset conjecture of Furstenberg that was first proved by Hochman and Shmerkin in 2012: if $\log r / \log s$ is irrational and $X$ and $Y$ are $\times r$- and $\times s$-invariant subsets of $[0,1]$, respectively, then $\dim_\text{H} (X+Y) = \min ( 1, \dim_\text{H} X + \dim_\text{H} Y)$. Our main result yields information on the size of the sumset $λX + ηY$ uniformly across a compact set of parameters at fixed scales. The proof is combinatorial and avoids the machinery of local entropy averages and CP-processes, relying instead on a quantitative, discrete Marstrand projection theorem and a subtree regularity theorem that may be of independent interest. △ Less

Submitted 5 January, 2024; v1 submitted 22 July, 2021; originally announced July 2021.

Comments: 26 pages. Some of this work was originally posted to the arXiv in the first half of the paper "Additive transversality of fractal sets in the reals and the integers" (arXiv:2007.05480v1); that paper has since been updated (arXiv:2007.05480) and no longer includes any of this work

Journal ref: Combinatorica 43 2023, no 2, 299-328

Enhanced electro-optic modulation in resonant metasurfaces of lithium niobate

Authors: Helena Weigand, Viola V. Vogler-Neuling, Marc Reig Escalé, David Pohl, Felix Richter, Artemios Karvounis, Flavia Timpu, Rachel Grange

Abstract: In display technologies or data processing, planar and subwavelength free-space components suited for flat photonic devices are needed. Metasurfaces, which shape the optical wavefront within hundreds of nanometers, can provide a solution for thin and portable photonic devices, e.g. as CMOS-compatible modules. While conventional electro-optic modulators are inconvenient to operate in free space con… ▽ More In display technologies or data processing, planar and subwavelength free-space components suited for flat photonic devices are needed. Metasurfaces, which shape the optical wavefront within hundreds of nanometers, can provide a solution for thin and portable photonic devices, e.g. as CMOS-compatible modules. While conventional electro-optic modulators are inconvenient to operate in free space configurations, its principle can largely be applied to the development of active metasurfaces with the prospect of modulation speeds up to the GHz region. Here, we use this concept to realize fast and continuous modulation of light at low voltage and MHz speed with a lithium niobate metasurface tuned by the linear electro-optic effect. Furthermore, we exploit the resonance in the visible to enhance the modulation of the transmitted light by two orders of magnitude, namely by a factor of 80, compared to the unstructured substrate. This proof-of-concept work is a first important step towards the use of lithium niobate metasurfaces for free space modulation. △ Less

Submitted 21 July, 2021; v1 submitted 23 June, 2021; originally announced June 2021.

On Katznelson's Question for skew product systems

Authors: Daniel Glasscock, Andreas Koutsogiannis, Florian K. Richter

Abstract: Katznelson's Question is a long-standing open question concerning recurrence in topological dynamics with strong historical and mathematical ties to open problems in combinatorics and harmonic analysis. In this article, we give a positive answer to Katznelson's Question for certain towers of skew product extensions of equicontinuous systems, including systems of the form… ▽ More Katznelson's Question is a long-standing open question concerning recurrence in topological dynamics with strong historical and mathematical ties to open problems in combinatorics and harmonic analysis. In this article, we give a positive answer to Katznelson's Question for certain towers of skew product extensions of equicontinuous systems, including systems of the form $(x,t) \mapsto (x + α, t + h(x))$. We describe which frequencies must be controlled for in order to ensure recurrence in such systems, and we derive combinatorial corollaries concerning the difference sets of syndetic subsets of the natural numbers. △ Less

Submitted 30 July, 2022; v1 submitted 21 June, 2021; originally announced June 2021.

Comments: 38 pages, revised version; the statement of Theorem C has become more general addressing the case in which a higher-order derivative of the sequence f is almost periodic. To appear in BAMS

MSC Class: 37B05; 37B20; 05B10

Journal ref: Bull. Amer. Math. Soc., Volume 59 (2022), Number 4, pages 569-606

Autonomous Kinetic Modeling of Biomass Pyrolysis using Chemical Reaction Neural Networks

Authors: Weiqi Ji, Franz Richter, Michael J. Gollner, Sili Deng

Abstract: Modeling the burning processes of biomass such as wood, grass, and crops is crucial for the modeling and prediction of wildland and urban fire behavior. Despite its importance, the burning of solid fuels remains poorly understood, which can be partly attributed to the unknown chemical kinetics of most solid fuels. Most available kinetic models were built upon expert knowledge, which requires chemi… ▽ More Modeling the burning processes of biomass such as wood, grass, and crops is crucial for the modeling and prediction of wildland and urban fire behavior. Despite its importance, the burning of solid fuels remains poorly understood, which can be partly attributed to the unknown chemical kinetics of most solid fuels. Most available kinetic models were built upon expert knowledge, which requires chemical insights and years of experience. This work presents a framework for autonomously discovering biomass pyrolysis kinetic models from thermogravimetric analyzer (TGA) experimental data using the recently developed chemical reaction neural networks (CRNN). The approach incorporated the CRNN model into the framework of neural ordinary differential equations to predict the residual mass in TGA data. In addition to the flexibility of neural-network-based models, the learned CRNN model is interpretable, by incorporating the fundamental physics laws, such as the law of mass action and Arrhenius law, into the neural network structure. The learned CRNN model can then be translated into the classical forms of biomass chemical kinetic models, which facilitates the extraction of chemical insights and the integration of the kinetic model into large-scale fire simulations. We demonstrated the effectiveness of the framework in predicting the pyrolysis and oxidation of cellulose. This successful demonstration opens the possibility of rapid and autonomous chemical kinetic modeling of solid fuels, such as wildfire fuels and industrial polymers. △ Less

Submitted 8 January, 2022; v1 submitted 24 May, 2021; originally announced May 2021.

SOLO: Search Online, Learn Offline for Combinatorial Optimization Problems

Authors: Joel Oren, Chana Ross, Maksym Lefarov, Felix Richter, Ayal Taitler, Zohar Feldman, Christian Daniel, Dotan Di Castro

Abstract: We study combinatorial problems with real world applications such as machine scheduling, routing, and assignment. We propose a method that combines Reinforcement Learning (RL) and planning. This method can equally be applied to both the offline, as well as online, variants of the combinatorial problem, in which the problem components (e.g., jobs in scheduling problems) are not known in advance, bu… ▽ More We study combinatorial problems with real world applications such as machine scheduling, routing, and assignment. We propose a method that combines Reinforcement Learning (RL) and planning. This method can equally be applied to both the offline, as well as online, variants of the combinatorial problem, in which the problem components (e.g., jobs in scheduling problems) are not known in advance, but rather arrive during the decision-making process. Our solution is quite generic, scalable, and leverages distributional knowledge of the problem parameters. We frame the solution process as an MDP, and take a Deep Q-Learning approach wherein states are represented as graphs, thereby allowing our trained policies to deal with arbitrary changes in a principled manner. Though learned policies work well in expectation, small deviations can have substantial negative effects in combinatorial settings. We mitigate these drawbacks by employing our graph-convolutional policies as non-optimal heuristics in a compatible search algorithm, Monte Carlo Tree Search, to significantly improve overall performance. We demonstrate our method on two problems: Machine Scheduling and Capacitated Vehicle Routing. We show that our method outperforms custom-tailored mathematical solvers, state of the art learning-based algorithms, and common heuristics, both in computation time and performance. △ Less

Submitted 18 May, 2021; v1 submitted 4 April, 2021; originally announced April 2021.

Robotic Tool Tracking under Partially Visible Kinematic Chain: A Unified Approach

Authors: Florian Richter, **gpei Lu, Ryan K. Orosco, Michael C. Yip

Abstract: Anytime a robot manipulator is controlled via visual feedback, the transformation between the robot and camera frame must be known. However, in the case where cameras can only capture a portion of the robot manipulator in order to better perceive the environment being interacted with, there is greater sensitivity to errors in calibration of the base-to-camera transform. A secondary source of uncer… ▽ More Anytime a robot manipulator is controlled via visual feedback, the transformation between the robot and camera frame must be known. However, in the case where cameras can only capture a portion of the robot manipulator in order to better perceive the environment being interacted with, there is greater sensitivity to errors in calibration of the base-to-camera transform. A secondary source of uncertainty during robotic control are inaccuracies in joint angle measurements which can be caused by biases in positioning and complex transmission effects such as backlash and cable stretch. In this work, we bring together these two sets of unknown parameters into a unified problem formulation when the kinematic chain is partially visible in the camera view. We prove that these parameters are non-identifiable implying that explicit estimation of them is infeasible. To overcome this, we derive a smaller set of parameters we call Lumped Error since it lumps together the errors of calibration and joint angle measurements. A particle filter method is presented and tested in simulation and on two real world robots to estimate the Lumped Error and show the efficiency of this parameter reduction. △ Less

Submitted 6 September, 2021; v1 submitted 11 February, 2021; originally announced February 2021.

Comments: 18 pages, 13 figures, and 3 tables

Model-Predictive Control of Blood Suction for Surgical Hemostasis using Differentiable Fluid Simulations

Authors: **gbin Huang, Fei Liu, Florian Richter, Michael C. Yip

Abstract: Recent developments in surgical robotics have led to new advancements in the automation of surgical sub-tasks such as suturing, soft tissue manipulation, tissue tensioning and cutting. However, integration of dynamics to optimize these control policies for the variety of scenes encountered in surgery remains unsolved. Towards this effort, we investigate the integration of differentiable fluid dyna… ▽ More Recent developments in surgical robotics have led to new advancements in the automation of surgical sub-tasks such as suturing, soft tissue manipulation, tissue tensioning and cutting. However, integration of dynamics to optimize these control policies for the variety of scenes encountered in surgery remains unsolved. Towards this effort, we investigate the integration of differentiable fluid dynamics to optimizing a suction tool's trajectory to clear the surgical field from blood as fast as possible. The fully differentiable fluid dynamics is integrated with a novel suction model for effective model predictive control of the tool. The differentiability of the fluid model is crucial because we utilize the gradients of the fluid states with respect to the suction tool position to optimize the trajectory. Through a series of experiments, we demonstrate how, by incorporating fluid models, the trajectories generated by our method can perform as good as or better than handcrafted human-intuitive suction policies. We also show that our method is adaptable and can work in different cavity conditions while using a single handcrafted strategy fails. △ Less

Submitted 2 February, 2021; originally announced February 2021.

Comments: Submission to ICRA2021

Bimanual Regras** for Suture Needles using Reinforcement Learning for Rapid Motion Planning

Authors: Zih-Yun Chiu, Florian Richter, Emily K. Funk, Ryan K. Orosco, Michael C. Yip

Abstract: Regras** a suture needle is an important yet time-consuming process in suturing. To bring efficiency into regras**, prior work either designs a task-specific mechanism or guides the gripper toward some specific pick-up point for proper gras** of a needle. Yet, these methods are usually not deployable when the working space is changed. Therefore, in this work, we present rapid trajectory gene… ▽ More Regras** a suture needle is an important yet time-consuming process in suturing. To bring efficiency into regras**, prior work either designs a task-specific mechanism or guides the gripper toward some specific pick-up point for proper gras** of a needle. Yet, these methods are usually not deployable when the working space is changed. Therefore, in this work, we present rapid trajectory generation for bimanual needle regras** via reinforcement learning (RL). Demonstrations from a sampling-based motion planning algorithm is incorporated to speed up the learning. In addition, we propose the ego-centric state and action spaces for this bimanual planning problem, where the reference frames are on the end-effectors instead of some fixed frame. Thus, the learned policy can be directly applied to any feasible robot configuration. Our experiments in simulation show that the success rate of a single pass is 97%, and the planning time is 0.0212s on average, which outperforms other widely used motion planning algorithms. For the real-world experiments, the success rate is 73.3% if the needle pose is reconstructed from an RGB image, with a planning time of 0.0846s and a run time of 5.1454s. If the needle pose is known beforehand, the success rate becomes 90.5%, with a planning time of 0.0807s and a run time of 2.8801s. △ Less

Submitted 23 May, 2021; v1 submitted 9 November, 2020; originally announced November 2020.

Real-to-Sim Registration of Deformable Soft Tissue with Position-Based Dynamics for Surgical Robot Autonomy

Authors: Fei Liu, Zihan Li, Yunhai Han, **gpei Lu, Florian Richter, Michael C. Yip

Abstract: Autonomy in robotic surgery is very challenging in unstructured environments, especially when interacting with deformable soft tissues. The main difficulty is to generate model-based control methods that account for deformation dynamics during tissue manipulation. Previous works in vision-based perception can capture the geometric changes within the scene, however, model-based controllers integrat… ▽ More Autonomy in robotic surgery is very challenging in unstructured environments, especially when interacting with deformable soft tissues. The main difficulty is to generate model-based control methods that account for deformation dynamics during tissue manipulation. Previous works in vision-based perception can capture the geometric changes within the scene, however, model-based controllers integrated with dynamic properties, a more accurate and safe approach, has not been studied before. Considering the mechanic coupling between the robot and the environment, it is crucial to develop a registered, simulated dynamical model. In this work, we propose an online, continuous, real-to-sim registration method to bridge 3D visual perception with position-based dynamics (PBD) modeling of tissues. The PBD method is employed to simulate soft tissue dynamics as well as rigid tool interactions for model-based control. Meanwhile, a vision-based strategy is used to generate 3D reconstructed point cloud surfaces based on real-world manipulation, so as to register and update the simulation. To verify this real-to-sim approach, tissue experiments have been conducted on the da Vinci Research Kit. Our real-to-sim approach successfully reduces registration error online, which is especially important for safety during autonomous control. Moreover, it achieves higher accuracy in occluded areas than fusion-based reconstruction. △ Less

Submitted 30 April, 2021; v1 submitted 2 November, 2020; originally announced November 2020.

Comments: Fei Liu and Zihan Li contributed equally to this work. Final version of this paper is going to be published in ICRA 2021

Autonomous Robotic Suction to Clear the Surgical Field for Hemostasis using Image-based Blood Flow Detection

Authors: Florian Richter, Shihao Shen, Fei Liu, **gbin Huang, Emily K. Funk, Ryan K. Orosco, Michael C. Yip

Abstract: Autonomous robotic surgery has seen significant progression over the last decade with the aims of reducing surgeon fatigue, improving procedural consistency, and perhaps one day take over surgery itself. However, automation has not been applied to the critical surgical task of controlling tissue and blood vessel bleeding--known as hemostasis. The task of hemostasis covers a spectrum of bleeding so… ▽ More Autonomous robotic surgery has seen significant progression over the last decade with the aims of reducing surgeon fatigue, improving procedural consistency, and perhaps one day take over surgery itself. However, automation has not been applied to the critical surgical task of controlling tissue and blood vessel bleeding--known as hemostasis. The task of hemostasis covers a spectrum of bleeding sources and a range of blood velocity, trajectory, and volume. In an extreme case, an un-controlled blood vessel fills the surgical field with flowing blood. In this work, we present the first, automated solution for hemostasis through development of a novel probabilistic blood flow detection algorithm and a trajectory generation technique that guides autonomous suction tools towards pooling blood. The blood flow detection algorithm is tested in both simulated scenes and in a real-life trauma scenario involving a hemorrhage that occurred during thyroidectomy. The complete solution is tested in a physical lab setting with the da Vinci Research Kit (dVRK) and a simulated surgical cavity for blood to flow through. The results show that our automated solution has accurate detection, a fast reaction time, and effective removal of the flowing blood. Therefore, the proposed methods are powerful tools to clearing the surgical field which can be followed by either a surgeon or future robotic automation developments to close the vessel rupture. △ Less

Submitted 18 January, 2021; v1 submitted 16 October, 2020; originally announced October 2020.

Comments: Accepted to IEEE Robotics and Automation Letters January, 2021, 8 pages, 8 figures, 1 table

Pose Estimation for Robot Manipulators via Keypoint Optimization and Sim-to-Real Transfer

Authors: **gpei Lu, Florian Richter, Michael Yip

Abstract: Keypoint detection is an essential building block for many robotic applications like motion capture and pose estimation. Historically, keypoints are detected using uniquely engineered markers such as checkerboards or fiducials. More recently, deep learning methods have been explored as they have the ability to detect user-defined keypoints in a marker-less manner. However, different manually selec… ▽ More Keypoint detection is an essential building block for many robotic applications like motion capture and pose estimation. Historically, keypoints are detected using uniquely engineered markers such as checkerboards or fiducials. More recently, deep learning methods have been explored as they have the ability to detect user-defined keypoints in a marker-less manner. However, different manually selected keypoints can have uneven performance when it comes to detection and localization. An example of this can be found on symmetric robotic tools where DNN detectors cannot solve the correspondence problem correctly. In this work, we propose a new and autonomous way to define the keypoint locations that overcomes these challenges. The approach involves finding the optimal set of keypoints on robotic manipulators for robust visual detection and localization. Using a robotic simulator as a medium, our algorithm utilizes synthetic data for DNN training, and the proposed algorithm is used to optimize the selection of keypoints through an iterative approach. The results show that when using the optimized keypoints, the detection performance of the DNNs improved significantly. We further use the optimized keypoints for real robotic applications by using domain randomization to bridge the reality gap between the simulator and the physical world. The physical world experiments show how the proposed method can be applied to the wide-breadth of robotic applications that require visual feedback, such as camera-to-robot calibration, robotic tool tracking, and end-effector pose estimation. △ Less

Submitted 7 February, 2022; v1 submitted 15 October, 2020; originally announced October 2020.

Comments: 8 pages, 9 figures. Accepted to IEEE Robotics and Automation Letters January, 2022

Journal ref: in IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4622-4629, April 2022

Additive and geometric transversality of fractal sets in the integers

Authors: Daniel Glasscock, Joel Moreira, Florian K. Richter

Abstract: By juxtaposing ideas from fractal geometry and dynamical systems, Furstenberg proposed a series of conjectures in the late 1960's that explore the relationship between digit expansions with respect to multiplicatively independent bases. In this work, we introduce and study - in the discrete context of the integers - analogues of some of the notions and results surrounding Furstenberg's work. In pa… ▽ More By juxtaposing ideas from fractal geometry and dynamical systems, Furstenberg proposed a series of conjectures in the late 1960's that explore the relationship between digit expansions with respect to multiplicatively independent bases. In this work, we introduce and study - in the discrete context of the integers - analogues of some of the notions and results surrounding Furstenberg's work. In particular, we define a new class of fractal sets of integers that parallels the notion of $\times r$-invariant sets on the 1-torus and investigate the additive and geometric independence between two such fractal sets when they are structured with respect to multiplicatively independent bases. Our main results in this direction parallel the works of Furstenberg, Hochman-Shmerkin, Shmerkin, Wu, and Lindenstrauss-Meiri-Peres and include: -a classification of all subsets of the positive integers that are simultaneously $\times r$- and $\times s$-invariant; -integer analogues of two of Furstenberg's transversality conjectures pertaining to the dimensions of the intersection $A\cap B$ and the sumset $A+B$ of $\times r$- and $\times s$-invariant sets $A$ and $B$ when $r$ and $s$ are multiplicatively independent; and -a description of the dimension of iterated sumsets $A+A+\cdots+A$ for any $\times r$-invariant set $A$. We achieve these results by combining ideas from fractal geometry and ergodic theory to build a bridge between the continuous and discrete regimes. For the transversality results, we rely heavily on quantitative bounds on the $L^q$-dimensions of projections of restricted digit Cantor measures obtained recently by Shmerkin. We end by outlining a number of open questions and directions regarding fractal subsets of the integers. △ Less

Submitted 20 July, 2021; v1 submitted 10 July, 2020; originally announced July 2020.

Comments: 51 pages

MSC Class: 11A63; 37C45; 28A80; 11K55

Space of Reasons and Mathematical Model

Authors: Florian Richter

Abstract: Inferential relations govern our concept use. In order to understand a concept it has to be located in a space of implications. There are different kinds of conditions for statements, i.e. that the conditions represent different kinds of explanations, e.g. causal or conceptual explanations. The crucial questions is: How can the conditionality of language use be represented. The conceptual backgrou… ▽ More Inferential relations govern our concept use. In order to understand a concept it has to be located in a space of implications. There are different kinds of conditions for statements, i.e. that the conditions represent different kinds of explanations, e.g. causal or conceptual explanations. The crucial questions is: How can the conditionality of language use be represented. The conceptual background of representation in models is discussed and in the end I propose how implications of propositional logic and conceptual determinations can be represented in a model of a neural network. △ Less

Submitted 5 July, 2020; originally announced July 2020.

Inferences and Modal Vocabulary

Authors: Florian Richter

Abstract: Deduction is the one of the major forms of inferences and commonly used in formal logic. This kind of inference has the feature of monotonicity, which can be problematic. There are different types of inferences that are not monotonic, e.g. abductive inferences. The debate between advocates and critics of abduction as a useful instrument can be reconstructed along the issue, how an abductive infere… ▽ More Deduction is the one of the major forms of inferences and commonly used in formal logic. This kind of inference has the feature of monotonicity, which can be problematic. There are different types of inferences that are not monotonic, e.g. abductive inferences. The debate between advocates and critics of abduction as a useful instrument can be reconstructed along the issue, how an abductive inference warrants to pick out one hypothesis as the best one. But how can the goodness of an inference be assessed? Material inferences express good inferences based on the principle of material incompatibility. Material inferences are based on modal vocabulary, which enriches the logical expressivity of the inferential relations. This leads also to certain limits in the application of labeling in machine learning. I propose a modal interpretation of implications to express conceptual relations. △ Less

Submitted 5 July, 2020; originally announced July 2020.

Logic, Language, and Calculus

Authors: Florian Richter

Abstract: The difference between object-language and metalanguage is crucial for logical analysis, but has yet not been examined for the field of computer science. In this paper the difference is examined with regard to inferential relations. It is argued that inferential relations in a metalanguage (like a calculus for propositional logic) cannot represent conceptual relations of natural language. Inferent… ▽ More The difference between object-language and metalanguage is crucial for logical analysis, but has yet not been examined for the field of computer science. In this paper the difference is examined with regard to inferential relations. It is argued that inferential relations in a metalanguage (like a calculus for propositional logic) cannot represent conceptual relations of natural language. Inferential relations govern our concept use and understanding. Several approaches in the field of Natural Language Understanding (NLU) and Natural Language Inference (NLI) take this insight in account, but do not consider, how an inference can be assessed as a good inference. I present a logical analysis that can assesss the normative dimension of inferences, which is a crucial part of logical understanding and goes beyond formal understanding of metalanguages. △ Less

Submitted 5 July, 2020; originally announced July 2020.

Multiple ergodic averages along functions from a Hardy field: convergence, recurrence and combinatorial applications

Authors: Vitaly Bergelson, Joel Moreira, Florian K. Richter

Abstract: We obtain new results pertaining to convergence and recurrence of multiple ergodic averages along functions from a Hardy field. Among other things, we confirm some of the conjectures posed by Frantzikinakis in [Fra10; Fra16] and obtain combinatorial applications which contain, as rather special cases, several previously known (polynomial and non-polynomial) extensions of Szemeredi's theorem on ari… ▽ More We obtain new results pertaining to convergence and recurrence of multiple ergodic averages along functions from a Hardy field. Among other things, we confirm some of the conjectures posed by Frantzikinakis in [Fra10; Fra16] and obtain combinatorial applications which contain, as rather special cases, several previously known (polynomial and non-polynomial) extensions of Szemeredi's theorem on arithmetic progressions [BL96; BLL08; FW09; Fra10; BMR17]. One of the novel features of our results, which is not present in previous work, is that they allow for a mixture of polynomials and non-polynomial functions. As an illustration, assume $f_i(t)=a_{i,1}t^{c_{i,1}}+\cdots+a_{i,d}t^{c_{i,d}}$ for $c_{i,j}>0$ and $a_{i,j}\in\mathbb{R}$. Then $\bullet$ for any measure preserving system $(X,{\mathcal B},μ,T)$ and $h_1,\dots,h_k\in L^\infty(X)$, the limit $$\lim_{N\to\infty}\frac{1}{N}\sum_{n=1}^N T^{[f_1(n)]}h_1\cdots T^{[f_k(n)]}h_k$$ exists in $L^2$; $\bullet$ for any $E\subset \mathbb{N}$ with $\overline{\mathrm{d}}(E)>0$ there are $a,n\in\mathbb{N}$ such that $\{a,\, a+[f_1(n)],\ldots,a+[f_k(n)]\}\subset E$. We also show that if $f_1,\dots,f_k$ belong to a Hardy field, have polynomial growth, and are such that no linear combination of them is a polynomial, then for any measure preserving system $(X,{\mathcal B},μ,T)$ and any $A\in{\mathcal B}$, $$\limsup_{N\to\infty}\frac{1}{N}\sum_{n=1}^Nμ\Big(A\cap T^{-[ f_1(n) ]}A\cap\ldots\cap T^{-[f_k(n)]}A\Big)\,\geq\,μ(A)^{k+1}.$$ △ Less

Submitted 21 February, 2024; v1 submitted 5 June, 2020; originally announced June 2020.

Comments: 41 pages, 2nd revised version implementing referee comments

MSC Class: 37A44; 28D05; 05D10; 11B30

Uniform distribution in nilmanifolds along functions from a Hardy field

Authors: Florian K. Richter

Abstract: We study equidistribution properties of translations on nilmanifolds along functions of polynomial growth from a Hardy field. More precisely, if $X=G/Γ$ is a nilmanifold, $a_1,\ldots,a_k\in G$ are commuting nilrotations, and $f_1,\ldots,f_k$ are functions of polynomial growth from a Hardy field then we show that $\bullet$ the distribution of the sequence… ▽ More We study equidistribution properties of translations on nilmanifolds along functions of polynomial growth from a Hardy field. More precisely, if $X=G/Γ$ is a nilmanifold, $a_1,\ldots,a_k\in G$ are commuting nilrotations, and $f_1,\ldots,f_k$ are functions of polynomial growth from a Hardy field then we show that $\bullet$ the distribution of the sequence $a_1^{f_1(n)}\cdot\ldots\cdot a_k^{f_k(n)}Γ$ is governed by its projection onto the maximal factor torus, which extends Leibman's Equidistribution Criterion form polynomials to a much wider range of functions; and $\bullet$ the orbit closure of $a_1^{f_1(n)}\cdot\ldots\cdot a_k^{f_k(n)}Γ$ is always a finite union of sub-nilmanifolds, which extends some of the previous work of Leibman and Frantzikinakis on this topic. △ Less

Submitted 17 December, 2023; v1 submitted 2 June, 2020; originally announced June 2020.

Comments: 49 pages, 2nd revised version after referee comments

Journal ref: Journal d'Analyse Mathématique 149 (2023): 421 - 483

Structure of multicorrelation sequences with integer part polynomial iterates along primes

Authors: Andreas Koutsogiannis, Anh N. Le, Joel Moreira, Florian K. Richter

Abstract: Let $T$ be a measure preserving $\mathbb{Z}^\ell$-action on the probability space $(X,{\mathcal B},μ),$ $q_1,\dots,q_m:{\mathbb R}\to{\mathbb R}^\ell$ vector polynomials, and $f_0,\dots,f_m\in L^\infty(X)$. For any $ε> 0$ and multicorrelation sequences of the form $\displaystyleα(n)=\int_Xf_0\cdot T^{ \lfloor q_1(n) \rfloor }f_1\cdots T^{ \lfloor q_m(n) \rfloor }f_m\;dμ$ we show that there exists… ▽ More Let $T$ be a measure preserving $\mathbb{Z}^\ell$-action on the probability space $(X,{\mathcal B},μ),$ $q_1,\dots,q_m:{\mathbb R}\to{\mathbb R}^\ell$ vector polynomials, and $f_0,\dots,f_m\in L^\infty(X)$. For any $ε> 0$ and multicorrelation sequences of the form $\displaystyleα(n)=\int_Xf_0\cdot T^{ \lfloor q_1(n) \rfloor }f_1\cdots T^{ \lfloor q_m(n) \rfloor }f_m\;dμ$ we show that there exists a nilsequence $ψ$ for which $\displaystyle\lim_{N - M \to \infty} \frac{1}{N-M} \sum_{n=M}^{N-1} |α(n) - ψ(n)| \leq ε$ and $\displaystyle\lim_{N \to \infty} \frac{1}{π(N)} \sum_{p \in {\mathbb P}\cap[1,N]} |α(p) - ψ(p)| \leq ε.$ This result simultaneously generalizes previous results of Frantzikinakis [2] and the authors [11,13]. △ Less

Submitted 13 May, 2020; v1 submitted 24 April, 2020; originally announced April 2020.

Comments: 7 pages

MSC Class: (Primary)37A44; 37A15 (Secondary): 11B30

Journal ref: Proceedings of the AMS, Volume 149, (2021), Number 1, pp. 209-216

SuPer Deep: A Surgical Perception Framework for Robotic Tissue Manipulation using Deep Learning for Feature Extraction

Authors: **gpei Lu, Ambareesh Jayakumari, Florian Richter, Yang Li, Michael C. Yip

Abstract: Robotic automation in surgery requires precise tracking of surgical tools and map** of deformable tissue. Previous works on surgical perception frameworks require significant effort in develo** features for surgical tool and tissue tracking. In this work, we overcome the challenge by exploiting deep learning methods for surgical perception. We integrated deep neural networks, capable of effici… ▽ More Robotic automation in surgery requires precise tracking of surgical tools and map** of deformable tissue. Previous works on surgical perception frameworks require significant effort in develo** features for surgical tool and tissue tracking. In this work, we overcome the challenge by exploiting deep learning methods for surgical perception. We integrated deep neural networks, capable of efficient feature extraction, into the tissue reconstruction and instrument pose estimation processes. By leveraging transfer learning, the deep learning based approach requires minimal training data and reduced feature engineering efforts to fully perceive a surgical scene. The framework was tested on three publicly available datasets, which use the da Vinci Surgical System, for comprehensive analysis. Experimental results show that our framework achieves state-of-the-art tracking performance in a surgical environment by utilizing deep learning for feature extraction. △ Less

Submitted 25 March, 2021; v1 submitted 6 March, 2020; originally announced March 2020.

Comments: 7 pages, 7 figures, ICRA 2021 camera-ready version

Dynamical generalizations of the Prime Number Theorem and disjointness of additive and multiplicative semigroup actions

Authors: Vitaly Bergelson, Florian K. Richter

Abstract: We establish two ergodic theorems which have among their corollaries numerous classical results from multiplicative number theory, including the Prime Number Theorem, a theorem of Pillai-Selberg, a theorem of Erdős-Delange, the mean value theorem of Wirsing, and special cases of the mean value theorem of Halász. By building on the ideas behind our ergodic results, we recast Sarnak's Möbius disjoin… ▽ More We establish two ergodic theorems which have among their corollaries numerous classical results from multiplicative number theory, including the Prime Number Theorem, a theorem of Pillai-Selberg, a theorem of Erdős-Delange, the mean value theorem of Wirsing, and special cases of the mean value theorem of Halász. By building on the ideas behind our ergodic results, we recast Sarnak's Möbius disjointness conjecture in a new dynamical framework. This naturally leads to an extension of Sarnak's conjecture which focuses on the disjointness of additive and multiplicative semigroup actions. We substantiate this extension by providing proofs of several special cases. △ Less

Submitted 17 December, 2023; v1 submitted 9 February, 2020; originally announced February 2020.

Comments: 56 pages, implemented changes following the referees comments

MSC Class: 37A45; 11N99; 11J71

Journal ref: Duke Math. J., Vol. 171, No. 15, October 2022, pp. 3133-3200

A new elementary proof of the Prime Number Theorem

Authors: Florian K. Richter

Abstract: Let $Ω(n)$ denote the number of prime factors of $n$. We show that for any bounded $f\colon\mathbb{N}\to\mathbb{C}$ one has \[ \frac{1}{N}\sum_{n=1}^N\, f(Ω(n)+1)=\frac{1}{N}\sum_{n=1}^N\, f(Ω(n))+\mathrm{o}_{N\to\infty}(1). \] This yields a new elementary proof of the Prime Number Theorem. Let $Ω(n)$ denote the number of prime factors of $n$. We show that for any bounded $f\colon\mathbb{N}\to\mathbb{C}$ one has \[ \frac{1}{N}\sum_{n=1}^N\, f(Ω(n)+1)=\frac{1}{N}\sum_{n=1}^N\, f(Ω(n))+\mathrm{o}_{N\to\infty}(1). \] This yields a new elementary proof of the Prime Number Theorem. △ Less

Submitted 3 August, 2021; v1 submitted 8 February, 2020; originally announced February 2020.

Comments: 13 pages; to appear in Bulletin of the London Mathematical Society; corrected a small mistake in the proof of Proposition 2.2, see footnote 2 at the bottom of page 10

MSC Class: 11N05; 11A41

Journal ref: Bulletin of the London Mathematical Society, Volume 53 (2021), Issue 5, pp. 1365-1375

A decomposition of multicorrelation sequences for commuting transformations along primes

Authors: Anh N. Le, Joel Moreira, Florian K. Richter

Abstract: We study multicorrelation sequences arising from systems with commuting transformations. Our main result is a refinement of a decomposition result of Frantzikinakis and it states that any multicorrelation sequences for commuting transformations can be decomposed, for every $ε>0$, as the sum of a nilsequence $φ(n)$ and a sequence $ω(n)$ satisfying… ▽ More We study multicorrelation sequences arising from systems with commuting transformations. Our main result is a refinement of a decomposition result of Frantzikinakis and it states that any multicorrelation sequences for commuting transformations can be decomposed, for every $ε>0$, as the sum of a nilsequence $φ(n)$ and a sequence $ω(n)$ satisfying $\lim_{N\to\infty}\frac{1}{N}\sum_{n=1}^N |ω(n)|<ε$ and $\lim_{N\to\infty}\frac{1}{|\mathbb{P}\cap [N]|}\sum_{p\in \mathbb{P}\cap [N]} |ω(p)|<ε$. △ Less

Submitted 7 June, 2021; v1 submitted 30 January, 2020; originally announced January 2020.

Comments: 27 pages

Journal ref: Discrete Analysis, 2021:4

ARCSnake: An Archimedes' Screw-Propelled, Reconfigurable Robot Snake for Complex Environments

Authors: Dimitri A. Schreiber, Florian Richter, Andrew Bilan, Peter V. Gavrilov, Hoi Lam Man, Casey H. Price, Kalind C. Carpenter, Michael C. Yip

Abstract: This paper presents the design and performance of a screw-propelled redundant serpentine robot. This robot comprises serially linked, identical modules, each incorporating an Archimedes' screw for propulsion and a universal joint (U-Joint) for orientation control. When serially chained, these modules form a versatile snake robot platform which enables the robot to reshape its body configuration fo… ▽ More This paper presents the design and performance of a screw-propelled redundant serpentine robot. This robot comprises serially linked, identical modules, each incorporating an Archimedes' screw for propulsion and a universal joint (U-Joint) for orientation control. When serially chained, these modules form a versatile snake robot platform which enables the robot to reshape its body configuration for varying environments and gait patterns that would be typical of snake movement. Furthermore, the Archimedes' screws allow for novel omni-wheel drive-like motions by speed controlling their screw threads. This paper considers the mechanical and electrical design, as well as the software architecture for realizing a fully integrated system. The system includes 3$N$ actuators for $N$ segments, each controlled using a BeagleBone Black with a customized power-electronics cape, a 9 Degrees of Freedom (DoF) Inertial Measurement Unit (IMU), and a scalable communication channel over ROS. The intended application for this robot is its use as an instrumentation mobility platform on terrestrial planets where the terrain may involve vents, caves, ice, and rocky surfaces. Additional experiments are shown on our website. △ Less

Submitted 3 June, 2020; v1 submitted 25 September, 2019; originally announced September 2019.

Comments: 6 pages, 8 figures, presented at ICRA 2020