Showing 1–39 of 39 results for author: Hamann, H

Purely vision-based collective movement of robots

Authors: David Mezey, Renaud Bastien, Yating Zheng, Neal McKee, David Stoll, Heiko Hamann, Pawel Romanczuk

Abstract: Collective movement inspired by animal groups promises inherited benefits for robot swarms, such as enhanced sensing and efficiency. However, while animals move in groups using only their local senses, robots often obey central control or use direct communication, introducing systemic weaknesses to the swarm. In the hope of addressing such vulnerabilities, develo** bio-inspired decentralized swa… ▽ More Collective movement inspired by animal groups promises inherited benefits for robot swarms, such as enhanced sensing and efficiency. However, while animals move in groups using only their local senses, robots often obey central control or use direct communication, introducing systemic weaknesses to the swarm. In the hope of addressing such vulnerabilities, develo** bio-inspired decentralized swarms has been a major focus in recent decades. Yet, creating robots that move efficiently together using only local sensory information remains an extraordinary challenge. In this work, we present a decentralized, purely vision-based swarm of terrestrial robots. Within this novel framework robots achieve collisionless, polarized motion exclusively through minimal visual interactions, computing everything on board based on their individual camera streams, making central processing or direct communication obsolete. With agent-based simulations, we further show that using this model, even with a strictly limited field of view and within confined spaces, ordered group motion can emerge, while also highlighting key limitations. Our results offer a multitude of practical applications from hybrid societies coordinating collective movement without any common communication protocol, to advanced, decentralized vision-based robot swarms capable of diverse tasks in ever-changing environments. △ Less

Submitted 24 June, 2024; originally announced June 2024.

AIM: Attributing, Interpreting, Mitigating Data Unfairness

Authors: Zhining Liu, Ruizhong Qiu, Zhichen Zeng, Yada Zhu, Hendrik Hamann, Hanghang Tong

Abstract: Data collected in the real world often encapsulates historical discrimination against disadvantaged groups and individuals. Existing fair machine learning (FairML) research has predominantly focused on mitigating discriminative bias in the model prediction, with far less effort dedicated towards exploring how to trace biases present in the data, despite its importance for the transparency and inte… ▽ More Data collected in the real world often encapsulates historical discrimination against disadvantaged groups and individuals. Existing fair machine learning (FairML) research has predominantly focused on mitigating discriminative bias in the model prediction, with far less effort dedicated towards exploring how to trace biases present in the data, despite its importance for the transparency and interpretability of FairML. To fill this gap, we investigate a novel research problem: discovering samples that reflect biases/prejudices from the training data. Grounding on the existing fairness notions, we lay out a sample bias criterion and propose practical algorithms for measuring and countering sample bias. The derived bias score provides intuitive sample-level attribution and explanation of historical bias in data. On this basis, we further design two FairML strategies via sample-bias-informed minimal data editing. They can mitigate both group and individual unfairness at the cost of minimal or zero predictive utility loss. Extensive experiments and analyses on multiple real-world datasets demonstrate the effectiveness of our methods in explaining and mitigating unfairness. Code is available at https://github.com/ZhiningLiu1998/AIM. △ Less

Submitted 18 June, 2024; v1 submitted 13 June, 2024; originally announced June 2024.

Comments: 12 pages, 6 figures, accepted by ACM SIGKDD 2024. Webpage: https://github.com/ZhiningLiu1998/AIM

Messengers: Breaking Echo Chambers in Collective Opinion Dynamics with Homophily

Authors: Mohsen Raoufi, Heiko Hamann, Pawel Romanczuk

Abstract: Collective estimation manifests computational intelligence emerging from inter-individual local interactions, e.g., by aggregating opinions from neighbors to estimate a quantity. Use cases of collective estimation may include directed motion in physical space, such that agents, for example, have to collectively explore a distributed feature, and collectively agree on a numerical value. In doing so… ▽ More Collective estimation manifests computational intelligence emerging from inter-individual local interactions, e.g., by aggregating opinions from neighbors to estimate a quantity. Use cases of collective estimation may include directed motion in physical space, such that agents, for example, have to collectively explore a distributed feature, and collectively agree on a numerical value. In doing so, collectives face several challenges in achieving precise estimations. These challenges exhibit complex behaviors, particularly when the interaction network and opinion of agents evolve simultaneously. We take homophilic networks as an example, where disproportionate interaction with like-minded neighbors leads to the emergence of echo chambers, preventing collective consensus. Our simulation results confirm that, besides a lack of exposure to attitude-challenging opinions, seeking reaffirming information entraps agents in echo chambers. We propose a generic novel approach based on a Dichotomous Markov Process (DMP) where stubborn agents (called Messengers) connect the disconnected clusters by physically transporting their opinions to other clusters to inform and direct the other agents. We show that diverse collective behaviors arise from the DMP and study a continuum between task specialization with no switching (full-time Messengers), generalization with slow task switching (part-time Messengers), and rapid task switching (short-time Messengers) and its impact on system performance. Our results show that stubborn agents can, in various ways, break the echo chambers and promote consensus in collective opinion. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Comments: This paper has not yet been peer-reviewed

Climatic & Anthropogenic Hazards to the Nasca World Heritage: Application of Remote Sensing, AI, and Flood Modelling

Authors: Masato Sakai, Marcus Freitag, Akihisa Sakurai, Conrad M Albrecht, Hendrik F Hamann

Abstract: Preservation of the Nasca geoglyphs at the UNESCO World Heritage Site in Peru is urgent as natural and human impact accelerates. More frequent weather extremes such as flashfloods threaten Nasca artifacts. We demonstrate that runoff models based on (sub-)meter scale, LiDAR-derived digital elevation data can highlight AI-detected geoglyphs that are in danger of erosion. We recommend measures of mit… ▽ More Preservation of the Nasca geoglyphs at the UNESCO World Heritage Site in Peru is urgent as natural and human impact accelerates. More frequent weather extremes such as flashfloods threaten Nasca artifacts. We demonstrate that runoff models based on (sub-)meter scale, LiDAR-derived digital elevation data can highlight AI-detected geoglyphs that are in danger of erosion. We recommend measures of mitigation to protect the famous "lizard", "tree", and "hand" geoglyphs located close by, or even cut by the Pan-American Highway. △ Less

Submitted 20 May, 2024; originally announced May 2024.

Comments: accepted at IGARSS 2024

Self-Organized Construction by Minimal Surprise

Authors: Tanja Katharina Kaiser, Heiko Hamann

Abstract: For the robots to achieve a desired behavior, we can program them directly, train them, or give them an innate driver that makes the robots themselves desire the targeted behavior. With the minimal surprise approach, we implant in our robots the desire to make their world predictable. Here, we apply minimal surprise to collective construction. Simulated robots push blocks in a 2D torus grid world.… ▽ More For the robots to achieve a desired behavior, we can program them directly, train them, or give them an innate driver that makes the robots themselves desire the targeted behavior. With the minimal surprise approach, we implant in our robots the desire to make their world predictable. Here, we apply minimal surprise to collective construction. Simulated robots push blocks in a 2D torus grid world. In two variants of our experiment we either allow for emergent behaviors or predefine the expected environment of the robots. In either way, we evolve robot behaviors that move blocks to structure their environment and make it more predictable. The resulting controllers can be applied in collective construction by robots. △ Less

Submitted 5 May, 2024; originally announced May 2024.

Comments: Published in 2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W)

Innate Motivation for Robot Swarms by Minimizing Surprise: From Simple Simulations to Real-World Experiments

Authors: Tanja Katharina Kaiser, Heiko Hamann

Abstract: Applications of large-scale mobile multi-robot systems can be beneficial over monolithic robots because of higher potential for robustness and scalability. Develo** controllers for multi-robot systems is challenging because the multitude of interactions is hard to anticipate and difficult to model. Automatic design using machine learning or evolutionary robotics seem to be options to avoid that… ▽ More Applications of large-scale mobile multi-robot systems can be beneficial over monolithic robots because of higher potential for robustness and scalability. Develo** controllers for multi-robot systems is challenging because the multitude of interactions is hard to anticipate and difficult to model. Automatic design using machine learning or evolutionary robotics seem to be options to avoid that challenge, but bring the challenge of designing reward or fitness functions. Generic reward and fitness functions seem unlikely to exist and task-specific rewards often have undesired side effects. Approaches of so-called innate motivation try to avoid the specific formulation of rewards and work instead with different drivers, such as curiosity. Our approach to innate motivation is to minimize surprise, which we implement by maximizing the accuracy of the swarm robot's sensor predictions using neuroevolution. A unique advantage of the swarm robot case is that swarm members populate the robot's environment and can trigger more active behaviors in a self-referential loop. We summarize our previous simulation-based results concerning behavioral diversity, robustness, scalability, and engineered self-organization, and put them into context. In several new studies, we analyze the influence of the optimizer's hyperparameters, the scalability of evolved behaviors, and the impact of realistic robot simulations. Finally, we present results using real robots that show how the reality gap can be bridged. △ Less

Submitted 4 May, 2024; originally announced May 2024.

Comments: Published in IEEE Transactions on Robotics

ROS2swarm - A ROS 2 Package for Swarm Robot Behaviors

Authors: Tanja Katharina Kaiser, Marian Johannes Begemann, Tavia Plattenteich, Lars Schilling, Georg Schildbach, Heiko Hamann

Abstract: Develo** reusable software for mobile robots is still challenging. Even more so for swarm robots, despite the desired simplicity of the robot controllers. Prototy** and experimenting are difficult due to the multi-robot setting and often require robot-robot communication. Also, the diversity of swarm robot hardware platforms increases the need for hardware-independent software concepts. The ma… ▽ More Develo** reusable software for mobile robots is still challenging. Even more so for swarm robots, despite the desired simplicity of the robot controllers. Prototy** and experimenting are difficult due to the multi-robot setting and often require robot-robot communication. Also, the diversity of swarm robot hardware platforms increases the need for hardware-independent software concepts. The main advantages of the commonly used robot software architecture ROS 2 are modularity and platform independence. We propose a new ROS 2 package, ROS2swarm, for applications of swarm robotics that provides a library of ready-to-use swarm behavioral primitives. We show the successful application of our approach on three different platforms, the TurtleBot3 Burger, the TurtleBot3 Waffle Pi, and the Jackal UGV, and with a set of different behavioral primitives, such as aggregation, dispersion, and collective decision-making. The proposed approach is easy to maintain, extendable, and has good potential for simplifying swarm robotics experiments in future applications. △ Less

Submitted 3 May, 2024; originally announced May 2024.

Comments: published in 2022 International Conference on Robotics and Automation (ICRA)

On the Road to Clarity: Exploring Explainable AI for World Models in a Driver Assistance System

Authors: Mohamed Roshdi, Julian Petzold, Mostafa Wahby, Hussein Ebrahim, Mladen Berekovic, Heiko Hamann

Abstract: In Autonomous Driving (AD) transparency and safety are paramount, as mistakes are costly. However, neural networks used in AD systems are generally considered black boxes. As a countermeasure, we have methods of explainable AI (XAI), such as feature relevance estimation and dimensionality reduction. Coarse graining techniques can also help reduce dimensionality and find interpretable global patter… ▽ More In Autonomous Driving (AD) transparency and safety are paramount, as mistakes are costly. However, neural networks used in AD systems are generally considered black boxes. As a countermeasure, we have methods of explainable AI (XAI), such as feature relevance estimation and dimensionality reduction. Coarse graining techniques can also help reduce dimensionality and find interpretable global patterns. A specific coarse graining method is Renormalization Groups from statistical physics. It has previously been applied to Restricted Boltzmann Machines (RBMs) to interpret unsupervised learning. We refine this technique by building a transparent backbone model for convolutional variational autoencoders (VAE) that allows map** latent values to input features and has performance comparable to trained black box VAEs. Moreover, we propose a custom feature map visualization technique to analyze the internal convolutional layers in the VAE to explain internal causes of poor reconstruction that may lead to dangerous traffic scenarios in AD applications. In a second key contribution, we propose explanation and evaluation techniques for the internal dynamics and feature relevance of prediction networks. We test a long short-term memory (LSTM) network in the computer vision domain to evaluate the predictability and in future applications potentially safety of prediction models. We showcase our methods by analyzing a VAE-LSTM world model that predicts pedestrian perception in an urban traffic situation. △ Less

Submitted 26 April, 2024; originally announced April 2024.

Comments: 8 pages, 6 figures, to be published in IEEE CAI 2024

Automatic Classification of Subjective Time Perception Using Multi-modal Physiological Data of Air Traffic Controllers

Authors: Till Aust, Eirini Balta, Argiro Vatakis, Heiko Hamann

Abstract: One indicator of well-being can be the person's subjective time perception. In our project ChronoPilot, we aim to develop a device that modulates human subjective time perception. In this study, we present a method to automatically assess the subjective time perception of air traffic controllers, a group often faced with demanding conditions, using their physiological data and eleven state-of-the-… ▽ More One indicator of well-being can be the person's subjective time perception. In our project ChronoPilot, we aim to develop a device that modulates human subjective time perception. In this study, we present a method to automatically assess the subjective time perception of air traffic controllers, a group often faced with demanding conditions, using their physiological data and eleven state-of-the-art machine learning classifiers. The physiological data consist of photoplethysmogram, electrodermal activity, and temperature data. We find that the support vector classifier works best with an accuracy of 79 % and electrodermal activity provides the most descriptive biomarker. These findings are an important step towards closing the feedback loop of our ChronoPilot-device to automatically modulate the user's subjective time perception. This technological advancement may promise improvements in task management, stress reduction, and overall productivity in high-stakes professions. △ Less

Submitted 28 March, 2024; originally announced April 2024.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

From One to Many: How Active Robot Swarm Sizes Influence Human Cognitive Processes

Authors: Julian Kaduk, Müge Cavdan, Knut Drewing, Heiko Hamann

Abstract: In robotics, understanding human interaction with autonomous systems is crucial for enhancing collaborative technologies. We focus on human-swarm interaction (HSI), exploring how differently sized groups of active robots affect operators' cognitive and perceptual reactions over different durations. We analyze the impact of different numbers of active robots within a 15-robot swarm on operators' ti… ▽ More In robotics, understanding human interaction with autonomous systems is crucial for enhancing collaborative technologies. We focus on human-swarm interaction (HSI), exploring how differently sized groups of active robots affect operators' cognitive and perceptual reactions over different durations. We analyze the impact of different numbers of active robots within a 15-robot swarm on operators' time perception, emotional state, flow experience, and task difficulty perception. Our findings indicate that managing multiple active robots when compared to one active robot significantly alters time perception and flow experience, leading to a faster passage of time and increased flow. More active robots and extended durations cause increased emotional arousal and perceived task difficulty, highlighting the interaction between robot the number of active robots and human cognitive processes. These insights inform the creation of intuitive human-swarm interfaces and aid in develo** swarm robotic systems aligned with human cognitive structures, enhancing human-robot collaboration. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Emotional Tandem Robots: How Different Robot Behaviors Affect Human Perception While Controlling a Mobile Robot

Authors: Julian Kaduk, Friederike Weilbeer, Heiko Hamann

Abstract: In human-robot interaction (HRI), we study how humans interact with robots, but also the effects of robot behavior on human perception and well-being. Especially, the influence on humans by tandem robots with one human controlled and one autonomous robot or even semi-autonomous multi-robot systems is not yet fully understood. Here, we focus on a leader-follower scenario and study how emotionally e… ▽ More In human-robot interaction (HRI), we study how humans interact with robots, but also the effects of robot behavior on human perception and well-being. Especially, the influence on humans by tandem robots with one human controlled and one autonomous robot or even semi-autonomous multi-robot systems is not yet fully understood. Here, we focus on a leader-follower scenario and study how emotionally expressive motion patterns of a small, mobile follower robot affect the perception of a human operator controlling the leading robot. We examined three distinct emotional behaviors for the follower compared to a neutral condition: angry, happy and sad. We analyzed how participants maneuvered the leader robot along a set path while experiencing each follower behavior in a randomized order. We identified a significant shift in attention toward the follower with emotionally expressive behaviors compared to the neutral condition. For example, the angry behavior significantly heightened participant stress levels and was considered the least preferred behavior. The happy behavior was the most preferred and associated with increased excitement by the participants. Integrating the proposed behaviors in robots can profoundly influence the human operator's attention, emotional state, and overall experience. These insights are valuable for future HRI tandem robot designs. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Leveraging Uncertainty in Collective Opinion Dynamics with Heterogeneity

Authors: Vito Mengers, Mohsen Raoufi, Oliver Brock, Heiko Hamann, Pawel Romanczuk

Abstract: Natural and artificial collectives exhibit heterogeneities across different dimensions, contributing to the complexity of their behavior. We investigate the effect of two such heterogeneities on collective opinion dynamics: heterogeneity of the quality of agents' prior information and of centrality in the network, i.e., the number of immediate neighbors. To study these heterogeneities, we not only… ▽ More Natural and artificial collectives exhibit heterogeneities across different dimensions, contributing to the complexity of their behavior. We investigate the effect of two such heterogeneities on collective opinion dynamics: heterogeneity of the quality of agents' prior information and of centrality in the network, i.e., the number of immediate neighbors. To study these heterogeneities, we not only consider them in our model, proposing a novel network generator with heterogeneous centrality, but also introduce uncertainty as an additional dimension. By quantifying the uncertainty of each agent, we provide a mechanism for agents to adaptively weigh their individual against social information. As uncertainties develop according to the interactions between agents, they capture information on heterogeneities. Therefore, uncertainty is a relevant additional observable in the study of complex collective opinion dynamics that we use to show the bidirectional relationship of heterogeneous centrality and information. Furthermore, we demonstrate that uncertainty-driven adaptive weighting leads to increased accuracy and speed of consensus, especially under heterogeneity, and provide guidelines for avoiding performance-decreasing errors in uncertainty modeling. These opportunities for improved performance and observability suggest the importance of uncertainty both for the study of natural and the design of artificial heterogeneous systems. △ Less

Submitted 26 January, 2024; originally announced February 2024.

Comments: 15 pages, 7 figures

Evolution of Collective Decision-Making Mechanisms for Collective Perception

Authors: Tanja Katharina Kaiser, Tristan Potten, Heiko Hamann

Abstract: Autonomous robot swarms must be able to make fast and accurate collective decisions, but speed and accuracy are known to be conflicting goals. While collective decision-making is widely studied in swarm robotics research, only few works on using methods of evolutionary computation to generate collective decision-making mechanisms exist. These works use task-specific fitness functions rewarding the… ▽ More Autonomous robot swarms must be able to make fast and accurate collective decisions, but speed and accuracy are known to be conflicting goals. While collective decision-making is widely studied in swarm robotics research, only few works on using methods of evolutionary computation to generate collective decision-making mechanisms exist. These works use task-specific fitness functions rewarding the accomplishment of the respective collective decision-making task. But task-independent rewards, such as for prediction error minimization, may promote the emergence of diverse and innovative solutions. We evolve collective decision-making mechanisms using a task-specific fitness function rewarding correct robot opinions, a task-independent reward for prediction accuracy, and a hybrid fitness function combining the two previous. In our simulations, we use the collective perception scenario, that is, robots must collectively determine which of two environmental features is more frequent. We show that evolution successfully optimizes fitness in all three scenarios, but that only the task-specific fitness function and the hybrid fitness function lead to the emergence of collective decision-making behaviors. In benchmark experiments, we show the competitiveness of the evolved decision-making mechanisms to the voter model and the majority rule and analyze the scalability of the decision-making mechanisms with problem difficulty. △ Less

Submitted 6 November, 2023; originally announced November 2023.

Comments: 2023 IEEE Congress on Evolutionary Computation (CEC), Chicago, IL, USA

Do We Run Large-scale Multi-Robot Systems on the Edge? More Evidence for Two-Phase Performance in System Size Scaling

Authors: Jonas Kuckling, Robin Luckey, Viktor Avrutin, Andrew Vardy, Andreagiovanni Reina, Heiko Hamann

Abstract: With increasing numbers of mobile robots arriving in real-world applications, more robots coexist in the same space, interact, and possibly collaborate. Methods to provide such systems with system size scalability are known, for example, from swarm robotics. Example strategies are self-organizing behavior, a strict decentralized approach, and limiting the robot-robot communication. Despite applyin… ▽ More With increasing numbers of mobile robots arriving in real-world applications, more robots coexist in the same space, interact, and possibly collaborate. Methods to provide such systems with system size scalability are known, for example, from swarm robotics. Example strategies are self-organizing behavior, a strict decentralized approach, and limiting the robot-robot communication. Despite applying such strategies, any multi-robot system breaks above a certain critical system size (i.e., number of robots) as too many robots share a resource (e.g., space, communication channel). We provide additional evidence based on simulations, that at these critical system sizes, the system performance separates into two phases: nearly optimal and minimal performance. We speculate that in real-world applications that are configured for optimal system size, the supposedly high-performing system may actually live on borrowed time as it is on a transient to breakdown. We provide two modeling options (based on queueing theory and a population model) that may help to support this reasoning. △ Less

Submitted 14 May, 2024; v1 submitted 18 October, 2023; originally announced October 2023.

Comments: Submitted to the 2024 IEEE International Conference on Robotics and Automation (ICRA 2024)

AI Foundation Models for Weather and Climate: Applications, Design, and Implementation

Authors: S. Karthik Mukkavilli, Daniel Salles Civitarese, Johannes Schmude, Johannes Jakubik, Anne Jones, Nam Nguyen, Christopher Phillips, Sujit Roy, Shraddha Singh, Campbell Watson, Raghu Ganti, Hendrik Hamann, Udaysankar Nair, Rahul Ramachandran, Kommy Weldemariam

Abstract: Machine learning and deep learning methods have been widely explored in understanding the chaotic behavior of the atmosphere and furthering weather forecasting. There has been increasing interest from technology companies, government institutions, and meteorological agencies in building digital twins of the Earth. Recent approaches using transformers, physics-informed machine learning, and graph n… ▽ More Machine learning and deep learning methods have been widely explored in understanding the chaotic behavior of the atmosphere and furthering weather forecasting. There has been increasing interest from technology companies, government institutions, and meteorological agencies in building digital twins of the Earth. Recent approaches using transformers, physics-informed machine learning, and graph neural networks have demonstrated state-of-the-art performance on relatively narrow spatiotemporal scales and specific tasks. With the recent success of generative artificial intelligence (AI) using pre-trained transformers for language modeling and vision with prompt engineering and fine-tuning, we are now moving towards generalizable AI. In particular, we are witnessing the rise of AI foundation models that can perform competitively on multiple domain-specific downstream tasks. Despite this progress, we are still in the nascent stages of a generalizable AI model for global Earth system models, regional climate models, and mesoscale weather models. Here, we review current state-of-the-art AI approaches, primarily from transformer and operator learning literature in the context of meteorology. We provide our perspective on criteria for success towards a family of foundation models for nowcasting and forecasting weather and climate predictions. We also discuss how such models can perform competitively on downstream tasks such as downscaling (super-resolution), identifying conditions conducive to the occurrence of wildfires, and predicting consequential meteorological phenomena across various spatiotemporal scales such as hurricanes and atmospheric rivers. In particular, we examine current AI methodologies and contend they have matured enough to design and implement a weather foundation model. △ Less

Submitted 19 September, 2023; v1 submitted 19 September, 2023; originally announced September 2023.

Comments: 44 pages, 1 figure, updated Fig. 1

MSC Class: 68T07 (Primary); 68T01; 86A08 ACM Class: I.2.0; I.4.0; J.2.5

TensorBank: Tensor Lakehouse for Foundation Model Training

Authors: Romeo Kienzler, Leonardo Pondian Tizzei, Benedikt Blumenstiel, Zoltan Arnold Nagy, S. Karthik Mukkavilli, Johannes Schmude, Marcus Freitag, Michael Behrendt, Daniel Salles Civitarese, Naomi Simumba, Daiki Kimura, Hendrik Hamann

Abstract: Storing and streaming high dimensional data for foundation model training became a critical requirement with the rise of foundation models beyond natural language. In this paper we introduce TensorBank, a petabyte scale tensor lakehouse capable of streaming tensors from Cloud Object Store (COS) to GPU memory at wire speed based on complex relational queries. We use Hierarchical Statistical Indices… ▽ More Storing and streaming high dimensional data for foundation model training became a critical requirement with the rise of foundation models beyond natural language. In this paper we introduce TensorBank, a petabyte scale tensor lakehouse capable of streaming tensors from Cloud Object Store (COS) to GPU memory at wire speed based on complex relational queries. We use Hierarchical Statistical Indices (HSI) for query acceleration. Our architecture allows to directly address tensors on block level using HTTP range reads. Once in GPU memory, data can be transformed using PyTorch transforms. We provide a generic PyTorch dataset type with a corresponding dataset factory translating relational queries and requested transformations as an instance. By making use of the HSI, irrelevant blocks can be skipped without reading them as those indices contain statistics on their content at different hierarchical resolution levels. This is an opinionated architecture powered by open standards and making heavy use of open-source technology. Although, hardened for production use using geospatial-temporal data, this architecture generalizes to other use case like computer vision, computational neuroscience, biological sequence analysis and more. △ Less

Submitted 21 March, 2024; v1 submitted 5 September, 2023; originally announced September 2023.

Congestion and Scalability in Robot Swarms: a Study on Collective Decision Making

Authors: Karthik Soma, Vivek Shankar Vardharajan, Heiko Hamann, Giovanni Beltrame

Abstract: One of the most important promises of decentralized systems is scalability, which is often assumed to be present in robot swarm systems without being contested. Simple limitations, such as movement congestion and communication conflicts, can drastically affect scalability. In this work, we study the effects of congestion in a binary collective decision-making task. We evaluate the impact of two ty… ▽ More One of the most important promises of decentralized systems is scalability, which is often assumed to be present in robot swarm systems without being contested. Simple limitations, such as movement congestion and communication conflicts, can drastically affect scalability. In this work, we study the effects of congestion in a binary collective decision-making task. We evaluate the impact of two types of congestion (communication and movement) when using three different techniques for the task: Honey Bee inspired, Stigmergy based, and Division of Labor. We deploy up to 150 robots in a physics-based simulator performing a sampling mission in an arena with variable levels of robot density, applying the three techniques. Our results suggest that applying Division of Labor coupled with versioned local communication helps to scale the system by minimizing congestion. △ Less

Submitted 17 July, 2023; originally announced July 2023.

Individuality in Swarm Robots with the Case Study of Kilobots: Noise, Bug, or Feature?

Authors: Mohsen Raoufi, Pawel Romanczuk, Heiko Hamann

Abstract: Inter-individual differences are studied in natural systems, such as fish, bees, and humans, as they contribute to the complexity of both individual and collective behaviors. However, individuality in artificial systems, such as robotic swarms, is undervalued or even overlooked. Agent-specific deviations from the norm in swarm robotics are usually understood as mere noise that can be minimized, fo… ▽ More Inter-individual differences are studied in natural systems, such as fish, bees, and humans, as they contribute to the complexity of both individual and collective behaviors. However, individuality in artificial systems, such as robotic swarms, is undervalued or even overlooked. Agent-specific deviations from the norm in swarm robotics are usually understood as mere noise that can be minimized, for example, by calibration. We observe that robots have consistent deviations and argue that awareness and knowledge of these can be exploited to serve a task. We measure heterogeneity in robot swarms caused by individual differences in how robots act, sense, and oscillate. Our use case is Kilobots and we provide example behaviors where the performance of robots varies depending on individual differences. We show a non-intuitive example of phototaxis with Kilobots where the non-calibrated Kilobots show better performance than the calibrated supposedly ``ideal" one. We measure the inter-individual variations for heterogeneity in sensing and oscillation, too. We briefly discuss how these variations can enhance the complexity of collective behaviors. We suggest that by recognizing and exploring this new perspective on individuality, and hence diversity, in robotic swarms, we can gain a deeper understanding of these systems and potentially unlock new possibilities for their design and implementation of applications. △ Less

Submitted 25 May, 2023; originally announced May 2023.

Comments: Accepted at the 2023 Conference on Artificial Life (ALife). To see the 9 Figures in large check this repo: https://github.com/mohsen-raoufi/Kilobots-Individuality-ALife-23/tree/main/Figures

Journal ref: ALIFE 2023: Ghost in the Machine: Proceedings of the 2023 Artificial Life Conference

Estimation of continuous environments by robot swarms: Correlated networks and decision-making

Authors: Mohsen Raoufi, Pawel Romanczuk, Heiko Hamann

Abstract: Collective decision-making is an essential capability of large-scale multi-robot systems to establish autonomy on the swarm level. A large portion of literature on collective decision-making in swarm robotics focuses on discrete decisions selecting from a limited number of options. Here we assign a decentralized robot system with the task of exploring an unbounded environment, finding consensus on… ▽ More Collective decision-making is an essential capability of large-scale multi-robot systems to establish autonomy on the swarm level. A large portion of literature on collective decision-making in swarm robotics focuses on discrete decisions selecting from a limited number of options. Here we assign a decentralized robot system with the task of exploring an unbounded environment, finding consensus on the mean of a measurable environmental feature, and aggregating at areas where that value is measured (e.g., a contour line). A unique quality of this task is a causal loop between the robots' dynamic network topology and their decision-making. For example, the network's mean node degree influences time to convergence while the currently agreed-on mean value influences the swarm's aggregation location, hence, also the network structure as well as the precision error. We propose a control algorithm and study it in real-world robot swarm experiments in different environments. We show that our approach is effective and achieves higher precision than a control experiment. We anticipate applications, for example, in containing pollution with surface vehicles. △ Less

Submitted 15 March, 2023; v1 submitted 27 February, 2023; originally announced February 2023.

Comments: \c{opyright} Accepted at IEEE/International Conference on Robotics and Automation (ICRA) 2023, 7 pages, 7 figures

Journal ref: 2023 IEEE International Conference on Robotics and Automation (ICRA)

"If you could see me through my eyes": Predicting Pedestrian Perception

Authors: Julian Petzold, Mostafa Wahby, Franek Stark, Ulrich Behrje, Heiko Hamann

Abstract: Pedestrians are particularly vulnerable road users in urban traffic. With the arrival of autonomous driving, novel technologies can be developed specifically to protect pedestrians. We propose a machine learning toolchain to train artificial neural networks as models of pedestrian behavior. In a preliminary study, we use synthetic data from simulations of a specific pedestrian crossing scenario to… ▽ More Pedestrians are particularly vulnerable road users in urban traffic. With the arrival of autonomous driving, novel technologies can be developed specifically to protect pedestrians. We propose a machine learning toolchain to train artificial neural networks as models of pedestrian behavior. In a preliminary study, we use synthetic data from simulations of a specific pedestrian crossing scenario to train a variational autoencoder and a long short-term memory network to predict a pedestrian's future visual perception. We can accurately predict a pedestrian's future perceptions within relevant time horizons. By iteratively feeding these predicted frames into these networks, they can be used as simulations of pedestrians as indicated by our results. Such trained networks can later be used to predict pedestrian behaviors even from the perspective of the autonomous car. Another future extension will be to re-train these networks with real-world video data. △ Less

Submitted 22 March, 2022; v1 submitted 28 February, 2022; originally announced February 2022.

Speed-vs-Accuracy Tradeoff in Collective Estimation: An Adaptive Exploration-Exploitation Case

Authors: Mohsen Raoufi, Heiko Hamann, Pawel Romanczuk

Abstract: The tradeoff between accuracy and speed is considered fundamental to individual and collective decision-making. In this paper, we focus on collective estimation as an example of collective decision-making. The task is to estimate the average scalar intensity of a desired feature in the environment. The solution we propose consists of exploration and exploitation phases, where the switching time is… ▽ More The tradeoff between accuracy and speed is considered fundamental to individual and collective decision-making. In this paper, we focus on collective estimation as an example of collective decision-making. The task is to estimate the average scalar intensity of a desired feature in the environment. The solution we propose consists of exploration and exploitation phases, where the switching time is a factor dictating the balance between the two phases. By decomposing the total accuracy into bias and variance, we explain that diversity and social interactions could promote the accuracy of the collective decision. We also show how the exploration-vs-exploitation tradeoff relates to the speed-vs-accuracy tradeoff. One significant finding of our work is that there is an optimal duration for exploration to compromise between speed and accuracy. This duration cannot be determined offline for an unknown environment. Hence, we propose an adaptive, distributed mechanism enabling individual agents to decide in a decentralized manner when to switch. Moreover, the spatial consequence of the exploitation phase is an emergent collective movement, leading to the aggregation of the collective at the iso-contours of the mean intensity of the environmental field in the spatial domain. Examples of potential applications for such a fully distributed collective estimation model are spillage capturing and source localization. △ Less

Submitted 18 January, 2022; originally announced January 2022.

Journal ref: 2021 International Symposium on Multi-Robot and Multi-Agent Systems (MRS), 2021, pp. 47-55

Automatic Centralized Control of Underactuated Large-scale Multi-robot Systems using a Generalized Coordinate Transformation

Authors: Babak Salamat, Christopher Johannes Starck, Heiko Hamann

Abstract: Controlling large-scale particle or robot systems is challenging because of their high dimensionality. We use a centralized stochastic approach that allows for optimal control at the cost of a central element instead of a decentralized approach. Previous works are often restricted to the assumption of fully actuated robots. Here we propose an approach for underactuated robots that allows for energ… ▽ More Controlling large-scale particle or robot systems is challenging because of their high dimensionality. We use a centralized stochastic approach that allows for optimal control at the cost of a central element instead of a decentralized approach. Previous works are often restricted to the assumption of fully actuated robots. Here we propose an approach for underactuated robots that allows for energy-efficient control of the robot system. We consider a simple task of gathering the robots (minimizing positional variance) and steering them towards a goal point within a bounded area without obstacles. We make two main contributions. First, we present a generalized coordinate transformation for underactuated robots, whose physical properties should be considered. We choose Euler- Lagrange systems that describe a large class of robot systems. Second, we propose an optimal control mechanism with the prime objective of energy efficiency. We show the feasibility of our approach in numerical simulations and robot simulations. △ Less

Submitted 24 August, 2021; v1 submitted 18 August, 2021; originally announced August 2021.

Lifelong Object Detection

Authors: Wang Zhou, Shiyu Chang, Norma Sosa, Hendrik Hamann, David Cox

Abstract: Recent advances in object detection have benefited significantly from rapid developments in deep neural networks. However, neural networks suffer from the well-known issue of catastrophic forgetting, which makes continual or lifelong learning problematic. In this paper, we leverage the fact that new training classes arrive in a sequential manner and incrementally refine the model so that it additi… ▽ More Recent advances in object detection have benefited significantly from rapid developments in deep neural networks. However, neural networks suffer from the well-known issue of catastrophic forgetting, which makes continual or lifelong learning problematic. In this paper, we leverage the fact that new training classes arrive in a sequential manner and incrementally refine the model so that it additionally detects new object classes in the absence of previous training data. Specifically, we consider the representative object detector, Faster R-CNN, for both accurate and efficient prediction. To prevent abrupt performance degradation due to catastrophic forgetting, we propose to apply knowledge distillation on both the region proposal network and the region classification network, to retain the detection of previously trained classes. A pseudo-positive-aware sampling strategy is also introduced for distillation sample selection. We evaluate the proposed method on PASCAL VOC 2007 and MS COCO benchmarks and show competitive mAP and 6x inference speed improvement, which makes the approach more suitable for real-time applications. Our implementation will be publicly available. △ Less

Submitted 2 September, 2020; originally announced September 2020.

Scalability in Computing and Robotics

Authors: Heiko Hamann, Andreagiovanni Reina

Abstract: Efficient engineered systems require scalability. A scalable system has increasing performance with increasing system size. In an ideal case, the increase in performance (e.g., speedup) corresponds to the number of units that are added to the system. However, if multiple units work on the same task, then coordination among these units is required. This coordination can introduce overheads with an… ▽ More Efficient engineered systems require scalability. A scalable system has increasing performance with increasing system size. In an ideal case, the increase in performance (e.g., speedup) corresponds to the number of units that are added to the system. However, if multiple units work on the same task, then coordination among these units is required. This coordination can introduce overheads with an impact on system performance. The coordination costs can lead to sublinear improvement or even diminishing performance with increasing system size. However, there are also systems that implement efficient coordination and exploit collaboration of units to attain superlinear improvement. Modeling the scalability dynamics is key to understanding efficient systems. Known laws of scalability, such as Amdahl's law, Gustafson's law, and Gunther's Universal Scalability Law, are minimalistic phenomenological models that explain a rich variety of system behaviors through concise equations. While useful to gain general insights, the phenomenological nature of these models may limit the understanding of the underlying dynamics, as they are detached from first principles that could explain coordination overheads among units. Through a decentralized system approach, we propose a general model based on generic interactions between units that is able to describe, as specific cases, any general pattern of scalability included by previously reported laws. The proposed general model of scalability is built on first principles, or at least on a microscopic description of interaction between units, and therefore has the potential to contribute to a better understanding of system behavior and scalability. We show that this model can be applied to a diverse set of systems, such as parallel supercomputers, robot swarms, or wireless sensor networks, creating a unified view on interdisciplinary design for scalability. △ Less

Submitted 11 June, 2021; v1 submitted 8 June, 2020; originally announced June 2020.

Comments: 33 pages, 8 figures

Learning and Recognizing Archeological Features from LiDAR Data

Authors: Conrad M Albrecht, Chris Fisher, Marcus Freitag, Hendrik F Hamann, Sharathchandra Pankanti, Florencia Pezzutti, Francesca Rossi

Abstract: We present a remote sensing pipeline that processes LiDAR (Light Detection And Ranging) data through machine & deep learning for the application of archeological feature detection on big geo-spatial data platforms such as e.g. IBM PAIRS Geoscope. Today, archeologists get overwhelmed by the task of visually surveying huge amounts of (raw) LiDAR data in order to identify areas of interest for insp… ▽ More We present a remote sensing pipeline that processes LiDAR (Light Detection And Ranging) data through machine & deep learning for the application of archeological feature detection on big geo-spatial data platforms such as e.g. IBM PAIRS Geoscope. Today, archeologists get overwhelmed by the task of visually surveying huge amounts of (raw) LiDAR data in order to identify areas of interest for inspection on the ground. We showcase a software system pipeline that results in significant savings in terms of expert productivity while missing only a small fraction of the artifacts. Our work employs artificial neural networks in conjunction with an efficient spatial segmentation procedure based on domain knowledge. Data processing is constraint by a limited amount of training labels and noisy LiDAR signals due to vegetation cover and decay of ancient structures. We aim at identifying geo-spatial areas with archeological artifacts in a supervised fashion allowing the domain expert to flexibly tune parameters based on her needs. △ Less

Submitted 5 April, 2020; originally announced April 2020.

Journal ref: 2019 IEEE International Conference on Big Data (Big Data)

Event Clustering & Event Series Characterization on Expected Frequency

Authors: Conrad M Albrecht, Marcus Freitag, Theodore G van Kessel, Siyuan Lu, Hendrik F Hamann

Abstract: We present an efficient clustering algorithm applicable to one-dimensional data such as e.g. a series of timestamps. Given an expected frequency $ΔT^{-1}$, we introduce an $\mathcal{O}(N)$-efficient method of characterizing $N$ events represented by an ordered series of timestamps $t_1,t_2,\dots,t_N$. In practice, the method proves useful to e.g. identify time intervals of "missing" data or to loc… ▽ More We present an efficient clustering algorithm applicable to one-dimensional data such as e.g. a series of timestamps. Given an expected frequency $ΔT^{-1}$, we introduce an $\mathcal{O}(N)$-efficient method of characterizing $N$ events represented by an ordered series of timestamps $t_1,t_2,\dots,t_N$. In practice, the method proves useful to e.g. identify time intervals of "missing" data or to locate "isolated events". Moreover, we define measures to quantify a series of events by varying $ΔT$ to e.g. determine the quality of an Internet of Things service. △ Less

Submitted 5 April, 2020; originally announced April 2020.

Journal ref: 2017 IEEE International Conference on Big Data (Big Data)

Engineered Self-Organization for Resilient Robot Self-Assembly with Minimal Surprise

Authors: Tanja Katharina Kaiser, Heiko Hamann

Abstract: In collective robotic systems, the automatic generation of controllers for complex tasks is still a challenging problem. Open-ended evolution of complex robot behaviors can be a possible solution whereby an intrinsic driver for pattern formation and self-organization may prove to be important. We implement such a driver in collective robot systems by evolving prediction networks as world models in… ▽ More In collective robotic systems, the automatic generation of controllers for complex tasks is still a challenging problem. Open-ended evolution of complex robot behaviors can be a possible solution whereby an intrinsic driver for pattern formation and self-organization may prove to be important. We implement such a driver in collective robot systems by evolving prediction networks as world models in pair with action-selection networks. Fitness is given for good predictions which causes a bias towards easily predictable environments and behaviors in the form of emergent patterns, that is, environments of minimal surprise. There is no task-dependent bias or any other explicit predetermination for the different qualities of the emerging patterns. A careful configuration of actions, sensor models, and the environment is required to stimulate the emergence of complex behaviors. We study self-assembly to increase the scenario's complexity for our minimal surprise approach and, at the same time, limit the complexity of our simulations to a grid world to manage the feasibility of this approach. We investigate the impact of different swarm densities and the shape of the environment on the emergent patterns. Furthermore, we study how evolution can be biased towards the emergence of desired patterns. We analyze the resilience of the resulting self-assembly behaviors by causing damages to the assembled pattern and observe the self-organized reassembly of the structure. In summary, we evolved swarm behaviors for resilient self-assembly and successfully engineered self-organization in simulation. In future work, we plan to transfer our approach to a swarm of real robots. △ Less

Submitted 11 October, 2019; v1 submitted 14 February, 2019; originally announced February 2019.

An Unsupervised Clustering-Based Short-Term Solar Forecasting Methodology Using Multi-Model Machine Learning Blending

Authors: Cong Feng, Mingjian Cui, Bri-Mathias Hodge, Siyuan Lu, Hendrik F. Hamann, Jie Zhang

Abstract: Solar forecasting accuracy is affected by weather conditions, and weather awareness forecasting models are expected to improve the performance. However, it may not be available and reliable to classify different forecasting tasks by using only meteorological weather categorization. In this paper, an unsupervised clustering-based (UC-based) solar forecasting methodology is developed for short-term… ▽ More Solar forecasting accuracy is affected by weather conditions, and weather awareness forecasting models are expected to improve the performance. However, it may not be available and reliable to classify different forecasting tasks by using only meteorological weather categorization. In this paper, an unsupervised clustering-based (UC-based) solar forecasting methodology is developed for short-term (1-hour-ahead) global horizontal irradiance (GHI) forecasting. This methodology consists of three parts: GHI time series unsupervised clustering, pattern recognition, and UC-based forecasting. The daily GHI time series is first clustered by an Optimized Cross-validated ClUsteRing (OCCUR) method, which determines the optimal number of clusters and best clustering results. Then, support vector machine pattern recognition (SVM-PR) is adopted to recognize the category of a certain day using the first few hours' data in the forecasting stage. GHI forecasts are generated by the most suitable models in different clusters, which are built by a two-layer Machine learning based Multi-Model (M3) forecasting framework. The developed UC-based methodology is validated by using 1-year of data with six solar features. Numerical results show that (i) UC-based models outperform non-UC (all-in-one) models with the same M3 architecture by approximately 20%; (ii) M3-based models also outperform the single-algorithm machine learning (SAML) models by approximately 20%. △ Less

Submitted 10 May, 2018; originally announced May 2018.

A Robot to Shape your Natural Plant: The Machine Learning Approach to Model and Control Bio-Hybrid Systems

Authors: Mostafa Wahby, Mary Katherine Heinrich, Daniel Nicolas Hofstadler, Payam Zahadat, Sebastian Risi, Phil Ayres, Thomas Schmickl, Heiko Hamann

Abstract: Bio-hybrid systems---close couplings of natural organisms with technology---are high potential and still underexplored. In existing work, robots have mostly influenced group behaviors of animals. We explore the possibilities of mixing robots with natural plants, merging useful attributes. Significant synergies arise by combining the plants' ability to efficiently produce shaped material and the ro… ▽ More Bio-hybrid systems---close couplings of natural organisms with technology---are high potential and still underexplored. In existing work, robots have mostly influenced group behaviors of animals. We explore the possibilities of mixing robots with natural plants, merging useful attributes. Significant synergies arise by combining the plants' ability to efficiently produce shaped material and the robots' ability to extend sensing and decision-making behaviors. However, programming robots to control plant motion and shape requires good knowledge of complex plant behaviors. Therefore, we use machine learning to create a holistic plant model and evolve robot controllers. As a benchmark task we choose obstacle avoidance. We use computer vision to construct a model of plant stem stiffening and motion dynamics by training an LSTM network. The LSTM network acts as a forward model predicting change in the plant, driving the evolution of neural network robot controllers. The evolved controllers augment the plants' natural light-finding and tissue-stiffening behaviors to avoid obstacles and grow desired shapes. We successfully verify the robot controllers and bio-hybrid behavior in reality, with a physical setup and actual plants. △ Less

Submitted 19 April, 2018; v1 submitted 18 April, 2018; originally announced April 2018.

Where computer vision can aid physics: dynamic cloud motion forecasting from satellite images

Authors: Sergiy Zhuk, Tigran Tchrakian, Albert Akhriev, Siyuan Lu, Hendrik Hamann

Abstract: This paper describes a new algorithm for solar energy forecasting from a sequence of Cloud Optical Depth (COD) images. The algorithm is based on the following simple observation: the dynamics of clouds represented by COD images resembles the motion (transport) of a density in a fluid flow. This suggests that, to forecast the motion of COD images, it is sufficient to forecast the flow. The latter,… ▽ More This paper describes a new algorithm for solar energy forecasting from a sequence of Cloud Optical Depth (COD) images. The algorithm is based on the following simple observation: the dynamics of clouds represented by COD images resembles the motion (transport) of a density in a fluid flow. This suggests that, to forecast the motion of COD images, it is sufficient to forecast the flow. The latter, in turn, can be accomplished by fitting a parametric model of the fluid flow to the COD images observed in the past. Namely, the learning phase of the algorithm is composed of the following steps: (i) given a sequence of COD images, the snapshots of the optical flow are estimated from two consecutive COD images; (ii) these snapshots are then assimilated into a Navier-Stokes Equation (NSE), i.e. an initial velocity field for NSE is selected so that the corresponding NSE' solution is as close as possible to the optical flow snapshots. The prediction phase consists of utilizing a linear transport equation, which describes the propagation of COD images in the fluid flow predicted by NSE, to estimate the future motion of the COD images. The algorithm has been tested on COD images provided by two geostationary operational environmental satellites from NOAA serving the west-hemisphere. △ Less

Submitted 30 September, 2017; originally announced October 2017.

Comments: published in the proceedings of 2017 IEEE 56th Conference on Decision and Control (CDC)

Flora robotica -- An Architectural System Combining Living Natural Plants and Distributed Robots

Authors: Heiko Hamann, Mohammad Divband Soorati, Mary Katherine Heinrich, Daniel Nicolas Hofstadler, Igor Kuksin, Frank Veenstra, Mostafa Wahby, Stig Anton Nielsen, Sebastian Risi, Tomasz Skrzypczak, Payam Zahadat, Przemyslaw Wojtaszek, Kasper Støy, Thomas Schmickl, Serge Kernbach, Phil Ayres

Abstract: Key to our project flora robotica is the idea of creating a bio-hybrid system of tightly coupled natural plants and distributed robots to grow architectural artifacts and spaces. Our motivation with this ground research project is to lay a principled foundation towards the design and implementation of living architectural systems that provide functionalities beyond those of orthodox building pract… ▽ More Key to our project flora robotica is the idea of creating a bio-hybrid system of tightly coupled natural plants and distributed robots to grow architectural artifacts and spaces. Our motivation with this ground research project is to lay a principled foundation towards the design and implementation of living architectural systems that provide functionalities beyond those of orthodox building practice, such as self-repair, material accumulation and self-organization. Plants and robots work together to create a living organism that is inhabited by human beings. User-defined design objectives help to steer the directional growth of the plants, but also the system's interactions with its inhabitants determine locations where growth is prohibited or desired (e.g., partitions, windows, occupiable space). We report our plant species selection process and aspects of living architecture. A leitmotif of our project is the rich concept of braiding: braids are produced by robots from continuous material and serve as both scaffolds and initial architectural artifacts before plants take over and grow the desired architecture. We use light and hormones as attraction stimuli and far-red light as repelling stimulus to influence the plants. Applied sensors range from simple proximity sensing to detect the presence of plants to sophisticated sensing technology, such as electrophysiology and measurements of sap flow. We conclude by discussing our anticipated final demonstrator that integrates key features of flora robotica, such as the continuous growth process of architectural artifacts and self-repair of living architecture. △ Less

Submitted 13 September, 2017; originally announced September 2017.

Comments: 16 pages, 12 figures

Sooner than Expected: Hitting the Wall of Complexity in Evolution

Authors: Thomas Schmickl, Payam Zahadat, Heiko Hamann

Abstract: In evolutionary robotics an encoding of the control software, which maps sensor data (input) to motor control values (output), is shaped by stochastic optimization methods to complete a predefined task. This approach is assumed to be beneficial compared to standard methods of controller design in those cases where no a-priori model is available that could help to optimize performance. Also for rob… ▽ More In evolutionary robotics an encoding of the control software, which maps sensor data (input) to motor control values (output), is shaped by stochastic optimization methods to complete a predefined task. This approach is assumed to be beneficial compared to standard methods of controller design in those cases where no a-priori model is available that could help to optimize performance. Also for robots that have to operate in unpredictable environments, an evolutionary robotics approach is favorable. We demonstrate here that such a model-free approach is not a free lunch, as already simple tasks can represent unsolvable barriers for fully open-ended uninformed evolutionary computation techniques. We propose here the 'Wankelmut' task as an objective for an evolutionary approach that starts from scratch without pre-shaped controller software or any other informed approach that would force the behavior to be evolved in a desired way. Our focal claim is that 'Wankelmut' represents the simplest set of problems that makes plain-vanilla evolutionary computation fail. We demonstrate this by a series of simple standard evolutionary approaches using different fitness functions and standard artificial neural networks as well as continuous-time recurrent neural networks. All our tested approaches failed. We claim that any other evolutionary approach will also fail that does per-se not favor or enforce modularity and does not freeze or protect already evolved functionalities. Thus we propose a hard-to-pass benchmark and make a strong statement for self-complexifying and generative approaches in evolutionary computation. We anticipate that defining such a 'simplest task to fail' is a valuable benchmark for promoting future development in the field of artificial intelligence, evolutionary robotics and artificial life. △ Less

Submitted 25 September, 2016; originally announced September 2016.

Comments: 24 pages, 15 figures

Investigation of A Collective Decision Making System of Different Neighbourhood-Size Based on Hyper-Geometric Distribution

Authors: Debdipta Goswami, Heiko Hamann

Abstract: The study of collective decision making system has become the central part of the Swarm- Intelligence Related research in recent years. The most challenging task of modelling a collec- tive decision making system is to develop the macroscopic stochastic equation from its microscopic model. In this report we have investigated the behaviour of a collective decision making system with specified micro… ▽ More The study of collective decision making system has become the central part of the Swarm- Intelligence Related research in recent years. The most challenging task of modelling a collec- tive decision making system is to develop the macroscopic stochastic equation from its microscopic model. In this report we have investigated the behaviour of a collective decision making system with specified microscopic rules that resemble the chemical reaction and used different group size. Then we ventured to derive a generalized analytical model of a collective-decision system using hyper-geometric distribution. Index Terms-swarm; collective decision making; noise; group size; hyper-geometric distribution △ Less

Submitted 21 October, 2014; originally announced October 2014.

Comments: 9 pages, 20 figures

Towards Swarm Calculus: Urn Models of Collective Decisions and Universal Properties of Swarm Performance

Authors: Heiko Hamann

Abstract: Methods of general applicability are searched for in swarm intelligence with the aim of gaining new insights about natural swarms and to develop design methodologies for artificial swarms. An ideal solution could be a `swarm calculus' that allows to calculate key features of swarms such as expected swarm performance and robustness based on only a few parameters. To work towards this ideal, one nee… ▽ More Methods of general applicability are searched for in swarm intelligence with the aim of gaining new insights about natural swarms and to develop design methodologies for artificial swarms. An ideal solution could be a `swarm calculus' that allows to calculate key features of swarms such as expected swarm performance and robustness based on only a few parameters. To work towards this ideal, one needs to find methods and models with high degrees of generality. In this paper, we report two models that might be examples of exceptional generality. First, an abstract model is presented that describes swarm performance depending on swarm density based on the dichotomy between cooperation and interference. Typical swarm experiments are given as examples to show how the model fits to several different results. Second, we give an abstract model of collective decision making that is inspired by urn models. The effects of positive feedback probability, that is increasing over time in a decision making system, are understood by the help of a parameter that controls the feedback based on the swarm's current consensus. Several applicable methods, such as the description as Markov process, calculation of splitting probabilities, mean first passage times, and measurements of positive feedback, are discussed and applications to artificial and natural swarms are reported. △ Less

Submitted 18 March, 2013; v1 submitted 24 October, 2012; originally announced October 2012.

Artificial Hormone Reaction Networks: Towards Higher Evolvability in Evolutionary Multi-Modular Robotics

Authors: Heiko Hamann, Jürgen Stradner, Thomas Schmickl, Karl Crailsheim

Abstract: The semi-automatic or automatic synthesis of robot controller software is both desirable and challenging. Synthesis of rather simple behaviors such as collision avoidance by applying artificial evolution has been shown multiple times. However, the difficulty of this synthesis increases heavily with increasing complexity of the task that should be performed by the robot. We try to tackle this probl… ▽ More The semi-automatic or automatic synthesis of robot controller software is both desirable and challenging. Synthesis of rather simple behaviors such as collision avoidance by applying artificial evolution has been shown multiple times. However, the difficulty of this synthesis increases heavily with increasing complexity of the task that should be performed by the robot. We try to tackle this problem of complexity with Artificial Homeostatic Hormone Systems (AHHS), which provide both intrinsic, homeostatic processes and (transient) intrinsic, variant behavior. By using AHHS the need for pre-defined controller topologies or information about the field of application is minimized. We investigate how the principle design of the controller and the hormone network size affects the overall performance of the artificial evolution (i.e., evolvability). This is done by comparing two variants of AHHS that show different effects when mutated. We evolve a controller for a robot built from five autonomous, cooperating modules. The desired behavior is a form of gait resulting in fast locomotion by using the modules' main hinges. △ Less

Submitted 17 November, 2010; originally announced November 2010.

Journal ref: Artificial Life XII (ALife XII), Odense, Denmark, pp. 773-780, MIT Press, 2010

Coherence properties of infrared thermal emission from heated metallic nanowires

Authors: Levente J. Klein, Hendrik F. Hamann, Yat-Yin Au, Snorri Ingvarsson

Abstract: Coherence properties of the infrared thermal radiation from individual heated nanowires are investigated as function of nanowire dimensions. Interfering the thermally induced radiation from a heated nanowire with its image in a nearby moveable mirror, well-defined fringes are observed. From the fringe visibility, the coherence length of the thermal emission radiation from the narrowest nanowires… ▽ More Coherence properties of the infrared thermal radiation from individual heated nanowires are investigated as function of nanowire dimensions. Interfering the thermally induced radiation from a heated nanowire with its image in a nearby moveable mirror, well-defined fringes are observed. From the fringe visibility, the coherence length of the thermal emission radiation from the narrowest nanowires was estimated to be at least 20 um which is much larger than expected from a classical blackbody radiator. A significant increase in coherence and emission efficiency is observed for smaller nanowires. △ Less

Submitted 14 May, 2008; originally announced May 2008.

Comments: 4 pages,figures included

Study of the reaction pbar p -> phi phi from 1.1 to 2.0 GeV/c

Authors: C. Evangelista, A. Palano, D. Drijard, N. H. Hamann, R. T. Jones, B. Mouëllic, S. Ohlsson, J. -M. Perreau, W. Eyrich, M. Moosburger, S. Pomp, F. Stinzing, H. Fischer, J. Franz, E. Rössle, H. Schmitt, H. Wirth, A. Buzzo, K. Kirsebom, M. Lo Vetere, M. Macrì, M. Marinelli, S. Passaggio, M. G. Pia, A. Pozzo , et al. (18 additional authors not shown)

Abstract: A study has been performed of the reaction pbar p -> 4K using in-flight antiprotons from 1.1 to 2.0 GeV/c incident momentum interacting with a hydrogen jet target. The reaction is dominated by the production of a pair of phi mesons. The pbar p -> phi phi cross section rises sharply above threshold and then falls continuously as a function of increasing antiproton momentum. The overall magnitude… ▽ More A study has been performed of the reaction pbar p -> 4K using in-flight antiprotons from 1.1 to 2.0 GeV/c incident momentum interacting with a hydrogen jet target. The reaction is dominated by the production of a pair of phi mesons. The pbar p -> phi phi cross section rises sharply above threshold and then falls continuously as a function of increasing antiproton momentum. The overall magnitude of the cross section exceeds expectations from a simple application of the OZI rule by two orders of magnitude. In a fine scan around the xi/f_J(2230) resonance, no structure is observed. A limit is set for the double branching ratio B(xi -> pbar p) * B(xi -> phi phi) < 6e-5 for a spin 2 resonance of M = 2.235 GeV and Width = 15 MeV. △ Less

Submitted 18 February, 1998; originally announced February 1998.

Comments: 13 pages, 13 figures, 2 tables, Latex. To be published in Phys. Rev. D

Journal ref: Phys.Rev.D57:5370-5381,1998

Search for narrow pbar p resonances in the reaction pbar p>pbar p pi+pi-

Authors: A. Buzzo, P. Debevec, D. Drijard, R. A. Eisenstein, C. Evangelista, W. Eyrich, H. Fischer, J. Franz, R. Geyer, N. H. Hamann, P. G. Harris, D. W. Hertzog, S. A. Hughes, T. Johansson, R. T. Jones, K. Kilian, K. Kirsebom, H. Korsmo, M. Lo Vetere, M. Macri, M. Marinelli, M. Moosburger, B. Mouellic, W. Oelert, S. Ohlsson , et al. (19 additional authors not shown)

Abstract: The reaction pbar p -> pbar p pi+ pi- has been studied with high statistics at CERN-LEAR with incident pbar momenta from 1.65 to 2.0 GeV/c by the JETSET (PS202) experiment. The aim of this paper is to search for narrow resonances decaying to pbar p. No evidence for such structures is found. In particular, an upper limit for the production of a 2.02 GeV state with a width of Gamma = 20 MeV, havin… ▽ More The reaction pbar p -> pbar p pi+ pi- has been studied with high statistics at CERN-LEAR with incident pbar momenta from 1.65 to 2.0 GeV/c by the JETSET (PS202) experiment. The aim of this paper is to search for narrow resonances decaying to pbar p. No evidence for such structures is found. In particular, an upper limit for the production of a 2.02 GeV state with a width of Gamma = 20 MeV, having been seen in other hadroproduction experiments, is established. Our results restrict the cross section for such a peak to be below 200 nb at the 95% confidence level. △ Less

Submitted 16 January, 1998; originally announced January 1998.

Comments: 4 pages, 4 figures, 1 table, LaTeX

Journal ref: Z.Phys.C76:475-478,1997

Measurement of the pbar p -> Ks Ks Reaction from 0.6 to 1.9 GeV/c

Authors: C. Evangelista, A. Palano, D. Drijard, N. H. Hamann, R. T. Jones, B. Mouellic, S. Ohlsson, J. -M. Perreau, W. Eyrich, M. Moosburger, S. Pomp, F. Stinzing, H. Fischer, J. Franz, E. Rossle, H. Schmitt, H. Wirth, A. Buzzo, K. Kirsebom, M. Lo Vetere, M. Macri, M. Marinelli, S. Passaggio, M. G. Pia, A. Pozzo , et al. (18 additional authors not shown)

Abstract: The pbar p -> Ks Ks -> 4pi+/- cross section was measured at incident antiproton momenta between 0.6 and 1.9 GeV/c using the CERN Low Energy Antiproton Ring (LEAR). This investigation was part of a systematic study of in-flight antiproton-proton annihilations into two-neutral-meson final states in a search for hadronic resonances. A coarse scan of the pbar p -> Ks Ks cross section as a function o… ▽ More The pbar p -> Ks Ks -> 4pi+/- cross section was measured at incident antiproton momenta between 0.6 and 1.9 GeV/c using the CERN Low Energy Antiproton Ring (LEAR). This investigation was part of a systematic study of in-flight antiproton-proton annihilations into two-neutral-meson final states in a search for hadronic resonances. A coarse scan of the pbar p -> Ks Ks cross section as a function of center-of-mass energy between 1.964 and 2.395 GeV/c^2 and a fine scan of the region surrounding the Xi(2220) are presented. Upper limits on the product branching ratio BR(Xi -> pbar p)BR(Xi -> Ks Ks) are determined for a wide range of mass and width assumptions based on the non-observation of the Xi(2220). A rise in the pbar p -> Ks Ks cross section is observed near 2.15 GeV/c^2, which is consistent with the f2(2150) resonance. △ Less

Submitted 28 July, 1997; originally announced July 1997.

Comments: 11 pages, Latex, to be published in Phys Rev D (Oct 97)

Journal ref: Phys.Rev.D56:3803-3810,1997