Showing 1–24 of 24 results for author: Galvan, E

NeuroLGP-SM: Scalable Surrogate-Assisted Neuroevolution for Deep Neural Networks

Authors: Fergal Stapleton, Edgar Galván

Abstract: Evolutionary Algorithms (EAs) play a crucial role in the architectural configuration and training of Artificial Deep Neural Networks (DNNs), a process known as neuroevolution. However, neuroevolution is hindered by its inherent computational expense, requiring multiple generations, a large population, and numerous epochs. The most computationally intensive aspect lies in evaluating the fitness fun… ▽ More Evolutionary Algorithms (EAs) play a crucial role in the architectural configuration and training of Artificial Deep Neural Networks (DNNs), a process known as neuroevolution. However, neuroevolution is hindered by its inherent computational expense, requiring multiple generations, a large population, and numerous epochs. The most computationally intensive aspect lies in evaluating the fitness function of a single candidate solution. To address this challenge, we employ Surrogate-assisted EAs (SAEAs). While a few SAEAs approaches have been proposed in neuroevolution, none have been applied to truly large DNNs due to issues like intractable information usage. In this work, drawing inspiration from Genetic Programming semantics, we use phenotypic distance vectors, outputted from DNNs, alongside Kriging Partial Least Squares (KPLS), an approach that is effective in handling these large vectors, making them suitable for search. Our proposed approach, named Neuro-Linear Genetic Programming surrogate model (NeuroLGP-SM), efficiently and accurately estimates DNN fitness without the need for complete evaluations. NeuroLGP-SM demonstrates competitive or superior results compared to 12 other methods, including NeuroLGP without SM, convolutional neural networks, support vector machines, and autoencoders. Additionally, it is worth noting that NeuroLGP-SM is 25% more energy-efficient than its NeuroLGP counterpart. This efficiency advantage adds to the overall appeal of our proposed NeuroLGP-SM in optimising the configuration of large DNNs. △ Less

Submitted 2 May, 2024; v1 submitted 12 April, 2024; originally announced April 2024.

Comments: Accept for IEEE Congress on Evolutionary Computation (CEC) (CEC 2024), Yokohama, Japan, 8 pages, 5 figures, 2 tables (Fixed typo x' -> x*)

NeuroLGP-SM: A Surrogate-assisted Neuroevolution Approach using Linear Genetic Programming

Authors: Fergal Stapleton, Brendan Cody-Kenny, Edgar Galván

Abstract: Evolutionary algorithms are increasingly recognised as a viable computational approach for the automated optimisation of deep neural networks (DNNs) within artificial intelligence. This method extends to the training of DNNs, an approach known as neuroevolution. However, neuroevolution is an inherently resource-intensive process, with certain studies reporting the consumption of thousands of GPU d… ▽ More Evolutionary algorithms are increasingly recognised as a viable computational approach for the automated optimisation of deep neural networks (DNNs) within artificial intelligence. This method extends to the training of DNNs, an approach known as neuroevolution. However, neuroevolution is an inherently resource-intensive process, with certain studies reporting the consumption of thousands of GPU days for refining and training a single DNN network. To address the computational challenges associated with neuroevolution while still attaining good DNN accuracy, surrogate models emerge as a pragmatic solution. Despite their potential, the integration of surrogate models into neuroevolution is still in its early stages, hindered by factors such as the effective use of high-dimensional data and the representation employed in neuroevolution. In this context, we address these challenges by employing a suitable representation based on Linear Genetic Programming, denoted as NeuroLGP, and leveraging Kriging Partial Least Squares. The amalgamation of these two techniques culminates in our proposed methodology known as the NeuroLGP-Surrogate Model (NeuroLGP-SM). For comparison purposes, we also code and use a baseline approach incorporating a repair mechanism, a common practice in neuroevolution. Notably, the baseline approach surpasses the renowned VGG-16 model in accuracy. Given the computational intensity inherent in DNN operations, a singular run is typically the norm. To evaluate the efficacy of our proposed approach, we conducted 96 independent runs. Significantly, our methodologies consistently outperform the baseline, with the SM model demonstrating superior accuracy or comparable results to the NeuroLGP approach. Noteworthy is the additional advantage that the SM approach exhibits a 25% reduction in computational requirements, further emphasising its efficiency for neuroevolution. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Comments: Accepted in "International Conference on Optimization and Learning (OLA), Dubrovnik, Croatia, 2024", 13 pages, 4 figures, 1 table

An Analysis on the Effects of Evolving the Monte Carlo Tree Search Upper Confidence for Trees Selection Policy on Unimodal, Multimodal and Deceptive Landscapes

Authors: Edgar Galvan, Fred Valdez Ameneyro

Abstract: Monte Carlo Tree Search (MCTS) is a best-first sampling method employed in the search for optimal decisions. The effectiveness of MCTS relies on the construction of its statistical tree, with the selection policy playing a crucial role. A selection policy that works particularly well in MCTS is the Upper Confidence Bounds for Trees, referred to as UCT. The research community has also put forth mor… ▽ More Monte Carlo Tree Search (MCTS) is a best-first sampling method employed in the search for optimal decisions. The effectiveness of MCTS relies on the construction of its statistical tree, with the selection policy playing a crucial role. A selection policy that works particularly well in MCTS is the Upper Confidence Bounds for Trees, referred to as UCT. The research community has also put forth more sophisticated bounds aimed at enhancing MCTS performance on specific problem domains. Thus, while MCTS UCT generally performs well, there may be variants that outperform it. This has led to various efforts to evolve selection policies for use in MCTS. While all of these previous works are inspiring, none have undertaken an in-depth analysis to shed light on the circumstances in which an evolved alternative to MCTS UCT might prove advantageous. Most of these studies have focused on a single type of problem. In sharp contrast, this work explores the use of five functions of different natures, ranging from unimodal to multimodal and deceptive functions. We illustrate how the evolution of MCTS UCT can yield benefits in multimodal and deceptive scenarios, whereas MCTS UCT is robust in all of the functions used in this work. △ Less

Submitted 21 November, 2023; originally announced November 2023.

Comments: 31 pages, 7 figures, 6 tables

Evolutionary Multi-objective Optimisation in Neurotrajectory Prediction

Authors: Edgar Galván, Fergal Stapleton

Abstract: Machine learning has rapidly evolved during the last decade, achieving expert human performance on notoriously challenging problems such as image classification. This success is partly due to the re-emergence of bio-inspired modern artificial neural networks (ANNs) along with the availability of computation power, vast labelled data and ingenious human-based expert knowledge as well as optimisatio… ▽ More Machine learning has rapidly evolved during the last decade, achieving expert human performance on notoriously challenging problems such as image classification. This success is partly due to the re-emergence of bio-inspired modern artificial neural networks (ANNs) along with the availability of computation power, vast labelled data and ingenious human-based expert knowledge as well as optimisation approaches that can find the correct configuration (and weights) for these networks. Neuroevolution is a term used for the latter when employing evolutionary algorithms. Most of the works in neuroevolution have focused their attention in a single type of ANNs, named Convolutional Neural Networks (CNNs). Moreover, most of these works have used a single optimisation approach. This work makes a progressive step forward in neuroevolution for vehicle trajectory prediction, referred to as neurotrajectory prediction, where multiple objectives must be considered. To this end, rich ANNs composed of CNNs and Long-short Term Memory Network are adopted. Two well-known and robust Evolutionary Multi-objective Optimisation (EMO) algorithms, NSGA-II and MOEA/D are also adopted. The completely different underlying mechanism of each of these algorithms sheds light on the implications of using one over the other EMO approach in neurotrajectory prediction. In particular, the importance of considering objective scaling is highlighted, finding that MOEA/D can be more adept at focusing on specific objectives whereas, NSGA-II tends to be more invariant to objective scaling. Additionally, certain objectives are shown to be either beneficial or detrimental to finding valid models, for instance, inclusion of a distance feedback objective was considerably detrimental to finding valid models, while a lateral velocity objective was more beneficial. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Comments: 38 pages, 6 Figure, 10 Tables

Journal ref: Applied Soft Computing (2023)

Initial Steps Towards Tackling High-dimensional Surrogate Modeling for Neuroevolution Using Kriging Partial Least Squares

Authors: Fergal Stapleton, Edgar Galván

Abstract: Surrogate-assisted evolutionary algorithms (SAEAs) aim to use efficient computational models with the goal of approximating the fitness function in evolutionary computation systems. This area of research has been active for over two decades and has received significant attention from the specialised research community in different areas, for example, single and many objective optimisation or dynam… ▽ More Surrogate-assisted evolutionary algorithms (SAEAs) aim to use efficient computational models with the goal of approximating the fitness function in evolutionary computation systems. This area of research has been active for over two decades and has received significant attention from the specialised research community in different areas, for example, single and many objective optimisation or dynamic and stationary optimisation problems. An emergent and exciting area that has received little attention from the SAEAs community is in neuroevolution. This refers to the use of evolutionary algorithms in the automatic configuration of artificial neural network (ANN) architectures, hyper-parameters and/or the training of ANNs. However, ANNs suffer from two major issues: (a) the use of highly-intense computational power for their correct training, and (b) the highly specialised human expertise required to correctly configure ANNs necessary to get a well-performing network. This work aims to fill this important research gap in SAEAs in neuroevolution by addressing these two issues. We demonstrate how one can use a Kriging Partial Least Squares method that allows efficient computation of good approximate surrogate models compared to the well-known Kriging method, which normally cannot be used in neuroevolution due to the high dimensionality of the data. △ Less

Submitted 4 August, 2023; v1 submitted 5 May, 2023; originally announced May 2023.

Comments: 2 pages, 1 table

Journal ref: GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary Computation (2023)

Neural Architecture Search Using Genetic Algorithm for Facial Expression Recognition

Authors: Shuchao Deng, Yanan Sun, Edgar Galvan

Abstract: Facial expression is one of the most powerful, natural, and universal signals for human beings to express emotional states and intentions. Thus, it is evident the importance of correct and innovative facial expression recognition (FER) approaches in Artificial Intelligence. The current common practice for FER is to correctly design convolutional neural networks' architectures (CNNs) using human ex… ▽ More Facial expression is one of the most powerful, natural, and universal signals for human beings to express emotional states and intentions. Thus, it is evident the importance of correct and innovative facial expression recognition (FER) approaches in Artificial Intelligence. The current common practice for FER is to correctly design convolutional neural networks' architectures (CNNs) using human expertise. However, finding a well-performing architecture is often a very tedious and error-prone process for deep learning researchers. Neural architecture search (NAS) is an area of growing interest as demonstrated by the large number of scientific works published in recent years thanks to the impressive results achieved in recent years. We propose a genetic algorithm approach that uses an ingenious encoding-decoding mechanism that allows to automatically evolve CNNs on FER tasks attaining high accuracy classification rates. The experimental results demonstrate that the proposed algorithm achieves the best-known results on the CK+ and FERG datasets as well as competitive results on the JAFFE dataset. △ Less

Submitted 12 April, 2023; originally announced April 2023.

Towards Understanding the Effects of Evolving the MCTS UCT Selection Policy

Authors: Fred Valdez Ameneyro, Edgar Galvan

Abstract: Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the MCTS statistical tree is built and the selection policy plays a fundamental role in this. A particular selection policy that works particularly well, widely adopted in MCTS, is the Upper Confidence Bounds for Trees, referred to as UCT. Other more sophistica… ▽ More Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the MCTS statistical tree is built and the selection policy plays a fundamental role in this. A particular selection policy that works particularly well, widely adopted in MCTS, is the Upper Confidence Bounds for Trees, referred to as UCT. Other more sophisticated bounds have been proposed by the community with the goal to improve MCTS performance on particular problems. Thus, it is evident that while the MCTS UCT behaves generally well, some variants might behave better. As a result of this, multiple works have been proposed to evolve a selection policy to be used in MCTS. Although all these works are inspiring, none of them have carried out an in-depth analysis shedding light under what circumstances an evolved alternative of MCTS UCT might be beneficial in MCTS due to focusing on a single type of problem. In sharp contrast to this, in this work we use five functions of different nature, going from a unimodal function, covering multimodal functions to deceptive functions. We demonstrate how the evolution of the MCTS UCT might be beneficial in multimodal and deceptive scenarios, whereas the MCTS UCT is robust in unimodal scenarios and competitive in the rest of the scenarios used in this study. △ Less

Submitted 7 February, 2023; originally announced February 2023.

Comments: 8 pages, double column, 6 figures, 1 table, conference. arXiv admin note: substantial text overlap with arXiv:2208.13589, arXiv:2112.09697

Pattern-Based Prediction of Population Outbreaks

Authors: Gabriel R. Palma, Wesley A. C. Godoy, Eduardo Engel, Douglas Lau, Edgar Galvan, Oliver Mason, Charles Markham, Rafael A. Moral

Abstract: Insect outbreaks are biotic disturbances in forests and agroecosystems that cause economic and ecological damage. This phenomenon depends on a variety of biological and physical factors. The complexity and practical importance of the issue have made the problem of predicting outbreaks a focus of recent research. Here, we propose the Pattern-Based Prediction (PBP) method for predicting population o… ▽ More Insect outbreaks are biotic disturbances in forests and agroecosystems that cause economic and ecological damage. This phenomenon depends on a variety of biological and physical factors. The complexity and practical importance of the issue have made the problem of predicting outbreaks a focus of recent research. Here, we propose the Pattern-Based Prediction (PBP) method for predicting population outbreaks. It is based on the Alert Zone Procedure, combined with elements from machine learning. It uses information on previous time series values that precede an outbreak event as predictors of future outbreaks, which can be useful when monitoring pest species. We illustrate the methodology using simulated datasets and real time series data obtained by monitoring aphids in wheat crops in Southern Brazil. We obtained an average test accuracy of $84.6\%$ in the simulation studies implemented with stochastic models, and $95.0\%$ for predicting outbreaks using the real dataset. This shows the feasibility of the PBP method in predicting outbreaks in population dynamics. We benchmarked our results against established state-of-the-art machine learning methods, namely Support Vector Machines, Deep Neural Networks, Long Short Term Memory and Random Forests. The PBP method yielded a competitive performance, associated with higher true-positive rates in most comparisons, while being able to provide interpretability rather than being a black-box method. This is an improvement over current state-of-the-art machine learning tools, especially when being used by non-specialists, such as ecologists aiming to use a quantitative approach for pest monitoring. We provide open-source code to implement the PBP method in Python, through the \texttt{pypbp} package, which may be directly downloaded from the Python Package Index server or accessed through \url{https://pypbp-documentation.readthedocs.io} △ Less

Submitted 6 September, 2022; originally announced September 2022.

Comments: 40 pages

Evolving the MCTS Upper Confidence Bounds for Trees Using a Semantic-inspired Evolutionary Algorithm in the Game of Carcassonne

Authors: Edgar Galván, Gavin Simpson, Fred Valdez Ameneyro

Abstract: Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the tree is built and the selection process plays a fundamental role in this. One particular selection mechanism that has proved to be reliable is based on the Upper Confidence Bounds for Trees (UCT). The UCT attempts to balance exploration and exploitation by… ▽ More Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the tree is built and the selection process plays a fundamental role in this. One particular selection mechanism that has proved to be reliable is based on the Upper Confidence Bounds for Trees (UCT). The UCT attempts to balance exploration and exploitation by considering the values stored in the statistical tree of the MCTS. However, some tuning of the MCTS UCT is necessary for this to work well. In this work, we use Evolutionary Algorithms (EAs) to evolve mathematical expressions with the goal to substitute the UCT formula and use the evolved expressions in MCTS. More specifically, we evolve expressions by means of our proposed Semantic-inspired Evolutionary Algorithm in MCTS approach (SIEA-MCTS). This is inspired by semantics in Genetic Programming (GP), where the use of fitness cases is seen as a requirement to be adopted in GP. Fitness cases are normally used to determine the fitness of individuals and can be used to compute the semantic similarity (or dissimilarity) of individuals. However, fitness cases are not available in MCTS. We extend this notion by using multiple reward values from MCTS that allow us to determine both the fitness of an individual and its semantics. By doing so, we show how SIEA-MCTS is able to successfully evolve mathematical expressions that yield better or competitive results compared to UCT without the need of tuning these evolved expressions. We compare the performance of the proposed SIEA-MCTS against MCTS algorithms, MCTS Rapid Action Value Estimation algorithms, three variants of the *-minimax family of algorithms, a random controller and two more EA approaches. We consistently show how SIEA-MCTS outperforms most of these intelligent controllers in the challenging game of Carcassonne. △ Less

Submitted 29 August, 2022; originally announced August 2022.

Comments: 10 pages, 2 figures, 11 tables. arXiv admin note: substantial text overlap with arXiv:2112.09697

Highlights of Semantics in Multi-objective Genetic Programming

Authors: Edgar Galván, Leonardo Trujillo, Fergal Stapleton

Abstract: Semantics is a growing area of research in Genetic programming (GP) and refers to the behavioural output of a Genetic Programming individual when executed. This research expands upon the current understanding of semantics by proposing a new approach: Semantic-based Distance as an additional criteriOn (SDO), in the thus far, somewhat limited researched area of semantics in Multi-objective GP (MOGP)… ▽ More Semantics is a growing area of research in Genetic programming (GP) and refers to the behavioural output of a Genetic Programming individual when executed. This research expands upon the current understanding of semantics by proposing a new approach: Semantic-based Distance as an additional criteriOn (SDO), in the thus far, somewhat limited researched area of semantics in Multi-objective GP (MOGP). Our work included an expansive analysis of the GP in terms of performance and diversity metrics, using two additional semantic-based approaches, namely Semantic Similarity-based Crossover (SCC) and Semantic-based Crowding Distance (SCD). Each approach is integrated into two evolutionary multi-objective (EMO) frameworks: Non-dominated Sorting Genetic Algorithm II (NSGA-II) and the Strength Pareto Evolutionary Algorithm 2 (SPEA2), and along with the three semantic approaches, the canonical form of NSGA-II and SPEA2 are rigorously compared. Using highly-unbalanced binary classification datasets, we demonstrated that the newly proposed approach of SDO consistently generated more non-dominated solutions, with better diversity and improved hypervolume results. △ Less

Submitted 13 June, 2022; v1 submitted 10 June, 2022; originally announced June 2022.

Comments: Accepted in GECCO '22 Companion, July 9--13, 2022, Boston, MA, USA, 2 pages, 1 figure. This Hot-off-the-Press paper summarises "Semantics in Multi-objective Genetic Programming" by Edgar Galván, Leonardo Trujillo and Fergal Stapleton, published in the journal of Applied Soft Computing 2022, https://doi.org/10.1016/j.asoc.2021.108143 [arXiv:2105.02944]

ViT-BEVSeg: A Hierarchical Transformer Network for Monocular Birds-Eye-View Segmentation

Authors: Pramit Dutta, Ganesh Sistu, Senthil Yogamani, Edgar Galván, John McDonald

Abstract: Generating a detailed near-field perceptual model of the environment is an important and challenging problem in both self-driving vehicles and autonomous mobile robotics. A Bird Eye View (BEV) map, providing a panoptic representation, is a commonly used approach that provides a simplified 2D representation of the vehicle surroundings with accurate semantic level segmentation for many downstream ta… ▽ More Generating a detailed near-field perceptual model of the environment is an important and challenging problem in both self-driving vehicles and autonomous mobile robotics. A Bird Eye View (BEV) map, providing a panoptic representation, is a commonly used approach that provides a simplified 2D representation of the vehicle surroundings with accurate semantic level segmentation for many downstream tasks. Current state-of-the art approaches to generate BEV-maps employ a Convolutional Neural Network (CNN) backbone to create feature-maps which are passed through a spatial transformer to project the derived features onto the BEV coordinate frame. In this paper, we evaluate the use of vision transformers (ViT) as a backbone architecture to generate BEV maps. Our network architecture, ViT-BEVSeg, employs standard vision transformers to generate a multi-scale representation of the input image. The resulting representation is then provided as an input to a spatial transformer decoder module which outputs segmentation maps in the BEV grid. We evaluate our approach on the nuScenes dataset demonstrating a considerable improvement in the performance relative to state-of-the-art approaches. △ Less

Submitted 31 May, 2022; originally announced May 2022.

Comments: Accepted for 2022 IEEE World Congress on Computational Intelligence (Track: IJCNN)

Neuroevolutionary Multi-objective approaches to Trajectory Prediction in Autonomous Vehicles

Authors: Fergal Stapleton, Edgar Galván, Ganesh Sistu, Senthil Yogamani

Abstract: The incentive for using Evolutionary Algorithms (EAs) for the automated optimization and training of deep neural networks (DNNs), a process referred to as neuroevolution, has gained momentum in recent years. The configuration and training of these networks can be posed as optimization problems. Indeed, most of the recent works on neuroevolution have focused their attention on single-objective opti… ▽ More The incentive for using Evolutionary Algorithms (EAs) for the automated optimization and training of deep neural networks (DNNs), a process referred to as neuroevolution, has gained momentum in recent years. The configuration and training of these networks can be posed as optimization problems. Indeed, most of the recent works on neuroevolution have focused their attention on single-objective optimization. Moreover, from the little research that has been done at the intersection of neuroevolution and evolutionary multi-objective optimization (EMO), all the research that has been carried out has focused predominantly on the use of one type of DNN: convolutional neural networks (CNNs), using well-established standard benchmark problems such as MNIST. In this work, we make a leap in the understanding of these two areas (neuroevolution and EMO), regarded in this work as neuroevolutionary multi-objective, by using and studying a rich DNN composed of a CNN and Long-short Term Memory network. Moreover, we use a robust and challenging vehicle trajectory prediction problem. By using the well-known Non-dominated Sorting Genetic Algorithm-II, we study the effects of five different objectives, tested in categories of three, allowing us to show how these objectives have either a positive or detrimental effect in neuroevolution for trajectory prediction in autonomous vehicles. △ Less

Submitted 6 May, 2022; v1 submitted 4 May, 2022; originally announced May 2022.

Comments: Accepted in Genetic and Evolutionary Computation Conference Companion (GECCO '22 Companion), July 9--13, 2022, Boston, MA, USA, 4 pages, 1 figure, 6 tables

On the Evolution of the MCTS Upper Confidence Bounds for Trees by Means of Evolutionary Algorithms in the Game of Carcassonne

Authors: Edgar Galván, Gavin Simpson

Abstract: Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The MCTS's popularity is based on its extraordinary results in the challenging two-player based game Go, a game considered much harder than Chess and that until very recently was considered infeasible for Artificial Intelligence methods. The success of MCTS depends heavily on how the tree is built and t… ▽ More Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The MCTS's popularity is based on its extraordinary results in the challenging two-player based game Go, a game considered much harder than Chess and that until very recently was considered infeasible for Artificial Intelligence methods. The success of MCTS depends heavily on how the tree is built and the selection process plays a fundamental role in this. One particular selection mechanism that has proved to be reliable is based on the Upper Confidence Bounds for Trees, commonly referred as UCT. The UCT attempts to nicely balance exploration and exploitation by considering the values stored in the statistical tree of the MCTS. However, some tuning of the MCTS UCT is necessary for this to work well. In this work, we use Evolutionary Algorithms (EAs) to evolve mathematical expressions with the goal to substitute the UCT mathematical expression. We compare our proposed approach, called Evolution Strategy in MCTS (ES-MCTS) against five variants of the MCTS UCT, three variants of the star-minimax family of algorithms as well as a random controller in the Game of Carcassonne. We also use a variant of our proposed EA-based controller, dubbed ES partially integrated in MCTS. We show how the ES-MCTS controller, is able to outperform all these 10 intelligent controllers, including robust MCTS UCT controllers. △ Less

Submitted 17 December, 2021; originally announced December 2021.

Comments: 9 pages, 1 figure, 11 tables

Semantics in Multi-objective Genetic Programming

Authors: Edgar Galván, Leonardo Trujillo, Fergal Stapleton

Abstract: Semantics has become a key topic of research in Genetic Programming (GP). Semantics refers to the outputs (behaviour) of a GP individual when this is run on a data set. The majority of works that focus on semantic diversity in single-objective GP indicates that it is highly beneficial in evolutionary search. Surprisingly, there is minuscule research conducted in semantics in Multi-objective GP (MO… ▽ More Semantics has become a key topic of research in Genetic Programming (GP). Semantics refers to the outputs (behaviour) of a GP individual when this is run on a data set. The majority of works that focus on semantic diversity in single-objective GP indicates that it is highly beneficial in evolutionary search. Surprisingly, there is minuscule research conducted in semantics in Multi-objective GP (MOGP). In this work we make a leap beyond our understanding of semantics in MOGP and propose SDO: Semantic-based Distance as an additional criteriOn. This naturally encourages semantic diversity in MOGP. To do so, we find a pivot in the less dense region of the first Pareto front (most promising front). This is then used to compute a distance between the pivot and every individual in the population. The resulting distance is then used as an additional criterion to be optimised to favour semantic diversity. We also use two other semantic-based methods as baselines, called Semantic Similarity-based Crossover and Semantic-based Crowding Distance. Furthermore, we also use the NSGA-II and the SPEA2 for comparison too. We use highly unbalanced binary classification problems and consistently show how our proposed SDO approach produces more non-dominated solutions and better diversity, leading to better statistically significant results, using the hypervolume results as evaluation measure, compared to the rest of the other four methods. △ Less

Submitted 30 November, 2021; v1 submitted 6 May, 2021; originally announced May 2021.

Comments: 30 pages, 4 figures, 10 tables, journal article

Journal ref: Applied Soft Computing, volume 115, 2022

Semantic Neighborhood Ordering in Multi-objective Genetic Programming based on Decomposition

Authors: Fergal Stapleton, Edgar Galván

Abstract: Semantic diversity in Genetic Programming has proved to be highly beneficial in evolutionary search. We have witnessed a surge in the number of scientific works in the area, starting first in discrete spaces and moving then to continuous spaces. The vast majority of these works, however, have focused their attention on single-objective genetic programming paradigms, with a few exceptions focusing… ▽ More Semantic diversity in Genetic Programming has proved to be highly beneficial in evolutionary search. We have witnessed a surge in the number of scientific works in the area, starting first in discrete spaces and moving then to continuous spaces. The vast majority of these works, however, have focused their attention on single-objective genetic programming paradigms, with a few exceptions focusing on Evolutionary Multi-objective Optimization (EMO). The latter works have used well-known robust algorithms, including the Non-dominated Sorting Genetic Algorithm II and the Strength Pareto Evolutionary Algorithm, both heavily influenced by the notion of Pareto dominance. These inspiring works led us to make a step forward in EMO by considering Multi-objective Evolutionary Algorithms Based on Decomposition (MOEA/D). We show, for the first time, how we can promote semantic diversity in MOEA/D in Genetic Programming. △ Less

Submitted 13 April, 2021; v1 submitted 28 February, 2021; originally announced March 2021.

Comments: 9 pages, 4 tables, 2 figures, added additional references, fixed minor typos

Neuroevolution in Deep Learning: The Role of Neutrality

Authors: Edgar Galván

Abstract: A variety of methods have been applied to the architectural configuration and learning or training of artificial deep neural networks (DNN). These methods play a crucial role in the success or failure of the DNN for most problems and applications. Evolutionary Algorithms (EAs) are gaining momentum as a computationally feasible method for the automated optimisation of DNNs. Neuroevolution is a term… ▽ More A variety of methods have been applied to the architectural configuration and learning or training of artificial deep neural networks (DNN). These methods play a crucial role in the success or failure of the DNN for most problems and applications. Evolutionary Algorithms (EAs) are gaining momentum as a computationally feasible method for the automated optimisation of DNNs. Neuroevolution is a term which describes these processes of automated configuration and training of DNNs using EAs. However, the automatic design and/or training of these modern neural networks through evolutionary algorithms is computanalli expensive. Kimura's neutral theory of molecular evolution states that the majority of evolutionary changes at molecular level are the result of random fixation of selectively neutral mutations. A mutation from one gene to another is neutral if it does not affect the phenotype. This work discusses how neutrality, given certain conditions, can help to speed up the training/design of deep neural networks. △ Less

Submitted 16 February, 2021; originally announced February 2021.

Comments: 9 pages, 2 figures. arXiv admin note: substantial text overlap with arXiv:2006.05415

Promoting Semantics in Multi-objective Genetic Programming based on Decomposition

Authors: Edgar Galván, Fergal Stapleton

Abstract: The study of semantics in Genetic Program (GP) deals with the behaviour of a program given a set of inputs and has been widely reported in hel** to promote diversity in GP for a range of complex problems ultimately improving evolutionary search. The vast majority of these studies have focused their attention in single-objective GP, with just a few exceptions where Pareto-based dominance algorith… ▽ More The study of semantics in Genetic Program (GP) deals with the behaviour of a program given a set of inputs and has been widely reported in hel** to promote diversity in GP for a range of complex problems ultimately improving evolutionary search. The vast majority of these studies have focused their attention in single-objective GP, with just a few exceptions where Pareto-based dominance algorithms such as NSGA-II and SPEA2 have been used as frameworks to test whether highly popular semantics-based methods, such as Semantic Similarity-based Crossover (SSC), helps or hinders evolutionary search. Surprisingly it has been reported that the benefits exhibited by SSC in SOGP are not seen in Pareto-based dominance Multi-objective GP. In this work, we are interested in studying if the same carries out in Multi-objective Evolutionary Algorithms based on Decomposition (MOEA/D). By using the MNIST dataset, a well-known dataset used in the machine learning community, we show how SSC in MOEA/D promotes semantic diversity yielding better results compared to when this is not present in canonical MOEA/D. △ Less

Submitted 8 December, 2020; originally announced December 2020.

Comments: 9 pages, 4 Tables, 1 Figure. arXiv admin note: substantial text overlap with arXiv:2009.12401

Playing Carcassonne with Monte Carlo Tree Search

Authors: Fred Valdez Ameneyro, Edgar Galvan, Anger Fernando Kuri Morales

Abstract: Monte Carlo Tree Search (MCTS) is a relatively new sampling method with multiple variants in the literature. They can be applied to a wide variety of challenging domains including board games, video games, and energy-based problems to mention a few. In this work, we explore the use of the vanilla MCTS and the MCTS with Rapid Action Value Estimation (MCTS-RAVE) in the game of Carcassonne, a stochas… ▽ More Monte Carlo Tree Search (MCTS) is a relatively new sampling method with multiple variants in the literature. They can be applied to a wide variety of challenging domains including board games, video games, and energy-based problems to mention a few. In this work, we explore the use of the vanilla MCTS and the MCTS with Rapid Action Value Estimation (MCTS-RAVE) in the game of Carcassonne, a stochastic game with a deceptive scoring system where limited research has been conducted. We compare the strengths of the MCTS-based methods with the Star2.5 algorithm, previously reported to yield competitive results in the game of Carcassonne when a domain-specific heuristic is used to evaluate the game states. We analyse the particularities of the strategies adopted by the algorithms when they share a common reward system. The MCTS-based methods consistently outperformed the Star2.5 algorithm given their ability to find and follow long-term strategies, with the vanilla MCTS exhibiting a more robust game-play than the MCTS-RAVE. △ Less

Submitted 4 October, 2020; v1 submitted 27 September, 2020; originally announced September 2020.

Comments: 8 pages, 6 figures

Semantic-based Distance Approaches in Multi-objective Genetic Programming

Authors: Edgar Galván, Fergal Stapleton

Abstract: Semantics in the context of Genetic Program (GP) can be understood as the behaviour of a program given a set of inputs and has been well documented in improving performance of GP for a range of diverse problems. There have been a wide variety of different methods which have incorporated semantics into single-objective GP. The study of semantics in Multi-objective (MO) GP, however, has been limited… ▽ More Semantics in the context of Genetic Program (GP) can be understood as the behaviour of a program given a set of inputs and has been well documented in improving performance of GP for a range of diverse problems. There have been a wide variety of different methods which have incorporated semantics into single-objective GP. The study of semantics in Multi-objective (MO) GP, however, has been limited and this paper aims at tackling this issue. More specifically, we conduct a comparison of three different forms of semantics in MOGP. One semantic-based method, (i) Semantic Similarity-based Crossover (SSC), is borrowed from single-objective GP, where the method has consistently being reported beneficial in evolutionary search. We also study two other methods, dubbed (ii) Semantic-based Distance as an additional criteriOn (SDO) and (iii) Pivot Similarity SDO. We empirically and consistently show how by naturally handling semantic distance as an additional criterion to be optimised in MOGP leads to better performance when compared to canonical methods and SSC. Both semantic distance based approaches made use of a pivot, which is a reference point from the sparsest region of the search space and it was found that individuals which were both semantically similar and dissimilar to this pivot were beneficial in promoting diversity. Moreover, we also show how the semantics successfully promoted in single-objective optimisation does not necessary lead to a better performance when adopted in MOGP. △ Less

Submitted 16 December, 2020; v1 submitted 25 September, 2020; originally announced September 2020.

Comments: 8 pages, 6 tables, added additional reference, updated citation format

Statistical Tree-based Population Seeding for Rolling Horizon EAs in General Video Game Playing

Authors: Edgar Galván, Oxana Gorshkova, Peter Mooney, Fred Valdez Ameneyro, Erik Cuevas

Abstract: Multiple Artificial Intelligence (AI) methods have been proposed over recent years to create controllers to play multiple video games of different nature and complexity without revealing the specific mechanics of each of these games to the AI methods. In recent years, Evolutionary Algorithms (EAs) employing rolling horizon mechanisms have achieved extraordinary results in these type of problems. H… ▽ More Multiple Artificial Intelligence (AI) methods have been proposed over recent years to create controllers to play multiple video games of different nature and complexity without revealing the specific mechanics of each of these games to the AI methods. In recent years, Evolutionary Algorithms (EAs) employing rolling horizon mechanisms have achieved extraordinary results in these type of problems. However, some limitations are present in Rolling Horizon EAs making it a grand challenge of AI. These limitations include the wasteful mechanism of creating a population and evolving it over a fraction of a second to propose an action to be executed by the game agent. Another limitation is to use a scalar value (fitness value) to direct evolutionary search instead of accounting for a mechanism that informs us how a particular agent behaves during the rolling horizon simulation. In this work, we address both of these issues. We introduce the use of a statistical tree that tackles the latter limitation. Furthermore, we tackle the former limitation by employing a mechanism that allows us to seed part of the population using Monte Carlo Tree Search, a method that has dominated multiple General Video Game AI competitions. We show how the proposed novel mechanism, called Statistical Tree-based Population Seeding, achieves better results compared to vanilla Rolling Horizon EAs in a set of 20 games, including 10 stochastic and 10 deterministic games. △ Less

Submitted 30 August, 2020; originally announced August 2020.

Comments: 14 Pages, 5 Tables

Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges

Authors: Edgar Galván, Peter Mooney

Abstract: A variety of methods have been applied to the architectural configuration and learning or training of artificial deep neural networks (DNN). These methods play a crucial role in the success or failure of the DNN for most problems and applications. Evolutionary Algorithms (EAs) are gaining momentum as a computationally feasible method for the automated optimisation and training of DNNs. Neuroevolut… ▽ More A variety of methods have been applied to the architectural configuration and learning or training of artificial deep neural networks (DNN). These methods play a crucial role in the success or failure of the DNN for most problems and applications. Evolutionary Algorithms (EAs) are gaining momentum as a computationally feasible method for the automated optimisation and training of DNNs. Neuroevolution is a term which describes these processes of automated configuration and training of DNNs using EAs. While many works exist in the literature, no comprehensive surveys currently exist focusing exclusively on the strengths and limitations of using neuroevolution approaches in DNNs. Prolonged absence of such surveys can lead to a disjointed and fragmented field preventing DNNs researchers potentially adopting neuroevolutionary methods in their own research, resulting in lost opportunities for improving performance and wider application within real-world deep learning problems. This paper presents a comprehensive survey, discussion and evaluation of the state-of-the-art works on using EAs for architectural configuration and training of DNNs. Based on this survey, the paper highlights the most pertinent current issues and challenges in neuroevolution and identifies multiple promising future research directions. △ Less

Submitted 9 June, 2020; originally announced June 2020.

Comments: 20 pages (double column), 2 figures, 3 tables, 157 references

Exploration of the High Entropy Alloy Space as a Constraint Satisfaction Problem

Authors: Anas Abu-Odeh, Edgar Galvan, Tanner Kirk, Huahai Mao, Qing Chen, Paul Mason, Richard Malak, Raymundo Arroyave

Abstract: High Entropy Alloys (HEAs), Multi-principal Component Alloys (MCA), or Compositionally Complex Alloys (CCAs) are alloys that contain multiple principal alloying elements. While many HEAs have been shown to have unique properties, their discovery has been largely done through costly and time-consuming trial-and-error approaches, with only an infinitesimally small fraction of the entire possible com… ▽ More High Entropy Alloys (HEAs), Multi-principal Component Alloys (MCA), or Compositionally Complex Alloys (CCAs) are alloys that contain multiple principal alloying elements. While many HEAs have been shown to have unique properties, their discovery has been largely done through costly and time-consuming trial-and-error approaches, with only an infinitesimally small fraction of the entire possible composition space having been explored. In this work, the exploration of the HEA composition space is framed as a Continuous Constraint Satisfaction Problem (CCSP) and solved using a novel Constraint Satisfaction Algorithm (CSA) for the rapid and robust exploration of alloy thermodynamic spaces. The algorithm is used to discover regions in the HEA Composition-Temperature space that satisfy desired phase constitution requirements. The algorithm is demonstrated against a new (TCHEA1) CALPHAD HEA thermodynamic database. The database is first validated by comparing phase stability predictions against experiments and then the CSA is deployed and tested against design tasks consisting of identifying not only single phase solid solution regions in ternary, quaternary and quinary composition spaces but also the identification of regions that are likely to yield precipitation-strengthened HEAs. △ Less

Submitted 25 February, 2018; v1 submitted 6 December, 2017; originally announced December 2017.

Comments: 14 pages, 13 figures

The Behaviour of the Optical and X-ray Emission from Scorpius X-1

Authors: B. J. McNamara, T. E. Harrison, R. T. Zavala, Eduardo Galvan, Javier Galvan, T. Jarvis, GeeAnn Killgore, O. R. Mireles, D. Olivares, B. A. Rodriguez, M. Sanchez, Allison L. Silva, E. Silva-Velarde, M. R. Templeton

Abstract: In 1970, Hiltner & Mook reported the results of the first multiyear study of the optical emission from Sco X-1. They found that the Sco X-1 B-magnitude histograms changed from year to year. Subsequent multi-wavelength campaigns confirmed the variable nature of these optical histograms and also found that the X-ray and optical emissions were only correlated when Sco X-1 was brighter than about B… ▽ More In 1970, Hiltner & Mook reported the results of the first multiyear study of the optical emission from Sco X-1. They found that the Sco X-1 B-magnitude histograms changed from year to year. Subsequent multi-wavelength campaigns confirmed the variable nature of these optical histograms and also found that the X-ray and optical emissions were only correlated when Sco X-1 was brighter than about B = 12.6. Models had suggested that the optical emission from this source arose from X-rays reprocessed in an accretion disk surrounding the central neutron star. It was therefore difficult to explain why the optical and X-ray fluxes were not more closely correlated. In 1994 and 1995, two new simultaneous optical and X-ray campaigns on Sco X-1 were conducted with the Burst and Transient Source Experiment on the Compton Gamma Ray Observatory and the 1 m Yale telescope at Cerro Tololo Inter-American Observatory. Using these data and models by Psaltis, Lamb & Miller, it is now possible to provide a qualitative picture of how the X-ray and optical emissions from Sco X-1 are related. Differences in the B-magnitude histograms are caused by variations in the mass accretion rate and the relatively short time period usually covered by optical investigations. The tilted Gamma pattern seen in plots of the simultaneous X-ray and optical emission from Sco X-1 arises from (1) the nearly linear relation between the optical B magnitude and the mass accretion rate in the range 13.3 > B > 12.3 and an asymptotic behaviour in the B magnitude outside this range, and (2) a double-valued relation between the X-ray emission and mass accretion rate along the normal branch and the lower flaring branch of this source. △ Less

Submitted 25 February, 2003; originally announced February 2003.

Comments: Accepted to the Astronomical Journal: 7 pages, 3 figures

Journal ref: Astron.J. 125 (2003) 1437

The origin of cyclic period changes in close binaries: the case of the Algol binary WW Cygni

Authors: Robert T. Zavala, Bernard J. McNamara, Thomas E. Harrison, Eduardo Galvan, Javier Galvan, Thomas Jarvis, GeeAnn Killgore, Omar R. Mireles, Diana Olivares, Brian A. Rodriguez, Matthew Sanchez, Allison L. Silva, Andrea L. Silva, Elena Silva-Velarde

Abstract: Years to decade-long cyclic orbital period changes have been observed in several classes of close binary systems including Algols, W Ursae Majoris and RS Canum Venaticorum systems, and the cataclysmic variables. The origin of these changes is unknown, but mass loss, apsidal motion, magnetic activity, and the presence of a third body have all been proposed. In this paper we use new CCD observatio… ▽ More Years to decade-long cyclic orbital period changes have been observed in several classes of close binary systems including Algols, W Ursae Majoris and RS Canum Venaticorum systems, and the cataclysmic variables. The origin of these changes is unknown, but mass loss, apsidal motion, magnetic activity, and the presence of a third body have all been proposed. In this paper we use new CCD observations and the century-long historical record of the times of primary eclipse for WW Cygni to explore the cause of these period changes. WW Cygni is an Algol binary whose orbital period undergoes a 56 year cyclic variation with an amplitude of approximately 0.02 days. We consider and reject the hypotheses of mass transfer, mass loss, apsidal motion and the gravitational influence of an unseen companion as the cause for these changes. A model proposed by Applegate, which invokes changes in the gravitational quadrupole moment of the convective and rotating secondary star, is the most likely explanation of this star's orbital period changes. This finding is based on an examination of WW Cygni's residual O-C curve and an analysis of the period changes seen in 66 other Algols. Variations in the gravitational quadrupole moment are also considered to be the most likely explanation for the cyclic period changes observed in several different types of binary systems. △ Less

Submitted 7 March, 2002; originally announced March 2002.

Comments: Accepted to AJ, 23 pages, 7 postscript figures

Journal ref: AJ, 123, 2002 January, 450