-
Large scale response of a vehicle wake to on-road perturbations
Authors:
Cembalo Agostino,
Borée Jacques,
Coirault Patrick,
Dumand Clément
Abstract:
The aim of this research work is to analyse the large scale response of a vehicle wake to on-road perturbations by using an instrumented vehicle and a combination of scale one wind tunnel tests, track trials and on road experiments. More precisely, in all these tests, we focus on the analysis of the asymmetry of the pressure distribution at the base. Proper Orthogonal Decomposition (POD) is used.…
▽ More
The aim of this research work is to analyse the large scale response of a vehicle wake to on-road perturbations by using an instrumented vehicle and a combination of scale one wind tunnel tests, track trials and on road experiments. More precisely, in all these tests, we focus on the analysis of the asymmetry of the pressure distribution at the base. Proper Orthogonal Decomposition (POD) is used. For all cases considered, POD analysis reveals two dominant modes, respectively associated with vertical and horizontal wake large scale reorganisation. More than 50\% of the total energy is carried by these two modes and this value increases significantly for on-road tests. Noteworthy, the low-frequency energy content of the temporal coefficients of these modes is significantly higher on-road. Low frequencies (even very low ones) then play a major role, corresponding to a quasi-static perturbation domain of the velocity seen by the vehicle. We show that a quasi-steady exploration of the on-road yaw angle statistical distribution during a wind tunnel test captures phenomena similar to those observed on the road and is therefore interesting to evaluate on-road aerodynamic performances. This also opens perspectives for develo** closed loop control strategies aiming to maintain a prescribed wake balance in order to reduce drag experienced on the road.
△ Less
Submitted 4 July, 2024;
originally announced July 2024.
-
An Integrated Framework for Team Formation and Winner Prediction in the FIRST Robotics Competition: Model, Algorithm, and Analysis
Authors:
Federico Galbiati,
Ranier X. Gran,
Brendan D. Jacques,
Sullivan J. Mulhern,
Chun-Kit Ngan
Abstract:
This research work aims to develop an analytical approach for optimizing team formation and predicting team performance in a competitive environment based on data on the competitors' skills prior to the team formation. There are several approaches in scientific literature to optimize and predict a team's performance. However, most studies employ fine-grained skill statistics of the individual memb…
▽ More
This research work aims to develop an analytical approach for optimizing team formation and predicting team performance in a competitive environment based on data on the competitors' skills prior to the team formation. There are several approaches in scientific literature to optimize and predict a team's performance. However, most studies employ fine-grained skill statistics of the individual members or constraints such as teams with a set group of members. Currently, no research tackles the highly constrained domain of the FIRST Robotics Competition. This research effort aims to fill this gap by providing an analytical method for optimizing and predicting team performance in a competitive environment while allowing these constraints and only using metrics on previous team performance, not on each individual member's performance. We apply our method to the drafting process of the FIRST Robotics competition, a domain in which the skills change year-over-year, team members change throughout the season, each match only has a superficial set of statistics, and alliance formation is key to competitive success. First, we develop a method that could extrapolate individual members' performance based on overall team performance. An alliance optimization algorithm is developed to optimize team formation and a deep neural network model is trained to predict the winning team, both using highly post-processed real-world data. Our method is able to successfully extract individual members' metrics from overall team statistics, form competitive teams, and predict the winning team with 84.08% accuracy.
△ Less
Submitted 6 January, 2024;
originally announced February 2024.
-
The Canadian Cropland Dataset: A New Land Cover Dataset for Multitemporal Deep Learning Classification in Agriculture
Authors:
Amanda A. Boatswain Jacques,
Abdoulaye Baniré Diallo,
Etienne Lord
Abstract:
Monitoring land cover using remote sensing is vital for studying environmental changes and ensuring global food security through crop yield forecasting. Specifically, multitemporal remote sensing imagery provides relevant information about the dynamics of a scene, which has proven to lead to better land cover classification results. Nevertheless, few studies have benefited from high spatial and te…
▽ More
Monitoring land cover using remote sensing is vital for studying environmental changes and ensuring global food security through crop yield forecasting. Specifically, multitemporal remote sensing imagery provides relevant information about the dynamics of a scene, which has proven to lead to better land cover classification results. Nevertheless, few studies have benefited from high spatial and temporal resolution data due to the difficulty of accessing reliable, fine-grained and high-quality annotated samples to support their hypotheses. Therefore, we introduce a temporal patch-based dataset of Canadian croplands, enriched with labels retrieved from the Canadian Annual Crop Inventory. The dataset contains 78,536 manually verified high-resolution (10 m/pixel, 640 x 640 m) geo-referenced images from 10 crop classes collected over four crop production years (2017-2020) and five months (June-October). Each instance contains 12 spectral bands, an RGB image, and additional vegetation index bands. Individually, each category contains at least 4,800 images. Moreover, as a benchmark, we provide models and source code that allow a user to predict the crop class using a single image (ResNet, DenseNet, EfficientNet) or a sequence of images (LRCN, 3D-CNN) from the same location. In perspective, we expect this evolving dataset to propel the creation of robust agro-environmental models that can accelerate the comprehension of complex agricultural regions by providing accurate and continuous monitoring of land cover.
△ Less
Submitted 4 June, 2023; v1 submitted 31 May, 2023;
originally announced June 2023.
-
A deep convolutional neural network that is invariant to time rescaling
Authors:
Brandon G. Jacques,
Zoran Tiganj,
Aakash Sarkar,
Marc W. Howard,
Per B. Sederberg
Abstract:
Human learners can readily understand speech, or a melody, when it is presented slower or faster than usual. Although deep convolutional neural networks (CNNs) are extremely powerful in extracting information from time series, they require explicit training to generalize to different time scales. This paper presents a deep CNN that incorporates a temporal representation inspired by recent findings…
▽ More
Human learners can readily understand speech, or a melody, when it is presented slower or faster than usual. Although deep convolutional neural networks (CNNs) are extremely powerful in extracting information from time series, they require explicit training to generalize to different time scales. This paper presents a deep CNN that incorporates a temporal representation inspired by recent findings from neuroscience. In the mammalian brain, time is represented by populations of neurons with temporal receptive fields. Critically, the peaks of the receptive fields form a geometric series, such that the population codes a set of temporal basis functions over log time. Because memory for the recent past is a function of log time, rescaling the input results in translation of the memory. The Scale-Invariant Temporal History Convolution network (SITHCon) builds a convolutional layer over this logarithmically-distributed temporal memory. A max-pool operation results in a network that is invariant to rescalings of time modulo edge effects. We compare performance of SITHCon to a Temporal Convolution Network (TCN). Although both networks can learn classification and regression problems on both univariate and multivariate time series f(t), only SITHCon generalizes to rescalings f(at). This property, inspired by findings from contemporary neuroscience and consistent with findings from cognitive psychology, may enable networks that learn with fewer training examples, fewer weights and that generalize more robustly to out of sample data.
△ Less
Submitted 29 June, 2022; v1 submitted 9 July, 2021;
originally announced July 2021.
-
DeepSITH: Efficient Learning via Decomposition of What and When Across Time Scales
Authors:
Brandon Jacques,
Zoran Tiganj,
Marc W. Howard,
Per B. Sederberg
Abstract:
Extracting temporal relationships over a range of scales is a hallmark of human perception and cognition -- and thus it is a critical feature of machine learning applied to real-world problems. Neural networks are either plagued by the exploding/vanishing gradient problem in recurrent neural networks (RNNs) or must adjust their parameters to learn the relevant time scales (e.g., in LSTMs). This pa…
▽ More
Extracting temporal relationships over a range of scales is a hallmark of human perception and cognition -- and thus it is a critical feature of machine learning applied to real-world problems. Neural networks are either plagued by the exploding/vanishing gradient problem in recurrent neural networks (RNNs) or must adjust their parameters to learn the relevant time scales (e.g., in LSTMs). This paper introduces DeepSITH, a network comprising biologically-inspired Scale-Invariant Temporal History (SITH) modules in series with dense connections between layers. SITH modules respond to their inputs with a geometrically-spaced set of time constants, enabling the DeepSITH network to learn problems along a continuum of time-scales. We compare DeepSITH to LSTMs and other recent RNNs on several time series prediction and decoding tasks. DeepSITH achieves state-of-the-art performance on these problems.
△ Less
Submitted 26 October, 2021; v1 submitted 9 April, 2021;
originally announced April 2021.
-
Reduction of Spikes on the Sides of Patterned Thin Films for Magnetic Tunnel Junction Based Molecular Device Fabrication
Authors:
Pawan Tyagi,
Edward Friebe,
Beachrhell Jacques,
Tobias Goulet,
Stanley Travers
Abstract:
Sputter thin film deposition after photolithography often produces unwanted spikes along the side edges. These spikes are a significant issue for the development of magnetic tunnel junction (MTJ)-based memory and molecular spintronics devices, microelectronics, and micro-electro-mechanical systems because they influence the properties of the other films deposited on the top. Our molecular spintron…
▽ More
Sputter thin film deposition after photolithography often produces unwanted spikes along the side edges. These spikes are a significant issue for the development of magnetic tunnel junction (MTJ)-based memory and molecular spintronics devices, microelectronics, and micro-electro-mechanical systems because they influence the properties of the other films deposited on the top. Our molecular spintronics devices that utilize MTJ as the testbed are almost short-lived and encountered high background current that masked the effect of molecular transport channels placed along the sides of MTJs. Therefore, tapered thin film edges are critically needed in devices. Here, we report a very cost-efficient and fast way of creating an optimum photoresist profile for the production of spike-free patterned films. This approach is based on performing a soaking in the photoresist developer after baking and before the UV exposure. However, the success of this method depends on multiple factors accounted for during photolithography - photoresist thickness (spin speed), baking temperature, soaking time and exposure time. Our recent experiments systematically studied the effect of these factors by following the L9 experimental scheme of the Taguchi Design of the experiment (TDOE). We discovered that baking temperature was the most influential parameter; presoak time and photoresist thickness were two other influential factors; exposure time was the least effective factor. We also found that 4000 rpm, 100 C soft baking, 60 s soaking, and 15 s UV exposure yielded the best results. Finally, the paper also discusses the interdependence of selected factors, and the impact of the individual levels of each factor. This study is expected to benefit MEMS and micro/nanoelectronics device researchers because it attempts at finding a cheaper and faster alternative to creating an optimum photoresist profile.
△ Less
Submitted 3 December, 2019;
originally announced December 2019.
-
Scale-invariant temporal history (SITH): optimal slicing of the past in an uncertain world
Authors:
Tyler A. Spears,
Brandon G. Jacques,
Marc W. Howard,
Per B. Sederberg
Abstract:
In both the human brain and any general artificial intelligence (AI), a representation of the past is necessary to predict the future. However, perfect storage of all experiences is not feasible. One approach utilized in many applications, including reward prediction in reinforcement learning, is to retain recently active features of experience in a buffer. Despite its prior successes, we show tha…
▽ More
In both the human brain and any general artificial intelligence (AI), a representation of the past is necessary to predict the future. However, perfect storage of all experiences is not feasible. One approach utilized in many applications, including reward prediction in reinforcement learning, is to retain recently active features of experience in a buffer. Despite its prior successes, we show that the fixed length buffer renders Deep Q-learning Networks (DQNs) fragile to changes in the scale over which information can be learned. To enable learning when the relevant temporal scales in the environment are not known *a priori*, recent advances in psychology and neuroscience suggest that the brain maintains a compressed representation of the past. Here we introduce a neurally-plausible, scale-free memory representation we call Scale-Invariant Temporal History (SITH) for use with artificial agents. This representation covers an exponentially large period of time by sacrificing temporal accuracy for events further in the past. We demonstrate the utility of this representation by comparing the performance of agents given SITH, buffer, and exponential decay representations in learning to play video games at different levels of complexity. In these environments, SITH exhibits better learning performance by storing information for longer timescales than a fixed-size buffer, and representing this information more clearly than a set of exponentially decayed features. Finally, we discuss how the application of SITH, along with other human-inspired models of cognition, could improve reinforcement and machine learning algorithms in general.
△ Less
Submitted 18 December, 2018; v1 submitted 19 December, 2017;
originally announced December 2017.
-
Random effects compound Poisson model to represent data with extra zeros
Authors:
Marie-Pierre Etienne,
Eric Parent,
Benoit Hugues,
Bernier Jacques
Abstract:
This paper describes a compound Poisson-based random effects structure for modeling zero-inflated data. Data with large proportion of zeros are found in many fields of applied statistics, for example in ecology when trying to model and predict species counts (discrete data) or abundance distributions (continuous data). Standard methods for modeling such data include mixture and two-part conditio…
▽ More
This paper describes a compound Poisson-based random effects structure for modeling zero-inflated data. Data with large proportion of zeros are found in many fields of applied statistics, for example in ecology when trying to model and predict species counts (discrete data) or abundance distributions (continuous data). Standard methods for modeling such data include mixture and two-part conditional models. Conversely to these methods, the stochastic models proposed here behave coherently with regards to a change of scale, since they mimic the harvesting of a marked Poisson process in the modeling steps. Random effects are used to account for inhomogeneity. In this paper, model design and inference both rely on conditional thinking to understand the links between various layers of quantities : parameters, latent variables including random effects and zero-inflated observations. The potential of these parsimonious hierarchical models for zero-inflated data is exemplified using two marine macroinvertebrate abundance datasets from a large scale scientific bottom-trawl survey. The EM algorithm with a Monte Carlo step based on importance sampling is checked for this model structure on a simulated dataset : it proves to work well for parameter estimation but parameter values matter when re-assessing the actual coverage level of the confidence regions far from the asymptotic conditions.
△ Less
Submitted 28 July, 2009;
originally announced July 2009.