-
Longitudinal Performance of Iris Recognition in Children: Time Intervals up to Six years
Authors:
Priyanka Das,
Naveen G Venkataswamy,
Laura Holsopple,
Masudul H Imtiaz,
Michael Schuckers,
Stephanie Schuckers
Abstract:
The temporal stability of iris recognition performance is core to its success as a biometric modality. With the expanding horizon of applications for children, gaps in the knowledge base on the temporal stability of iris recognition performance in children have impacted decision-making during applications at the global scale. This report presents the most extensive analysis of longitudinal iris re…
▽ More
The temporal stability of iris recognition performance is core to its success as a biometric modality. With the expanding horizon of applications for children, gaps in the knowledge base on the temporal stability of iris recognition performance in children have impacted decision-making during applications at the global scale. This report presents the most extensive analysis of longitudinal iris recognition performance in children with data from the same 230 children over 6.5 years between enrollment and query for ages 4 to 17 years. Assessment of match scores, statistical modelling of variability factors impacting match scores and in-depth assessment of the root causes of the false rejections concludes no impact on iris recognition performance due to aging.
△ Less
Submitted 9 March, 2023;
originally announced March 2023.
-
Statistical Methods for Assessing Differences in False Non-Match Rates Across Demographic Groups
Authors:
Michael Schuckers,
Sandip Purnapatra,
Kaniz Fatima,
Daqing Hou,
Stephanie Schuckers
Abstract:
Biometric recognition is used across a variety of applications from cyber security to border security. Recent research has focused on ensuring biometric performance (false negatives and false positives) is fair across demographic groups. While there has been significant progress on the development of metrics, the evaluation of the performance across groups, and the mitigation of any problems, ther…
▽ More
Biometric recognition is used across a variety of applications from cyber security to border security. Recent research has focused on ensuring biometric performance (false negatives and false positives) is fair across demographic groups. While there has been significant progress on the development of metrics, the evaluation of the performance across groups, and the mitigation of any problems, there has been little work incorporating statistical variation. This is important because differences among groups can be found by chance when no difference is present. In statistics this is called a Type I error. Differences among groups may be due to sampling variation or they may be due to actual difference in system performance. Discriminating between these two sources of error is essential for good decision making about fairness and equity. This paper presents two novel statistical approaches for assessing fairness across demographic groups. The first methodology is a bootstrapped-based hypothesis test, while the second is simpler test methodology focused upon non-statistical audience. For the latter we present the results of a simulation study about the relationship between the margin of error and factors such as number of subjects, number of attempts, correlation between attempts, underlying false non-match rates(FNMR's), and number of groups.
△ Less
Submitted 21 August, 2022;
originally announced August 2022.
-
What does not get observed can be used to make age curves stronger: estimating player age curves using regression and imputation
Authors:
Michael Schuckers,
Michael Lopez,
Brian Macdonald
Abstract:
The impact of player age on performance has received attention across sport. Most research has focused on the performance of players at each age, ignoring the reality that age likewise influences which players receive opportunities to perform. Our manuscript makes two contributions. First, we highlight how selection bias is linked to both (i) which players receive opportunity to perform in sport,…
▽ More
The impact of player age on performance has received attention across sport. Most research has focused on the performance of players at each age, ignoring the reality that age likewise influences which players receive opportunities to perform. Our manuscript makes two contributions. First, we highlight how selection bias is linked to both (i) which players receive opportunity to perform in sport, and (ii) at which ages we observe these players perform. This approach is used to generate underlying distributions of how players move in and out of sport organizations. Second, motivated by methods for missing data, we propose novel estimation methods of age curves by using both observed and unobserved (imputed) data. We use simulations to compare several comparative approaches for estimating aging curves. Imputation-based methods, as well as models that account for individual player skill, tend to generate lower RMSE and age curve shapes that better match the truth. We implement our approach using data from the National Hockey League.
△ Less
Submitted 3 February, 2023; v1 submitted 26 October, 2021;
originally announced October 2021.
-
Iris Recognition Performance in Children: A Longitudinal Study
Authors:
Priyanka Das,
Laura Holsopple,
Dan Rissacher,
Michael Schuckers,
Stephanie Schuckers
Abstract:
There is uncertainty around the effect of aging of children on biometric characteristics impacting applications relying on biometric recognition, particularly as the time between enrollment and query increases. Though there have been studies of such effects for iris recognition in adults, there have been few studies evaluating impact in children. This paper presents longitudinal analysis from 209…
▽ More
There is uncertainty around the effect of aging of children on biometric characteristics impacting applications relying on biometric recognition, particularly as the time between enrollment and query increases. Though there have been studies of such effects for iris recognition in adults, there have been few studies evaluating impact in children. This paper presents longitudinal analysis from 209 subjects aged 4 to 11 years at enrollment and six additional sessions over a period of 3 years. The influence of time, dilation and enrollment age on iris recognition have been analyzed and their statistical importance has been evaluated. A minor aging effect is noted which is statistically significant, but practically insignificant and is comparatively less important than other variability factors. Practical biometric applications of iris recognition in children are feasible for a time frame of at least 3 years between samples, for ages 4 to 11 years, even in presence of aging, though we note practical difficulties in enrolling young children with cameras not designed for the purpose. To the best of our knowledge, the database used in this study is the only dataset of longitudinal iris images from children for this age group and time period that is available for research.
△ Less
Submitted 15 January, 2021;
originally announced January 2021.
-
Analysis of Dilation in Children and its Impact on Iris Recognition
Authors:
Priyanka Das,
Laura Holsopple,
Michael Schuckers,
Stephanie Schuckers
Abstract:
The dilation of the pupil and it's variation between a mated pair of irides has been found to be an important factor in the performance of iris recognition systems. Studies on adult irides indicated significant impact of dilation on iris recognition performance at different ages. However, the results of adults may not necessarily translate to children. This study analyzes dilation as a factor of a…
▽ More
The dilation of the pupil and it's variation between a mated pair of irides has been found to be an important factor in the performance of iris recognition systems. Studies on adult irides indicated significant impact of dilation on iris recognition performance at different ages. However, the results of adults may not necessarily translate to children. This study analyzes dilation as a factor of age and over time in children, from data collected from same 209 subjects in the age group of four to 11 years at enrollment, longitudinally over three years spaced by six months. The performance of iris recognition is also analyzed in presence of dilation variation.
△ Less
Submitted 1 September, 2020;
originally announced September 2020.
-
Accounting for Rink Effects in the National Hockey League's Real Time Scoring System
Authors:
Michael Schuckers,
Brian Macdonald
Abstract:
Recording of events in National Hockey League rinks is done through the Real Time Scoring System. This system records events such as hits, shots, faceoffs, etc., as part of the play-by-play files that are made publicly available. Several previous studies have found that there are inconsistencies in the recording of these events from rink to rink. In this paper, we propose a methodology for estimat…
▽ More
Recording of events in National Hockey League rinks is done through the Real Time Scoring System. This system records events such as hits, shots, faceoffs, etc., as part of the play-by-play files that are made publicly available. Several previous studies have found that there are inconsistencies in the recording of these events from rink to rink. In this paper, we propose a methodology for estimation of the rink effects for each of the rinks in the National Hockey League. Our aim is to build a model which accounts for the relative differences between rinks. We use log-linear regression to model counts of events per game with several predictors including team factors and average score differential. The estimated rink effects can be used to reweight recorded events so that can have comparable counts of events across rinks. Applying our methodology to data from six regular seasons, we find that there are some rinks with rink effects that are significant and consistent across these seasons for multiple events.
△ Less
Submitted 2 December, 2014;
originally announced December 2014.
-
You Can Beat the Market: Estimating the Return on Investment for National Hockey League (NHL) Team Scouting using a Draft Value Pick Chart for the NHL
Authors:
Michael Schuckers,
Steve Argeris
Abstract:
Scouting is a major part of talent acquisition for any professional sports team. In the National Hockey League (NHL), the market for scouting is set by the NHLs Central Scouting Service which develops a ranking of draft eligible players. In addition to the Central Scouting rankings, NHL teams use their own internal scouting to augment their knowledge of eligible players and develop their own ranki…
▽ More
Scouting is a major part of talent acquisition for any professional sports team. In the National Hockey League (NHL), the market for scouting is set by the NHLs Central Scouting Service which develops a ranking of draft eligible players. In addition to the Central Scouting rankings, NHL teams use their own internal scouting to augment their knowledge of eligible players and develop their own rankings. Using a novel statistical approach we show in this paper that the additional information possessed by teams provides better rankings than those of Central Scouting. Using data from the 1998 to 2002 NHL drafts, we estimate that the average yearly gain per team from their internal scouting is between \$1.8MM and \$5.2MM. These values are consistent across the three measures of player productivity that we consider: cumulative Games Played, cumulative Time On Ice and cumulative Goals Versus Threshold where we have aggregated these metrics across the first seven years post draft. We used this time frame since teams generally retain rights to their draft picks for seven years. Further, we find that no individual team outperformed the others in terms of draft performance. One byproduct of our analysis is the development of a Draft Value Pick Chart to assess the worth of an individual selection.
△ Less
Submitted 20 November, 2014;
originally announced November 2014.
