-
Moment-Type Estimators for the Dirichlet and the Multivariate Gamma Distributions
Authors:
Ioannis Oikonomidis,
Samis Trevezas
Abstract:
This study presents new closed-form estimators for the Dirichlet and the Multivariate Gamma distribution families, whose maximum likelihood estimator cannot be explicitly derived. The methodology builds upon the score-adjusted estimators for the Beta and Gamma distributions, extending their applicability to the Dirichlet and Multivariate Gamma distributions. Expressions for the asymptotic variance…
▽ More
This study presents new closed-form estimators for the Dirichlet and the Multivariate Gamma distribution families, whose maximum likelihood estimator cannot be explicitly derived. The methodology builds upon the score-adjusted estimators for the Beta and Gamma distributions, extending their applicability to the Dirichlet and Multivariate Gamma distributions. Expressions for the asymptotic variance-covariance matrices are provided, demonstrating the superior performance of score-adjusted estimators over the traditional moment ones. Leveraging well-established connections between Dirichlet and Multivariate Gamma distributions, a novel class of estimators for the latter is introduced, referred to as "Dirichlet-based moment-type estimators". The general asymptotic variance-covariance matrix form for this estimator class is derived. To facilitate the application of these innovative estimators, an R package called estimators is developed and made publicly available.
△ Less
Submitted 25 November, 2023;
originally announced November 2023.
-
Cumulative Link Mixed-Effects Models in the Service of Remote Sensing Crop Progress Monitoring
Authors:
Ioannis Oikonomidis,
Samis Trevezas
Abstract:
This study introduces an innovative Cumulative Link Modeling approach to monitor crop progress over large areas using remote sensing data. The models utilize the predictive attributes of calendar time, thermal time, and the Normalized Difference Vegetation Index (NDVI). Two distinct issues are tackled: real-time crop progress prediction, and completed season fitting. In the context of prediction,…
▽ More
This study introduces an innovative Cumulative Link Modeling approach to monitor crop progress over large areas using remote sensing data. The models utilize the predictive attributes of calendar time, thermal time, and the Normalized Difference Vegetation Index (NDVI). Two distinct issues are tackled: real-time crop progress prediction, and completed season fitting. In the context of prediction, the study presents two model variations, the standard one based on the Multinomial distribution and a novel one based on the Multivariate Binomial distribution. In the context of fitting, random effects are incorporated to capture the inherent inter-seasonal variability, allowing the estimation of biological parameters that govern crop development and determine stage completion requirements. Theoretical properties in terms of consistency, asymptotic normality, and distribution-misspecification are reviewed. Model performance was evaluated on eight crops, namely corn, oats, sorghum, soybeans, winter wheat, alfalfa, dry beans, and millet, using in-situ data from Nebraska, USA, spanning a 20-year period. The results demonstrate the wide applicability of this approach to different crops, providing real-time predictions of crop progress worldwide, solely utilizing open-access data. To facilitate implementation, an ecosystem of R packages has been developed and made publicly accessible under the name Ages of Man.
△ Less
Submitted 28 August, 2023;
originally announced August 2023.
-
Multi-view Image-based Hand Geometry Refinement using Differentiable Monte Carlo Ray Tracing
Authors:
Giorgos Karvounas,
Nikolaos Kyriazis,
Iason Oikonomidis,
Aggeliki Tsoli,
Antonis A. Argyros
Abstract:
The amount and quality of datasets and tools available in the research field of hand pose and shape estimation act as evidence to the significant progress that has been made.However, even the datasets of the highest quality, reported to date, have shortcomings in annotation. We propose a refinement approach, based on differentiable ray tracing,and demonstrate how a high-quality publicly available,…
▽ More
The amount and quality of datasets and tools available in the research field of hand pose and shape estimation act as evidence to the significant progress that has been made.However, even the datasets of the highest quality, reported to date, have shortcomings in annotation. We propose a refinement approach, based on differentiable ray tracing,and demonstrate how a high-quality publicly available, multi-camera dataset of hands(InterHand2.6M) can become an even better dataset, with respect to annotation quality. Differentiable ray tracing has not been employed so far to relevant problems and is hereby shown to be superior to the approximative alternatives that have been employed in the past. To tackle the lack of reliable ground truth, as far as quantitative evaluation is concerned, we resort to realistic synthetic data, to show that the improvement we induce is indeed significant. The same becomes evident in real data through visual evaluation.
△ Less
Submitted 7 January, 2022; v1 submitted 12 July, 2021;
originally announced July 2021.
-
Even Faster SNN Simulation with Lazy+Event-driven Plasticity and Shared Atomics
Authors:
Dennis Bautembach,
Iason Oikonomidis,
Antonis Argyros
Abstract:
We present two novel optimizations that accelerate clock-based spiking neural network (SNN) simulators. The first one targets spike timing dependent plasticity (STDP). It combines lazy- with event-driven plasticity and efficiently facilitates the computation of pre- and post-synaptic spikes using bitfields and integer intrinsics. It offers higher bandwidth than event-driven plasticity alone and ac…
▽ More
We present two novel optimizations that accelerate clock-based spiking neural network (SNN) simulators. The first one targets spike timing dependent plasticity (STDP). It combines lazy- with event-driven plasticity and efficiently facilitates the computation of pre- and post-synaptic spikes using bitfields and integer intrinsics. It offers higher bandwidth than event-driven plasticity alone and achieves a 1.5x-2x speedup over our closest competitor. The second optimization targets spike delivery. We partition our graph representation in a way that bounds the number of neurons that need be updated at any given time which allows us to perform said update in shared memory instead of global memory. This is 2x-2.5x faster than our closest competitor. Both optimizations represent the final evolutionary stages of years of iteration on STDP and spike delivery inside "Spice" (/spaIk/), our state of the art SNN simulator. The proposed optimizations are not exclusive to our graph representation or pipeline but are applicable to a multitude of simulator designs. We evaluate our performance on three well-established models and compare ourselves against three other state of the art simulators.
△ Less
Submitted 23 August, 2021; v1 submitted 8 July, 2021;
originally announced July 2021.
-
H-GAN: the power of GANs in your Hands
Authors:
Sergiu Oprea,
Giorgos Karvounas,
Pablo Martinez-Gonzalez,
Nikolaos Kyriazis,
Sergio Orts-Escolano,
Iason Oikonomidis,
Alberto Garcia-Garcia,
Aggeliki Tsoli,
Jose Garcia-Rodriguez,
Antonis Argyros
Abstract:
We present HandGAN (H-GAN), a cycle-consistent adversarial learning approach implementing multi-scale perceptual discriminators. It is designed to translate synthetic images of hands to the real domain. Synthetic hands provide complete ground-truth annotations, yet they are not representative of the target distribution of real-world data. We strive to provide the perfect blend of a realistic hand…
▽ More
We present HandGAN (H-GAN), a cycle-consistent adversarial learning approach implementing multi-scale perceptual discriminators. It is designed to translate synthetic images of hands to the real domain. Synthetic hands provide complete ground-truth annotations, yet they are not representative of the target distribution of real-world data. We strive to provide the perfect blend of a realistic hand appearance with synthetic annotations. Relying on image-to-image translation, we improve the appearance of synthetic hands to approximate the statistical distribution underlying a collection of real images of hands. H-GAN tackles not only the cross-domain tone map** but also structural differences in localized areas such as shading discontinuities. Results are evaluated on a qualitative and quantitative basis improving previous works. Furthermore, we relied on the hand classification task to claim our generated hands are statistically similar to the real domain of hands.
△ Less
Submitted 21 April, 2021; v1 submitted 27 March, 2021;
originally announced March 2021.
-
Multi-GPU SNN Simulation with Static Load Balancing
Authors:
Dennis Bautembach,
Iason Oikonomidis,
Antonis Argyros
Abstract:
We present a SNN simulator which scales to millions of neurons, billions of synapses, and 8 GPUs. This is made possible by 1) a novel, cache-aware spike transmission algorithm 2) a model parallel multi-GPU distribution scheme and 3) a static, yet very effective load balancing strategy. The simulator further features an easy to use API and the ability to create custom models. We compare the propose…
▽ More
We present a SNN simulator which scales to millions of neurons, billions of synapses, and 8 GPUs. This is made possible by 1) a novel, cache-aware spike transmission algorithm 2) a model parallel multi-GPU distribution scheme and 3) a static, yet very effective load balancing strategy. The simulator further features an easy to use API and the ability to create custom models. We compare the proposed simulator against two state of the art ones on a series of benchmarks using three well-established models. We find that our simulator is faster, consumes less memory, and scales linearly with the number of GPUs.
△ Less
Submitted 22 April, 2021; v1 submitted 9 February, 2021;
originally announced February 2021.
-
Faster and Simpler SNN Simulation with Work Queues
Authors:
Dennis Bautembach,
Iason Oikonomidis,
Nikolaos Kyriazis,
Antonis Argyros
Abstract:
We present a clock-driven Spiking Neural Network simulator which is up to 3x faster than the state of the art while, at the same time, being more general and requiring less programming effort on both the user's and maintainer's side. This is made possible by designing our pipeline around "work queues" which act as interfaces between stages and greatly reduce implementation complexity. We evaluate…
▽ More
We present a clock-driven Spiking Neural Network simulator which is up to 3x faster than the state of the art while, at the same time, being more general and requiring less programming effort on both the user's and maintainer's side. This is made possible by designing our pipeline around "work queues" which act as interfaces between stages and greatly reduce implementation complexity. We evaluate our work using three well-established SNN models on a series of benchmarks.
△ Less
Submitted 24 May, 2020; v1 submitted 16 December, 2019;
originally announced December 2019.
-
ReActNet: Temporal Localization of Repetitive Activities in Real-World Videos
Authors:
Giorgos Karvounas,
Iason Oikonomidis,
Antonis Argyros
Abstract:
We address the problem of temporal localization of repetitive activities in a video, i.e., the problem of identifying all segments of a video that contain some sort of repetitive or periodic motion. To do so, the proposed method represents a video by the matrix of pairwise frame distances. These distances are computed on frame representations obtained with a convolutional neural network. On top of…
▽ More
We address the problem of temporal localization of repetitive activities in a video, i.e., the problem of identifying all segments of a video that contain some sort of repetitive or periodic motion. To do so, the proposed method represents a video by the matrix of pairwise frame distances. These distances are computed on frame representations obtained with a convolutional neural network. On top of this representation, we design, implement and evaluate ReActNet, a lightweight convolutional neural network that classifies a given frame as belonging (or not) to a repetitive video segment. An important property of the employed representation is that it can handle repetitive segments of arbitrary number and duration. Furthermore, the proposed training process requires a relatively small number of annotated videos. Our method raises several of the limiting assumptions of existing approaches regarding the contents of the video and the types of the observed repetitive activities. Experimental results on recent, publicly available datasets validate our design choices, verify the generalization potential of ReActNet and demonstrate its superior performance in comparison to the current state of the art.
△ Less
Submitted 14 October, 2019;
originally announced October 2019.
-
Accurate Hand Keypoint Localization on Mobile Devices
Authors:
Filippos Gouidis,
Paschalis Panteleris,
Iason Oikonomidis,
Antonis Argyros
Abstract:
We present a novel approach for 2D hand keypoint localization from regular color input. The proposed approach relies on an appropriately designed Convolutional Neural Network (CNN) that computes a set of heatmaps, one per hand keypoint of interest. Extensive experiments with the proposed method compare it against state of the art approaches and demonstrate its accuracy and computational performanc…
▽ More
We present a novel approach for 2D hand keypoint localization from regular color input. The proposed approach relies on an appropriately designed Convolutional Neural Network (CNN) that computes a set of heatmaps, one per hand keypoint of interest. Extensive experiments with the proposed method compare it against state of the art approaches and demonstrate its accuracy and computational performance on standard, publicly available datasets. The obtained results demonstrate that the proposed method matches or outperforms the competing methods in accuracy, but clearly outperforms them in computational efficiency, making it a suitable building block for applications that require hand keypoint estimation on mobile devices.
△ Less
Submitted 19 December, 2018;
originally announced December 2018.
-
Learning to Infer the Depth Map of a Hand from its Color Image
Authors:
Vassilis C. Nicodemou,
Iason Oikonomidis,
Georgios Tzimiropoulos,
Antonis Argyros
Abstract:
We propose the first approach to the problem of inferring the depth map of a human hand based on a single RGB image. We achieve this with a Convolutional Neural Network (CNN) that employs a stacked hourglass model as its main building block. Intermediate supervision is used in several outputs of the proposed architecture in a staged approach. To aid the process of training and inference, hand segm…
▽ More
We propose the first approach to the problem of inferring the depth map of a human hand based on a single RGB image. We achieve this with a Convolutional Neural Network (CNN) that employs a stacked hourglass model as its main building block. Intermediate supervision is used in several outputs of the proposed architecture in a staged approach. To aid the process of training and inference, hand segmentation masks are also estimated in such an intermediate supervision step, and used to guide the subsequent depth estimation process. In order to train and evaluate the proposed method we compile and make publicly available HandRGBD, a new dataset of 20,601 views of hands, each consisting of an RGB image and an aligned depth map. Based on HandRGBD, we explore variants of the proposed approach in an ablative study and determine the best performing one. The results of an extensive experimental evaluation demonstrate that hand depth estimation from a single RGB frame can be achieved with an accuracy of 22mm, which is comparable to the accuracy achieved by contemporary low-cost depth cameras. Such a 3D reconstruction of hands based on RGB information is valuable as a final result on its own right, but also as an input to several other hand analysis and perception algorithms that require depth input. Essentially, in such a context, the proposed approach bridges the gap between RGB and RGBD, by making all existing RGBD-based methods applicable to RGB input.
△ Less
Submitted 6 December, 2018;
originally announced December 2018.
-
HANDS18: Methods, Techniques and Applications for Hand Observation
Authors:
Iason Oikonomidis,
Guillermo Garcia-Hernando,
Angela Yao,
Antonis Argyros,
Vincent Lepetit,
Tae-Kyun Kim
Abstract:
This report outlines the proceedings of the Fourth International Workshop on Observing and Understanding Hands in Action (HANDS 2018). The fourth instantiation of this workshop attracted significant interest from both academia and the industry. The program of the workshop included regular papers that are published as the workshop's proceedings, extended abstracts, invited posters, and invited talk…
▽ More
This report outlines the proceedings of the Fourth International Workshop on Observing and Understanding Hands in Action (HANDS 2018). The fourth instantiation of this workshop attracted significant interest from both academia and the industry. The program of the workshop included regular papers that are published as the workshop's proceedings, extended abstracts, invited posters, and invited talks. Topics of the submitted works and invited talks and posters included novel methods for hand pose estimation from RGB, depth, or skeletal data, datasets for special cases and real-world applications, and techniques for hand motion re-targeting and hand gesture recognition. The invited speakers are leaders in their respective areas of specialization, coming from both industry and academia. The main conclusions that can be drawn are the turn of the community towards RGB data and the maturation of some methods and techniques, which in turn has led to increasing interest for real-world applications.
△ Less
Submitted 25 October, 2018;
originally announced October 2018.
-
Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Authors:
Shanxin Yuan,
Guillermo Garcia-Hernando,
Bjorn Stenger,
Gyeongsik Moon,
Ju Yong Chang,
Kyoung Mu Lee,
Pavlo Molchanov,
Jan Kautz,
Sina Honari,
Liuhao Ge,
Junsong Yuan,
Xinghao Chen,
Gui** Wang,
Fan Yang,
Kai Akiyama,
Yang Wu,
Qingfu Wan,
Meysam Madadi,
Sergio Escalera,
Shile Li,
Dongheui Lee,
Iason Oikonomidis,
Antonis Argyros,
Tae-Kyun Kim
Abstract:
In this paper, we strive to answer two questions: What is the current state of 3D hand pose estimation from depth images? And, what are the next challenges that need to be tackled? Following the successful Hands In the Million Challenge (HIM2017), we investigate the top 10 state-of-the-art methods on three tasks: single frame 3D pose estimation, 3D hand tracking, and hand pose estimation during ob…
▽ More
In this paper, we strive to answer two questions: What is the current state of 3D hand pose estimation from depth images? And, what are the next challenges that need to be tackled? Following the successful Hands In the Million Challenge (HIM2017), we investigate the top 10 state-of-the-art methods on three tasks: single frame 3D pose estimation, 3D hand tracking, and hand pose estimation during object interaction. We analyze the performance of different CNN structures with regard to hand shape, joint visibility, view point and articulation distributions. Our findings include: (1) isolated 3D hand pose estimation achieves low mean errors (10 mm) in the view point range of [70, 120] degrees, but it is far from being solved for extreme view points; (2) 3D volumetric representations outperform 2D CNNs, better capturing the spatial structure of the depth data; (3) Discriminative methods still generalize poorly to unseen hand shapes; (4) While joint occlusions pose a challenge for most methods, explicit modeling of structure constraints can significantly narrow the gap between errors on visible and occluded joints.
△ Less
Submitted 29 March, 2018; v1 submitted 11 December, 2017;
originally announced December 2017.
-
Using a single RGB frame for real time 3D hand pose estimation in the wild
Authors:
Paschalis Panteleris,
Iason Oikonomidis,
Antonis Argyros
Abstract:
We present a method for the real-time estimation of the full 3D pose of one or more human hands using a single commodity RGB camera. Recent work in the area has displayed impressive progress using RGBD input. However, since the introduction of RGBD sensors, there has been little progress for the case of monocular color input. We capitalize on the latest advancements of deep learning, combining the…
▽ More
We present a method for the real-time estimation of the full 3D pose of one or more human hands using a single commodity RGB camera. Recent work in the area has displayed impressive progress using RGBD input. However, since the introduction of RGBD sensors, there has been little progress for the case of monocular color input. We capitalize on the latest advancements of deep learning, combining them with the power of generative hand pose estimation techniques to achieve real-time monocular 3D hand pose estimation in unrestricted scenarios. More specifically, given an RGB image and the relevant camera calibration information, we employ a state-of-the-art detector to localize hands. Given a crop of a hand in the image, we run the pretrained network of OpenPose for hands to estimate the 2D location of hand joints. Finally, non-linear least-squares minimization fits a 3D model of the hand to the estimated 2D joint positions, recovering the 3D hand pose. Extensive experimental results provide comparison to the state of the art as well as qualitative assessment of the method in the wild.
△ Less
Submitted 11 December, 2017;
originally announced December 2017.
