-
HMP: Hand Motion Priors for Pose and Shape Estimation from Video
Authors:
Enes Duran,
Muhammed Kocabas,
Vasileios Choutas,
Zicong Fan,
Michael J. Black
Abstract:
Understanding how humans interact with the world necessitates accurate 3D hand pose estimation, a task complicated by the hand's high degree of articulation, frequent occlusions, self-occlusions, and rapid motions. While most existing methods rely on single-image inputs, videos have useful cues to address aforementioned issues. However, existing video-based 3D hand datasets are insufficient for tr…
▽ More
Understanding how humans interact with the world necessitates accurate 3D hand pose estimation, a task complicated by the hand's high degree of articulation, frequent occlusions, self-occlusions, and rapid motions. While most existing methods rely on single-image inputs, videos have useful cues to address aforementioned issues. However, existing video-based 3D hand datasets are insufficient for training feedforward models to generalize to in-the-wild scenarios. On the other hand, we have access to large human motion capture datasets which also include hand motions, e.g. AMASS. Therefore, we develop a generative motion prior specific for hands, trained on the AMASS dataset which features diverse and high-quality hand motions. This motion prior is then employed for video-based 3D hand motion estimation following a latent optimization approach. Our integration of a robust motion prior significantly enhances performance, especially in occluded scenarios. It produces stable, temporally consistent results that surpass conventional single-frame methods. We demonstrate our method's efficacy via qualitative and quantitative evaluations on the HO3D and DexYCB datasets, with special emphasis on an occlusion-focused subset of HO3D. Code is available at https://hmp.is.tue.mpg.de
△ Less
Submitted 27 December, 2023;
originally announced December 2023.
-
AWD3: Dynamic Reduction of the Estimation Bias
Authors:
Dogan C. Cicek,
Enes Duran,
Baturay Saglam,
Kagan Kaya,
Furkan B. Mutlu,
Suleyman S. Kozat
Abstract:
Value-based deep Reinforcement Learning (RL) algorithms suffer from the estimation bias primarily caused by function approximation and temporal difference (TD) learning. This problem induces faulty state-action value estimates and therefore harms the performance and robustness of the learning algorithms. Although several techniques were proposed to tackle, learning algorithms still suffer from thi…
▽ More
Value-based deep Reinforcement Learning (RL) algorithms suffer from the estimation bias primarily caused by function approximation and temporal difference (TD) learning. This problem induces faulty state-action value estimates and therefore harms the performance and robustness of the learning algorithms. Although several techniques were proposed to tackle, learning algorithms still suffer from this bias. Here, we introduce a technique that eliminates the estimation bias in off-policy continuous control algorithms using the experience replay mechanism. We adaptively learn the weighting hyper-parameter beta in the Weighted Twin Delayed Deep Deterministic Policy Gradient algorithm. Our method is named Adaptive-WD3 (AWD3). We show through continuous control environments of OpenAI gym that our algorithm matches or outperforms the state-of-the-art off-policy policy gradient learning algorithms.
△ Less
Submitted 12 November, 2021;
originally announced November 2021.
-
Off-Policy Correction for Deep Deterministic Policy Gradient Algorithms via Batch Prioritized Experience Replay
Authors:
Dogan C. Cicek,
Enes Duran,
Baturay Saglam,
Furkan B. Mutlu,
Suleyman S. Kozat
Abstract:
The experience replay mechanism allows agents to use the experiences multiple times. In prior works, the sampling probability of the transitions was adjusted according to their importance. Reassigning sampling probabilities for every transition in the replay buffer after each iteration is highly inefficient. Therefore, experience replay prioritization algorithms recalculate the significance of a t…
▽ More
The experience replay mechanism allows agents to use the experiences multiple times. In prior works, the sampling probability of the transitions was adjusted according to their importance. Reassigning sampling probabilities for every transition in the replay buffer after each iteration is highly inefficient. Therefore, experience replay prioritization algorithms recalculate the significance of a transition when the corresponding transition is sampled to gain computational efficiency. However, the importance level of the transitions changes dynamically as the policy and the value function of the agent are updated. In addition, experience replay stores the transitions are generated by the previous policies of the agent that may significantly deviate from the most recent policy of the agent. Higher deviation from the most recent policy of the agent leads to more off-policy updates, which is detrimental for the agent. In this paper, we develop a novel algorithm, Batch Prioritizing Experience Replay via KL Divergence (KLPER), which prioritizes batch of transitions rather than directly prioritizing each transition. Moreover, to reduce the off-policyness of the updates, our algorithm selects one batch among a certain number of batches and forces the agent to learn through the batch that is most likely generated by the most recent policy of the agent. We combine our algorithm with Deep Deterministic Policy Gradient and Twin Delayed Deep Deterministic Policy Gradient and evaluate it on various continuous control tasks. KLPER provides promising improvements for deep deterministic continuous control algorithms in terms of sample efficiency, final performance, and stability of the policy during the training.
△ Less
Submitted 12 November, 2021; v1 submitted 2 November, 2021;
originally announced November 2021.
-
Estimation Error Correction in Deep Reinforcement Learning for Deterministic Actor-Critic Methods
Authors:
Baturay Saglam,
Enes Duran,
Dogan C. Cicek,
Furkan B. Mutlu,
Suleyman S. Kozat
Abstract:
In value-based deep reinforcement learning methods, approximation of value functions induces overestimation bias and leads to suboptimal policies. We show that in deep actor-critic methods that aim to overcome the overestimation bias, if the reinforcement signals received by the agent have a high variance, a significant underestimation bias arises. To minimize the underestimation, we introduce a p…
▽ More
In value-based deep reinforcement learning methods, approximation of value functions induces overestimation bias and leads to suboptimal policies. We show that in deep actor-critic methods that aim to overcome the overestimation bias, if the reinforcement signals received by the agent have a high variance, a significant underestimation bias arises. To minimize the underestimation, we introduce a parameter-free, novel deep Q-learning variant. Our Q-value update rule combines the notions behind Clipped Double Q-learning and Maxmin Q-learning by computing the critic objective through the nested combination of maximum and minimum operators to bound the approximate value estimates. We evaluate our modification on the suite of several OpenAI Gym continuous control tasks, improving the state-of-the-art in every environment tested.
△ Less
Submitted 23 September, 2021; v1 submitted 22 September, 2021;
originally announced September 2021.
-
Integrity Coded Databases: An Evaluation of Performance, Efficiency, and Practicality
Authors:
Dan Kondratyuk,
Jake Rodden,
Elmer Duran
Abstract:
In recent years, cloud database storage has become an inexpensive and convenient option for businesses and individuals to store information. While its positive aspects make the cloud extremely attractive for data storage, it is a relatively new area of service, making it vulnerable to cyber-attacks and security breaches. Storing data in a foreign location also requires the owner to relinquish cont…
▽ More
In recent years, cloud database storage has become an inexpensive and convenient option for businesses and individuals to store information. While its positive aspects make the cloud extremely attractive for data storage, it is a relatively new area of service, making it vulnerable to cyber-attacks and security breaches. Storing data in a foreign location also requires the owner to relinquish control of their information to system administrators of these online database services. This opens the possibility for malicious, internal attacks on the data that may involve the manipulation, omission, or addition of data. The retention of the data as it was intended to be stored is referred to as the database's integrity. Our research tests a potential solution for maintaining the integrity of these cloud-storage databases by converting the original databases to Integrity Coded Databases (ICDB). ICDBs utilize Integrity Codes: cryptographic codes created alongside the data by a private key that only the data owner has access to. When the database is queried, an integrity code is returned along with the queried information. The owner is then able to verify that the information is correct, complete, and fresh. Consequently, ICDBs also incur performance and memory penalties. In our research, we explore, test, and benchmark ICDBs to determine the costs and benefits of maintaining an ICDB versus a standard database.
△ Less
Submitted 1 February, 2018;
originally announced February 2018.
-
Geometry of Fanning Curves in Divisible Grassmannians
Authors:
Carlos E. Durán,
Cíntia R. de A. Peixoto
Abstract:
We study the geometry of fanning curves in the Grassmann manifold of n-dimensional subspaces of $\mathbb{R}^{kn}$; we construct a complete system of invariants which solve the congruence problem. The geometry of the invariants themselves and their relation with classical invariants is also studied.
We study the geometry of fanning curves in the Grassmann manifold of n-dimensional subspaces of $\mathbb{R}^{kn}$; we construct a complete system of invariants which solve the congruence problem. The geometry of the invariants themselves and their relation with classical invariants is also studied.
△ Less
Submitted 25 May, 2016; v1 submitted 10 December, 2014;
originally announced December 2014.
-
Immunoexpression of Nm23: correlation with traditional prognostic markers in breast carcinoma
Authors:
Esther Durán,
Riánsares Arriazu
Abstract:
Fifty cases of breast carcinoma were investigated for Nm23, LPA1, Ki67 and p53 antigen expression, using immunohistochemical techniques. Correlation between markers was studied. Nm23 showed an inverse correlation with LPA1 and Ki67, and positive with p53. Nm23/LPA1presented significant (p<0.001) negative correlation with p53, but not difference were observed with Ki67. It can be concluded that: 1)…
▽ More
Fifty cases of breast carcinoma were investigated for Nm23, LPA1, Ki67 and p53 antigen expression, using immunohistochemical techniques. Correlation between markers was studied. Nm23 showed an inverse correlation with LPA1 and Ki67, and positive with p53. Nm23/LPA1presented significant (p<0.001) negative correlation with p53, but not difference were observed with Ki67. It can be concluded that: 1) Nm23 and LPA1 tend to be inversely correlated; 2) Nm23 correlates positively with p53, regardless of tumour type and patient's hormonal status; 3) Nm23 shows a reverse trend in comparison with Ki67. However, more studies are needed to determinate if hormone receptors play some role in the inverse relationship between Nm23-LPA1 and to know the tumour type implication in these relationships.
△ Less
Submitted 19 July, 2012;
originally announced July 2012.
-
The effect of low doses of cadmium and zinc chloride on the Blood-Testis Barrier of Sprague Dawley rats
Authors:
Andrea Redondo,
Raquel Romero,
Ana Lorenzo,
Noelia Sanz,
Esther Durán,
Beatriz Oltra,
José Manuel Pozuelo,
Luis Santamaría,
Riánsares Arriazu
Abstract:
Background: Cadmium chloride is an environmental toxic that affects the male reproductive system. This study was directed 1) to evaluate whether long-term oral exposures to low doses of Cd in rats causes morphological changes, 2) the immunohistochemical TJ and AJ protein expression; and 3) to evidence that zinc exposure can modify Cd effects. Methods: Testis of normal rats and rats that have recei…
▽ More
Background: Cadmium chloride is an environmental toxic that affects the male reproductive system. This study was directed 1) to evaluate whether long-term oral exposures to low doses of Cd in rats causes morphological changes, 2) the immunohistochemical TJ and AJ protein expression; and 3) to evidence that zinc exposure can modify Cd effects. Methods: Testis of normal rats and rats that have received Cd or Cd+Zn in drinking water during 12 months did not show any morphological change. Immunohistochemistry was used to identify BTB integrity, claudin-1, ZO-1, N-Cadherin and β-catenin were detected by immunohistochemistry and IOD were measure. Results: No immunoexpression changes of claudin-1 and ZO-1 were observed. Cd + Zn group showed a significant increase of IOD of N-Cadherin, and a significant decrease of β-catenin and transferrin immunoexpression was observed. Conclusions: Ours findings showed that the intake of low oral doses of cadmium chloride over a long time period of time did not cause morphological variation on rat testis. Neither alteration on BTB was found. Zinc chloride was able to strengthen TJ and AJ, and decrease transferrin.
Key words: Testis prostate, cadmium, zinc, TJ, AJ, immunohistochemistry
△ Less
Submitted 13 July, 2012;
originally announced July 2012.
-
Equivariant homotopy and deformations of diffeomorphisms
Authors:
C. E. Durán,
A. Rigas
Abstract:
We present a way of constructing and deforming diffeomorphisms of manifolds endowed with a Lie group action. This is applied to the study of exotic diffeomorphisms and involutions of spheres and to the equivariant homotopy of Lie groups.
We present a way of constructing and deforming diffeomorphisms of manifolds endowed with a Lie group action. This is applied to the study of exotic diffeomorphisms and involutions of spheres and to the equivariant homotopy of Lie groups.
△ Less
Submitted 12 August, 2007;
originally announced August 2007.
-
Geometric invariants of fanning curves
Authors:
Juan Carlos Álvarez Paiva,
Carlos E. Durán
Abstract:
We study the geometry of an important class of generic curves in the Grassmannian manifolds of $n$-dimensional subspaces and Lagrangian subspaces of $R^{2n}$ under the action of the linear and linear symplectic group.
We study the geometry of an important class of generic curves in the Grassmannian manifolds of $n$-dimensional subspaces and Lagrangian subspaces of $R^{2n}$ under the action of the linear and linear symplectic group.
△ Less
Submitted 23 February, 2005;
originally announced February 2005.
