-
Tree P{ó}lya Splitting distributions for multivariate count data
Authors:
Samuel Valiquette,
Éric Marchand,
Jean Peyhardi,
Gwladys Toulemonde,
Frédéric Mortier
Abstract:
In this article, we develop a new class of multivariate distributions adapted for count data, called Tree P{ó}lya Splitting. This class results from the combination of a univariate distribution and singular multivariate distributions along a fixed partition tree. As we will demonstrate, these distributions are flexible, allowing for the modeling of complex dependencies (positive, negative, or null…
▽ More
In this article, we develop a new class of multivariate distributions adapted for count data, called Tree P{ó}lya Splitting. This class results from the combination of a univariate distribution and singular multivariate distributions along a fixed partition tree. As we will demonstrate, these distributions are flexible, allowing for the modeling of complex dependencies (positive, negative, or null) at the observation level. Specifically, we present the theoretical properties of Tree P{ó}lya Splitting distributions by focusing primarily on marginal distributions, factorial moments, and dependency structures (covariance and correlations). The abundance of 17 species of Trichoptera recorded at 49 sites is used, on one hand, to illustrate the theoretical properties developed in this article on a concrete case, and on the other hand, to demonstrate the interest of this type of models, notably by comparing them to classical approaches in ecology or microbiome.
△ Less
Submitted 30 April, 2024;
originally announced April 2024.
-
Bayesian prediction regions and density estimation with type-2 censored data
Authors:
Akbar Asgharzadeh,
Éric Marchand,
Ali Saadati Nik
Abstract:
For exponentially distributed lifetimes, we consider the prediction of future order statistics based on having observed the first $m$ order statistics. We focus on the previously less explored aspects of predicting: (i) an arbitrary pair of future order statistics such as the next and last ones, as well as (ii) the next $N$ future order statistics. We provide explicit and exact Bayesian credible r…
▽ More
For exponentially distributed lifetimes, we consider the prediction of future order statistics based on having observed the first $m$ order statistics. We focus on the previously less explored aspects of predicting: (i) an arbitrary pair of future order statistics such as the next and last ones, as well as (ii) the next $N$ future order statistics. We provide explicit and exact Bayesian credible regions associated with Gamma priors, and constructed by identifying a region with a given credibility $1-λ$ under the Bayesian predictive density. For (ii), the HPD region is obtained, while a two-step algorithm is given for (i). The predictive distributions are represented as mixtures of bivariate Pareto distributions, as well as multivariate Pareto distributions. For the non-informative prior density choice, we demonstrate that a resulting Bayesian credible region has matching frequentist coverage probability, and that the resulting predictive density possesses the optimality properties of best invariance and minimaxity.
△ Less
Submitted 11 March, 2024;
originally announced March 2024.
-
Bayesian and minimax estimators of loss
Authors:
Christine Allard,
Éric Marchand
Abstract:
We study the problem of loss estimation that involves for an observable $X \sim f_θ$ the choice of a first-stage estimator $\hatγ$ of $γ(θ)$, incurred loss $L=L(θ, \hatγ)$, and the choice of a second-stage estimator $\hat{L}$ of $L$. We consider both: (i) a sequential version where the first-stage estimate and loss are fixed and optimization is performed at the second-stage level, and (ii) a simul…
▽ More
We study the problem of loss estimation that involves for an observable $X \sim f_θ$ the choice of a first-stage estimator $\hatγ$ of $γ(θ)$, incurred loss $L=L(θ, \hatγ)$, and the choice of a second-stage estimator $\hat{L}$ of $L$. We consider both: (i) a sequential version where the first-stage estimate and loss are fixed and optimization is performed at the second-stage level, and (ii) a simultaneous version with a Rukhin-type loss function designed for the evaluation of $(\hatγ, \hat{L})$ as an estimator of $(γ, L)$.
We explore various Bayesian solutions and provide minimax estimators for both situations (i) and (ii). The analysis is carried out for several probability models, including multivariate normal models $N_d(θ, σ^2 I_d)$ with both known and unknown $σ^2$, Gamma, univariate and multivariate Poisson, and negative binomial models, and relates to different choices of the first-stage and second-stage losses. The minimax findings are achieved by identifying least favourable of sequence of priors and depend critically on particular Bayesian solution properties, namely situations where the second-stage estimator $\hat{L}(x)$ is constant as a function of $x$.
△ Less
Submitted 19 December, 2023;
originally announced December 2023.
-
Asymptotic tail properties of Poisson mixture distributions
Authors:
Samuel Valiquette,
Gwladys Toulemonde,
Jean Peyhardi,
Éric Marchand,
Frédéric Mortier
Abstract:
Count data are omnipresent in many applied fields, often with overdispersion. With mixtures of Poisson distributions representing an elegant and appealing modelling strategy, we focus here on how the tail behaviour of the mixing distribution is related to the tail of the resulting Poisson mixture. We define five sets of mixing distributions and we identify for each case whenever the Poisson mixtur…
▽ More
Count data are omnipresent in many applied fields, often with overdispersion. With mixtures of Poisson distributions representing an elegant and appealing modelling strategy, we focus here on how the tail behaviour of the mixing distribution is related to the tail of the resulting Poisson mixture. We define five sets of mixing distributions and we identify for each case whenever the Poisson mixture is in, close to or far from a domain of attraction of maxima. We also characterize how the Poisson mixture behaves similarly to a standard Poisson distribution when the mixing distribution has a finite support. Finally, we study, both analytically and numerically, how goodness-of-fit can be assessed with the inspection of tail behaviour.
△ Less
Submitted 26 May, 2023;
originally announced May 2023.
-
JAWS: Just A Wild Shot for Cinematic Transfer in Neural Radiance Fields
Authors:
Xi Wang,
Robin Courant,
**glei Shi,
Eric Marchand,
Marc Christie
Abstract:
This paper presents JAWS, an optimization-driven approach that achieves the robust transfer of visual cinematic features from a reference in-the-wild video clip to a newly generated clip. To this end, we rely on an implicit-neural-representation (INR) in a way to compute a clip that shares the same cinematic features as the reference clip. We propose a general formulation of a camera optimization…
▽ More
This paper presents JAWS, an optimization-driven approach that achieves the robust transfer of visual cinematic features from a reference in-the-wild video clip to a newly generated clip. To this end, we rely on an implicit-neural-representation (INR) in a way to compute a clip that shares the same cinematic features as the reference clip. We propose a general formulation of a camera optimization problem in an INR that computes extrinsic and intrinsic camera parameters as well as timing. By leveraging the differentiability of neural representations, we can back-propagate our designed cinematic losses measured on proxy estimators through a NeRF network to the proposed cinematic parameters directly. We also introduce specific enhancements such as guidance maps to improve the overall quality and efficiency. Results display the capacity of our system to replicate well known camera sequences from movies, adapting the framing, camera parameters and timing of the generated video clip to maximize the similarity with the reference clip.
△ Less
Submitted 27 March, 2023;
originally announced March 2023.
-
Predictive density estimators with integrated $L_1$ loss
Authors:
Pankaj Bhagwat,
Eric Marchand
Abstract:
This paper addresses the problem of an efficient predictive density estimation for the density $q(\|y-θ\|^2)$ of $Y$ based on $X \sim p(\|x-θ\|^2)$ for $y, x, θ\in \mathbb{R}^d$. The chosen criteria are integrated $L_1$ loss given by $L(θ, \hat{q}) \, =\, \int_{\mathbb{R}^d} \big|\hat{q}(y)- q(\|y-θ\|^2) \big| \, dy$, and the associated frequentist risk, for $θ\in Θ$. For absolutely continuous and…
▽ More
This paper addresses the problem of an efficient predictive density estimation for the density $q(\|y-θ\|^2)$ of $Y$ based on $X \sim p(\|x-θ\|^2)$ for $y, x, θ\in \mathbb{R}^d$. The chosen criteria are integrated $L_1$ loss given by $L(θ, \hat{q}) \, =\, \int_{\mathbb{R}^d} \big|\hat{q}(y)- q(\|y-θ\|^2) \big| \, dy$, and the associated frequentist risk, for $θ\in Θ$. For absolutely continuous and strictly decreasing $q$, we establish the inevitability of scale expansion improvements $\hat{q}_c(y;X)\,=\, \frac{1}{c^d} q\big(\|y-X\|^2/c^2 \big) $ over the plug-in density $\hat{q}_1$, for a subset of values $c \in (1,c_0)$. The finding is universal with respect to $p,q$, and $d \geq 2$, and extended to loss functions $γ\big(L(θ, \hat{q} ) \big)$ with strictly increasing $γ$. The finding is also extended to include scale expansion improvements of more general plug-in densities $q(\|y-\hatθ(X)\|^2 \big)$, when the parameter space $Θ$ is a compact subset of $\mathbb{R}^d$. Numerical analyses illustrative of the dominance findings are presented and commented upon. As a complement, we demonstrate that the unimodal assumption on $q$ is necessary with a detailed analysis of cases where the distribution of $Y|θ$ is uniformly distributed on a ball centered about $θ$. In such cases, we provide a univariate ($d=1$) example where the best equivariant estimator is a plug-in estimator, and we obtain cases (for $d=1,3$) where the plug-in density $\hat{q}_1$ is optimal among all $\hat{q}_c$.
△ Less
Submitted 3 October, 2022;
originally announced October 2022.
-
TwistSLAM++: Fusing multiple modalities for accurate dynamic semantic SLAM
Authors:
Mathieu Gonzalez,
Eric Marchand,
Amine Kacete,
Jérôme Royan
Abstract:
Most classical SLAM systems rely on the static scene assumption, which limits their applicability in real world scenarios. Recent SLAM frameworks have been proposed to simultaneously track the camera and moving objects. However they are often unable to estimate the canonical pose of the objects and exhibit a low object tracking accuracy. To solve this problem we propose TwistSLAM++, a semantic, dy…
▽ More
Most classical SLAM systems rely on the static scene assumption, which limits their applicability in real world scenarios. Recent SLAM frameworks have been proposed to simultaneously track the camera and moving objects. However they are often unable to estimate the canonical pose of the objects and exhibit a low object tracking accuracy. To solve this problem we propose TwistSLAM++, a semantic, dynamic, SLAM system that fuses stereo images and LiDAR information. Using semantic information, we track potentially moving objects and associate them to 3D object detections in LiDAR scans to obtain their pose and size. Then, we perform registration on consecutive object scans to refine object pose estimation. Finally, object scans are used to estimate the shape of the object and constrain map points to lie on the estimated surface within the BA. We show on classical benchmarks that this fusion approach based on multimodal information improves the accuracy of object tracking.
△ Less
Submitted 22 March, 2023; v1 submitted 16 September, 2022;
originally announced September 2022.
-
TwistSLAM: Constrained SLAM in Dynamic Environment
Authors:
Mathieu Gonzalez,
Eric Marchand,
Amine Kacete,
Jérôme Royan
Abstract:
Classical visual simultaneous localization and map** (SLAM) algorithms usually assume the environment to be rigid. This assumption limits the applicability of those algorithms as they are unable to accurately estimate the camera poses and world structure in real life scenes containing moving objects (e.g. cars, bikes, pedestrians, etc.). To tackle this issue, we propose TwistSLAM: a semantic, dy…
▽ More
Classical visual simultaneous localization and map** (SLAM) algorithms usually assume the environment to be rigid. This assumption limits the applicability of those algorithms as they are unable to accurately estimate the camera poses and world structure in real life scenes containing moving objects (e.g. cars, bikes, pedestrians, etc.). To tackle this issue, we propose TwistSLAM: a semantic, dynamic and stereo SLAM system that can track dynamic objects in the environment. Our algorithm creates clusters of points according to their semantic class. Thanks to the definition of inter-cluster constraints modeled by mechanical joints (function of the semantic class), a novel constrained bundle adjustment is then able to jointly estimate both poses and velocities of moving objects along with the classical world structure and camera trajectory. We evaluate our approach on several sequences from the public KITTI dataset and demonstrate quantitatively that it improves camera and object tracking compared to state-of-the-art approaches.
△ Less
Submitted 27 September, 2022; v1 submitted 24 February, 2022;
originally announced February 2022.
-
Bayesian inference and prediction for mean-mixtures of normal distributions
Authors:
Pankaj Bhagwat,
Eric Marchand
Abstract:
We study frequentist risk properties of predictive density estimators for mean mixtures of multivariate normal distributions, involving an unknown location parameter $θ\in \mathbb{R}^d$, and which include multivariate skew normal distributions. We provide explicit representations for Bayesian posterior and predictive densities, including the benchmark minimum risk equivariant (MRE) density, which…
▽ More
We study frequentist risk properties of predictive density estimators for mean mixtures of multivariate normal distributions, involving an unknown location parameter $θ\in \mathbb{R}^d$, and which include multivariate skew normal distributions. We provide explicit representations for Bayesian posterior and predictive densities, including the benchmark minimum risk equivariant (MRE) density, which is minimax and generalized Bayes with respect to an improper uniform density for $θ$. For four dimensions or more, we obtain Bayesian densities that improve uniformly on the MRE density under Kullback-Leibler loss. We also provide plug-in type improvements, investigate implications for certain type of parametric restrictions on $θ$, and illustrate and comment the findings based on numerical evaluations.
△ Less
Submitted 1 February, 2022;
originally announced February 2022.
-
S3LAM: Structured Scene SLAM
Authors:
Mathieu Gonzalez,
Eric Marchand,
Amine Kacete,
Jérôme Royan
Abstract:
We propose a new SLAM system that uses the semantic segmentation of objects and structures in the scene. Semantic information is relevant as it contains high level information which may make SLAM more accurate and robust. Our contribution is twofold: i) A new SLAM system based on ORB-SLAM2 that creates a semantic map made of clusters of points corresponding to objects instances and structures in t…
▽ More
We propose a new SLAM system that uses the semantic segmentation of objects and structures in the scene. Semantic information is relevant as it contains high level information which may make SLAM more accurate and robust. Our contribution is twofold: i) A new SLAM system based on ORB-SLAM2 that creates a semantic map made of clusters of points corresponding to objects instances and structures in the scene. ii) A modification of the classical Bundle Adjustment formulation to constrain each cluster using geometrical priors, which improves both camera localization and reconstruction and enables a better understanding of the scene. We evaluate our approach on sequences from several public datasets and show that it improves camera pose estimation with respect to state of the art.
△ Less
Submitted 1 March, 2022; v1 submitted 15 September, 2021;
originally announced September 2021.
-
Tracking Pedestrian Heads in Dense Crowd
Authors:
Ramana Sundararaman,
Cedric De Almeida Braga,
Eric Marchand,
Julien Pettre
Abstract:
Tracking humans in crowded video sequences is an important constituent of visual scene understanding. Increasing crowd density challenges visibility of humans, limiting the scalability of existing pedestrian trackers to higher crowd densities. For that reason, we propose to revitalize head tracking with Crowd of Heads Dataset (CroHD), consisting of 9 sequences of 11,463 frames with over 2,276,838…
▽ More
Tracking humans in crowded video sequences is an important constituent of visual scene understanding. Increasing crowd density challenges visibility of humans, limiting the scalability of existing pedestrian trackers to higher crowd densities. For that reason, we propose to revitalize head tracking with Crowd of Heads Dataset (CroHD), consisting of 9 sequences of 11,463 frames with over 2,276,838 heads and 5,230 tracks annotated in diverse scenes. For evaluation, we proposed a new metric, IDEucl, to measure an algorithm's efficacy in preserving a unique identity for the longest stretch in image coordinate space, thus building a correspondence between pedestrian crowd motion and the performance of a tracking algorithm. Moreover, we also propose a new head detector, HeadHunter, which is designed for small head detection in crowded scenes. We extend HeadHunter with a Particle Filter and a color histogram based re-identification module for head tracking. To establish this as a strong baseline, we compare our tracker with existing state-of-the-art pedestrian trackers on CroHD and demonstrate superiority, especially in identity preserving tracking metrics. With a light-weight head detector and a tracker which is efficient at identity preservation, we believe our contributions will serve useful in advancement of pedestrian tracking in dense crowds.
△ Less
Submitted 24 March, 2021;
originally announced March 2021.
-
On shrinkage estimation of a spherically symmetric distribution for balanced loss functions
Authors:
Lahoucine Hobbad,
Éric Marchand,
Idir Ouassou
Abstract:
We consider the problem of estimating the mean vector $θ$ of a $d$-dimensional spherically symmetric distributed $X$ based on balanced loss functions of the forms: {\bf (i)} $ωρ(\|\de-\de_{0}\|^{2}) +(1-ω)ρ(\|\de - θ\|^{2})$ and {\bf (ii)} $\ell\left(ω\|\de - \de_{0}\|^{2} +(1-ω)\|\de - θ\|^{2}\right)$, where $δ_0$ is a target estimator, and where $ρ$ and $\ell$ are increasing and concave function…
▽ More
We consider the problem of estimating the mean vector $θ$ of a $d$-dimensional spherically symmetric distributed $X$ based on balanced loss functions of the forms: {\bf (i)} $ωρ(\|\de-\de_{0}\|^{2}) +(1-ω)ρ(\|\de - θ\|^{2})$ and {\bf (ii)} $\ell\left(ω\|\de - \de_{0}\|^{2} +(1-ω)\|\de - θ\|^{2}\right)$, where $δ_0$ is a target estimator, and where $ρ$ and $\ell$ are increasing and concave functions. For $d\geq 4$ and the target estimator $δ_0(X)=X$, we provide Baranchik-type estimators that dominate $δ_0(X)=X$ and are minimax. The findings represent extensions of those of Marchand \& Strawderman (\cite{ms2020}) in two directions: {\bf (a)} from scale mixture of normals to the spherical class of distributions with Lebesgue densities and {\bf (b)} from completely monotone to concave $ρ'$ and $\ell'$.
△ Less
Submitted 25 February, 2021;
originally announced February 2021.
-
Bayesian estimation and prediction for certain mixtures
Authors:
Aziz LMoudden,
Éric Marchand
Abstract:
For two vast families of mixture distributions and a given prior, we provide unified representations of posterior and predictive distributions. Model applications presented include bivariate mixtures of Gamma distributions labelled as Kibble-type, non-central Chi-square and F distributions, the distribution of $R^2$ in multiple regression, variance mixture of normal distributions, and mixtures of…
▽ More
For two vast families of mixture distributions and a given prior, we provide unified representations of posterior and predictive distributions. Model applications presented include bivariate mixtures of Gamma distributions labelled as Kibble-type, non-central Chi-square and F distributions, the distribution of $R^2$ in multiple regression, variance mixture of normal distributions, and mixtures of location-scale exponential distributions including the multivariate Lomax distribution. An emphasis is also placed on analytical representations and the relationships with a host of existing distributions and several hypergeomtric functions of one or two variables.
△ Less
Submitted 7 September, 2020; v1 submitted 6 May, 2020;
originally announced May 2020.
-
L6DNet: Light 6 DoF Network for Robust and Precise Object Pose Estimation with Small Datasets
Authors:
Mathieu Gonzalez,
Amine Kacete,
Albert Murienne,
Eric Marchand
Abstract:
Estimating the 3D pose of an object is a challenging task that can be considered within augmented reality or robotic applications. In this paper, we propose a novel approach to perform 6 DoF object pose estimation from a single RGB-D image. We adopt a hybrid pipeline in two stages: data-driven and geometric respectively. The data-driven step consists of a classification CNN to estimate the object…
▽ More
Estimating the 3D pose of an object is a challenging task that can be considered within augmented reality or robotic applications. In this paper, we propose a novel approach to perform 6 DoF object pose estimation from a single RGB-D image. We adopt a hybrid pipeline in two stages: data-driven and geometric respectively. The data-driven step consists of a classification CNN to estimate the object 2D location in the image from local patches, followed by a regression CNN trained to predict the 3D location of a set of keypoints in the camera coordinate system. To extract the pose information, the geometric step consists in aligning the 3D points in the camera coordinate system with the corresponding 3D points in world coordinate system by minimizing a registration error, thus computing the pose. Our experiments on the standard dataset LineMod show that our approach is more robust and accurate than state-of-the-art methods. The approach is also validated to achieve a 6 DoF positioning task by visual servoing.
△ Less
Submitted 29 May, 2022; v1 submitted 3 February, 2020;
originally announced February 2020.
-
Co-Designing in Social VR. Process awareness and suitable representations to empower user participation
Authors:
Tomás Dorta,
Stéphane Safin,
Sana Boudhraâ,
Emmanuel Beaudry Marchand
Abstract:
To allow non-designers' involvement in design projects new methods are needed. Co-design gives the same opportunity to all the multidisciplinary participants to co-create ideas simultaneously. Nevertheless, current co-design processes involving such users tend to limit their contribution to the proposal of basic design ideas only through brainstorming. The co-design approach needs to be enhanced b…
▽ More
To allow non-designers' involvement in design projects new methods are needed. Co-design gives the same opportunity to all the multidisciplinary participants to co-create ideas simultaneously. Nevertheless, current co-design processes involving such users tend to limit their contribution to the proposal of basic design ideas only through brainstorming. The co-design approach needs to be enhanced by a properly suited representational ecosystem supporting active participation and by conscious use of structured verbal exchanges giving awareness of the creative process. In this respect, we developed two social virtual reality co-design systems, and a co-design verbal exchange methodology to favour participants' awareness of the co-creative process. By using such representations and verbal exchanges, participants could co-create with more ease by benefiting from being informed of the process and from the collective immersion, empowering their participation. This paper presents the rationale behind this approach of using Social VR in co-design and the feedback of three co-design workshops.
△ Less
Submitted 26 June, 2019;
originally announced June 2019.
-
On shrinkage estimation for balanced loss functions
Authors:
Éric Marchand,
William E. Strawderman
Abstract:
The estimation of a multivariate mean $θ$ is considered under natural modifications of balanced loss function of the form: (i) $ω\, ρ(\|δ-δ_0\|^2) + (1-ω) \, ρ(\|δ-θ\|^2) $, and (ii) $\ell \left( ω\, \|δ-δ_0\|^2 + (1-ω) \, \|δ-θ\|^2 \right)\,$, where $δ_0$ is a target estimator of $γ(θ)$. After briefly reviewing known results for original balanced loss with identity $ρ$ or $\ell$, we provide, for…
▽ More
The estimation of a multivariate mean $θ$ is considered under natural modifications of balanced loss function of the form: (i) $ω\, ρ(\|δ-δ_0\|^2) + (1-ω) \, ρ(\|δ-θ\|^2) $, and (ii) $\ell \left( ω\, \|δ-δ_0\|^2 + (1-ω) \, \|δ-θ\|^2 \right)\,$, where $δ_0$ is a target estimator of $γ(θ)$. After briefly reviewing known results for original balanced loss with identity $ρ$ or $\ell$, we provide, for increasing and concave $ρ$ and $\ell$ which also satisfy a completely monotone property, Baranchik-type estimators of $θ$ which dominate the benchmark $δ_0(X)=X$ for $X$ either distributed as multivariate normal or as a scale mixture of normals. Implications are given with respect to model robustness and simultaneous dominance with respect to either $ρ$ or $\ell
△ Less
Submitted 5 April, 2019;
originally announced April 2019.
-
On efficient prediction and predictive density estimation for spherically symmetric models
Authors:
Dominique Fourdrinier,
Éric Marchand,
William E. Strawderman
Abstract:
Let $X,U,Y$ be spherically symmetric distributed having density $$η^{d +k/2} \, f\left(η(\|x-θ|^2+ \|u\|^2 + \|y-cθ\|^2 ) \right)\,,$$ with unknown parameters $θ\in \mathbb{R}^d$ and $η>0$, and with known density $f$ and constant $c >0$. Based on observing $X=x,U=u$, we consider the problem of obtaining a predictive density $\hat{q}(y;x,u)$ for $Y$ as measured by the expected Kullback-Leibler loss…
▽ More
Let $X,U,Y$ be spherically symmetric distributed having density $$η^{d +k/2} \, f\left(η(\|x-θ|^2+ \|u\|^2 + \|y-cθ\|^2 ) \right)\,,$$ with unknown parameters $θ\in \mathbb{R}^d$ and $η>0$, and with known density $f$ and constant $c >0$. Based on observing $X=x,U=u$, we consider the problem of obtaining a predictive density $\hat{q}(y;x,u)$ for $Y$ as measured by the expected Kullback-Leibler loss. A benchmark procedure is the minimum risk equivariant density $\hat{q}_{mre}$, which is Generalized Bayes with respect to the prior $π(θ, η) = η^{-1}$. For $d \geq 3$, we obtain improvements on $\hat{q}_{mre}$, and further show that the dominance holds simultaneously for all $f$ subject to finite moments and finite risk conditions. We also obtain that the Bayes predictive density with respect to the harmonic prior $π_h(θ, η) =η^{-1} \|θ\|^{2-d}$ dominates $\hat{q}_{mre}$ simultaneously for all scale mixture of normals $f$.
△ Less
Submitted 12 July, 2018;
originally announced July 2018.
-
On Predictive Density Estimation under $α$-divergence Loss
Authors:
Aziz L'Moudden,
Éric Marchand
Abstract:
Based on $X \sim N_d(θ, σ^2_X I_d)$, we study the efficiency of predictive densities under $α-$divergence loss $L_α$ for estimating the density of $Y \sim N_d(θ, σ^2_Y I_d)$. We identify a large number of cases where improvement on a plug-in density are obtainable by expanding the variance, thus extending earlier findings applicable to Kullback-Leibler loss. The results and proofs are unified with…
▽ More
Based on $X \sim N_d(θ, σ^2_X I_d)$, we study the efficiency of predictive densities under $α-$divergence loss $L_α$ for estimating the density of $Y \sim N_d(θ, σ^2_Y I_d)$. We identify a large number of cases where improvement on a plug-in density are obtainable by expanding the variance, thus extending earlier findings applicable to Kullback-Leibler loss. The results and proofs are unified with respect to the dimension $d$, the variances $σ^2_X$ and $σ^2_Y$, the choice of loss $L_α$; $α\in (-1,1)$. The findings also apply to a large number of plug-in densities, as well as for restricted parameter spaces with $θ\in Θ\subset \mathbb{R}^d$. The theoretical findings are accompanied by various observations, illustrations, and implications dealing for instance with robustness with respect to the model variances and simultaneous dominance with respect to the loss.
△ Less
Submitted 7 June, 2018;
originally announced June 2018.
-
Inference for a constrained parameter in presence of an uncertain constraint
Authors:
Éric Marchand,
Theodoros Nicoleris
Abstract:
We describe a hierarchical Bayesian approach for inference about a parameter $θ$ lower-bounded by $α$ with uncertain $α$, derive some basic identities for posterior analysis about $(θ,α)$, and provide illustrations for normal and Poisson models. For the normal case with unknown mean $θ$ and known variance $σ^2$, we obtain Bayes estimators of $θ$ that take values on $\mathbb{R}$, but that are equal…
▽ More
We describe a hierarchical Bayesian approach for inference about a parameter $θ$ lower-bounded by $α$ with uncertain $α$, derive some basic identities for posterior analysis about $(θ,α)$, and provide illustrations for normal and Poisson models. For the normal case with unknown mean $θ$ and known variance $σ^2$, we obtain Bayes estimators of $θ$ that take values on $\mathbb{R}$, but that are equally adapted to a lower-bound constraint in being minimax under squared error loss for the constrained problem.
△ Less
Submitted 7 June, 2018;
originally announced June 2018.
-
On predictive density estimation with additional information
Authors:
Éric Marchand,
Abdolnasser Sadeghkhani
Abstract:
Based on independently distributed $X_1 \sim N_p(θ_1, σ^2_1 I_p)$ and $X_2 \sim N_p(θ_2, σ^2_2 I_p)$, we consider the efficiency of various predictive density estimators for $Y_1 \sim N_p(θ_1, σ^2_Y I_p)$, with the additional information $θ_1 - θ_2 \in A$ and known $σ^2_1, σ^2_2, σ^2_Y$. We provide improvements on benchmark predictive densities such as plug-in, the maximum likelihood, and the mini…
▽ More
Based on independently distributed $X_1 \sim N_p(θ_1, σ^2_1 I_p)$ and $X_2 \sim N_p(θ_2, σ^2_2 I_p)$, we consider the efficiency of various predictive density estimators for $Y_1 \sim N_p(θ_1, σ^2_Y I_p)$, with the additional information $θ_1 - θ_2 \in A$ and known $σ^2_1, σ^2_2, σ^2_Y$. We provide improvements on benchmark predictive densities such as plug-in, the maximum likelihood, and the minimum risk equivariant predictive densities. Dominance results are obtained for $α-$divergence losses and include Bayesian improvements for reverse Kullback-Leibler loss, and Kullback-Leibler (KL) loss in the univariate case ($p=1$). An ensemble of techniques are exploited, including variance expansion (for KL loss), point estimation duality, and concave inequalities. Representations for Bayesian predictive densities, and in particular for $\hat{q}_{π_{U,A}}$ associated with a uniform prior for $θ=(θ_1, θ_2)$ truncated to $\{θ\in \mathbb{R}^{2p}: θ_1 - θ_2 \in A \}$, are established and are used for the Bayesian dominance findings. Finally and interestingly, these Bayesian predictive densities also relate to skew-normal distributions, as well as new forms of such distributions.
△ Less
Submitted 22 September, 2017;
originally announced September 2017.
-
Visual Servoing from Deep Neural Networks
Authors:
Quentin Bateux,
Eric Marchand,
Jürgen Leitner,
Francois Chaumette,
Peter Corke
Abstract:
We present a deep neural network-based method to perform high-precision, robust and real-time 6 DOF visual servoing. The paper describes how to create a dataset simulating various perturbations (occlusions and lighting conditions) from a single real-world image of the scene. A convolutional neural network is fine-tuned using this dataset to estimate the relative pose between two images of the same…
▽ More
We present a deep neural network-based method to perform high-precision, robust and real-time 6 DOF visual servoing. The paper describes how to create a dataset simulating various perturbations (occlusions and lighting conditions) from a single real-world image of the scene. A convolutional neural network is fine-tuned using this dataset to estimate the relative pose between two images of the same scene. The output of the network is then employed in a visual servoing control scheme. The method converges robustly even in difficult real-world settings with strong lighting variations and occlusions.A positioning error of less than one millimeter is obtained in experiments with a 6 DOF robot.
△ Less
Submitted 7 June, 2017; v1 submitted 24 May, 2017;
originally announced May 2017.
-
Count-Min Tree Sketch: Approximate counting for NLP
Authors:
Guillaume Pitel,
Geoffroy Fouquier,
Emmanuel Marchand,
Abdul Mouhamadsultane
Abstract:
The Count-Min Sketch is a widely adopted structure for approximate event counting in large scale processing. In a previous work we improved the original version of the Count-Min-Sketch (CMS) with conservative update using approximate counters instead of linear counters. These structures are computationaly efficient and improve the average relative error (ARE) of a CMS at constant memory footprint.…
▽ More
The Count-Min Sketch is a widely adopted structure for approximate event counting in large scale processing. In a previous work we improved the original version of the Count-Min-Sketch (CMS) with conservative update using approximate counters instead of linear counters. These structures are computationaly efficient and improve the average relative error (ARE) of a CMS at constant memory footprint. These improvements are well suited for NLP tasks, in which one is interested by the low-frequency items. However, if Log counters allow to improve ARE, they produce a residual error due to the approximation. In this paper, we propose the Count-Min Tree Sketch (Copyright 2016 eXenSa. All rights reserved) variant with pyramidal counters, which are focused toward taking advantage of the Zipfian distribution of text data.
△ Less
Submitted 15 June, 2016; v1 submitted 19 April, 2016;
originally announced April 2016.
-
On Predictive Density Estimation for Location Families under Integrated $L_2$ and $L_1$ Losses
Authors:
Tatsuya Kubokawa,
Éric Marchand,
William E. Strawderman
Abstract:
Our investigation concerns the estimation of predictive densities and a study of efficiency as measured by the frequentist risk of such predictive densities with integrated $L_2$ and $L_1$ losses. Our findings relate to a $p-$variate spherically symmetric observable $X \sim p_X(\|x-μ\|^2)$ and the objective of estimating the density of $Y \sim q_Y(\|y-μ\|^2)$ based on $X$. For $L_2$ loss, we descr…
▽ More
Our investigation concerns the estimation of predictive densities and a study of efficiency as measured by the frequentist risk of such predictive densities with integrated $L_2$ and $L_1$ losses. Our findings relate to a $p-$variate spherically symmetric observable $X \sim p_X(\|x-μ\|^2)$ and the objective of estimating the density of $Y \sim q_Y(\|y-μ\|^2)$ based on $X$. For $L_2$ loss, we describe Bayes estimation, minimum risk equivariant estimation (MRE), and minimax estimation. We focus on the risk performance of the benchmark minimum risk equivariant estimator, plug-in estimators, and plug-in type estimators with expanded scale. For the multivariate normal case, we make use of a duality result with a point estimation problem bringing into play reflected normal loss. In three of more dimensions (i.e., $p \geq 3$), we show that the MRE estimator is inadmissible under $L_2$ loss and provide dominating estimators. This brings into play Stein-type results for estimating a multivariate normal mean with a loss which is a concave and increasing function of $\|\hatμ-μ\|^2$. We also study the phenomenon of improvement on the plug-in density estimator of the form $q_Y(\|y-aX\|^2)\,, 0<a \leq 1\,,$ by a subclass of scale expansions $\frac{1}{c^p} \, q_Y(\|(y -aX)/c \|^2)$ with $c>1$, showing in some cases, inevitably for large enough $p$, that all choices $c>1$ are dominating estimators. Extensions are obtained for scale mixture of normals including a general inadmissibility result of the MRE estimator for $p \geq 3$. Finally, we describe and expand on analogous plug-in dominance results for spherically symmetric distributions with $p \geq 4$ under $L_1$ loss.
△ Less
Submitted 22 August, 2014;
originally announced August 2014.
-
On continuous distribution functions, minimax and best invariant estimators, and integrated balanced loss functions
Authors:
Mohammad Jafari Jozani,
Alexandre Leblanc,
Eric Marchand
Abstract:
We consider the problem of estimating a continuous distribution function $F$, as well as meaningful functions $τ(F)$ under a large class of loss functions. We obtain best invariant estimators and establish their minimaxity for Hölder continuous $τ$'s and strict bowl-shaped losses with a bounded derivative. We also introduce and motivate the use of integrated balanced loss functions which combine t…
▽ More
We consider the problem of estimating a continuous distribution function $F$, as well as meaningful functions $τ(F)$ under a large class of loss functions. We obtain best invariant estimators and establish their minimaxity for Hölder continuous $τ$'s and strict bowl-shaped losses with a bounded derivative. We also introduce and motivate the use of integrated balanced loss functions which combine the criteria of an integrated distance between a decision $d$ and $F$, with the proximity of $d$ with a target estimator $d_0$. Moreover, we show how the risk analysis of procedures under such an integrated balanced loss relates to a dual risk analysis under an "unbalanced" loss, and we derive best invariant estimators, minimax estimators, risk comparisons, dominance and inadmissibility results. Finally, we expand on various illustrations and applications relative to maxima-nomination sampling, median-nomination sampling, and a case study related to bilirubin levels in the blood of babies suffering from jaundice.
△ Less
Submitted 8 August, 2013;
originally announced August 2013.
-
On Bayesian credible sets in restricted parameter space problems and lower bounds for frequentist coverage
Authors:
Eric Marchand,
William E. Strawderman
Abstract:
For estimating a lower bounded parametric function in the framework of Marchand and Strawderman (2006), we provide through a unified approach a class of Bayesian confidence intervals with credibility $1-α$ and frequentist coverage probability bounded below by $\frac{1-α}{1+α}$. In cases where the underlying pivotal distribution is symmetric, the findings represent extensions with respect to the sp…
▽ More
For estimating a lower bounded parametric function in the framework of Marchand and Strawderman (2006), we provide through a unified approach a class of Bayesian confidence intervals with credibility $1-α$ and frequentist coverage probability bounded below by $\frac{1-α}{1+α}$. In cases where the underlying pivotal distribution is symmetric, the findings represent extensions with respect to the specification of the credible set achieved through the choice of a {\it spending function}, and include Marchand and Strawderman's HPD procedure result. For non-symmetric cases, the determination of a such a class of Bayesian credible sets fills a gap in the literature and includes an "equal-tails" modification of the HPD procedure. Several examples are presented demonstrating wide applicability.
△ Less
Submitted 19 December, 2012; v1 submitted 31 July, 2012;
originally announced August 2012.
-
Estimation of a nonnegative location parameter with unknown scale
Authors:
Mohammad Jafari Jozani,
Eric Marchand,
William Strawderman
Abstract:
For normal canonical models, and more generally a vast array of general spherically symmetric location-scale models with a residual vector, we consider estimating the (univariate) location parameter when it is lower bounded. We provide conditions for estimators to dominate the benchmark minimax MRE estimator, and thus be minimax under scale invariant loss. These minimax estimators include the gene…
▽ More
For normal canonical models, and more generally a vast array of general spherically symmetric location-scale models with a residual vector, we consider estimating the (univariate) location parameter when it is lower bounded. We provide conditions for estimators to dominate the benchmark minimax MRE estimator, and thus be minimax under scale invariant loss. These minimax estimators include the generalized Bayes estimator with respect to the truncation of the common non-informative prior onto the restricted parameter space for normal models under general convex symmetric loss, as well as non-normal models under scale invariant $L^p$ loss with $p>0$. We cover many other situations when the loss is asymmetric, and where other generalized Bayes estimators, obtained with different powers of the scale parameter in the prior measure, are proven to be minimax. We rely on various novel representations, sharp sign change analyses, as well as capitalize on Kubokawa's integral expression for risk difference technique. Several other analytical properties are obtained, including a robustness property of the generalized Bayes estimators above when the loss is either scale invariant $L^p$ or asymmetrized versions. Applications include inference in two-sample normal model with order constraints on the means.
△ Less
Submitted 21 July, 2012;
originally announced July 2012.
-
A unified minimax result for restricted parameter spaces
Authors:
Éric Marchand,
William E. Strawderman
Abstract:
We provide a development that unifies, simplifies and extends considerably a number of minimax results in the restricted parameter space literature. Various applications follow, such as that of estimating location or scale parameters under a lower (or upper) bound restriction, location parameter vectors restricted to a polyhedral cone, scale parameters subject to restricted ratios or products, lin…
▽ More
We provide a development that unifies, simplifies and extends considerably a number of minimax results in the restricted parameter space literature. Various applications follow, such as that of estimating location or scale parameters under a lower (or upper) bound restriction, location parameter vectors restricted to a polyhedral cone, scale parameters subject to restricted ratios or products, linear combinations of restricted location parameters, location parameters bounded to an interval with unknown scale, quantiles for location-scale families with parametric restrictions and restricted covariance matrices.
△ Less
Submitted 9 May, 2012;
originally announced May 2012.
-
Estimation of a multivariate normal mean with a bounded signal to noise ratio
Authors:
Othmane Kortbi,
Éric Marchand
Abstract:
For normal canonical models with $X \sim N_p(θ, σ^{2} I_{p}), \;\; S^{2} \sim σ^{2}χ^{2}_{k}, \;{independent}$, we consider the problem of estimating $θ$ under scale invariant squared error loss $\frac{\|d-θ\|^{2}}{σ^{2}}$, when it is known that the signal-to-noise ratio $\frac{\|θ\|}σ$ is bounded above by $m$. Risk analysis is achieved by making use of a conditional risk decomposition and we obta…
▽ More
For normal canonical models with $X \sim N_p(θ, σ^{2} I_{p}), \;\; S^{2} \sim σ^{2}χ^{2}_{k}, \;{independent}$, we consider the problem of estimating $θ$ under scale invariant squared error loss $\frac{\|d-θ\|^{2}}{σ^{2}}$, when it is known that the signal-to-noise ratio $\frac{\|θ\|}σ$ is bounded above by $m$. Risk analysis is achieved by making use of a conditional risk decomposition and we obtain in particular sufficient conditions for an estimator to dominate either the unbiased estimator $δ_{UB}(X)=X$, or the maximum likelihood estimator $δ_{\hbox{mle}}(X,S^2)$, or both of these benchmark procedures. The given developments bring into play the pivotal role of the boundary Bayes estimator $δ_{BU}$ associated with a prior on $(θ,σ)$ such that $θ|σ$ is uniformly distributed on the (boundary) sphere of radius $m$ and a non-informative $\frac{1}σ$ prior measure is placed marginally on $σ$. With a series of technical results related to $δ_{BU}$; which relate to particular ratios of confluent hypergeometric functions; we show that, whenever $m \leq \sqrt{p}$ and $p \geq 2$, $δ_{BU}$ dominates both $δ_{UB}$ and $δ_{\hbox{mle}}$. The finding can be viewed as both a multivariate extension of $p=1$ result due to Kubokawa (2005) and a unknown variance extension of a similar dominance finding due to Marchand and Perron (2001). Various other dominance results are obtained, illustrations are provided and commented upon. In particular, for $m \leq \sqrt{\frac{p}{2}}$, a wide class of Bayes estimators, which include priors where $θ|σ$ is uniformly distributed on the ball of radius $m$, are shown to dominate $δ_{UB}$.
△ Less
Submitted 26 April, 2012;
originally announced April 2012.
-
On the frequentist coverage of Bayesian credible intervals for lower bounded means
Authors:
Éric Marchand,
William E. Strawderman,
Keven Bosa,
Aziz Lmoudden
Abstract:
For estimating a lower bounded location or mean parameter for a symmetric and logconcave density, we investigate the frequentist performance of the $100(1-α)%$ Bayesian HPD credible set associated with priors which are truncations of flat priors onto the restricted parameter space. Various new properties are obtained. Namely, we identify precisely where the minimum coverage is obtained and we sh…
▽ More
For estimating a lower bounded location or mean parameter for a symmetric and logconcave density, we investigate the frequentist performance of the $100(1-α)%$ Bayesian HPD credible set associated with priors which are truncations of flat priors onto the restricted parameter space. Various new properties are obtained. Namely, we identify precisely where the minimum coverage is obtained and we show that this minimum coverage is bounded between $1-\frac{3α}{2}$ and $1-\frac{3α}{2}+\frac{α^2}{1+α}$; with the lower bound $1-\frac{3α}{2}$ improving (for $α\leq 1/3$) on the previously established ([9]; [8]) lower bound $\frac{1-α}{1+α}$. Several illustrative examples are given.
△ Less
Submitted 13 November, 2008; v1 submitted 5 September, 2008;
originally announced September 2008.
-
On the behavior of Bayesian credible intervals for some restricted parameter space problems
Authors:
Éric Marchand,
William E. Strawderman
Abstract:
For estimating a positive normal mean, Zhang and Woodroofe (2003) as well as Roe and Woodroofe (2000) investigate 100($1-α)%$ HPD credible sets associated with priors obtained as the truncation of noninformative priors onto the restricted parameter space. Namely, they establish the attractive lower bound of $\frac{1-α}{1+α}$ for the frequentist coverage probability of these procedures. In this w…
▽ More
For estimating a positive normal mean, Zhang and Woodroofe (2003) as well as Roe and Woodroofe (2000) investigate 100($1-α)%$ HPD credible sets associated with priors obtained as the truncation of noninformative priors onto the restricted parameter space. Namely, they establish the attractive lower bound of $\frac{1-α}{1+α}$ for the frequentist coverage probability of these procedures. In this work, we establish that the lower bound of $\frac{1-α}{1+α}$ is applicable for a substantially more general setting with underlying distributional symmetry, and obtain various other properties. The derivations are unified and are driven by the choice of a right Haar invariant prior. Investigations of non-symmetric models are carried out and similar results are obtained. Namely, (i) we show that the lower bound $\frac{1-α}{1+α}$ still applies for certain types of asymmetry (or skewness), and (ii) we extend results obtained by Zhang and Woodroofe (2002) for estimating the scale parameter of a Fisher distribution; which arises in estimating the ratio of variance components in a one-way balanced random effects ANOVA. Finally, various examples illustrating the wide scope of applications are expanded upon. Examples include estimating parameters in location models and location-scale models, estimating scale parameters in scale models, estimating linear combinations of location parameters such as differences, estimating ratios of scale parameters, and problems with non-independent observations.
△ Less
Submitted 22 November, 2006;
originally announced November 2006.
