Skip to main content

Showing 1–17 of 17 results for author: Zheng, N

Searching in archive stat. Search in all archives.
.
  1. arXiv:2401.15281  [pdf, other

    stat.ME math.ST

    Improved confidence intervals for nonlinear mixed-effects and nonparametric regression models

    Authors: Nan Zheng, Noel Cadigan

    Abstract: Statistical inference for high dimensional parameters (HDPs) can be based on their intrinsic correlation; that is, parameters that are close spatially or temporally tend to have more similar values. This is why nonlinear mixed-effects models (NMMs) are commonly (and appropriately) used for models with HDPs. Conversely, in many practical applications of NMM, the random effects (REs) are actually co… ▽ More

    Submitted 26 January, 2024; originally announced January 2024.

  2. arXiv:2309.16578  [pdf, other

    stat.ML cs.LG physics.chem-ph

    Overcoming the Barrier of Orbital-Free Density Functional Theory for Molecular Systems Using Deep Learning

    Authors: He Zhang, Siyuan Liu, Jiacheng You, Chang Liu, Shuxin Zheng, Ziheng Lu, Tong Wang, Nanning Zheng, Bin Shao

    Abstract: Orbital-free density functional theory (OFDFT) is a quantum chemistry formulation that has a lower cost scaling than the prevailing Kohn-Sham DFT, which is increasingly desired for contemporary molecular research. However, its accuracy is limited by the kinetic energy density functional, which is notoriously hard to approximate for non-periodic molecular systems. Here we propose M-OFDFT, an OFDFT… ▽ More

    Submitted 9 March, 2024; v1 submitted 28 September, 2023; originally announced September 2023.

    Comments: Published in Nature Computational Science, March 2024. Full paper with supplementary information

  3. arXiv:2309.05077  [pdf, ps, other

    cs.LG stat.ML

    Generalization error bounds for iterative learning algorithms with bounded updates

    Authors: **gwen Fu, Nanning Zheng

    Abstract: This paper explores the generalization characteristics of iterative learning algorithms with bounded updates for non-convex loss functions, employing information-theoretic techniques. Our key contribution is a novel bound for the generalization error of these algorithms with bounded updates. Our approach introduces two main novelties: 1) we reformulate the mutual information as the uncertainty of… ▽ More

    Submitted 14 October, 2023; v1 submitted 10 September, 2023; originally announced September 2023.

  4. arXiv:2011.03737  [pdf, other

    cs.LG cs.CV stat.ML

    Interventional Domain Adaptation

    Authors: Jun Wen, Changjian Shui, Kun Kuang, Junsong Yuan, Zenan Huang, Zhefeng Gong, Nenggan Zheng

    Abstract: Domain adaptation (DA) aims to transfer discriminative features learned from source domain to target domain. Most of DA methods focus on enhancing feature transferability through domain-invariance learning. However, source-learned discriminability itself might be tailored to be biased and unsafely transferable by spurious correlations, \emph{i.e.}, part of source-specific features are correlated w… ▽ More

    Submitted 7 November, 2020; originally announced November 2020.

  5. arXiv:2009.03986  [pdf, ps, other

    cs.LG stat.ML

    Conditional Uncorrelation and Efficient Non-approximate Subset Selection in Sparse Regression

    Authors: Jianji Wang, Qi Liu, Shupei Zhang, Nanning Zheng, Fei-Yue Wang

    Abstract: Given $m$ $d$-dimensional responsors and $n$ $d$-dimensional predictors, sparse regression finds at most $k$ predictors for each responsor for linear approximation, $1\leq k \leq d-1$. The key problem in sparse regression is subset selection, which usually suffers from high computational cost. Recent years, many improved approximate methods of subset selection have been published. However, less at… ▽ More

    Submitted 24 November, 2020; v1 submitted 8 September, 2020; originally announced September 2020.

    Comments: 17 pages, 0 figure

  6. arXiv:1910.14380  [pdf, other

    math.OC cs.LG stat.ML

    A Decentralized Proximal Point-type Method for Saddle Point Problems

    Authors: Weijie Liu, Aryan Mokhtari, Asuman Ozdaglar, Sarath Pattathil, Zebang Shen, Nenggan Zheng

    Abstract: In this paper, we focus on solving a class of constrained non-convex non-concave saddle point problems in a decentralized manner by a group of nodes in a network. Specifically, we assume that each node has access to a summand of a global objective function and nodes are allowed to exchange information only with their neighboring nodes. We propose a decentralized variant of the proximal point metho… ▽ More

    Submitted 31 October, 2019; originally announced October 2019.

    Comments: 18 pages

  7. arXiv:1908.08807  [pdf, other

    q-bio.NC cs.LG eess.IV stat.ML

    An encoding framework with brain inner state for natural image identification

    Authors: Hao Wu, Ziyu Zhu, Jiayi Wang, Nanning Zheng, Badong Chen

    Abstract: Neural encoding and decoding, which aim to characterize the relationship between stimuli and brain activities, have emerged as an important area in cognitive neuroscience. Traditional encoding models, which focus on feature extraction and map**, consider the brain as an input-output mapper without inner states. In this work, inspired by the fact that human brain acts like a state machine, we pro… ▽ More

    Submitted 22 August, 2019; originally announced August 2019.

  8. arXiv:1907.12439  [pdf, other

    cs.LG cs.AI stat.ML

    Hindsight Trust Region Policy Optimization

    Authors: Hanbo Zhang, Site Bai, Xuguang Lan, David Hsu, Nanning Zheng

    Abstract: Reinforcement Learning(RL) with sparse rewards is a major challenge. We propose \emph{Hindsight Trust Region Policy Optimization}(HTRPO), a new RL algorithm that extends the highly successful TRPO algorithm with \emph{hindsight} to tackle the challenge of sparse rewards. Hindsight refers to the algorithm's ability to learn from information across goals, including ones not intended for the current… ▽ More

    Submitted 17 May, 2021; v1 submitted 29 July, 2019; originally announced July 2019.

    Comments: Accepted by IJCAI 2021

  9. arXiv:1906.09693  [pdf, other

    cs.LG cs.CV stat.ML

    Bayesian Uncertainty Matching for Unsupervised Domain Adaptation

    Authors: Jun Wen, Nenggan Zheng, Junsong Yuan, Zhefeng Gong, Changyou Chen

    Abstract: Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by matching marginal feature distributions through deep transformations on the input features, due to the unavailability of target domain labels. We show that doma… ▽ More

    Submitted 23 June, 2019; originally announced June 2019.

    Comments: IJCAI-2019 Accepted

  10. arXiv:1811.05042  [pdf, other

    cs.LG stat.ML

    Exploiting Local Feature Patterns for Unsupervised Domain Adaptation

    Authors: Jun Wen, Risheng Liu, Nenggan Zheng, Qian Zheng, Zhefeng Gong, Junsong Yuan

    Abstract: Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching source and target holistic feature distributions, without considering local features and their multi-mode statistics. We show that the learned local feature patter… ▽ More

    Submitted 18 November, 2018; v1 submitted 12 November, 2018; originally announced November 2018.

    Comments: AAAI-2019 accepted

  11. arXiv:1710.04089  [pdf, ps, other

    stat.ML cs.LG

    Quantized Minimum Error Entropy Criterion

    Authors: Badong Chen, Lei Xing, Nanning Zheng, Jose C. Príncipe

    Abstract: Comparing with traditional learning criteria, such as mean square error (MSE), the minimum error entropy (MEE) criterion is superior in nonlinear and non-Gaussian signal processing and machine learning. The argument of the logarithm in Renyis entropy estimator, called information potential (IP), is a popular MEE cost in information theoretic learning (ITL). The computational complexity of IP is ho… ▽ More

    Submitted 12 October, 2017; v1 submitted 11 October, 2017; originally announced October 2017.

  12. arXiv:1708.05512  [pdf, other

    cs.CV cs.LG stat.ML

    Large Margin Learning in Set to Set Similarity Comparison for Person Re-identification

    Authors: San** Zhou, **jun Wang, Rui Shi, Qiqi Hou, Yihong Gong, Nanning Zheng

    Abstract: Person re-identification (Re-ID) aims at matching images of the same person across disjoint camera views, which is a challenging problem in multimedia analysis, multimedia editing and content-based media retrieval communities. The major challenge lies in how to preserve similarity of the same person across video footages with large appearance variations, while discriminating different individuals.… ▽ More

    Submitted 18 August, 2017; originally announced August 2017.

    Comments: Accepted by IEEE Transactions on Multimedia

  13. arXiv:1612.07019  [pdf, ps, other

    stat.ML cs.LG

    Robust Learning with Kernel Mean p-Power Error Loss

    Authors: Badong Chen, Lei Xing, Xin Wang, **g Qin, Nanning Zheng

    Abstract: Correntropy is a second order statistical measure in kernel space, which has been successfully applied in robust learning and signal processing. In this paper, we define a nonsecond order statistical measure in kernel space, called the kernel mean-p power error (KMPE), including the correntropic loss (CLoss) as a special case. Some basic properties of KMPE are presented. In particular, we apply th… ▽ More

    Submitted 21 December, 2016; originally announced December 2016.

    Comments: 11 pages, 7 figures, 10 tables

  14. Kernel Risk-Sensitive Loss: Definition, Properties and Application to Robust Adaptive Filtering

    Authors: Badong Chen, Lei Xing, Bin Xu, Haiquan Zhao, Nanning Zheng, Jose C. Principe

    Abstract: Nonlinear similarity measures defined in kernel space, such as correntropy, can extract higher-order statistics of data and offer potentially significant performance improvement over their linear counterparts especially in non-Gaussian signal processing and machine learning. In this work, we propose a new similarity measure in kernel space, called the kernel risk-sensitive loss (KRSL), and provide… ▽ More

    Submitted 1 August, 2016; originally announced August 2016.

    Comments: 12 pages,8 figures

  15. arXiv:1602.01729  [pdf, ps, other

    stat.ML cs.CV cs.NE

    Correntropy Maximization via ADMM - Application to Robust Hyperspectral Unmixing

    Authors: Fei Zhu, Abderrahim Halimi, Paul Honeine, Badong Chen, Nanning Zheng

    Abstract: In hyperspectral images, some spectral bands suffer from low signal-to-noise ratio due to noisy acquisition and atmospheric effects, thus requiring robust techniques for the unmixing problem. This paper presents a robust supervised spectral unmixing approach for hyperspectral images. The robustness is achieved by writing the unmixing problem as the maximization of the correntropy criterion subject… ▽ More

    Submitted 4 February, 2016; originally announced February 2016.

    Comments: 23 pages

  16. Generalized Correntropy for Robust Adaptive Filtering

    Authors: Badong Chen, Lei Xing, Haiquan Zhao, Nanning Zheng, José C. Príncipe

    Abstract: As a robust nonlinear similarity measure in kernel space, correntropy has received increasing attention in domains of machine learning and signal processing. In particular, the maximum correntropy criterion (MCC) has recently been successfully applied in robust regression and filtering. The default kernel function in correntropy is the Gaussian kernel, which is, of course, not always the best choi… ▽ More

    Submitted 11 April, 2015; originally announced April 2015.

    Comments: 34 pages, 9 figures, submitted to IEEE Transactions on Signal Processing

    Journal ref: IEEE Trans. on Signal Processing, vol. 64, no. 13, pp. 3376-3387, 2016

  17. Kernel Least Mean Square with Adaptive Kernel Size

    Authors: Badong Chen, Junli Liang, Nanning Zheng, Jose C. Principe

    Abstract: Kernel adaptive filters (KAF) are a class of powerful nonlinear filters developed in Reproducing Kernel Hilbert Space (RKHS). The Gaussian kernel is usually the default kernel in KAF algorithms, but selecting the proper kernel size (bandwidth) is still an open important issue especially for learning with small sample sizes. In previous research, the kernel size was set manually or estimated in adv… ▽ More

    Submitted 11 February, 2014; v1 submitted 23 January, 2014; originally announced January 2014.

    Comments: 25 pages, 9 figures, and 4 tables

    Journal ref: Neurocomputing,2016