Skip to main content

Showing 1–18 of 18 results for author: Jang, H

Searching in archive stat. Search in all archives.
.
  1. arXiv:2106.05319  [pdf, other

    cs.LG stat.ML

    Stein Latent Optimization for Generative Adversarial Networks

    Authors: Uiwon Hwang, Heeseung Kim, Dahuin Jung, Hyemi Jang, Hyungyu Lee, Sungroh Yoon

    Abstract: Generative adversarial networks (GANs) with clustered latent spaces can perform conditional generation in a completely unsupervised manner. In the real world, the salient attributes of unlabeled data can be imbalanced. However, most of existing unsupervised conditional GANs cannot cluster attributes of these data in their latent spaces properly because they assume uniform distributions of the attr… ▽ More

    Submitted 15 March, 2022; v1 submitted 9 June, 2021; originally announced June 2021.

    Comments: ICLR 2022 camera ready

  2. arXiv:2104.02468  [pdf, other

    stat.ML cs.AI cs.LG physics.comp-ph physics.plasm-ph

    A Novel Approach for Semiconductor Etching Process with Inductive Biases

    Authors: Sanghoon Myung, Hyunjae Jang, Byungseon Choi, Jisu Ryu, Hyuk Kim, Sang Wuk Park, Changwook Jeong, Dae Sin Kim

    Abstract: The etching process is one of the most important processes in semiconductor manufacturing. We have introduced the state-of-the-art deep learning model to predict the etching profiles. However, the significant problems violating physics have been found through various techniques such as explainable artificial intelligence and representation of prediction uncertainty. To address this problem, this p… ▽ More

    Submitted 6 April, 2021; originally announced April 2021.

    Comments: 5 pages; accepted to NeurIPS 2020 Workshop on Interpretable Inductive Biases and Physically Structured Learning

  3. arXiv:2102.03280  [pdf, other

    cs.LG cs.NE eess.SP stat.ML

    Multi-Sample Online Learning for Spiking Neural Networks based on Generalized Expectation Maximization

    Authors: Hyeryung Jang, Osvaldo Simeone

    Abstract: Spiking Neural Networks (SNNs) offer a novel computational paradigm that captures some of the efficiency of biological brains by processing through binary neural dynamic activations. Probabilistic SNN models are typically trained to maximize the likelihood of the desired outputs by using unbiased estimates of the log-likelihood gradients. While prior work used single-sample estimators obtained fro… ▽ More

    Submitted 5 February, 2021; originally announced February 2021.

    Comments: To be presented at ICASSP 2021. Author's Accepted Manuscript. (A longer version can be found at arXiv:2007.11894), Author's Accepted Manuscript. arXiv admin note: text overlap with arXiv:2007.11894

  4. arXiv:2012.04181  [pdf, other

    q-fin.TR q-fin.RM q-fin.ST stat.AP

    Systemic Risk in Market Microstructure of Crude Oil and Gasoline Futures Prices: A Hawkes Flocking Model Approach

    Authors: Hyun ** Jang, Kiseop Lee, Kyungsub Lee

    Abstract: We propose the Hawkes flocking model that assesses systemic risk in high-frequency processes at the two perspectives -- endogeneity and interactivity. We examine the futures markets of WTI crude oil and gasoline for the past decade, and perform a comparative analysis with conditional value-at-risk as a benchmark measure. In terms of high-frequency structure, we derive the empirical findings. The e… ▽ More

    Submitted 7 December, 2020; originally announced December 2020.

    Journal ref: Journal of Futures Markets, 40, 2020, 247-275

  5. arXiv:2007.11894  [pdf, other

    cs.LG cs.NE eess.SP stat.ML

    Multi-Sample Online Learning for Probabilistic Spiking Neural Networks

    Authors: Hyeryung Jang, Osvaldo Simeone

    Abstract: Spiking Neural Networks (SNNs) capture some of the efficiency of biological brains for inference and learning via the dynamic, online, event-driven processing of binary time series. Most existing learning algorithms for SNNs are based on deterministic neuronal models, such as leaky integrate-and-fire, and rely on heuristic approximations of backpropagation through time that enforce constraints suc… ▽ More

    Submitted 5 January, 2021; v1 submitted 23 July, 2020; originally announced July 2020.

    Comments: Submitted

  6. arXiv:2004.09416  [pdf, other

    cs.LG cs.NE eess.SP stat.ML

    VOWEL: A Local Online Learning Rule for Recurrent Networks of Probabilistic Spiking Winner-Take-All Circuits

    Authors: Hyeryung Jang, Nicolas Skatchkovsky, Osvaldo Simeone

    Abstract: Networks of spiking neurons and Winner-Take-All spiking circuits (WTA-SNNs) can detect information encoded in spatio-temporal multi-valued events. These are described by the timing of events of interest, e.g., clicks, as well as by categorical numerical values assigned to each event, e.g., like or dislike. Other use cases include object recognition from data collected by neuromorphic cameras, whic… ▽ More

    Submitted 20 April, 2020; originally announced April 2020.

    Comments: 14 pages, submitted for possible conference publication

  7. arXiv:1910.09594  [pdf, ps, other

    cs.LG cs.NE eess.SP stat.ML

    Federated Neuromorphic Learning of Spiking Neural Networks for Low-Power Edge Intelligence

    Authors: Nicolas Skatchkovsky, Hyeryung Jang, Osvaldo Simeone

    Abstract: Spiking Neural Networks (SNNs) offer a promising alternative to conventional Artificial Neural Networks (ANNs) for the implementation of on-device low-power online learning and inference. On-device training is, however, constrained by the limited amount of data available at each device. In this paper, we propose to mitigate this problem via cooperative training through Federated Learning (FL). To… ▽ More

    Submitted 21 October, 2019; originally announced October 2019.

    Comments: submitted for conference publication

  8. arXiv:1910.04500  [pdf, other

    cs.LG eess.AS stat.ML

    Orthogonality Constrained Multi-Head Attention For Keyword Spotting

    Authors: Mingu Lee, **kyu Lee, Hye ** Jang, Byeonggeun Kim, Wonil Chang, Kyuwoong Hwang

    Abstract: Multi-head attention mechanism is capable of learning various representations from sequential data while paying attention to different subsequences, e.g., word-pieces or syllables in a spoken word. From the subsequences, it retrieves richer information than a single-head attention which only summarizes the whole sequence into one context vector. However, a naive use of the multi-head attention doe… ▽ More

    Submitted 10 October, 2019; originally announced October 2019.

    Comments: Accepted to ASRU 2019

  9. arXiv:1910.01059  [pdf, other

    cs.LG cs.NE eess.SP stat.ML

    An Introduction to Probabilistic Spiking Neural Networks: Probabilistic Models, Learning Rules, and Applications

    Authors: Hyeryung Jang, Osvaldo Simeone, Brian Gardner, André Grüning

    Abstract: Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking inputs and the corresponding event-driven nature of neural processing can be leveraged by energy-efficient hardware implementations, which can offer significant en… ▽ More

    Submitted 27 November, 2019; v1 submitted 2 October, 2019; originally announced October 2019.

    Comments: Published in IEEE Signal Processing Magazine, Vol. 36, No. 6, pp. 64-77 (subsumes arXiv:1812.03929), Author's Accepted Manuscript

  10. arXiv:1909.03638  [pdf, other

    cs.LG cs.AI stat.ML

    Solving Continual Combinatorial Selection via Deep Reinforcement Learning

    Authors: Hyungseok Song, Hyeryung Jang, Hai H. Tran, Se-eun Yoon, Kyunghwan Son, Donggyu Yun, Hyoju Chung, Yung Yi

    Abstract: We consider the Markov Decision Process (MDP) of selecting a subset of items at each step, termed the Select-MDP (S-MDP). The large state and action spaces of S-MDPs make them intractable to solve with typical reinforcement learning (RL) algorithms especially when the number of items is huge. In this paper, we present a deep RL algorithm to solve this issue by adopting the following key ideas. Fir… ▽ More

    Submitted 9 September, 2019; originally announced September 2019.

    Comments: Accepted to IJCAI 2019,14 pages,8 figures

    Journal ref: Proceedings of the Twenty-Eighth International Joint Conference Artificial Intelligence, {IJCAI-19} (2019), 3467--3474

  11. arXiv:1903.00585  [pdf, other

    cs.LG cs.CR cs.CV stat.ML

    PuVAE: A Variational Autoencoder to Purify Adversarial Examples

    Authors: Uiwon Hwang, Jaewoo Park, Hyemi Jang, Sungroh Yoon, Nam Ik Cho

    Abstract: Deep neural networks are widely used and exhibit excellent performance in many areas. However, they are vulnerable to adversarial attacks that compromise the network at the inference time by applying elaborately designed perturbation to input data. Although several defense methods have been proposed to address specific attacks, other attack methods can circumvent these defense mechanisms. Therefor… ▽ More

    Submitted 1 March, 2019; originally announced March 2019.

  12. arXiv:1812.03929   

    eess.SP cs.IT cs.LG cs.NE stat.ML

    An Introduction to Spiking Neural Networks: Probabilistic Models, Learning Rules, and Applications

    Authors: Hyeryung Jang, Osvaldo Simeone, Brian Gardner, André Grüning

    Abstract: Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking inputs and the corresponding event-driven nature of neural processing can be leveraged by hardware implementations that have demonstrated significant energy reduct… ▽ More

    Submitted 20 October, 2019; v1 submitted 10 December, 2018; originally announced December 2018.

    Comments: This article is now superseded by arXiv:1910.01059. To appear on IEEE Signal Processing Magazine

  13. arXiv:1810.08940  [pdf, other

    cs.LG cs.IT eess.SP stat.ML

    Training Dynamic Exponential Family Models with Causal and Lateral Dependencies for Generalized Neuromorphic Computing

    Authors: Hyeryung Jang, Osvaldo Simeone

    Abstract: Neuromorphic hardware platforms, such as Intel's Loihi chip, support the implementation of Spiking Neural Networks (SNNs) as an energy-efficient alternative to Artificial Neural Networks (ANNs). SNNs are networks of neurons with internal analogue dynamics that communicate by means of binary time series. In this work, a probabilistic model is introduced for a generalized set-up in which the synapti… ▽ More

    Submitted 18 December, 2019; v1 submitted 21 October, 2018; originally announced October 2018.

    Comments: Published in IEEE ICASSP 2019. Author's Accepted Manuscript

  14. arXiv:1807.11655  [pdf, other

    cs.CR cs.LG stat.ML

    Security and Privacy Issues in Deep Learning

    Authors: Ho Bae, Jaehee Jang, Dahuin Jung, Hyemi Jang, Heonseok Ha, Hyungyu Lee, Sungroh Yoon

    Abstract: To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that can compromise its integrity and efficiency. Security attacks can be divided based on when they occur: if an attack occurs during training, it is known as a poi… ▽ More

    Submitted 9 March, 2021; v1 submitted 31 July, 2018; originally announced July 2018.

  15. arXiv:1804.10942  [pdf, other

    stat.ML cs.LG

    Learning Data Dependency with Communication Cost

    Authors: Hyeryung Jang, HyungSeok Song, Yung Yi

    Abstract: In this paper, we consider the problem of recovering a graph that represents the statistical data dependency among nodes for a set of data samples generated by nodes, which provides the basic structure to perform an inference task, such as MAP (maximum a posteriori). This problem is referred to as structure learning. When nodes are spatially separated in different locations, running an inference a… ▽ More

    Submitted 29 April, 2018; originally announced April 2018.

    Comments: 33 pages, to appear at MobiHoc'18

  16. arXiv:1605.08174  [pdf, other

    cs.LG stat.ML

    Adiabatic Persistent Contrastive Divergence Learning

    Authors: Hyeryung Jang, Hyungwon Choi, Yung Yi, **woo Shin

    Abstract: This paper studies the problem of parameter learning in probabilistic graphical models having latent variables, where the standard approach is the expectation maximization algorithm alternating expectation (E) and maximization (M) steps. However, both E and M steps are computationally intractable for high dimensional data, while the substitution of one step to a faster surrogate for combating agai… ▽ More

    Submitted 14 February, 2017; v1 submitted 26 May, 2016; originally announced May 2016.

    Comments: 22 pages, 2 figures

  17. arXiv:1406.7250  [pdf, other

    q-bio.PE cs.LG stat.ML

    Reconstructing subclonal composition and evolution from whole genome sequencing of tumors

    Authors: Amit G. Deshwar, Shankar Vembu, Christina K. Yung, Gun Ho Jang, Lincoln Stein, Quaid Morris

    Abstract: Tumors often contain multiple subpopulations of cancerous cells defined by distinct somatic mutations. We describe a new method, PhyloWGS, that can be applied to WGS data from one or more tumor samples to reconstruct complete genotypes of these subpopulations based on variant allele frequencies (VAFs) of point mutations and population frequencies of structural variations. We introduce a principled… ▽ More

    Submitted 6 January, 2015; v1 submitted 27 June, 2014; originally announced June 2014.

  18. Weak Informativity and the Information in One Prior Relative to Another

    Authors: Michael Evans, Gun Ho Jang

    Abstract: A question of some interest is how to characterize the amount of information that a prior puts into a statistical analysis. Rather than a general characterization, we provide an approach to characterizing the amount of information a prior puts into an analysis, when compared to another base prior. The base prior is considered to be the prior that best reflects the current available information. Ou… ▽ More

    Submitted 9 January, 2012; originally announced January 2012.

    Comments: Published in at http://dx.doi.org/10.1214/11-STS357 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

    Report number: IMS-STS-STS357

    Journal ref: Statistical Science 2011, Vol. 26, No. 3, 423-439