-
A nonlinearity and model specification test for functional time series
Authors:
Xin Huang,
Han Lin Shang,
Tak Kuen Siu
Abstract:
An important issue in functional time series analysis is whether an observed series comes from a purely random process. We extend the BDS test, a widely-used nonlinear independence test, to the functional time series. Like the BDS test in the univariate case, the functional BDS test can act as the model specification test to evaluate the adequacy of various prediction models and as a nonlinearity…
▽ More
An important issue in functional time series analysis is whether an observed series comes from a purely random process. We extend the BDS test, a widely-used nonlinear independence test, to the functional time series. Like the BDS test in the univariate case, the functional BDS test can act as the model specification test to evaluate the adequacy of various prediction models and as a nonlinearity test to detect the existence of nonlinear structures in a functional time series after removing the linear structure exhibited. We show that the test statistic from the functional BDS test has the same asymptotic properties as those in the univariate case and provides the recommended range of its hyperparameters. Additionally, empirical data analysis features its applications in evaluating the adequacy of the fAR(1) and fGARCH(1,1) models in fitting the daily curves of cumulative intraday returns (CIDR) of the VIX index. We showed that the functional BDS test remedies the weakness of the existing independence test in the literature, as the latter is restricted in detecting linear structures, thus, can neglect nonlinear temporal structures.
△ Less
Submitted 4 April, 2023;
originally announced April 2023.
-
Expressing Multivariate Time Series as Graphs with Time Series Attention Transformer
Authors:
William T. Ng,
K. Siu,
Albert C. Cheung,
Michael K. Ng
Abstract:
A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are inter-dependencies among variables as well. Models have to be designed to capture both intra- and inter-relationships among the time series. To move towards this goal, we pr…
▽ More
A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are inter-dependencies among variables as well. Models have to be designed to capture both intra- and inter-relationships among the time series. To move towards this goal, we propose the Time Series Attention Transformer (TSAT) for multivariate time series representation learning. Using TSAT, we represent both temporal information and inter-dependencies of multivariate time series in terms of edge-enhanced dynamic graphs. The intra-series correlations are represented by nodes in a dynamic graph; a self-attention mechanism is modified to capture the inter-series correlations by using the super-empirical mode decomposition (SMD) module. We applied the embedded dynamic graphs to times series forecasting problems, including two real-world datasets and two benchmark datasets. Extensive experiments show that TSAT clearly outerperforms six state-of-the-art baseline methods in various forecasting horizons. We further visualize the embedded dynamic graphs to illustrate the graph representation power of TSAT. We share our code at https://github.com/RadiantResearch/TSAT.
△ Less
Submitted 19 August, 2022;
originally announced August 2022.
-
Regime Switching Optimal Growth Model with Risk Sensitive Preferences
Authors:
Anindya Goswami,
Nimit Rana,
Tak Kuen Siu
Abstract:
We consider a risk-sensitive optimization of consumption-utility on infinite time horizon where the one-period investment gain depends on an underlying economic state whose evolution over time is assumed to be described by a discrete-time, finite-state, Markov chain. We suppose that the production function also depends on a sequence of i.i.d. random shocks. For the sake of generality, the utility…
▽ More
We consider a risk-sensitive optimization of consumption-utility on infinite time horizon where the one-period investment gain depends on an underlying economic state whose evolution over time is assumed to be described by a discrete-time, finite-state, Markov chain. We suppose that the production function also depends on a sequence of i.i.d. random shocks. For the sake of generality, the utility and the production functions are allowed to be unbounded from above. Under the Markov regime-switching model, it is shown that the value function of optimization problem satisfies an optimality equation and that the optimality equation has a unique solution in a particular class of functions. Furthermore, we show that an optimal policy exists in the class of stationary policies. We also derive the Euler equation of optimal consumption. Furthermore, the existence of the unique joint stationary distribution of the optimal growth process and the underlying regime process is examined. Finally, we present a numerical solution by considering power utility and some hypothetical values of parameters in a regime switching extension of Cobb-Douglas production rate function.
△ Less
Submitted 17 November, 2021; v1 submitted 28 October, 2021;
originally announced October 2021.
-
DPRed: Making Typical Activation and Weight Values Matter In Deep Learning Computing
Authors:
Alberto Delmas,
Sayeh Sharify,
Patrick Judd,
Kevin Siu,
Milos Nikolic,
Andreas Moshovos
Abstract:
We show that selecting a single data type (precision) for all values in Deep Neural Networks, even if that data type is different per layer, amounts to worst case design. Much shorter data types can be used if we target the common case by adjusting the precision at a much finer granularity. We propose Dynamic Precision Reduction (DPRed), where we group weights and activations and encode them using…
▽ More
We show that selecting a single data type (precision) for all values in Deep Neural Networks, even if that data type is different per layer, amounts to worst case design. Much shorter data types can be used if we target the common case by adjusting the precision at a much finer granularity. We propose Dynamic Precision Reduction (DPRed), where we group weights and activations and encode them using a precision specific to each group. The per group precisions are selected statically for the weights and dynamically by hardware for the activations. We exploit these precisions to reduce: 1) off-chip storage and off- and on-chip communication, and 2) execution time. DPRed compression reduces off-chip traffic to nearly 35% and 33% on average compared to no compression respectively for 16b and 8b models. This makes it possible to sustain higher performance for a given off-chip memory interface while also boosting energy efficiency. We also demonstrate designs where the time required to process each group of activations and/or weights scales proportionally to the precision they use for convolutional and fully-connected layers. This improves execution time and energy efficiency for both dense and sparse networks. We show the techniques work with 8-bit networks, where 1.82x and 2.81x speedups are achieved for two different hardware variants that take advantage of dynamic precision variability.
△ Less
Submitted 17 December, 2018; v1 submitted 16 April, 2018;
originally announced April 2018.
-
Loom: Exploiting Weight and Activation Precisions to Accelerate Convolutional Neural Networks
Authors:
Sayeh Sharify,
Alberto Delmas Lascorz,
Kevin Siu,
Patrick Judd,
Andreas Moshovos
Abstract:
Loom (LM), a hardware inference accelerator for Convolutional Neural Networks (CNNs) is presented. In LM every bit of data precision that can be saved translates to proportional performance gains. Specifically, for convolutional layers LM's execution time scales inversely proportionally with the precisions of both weights and activations. For fully-connected layers LM's performance scales inversel…
▽ More
Loom (LM), a hardware inference accelerator for Convolutional Neural Networks (CNNs) is presented. In LM every bit of data precision that can be saved translates to proportional performance gains. Specifically, for convolutional layers LM's execution time scales inversely proportionally with the precisions of both weights and activations. For fully-connected layers LM's performance scales inversely proportionally with the precision of the weights. LM targets area- and bandwidth-constrained System-on-a-Chip designs such as those found on mobile devices that cannot afford the multi-megabyte buffers that would be needed to store each layer on-chip. Accordingly, given a data bandwidth budget, LM boosts energy efficiency and performance over an equivalent bit-parallel accelerator. For both weights and activations LM can exploit profile-derived perlayer precisions. However, at runtime LM further trims activation precisions at a much smaller than a layer granularity. Moreover, it can naturally exploit weight precision variability at a smaller granularity than a layer. On average, across several image classification CNNs and for a configuration that can perform the equivalent of 128 16b x 16b multiply-accumulate operations per cycle LM outperforms a state-of-the-art bit-parallel accelerator [1] by 4.38x without any loss in accuracy while being 3.54x more energy efficient. LM can trade-off accuracy for additional improvements in execution performance and energy efficiency and compares favorably to an accelerator that targeted only activation precisions. We also study 2- and 4-bit LM variants and find the the 2-bit per cycle variant is the most energy efficient.
△ Less
Submitted 16 May, 2018; v1 submitted 23 June, 2017;
originally announced June 2017.
-
A Framework for Exploring and Evaluating Mechanics in Human Computation Games
Authors:
Kristin Siu,
Alexander Zook,
Mark O. Riedl
Abstract:
Human computation games (HCGs) are a crowdsourcing approach to solving computationally-intractable tasks using games. In this paper, we describe the need for generalizable HCG design knowledge that accommodates the needs of both players and tasks. We propose a formal representation of the mechanics in HCGs, providing a structural breakdown to visualize, compare, and explore the space of HCG mechan…
▽ More
Human computation games (HCGs) are a crowdsourcing approach to solving computationally-intractable tasks using games. In this paper, we describe the need for generalizable HCG design knowledge that accommodates the needs of both players and tasks. We propose a formal representation of the mechanics in HCGs, providing a structural breakdown to visualize, compare, and explore the space of HCG mechanics. We present a methodology based on small-scale design experiments using fixed tasks while varying game elements to observe effects on both the player experience and the human computation task completion. Finally we discuss applications of our framework using comparisons of prior HCGs and recent design experiments. Ultimately, we wish to enable easier exploration and development of HCGs, hel** these games provide meaningful player experiences while solving difficult problems.
△ Less
Submitted 11 June, 2017;
originally announced June 2017.
-
Evaluating Singleplayer and Multiplayer in Human Computation Games
Authors:
Kristin Siu,
Matthew Guzdial,
Mark O. Riedl
Abstract:
Human computation games (HCGs) can provide novel solutions to intractable computational problems, help enable scientific breakthroughs, and provide datasets for artificial intelligence. However, our knowledge about how to design and deploy HCGs that appeal to players and solve problems effectively is incomplete. We present an investigatory HCG based on Super Mario Bros. We used this game in a huma…
▽ More
Human computation games (HCGs) can provide novel solutions to intractable computational problems, help enable scientific breakthroughs, and provide datasets for artificial intelligence. However, our knowledge about how to design and deploy HCGs that appeal to players and solve problems effectively is incomplete. We present an investigatory HCG based on Super Mario Bros. We used this game in a human subjects study to investigate how different social conditions---singleplayer and multiplayer---and scoring mechanics---collaborative and competitive---affect players' subjective experiences, accuracy at the task, and the completion rate. In doing so, we demonstrate a novel design approach for HCGs, and discuss the benefits and tradeoffs of these mechanics in HCG design.
△ Less
Submitted 2 March, 2017;
originally announced March 2017.
-
Bilayer manganites: polarons in the midst of a metallic breakdown
Authors:
F. Massee,
S. de Jong. Y. Huang,
W. K. Siu,
I. Santoso,
A. Mans,
A. T. Boothroyd,
D. Prabhakaran,
R. Follath,
A. Varykhalov,
L. Patthey,
M. Shi,
J. B. Goedkoop,
M. S. Golden
Abstract:
The exact nature of the low temperature electronic phase of the manganite materials family, and hence the origin of their colossal magnetoresistant (CMR) effect, is still under heavy debate. By combining new photoemission and tunneling data, we show that in La{2-2x}Sr{1+2x}Mn2O7 the polaronic degrees of freedom win out across the CMR region of the phase diagram. This means that the generic ground…
▽ More
The exact nature of the low temperature electronic phase of the manganite materials family, and hence the origin of their colossal magnetoresistant (CMR) effect, is still under heavy debate. By combining new photoemission and tunneling data, we show that in La{2-2x}Sr{1+2x}Mn2O7 the polaronic degrees of freedom win out across the CMR region of the phase diagram. This means that the generic ground state is that of a system in which strong electron-lattice interactions result in vanishing coherent quasi-particle spectral weight at the Fermi level for all locations in k-space. The incoherence of the charge carriers offers a unifying explanation for the anomalous charge-carrier dynamics seen in transport, optics and electron spectroscopic data. The stacking number N is the key factor for true metallic behavior, as an intergrowth-driven breakdown of the polaronic domination to give a metal possessing a traditional Fermi surface is seen in the bilayer system.
△ Less
Submitted 19 March, 2011;
originally announced March 2011.
-
Antinodal quasiparticles below and above T_Curie in the CMR oxide La_(2-2x)Sr_(1+2x)Mn_(2)O_(7) with x=0.36
Authors:
S. de Jong,
Y. Huang,
I. Santoso,
F. Massee,
W. K. Siu,
A. Mans,
R. Follath,
O. Schwartzkopf,
M. S. Golden
Abstract:
In light of recent conflicting angle resolved photoemission studies on the bilayered colossal magnetoresistant (CMR) manganite La_{2-2x}Sr_{1+2x}Mn_{2}O_{7} (0.36< x< 0.40), new ARPES data are presented for x=0.36 and 0.40, showing only for the former clear quasiparticle-like features at and around the (pi, 0)-point in k-space. The electronic states are clearly renormalised, both as regards thei…
▽ More
In light of recent conflicting angle resolved photoemission studies on the bilayered colossal magnetoresistant (CMR) manganite La_{2-2x}Sr_{1+2x}Mn_{2}O_{7} (0.36< x< 0.40), new ARPES data are presented for x=0.36 and 0.40, showing only for the former clear quasiparticle-like features at and around the (pi, 0)-point in k-space. The electronic states are clearly renormalised, both as regards their dispersion relation and lifetime due to coupling to bosonic degrees of freedom. Importantly, both the existence of quasiparticles and their renormalisation survive well into the paramagnetic state, up to 50 K above T_Curie. This argues against strong coupling to spin modes and raises questions regarding the nature of the paramagnetic insulating phase.
△ Less
Submitted 10 November, 2006;
originally announced November 2006.
-
A Brief Overview of ATM: Protocol Layers, LAN Emulation, and Traffic Management
Authors:
K. Siu,
R. Jain
Abstract:
Asynchronous Transfer Mode (ATM) has emerged as the most promising technology in supporting future broadband multimedia communication services. To accelerate the deployment of ATM technology, the ATM Forum, which is a consortium of service providers and equipment vendors in the communication industries has been created to develop implementation and specification agreements. In this article, we p…
▽ More
Asynchronous Transfer Mode (ATM) has emerged as the most promising technology in supporting future broadband multimedia communication services. To accelerate the deployment of ATM technology, the ATM Forum, which is a consortium of service providers and equipment vendors in the communication industries has been created to develop implementation and specification agreements. In this article, we present a brief overview on ATM protocol layers and current progress on LAN Emulation and Traffic Management in the ATM Forum.
△ Less
Submitted 24 September, 1998;
originally announced September 1998.
