-
2023 Low-Power Computer Vision Challenge (LPCVC) Summary
Authors:
Leo Chen,
Benjamin Boardley,
** Hu,
Yiru Wang,
Yifan Pu,
Xin **,
Yongqiang Yao,
Ruihao Gong,
Bo Li,
Gao Huang,
Xianglong Liu,
Zifu Wan,
Xinwang Chen,
Ning Liu,
Ziyi Zhang,
Dong** Liu,
Ruijie Shan,
Zheng** Che,
Fachao Zhang,
Xiaofeng Mou,
Jian Tang,
Maxim Chuprov,
Ivan Malofeev,
Alexander Goncharenko,
Andrey Shcherbin
, et al. (5 additional authors not shown)
Abstract:
This article describes the 2023 IEEE Low-Power Computer Vision Challenge (LPCVC). Since 2015, LPCVC has been an international competition devoted to tackling the challenge of computer vision (CV) on edge devices. Most CV researchers focus on improving accuracy, at the expense of ever-growing sizes of machine models. LPCVC balances accuracy with resource requirements. Winners must achieve high accu…
▽ More
This article describes the 2023 IEEE Low-Power Computer Vision Challenge (LPCVC). Since 2015, LPCVC has been an international competition devoted to tackling the challenge of computer vision (CV) on edge devices. Most CV researchers focus on improving accuracy, at the expense of ever-growing sizes of machine models. LPCVC balances accuracy with resource requirements. Winners must achieve high accuracy with short execution time when their CV solutions run on an embedded device, such as Raspberry PI or Nvidia Jetson Nano. The vision problem for 2023 LPCVC is segmentation of images acquired by Unmanned Aerial Vehicles (UAVs, also called drones) after disasters. The 2023 LPCVC attracted 60 international teams that submitted 676 solutions during the submission window of one month. This article explains the setup of the competition and highlights the winners' methods that improve accuracy and shorten execution time.
△ Less
Submitted 11 March, 2024;
originally announced March 2024.
-
Reply to Discussions of "Multivariate Dynamic Modeling for Bayesian Forecasting of Business Revenue"
Authors:
Anna K. Yanchenko,
Graham Tierney,
Joseph Lawson,
Christoph Hellmayr,
Andrew Cron,
Mike West
Abstract:
We are most grateful to all discussants for their positive comments and many thought-provoking questions. In addition, the discussants provide a number of useful leads into various areas of the literatures on time series, forecasting and commercial application within which the work in our paper is, of course, just one contribution linked to multiple threads. Our view is that, collectively, the dis…
▽ More
We are most grateful to all discussants for their positive comments and many thought-provoking questions. In addition, the discussants provide a number of useful leads into various areas of the literatures on time series, forecasting and commercial application within which the work in our paper is, of course, just one contribution linked to multiple threads. Our view is that, collectively, the discussion contributions nicely expand on the core of the paper and together -- with multiple additional references -- provide an excellent point-of-entrée to the broader field of retail forecasting and its research challenges. Interested readers are encouraged to dig deeply into the discussions and our responses here, and explore referenced sources.
There are several themes that recur across discussants, as well as a range of specific points/questions raised. Following some "big-picture" comments on our perspectives on Bayesian forecasting systems, we comment in turn on some specifics in each contribution.
△ Less
Submitted 2 April, 2023;
originally announced April 2023.
-
Multivariate Dynamic Modeling for Bayesian Forecasting of Business Revenue
Authors:
Anna K. Yanchenko,
Graham Tierney,
Joseph Lawson,
Christoph Hellmayr,
Andrew Cron,
Mike West
Abstract:
Forecasting enterprise-wide revenue is critical to many companies and presents several challenges and opportunities for significant business impact. This case study is based on model developments to address these challenges for forecasting in a large-scale retail company. Focused on multivariate revenue forecasting across collections of supermarkets and product Categories, hierarchical dynamic mod…
▽ More
Forecasting enterprise-wide revenue is critical to many companies and presents several challenges and opportunities for significant business impact. This case study is based on model developments to address these challenges for forecasting in a large-scale retail company. Focused on multivariate revenue forecasting across collections of supermarkets and product Categories, hierarchical dynamic models are natural: these are able to couple revenue streams in an integrated forecasting model, while allowing conditional decoupling to enable relevant and sensitive analysis together with scalable computation. Structured models exploit multi-scale modeling to cascade information on price and promotion activities as predictors relevant across Categories and groups of stores. With a context-relevant focus on forecasting revenue 12 weeks ahead, the study highlights product Categories that benefit from multi-scale information, defines insights into when, how and why multivariate models improve forecast accuracy, and shows how cross-Category dependencies can relate to promotion decisions in one Category impacting others. Bayesian modeling developments underlying the case study are accessible in custom code for interested readers.
△ Less
Submitted 10 December, 2021;
originally announced December 2021.
-
A Methodology for Exploring Deep Convolutional Features in Relation to Hand-Crafted Features with an Application to Music Audio Modeling
Authors:
Anna K. Yanchenko,
Mohammadreza Soltani,
Robert J. Ravier,
Sayan Mukherjee,
Vahid Tarokh
Abstract:
Understanding the features learned by deep models is important from a model trust perspective, especially as deep systems are deployed in the real world. Most recent approaches for deep feature understanding or model explanation focus on highlighting input data features that are relevant for classification decisions. In this work, we instead take the perspective of relating deep features to well-s…
▽ More
Understanding the features learned by deep models is important from a model trust perspective, especially as deep systems are deployed in the real world. Most recent approaches for deep feature understanding or model explanation focus on highlighting input data features that are relevant for classification decisions. In this work, we instead take the perspective of relating deep features to well-studied, hand-crafted features that are meaningful for the application of interest. We propose a methodology and set of systematic experiments for exploring deep features in this setting, where input feature importance approaches for deep feature understanding do not apply. Our experiments focus on understanding which hand-crafted and deep features are useful for the classification task of interest, how robust these features are for related tasks and how similar the deep features are to the meaningful hand-crafted features. Our proposed method is general to many application areas and we demonstrate its utility on orchestral music audio data.
△ Less
Submitted 9 October, 2021; v1 submitted 31 May, 2021;
originally announced June 2021.
-
Hierarchical Dynamic Modeling for Individualized Bayesian Forecasting
Authors:
Anna K. Yanchenko,
Di Daniel Deng,
**glan Li,
Andrew J. Cron,
Mike West
Abstract:
We present a case study and methodological developments in large-scale hierarchical dynamic modeling for personalized prediction in commerce. The context is supermarket sales, where improved forecasting of customer/household-specific purchasing behavior informs decisions about personalized pricing and promotions on a continuing basis. This is a big data, big modeling and forecasting setting involv…
▽ More
We present a case study and methodological developments in large-scale hierarchical dynamic modeling for personalized prediction in commerce. The context is supermarket sales, where improved forecasting of customer/household-specific purchasing behavior informs decisions about personalized pricing and promotions on a continuing basis. This is a big data, big modeling and forecasting setting involving many thousands of customers and items on sale, requiring sequential analysis, addressing information flows at multiple levels over time, and with heterogeneity of customer profiles and item categories. Models developed are fully Bayesian, interpretable and multi-scale, with hierarchical forms overlaid on the inherent structure of the retail setting. Customer behavior is modeled at several levels of aggregation, and information flows from aggregate to individual levels. Forecasting at an individual household level infers price sensitivity to inform personalized pricing and promotion decisions. Methodological innovations include extensions of Bayesian dynamic mixture models, their integration into multi-scale systems, and forecast evaluation with context-specific metrics. The use of simultaneous predictors from multiple hierarchical levels improves forecasts at the customer-item level of main interest. This is evidenced across many different households and items, indicating the utility of the modeling framework for this and other individualized forecasting applications.
△ Less
Submitted 9 January, 2021;
originally announced January 2021.
-
Network Analysis of Orchestral Concert Programming
Authors:
Anna K. Yanchenko
Abstract:
Orchestral concert programming is a challenging, yet critical task for expanding audience engagement and is usually driven by qualitative heuristics and common musical practices. Quantitative analysis of orchestral programming has been limited, but has become more possible as many orchestras archive their performance history online. The contribution of this work is to use statistical network model…
▽ More
Orchestral concert programming is a challenging, yet critical task for expanding audience engagement and is usually driven by qualitative heuristics and common musical practices. Quantitative analysis of orchestral programming has been limited, but has become more possible as many orchestras archive their performance history online. The contribution of this work is to use statistical network models to quantitatively explore orchestral concert programming, focusing on which factors determine if two composers are programmed together in the same concert by the Boston Symphony Orchestra. We find that the type of composition is the most important covariate in determining which composers are performed together and the additive and multiplicative effects are logical from an orchestral programming perspective. These results suggest that a network analysis is a promising approach for the analysis of concert programming, with several directions for future extensions.
△ Less
Submitted 16 September, 2020;
originally announced September 2020.
-
Stanza: A Nonlinear State Space Model for Probabilistic Inference in Non-Stationary Time Series
Authors:
Anna K. Yanchenko,
Sayan Mukherjee
Abstract:
Time series with long-term structure arise in a variety of contexts and capturing this temporal structure is a critical challenge in time series analysis for both inference and forecasting settings. Traditionally, state space models have been successful in providing uncertainty estimates of trajectories in the latent space. More recently, deep learning, attention-based approaches have achieved sta…
▽ More
Time series with long-term structure arise in a variety of contexts and capturing this temporal structure is a critical challenge in time series analysis for both inference and forecasting settings. Traditionally, state space models have been successful in providing uncertainty estimates of trajectories in the latent space. More recently, deep learning, attention-based approaches have achieved state of the art performance for sequence modeling, though often require large amounts of data and parameters to do so. We propose Stanza, a nonlinear, non-stationary state space model as an intermediate approach to fill the gap between traditional models and modern deep learning approaches for complex time series. Stanza strikes a balance between competitive forecasting accuracy and probabilistic, interpretable inference for highly structured time series. In particular, Stanza achieves forecasting accuracy competitive with deep LSTMs on real-world datasets, especially for multi-step ahead forecasting.
△ Less
Submitted 11 June, 2020;
originally announced June 2020.
-
Hierarchical Multidimensional Scaling for the Comparison of Musical Performance Styles
Authors:
Anna K. Yanchenko,
Peter D. Hoff
Abstract:
Quantification of stylistic differences between musical artists is of academic interest to the music community, and is also useful for other applications such as music information retrieval and recommendation systems. Information about stylistic differences can be obtained by comparing the performances of different artists across common musical pieces. In this article, we develop a statistical met…
▽ More
Quantification of stylistic differences between musical artists is of academic interest to the music community, and is also useful for other applications such as music information retrieval and recommendation systems. Information about stylistic differences can be obtained by comparing the performances of different artists across common musical pieces. In this article, we develop a statistical methodology for identifying and quantifying systematic stylistic differences among artists that are consistent across audio recordings of a common set of pieces, in terms of several musical features. Our focus is on a comparison of ten different orchestras, based on data from audio recordings of the nine Beethoven symphonies. As generative or fully parametric models of raw audio data can be highly complex, and more complex than necessary for our goal of identifying differences between orchestras, we propose to reduce the data from a set of audio recordings down to pairwise distances between orchestras, based on different musical characteristics of the recordings, such as tempo, dynamics, and timbre. For each of these characteristics, we obtain multiple pairwise distance matrices, one for each movement of each symphony. We develop a hierarchical multidimensional scaling (HMDS) model to identify and quantify systematic differences between orchestras in terms of these three musical characteristics, and interpret the results in the context of known qualitative information about the orchestras. This methodology is able to recover several expected systematic similarities between orchestras, as well as to identify some more novel results. For example, we find that modern recordings exhibit a high degree of similarity to each other, as compared to older recordings.
△ Less
Submitted 21 December, 2020; v1 submitted 28 April, 2020;
originally announced April 2020.
-
Classical Music Composition Using State Space Models
Authors:
Anna K. Yanchenko,
Sayan Mukherjee
Abstract:
Algorithmic composition of music has a long history and with the development of powerful deep learning methods, there has recently been increased interest in exploring algorithms and models to create art. We explore the utility of state space models, in particular hidden Markov models (HMMs) and variants, in composing classical piano pieces from the Romantic era and consider the models' ability to…
▽ More
Algorithmic composition of music has a long history and with the development of powerful deep learning methods, there has recently been increased interest in exploring algorithms and models to create art. We explore the utility of state space models, in particular hidden Markov models (HMMs) and variants, in composing classical piano pieces from the Romantic era and consider the models' ability to generate new pieces that sound like they were composed by a human. We find that the models we explored are fairly successful at generating new pieces that have largely consonant harmonies, especially when trained on original pieces with simple harmonic structure. However, we conclude that the major limitation in using these models to generate music that sounds like it was composed by a human is the lack of melodic progression in the composed pieces. We also examine the performance of the models in the context of music theory.
△ Less
Submitted 28 September, 2018; v1 submitted 12 August, 2017;
originally announced August 2017.
-
Predicting Exploitation of Disclosed Software Vulnerabilities Using Open-source Data
Authors:
Benjamin L. Bullough,
Anna K. Yanchenko,
Christopher L. Smith,
Joseph R. Zipkin
Abstract:
Each year, thousands of software vulnerabilities are discovered and reported to the public. Unpatched known vulnerabilities are a significant security risk. It is imperative that software vendors quickly provide patches once vulnerabilities are known and users quickly install those patches as soon as they are available. However, most vulnerabilities are never actually exploited. Since writing, tes…
▽ More
Each year, thousands of software vulnerabilities are discovered and reported to the public. Unpatched known vulnerabilities are a significant security risk. It is imperative that software vendors quickly provide patches once vulnerabilities are known and users quickly install those patches as soon as they are available. However, most vulnerabilities are never actually exploited. Since writing, testing, and installing software patches can involve considerable resources, it would be desirable to prioritize the remediation of vulnerabilities that are likely to be exploited. Several published research studies have reported moderate success in applying machine learning techniques to the task of predicting whether a vulnerability will be exploited. These approaches typically use features derived from vulnerability databases (such as the summary text describing the vulnerability) or social media posts that mention the vulnerability by name. However, these prior studies share multiple methodological shortcomings that inflate predictive power of these approaches. We replicate key portions of the prior work, compare their approaches, and show how selection of training and test data critically affect the estimated performance of predictive models. The results of this study point to important methodological considerations that should be taken into account so that results reflect real-world utility.
△ Less
Submitted 25 July, 2017;
originally announced July 2017.
-
Ultrafast Plasmonic Control of Second Harmonic Generation
Authors:
Roderick B. Davidson II,
Anna Yanchenko,
Jed I. Ziegler,
Sergey M. Avanesyan,
Ben J. Lawrie,
Richard F. Haglund Jr
Abstract:
Efficient frequency conversion techniques are crucial to the development of plasmonic metasurfaces for information processing and signal modulation. In principle, nanoscale electric-field confinement in nonlinear materials enables higher harmonic conversion efficiencies per unit volume than those attainable in bulk materials. Here we demonstrate efficient second-harmonic generation (SHG) in a serr…
▽ More
Efficient frequency conversion techniques are crucial to the development of plasmonic metasurfaces for information processing and signal modulation. In principle, nanoscale electric-field confinement in nonlinear materials enables higher harmonic conversion efficiencies per unit volume than those attainable in bulk materials. Here we demonstrate efficient second-harmonic generation (SHG) in a serrated nanogap plasmonic geometry that generates steep electric field gradients on a dielectric metasurface. An ultrafast pump is used to control plasmon-induced electric fields in a thin-film material with inversion symmetry that, without plasmonic enhancement, does not exhibit an an even-order nonlinear optical response. The temporal evolution of the plasmonic near-field is characterized with ~100as resolution using a novel nonlinear interferometric technique. The ability to manipulate nonlinear signals in a metamaterial geometry as demonstrated here is indispensable both to understanding the ultrafast nonlinear response of nanoscale materials, and to producing active, optically reconfigurable plasmonic devices
△ Less
Submitted 16 February, 2016; v1 submitted 18 March, 2015;
originally announced March 2015.