-
Are EEG-to-Text Models Working?
Authors:
Hyejeong Jo,
Yiqian Yang,
Juhyeok Han,
Yiqun Duan,
Hui Xiong,
Won Hee Lee
Abstract:
This work critically analyzes existing models for open-vocabulary EEG-to-Text translation. We identify a crucial limitation: previous studies often employed implicit teacher-forcing during evaluation, artificially inflating performance metrics. Additionally, they lacked a critical benchmark - comparing model performance on pure noise inputs. We propose a methodology to differentiate between models…
▽ More
This work critically analyzes existing models for open-vocabulary EEG-to-Text translation. We identify a crucial limitation: previous studies often employed implicit teacher-forcing during evaluation, artificially inflating performance metrics. Additionally, they lacked a critical benchmark - comparing model performance on pure noise inputs. We propose a methodology to differentiate between models that truly learn from EEG signals and those that simply memorize training data. Our analysis reveals that model performance on noise data can be comparable to that on EEG data. These findings highlight the need for stricter evaluation practices in EEG-to-Text research, emphasizing transparent reporting and rigorous benchmarking with noise inputs. This approach will lead to more reliable assessments of model capabilities and pave the way for robust EEG-to-Text communication systems.
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
-
Neural Video Compression with Temporal Layer-Adaptive Hierarchical B-frame Coding
Authors:
Yeongwoong Kim,
Suyong Bahk,
Seungeon Kim,
Won Hee Lee,
Dokwan Oh,
Hui Yong Kim
Abstract:
Neural video compression (NVC) is a rapidly evolving video coding research area, with some models achieving superior coding efficiency compared to the latest video coding standard Versatile Video Coding (VVC). In conventional video coding standards, the hierarchical B-frame coding, which utilizes a bidirectional prediction structure for higher compression, had been well-studied and exploited. In N…
▽ More
Neural video compression (NVC) is a rapidly evolving video coding research area, with some models achieving superior coding efficiency compared to the latest video coding standard Versatile Video Coding (VVC). In conventional video coding standards, the hierarchical B-frame coding, which utilizes a bidirectional prediction structure for higher compression, had been well-studied and exploited. In NVC, however, limited research has investigated the hierarchical B scheme. In this paper, we propose an NVC model exploiting hierarchical B-frame coding with temporal layer-adaptive optimization. We first extend an existing unidirectional NVC model to a bidirectional model, which achieves -21.13% BD-rate gain over the unidirectional baseline model. However, this model faces challenges when applied to sequences with complex or large motions, leading to performance degradation. To address this, we introduce temporal layer-adaptive optimization, incorporating methods such as temporal layer-adaptive quality scaling (TAQS) and temporal layer-adaptive latent scaling (TALS). The final model with the proposed methods achieves an impressive BD-rate gain of -39.86% against the baseline. It also resolves the challenges in sequences with large or complex motions with up to -49.13% more BD-rate gains than the simple bidirectional extension. This improvement is attributed to the allocation of more bits to lower temporal layers, thereby enhancing overall reconstruction quality with smaller bits. Since our method has little dependency on a specific NVC model architecture, it can serve as a general tool for extending unidirectional NVC models to the ones with hierarchical B-frame coding.
△ Less
Submitted 5 September, 2023; v1 submitted 30 August, 2023;
originally announced August 2023.
-
Join irreducible semigroups
Authors:
Edmond W. H. Lee,
John Rhodes,
Benjamin Steinberg
Abstract:
We begin a systematic study of finite semigroups that generate join irreducible members of the lattice of pseudovarieties of finite semigroups, which are important for the spectral theory of this lattice. Finite semigroups $S$ that generate join irreducible pseudovarieties are characterized as follows: whenever $S$ divides a direct product $A \times B$ of finite semigroups, then $S$ divides either…
▽ More
We begin a systematic study of finite semigroups that generate join irreducible members of the lattice of pseudovarieties of finite semigroups, which are important for the spectral theory of this lattice. Finite semigroups $S$ that generate join irreducible pseudovarieties are characterized as follows: whenever $S$ divides a direct product $A \times B$ of finite semigroups, then $S$ divides either $A^n$ or $B^n$ for some $n \geq 1$. We present a new operator ${ \mathbf{V} \mapsto \mathbf{V}^\mathsf{bar} }$ that preserves the property of join irreducibility, as does the dual operator, and show that iteration of these operators on any nontrivial join irreducible pseudovariety leads to an infinite hierarchy of join irreducible pseudovarieties. We also describe all join irreducible pseudovarieties generated by a semigroup of order up to five. It turns out that there are $30$ such pseudovarieties, and there is a relatively easy way to remember them. In addition, we survey most results known about join irreducible pseudovarieties to date and generalize a number of results in Sec. 7.3 of The $q$-theory of Finite Semigroups, Springer Monographs in Mathematics (Springer, Berlin, 2009).
△ Less
Submitted 29 June, 2019; v1 submitted 13 February, 2017;
originally announced February 2017.
-
MOO: A Methodology for Online Optimization through Mining the Offline Optimum
Authors:
Jason W. H. Lee,
Y. C. Tay,
Anthony K. H. Tung
Abstract:
Ports, warehouses and courier services have to decide online how an arriving task is to be served in order that cost is minimized (or profit maximized). These operators have a wealth of historical data on task assignments; can these data be mined for knowledge or rules that can help the decision-making?
MOO is a novel application of data mining to online optimization. The idea is to mine (logg…
▽ More
Ports, warehouses and courier services have to decide online how an arriving task is to be served in order that cost is minimized (or profit maximized). These operators have a wealth of historical data on task assignments; can these data be mined for knowledge or rules that can help the decision-making?
MOO is a novel application of data mining to online optimization. The idea is to mine (logged) expert decisions or the offline optimum for rules that can be used for online decisions. It requires little knowledge about the task distribution and cost structure, and is applicable to a wide range of problems.
This paper presents a feasibility study of the methodology for the well-known k-server problem. Experiments with synthetic data show that optimization can be recast as classification of the optimum decisions; the resulting heuristic can achieve the optimum for strong request patterns, consistently outperforms other heuristics for weak patterns, and is robust despite changes in cost model.
△ Less
Submitted 22 March, 2000;
originally announced March 2000.
