-
On Locality of Quantum Information in the Heisenberg Picture for Arbitrary States
Authors:
Otto C. W. Kong
Abstract:
The locality issue of quantum mechanics is a key issue to a proper understanding of quantum physics and beyond. What has been commonly emphasized as quantum nonlocality has received an inspiring examination through the notion of Heisenberg picture of quantum information. Deutsch and Hayden established a local description of quantum information in a setting of quantum information flow in a system o…
▽ More
The locality issue of quantum mechanics is a key issue to a proper understanding of quantum physics and beyond. What has been commonly emphasized as quantum nonlocality has received an inspiring examination through the notion of Heisenberg picture of quantum information. Deutsch and Hayden established a local description of quantum information in a setting of quantum information flow in a system of qubits. With the introduction of a slightly modified version of what we call the Deutsch-Hayden matrix values of observables, together with our recently introduced parallel notion of the noncommutative values from a more fundamental perspective, we clarify all the locality issues based on such values as quantum information carried by local observables in any given arbitrary state of a generic composite system. Quantum information as the {\em `quantum' values} of observables gives a transparent conceptual picture of all the. Spatial locality for a projective measurement is also discussed. The pressing question is if and how such information for an entangled system can be retrieved through local processes which can only be addressed with new experimental thinking.
△ Less
Submitted 10 June, 2024; v1 submitted 4 September, 2022;
originally announced September 2022.
-
Conservative Generator, Progressive Discriminator: Coordination of Adversaries in Few-shot Incremental Image Synthesis
Authors:
Chaerin Kong,
Nojun Kwak
Abstract:
The capacity to learn incrementally from an online stream of data is an envied trait of human learners, as deep neural networks typically suffer from catastrophic forgetting and stability-plasticity dilemma. Several works have previously explored incremental few-shot learning, a task with greater challenges due to data constraint, mostly in classification setting with mild success. In this work, w…
▽ More
The capacity to learn incrementally from an online stream of data is an envied trait of human learners, as deep neural networks typically suffer from catastrophic forgetting and stability-plasticity dilemma. Several works have previously explored incremental few-shot learning, a task with greater challenges due to data constraint, mostly in classification setting with mild success. In this work, we study the underrepresented task of generative incremental few-shot learning. To effectively handle the inherent challenges of incremental learning and few-shot learning, we propose a novel framework named ConPro that leverages the two-player nature of GANs. Specifically, we design a conservative generator that preserves past knowledge in parameter and compute efficient manner, and a progressive discriminator that learns to reason semantic distances between past and present task samples, minimizing overfitting with few data points and pursuing good forward transfer. We present experiments to validate the effectiveness of ConPro.
△ Less
Submitted 29 July, 2022;
originally announced July 2022.
-
Quantum Origin of (Newtonian) Mass and Galilean Relativity Symmetry
Authors:
Otto C. W. Kong
Abstract:
The Galilei group has been taken as the fundamental symmetry for 'nonrelativistic' physics, quantum or classical. Our fully group theoretical formulation approach to the quantum theory asks for some adjustments. We present a sketch of the full picture here, emphasizing aspects that are different from the more familiar picture. The analysis involves a more careful treatment of the relation between…
▽ More
The Galilei group has been taken as the fundamental symmetry for 'nonrelativistic' physics, quantum or classical. Our fully group theoretical formulation approach to the quantum theory asks for some adjustments. We present a sketch of the full picture here, emphasizing aspects that are different from the more familiar picture. The analysis involves a more careful treatment of the relation between the exact mathematics and its physical application in the dynamical theories, and a more serious full implementation of the mathematical logic than what is usually available in the physics literature. The article summarizes our earlier presented formulation while focusing on the part beyond, with an adjusted, or corrected, identification of the basic representations having the (Newtonian) mass as a Casimir invariant and the notion of center of mass as dictated by the symmetry. Another result is the necessary exclusion of the time translational symmetry, that otherwise bans interactions between particles.
△ Less
Submitted 16 May, 2023; v1 submitted 14 July, 2022;
originally announced July 2022.
-
System-Level Evaluation of Beam Hop** in NR-Based LEO Satellite Communication System
Authors:
**gwei Zhang,
Dali Qin,
Chuili Kong,
Feiran Zhao,
Rong Li,
Jun Wang,
Ye Wang
Abstract:
Satellite communication by leveraging the use of low earth orbit (LEO) satellites is expected to play an essential role in future communication systems through providing ubiquitous and continuous wireless connectivity. This thus has motivated the work in the 3rd generation partnership project (3GPP) to ensure the operation of fifth generation (5G) New Radio (NR) protocols for non-terrestrial netwo…
▽ More
Satellite communication by leveraging the use of low earth orbit (LEO) satellites is expected to play an essential role in future communication systems through providing ubiquitous and continuous wireless connectivity. This thus has motivated the work in the 3rd generation partnership project (3GPP) to ensure the operation of fifth generation (5G) New Radio (NR) protocols for non-terrestrial network (NTN). In this paper, we consider a NR-based LEO satellite communication system, where satellites equipped with phased array antennas are employed to serve user equipments (UEs) on the ground. To reduce payload weight and meet the time-varying traffic demands of UEs, an efficient beam hop** scheme considering both the traffic demands and inter-beam interference is proposed to jointly schedule beams and satellite transmit power. Then based on NR protocols, we present the first system-level evaluations of beam hop** scheme in LEO satellite system under different operating frequency bands and traffic models. Simulation results indicate that significant performance gains can be achieved by the proposed beam hop** scheme, especially under the distance limit constraint that avoids scheduling adjacent beams simultaneously, as compared to benchmark schemes.
△ Less
Submitted 15 October, 2022; v1 submitted 21 May, 2022;
originally announced May 2022.
-
LitMind Dictionary: An Open-Source Online Dictionary
Authors:
Cunliang Kong,
Xuezhi Fang,
Liner Yang,
Yun Chen,
Erhong Yang
Abstract:
Dictionaries can help language learners to learn vocabulary by providing definitions of words. Since traditional dictionaries present word senses as discrete items in predefined inventories, they fall short of flexibility, which is required in providing specific meanings of words in particular contexts. In this paper, we introduce the LitMind Dictionary (https://dictionary.litmind.ink), an open-so…
▽ More
Dictionaries can help language learners to learn vocabulary by providing definitions of words. Since traditional dictionaries present word senses as discrete items in predefined inventories, they fall short of flexibility, which is required in providing specific meanings of words in particular contexts. In this paper, we introduce the LitMind Dictionary (https://dictionary.litmind.ink), an open-source online generative dictionary that takes a word and context containing the word as input and automatically generates a definition as output. Incorporating state-of-the-art definition generation models, it supports not only Chinese and English, but also Chinese-English cross-lingual queries. Moreover, it has a user-friendly front-end design that can help users understand the query words quickly and easily. All the code and data are available at https://github.com/blcuicall/litmind-dictionary.
△ Less
Submitted 23 April, 2022;
originally announced April 2022.
-
BLCU-ICALL at SemEval-2022 Task 1: Cross-Attention Multitasking Framework for Definition Modeling
Authors:
Cunliang Kong,
Yujie Wang,
Ruining Chong,
Liner Yang,
Hengyuan Zhang,
Erhong Yang,
Ya** Huang
Abstract:
This paper describes the BLCU-ICALL system used in the SemEval-2022 Task 1 Comparing Dictionaries and Word Embeddings, the Definition Modeling subtrack, achieving 1st on Italian, 2nd on Spanish and Russian, and 3rd on English and French. We propose a transformer-based multitasking framework to explore the task. The framework integrates multiple embedding architectures through the cross-attention m…
▽ More
This paper describes the BLCU-ICALL system used in the SemEval-2022 Task 1 Comparing Dictionaries and Word Embeddings, the Definition Modeling subtrack, achieving 1st on Italian, 2nd on Spanish and Russian, and 3rd on English and French. We propose a transformer-based multitasking framework to explore the task. The framework integrates multiple embedding architectures through the cross-attention mechanism, and captures the structure of glosses through a masking language model objective. Additionally, we also investigate a simple but effective model ensembling strategy to further improve the robustness. The evaluation results show the effectiveness of our solution. We release our code at: https://github.com/blcuicall/SemEval2022-Task1-DM.
△ Less
Submitted 15 April, 2022;
originally announced April 2022.
-
Multitasking Framework for Unsupervised Simple Definition Generation
Authors:
Cunliang Kong,
Yun Chen,
Hengyuan Zhang,
Liner Yang,
Erhong Yang
Abstract:
The definition generation task can help language learners by providing explanations for unfamiliar words. This task has attracted much attention in recent years. We propose a novel task of Simple Definition Generation (SDG) to help language learners and low literacy readers. A significant challenge of this task is the lack of learner's dictionaries in many languages, and therefore the lack of data…
▽ More
The definition generation task can help language learners by providing explanations for unfamiliar words. This task has attracted much attention in recent years. We propose a novel task of Simple Definition Generation (SDG) to help language learners and low literacy readers. A significant challenge of this task is the lack of learner's dictionaries in many languages, and therefore the lack of data for supervised training. We explore this task and propose a multitasking framework SimpDefiner that only requires a standard dictionary with complex definitions and a corpus containing arbitrary simple texts. We disentangle the complexity factors from the text by carefully designing a parameter sharing scheme between two decoders. By jointly training these components, the framework can generate both complex and simple definitions simultaneously. We demonstrate that the framework can generate relevant, simple definitions for the target words through automatic and manual evaluations on English and Chinese datasets. Our method outperforms the baseline model by a 1.77 SARI score on the English dataset, and raises the proportion of the low level (HSK level 1-3) words in Chinese definitions by 3.87%.
△ Less
Submitted 24 March, 2022;
originally announced March 2022.
-
Unpaired Deep Image Dehazing Using Contrastive Disentanglement Learning
Authors:
Xiang Chen,
Zhentao Fan,
Pengpeng Li,
Longgang Dai,
Caihua Kong,
Zhuoran Zheng,
Yufeng Huang,
Yufeng Li
Abstract:
We offer a practical unpaired learning based image dehazing network from an unpaired set of clear and hazy images. This paper provides a new perspective to treat image dehazing as a two-class separated factor disentanglement task, i.e, the task-relevant factor of clear image reconstruction and the task-irrelevant factor of haze-relevant distribution. To achieve the disentanglement of these two-cla…
▽ More
We offer a practical unpaired learning based image dehazing network from an unpaired set of clear and hazy images. This paper provides a new perspective to treat image dehazing as a two-class separated factor disentanglement task, i.e, the task-relevant factor of clear image reconstruction and the task-irrelevant factor of haze-relevant distribution. To achieve the disentanglement of these two-class factors in deep feature space, contrastive learning is introduced into a CycleGAN framework to learn disentangled representations by guiding the generated images to be associated with latent factors. With such formulation, the proposed contrastive disentangled dehazing method (CDD-GAN) employs negative generators to cooperate with the encoder network to update alternately, so as to produce a queue of challenging negative adversaries. Then these negative adversaries are trained end-to-end together with the backbone representation network to enhance the discriminative information and promote factor disentanglement performance by maximizing the adversarial contrastive loss. During the training, we further show that hard negative examples can suppress the task-irrelevant factors and unpaired clear exemples can enhance the task-relevant factors, in order to better facilitate haze removal and help image restoration. Extensive experiments on both synthetic and real-world datasets demonstrate that our method performs favorably against existing unpaired dehazing baselines.
△ Less
Submitted 12 July, 2022; v1 submitted 15 March, 2022;
originally announced March 2022.
-
The International Linear Collider: Report to Snowmass 2021
Authors:
Alexander Aryshev,
Ties Behnke,
Mikael Berggren,
James Brau,
Nathaniel Craig,
Ayres Freitas,
Frank Gaede,
Spencer Gessner,
Stefania Gori,
Christophe Grojean,
Sven Heinemeyer,
Daniel Jeans,
Katja Kruger,
Benno List,
Jenny List,
Zhen Liu,
Shinichiro Michizono,
David W. Miller,
Ian Moult,
Hitoshi Murayama,
Tatsuya Nakada,
Emilio Nanni,
Mihoko Nojiri,
Hasan Padamsee,
Maxim Perelstein
, et al. (487 additional authors not shown)
Abstract:
The International Linear Collider (ILC) is on the table now as a new global energy-frontier accelerator laboratory taking data in the 2030s. The ILC addresses key questions for our current understanding of particle physics. It is based on a proven accelerator technology. Its experiments will challenge the Standard Model of particle physics and will provide a new window to look beyond it. This docu…
▽ More
The International Linear Collider (ILC) is on the table now as a new global energy-frontier accelerator laboratory taking data in the 2030s. The ILC addresses key questions for our current understanding of particle physics. It is based on a proven accelerator technology. Its experiments will challenge the Standard Model of particle physics and will provide a new window to look beyond it. This document brings the story of the ILC up to date, emphasizing its strong physics motivation, its readiness for construction, and the opportunity it presents to the US and the global particle physics community.
△ Less
Submitted 16 January, 2023; v1 submitted 14 March, 2022;
originally announced March 2022.
-
Towards Noncommutative Quantum Reality
Authors:
Otto C. W. Kong
Abstract:
The implications of the physical theory of quantum mechanics on the question of realism is much a subject of sustaining interest, while the background questions among physicists on how to think about all the theoretical notion and `interpretation' of the theory remains controversial. Through a careful analysis of the theoretical notions with the help of modern mathematical perspectives, we give he…
▽ More
The implications of the physical theory of quantum mechanics on the question of realism is much a subject of sustaining interest, while the background questions among physicists on how to think about all the theoretical notion and `interpretation' of the theory remains controversial. Through a careful analysis of the theoretical notions with the help of modern mathematical perspectives, we give here a picture of quantum mechanics, as the basic theory for `nonrelativistic' particle dynamics, that can be seen as being as much about the physical reality as classical mechanics itself. The key is to fully embrace the noncommutativity of the theory and see it as a notion about the reality of physical quantities. Quantum reality is then just a noncommutative version of the classical reality.
△ Less
Submitted 19 February, 2022;
originally announced February 2022.
-
Insightful Mining Equilibria
Authors:
Mengqian Zhang,
Yuhao Li,
Jichen Li,
Chaozhe Kong,
Xiaotie Deng
Abstract:
The selfish mining attack, arguably the most famous game-theoretic attack in blockchain, indicates that the Bitcoin protocol is not incentive-compatible. Most subsequent works mainly focus on strengthening the selfish mining strategy, thus enabling a single strategic agent more likely to deviate. In sharp contrast, little attention has been paid to the resistant behavior against the selfish mining…
▽ More
The selfish mining attack, arguably the most famous game-theoretic attack in blockchain, indicates that the Bitcoin protocol is not incentive-compatible. Most subsequent works mainly focus on strengthening the selfish mining strategy, thus enabling a single strategic agent more likely to deviate. In sharp contrast, little attention has been paid to the resistant behavior against the selfish mining attack, let alone further equilibrium analysis for miners and mining pools in the blockchain as a multi-agent system.
In this paper, first, we propose a strategy called insightful mining to counteract selfish mining. By infiltrating an undercover miner into the selfish pool, the insightful pool could acquire the number of its hidden blocks. We prove that, with this extra insight, the utility of the insightful pool could be strictly greater than the selfish pool's when they have the same mining power. Then we investigate the mining game where all pools can either choose to be honest or take the insightful mining strategy. We characterize the Nash equilibrium of this mining game, and derive three corollaries: (a) each mining game has a pure Nash equilibrium; (b) honest mining is a Nash equilibrium if the largest mining pool has a fraction of mining power no more than 1/3; (c) there are at most two insightful pools under equilibrium no matter how the mining power is distributed.
△ Less
Submitted 17 February, 2022;
originally announced February 2022.
-
Improving CP Measurement with THEIA and Muon Decay at Rest
Authors:
Shao-Feng Ge,
Chui-Fan Kong,
Pedro Pasquini
Abstract:
We explore the possibility of using the recently proposed THEIA detector to measure the $\bar ν_μ\rightarrow \bar ν_e$ oscillation with neutrinos from a muon decay at rest ($μ$DAR) source to improve the leptonic CP phase measurement. Due to its intrinsic low-energy beam, this $μ$THEIA configuration ($μ$DAR neutrinos at THEIA) is only sensitive to the genuine leptonic CP phase $δ_D$ and not contami…
▽ More
We explore the possibility of using the recently proposed THEIA detector to measure the $\bar ν_μ\rightarrow \bar ν_e$ oscillation with neutrinos from a muon decay at rest ($μ$DAR) source to improve the leptonic CP phase measurement. Due to its intrinsic low-energy beam, this $μ$THEIA configuration ($μ$DAR neutrinos at THEIA) is only sensitive to the genuine leptonic CP phase $δ_D$ and not contaminated by the matter effect. With detailed study of neutrino energy reconstruction and backgrounds at the THEIA detector, we find that the combination with the high-energy DUNE can significantly reduce the CP uncertainty, especially around the maximal CP violation cases $δ_D = \pm 90^\circ$. Both the $μ$THEIA-25 with 17kt and $μ$THEIA-100 with 70kt fiducial volumes are considered. For DUNE + $μ$THEIA-100, the CP uncertainty can be better than $8^\circ$.
△ Less
Submitted 7 July, 2022; v1 submitted 10 February, 2022;
originally announced February 2022.
-
Rethinking Attention-Model Explainability through Faithfulness Violation Test
Authors:
Yibing Liu,
Haoliang Li,
Yangyang Guo,
Chenqi Kong,
**g Li,
Shiqi Wang
Abstract:
Attention mechanisms are dominating the explainability of deep models. They produce probability distributions over the input, which are widely deemed as feature-importance indicators. However, in this paper, we find one critical limitation in attention explanations: weakness in identifying the polarity of feature impact. This would be somehow misleading -- features with higher attention weights ma…
▽ More
Attention mechanisms are dominating the explainability of deep models. They produce probability distributions over the input, which are widely deemed as feature-importance indicators. However, in this paper, we find one critical limitation in attention explanations: weakness in identifying the polarity of feature impact. This would be somehow misleading -- features with higher attention weights may not faithfully contribute to model predictions; instead, they can impose suppression effects. With this finding, we reflect on the explainability of current attention-based techniques, such as Attentio$\odot$Gradient and LRP-based attention explanations. We first propose an actionable diagnostic methodology (henceforth faithfulness violation test) to measure the consistency between explanation weights and the impact polarity. Through the extensive experiments, we then show that most tested explanation methods are unexpectedly hindered by the faithfulness violation issue, especially the raw attention. Empirical analyses on the factors affecting violation issues further provide useful observations for adopting explanation methods in attention models.
△ Less
Submitted 5 July, 2022; v1 submitted 28 January, 2022;
originally announced January 2022.
-
YACLC: A Chinese Learner Corpus with Multidimensional Annotation
Authors:
Yingying Wang,
Cunliang Kong,
Liner Yang,
Yijun Wang,
Xiaorong Lu,
Renfen Hu,
Shan He,
Zhenghao Liu,
Yun Chen,
Erhong Yang,
Maosong Sun
Abstract:
Learner corpus collects language data produced by L2 learners, that is second or foreign-language learners. This resource is of great relevance for second language acquisition research, foreign-language teaching, and automatic grammatical error correction. However, there is little focus on learner corpus for Chinese as Foreign Language (CFL) learners. Therefore, we propose to construct a large-sca…
▽ More
Learner corpus collects language data produced by L2 learners, that is second or foreign-language learners. This resource is of great relevance for second language acquisition research, foreign-language teaching, and automatic grammatical error correction. However, there is little focus on learner corpus for Chinese as Foreign Language (CFL) learners. Therefore, we propose to construct a large-scale, multidimensional annotated Chinese learner corpus. To construct the corpus, we first obtain a large number of topic-rich texts generated by CFL learners. Then we design an annotation scheme including a sentence acceptability score as well as grammatical error and fluency-based corrections. We build a crowdsourcing platform to perform the annotation effectively (https://yaclc.wenmind.net). We name the corpus YACLC (Yet Another Chinese Learner Corpus) and release it as part of the CUGE benchmark (http://cuge.baai.ac.cn). By analyzing the original sentences and annotations in the corpus, we found that YACLC has a considerable size and very high annotation quality. We hope this corpus can further enhance the studies on Chinese International Education and Chinese automatic grammatical error correction.
△ Less
Submitted 30 December, 2021;
originally announced December 2021.
-
Quantum Origin of (Newtonian) Mass and Symmetry for Lorentz Covariant Physics
Authors:
Otto C. W. Kong,
Hock King Ting
Abstract:
The Galilean symmetry and the Poincare symmetry are usually taken as the fundamental (relativity) symmetries for `nonrelativistic' and `relativistic' physics, respectively, quantum or classical. Our fully group theoretical formulation approach to the theories, together with its natural companion of mechanics from symplectic geometry, ask for different perspectives. We present a sketch of the full…
▽ More
The Galilean symmetry and the Poincare symmetry are usually taken as the fundamental (relativity) symmetries for `nonrelativistic' and `relativistic' physics, respectively, quantum or classical. Our fully group theoretical formulation approach to the theories, together with its natural companion of mechanics from symplectic geometry, ask for different perspectives. We present a sketch of the full picture here, emphasizing aspects which are different from the more familiar picture. The letter summarizes our earlier presented formulation while focusing on the part beyond, with an adjusted, or corrected, identification of the basic representations having the (Newtonian) mass as a Casimir invariant. Discussion on the limitations of the Poincare symmetry for the purpose is particularly elaborated.
△ Less
Submitted 13 July, 2022; v1 submitted 16 December, 2021;
originally announced December 2021.
-
Mixed State Parametrization and Two-qubit Entanglement
Authors:
Otto C. W. Kong,
Hock King Ting
Abstract:
A generic scheme for the parametrization of mixed state systems is introduced, which is then adapted to bipartite systems, especially to a 2-qubit system. Various features of 2-qubit entanglement are analyzed based on the scheme. Our approach exploit much the interplay between is marked by pure states as Hilbert space vectors and mixed states as density matrices, both for the formulation of the pa…
▽ More
A generic scheme for the parametrization of mixed state systems is introduced, which is then adapted to bipartite systems, especially to a 2-qubit system. Various features of 2-qubit entanglement are analyzed based on the scheme. Our approach exploit much the interplay between is marked by pure states as Hilbert space vectors and mixed states as density matrices, both for the formulation of the parametrization and the analysis of entanglement properties. Explicit entanglement results, in terms of negativity and concurrence, for all 2-qubit mixed states with one single parameter/coordinate among the full set of fifteen being zero and a few other interesting cases are presented.
△ Less
Submitted 13 July, 2022; v1 submitted 16 December, 2021;
originally announced December 2021.
-
Quantum Frames of Reference and the Noncommutative Values of Observables
Authors:
Otto C. W. Kong
Abstract:
Based on a recent relational formulation of quantum reference frame transformations, especially with a case of quantum spatial translations in particular, we analyzed how the `value' of an observable for a fixed state change. That is the exact analog of the classical description, for example, of the value of the $x$-coordinate for a particle decrease by 2 units when we perform a translation of the…
▽ More
Based on a recent relational formulation of quantum reference frame transformations, especially with a case of quantum spatial translations in particular, we analyzed how the `value' of an observable for a fixed state change. That is the exact analog of the classical description, for example, of the value of the $x$-coordinate for a particle decrease by 2 units when we perform a translation of the reference frame putting the new origin at $x=2$. The essence of the quantum reference frame transformations is to have the quantum fluctuations, and even entanglement, of the physical object which serves as the (new) reference frame, taken into account. We illustrate how the recently introduced notion of the noncommutative values of quantum observables gives such a definite description successfully. Formulations, and an analysis of a case example in qubit systems, of analog transformations for observables with a discrete or finite spectrum is also presented. Issues about the evolving picture of the symmetry system of all quantum reference frame transformations discussed.
△ Less
Submitted 5 December, 2021;
originally announced December 2021.
-
Self-Distilled Self-Supervised Representation Learning
Authors:
Jiho Jang,
Seonhoon Kim,
Kiyoon Yoo,
Chaerin Kong,
Jangho Kim,
Nojun Kwak
Abstract:
State-of-the-art frameworks in self-supervised learning have recently shown that fully utilizing transformer-based models can lead to performance boost compared to conventional CNN models. Striving to maximize the mutual information of two views of an image, existing works apply a contrastive loss to the final representations. Motivated by self-distillation in the supervised regime, we further exp…
▽ More
State-of-the-art frameworks in self-supervised learning have recently shown that fully utilizing transformer-based models can lead to performance boost compared to conventional CNN models. Striving to maximize the mutual information of two views of an image, existing works apply a contrastive loss to the final representations. Motivated by self-distillation in the supervised regime, we further exploit this by allowing the intermediate representations to learn from the final layer via the contrastive loss. Through self-distillation, the intermediate layers are better suited for instance discrimination, making the performance of an early-exited sub-network not much degraded from that of the full network. This renders the pretext task easier also for the final layer, leading to better representations. Our method, Self-Distilled Self-Supervised Learning (SDSSL), outperforms competitive baselines (SimCLR, BYOL and MoCo v3) using ViT on various tasks and datasets. In the linear evaluation and k-NN protocol, SDSSL not only leads to superior performance in the final layers, but also in most of the lower layers. Furthermore, qualitative and quantitative analyses show how representations are formed more effectively along the transformer layers. Code is available at https://github.com/hagiss/SDSSL.
△ Less
Submitted 23 November, 2022; v1 submitted 25 November, 2021;
originally announced November 2021.
-
Few-shot Image Generation with Mixup-based Distance Learning
Authors:
Chaerin Kong,
Jeesoo Kim,
Donghoon Han,
Nojun Kwak
Abstract:
Producing diverse and realistic images with generative models such as GANs typically requires large scale training with vast amount of images. GANs trained with limited data can easily memorize few training samples and display undesirable properties like "stairlike" latent space where interpolation in the latent space yields discontinuous transitions in the output space. In this work, we consider…
▽ More
Producing diverse and realistic images with generative models such as GANs typically requires large scale training with vast amount of images. GANs trained with limited data can easily memorize few training samples and display undesirable properties like "stairlike" latent space where interpolation in the latent space yields discontinuous transitions in the output space. In this work, we consider a challenging task of pretraining-free few-shot image synthesis, and seek to train existing generative models with minimal overfitting and mode collapse. We propose mixup-based distance regularization on the feature space of both a generator and the counterpart discriminator that encourages the two players to reason not only about the scarce observed data points but the relative distances in the feature space they reside. Qualitative and quantitative evaluation on diverse datasets demonstrates that our method is generally applicable to existing models to enhance both fidelity and diversity under few-shot setting. Code is available.
△ Less
Submitted 7 July, 2022; v1 submitted 23 November, 2021;
originally announced November 2021.
-
Experiments conducted in the burning plasma regime with inertial fusion implosions
Authors:
J. S. Ross,
J. E. Ralph,
A. B. Zylstra,
A. L. Kritcher,
H. F. Robey,
C. V. Young,
O. A. Hurricane,
D. A. Callahan,
K. L. Baker,
D. T. Casey,
T. Doeppner,
L. Divol,
M. Hohenberger,
S. Le Pape,
A. Pak,
P. K. Patel,
R. Tommasini,
S. J. Ali,
P. A. Amendt,
L. J. Atherton,
B. Bachmann,
D. Bailey,
L. R. Benedetti,
L. Berzak Hopkins,
R. Betti
, et al. (127 additional authors not shown)
Abstract:
An experimental program is currently underway at the National Ignition Facility (NIF) to compress deuterium and tritium (DT) fuel to densities and temperatures sufficient to achieve fusion and energy gain. The primary approach being investigated is indirect drive inertial confinement fusion (ICF), where a high-Z radiation cavity (a hohlraum) is heated by lasers, converting the incident energy into…
▽ More
An experimental program is currently underway at the National Ignition Facility (NIF) to compress deuterium and tritium (DT) fuel to densities and temperatures sufficient to achieve fusion and energy gain. The primary approach being investigated is indirect drive inertial confinement fusion (ICF), where a high-Z radiation cavity (a hohlraum) is heated by lasers, converting the incident energy into x-ray radiation which in turn drives the DT fuel filled capsule causing it to implode. Previous experiments reported DT fuel gain exceeding unity [O.A. Hurricane et al., Nature 506, 343 (2014)] and then exceeding the kinetic energy of the imploding fuel [S. Le Pape et al., Phys. Rev. Lett. 120, 245003 (2018)]. We report on recent experiments that have achieved record fusion neutron yields on NIF, greater than 100 kJ with momentary fusion powers exceeding 1PW, and have for the first time entered the burning plasma regime where fusion alpha-heating of the fuel exceeds the energy delivered to the fuel via compression. This was accomplished by increasing the size of the high-density carbon (HDC) capsule, increasing energy coupling, while controlling symmetry and implosion design parameters. Two tactics were successful in controlling the radiation flux symmetry and therefore the implosion symmetry: transferring energy between laser cones via plasma waves, and changing the shape of the hohlraum. In conducting these experiments, we controlled for known sources of degradation. Herein we show how these experiments were performed to produce record performance, and demonstrate the data fidelity leading us to conclude that these shots have entered the burning plasma regime.
△ Less
Submitted 8 November, 2021;
originally announced November 2021.
-
Unpaired Deep Image Deraining Using Dual Contrastive Learning
Authors:
Xiang Chen,
**shan Pan,
Kui Jiang,
Yufeng Li,
Yufeng Huang,
Caihua Kong,
Longgang Dai,
Zhentao Fan
Abstract:
Learning single image deraining (SID) networks from an unpaired set of clean and rainy images is practical and valuable as acquiring paired real-world data is almost infeasible. However, without the paired data as the supervision, learning a SID network is challenging. Moreover, simply using existing unpaired learning methods (e.g., unpaired adversarial learning and cycle-consistency constraints)…
▽ More
Learning single image deraining (SID) networks from an unpaired set of clean and rainy images is practical and valuable as acquiring paired real-world data is almost infeasible. However, without the paired data as the supervision, learning a SID network is challenging. Moreover, simply using existing unpaired learning methods (e.g., unpaired adversarial learning and cycle-consistency constraints) in the SID task is insufficient to learn the underlying relationship from rainy inputs to clean outputs as there exists significant domain gap between the rainy and clean images. In this paper, we develop an effective unpaired SID adversarial framework which explores mutual properties of the unpaired exemplars by a dual contrastive learning manner in a deep feature space, named as DCD-GAN. The proposed method mainly consists of two cooperative branches: Bidirectional Translation Branch (BTB) and Contrastive Guidance Branch (CGB). Specifically, BTB exploits full advantage of the circulatory architecture of adversarial consistency to generate abundant exemplar pairs and excavates latent feature distributions between two domains by equip** it with bidirectional map**. Simultaneously, CGB implicitly constrains the embeddings of different exemplars in the deep feature space by encouraging the similar feature distributions closer while pushing the dissimilar further away, in order to better facilitate rain removal and help image restoration. Extensive experiments demonstrate that our method performs favorably against existing unpaired deraining approaches on both synthetic and real-world datasets, and generates comparable results against several fully-supervised or semi-supervised models.
△ Less
Submitted 24 March, 2022; v1 submitted 7 September, 2021;
originally announced September 2021.
-
No-Reference Image Quality Assessment by Hallucinating Pristine Features
Authors:
Baoliang Chen,
Lingyu Zhu,
Chenqi Kong,
Hanwei Zhu,
Shiqi Wang,
Zhu Li
Abstract:
In this paper, we propose a no-reference (NR) image quality assessment (IQA) method via feature level pseudo-reference (PR) hallucination. The proposed quality assessment framework is grounded on the prior models of natural image statistical behaviors and rooted in the view that the perceptually meaningful features could be well exploited to characterize the visual quality. Herein, the PR features…
▽ More
In this paper, we propose a no-reference (NR) image quality assessment (IQA) method via feature level pseudo-reference (PR) hallucination. The proposed quality assessment framework is grounded on the prior models of natural image statistical behaviors and rooted in the view that the perceptually meaningful features could be well exploited to characterize the visual quality. Herein, the PR features from the distorted images are learned by a mutual learning scheme with the pristine reference as the supervision, and the discriminative characteristics of PR features are further ensured with the triplet constraints. Given a distorted image for quality inference, the feature level disentanglement is performed with an invertible neural layer for final quality prediction, leading to the PR and the corresponding distortion features for comparison. The effectiveness of our proposed method is demonstrated on four popular IQA databases, and superior performance on cross-database evaluation also reveals the high generalization capability of our method. The implementation of our method is publicly available on https://github.com/Baoliang93/FPR.
△ Less
Submitted 2 September, 2022; v1 submitted 9 August, 2021;
originally announced August 2021.
-
Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltales
Authors:
Chenqi Kong,
Baoliang Chen,
Haoliang Li,
Shiqi Wang,
Anderson Rocha,
Sam Kwong
Abstract:
The technological advancements of deep learning have enabled sophisticated face manipulation schemes, raising severe trust issues and security concerns in modern society. Generally speaking, detecting manipulated faces and locating the potentially altered regions are challenging tasks. Herein, we propose a conceptually simple but effective method to efficiently detect forged faces in an image whil…
▽ More
The technological advancements of deep learning have enabled sophisticated face manipulation schemes, raising severe trust issues and security concerns in modern society. Generally speaking, detecting manipulated faces and locating the potentially altered regions are challenging tasks. Herein, we propose a conceptually simple but effective method to efficiently detect forged faces in an image while simultaneously locating the manipulated regions. The proposed scheme relies on a segmentation map that delivers meaningful high-level semantic information clues about the image. Furthermore, a noise map is estimated, playing a complementary role in capturing low-level clues and subsequently empowering decision-making. Finally, the features from these two modules are combined to distinguish fake faces. Extensive experiments show that the proposed model achieves state-of-the-art detection accuracy and remarkable localization performance.
△ Less
Submitted 6 April, 2022; v1 submitted 12 July, 2021;
originally announced July 2021.
-
Nonreciprocal high-order sidebands induced by magnon Kerr nonlinearity
Authors:
Mei Wang,
Cui Kong,
Zhao-Yu Sun,
Duo Zhang,
Yu-Ying Wu,
Li-Li Zheng
Abstract:
We propose an effective approach for creating robust nonreciprocity of high-order sidebands, including the first-, second- and third-order sidebands, at microwave frequencies. This approach relies on magnon Kerr nonlinearity in a cavity magnonics system composed of two microwave cavities and one yttrium iron garnet (YIG) sphere. By manipulating the driving power applied on YIG and the frequency de…
▽ More
We propose an effective approach for creating robust nonreciprocity of high-order sidebands, including the first-, second- and third-order sidebands, at microwave frequencies. This approach relies on magnon Kerr nonlinearity in a cavity magnonics system composed of two microwave cavities and one yttrium iron garnet (YIG) sphere. By manipulating the driving power applied on YIG and the frequency detuning between the magnon mode in YIG and the driving field, the effective Kerr nonlinearity can be strengthened, thereby inducing strong transmission non-reciprocity. More interestingly, we find the higher the sideband order, the stronger the transmission nonreciprocity marked by the higher isolation ratio in the optimal detuning regime. Such a series of equally-spaced high-order sidebands have potential applications in frequency comb-like precision measurement, besides structuring high-performance on-chip nonreciprocal devices.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
-
Special Relativity and its Newtonian Limit from a Group Theoretical Perspective
Authors:
Otto C. W. Kong,
Jason Payne
Abstract:
In this pedagogical article, we explore a powerful language for describing the notion of spacetime and particle dynamics intrinsic to a given fundamental physical theory, focusing on special relativity and its Newtonian limit. The starting point of the formulation is the representations of the relativity symmetries. Moreover, that seriously furnishes -- via the notion of symmetry contractions -- a…
▽ More
In this pedagogical article, we explore a powerful language for describing the notion of spacetime and particle dynamics intrinsic to a given fundamental physical theory, focusing on special relativity and its Newtonian limit. The starting point of the formulation is the representations of the relativity symmetries. Moreover, that seriously furnishes -- via the notion of symmetry contractions -- a natural way in which one can understand how the Newtonian theory arises as an approximation to Einstein's theory. We begin with the Poincaré symmetry underlying special relativity and the nature of Minkowski spacetime as a coset representation space of the algebra and the group. Then, we proceed to the parallel for the phase space of a spin zero particle, in relation to which we present the full scheme for its dynamics under the Hamiltonian formulation, illustrating that as essentially the symmetry feature of the phase space geometry. Lastly, the reduction of all that to the Newtonian theory as an approximation with its space-time, phase space, and dynamics under the appropriate relativity symmetry contraction is presented. While all notions involved are well established, the systematic presentation of that story as one coherent picture fills a gap in the literature on the subject matter.
△ Less
Submitted 16 December, 2021; v1 submitted 15 August, 2020;
originally announced December 2020.
-
Controlling directed atomic motion and second-order tunneling of a spin-orbit-coupled atom in optical lattices
Authors:
Xiaobing Luo,
Zhao-Yun Zeng,
Yu Guo,
Baiyuan Yang,
**peng Xiao,
Lei Li,
Chao Kong,
Ai-Xi Chen
Abstract:
We theoretically explore the tunneling dynamics for the tight-binding (TB) model of a single spin-orbit-coupled atom trapped in an optical lattice subjected to lattice shaking and to time-periodic Zeeman field. By means of analytical and numerical methods, we demonstrate that the spin-orbit (SO) coupling adds some new results to the tunneling dynamics in both multiphoton resonance and far-off-reso…
▽ More
We theoretically explore the tunneling dynamics for the tight-binding (TB) model of a single spin-orbit-coupled atom trapped in an optical lattice subjected to lattice shaking and to time-periodic Zeeman field. By means of analytical and numerical methods, we demonstrate that the spin-orbit (SO) coupling adds some new results to the tunneling dynamics in both multiphoton resonance and far-off-resonance parameter regimes. When the driving frequency is resonant with the static Zeeman field (multi-photon resonances), we obtain an unexpected new dynamical localization (DL) phenomenon where the single SO-coupled atom is restricted to making perfect two-site Rabi oscillation accompanied by spin flip**.By using the unconventional DL phenomenon, we are able to generate a ratchetlike effect which enables directed atomic motion towards different directions and accompanies periodic spin-flip** under the action of SO coupling. For the far-off-resonance case, we show that by suppressing the usual inter-site tunneling alone, it is possible to realize a type of spin-conserving second-order tunneling between next-nearest-neighboring sites, which is not accessible in the conventional lattice system without SO coupling. We also show that simultaneous controls of the usual inter-site tunneling and the SO-coupling-related second-order-tunneling are necessary for quasienergies flatness (collapse) and completely frozen dynamics to exist. These results may be relevant to potential applications such as spin-based quantum information processing and design of novel spintronics devices.
△ Less
Submitted 2 February, 2021; v1 submitted 2 November, 2020;
originally announced November 2020.
-
Toward Cross-Lingual Definition Generation for Language Learners
Authors:
Cunliang Kong,
Liner Yang,
Tianzuo Zhang,
Qinan Fan,
Zhenghao Liu,
Yun Chen,
Erhong Yang
Abstract:
Generating dictionary definitions automatically can prove useful for language learners. However, it's still a challenging task of cross-lingual definition generation. In this work, we propose to generate definitions in English for words in various languages. To achieve this, we present a simple yet effective approach based on publicly available pretrained language models. In this approach, models…
▽ More
Generating dictionary definitions automatically can prove useful for language learners. However, it's still a challenging task of cross-lingual definition generation. In this work, we propose to generate definitions in English for words in various languages. To achieve this, we present a simple yet effective approach based on publicly available pretrained language models. In this approach, models can be directly applied to other languages after trained on the English dataset. We demonstrate the effectiveness of this approach on zero-shot definition generation. Experiments and manual analyses on newly constructed datasets show that our models have a strong cross-lingual transfer ability and can generate fluent English definitions for Chinese words. We further measure the lexical complexity of generated and reference definitions. The results show that the generated definitions are much simpler, which is more suitable for language learners.
△ Less
Submitted 12 October, 2020;
originally announced October 2020.
-
Group Theoretical Approach to Pseudo-Hermitian Quantum Mechanics with Lorentz Covariance and $c \rightarrow \infty $ Limit
Authors:
Suzana Bedić,
Otto C. W. Kong,
Hock King Ting
Abstract:
We present in the article the formulation of a version of Lorentz covariant quantum mechanics based on a group theoretical construction from a Heisenberg-Weyl symmetry with position and momentum operators transforming as Minkowski four-vectors under the Lorentz symmetry. The basic representation is identified as a coherent state representation, essentially an irreducible component of the regular r…
▽ More
We present in the article the formulation of a version of Lorentz covariant quantum mechanics based on a group theoretical construction from a Heisenberg-Weyl symmetry with position and momentum operators transforming as Minkowski four-vectors under the Lorentz symmetry. The basic representation is identified as a coherent state representation, essentially an irreducible component of the regular representation, with the matching representation of an extension of the group $C^*$-algebra giving the algebra of observables. The key feature of the formulation is that it is not unitary but pseudo-unitary, exactly in the same sense as the Minkowski spacetime representation. The language of pseudo-Hermitian quantum mechanics is adopted for a clear illustration of the aspect, with a metric operator obtained as really the manifestation of the Minkowski metric on the space of the state vectors. Explicit wavefunction description is given without any restriction of the variable domains, yet with a finite integral inner product. The associated covariant harmonic oscillator Fock state basis has all the standard properties in exact analog to those of a harmonic oscillator with Euclidean position and momentum operators of any `dimension'. Galilean limit of the Lorentz symmetry and the classical limit are retrieved rigorously through appropriate symmetry contractions of the algebra and its representation, including the dynamics described through the symmetry of the phase space.
△ Less
Submitted 28 December, 2020; v1 submitted 12 September, 2020;
originally announced September 2020.
-
Evaluation of the Visibility and Artifacts of 11 Common Fiducial Markers for Image-Guided Stereotactic Body Radiation Therapy in the Abdomen
Authors:
Jordan M. Slagowski,
Lauren E. Colbert,
Irina M. Cazacu,
Ben S. Singh,
Rachael Martin,
Eugene J. Koay,
Cullen M. Taniguchi,
Albert C. Koong,
Manoop S. Bhutani,
Joseph M. Herman,
Sam Beddar
Abstract:
The purpose of this study was to quantitatively evaluate the visibility and artifacts of commercially available fiducial markers in order to optimize their selection for image-guided stereotactic body radiation therapy (SBRT). From six different vendors, we selected 11 fiducials commonly used in image-guided radiation therapy (IGRT); the fiducials varied in material composition (gold, platinum, ca…
▽ More
The purpose of this study was to quantitatively evaluate the visibility and artifacts of commercially available fiducial markers in order to optimize their selection for image-guided stereotactic body radiation therapy (SBRT). From six different vendors, we selected 11 fiducials commonly used in image-guided radiation therapy (IGRT); the fiducials varied in material composition (gold, platinum, carbon), shape (cylindrical, notched/linear, coiled, ball-like, step), and size measured in terms of diameter (0.28-1.0 mm) and length (3.0-20.0 mm). Each fiducial was centered in 4-mm bolus within a 13-cm-thick water-equivalent phantom. Fiducials were imaged with use of a simulation computed tomography (CT) scanner, a CT-on-rails system, and an onboard cone-beam CT system. Acquisition parameters were set according to clinical protocols. Visibility was assessed in terms of contrast and the Michelson visibility metric. Artifacts were quantified in terms of relative standard deviation and relative streak artifacts level (rSAL). Twelve radiation oncologists ranked each fiducial in terms of clinical usefulness. Contrast and artifacts increased with fiducial size. For CT imaging, maximum contrast (2722 HU) and artifacts (rSAL=2.69) occurred for the largest-diameter (0.75 mm) platinum fiducial. Minimum contrast (551 HU) and reduced artifacts (rSAL=0.65) were observed for the smallest-diameter (0.28 mm) gold fiducial. Carbon produced the least severe artifacts (rSAL = 0.29). The survey indicated that physicians preferred gold fiducials with a 0.35- to 0.43-mm diameter, 5- to 10-mm length, and a coiled or cylindrical shape that balanced contrast and artifacts. We evaluated 11 different fiducials in terms of visibility and artifacts. The results of this study may assist radiation oncologists who seek to maximize contrast, minimize artifacts, and/or balance contrast versus artifacts by fiducial selection.
△ Less
Submitted 10 August, 2020;
originally announced August 2020.
-
FroDO: From Detections to 3D Objects
Authors:
Kejie Li,
Martin Rünz,
Meng Tang,
Lingni Ma,
Chen Kong,
Tanner Schmidt,
Ian Reid,
Lourdes Agapito,
Julian Straub,
Steven Lovegrove,
Richard Newcombe
Abstract:
Object-oriented maps are important for scene understanding since they jointly capture geometry and semantics, allow individual instantiation and meaningful reasoning about objects. We introduce FroDO, a method for accurate 3D reconstruction of object instances from RGB video that infers object location, pose and shape in a coarse-to-fine manner. Key to FroDO is to embed object shapes in a novel le…
▽ More
Object-oriented maps are important for scene understanding since they jointly capture geometry and semantics, allow individual instantiation and meaningful reasoning about objects. We introduce FroDO, a method for accurate 3D reconstruction of object instances from RGB video that infers object location, pose and shape in a coarse-to-fine manner. Key to FroDO is to embed object shapes in a novel learnt space that allows seamless switching between sparse point cloud and dense DeepSDF decoding. Given an input sequence of localized RGB frames, FroDO first aggregates 2D detections to instantiate a category-aware 3D bounding box per object. A shape code is regressed using an encoder network before optimizing shape and pose further under the learnt shape priors using sparse and dense shape representations. The optimization uses multi-view geometric, photometric and silhouette losses. We evaluate on real-world datasets, including Pix3D, Redwood-OS, and ScanNet, for single-view, multi-view, and multi-object reconstruction.
△ Less
Submitted 11 May, 2020;
originally announced May 2020.
-
Kalman-Bucy filtering and minimum mean square estimator under uncertainty
Authors:
Shaolin Ji,
Chuiliu Kong,
Chuanfeng Sun,
Ji-Feng Zhang
Abstract:
In this paper, we study a generalized Kalman-Bucy filtering problem under uncertainty. The drift uncertainty for both signal process and observation process is considered and the attitude to uncertainty is characterized by a convex operator (convex risk measure). The optimal filter or the minimum mean square estimator (MMSE) is calculated by solving the minimum mean square estimation problem under…
▽ More
In this paper, we study a generalized Kalman-Bucy filtering problem under uncertainty. The drift uncertainty for both signal process and observation process is considered and the attitude to uncertainty is characterized by a convex operator (convex risk measure). The optimal filter or the minimum mean square estimator (MMSE) is calculated by solving the minimum mean square estimation problem under a convex operator. In the first part of this paper, this estimation problem is studied under g-expectation which is a special convex operator. For this case, we prove that there exists a worst-case prior. Based on this worst-case prior we obtained the Kalman-Bucy filtering equation under g-expectation. In the second part of this paper, we study the minimum mean square estimation problem under general convex operators. The existence and uniqueness results of the MMSE are deduced.
△ Less
Submitted 5 November, 2020; v1 submitted 20 April, 2020;
originally announced April 2020.
-
Analysis on Complete Set of Fock States with Explicit Wavefunctions for the Covariant Harmonic Oscillator Problem
Authors:
Suzana Bedić,
Otto C. W. Kong
Abstract:
The earlier treatments of Lorentz covariant harmonic oscillator have brought to light various difficulties, such as reconciling Lorentz symmetry with the full Fock space, and divergence issues with their functional representations. We present here a full solution avoiding those problems. The complete set of Fock states is obtained, together with the corresponding explicit wavefunction and their in…
▽ More
The earlier treatments of Lorentz covariant harmonic oscillator have brought to light various difficulties, such as reconciling Lorentz symmetry with the full Fock space, and divergence issues with their functional representations. We present here a full solution avoiding those problems. The complete set of Fock states is obtained, together with the corresponding explicit wavefunction and their inner product integrals free from any divergence problem and the Lorentz symmetry fully maintained without additional constraints imposed. By a simple choice of the pseudo-unitary representation of the underlying symmetry group, motivated from the perspective of the Minkowski spacetime as a representation for the Lorentz group, we obtain the natural non-unitary Fock space picture commonly considered though not formulated and presented in the careful details given here. From a direct derivation of the appropriate basis state wavefunctions of the finite-dimensional irreducible representations of the Lorentz symmetry, the relation between the latter and the Fock state wavefunctions is also explicitly shown. Moreover, the full picture including the states with non-positive norm may give consistent physics picture as a version of Lorentz covariant quantum mechanics. Probability interpretation for the usual von Neumann measurements is not a problem as all wavefunctions restricted to a definite value for the `time' variable are just like those of the usual time independent quantum mechanics. A further understanding from a perspective of the dynamics from the symplectic geometry of the phase space is shortly discussed.
△ Less
Submitted 19 March, 2020; v1 submitted 3 February, 2020;
originally announced February 2020.
-
Covariant Quantum Mechanics and Quantum Spacetime
Authors:
Suzana Bedić,
Otto C. W. Kong,
Hock King Ting
Abstract:
We present in the article the formulation of a version of Lorentz covariant quantum mechanics based on a group theoretical construction from a Heisenberg-Weyl symmetry with position and momentum operators transforming as Minkowski four-vectors under the Lorentz symmetry. The basic representation is identified as a coherent state representation, essentially an irreducible component of the regular r…
▽ More
We present in the article the formulation of a version of Lorentz covariant quantum mechanics based on a group theoretical construction from a Heisenberg-Weyl symmetry with position and momentum operators transforming as Minkowski four-vectors under the Lorentz symmetry. The basic representation is identified as a coherent state representation, essentially an irreducible component of the regular representation, with the matching representation of an extension of the group $C^*$-algebra giving the algebra of observables. The key feature of the formulation is that it is not unitary but pseudo-unitary, exactly in the same sense as the Minkowski spacetime representation. Explicit wavefunction description is given without any restriction of the variable domains, yet with a finite integral inner product. The associated covariant harmonic oscillator Fock state basis has all the standard properties in exact analog to those of a harmonic oscillator with Euclidean position and momentum operators of any `dimension'. Galilean limit of the Lorentz symmetry and the classical limit of the Lorentz covariant framework are retrieved rigorously through appropriate symmetry contractions of the algebra and its representation, including the dynamics described through the symmetry of the phase space, given both in terms of real/complex number coordinates and noncommutative operator coordinates. The latter gives an explicit picture of the (projective) Hilbert space as a quantum/noncommutative spacetime.
△ Less
Submitted 4 February, 2020;
originally announced February 2020.
-
Buffer-aware Wireless Scheduling based on Deep Reinforcement Learning
Authors:
Chen Xu,
Jian Wang,
Tianhang Yu,
Chuili Kong,
Yourui Huangfu,
Rong Li,
Yiqun Ge,
Jun Wang
Abstract:
In this paper, the downlink packet scheduling problem for cellular networks is modeled, which jointly optimizes throughput, fairness and packet drop rate. Two genie-aided heuristic search methods are employed to explore the solution space. A deep reinforcement learning (DRL) framework with A2C algorithm is proposed for the optimization problem. Several methods have been utilized in the framework t…
▽ More
In this paper, the downlink packet scheduling problem for cellular networks is modeled, which jointly optimizes throughput, fairness and packet drop rate. Two genie-aided heuristic search methods are employed to explore the solution space. A deep reinforcement learning (DRL) framework with A2C algorithm is proposed for the optimization problem. Several methods have been utilized in the framework to improve the sampling and training efficiency and to adapt the algorithm to a specific scheduling problem. Numerical results show that DRL outperforms the baseline algorithm and achieves similar performance as genie-aided methods without using the future information.
△ Less
Submitted 12 November, 2019;
originally announced November 2019.
-
Distill Knowledge from NRSfM for Weakly Supervised 3D Pose Learning
Authors:
Chaoyang Wang,
Chen Kong,
Simon Lucey
Abstract:
We propose to learn a 3D pose estimator by distilling knowledge from Non-Rigid Structure from Motion (NRSfM). Our method uses solely 2D landmark annotations. No 3D data, multi-view/temporal footage, or object specific prior is required. This alleviates the data bottleneck, which is one of the major concern for supervised methods. The challenge for using NRSfM as teacher is that they often make poo…
▽ More
We propose to learn a 3D pose estimator by distilling knowledge from Non-Rigid Structure from Motion (NRSfM). Our method uses solely 2D landmark annotations. No 3D data, multi-view/temporal footage, or object specific prior is required. This alleviates the data bottleneck, which is one of the major concern for supervised methods. The challenge for using NRSfM as teacher is that they often make poor depth reconstruction when the 2D projections have strong ambiguity. Directly using those wrong depth as hard target would negatively impact the student. Instead, we propose a novel loss that ties depth prediction to the cost function used in NRSfM. This gives the student pose estimator freedom to reduce depth error by associating with image features. Validated on H3.6M dataset, our learned 3D pose estimation network achieves more accurate reconstruction compared to NRSfM methods. It also outperforms other weakly supervised methods, in spite of using significantly less supervision.
△ Less
Submitted 18 August, 2019;
originally announced August 2019.
-
Dolphin: A Spoken Language Proficiency Assessment System for Elementary Education
Authors:
Wenbiao Ding,
Guowei Xu,
Tianqiao Liu,
Wei** Fu,
Yujia Song,
Chaoyou Guo,
Cong Kong,
Songfan Yang,
Gale Yan Huang,
Zitao Liu
Abstract:
Spoken language proficiency is critically important for children's growth and personal development. Due to the limited and imbalanced educational resources in China, elementary students barely have chances to improve their oral language skills in classes. Verbal fluency tasks (VFTs) were invented to let the students practice their spoken language proficiency after school. VFTs are simple but concr…
▽ More
Spoken language proficiency is critically important for children's growth and personal development. Due to the limited and imbalanced educational resources in China, elementary students barely have chances to improve their oral language skills in classes. Verbal fluency tasks (VFTs) were invented to let the students practice their spoken language proficiency after school. VFTs are simple but concrete math related questions that ask students to not only report answers but speak out the entire thinking process. In spite of the great success of VFTs, they bring a heavy grading burden to elementary teachers. To alleviate this problem, we develop Dolphin, a spoken language proficiency assessment system for Chinese elementary education. Dolphin is able to automatically evaluate both phonological fluency and semantic relevance of students' VFT answers. We conduct a wide range of offline and online experiments to demonstrate the effectiveness of Dolphin. In our offline experiments, we show that Dolphin improves both phonological fluency and semantic relevance evaluation performance when compared to state-of-the-art baselines on real-world educational data sets. In our online A/B experiments, we test Dolphin with 183 teachers from 2 major cities (Hangzhou and Xi'an) in China for 10 weeks and the results show that VFT assignments grading coverage is improved by 22\%.
△ Less
Submitted 29 January, 2020; v1 submitted 1 August, 2019;
originally announced August 2019.
-
Deep Non-Rigid Structure from Motion
Authors:
Chen Kong,
Simon Lucey
Abstract:
Current non-rigid structure from motion (NRSfM) algorithms are mainly limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many applications within vision. In this paper we propose a novel deep neural network to recover camera poses and 3D points solely from an ensemble of 2D image coordinate…
▽ More
Current non-rigid structure from motion (NRSfM) algorithms are mainly limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many applications within vision. In this paper we propose a novel deep neural network to recover camera poses and 3D points solely from an ensemble of 2D image coordinates. The proposed neural network is mathematically interpretable as a multi-layer block sparse dictionary learning problem, and can handle problems of unprecedented scale and shape complexity. Extensive experiments demonstrate the impressive performance of our approach where we exhibit superior precision and robustness against all available state-of-the-art works in the order of magnitude. We further propose a quality measure (based on the network weights) which circumvents the need for 3D ground-truth to ascertain the confidence we have in the reconstruction.
△ Less
Submitted 11 August, 2019; v1 submitted 29 July, 2019;
originally announced August 2019.
-
Deep Non-Rigid Structure from Motion with Missing Data
Authors:
Chen Kong,
Simon Lucey
Abstract:
Non-Rigid Structure from Motion (NRSfM) refers to the problem of reconstructing cameras and the 3D point cloud of a non-rigid object from an ensemble of images with 2D correspondences. Current NRSfM algorithms are limited from two perspectives: (i) the number of images, and (ii) the type of shape variability they can handle. These difficulties stem from the inherent conflict between the condition…
▽ More
Non-Rigid Structure from Motion (NRSfM) refers to the problem of reconstructing cameras and the 3D point cloud of a non-rigid object from an ensemble of images with 2D correspondences. Current NRSfM algorithms are limited from two perspectives: (i) the number of images, and (ii) the type of shape variability they can handle. These difficulties stem from the inherent conflict between the condition of the system and the degrees of freedom needing to be modeled -- which has hampered its practical utility for many applications within vision. In this paper we propose a novel hierarchical sparse coding model for NRSFM which can overcome (i) and (ii) to such an extent, that NRSFM can be applied to problems in vision previously thought too ill posed. Our approach is realized in practice as the training of an unsupervised deep neural network (DNN) auto-encoder with a unique architecture that is able to disentangle pose from 3D structure. Using modern deep learning computational platforms allows us to solve NRSfM problems at an unprecedented scale and shape complexity. Our approach has no 3D supervision, relying solely on 2D point correspondences. Further, our approach is also able to handle missing/occluded 2D points without the need for matrix completion. Extensive experiments demonstrate the impressive performance of our approach where we exhibit superior precision and robustness against all available state-of-the-art works in some instances by an order of magnitude. We further propose a new quality measure (based on the network weights) which circumvents the need for 3D ground-truth to ascertain the confidence we have in the reconstructability. We believe our work to be a significant advance over state-of-the-art in NRSFM.
△ Less
Submitted 6 September, 2019; v1 submitted 29 July, 2019;
originally announced July 2019.
-
Behavioral similarity of dissipative solitons in an ultrafast fiber laser
Authors:
Ying Yu,
Cihang Kong,
Bowen Li,
Jiqiang Kang,
Yu-Xuan Ren,
Zhi-Chao Luo,
Kenneth K. Y. Wong
Abstract:
Dissipative solitons are non-dispersive localized waves that exhibit intriguing dynamics. In optical systems, the discovery of new soliton dynamics and how to accurately manipulate dissipative solitons are still largely unexplored and challenging in the ultrafast fiber laser community. Herein, we unveil a new type of dissipative soliton behavior in a net-normal-dispersion bidirectional ultrafast f…
▽ More
Dissipative solitons are non-dispersive localized waves that exhibit intriguing dynamics. In optical systems, the discovery of new soliton dynamics and how to accurately manipulate dissipative solitons are still largely unexplored and challenging in the ultrafast fiber laser community. Herein, we unveil a new type of dissipative soliton behavior in a net-normal-dispersion bidirectional ultrafast fiber laser. That is, the bidirectional dissipative solitons will always reveal similar spectral and temporal characteristics through common gain and loss modulation, even if the transient instability is involved. The behavioral similarity enables us to accurately design the soliton patterns by introducing seed pulses through loss modulation. As a proof-of-concept application, the precise and flexible manipulation of multi-soliton patterns is demonstrated. These findings will shed new insights into the complex dissipative soliton dynamics, and also beneficial for designing ultrafast lasers with desirable soliton patterns for practical applications.
△ Less
Submitted 25 July, 2019;
originally announced July 2019.
-
A filtering problem with uncertainty in observation
Authors:
Shaolin Ji,
Chuiliu Kong,
Chuanfeng Sun
Abstract:
This paper is concerned with a generalized Kalman-Bucy filtering model and corresponding robust problem under model uncertainty. We find that this robust problem is equivalent to considering an estimate problem under some sublinear operator. Therefore, we turn to obtaining the minimum mean square estimator under a sublinear operator. By Girsanov theorem and minimax theorem, we obtain the optimal e…
▽ More
This paper is concerned with a generalized Kalman-Bucy filtering model and corresponding robust problem under model uncertainty. We find that this robust problem is equivalent to considering an estimate problem under some sublinear operator. Therefore, we turn to obtaining the minimum mean square estimator under a sublinear operator. By Girsanov theorem and minimax theorem, we obtain the optimal estimator $\hat{x}_{t}$ of the signal process $x_{t}$ for given time $t\in\lbrack0,T]$.
△ Less
Submitted 14 August, 2019; v1 submitted 1 July, 2019;
originally announced July 2019.
-
Incorporating Sememes into Chinese Definition Modeling
Authors:
Liner Yang,
Cunliang Kong,
Yun Chen,
Yang Liu,
Qinan Fan,
Erhong Yang
Abstract:
Chinese definition modeling is a challenging task that generates a dictionary definition in Chinese for a given Chinese word. To accomplish this task, we construct the Chinese Definition Modeling Corpus (CDM), which contains triples of word, sememes and the corresponding definition. We present two novel models to improve Chinese definition modeling: the Adaptive-Attention model (AAM) and the Self-…
▽ More
Chinese definition modeling is a challenging task that generates a dictionary definition in Chinese for a given Chinese word. To accomplish this task, we construct the Chinese Definition Modeling Corpus (CDM), which contains triples of word, sememes and the corresponding definition. We present two novel models to improve Chinese definition modeling: the Adaptive-Attention model (AAM) and the Self- and Adaptive-Attention Model (SAAM). AAM successfully incorporates sememes for generating the definition with an adaptive attention mechanism. It has the capability to decide which sememes to focus on and when to pay attention to sememes. SAAM further replaces recurrent connections in AAM with self-attention and relies entirely on the attention mechanism, reducing the path length between word, sememes and definition. Experiments on CDM demonstrate that by incorporating sememes, our best proposed model can outperform the state-of-the-art method by +6.0 BLEU.
△ Less
Submitted 15 May, 2019;
originally announced May 2019.
-
A robust Kalman-Bucy filtering problem
Authors:
Shaolin Ji,
Chuiliu Kong,
Chuanfeng Sun
Abstract:
A generalized Kalman-Bucy model under model uncertainty and a corresponding robust problem are studied in this paper. We find that this robust problem is equivalent to an estimate problem under a sublinear operator. By Girsanov transformation and the minimax theorem, we prove that this problem can be reformulated as a classical Kalman-Bucy filtering problem under a new probability measure. The equ…
▽ More
A generalized Kalman-Bucy model under model uncertainty and a corresponding robust problem are studied in this paper. We find that this robust problem is equivalent to an estimate problem under a sublinear operator. By Girsanov transformation and the minimax theorem, we prove that this problem can be reformulated as a classical Kalman-Bucy filtering problem under a new probability measure. The equation which governs the optimal estimator is obtained. Moreover, the optimal estimator can be decomposed into the classical optimal estimator and a term related to model uncertainty.
△ Less
Submitted 14 August, 2019; v1 submitted 5 May, 2019;
originally announced May 2019.
-
Noncommutative Coordinate Picture of the Quantum Phase Space
Authors:
Otto C. W. Kong,
Wei-Yin Liu
Abstract:
We illustrate an isomorphic representation of the observable algebra for quantum mechanics in terms of the functions on the projective Hilbert space, and its Hilbert space analog, with a noncommutative product in terms of explicit coordinates and discuss the physical and dynamical picture. The isomorphism is then used as a base for the translation of the differential symplectic geometry of the inf…
▽ More
We illustrate an isomorphic representation of the observable algebra for quantum mechanics in terms of the functions on the projective Hilbert space, and its Hilbert space analog, with a noncommutative product in terms of explicit coordinates and discuss the physical and dynamical picture. The isomorphism is then used as a base for the translation of the differential symplectic geometry of the infinite dimensional manifolds onto the observable algebra as a noncommutative geometry. Hence, we obtain the latter from the physical theory itself. We have essentially an extended formalism of the Schrodinger versus Heisenberg picture which we describe mathematically as like a coordinate map from the phase space, for which we have presented argument to be seen as the quantum model of the physical space, to the noncommutative geometry coordinated by the six position and momentum operators. The observable algebra is taken essentially as an algebra of formal functions on the latter operators. The work formulates the intuitive idea that the noncommutative geometry can be seen as an alternative, noncommutative coordinate, picture of familiar quantum phase space, at least so long as the symplectic geometry is concerned.
△ Less
Submitted 8 February, 2022; v1 submitted 27 March, 2019;
originally announced March 2019.
-
The Noncommutative Values of Quantum Observables
Authors:
Otto C. W. Kong,
Wei-Yin Liu
Abstract:
We discuss the notion about physical quantities as having values represented by real numbers, and its limiting to describe nature to be understood in relation to our appreciation that the quantum theory is a better theory of natural phenomena than its classical analog. Getting from the algebra of physical observables to their values on a fixed state is, at least for classical physics, really a hom…
▽ More
We discuss the notion about physical quantities as having values represented by real numbers, and its limiting to describe nature to be understood in relation to our appreciation that the quantum theory is a better theory of natural phenomena than its classical analog. Getting from the algebra of physical observables to their values on a fixed state is, at least for classical physics, really a homomorphic map from the algebra into the real number algebra. The limitation of the latter to represent the values of quantum observables with noncommutating algebraic relation is obvious. We introduce and discuss the idea of the noncommutative values of quantum observables and its feasibility, arguing that at least in terms of the representation of such a value as an infinite set of complex number, the idea makes reasonable sense theoretically as well as practically.
△ Less
Submitted 12 January, 2021; v1 submitted 20 March, 2019;
originally announced March 2019.
-
The minimum mean square estimator of integrable variables under sublinear operators
Authors:
Shaolin Ji,
Chuiliu Kong,
Chuanfeng Sun
Abstract:
In this paper, we study the minimum mean square estimator for non-bounded random variables under sublinear operators. The existence and uniqueness of the minimum mean square estimator are obtained. Several properties of the minimum mean square estimator for non-bounded random variables are proved under some mild assumptions.
In this paper, we study the minimum mean square estimator for non-bounded random variables under sublinear operators. The existence and uniqueness of the minimum mean square estimator are obtained. Several properties of the minimum mean square estimator for non-bounded random variables are proved under some mild assumptions.
△ Less
Submitted 5 March, 2019;
originally announced March 2019.
-
Deep Interpretable Non-Rigid Structure from Motion
Authors:
Chen Kong,
Simon Lucey
Abstract:
All current non-rigid structure from motion (NRSfM) algorithms are limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many applications within vision. In this paper we propose a novel deep neural network to recover camera poses and 3D points solely from an ensemble of 2D image coordinates.…
▽ More
All current non-rigid structure from motion (NRSfM) algorithms are limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many applications within vision. In this paper we propose a novel deep neural network to recover camera poses and 3D points solely from an ensemble of 2D image coordinates. The proposed neural network is mathematically interpretable as a multi-layer block sparse dictionary learning problem, and can handle problems of unprecedented scale and shape complexity. Extensive experiments demonstrate the impressive performance of our approach where we exhibit superior precision and robustness against all available state-of-the-art works. The considerable model capacity of our approach affords remarkable generalization to unseen data. We propose a quality measure (based on the network weights) which circumvents the need for 3D ground-truth to ascertain the confidence we have in the reconstruction. Once the network's weights are estimated (for a non-rigid object) we show how our approach can effectively recover 3D shape from a single image -- outperforming comparable methods that rely on direct 3D supervision.
△ Less
Submitted 27 February, 2019;
originally announced February 2019.
-
Spatiotemporal Bloch states of a spin-orbit coupled Bose-Einstein condensate in an optical lattice
Authors:
Yawen Wei,
Chao Kong,
Wenhua Hai
Abstract:
We study the spatiotemporal Bloch states of a high-frequency driven two-component Bose-Einstein condensate (BEC) with spin-orbit coupling (SOC) in an optical lattice. By adopting the rotating-wave approximation (RWA) and applying an exact trial-solution to the corresponding quasistationary system, we establish a different method for tuning SOC via external field such that the existence conditions…
▽ More
We study the spatiotemporal Bloch states of a high-frequency driven two-component Bose-Einstein condensate (BEC) with spin-orbit coupling (SOC) in an optical lattice. By adopting the rotating-wave approximation (RWA) and applying an exact trial-solution to the corresponding quasistationary system, we establish a different method for tuning SOC via external field such that the existence conditions of the exact particular solutions are fitted. Several novel features related to the exact states are demonstrated, such as SOC leads to spin-motion entanglement for the spatiotemporal Bloch states, SOC increases the population imbalance of the two-component BEC and SOC can be applied to manipulate the stable atomic flow which is conducive to control quantum transport of the BEC for different application purposes.
△ Less
Submitted 5 February, 2019;
originally announced February 2019.
-
Faster super-resolution imaging with auto-correlation two-step deconvolution
Authors:
Weisong Zhao,
Jian Liu,
Chenqi Kong,
Yixuan Zhao,
Changliang Guo,
Chenguang Liu,
Xiangyan Ding,
Xumin Ding,
Jiubin Tan,
Haoyu Li
Abstract:
Despite super-resolution fluorescence blinking microscopes break the diffraction limit, the intense phototoxic illumination and long-term image sequences thus far still pose to major challenges in visualizing live-organisms. Here, we proposed a super-resolution method based on auto-correlation two-step deconvolution (SACD) to enhance the temporal resolution at lower signal intensity levels. Unlike…
▽ More
Despite super-resolution fluorescence blinking microscopes break the diffraction limit, the intense phototoxic illumination and long-term image sequences thus far still pose to major challenges in visualizing live-organisms. Here, we proposed a super-resolution method based on auto-correlation two-step deconvolution (SACD) to enhance the temporal resolution at lower signal intensity levels. Unlike conventional techniques, such as super-resolution optical fluctuation imaging (SOFI) or stochastic optical reconstruction microscopy (STORM), our model allows 16 frames to generate super-resolution images, without noticeable degradation in recording quality. We demonstrate SACD both in simulated predictions and experimental validations, with the resulting spatial resolution of 64 nm and 2-10 fold speed improvements. The use of low signal-to-noise ratio acquisition of image sequences, our SACD enables fast, background-free, super-resolution imaging that maybe advance implemented as a suitable tool for rapid live-cells imaging.
△ Less
Submitted 5 December, 2019; v1 submitted 19 September, 2018;
originally announced September 2018.
-
Quantum Spacetime Pictures and Dynamics from a Relativity Perspective
Authors:
Otto C. W. Kong
Abstract:
Based on an identified quantum relativity symmetry the contraction of which gives the Newtonian approximation of Galilean relativity, a quantum model of the physical space can be formulated with the Newtonian space seen in a way as the classical approximation. Matching picture for the observable algebra as the corresponding representation of the group C* -algebra, describes the full dynamical pict…
▽ More
Based on an identified quantum relativity symmetry the contraction of which gives the Newtonian approximation of Galilean relativity, a quantum model of the physical space can be formulated with the Newtonian space seen in a way as the classical approximation. Matching picture for the observable algebra as the corresponding representation of the group C* -algebra, describes the full dynamical pictures equally successfully. Extension of the scheme to a Lorentz covariant setting and beyond will also be addressed.The formulation of quantum mechanics allows the theory to be seen in a new picture in line with the notion of a noncommutative spacetime.
△ Less
Submitted 12 September, 2018;
originally announced September 2018.
-
The First Physics Picture of Contractions from a Fundamental Quantum Relativity Symmetry Including all Known Relativity Symmetries, Classical and Quantum
Authors:
Otto C. W. Kong,
Jason Payne
Abstract:
In this article, we utilize the insights gleaned from our recent formulation of space(-time), as well as dynamical picture of quantum mechanics and its classical approximation, from the relativity symmetry perspective in order to push further into the realm of the proposed fundamental relativity symmetry $SO(2,4)$ of our quantum relativity project. We explicitly trace how the diverse actors in thi…
▽ More
In this article, we utilize the insights gleaned from our recent formulation of space(-time), as well as dynamical picture of quantum mechanics and its classical approximation, from the relativity symmetry perspective in order to push further into the realm of the proposed fundamental relativity symmetry $SO(2,4)$ of our quantum relativity project. We explicitly trace how the diverse actors in this story change through various contraction limits, paying careful attention to the relevant physical units, in order to place all known relativity theories -- quantum and classical -- within a single framework. More specifically, we explore both of the possible contractions of $SO(2,4)$ and its coset spaces in order to determine how best to recover the lower-level theories. These include both new models and all familiar theories, as well as quantum and classical dynamics with and without Einsteinian special relativity. Along the way, we also find connections with covariant quantum mechanics. The emphasis of this article rests on the ability of this language to not only encompass all known physical theories, but to also provide a path for extensions. It will serve as the basic background for more detailed formulations of the dynamical theories at each level, as well as the exact connections amongst them.
△ Less
Submitted 12 January, 2021; v1 submitted 7 February, 2018;
originally announced February 2018.