Showing 1–6 of 6 results for author: Yue, G

Exploring the Robustness of In-Context Learning with Noisy Labels

Authors: Chen Cheng, Xinzhi Yu, Haodong Wen, **gsong Sun, Guanzhang Yue, Yihao Zhang, Zeming Wei

Abstract: Recently, the mysterious In-Context Learning (ICL) ability exhibited by Transformer architectures, especially in large language models (LLMs), has sparked significant research interest. However, the resilience of Transformers' in-context learning capabilities in the presence of noisy samples, prevalent in both training corpora and prompt demonstrations, remains underexplored. In this paper, inspir… ▽ More Recently, the mysterious In-Context Learning (ICL) ability exhibited by Transformer architectures, especially in large language models (LLMs), has sparked significant research interest. However, the resilience of Transformers' in-context learning capabilities in the presence of noisy samples, prevalent in both training corpora and prompt demonstrations, remains underexplored. In this paper, inspired by prior research that studies ICL ability using simple function classes, we take a closer look at this problem by investigating the robustness of Transformers against noisy labels. Specifically, we first conduct a thorough evaluation and analysis of the robustness of Transformers against noisy labels during in-context learning and show that they exhibit notable resilience against diverse types of noise in demonstration labels. Furthermore, we delve deeper into this problem by exploring whether introducing noise into the training set, akin to a form of data augmentation, enhances such robustness during inference, and find that such noise can indeed improve the robustness of ICL. Overall, our fruitful analysis and findings provide a comprehensive understanding of the resilience of Transformer models against label noises during ICL and provide valuable insights into the research on Transformers in natural language processing. Our code is available at https://github.com/InezYu0928/in-context-learning. △ Less

Submitted 1 May, 2024; v1 submitted 28 April, 2024; originally announced April 2024.

Comments: ICLR 2024 Workshop on Reliable and Responsible Foundation Models

Affine Springer Fibers and the Affine Matrix Ball Construction for Rectangular Type Nilpotents

Authors: Pablo Boixeda Alvarez, Li Ying, Guangyi Yue

Abstract: In this paper, we study the affine Springer fiber $\mathcal{F} l_N$ in type $A$ for rectangular type semisimple nil-element $N$ and calculate the relative position between irreducible components. In particular, we use the affine matrix ball construction to show the relative position map is compatible with the Kazhdan-Lusztig cell structure, generalizing the work of Steinberg and van Leeuwen. In this paper, we study the affine Springer fiber $\mathcal{F} l_N$ in type $A$ for rectangular type semisimple nil-element $N$ and calculate the relative position between irreducible components. In particular, we use the affine matrix ball construction to show the relative position map is compatible with the Kazhdan-Lusztig cell structure, generalizing the work of Steinberg and van Leeuwen. △ Less

Submitted 19 August, 2020; v1 submitted 28 July, 2020; originally announced July 2020.

Relationship Between Mullineux Involution and the Generalized Regularization

Authors: Allen Wang, Guangyi Yue

Abstract: The Mullineux involution is an important map on $p$-regular partitions that originates from the modular representation theory of $\mathcal{S}_n$. In this paper we study the Mullineux transpose map and the generalized column regularization and prove a condition under which the two maps are exactly the same. Our results generalize the work of Bessenrodt, Olsson and Xu, and the combinatorial construc… ▽ More The Mullineux involution is an important map on $p$-regular partitions that originates from the modular representation theory of $\mathcal{S}_n$. In this paper we study the Mullineux transpose map and the generalized column regularization and prove a condition under which the two maps are exactly the same. Our results generalize the work of Bessenrodt, Olsson and Xu, and the combinatorial constructions is related to the Iwahori-Hecke algebra and the global crystal basis of the basic $U_q(\widehat{\mathfrak{sl}}_b)$-module. In the conclusion, we provide several conjectures regarding the $q$-decomposition numbers and generalizations of results due to Fayers. △ Less

Submitted 28 October, 2019; v1 submitted 18 December, 2018; originally announced December 2018.

Journal ref: European Journal of Combinatorics, Volume 85, March 2020, 103059

Combinatorial Wall-Crossing and the Mullineux Involution

Authors: Panagiotis Dimakis, Guangyi Yue

Abstract: In this paper, we define the combinatorial wall-crossing transformation and the generalized column regularization on partitions and prove that a certain composition of these two transformations has the same effect on the one-row partition $(n)$. As corollaries we explicitly describe the quotients of the partitions which arise in this process. We also prove that the one-row partition is the unique… ▽ More In this paper, we define the combinatorial wall-crossing transformation and the generalized column regularization on partitions and prove that a certain composition of these two transformations has the same effect on the one-row partition $(n)$. As corollaries we explicitly describe the quotients of the partitions which arise in this process. We also prove that the one-row partition is the unique partition that stays regular at any step of the wall-crossing transformation. △ Less

Submitted 25 August, 2018; v1 submitted 14 November, 2017; originally announced November 2017.

Journal ref: J Algebr Comb 50 (2019), 49-72

Counting Independent Sets in Graphs of Hyperplane Arrangements

Authors: Nicholas Guo, Guangyi Yue

Abstract: In this paper, we count the number of independent sets of a type of graph $G(\mathcal{A},q)$ associated to some hyperplane arrangement $\mathcal{A}$, which is a generalization of the construction of graphical arrangements. We show that when the parameters of $\mathcal{A}$ satisfy certain conditions, the number of independent sets of the disjoint union… ▽ More In this paper, we count the number of independent sets of a type of graph $G(\mathcal{A},q)$ associated to some hyperplane arrangement $\mathcal{A}$, which is a generalization of the construction of graphical arrangements. We show that when the parameters of $\mathcal{A}$ satisfy certain conditions, the number of independent sets of the disjoint union $G(\mathcal{A},q_1)\cup\cdots\cup G(\mathcal{A},q_s)$ depends only on the coefficients of $\mathcal{A}$ and the total number of vertices $\sum_i q_i$ when $q_i$'s are powers of large enough prime numbers. In addition it is independent of the coefficients as long as $\mathcal{A}$ is central and the coefficients are multiplicatively independent. △ Less

Submitted 18 November, 2019; v1 submitted 13 December, 2016; originally announced December 2016.

Comments: Accepted by Discrete Mathematics

Journal ref: Discrete Mathematics, Volume 343, Issue 3, March 2020, 111764

The Lie conformal algebra of a Block type Lie algebra

Authors: Ming Gao Ying Xu Xiaoqing Yue

Abstract: Let $L$ be a Lie algebra of Block type over $\C$ with basis $\{L_{α,i}\,|\,α,i\in\Z\}$ and brackets $[L_{α,i},L_{β,j}]=(β(i+1)-α(j+1))L_{α+β,i+j}$. In this paper, we shall construct a formal distribution Lie algebra of $L$. Then we decide its conformal algebra $B$ with $\C[\partial]$-basis $\{L_α(w)\,|\,α\in\Z\}$ and $λ$-brackets $[L_α(w)_λL_β(w)]=(α\partial+(α+β)λ)L_{α+β}(w)$. Finally, we give a… ▽ More Let $L$ be a Lie algebra of Block type over $\C$ with basis $\{L_{α,i}\,|\,α,i\in\Z\}$ and brackets $[L_{α,i},L_{β,j}]=(β(i+1)-α(j+1))L_{α+β,i+j}$. In this paper, we shall construct a formal distribution Lie algebra of $L$. Then we decide its conformal algebra $B$ with $\C[\partial]$-basis $\{L_α(w)\,|\,α\in\Z\}$ and $λ$-brackets $[L_α(w)_λL_β(w)]=(α\partial+(α+β)λ)L_{α+β}(w)$. Finally, we give a classification of free intermediate series $B$-modules. △ Less

Submitted 23 October, 2012; originally announced October 2012.

Comments: 17

MSC Class: 17B68; 17B69