-
Simple Drop-in LoRA Conditioning on Attention Layers Will Improve Your Diffusion Model
Authors:
Joo Young Choi,
Jaesung R. Park,
Inkyu Park,
Jaewoong Cho,
Albert No,
Ernest K. Ryu
Abstract:
Current state-of-the-art diffusion models employ U-Net architectures containing convolutional and (qkv) self-attention layers. The U-Net processes images while being conditioned on the time embedding input for each sampling step and the class or caption embedding input corresponding to the desired conditional generation. Such conditioning involves scale-and-shift operations to the convolutional la…
▽ More
Current state-of-the-art diffusion models employ U-Net architectures containing convolutional and (qkv) self-attention layers. The U-Net processes images while being conditioned on the time embedding input for each sampling step and the class or caption embedding input corresponding to the desired conditional generation. Such conditioning involves scale-and-shift operations to the convolutional layers but does not directly affect the attention layers. While these standard architectural choices are certainly effective, not conditioning the attention layers feels arbitrary and potentially suboptimal. In this work, we show that simply adding LoRA conditioning to the attention layers without changing or tuning the other parts of the U-Net architecture improves the image generation quality. For example, a drop-in addition of LoRA conditioning to EDM diffusion model yields FID scores of 1.91/1.75 for unconditional and class-conditional CIFAR-10 generation, improving upon the baseline of 1.97/1.79.
△ Less
Submitted 6 May, 2024;
originally announced May 2024.
-
Effective data reduction algorithm for topological data analysis
Authors:
Seonmi Choi,
**seok Oh,
Jeong Rye Park,
Seung Yeop Yang,
Hongdae Yun
Abstract:
One of the most interesting tools that have recently entered the data science toolbox is topological data analysis (TDA). With the explosion of available data sizes and dimensions, identifying and extracting the underlying structure of a given dataset is a fundamental challenge in data science, and TDA provides a methodology for analyzing the shape of a dataset using tools and prospects from algeb…
▽ More
One of the most interesting tools that have recently entered the data science toolbox is topological data analysis (TDA). With the explosion of available data sizes and dimensions, identifying and extracting the underlying structure of a given dataset is a fundamental challenge in data science, and TDA provides a methodology for analyzing the shape of a dataset using tools and prospects from algebraic topology. However, the computational complexity makes it quickly infeasible to process large datasets, especially those with high dimensions. Here, we introduce a preprocessing strategy called the Characteristic Lattice Algorithm (CLA), which allows users to reduce the size of a given dataset as desired while maintaining geometric and topological features in order to make the computation of TDA feasible or to shorten its computation time. In addition, we derive a stability theorem and an upper bound of the barcode errors for CLA based on the bottleneck distance.
△ Less
Submitted 23 June, 2023;
originally announced June 2023.
-
Sharp spectral bounds for the edge-connectivity of a regular graph
Authors:
Suil O,
Jongyook Park,
Jeong Rye Park,
Hyunju Yu
Abstract:
Let $λ_2(G)$ and $κ'(G)$ be the second largest eigenvalue and the edge-connectivity of a graph $G$, respectively. Let $d$ be a positive integer at least 3. For $t=1$ or 2, Cioaba proved sharp upper bounds for $λ_2(G)$ in a $d$-regular simple graph $G$ to guarantee that $κ'(G) \ge t+1$. In this paper, we settle down for all $t \ge 3$.
Let $λ_2(G)$ and $κ'(G)$ be the second largest eigenvalue and the edge-connectivity of a graph $G$, respectively. Let $d$ be a positive integer at least 3. For $t=1$ or 2, Cioaba proved sharp upper bounds for $λ_2(G)$ in a $d$-regular simple graph $G$ to guarantee that $κ'(G) \ge t+1$. In this paper, we settle down for all $t \ge 3$.
△ Less
Submitted 4 October, 2018; v1 submitted 2 October, 2018;
originally announced October 2018.
-
Sharp conditions for the existence of an even $[a,b]$-factor in a graph
Authors:
Eun-Kyung Cho,
Jong Yoon Hyun,
Suil O,
Jeong Rye Park
Abstract:
Let $a$ and $b$ be positive integers. An even $[a,b]$-factor of a graph $G$ is a spanning subgraph $H$ such that for every vertex $v \in V(G)$, $d_H(v)$ is even and $a \le d_H(v) \le b$. Matsuda conjectured that if $G$ is an $n$-vertex 2-edge-connected graph such that $n \ge 2a+b+\frac{a^2-3a}b - 2$, $δ(G) \ge a$, and $σ_2(G) \ge \frac{2an}{a+b}$, then $G$ has an even $[a,b]$-factor. In this paper…
▽ More
Let $a$ and $b$ be positive integers. An even $[a,b]$-factor of a graph $G$ is a spanning subgraph $H$ such that for every vertex $v \in V(G)$, $d_H(v)$ is even and $a \le d_H(v) \le b$. Matsuda conjectured that if $G$ is an $n$-vertex 2-edge-connected graph such that $n \ge 2a+b+\frac{a^2-3a}b - 2$, $δ(G) \ge a$, and $σ_2(G) \ge \frac{2an}{a+b}$, then $G$ has an even $[a,b]$-factor. In this paper, we provide counterexamples, which are highly connected. Furthermore, we give sharp sufficient conditions for a graph to have an even $[a,b]$-factor. For even $an$, we conjecture a lower bound for $λ_1(G)$ in an $n$-vertex graph to have an $[a,b]$-factor, where $λ_1(G)$ is the largest eigenvalue of $G$.
△ Less
Submitted 14 September, 2018;
originally announced September 2018.
-
The weighted poset metrics and directed graph metrics
Authors:
Jong Yoon Hyun,
Hyun Kwang Kim,
Jeong Rye Park
Abstract:
Etzion et al. introduced metrics on $\mathbb{F}_2^n$ based on directed graphs on $n$ vertices and developed some basic coding theory on directed graph metric spaces. In this paper, we consider the problem of classifying directed graphs which admit the extended Hamming codes to be a perfect code. We first consider weighted poset metrics as a natural generalization of poset metrics and investigate i…
▽ More
Etzion et al. introduced metrics on $\mathbb{F}_2^n$ based on directed graphs on $n$ vertices and developed some basic coding theory on directed graph metric spaces. In this paper, we consider the problem of classifying directed graphs which admit the extended Hamming codes to be a perfect code. We first consider weighted poset metrics as a natural generalization of poset metrics and investigate interrelation between weighted poset metrics and directed graph based metrics. In the next, we classify weighted posets on a set with eight elements and directed graphs on eight vertices which admit the extended Hamming code $\widetilde{\mathcal{H}}_3$ to be a $2$-perfect code. We also construct some families of such structures for any $k \geq 3$. Those families enable us to construct packing or covering codes of radius 2 under certain maps.
△ Less
Submitted 1 March, 2017;
originally announced March 2017.
