Showing 1–7 of 7 results for author: Kiselev, S

Cross-Modal Conceptualization in Bottleneck Models

Authors: Danis Alukaev, Semen Kiselev, Ilya Pershin, Bulat Ibragimov, Vladimir Ivanov, Alexey Kornaev, Ivan Titov

Abstract: Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting the label relying on these concepts. The main difficulty in using CBMs comes from having to choose concepts that are predictive of the label and then having to l… ▽ More Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting the label relying on these concepts. The main difficulty in using CBMs comes from having to choose concepts that are predictive of the label and then having to label training examples with these concepts. In our approach, we adopt a more moderate assumption and instead use text descriptions (e.g., radiology reports), accompanying the images in training, to guide the induction of concepts. Our cross-modal approach treats concepts as discrete latent variables and promotes concepts that (1) are predictive of the label, and (2) can be predicted reliably from both the image and text. Through experiments conducted on datasets ranging from synthetic datasets (e.g., synthetic images with generated descriptions) to realistic medical imaging datasets, we demonstrate that cross-modal learning encourages the induction of interpretable concepts while also facilitating disentanglement. Our results also suggest that this guidance leads to increased robustness by suppressing the reliance on shortcut features. △ Less

Submitted 17 December, 2023; v1 submitted 23 October, 2023; originally announced October 2023.

Comments: Accepted at EMNLP 2023; camera-ready version

On anti-stochastic properties of unlabeled graphs

Authors: Sergei Kiselev, Andrey Kupavskii, Oleg Verbitsky, Maksim Zhukovskii

Abstract: We study vulnerability of a uniformly distributed random graph to an attack by an adversary who aims for a global change of the distribution while being able to make only a local change in the graph. We call a graph property $A$ anti-stochastic if the probability that a random graph $G$ satisfies $A$ is small but, with high probability, there is a small perturbation transforming $G$ into a graph s… ▽ More We study vulnerability of a uniformly distributed random graph to an attack by an adversary who aims for a global change of the distribution while being able to make only a local change in the graph. We call a graph property $A$ anti-stochastic if the probability that a random graph $G$ satisfies $A$ is small but, with high probability, there is a small perturbation transforming $G$ into a graph satisfying $A$. While for labeled graphs such properties are easy to obtain from binary covering codes, the existence of anti-stochastic properties for unlabeled graphs is not so evident. If an admissible perturbation is either the addition or the deletion of one edge, we exhibit an anti-stochastic property that is satisfied by a random unlabeled graph of order $n$ with probability $(2+o(1))/n^2$, which is as small as possible. We also express another anti-stochastic property in terms of the degree sequence of a graph. This property has probability $(2+o(1))/(n\ln n)$, which is optimal up to factor of 2. △ Less

Submitted 8 April, 2023; v1 submitted 8 December, 2021; originally announced December 2021.

On the maximum number of distinct intersections in an intersecting family

Authors: Peter Frankl, Sergei Kiselev, Andrey Kupavskii

Abstract: For $n > 2k \geq 4$ we consider intersecting families $\mathcal F$ consisting of $k$-subsets of $\{1, 2, \ldots, n\}$. Let $\mathcal I(\mathcal F)$ denote the family of all distinct intersections $F \cap F'$, $F \neq F'$ and $F, F'\in \mathcal F$. Let $\mathcal A$ consist of the $k$-sets $A$ satisfying $|A \cap \{1, 2, 3\}| \geq 2$. We prove that for $n \geq 50 k^2$ $|\mathcal I(\mathcal F)|$ is m… ▽ More For $n > 2k \geq 4$ we consider intersecting families $\mathcal F$ consisting of $k$-subsets of $\{1, 2, \ldots, n\}$. Let $\mathcal I(\mathcal F)$ denote the family of all distinct intersections $F \cap F'$, $F \neq F'$ and $F, F'\in \mathcal F$. Let $\mathcal A$ consist of the $k$-sets $A$ satisfying $|A \cap \{1, 2, 3\}| \geq 2$. We prove that for $n \geq 50 k^2$ $|\mathcal I(\mathcal F)|$ is maximized by $\mathcal A$. △ Less

Submitted 1 August, 2021; originally announced August 2021.

Best possible bounds on the number of distinct differences in intersecting families

Authors: Peter Frankl, Sergei Kiselev, Andrey Kupavskii

Abstract: For a family $\mathcal F$, let $\mathcal D(\mathcal F)$ stand for the family of all sets that can be expressed as $F\setminus G$, where $F,G\in \mathcal F$. A family $\mathcal F$ is intersecting if any two sets from the family have non-empty intersection. In this paper, we study the following question: what is the maximum of $|\mathcal D(\mathcal F)|$ for an intersecting family of $k$-element sets… ▽ More For a family $\mathcal F$, let $\mathcal D(\mathcal F)$ stand for the family of all sets that can be expressed as $F\setminus G$, where $F,G\in \mathcal F$. A family $\mathcal F$ is intersecting if any two sets from the family have non-empty intersection. In this paper, we study the following question: what is the maximum of $|\mathcal D(\mathcal F)|$ for an intersecting family of $k$-element sets? Frankl conjectured that the maximum is attained when $\mathcal F$ is the family of all sets containing a fixed element. We show that this holds if $n \ge 50k\ln k$ and $k \ge 50$. At the same time, we provide a counterexample for $n< 4k$. △ Less

Submitted 10 August, 2022; v1 submitted 9 June, 2021; originally announced June 2021.

Trivial colors in colorings of Kneser graphs

Authors: Sergei Kiselev, Andrey Kupavskii

Abstract: We show that any proper coloring of a Kneser graph $KG_{n,k}$ with $n-2k+2$ colors contains a trivial color (i.e., a color consisting of sets that all contain a fixed element), provided $n>(2+\varepsilon)k^2$, where $\varepsilon\to 0$ as $k\to \infty$. This bound is essentially tight. This is a consequence of a more general result on the minimum number of non-trivial colors needed to properly colo… ▽ More We show that any proper coloring of a Kneser graph $KG_{n,k}$ with $n-2k+2$ colors contains a trivial color (i.e., a color consisting of sets that all contain a fixed element), provided $n>(2+\varepsilon)k^2$, where $\varepsilon\to 0$ as $k\to \infty$. This bound is essentially tight. This is a consequence of a more general result on the minimum number of non-trivial colors needed to properly color $KG_{n,k}$. △ Less

Submitted 10 August, 2022; v1 submitted 28 December, 2020; originally announced December 2020.

Rainbow matchings in $k$-partite hypergraphs

Authors: Sergei Kiselev, Andrey Kupavskii

Abstract: In this paper, we prove a conjecture of Aharoni and Howard on the existence of rainbow (transversal) matchings in sufficiently large families $\mathcal F_1,\ldots, \mathcal F_s$ of tuples in $\{1,\ldots, n\}^k$, provided $s\ge 470.$ In this paper, we prove a conjecture of Aharoni and Howard on the existence of rainbow (transversal) matchings in sufficiently large families $\mathcal F_1,\ldots, \mathcal F_s$ of tuples in $\{1,\ldots, n\}^k$, provided $s\ge 470.$ △ Less

Submitted 23 May, 2020; v1 submitted 7 January, 2020; originally announced January 2020.

Sharp bounds for the chromatic number of random Kneser graphs

Authors: Sergei Kiselev, Andrey Kupavskii

Abstract: Given positive integers $n\ge 2k$, the {\it Kneser graph} $KG_{n,k}$ is a graph whose vertex set is the collection of all $k$-element subsets of the set $\{1,\ldots, n\}$, with edges connecting pairs of disjoint sets. One of the classical results in combinatorics, conjectured by Kneser and proved by Lovász, states that the chromatic number of $KG_{n,k}$ is equal to $n-2k+2$. In this paper, we stud… ▽ More Given positive integers $n\ge 2k$, the {\it Kneser graph} $KG_{n,k}$ is a graph whose vertex set is the collection of all $k$-element subsets of the set $\{1,\ldots, n\}$, with edges connecting pairs of disjoint sets. One of the classical results in combinatorics, conjectured by Kneser and proved by Lovász, states that the chromatic number of $KG_{n,k}$ is equal to $n-2k+2$. In this paper, we study the chromatic number of the {\it random Kneser graph} $KG_{n,k}(p)$, that is, the graph obtained from $KG_{n,k}$ by including each of the edges of $KG_{n,k}$ independently and with probability $p$. We prove that, for any fixed $k\ge 3$, $χ(KG_{n,k}(1/2)) = n-Θ(\sqrt[2k-2]{\log_2 n})$, as well as $χ(KG_{n,2}(1/2)) = n-Θ(\sqrt[2]{\log_2 n \cdot \log_2\log_2 n})$. We also prove that, for $k\ge (1+\varepsilon) \log\log n$, we have $χ(KG_{n,k}(1/2))\ge n-2k-10$. This significantly improves previous results on the subject, obtained by Kupavskii and by Alishahi and Hajiabolhassan. The bound on $k$ in the second result is also tight up to a constant. We also discuss an interesting connection to an extremal problem on embeddability of complexes. △ Less

Submitted 17 July, 2021; v1 submitted 2 October, 2018; originally announced October 2018.

Comments: Thanks to a recent result of Kaiser and Stehlik, Theorem 2 is now in a stronger and essentially sharp form