GeSERA: General-domain Summary Evaluation by Relevance Analysis
Authors:
Jessica López Espejel,
Gaël de Chalendar,
Jorge Garcia Flores,
Thierry Charnois,
Ivan Vladimir Meza Ruiz
Abstract:
We present GeSERA, an open-source improved version of SERA for evaluating automatic extractive and abstractive summaries from the general domain. SERA is based on a search engine that compares candidate and reference summaries (called queries) against an information retrieval document base (called index). SERA was originally designed for the biomedical domain only, where it showed a better correla…
▽ More
We present GeSERA, an open-source improved version of SERA for evaluating automatic extractive and abstractive summaries from the general domain. SERA is based on a search engine that compares candidate and reference summaries (called queries) against an information retrieval document base (called index). SERA was originally designed for the biomedical domain only, where it showed a better correlation with manual methods than the widely used lexical-based ROUGE method. In this paper, we take out SERA from the biomedical domain to the general one by adapting its content-based method to successfully evaluate summaries from the general domain. First, we improve the query reformulation strategy with POS Tags analysis of general-domain corpora. Second, we replace the biomedical index used in SERA with two article collections from AQUAINT-2 and Wikipedia. We conduct experiments with TAC2008, TAC2009, and CNNDM datasets. Results show that, in most cases, GeSERA achieves higher correlations with manual evaluation methods than SERA, while it reduces its gap with ROUGE for general-domain summary evaluation. GeSERA even surpasses ROUGE in two cases of TAC2009. Finally, we conduct extensive experiments and provide a comprehensive study of the impact of human annotators and the index size on summary evaluation with SERA and GeSERA.
△ Less
Submitted 7 October, 2021;
originally announced October 2021.
$C^*$ exponential length of commutators unitaries in $AH$ algebras
Authors:
Chun Guang Li,
Liangqing Li,
Iván Velázquez Ruiz
Abstract:
For each unital $C^*$-algebra $A$, we denote $cel_{CU}(A)=\sup\{cel(u):u\in CU(A)\}$, where $cel(u)$ is the exponential length of $u$ and $CU(A)$ is the closure of the commutator subgroup of $U_0(A)$. In this paper, we prove that $cel_{CU}(A)=2π$ provided that $A$ is an $AH$ algebras with slow dimension growth whose real rank is not zero. On the other hand, we prove that $cel_{CU}(A)\leq 2π$ when…
▽ More
For each unital $C^*$-algebra $A$, we denote $cel_{CU}(A)=\sup\{cel(u):u\in CU(A)\}$, where $cel(u)$ is the exponential length of $u$ and $CU(A)$ is the closure of the commutator subgroup of $U_0(A)$. In this paper, we prove that $cel_{CU}(A)=2π$ provided that $A$ is an $AH$ algebras with slow dimension growth whose real rank is not zero. On the other hand, we prove that $cel_{CU}(A)\leq 2π$ when $A$ is an $AH$ algebra with ideal property and of no dimension growth (if we further assume $A$ is not of real rank zero, we have $cel_{CU}(A)= 2π$).
△ Less
Submitted 24 July, 2018;
originally announced July 2018.
