-
Optimizing a Data Science System for Text Reuse Analysis
Authors:
Ananth Mahadevan,
Michael Mathioudakis,
Eetu Mäkelä,
Mikko Tolonen
Abstract:
Text reuse is a methodological element of fundamental importance in humanities research: pieces of text that re-appear across different documents, verbatim or paraphrased, provide invaluable information about the historical spread and evolution of ideas. Large modern digitized corpora enable the joint analysis of text collections that span entire centuries and the detection of large-scale patterns…
▽ More
Text reuse is a methodological element of fundamental importance in humanities research: pieces of text that re-appear across different documents, verbatim or paraphrased, provide invaluable information about the historical spread and evolution of ideas. Large modern digitized corpora enable the joint analysis of text collections that span entire centuries and the detection of large-scale patterns, impossible to detect with traditional small-scale analysis. For this opportunity to materialize, it is necessary to develop efficient data science systems that perform the corresponding analysis tasks.
In this paper, we share insights from ReceptionReader, a system for analyzing text reuse in large historical corpora. The system is built upon billions of instances of text reuses from large digitized corpora of 18th-century texts. Its main functionality is to perform downstream text reuse analysis tasks, such as finding reuses that stem from a given article or identifying the most reused quotes from a set of documents, with each task expressed as a database query. For the purposes of the paper, we discuss the related design choices including various database normalization levels and query execution frameworks, such as distributed data processing (Apache Spark), indexed row store engine (MariaDB Aria), and compressed column store engine (MariaDB Columnstore). Moreover, we present an extensive evaluation with various metrics of interest (latency, storage size, and computing costs) for varying workloads, and we offer insights from the trade-offs we observed and the choices that emerged as optimal in our setting. In summary, our results show that (1) for the workloads that are most relevant to text-reuse analysis, the MariaDB Aria framework emerges as the overall optimal choice, (2) big data processing (Apache Spark) is irreplaceable for all processing stages of the system's pipeline.
△ Less
Submitted 14 January, 2024;
originally announced January 2024.
-
Reception Reader: Exploring Text Reuse in Early Modern British Publications
Authors:
David Rosson,
Eetu Mäkelä,
Ville Vaara,
Ananth Mahadevan,
Yann Ryan,
Mikko Tolonen
Abstract:
The Reception Reader is a web tool for studying text reuse in the Early English Books Online (EEBO-TCP) and Eighteenth Century Collections Online (ECCO) data. Users can: 1) explore a visual overview of the reception of a work, or its incoming connections, across time based on shared text segments, 2) interactively survey the details of connected documents, and 3) examine the context of reused text…
▽ More
The Reception Reader is a web tool for studying text reuse in the Early English Books Online (EEBO-TCP) and Eighteenth Century Collections Online (ECCO) data. Users can: 1) explore a visual overview of the reception of a work, or its incoming connections, across time based on shared text segments, 2) interactively survey the details of connected documents, and 3) examine the context of reused text for "close reading". We show examples of how the tool streamlines research and exploration tasks, and discuss the utility and limitations of the user interface along with its current data sources.
△ Less
Submitted 18 April, 2023; v1 submitted 8 February, 2023;
originally announced February 2023.
-
Mechanics of cell integration in vivo
Authors:
Guilherme B. Ventura,
Aboutaleb Amiri,
Raghavan Thiagarajan,
Mari Tolonen,
Amin Doostmohammadi,
Jakub Sedzinski
Abstract:
During embryonic development, regeneration and homeostasis, cells have to physically integrate into their target tissues, where they ultimately execute their function. Despite a significant body of research on how mechanical forces instruct cellular behaviors within the plane of an epithelium, very little is known about the mechanical interplay at the interface between migrating cells and their su…
▽ More
During embryonic development, regeneration and homeostasis, cells have to physically integrate into their target tissues, where they ultimately execute their function. Despite a significant body of research on how mechanical forces instruct cellular behaviors within the plane of an epithelium, very little is known about the mechanical interplay at the interface between migrating cells and their surrounding tissue, which has its own dynamics, architecture and identity. Here, using quantitative in vivo imaging and molecular perturbations, together with a theoretical model, we reveal that multiciliated cell (MCC) precursors in the Xenopus embryo form dynamic filopodia that pull at the vertices of the overlying epithelial sheet to probe their stiffness and identify the preferred positions for their integration into the tissue. Moreover, we report a novel function for a structural component of vertices, the lipolysis-stimulated lipoprotein receptor (LSR), in filopodia dynamics and show its critical role in cell intercalation. Remarkably, we find that pulling forces equip the MCCs to remodel the epithelial junctions of the neighboring tissue, enabling them to generate a permissive environment for their integration. Our findings reveal the intricate physical crosstalk at the cell-tissue interface and uncover previously unknown functions for mechanical forces in orchestrating cell integration.
△ Less
Submitted 24 November, 2021;
originally announced November 2021.
-
Topic modelling discourse dynamics in historical newspapers
Authors:
Jani Marjanen,
Elaine Zosa,
Simon Hengchen,
Lidia Pivovarova,
Mikko Tolonen
Abstract:
This paper addresses methodological issues in diachronic data analysis for historical research. We apply two families of topic models (LDA and DTM) on a relatively large set of historical newspapers, with the aim of capturing and understanding discourse dynamics. Our case study focuses on newspapers and periodicals published in Finland between 1854 and 1917, but our method can easily be transposed…
▽ More
This paper addresses methodological issues in diachronic data analysis for historical research. We apply two families of topic models (LDA and DTM) on a relatively large set of historical newspapers, with the aim of capturing and understanding discourse dynamics. Our case study focuses on newspapers and periodicals published in Finland between 1854 and 1917, but our method can easily be transposed to any diachronic data. Our main contributions are a) a combined sampling, training and inference procedure for applying topic models to huge and imbalanced diachronic text collections; b) a discussion on the differences between two topic models for this type of data; c) quantifying topic prominence for a period and thus a generalization of document-wise topic assignment to a discourse level; and d) a discussion of the role of humanistic interpretation with regard to analysing discourse dynamics through topic models.
△ Less
Submitted 20 November, 2020;
originally announced November 2020.
