MorphStore: Analytical Query Engine with a Holistic Compression-Enabled Processing Model
Authors:
Patrick Damme,
Annett Ungethüm,
Johannes Pietrzyk,
Alexander Krause,
Dirk Habich,
Wolfgang Lehner
Abstract:
In this paper, we present MorphStore, an open-source in-memory columnar analytical query engine with a novel holistic compression-enabled processing model. Basically, compression using lightweight integer compression algorithms already plays an important role in existing in-memory column-store database systems, but mainly for base data. In particular, during query processing, these systems only ke…
▽ More
In this paper, we present MorphStore, an open-source in-memory columnar analytical query engine with a novel holistic compression-enabled processing model. Basically, compression using lightweight integer compression algorithms already plays an important role in existing in-memory column-store database systems, but mainly for base data. In particular, during query processing, these systems only keep the data compressed until an operator cannot process the compressed data directly, whereupon the data is decompressed, but not recompressed. Thus, the full potential of compression during query processing is not exploited. To overcome that, we developed a novel compression-enabled processing model as presented in this paper. As we are going to show, the continuous usage of compression for all base data and all intermediates is very beneficial to reduce the overall memory footprint as well as to improve the query performance.
△ Less
Submitted 20 April, 2020;
originally announced April 2020.
Estimating infectious disease parameters from data on social contacts and serological status
Authors:
Nele Goeyvaerts,
Niel Hens,
Benson Ogunjimi,
Marc Aerts,
Ziv Shkedy,
Pierre Van Damme,
Philippe Beutels
Abstract:
In dynamic models of infectious disease transmission, typically various mixing patterns are imposed on the so-called Who-Acquires-Infection-From-Whom matrix (WAIFW). These imposed mixing patterns are based on prior knowledge of age-related social mixing behavior rather than observations. Alternatively, one can assume that transmission rates for infections transmitted predominantly through non-sexu…
▽ More
In dynamic models of infectious disease transmission, typically various mixing patterns are imposed on the so-called Who-Acquires-Infection-From-Whom matrix (WAIFW). These imposed mixing patterns are based on prior knowledge of age-related social mixing behavior rather than observations. Alternatively, one can assume that transmission rates for infections transmitted predominantly through non-sexual social contacts, are proportional to rates of conversational contact which can be estimated from a contact survey. In general, however, contacts reported in social contact surveys are proxies of those events by which transmission may occur and there may exist age-specific characteristics related to susceptibility and infectiousness which are not captured by the contact rates. Therefore, in this paper, transmission is modeled as the product of two age-specific variables: the age-specific contact rate and an age-specific proportionality factor, which entails an improvement of fit for the seroprevalence of the varicella-zoster virus (VZV) in Belgium. Furthermore, we address the impact on the estimation of the basic reproduction number, using non-parametric bootstrap** to account for different sources of variability and using multi-model inference to deal with model selection uncertainty. The proposed method makes it possible to obtain important information on transmission dynamics that cannot be inferred from approaches traditionally applied hitherto.
△ Less
Submitted 5 April, 2011; v1 submitted 23 July, 2009;
originally announced July 2009.