-
SBFT Tool Competition 2024 -- Python Test Case Generation Track
Authors:
Nicolas Erni,
Al-Ameen Mohammed Ali Mohammed,
Christian Birchler,
Pouria Derakhshanfar,
Stephan Lukasczyk,
Sebastiano Panichella
Abstract:
Test case generation (TCG) for Python poses distinctive challenges due to the language's dynamic nature and the absence of strict type information. Previous research has successfully explored automated unit TCG for Python, with solutions outperforming random test generation methods. Nevertheless, fundamental issues persist, hindering the practical adoption of existing test case generators. To addr…
▽ More
Test case generation (TCG) for Python poses distinctive challenges due to the language's dynamic nature and the absence of strict type information. Previous research has successfully explored automated unit TCG for Python, with solutions outperforming random test generation methods. Nevertheless, fundamental issues persist, hindering the practical adoption of existing test case generators. To address these challenges, we report on the organization, challenges, and results of the first edition of the Python Testing Competition. Four tools, namely UTBotPython, Klara, Hypothesis Ghostwriter, and Pynguin were executed on a benchmark set consisting of 35 Python source files sampled from 7 open-source Python projects for a time budget of 400 seconds. We considered one configuration of each tool for each test subject and evaluated the tools' effectiveness in terms of code and mutation coverage. This paper describes our methodology, the analysis of the results together with the competing tools, and the challenges faced while running the competition experiments.
△ Less
Submitted 26 January, 2024;
originally announced January 2024.
-
Enhancement of database access performance by improving data consistency in a non-relational database system (NoSQL)
Authors:
Adam A. E. Alflahi,
Mohammed A. Y. Mohammed,
Abdallah Alsammani
Abstract:
This study aims to enhance data consistency in NoSQL databases, traditionally designed with BASE properties, as opposed to the strong consistency guaranteed by ACID principles in RDBMS. We introduce a comprehensive four-stage server-side model engineered explicitly for MongoDB. This model covers transaction management, bifurcation of read and write transactions, assessment of transaction readiness…
▽ More
This study aims to enhance data consistency in NoSQL databases, traditionally designed with BASE properties, as opposed to the strong consistency guaranteed by ACID principles in RDBMS. We introduce a comprehensive four-stage server-side model engineered explicitly for MongoDB. This model covers transaction management, bifurcation of read and write transactions, assessment of transaction readiness, and transaction execution via a specialized locking algorithm. Utilizing the Yahoo Cloud Services Benchmark (YCSB), particularly for update-heavy workloads (A, B, and F), our model exhibited significant improvements. Specifically, the average throughput, read, and update latencies improved to 2864.726 ms, 32806.275 ms, and 51845.629 ms, respectively, from the baseline metrics of 2914.110 ms, 26510.930 ms, and 32457.662 ms. These results demonstrate the efficacy of our proposed model in enhancing consistency not only in document-based NoSQL databases like MongoDB but also in other NoSQL database variants, including key-value, graph, and wide-column stores.
△ Less
Submitted 26 August, 2023;
originally announced August 2023.
-
Applications and Techniques for Fast Machine Learning in Science
Authors:
Allison McCarn Deiana,
Nhan Tran,
Joshua Agar,
Michaela Blott,
Giuseppe Di Guglielmo,
Javier Duarte,
Philip Harris,
Scott Hauck,
Mia Liu,
Mark S. Neubauer,
Jennifer Ngadiuba,
Seda Ogrenci-Memik,
Maurizio Pierini,
Thea Aarrestad,
Steffen Bahr,
Jurgen Becker,
Anne-Sophie Berthold,
Richard J. Bonventre,
Tomas E. Muller Bravo,
Markus Diefenthaler,
Zhen Dong,
Nick Fritzsche,
Amir Gholami,
Ekaterina Govorkova,
Kyle J Hazelwood
, et al. (62 additional authors not shown)
Abstract:
In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time experimental data processing loop to accelerate scientific discovery. The material for the report builds on two workshops held by the Fast ML for Science community and covers three main areas: applications for fast ML ac…
▽ More
In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time experimental data processing loop to accelerate scientific discovery. The material for the report builds on two workshops held by the Fast ML for Science community and covers three main areas: applications for fast ML across a number of scientific domains; techniques for training and implementing performant and resource-efficient ML algorithms; and computing architectures, platforms, and technologies for deploying these algorithms. We also present overlap** challenges across the multiple scientific domains where common solutions can be found. This community report is intended to give plenty of examples and inspiration for scientific discovery through integrated and accelerated ML solutions. This is followed by a high-level overview and organization of technical advances, including an abundance of pointers to source material, which can enable these breakthroughs.
△ Less
Submitted 25 October, 2021;
originally announced October 2021.
-
A Performance Study of a Fast-Rate WLAN Fingerprint Measurement Collection Method
Authors:
Erick Schmidt,
Misbahuddin A. Mohammed,
David Akopian
Abstract:
Indoor positioning systems exploiting WLAN signal measurements such as Received Signal Strength (RSS) are gaining popularity due to high accuracy of the results. Sets of RSS and other measurements at designated locations from available WLAN access points (APs) are conventionally called fingerprints and retrieved from network cards at typically one Hz rate. Such measurement collection is needed for…
▽ More
Indoor positioning systems exploiting WLAN signal measurements such as Received Signal Strength (RSS) are gaining popularity due to high accuracy of the results. Sets of RSS and other measurements at designated locations from available WLAN access points (APs) are conventionally called fingerprints and retrieved from network cards at typically one Hz rate. Such measurement collection is needed for offline radio-map surveying stage which assigns fingerprints to locations, and for online navigation stage, when collected measurements are associated with the radio-map for positioning. As WLAN network is not originally designed for localization, the network cards occasionally miss the fingerprints, measurement fluctuations necessitate statistical signal processing, and surveying process is very time consuming. This paper describes a fast measurement collection approach that addresses the mentioned problems: higher probability of measurement acquisition, more data for statistical processing and faster surveying. The approach is further analyzed for practical setting applications.
△ Less
Submitted 14 February, 2019;
originally announced February 2019.