Showing 1–1 of 1 results for author: Abercrombie, D
-
Dynamo -- Handling Scientific Data Across Sites and Storage Media
Authors:
Yutaro Iiyama,
Benedikt Maier,
Daniel Abercrombie,
Maxim Goncharov,
Christoph Paus
Abstract:
Dynamo is a full-stack software solution for scientific data management. Dynamo's architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few terabytes stored at a single location to hundreds of petabytes distributed across a worldwide computing grid. This article documents the core system design of Dynamo…
▽ More
Dynamo is a full-stack software solution for scientific data management. Dynamo's architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few terabytes stored at a single location to hundreds of petabytes distributed across a worldwide computing grid. This article documents the core system design of Dynamo and describes the applications that implement various data management tasks. A brief report is also given on the operational experiences of the system at the CMS experiment at the CERN Large Hadron Collider and at a small scale analysis facility.
△ Less
Submitted 16 May, 2021; v1 submitted 25 March, 2020;
originally announced March 2020.