-
In-Database Data Imputation
Authors:
Massimo Perini,
Milos Nikolic
Abstract:
Missing data is a widespread problem in many domains, creating challenges in data analysis and decision making. Traditional techniques for dealing with missing data, such as excluding incomplete records or imputing simple estimates (e.g., mean), are computationally efficient but may introduce bias and disrupt variable relationships, leading to inaccurate analyses. Model-based imputation techniques…
▽ More
Missing data is a widespread problem in many domains, creating challenges in data analysis and decision making. Traditional techniques for dealing with missing data, such as excluding incomplete records or imputing simple estimates (e.g., mean), are computationally efficient but may introduce bias and disrupt variable relationships, leading to inaccurate analyses. Model-based imputation techniques offer a more robust solution that preserves the variability and relationships in the data, but they demand significantly more computation time, limiting their applicability to small datasets.
This work enables efficient, high-quality, and scalable data imputation within a database system using the widely used MICE method. We adapt this method to exploit computation sharing and a ring abstraction for faster model training. To impute both continuous and categorical values, we develop techniques for in-database learning of stochastic linear regression and Gaussian discriminant analysis models. Our MICE implementations in PostgreSQL and DuckDB outperform alternative MICE implementations and model-based imputation techniques by up to two orders of magnitude in terms of computation time, while maintaining high imputation quality.
△ Less
Submitted 6 January, 2024;
originally announced January 2024.
-
HL-LHC Computing Review: Common Tools and Community Software
Authors:
HEP Software Foundation,
:,
Thea Aarrestad,
Simone Amoroso,
Markus Julian Atkinson,
Joshua Bendavid,
Tommaso Boccali,
Andrea Bocci,
Andy Buckley,
Matteo Cacciari,
Paolo Calafiura,
Philippe Canal,
Federico Carminati,
Taylor Childers,
Vitaliano Ciulli,
Gloria Corti,
Davide Costanzo,
Justin Gage Dezoort,
Caterina Doglioni,
Javier Mauricio Duarte,
Agnieszka Dziurda,
Peter Elmer,
Markus Elsing,
V. Daniel Elvira,
Giulio Eulisse
, et al. (85 additional authors not shown)
Abstract:
Common and community software packages, such as ROOT, Geant4 and event generators have been a key part of the LHC's success so far and continued development and optimisation will be critical in the future. The challenges are driven by an ambitious physics programme, notably the LHC accelerator upgrade to high-luminosity, HL-LHC, and the corresponding detector upgrades of ATLAS and CMS. In this doc…
▽ More
Common and community software packages, such as ROOT, Geant4 and event generators have been a key part of the LHC's success so far and continued development and optimisation will be critical in the future. The challenges are driven by an ambitious physics programme, notably the LHC accelerator upgrade to high-luminosity, HL-LHC, and the corresponding detector upgrades of ATLAS and CMS. In this document we address the issues for software that is used in multiple experiments (usually even more widely than ATLAS and CMS) and maintained by teams of developers who are either not linked to a particular experiment or who contribute to common software within the context of their experiment activity. We also give space to general considerations for future software and projects that tackle upcoming challenges, no matter who writes it, which is an area where community convergence on best practice is extremely useful.
△ Less
Submitted 31 August, 2020;
originally announced August 2020.
-
Isolated zero field sub-10 nm skyrmions in ultrathin Co films
Authors:
Sebastian Meyer,
Marco Perini,
Stephan von Malottki,
André Kubetzka,
Roland Wiesendanger,
Kirsten von Bergmann,
Stefan Heinze
Abstract:
Due to their exceptional topological and dynamical properties magnetic skyrmions - localized stable spin structures on the nanometre scale - show great promise for future spintronic applications. To become technologically competitive, isolated skyrmions with diameters below 10 nm that are stable at zero magnetic field and room temperature are desired. Despite finding skyrmions in a wide spectrum o…
▽ More
Due to their exceptional topological and dynamical properties magnetic skyrmions - localized stable spin structures on the nanometre scale - show great promise for future spintronic applications. To become technologically competitive, isolated skyrmions with diameters below 10 nm that are stable at zero magnetic field and room temperature are desired. Despite finding skyrmions in a wide spectrum of materials, the quest for a material with these envisioned properties is still ongoing. Here we report zero field isolated skyrmions with diameters smaller than 5 nm coexisting with 1 nm thin domain walls in Rh/Co atomic bilayers on the Ir(111) surface. These spin structures are characterized by spin-polarized scanning tunnelling microscopy and can also be detected using non-spin-polarized tips due to a large non-collinear magnetoresistance. We demonstrate that sub-10 nm skyrmions are stabilised in these ferromagnetic Co films at zero field due to strong frustration of exchange interaction, together with Dzyaloshinskii-Moriya interaction and a large magnetocrystalline anisotropy.
△ Less
Submitted 6 March, 2019;
originally announced March 2019.
-
Magnetic domain walls in strain-patterned ultrathin films
Authors:
Aurore Finco,
Marco Perini,
André Kubetzka,
Kirsten von Bergmann,
Roland Wiesendanger
Abstract:
We present a comparison of the characteristics of the magnetic domain walls in an atomic monolayer of Co on Pt(111) and a Ni/Fe atomic bilayer on Ir(111), based on spin-polarized scanning tunneling microscopy measurements. In both cases, the films exhibit a roughly triangular dislocation line pattern created by epitaxial strain relief, as well as out-of-plane ferromagnetic order. Domains with oppo…
▽ More
We present a comparison of the characteristics of the magnetic domain walls in an atomic monolayer of Co on Pt(111) and a Ni/Fe atomic bilayer on Ir(111), based on spin-polarized scanning tunneling microscopy measurements. In both cases, the films exhibit a roughly triangular dislocation line pattern created by epitaxial strain relief, as well as out-of-plane ferromagnetic order. Domains with opposite magnetization are separated by domain walls with a unique rotational sense, demonstrating the important role of the Dzyaloshinskii-Moriya interaction induced by the Co/Pt and the Fe/Ir interfaces. The domain walls in Co/Pt(111) are straight and usually found in geometrical constrictions of the film, where they can minimize their length. In contrast, the domain walls in Ni/Fe/Ir(111) follow complicated paths, which can be correlated to the structural triangular pattern. The comparison between the two systems shows that the structural patterns, despite their similarity, have a different impact on the domain walls. In the Co/Pt(111) case, the magnetic state is not influenced by the dislocation line network, in contrast to the Ni/Fe/Ir(111) system in which the formation of the walls is favored at specific positions of the structural pattern.
△ Less
Submitted 24 August, 2018;
originally announced August 2018.
-
Domain walls and Dzyaloshinskii-Moriya interaction in epitaxial Co/Ir(111) and Pt/Co/Ir(111)
Authors:
Marco Perini,
Sebastian Meyer,
Bertrand Dupé,
Stephan von Malottki,
André Kubetzka,
Kirsten von Bergmann,
Roland Wiesendanger,
Stefan Heinze
Abstract:
We use spin-polarized scanning tunneling microscopy and density functional theory (DFT) to study domain walls (DWs) and the Dzyaloshinskii-Moriya interaction (DMI) in epitaxial films of Co/Ir(111) and Pt/Co/Ir(111). Our measurements reveal DWs with fixed rotational sense on one monolayer of Co on Ir, with a wall width around 2.7 nm. With Pt islands on top, we observe that the DWs occur mostly in t…
▽ More
We use spin-polarized scanning tunneling microscopy and density functional theory (DFT) to study domain walls (DWs) and the Dzyaloshinskii-Moriya interaction (DMI) in epitaxial films of Co/Ir(111) and Pt/Co/Ir(111). Our measurements reveal DWs with fixed rotational sense on one monolayer of Co on Ir, with a wall width around 2.7 nm. With Pt islands on top, we observe that the DWs occur mostly in the uncovered Co/Ir areas, suggesting that the wall energy density is higher in the Pt/Co/Ir(111). From DFT we find an interfacial DMI that stabilizes Néel-type DWs with clockwise rotational sense. The calculated DW widths are in good agreement with the experimental observations. The total DMI nearly doubles from Co/Ir(111) to Pt/Co/Ir(111), however, in the latter case the DMI is almost entirely due to the Pt with only a minor Ir contribution. Therefore a simple additive effect, where both interfaces contribute significantly to the total DMI, is not observed for one atomic Co layer.
△ Less
Submitted 6 February, 2018;
originally announced February 2018.
