-
Phase transition in the computational complexity of the shortest common superstring and genome assembly
Authors:
L. A. Fernandez,
V. Martin-Mayor,
D. Yllanes
Abstract:
Genome assembly, the process of reconstructing a long genetic sequence by aligning and merging short fragments, or reads, is known to be NP-hard, either as a version of the shortest common superstring problem or in a Hamiltonian-cycle formulation. That is, the computing time is believed to grow exponentially with the the problem size in the worst case. Despite this fact, high-throughput technologi…
▽ More
Genome assembly, the process of reconstructing a long genetic sequence by aligning and merging short fragments, or reads, is known to be NP-hard, either as a version of the shortest common superstring problem or in a Hamiltonian-cycle formulation. That is, the computing time is believed to grow exponentially with the the problem size in the worst case. Despite this fact, high-throughput technologies and modern algorithms currently allow bioinformaticians to handle datasets of billions of reads. Using methods from statistical mechanics, we address this conundrum by demonstrating the existence of a phase transition in the computational complexity of the problem and showing that practical instances always fall in the 'easy' phase (solvable by polynomial-time algorithms). In addition, we propose a Markov-chain Monte Carlo method that outperforms common deterministic algorithms in the hard regime.
△ Less
Submitted 11 March, 2024; v1 submitted 18 October, 2022;
originally announced October 2022.
-
How we are leading a 3-XORSAT challenge: from the energy landscape to the algorithm and its efficient implementation on GPUs
Authors:
M. Bernaschi,
M. Bisson,
M. Fatica,
E. Marinari,
V. Martin-Mayor,
G. Parisi,
F. Ricci-Tersenghi
Abstract:
A recent 3-XORSAT challenge required to minimize a very complex and rough energy function, typical of glassy models with a random first order transition and a golf course like energy landscape. We present the ideas beyond the quasi-greedy algorithm and its very efficient implementation on GPUs that are allowing us to rank first in such a competition. We suggest a better protocol to compare algorit…
▽ More
A recent 3-XORSAT challenge required to minimize a very complex and rough energy function, typical of glassy models with a random first order transition and a golf course like energy landscape. We present the ideas beyond the quasi-greedy algorithm and its very efficient implementation on GPUs that are allowing us to rank first in such a competition. We suggest a better protocol to compare algorithmic performances and we also provide analytical predictions about the exponential growth of the times to find the solution in terms of free-energy barriers.
△ Less
Submitted 24 February, 2021; v1 submitted 18 February, 2021;
originally announced February 2021.
-
Learning a Local Symmetry with Neural-Networks
Authors:
Aurélien Decelle,
Victor Martin-Mayor,
Beatriz Seoane
Abstract:
We explore the capacity of neural networks to detect a symmetry with complex local and non-local patterns : the gauge symmetry Z 2 . This symmetry is present in physical problems from topological transitions to QCD, and controls the computational hardness of instances of spin-glasses. Here, we show how to design a neural network, and a dataset, able to learn this symmetry and to find compressed la…
▽ More
We explore the capacity of neural networks to detect a symmetry with complex local and non-local patterns : the gauge symmetry Z 2 . This symmetry is present in physical problems from topological transitions to QCD, and controls the computational hardness of instances of spin-glasses. Here, we show how to design a neural network, and a dataset, able to learn this symmetry and to find compressed latent representations of the gauge orbits. Our method pays special attention to system-wrap** loops, the so-called Polyakov loops, known to be particularly relevant for computational complexity.
△ Less
Submitted 7 June, 2019; v1 submitted 16 April, 2019;
originally announced April 2019.
-
Janus II: a new generation application-driven computer for spin-system simulations
Authors:
Janus Collaboration,
M. Baity-Jesi,
R. A. Baños,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Muñoz Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
M. Pivanti,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
This paper describes the architecture, the development and the implementation of Janus II, a new generation application-driven number cruncher optimized for Monte Carlo simulations of spin systems (mainly spin glasses). This domain of computational physics is a recognized grand challenge of high-performance computing: the resources necessary to study in detail theoretical models that can make cont…
▽ More
This paper describes the architecture, the development and the implementation of Janus II, a new generation application-driven number cruncher optimized for Monte Carlo simulations of spin systems (mainly spin glasses). This domain of computational physics is a recognized grand challenge of high-performance computing: the resources necessary to study in detail theoretical models that can make contact with experimental data are by far beyond those available using commodity computer systems. On the other hand, several specific features of the associated algorithms suggest that unconventional computer architectures, which can be implemented with available electronics technologies, may lead to order of magnitude increases in performance, reducing to acceptable values on human scales the time needed to carry out simulation campaigns that would take centuries on commercially available machines. Janus II is one such machine, recently developed and commissioned, that builds upon and improves on the successful JANUS machine, which has been used for physics since 2008 and is still in operation today. This paper describes in detail the motivations behind the project, the computational requirements, the architecture and the implementation of this new machine and compares its expected performances with those of currently available commercial systems.
△ Less
Submitted 3 October, 2013;
originally announced October 2013.
-
Reconfigurable computing for Monte Carlo simulations: results and prospects of the Janus project
Authors:
Janus Collaboration,
M. Baity-Jesi,
R. A. Banos,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
M. Guidetti,
D. Iniguez,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Munoz Sudupe,
D. Navarro,
G. Parisi,
M. Pivanti,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
P. Tellez
, et al. (2 additional authors not shown)
Abstract:
We describe Janus, a massively parallel FPGA-based computer optimized for the simulation of spin glasses, theoretical models for the behavior of glassy materials. FPGAs (as compared to GPUs or many-core processors) provide a complementary approach to massively parallel computing. In particular, our model problem is formulated in terms of binary variables, and floating-point operations can be (almo…
▽ More
We describe Janus, a massively parallel FPGA-based computer optimized for the simulation of spin glasses, theoretical models for the behavior of glassy materials. FPGAs (as compared to GPUs or many-core processors) provide a complementary approach to massively parallel computing. In particular, our model problem is formulated in terms of binary variables, and floating-point operations can be (almost) completely avoided. The FPGA architecture allows us to run many independent threads with almost no latencies in memory access, thus updating up to 1024 spins per cycle. We describe Janus in detail and we summarize the physics results obtained in four years of operation of this machine; we discuss two types of physics applications: long simulations on very large systems (which try to mimic and provide understanding about the experimental non-equilibrium dynamics), and low-temperature equilibrium simulations using an artificial parallel tempering dynamics. The time scale of our non-equilibrium simulations spans eleven orders of magnitude (from picoseconds to a tenth of a second). On the other hand, our equilibrium simulations are unprecedented both because of the low temperatures reached and for the large systems that we have brought to equilibrium. A finite-time scaling ansatz emerges from the detailed comparison of the two sets of simulations. Janus has made it possible to perform spin-glass simulations that would take several decades on more conventional architectures. The paper ends with an assessment of the potential of possible future versions of the Janus architecture, based on state-of-the-art technology.
△ Less
Submitted 18 April, 2012;
originally announced April 2012.
-
JANUS: an FPGA-based System for High Performance Scientific Computing
Authors:
F. Belletti,
M. Cotallo,
A. Cruz,
L. A. Fernández,
A. Gordillo,
M. Guidetti,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martín-Mayor,
A. Muñoz-Sudupe,
D. Navarro,
G. Parisi,
S. Pérez-Gaviro,
M. Rossi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
D. Sciretti,
A. Tarancón,
R. Tripiccione,
J. L. Velasco
Abstract:
This paper describes JANUS, a modular massively parallel and reconfigurable FPGA-based computing system. Each JANUS module has a computational core and a host. The computational core is a 4x4 array of FPGA-based processing elements with nearest-neighbor data links. Processors are also directly connected to an I/O node attached to the JANUS host, a conventional PC. JANUS is tailored for, but not…
▽ More
This paper describes JANUS, a modular massively parallel and reconfigurable FPGA-based computing system. Each JANUS module has a computational core and a host. The computational core is a 4x4 array of FPGA-based processing elements with nearest-neighbor data links. Processors are also directly connected to an I/O node attached to the JANUS host, a conventional PC. JANUS is tailored for, but not limited to, the requirements of a class of hard scientific applications characterized by regular code structure, unconventional data manipulation instructions and not too large data-base size. We discuss the architecture of this configurable machine, and focus on its use on Monte Carlo simulations of statistical mechanics. On this class of application JANUS achieves impressive performances: in some cases one JANUS processing element outperfoms high-end PCs by a factor ~ 1000. We also discuss the role of JANUS on other classes of scientific applications.
△ Less
Submitted 8 April, 2008; v1 submitted 18 October, 2007;
originally announced October 2007.
-
Simulating spin systems on IANUS, an FPGA-based computer
Authors:
F. Belletti,
M. Cotallo,
A. Cruz,
L. A. Fernández,
A. Gordillo,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martín-Mayor,
A. Muñoz-Sudupe,
D. Navarro,
S. Pérez-Gaviro,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
D. Sciretti,
A. Tarancón,
R. Tripiccione,
J. L. Velasco
Abstract:
We describe the hardwired implementation of algorithms for Monte Carlo simulations of a large class of spin models. We have implemented these algorithms as VHDL codes and we have mapped them onto a dedicated processor based on a large FPGA device. The measured performance on one such processor is comparable to O(100) carefully programmed high-end PCs: it turns out to be even better for some sele…
▽ More
We describe the hardwired implementation of algorithms for Monte Carlo simulations of a large class of spin models. We have implemented these algorithms as VHDL codes and we have mapped them onto a dedicated processor based on a large FPGA device. The measured performance on one such processor is comparable to O(100) carefully programmed high-end PCs: it turns out to be even better for some selected spin models. We describe here codes that we are currently executing on the IANUS massively parallel FPGA-based system.
△ Less
Submitted 26 April, 2007;
originally announced April 2007.