Skip to main content

Showing 1–17 of 17 results for author: Bekas, C

.
  1. arXiv:1910.08036  [pdf, other

    cs.LG stat.ML

    Predicting retrosynthetic pathways using a combined linguistic model and hyper-graph exploration strategy

    Authors: Philippe Schwaller, Riccardo Petraglia, Valerio Zullo, Vishnu H Nair, Rico Andreas Haeuselmann, Riccardo Pisoni, Costas Bekas, Anna Iuliano, Teodoro Laino

    Abstract: We present an extension of our Molecular Transformer architecture combined with a hyper-graph exploration strategy for automatic retrosynthesis route planning without human intervention. The single-step retrosynthetic model sets a new state of the art for predicting reactants as well as reagents, solvents and catalysts for each retrosynthetic step. We introduce new metrics (coverage, class diversi… ▽ More

    Submitted 17 October, 2019; originally announced October 2019.

  2. arXiv:1909.10818  [pdf, other

    cs.LG cs.DC

    Constrained deep neural network architecture search for IoT devices accounting hardware calibration

    Authors: Florian Scheidegger, Luca Benini, Costas Bekas, Cristiano Malossi

    Abstract: Deep neural networks achieve outstanding results in challenging image classification tasks. However, the design of network topologies is a complex task and the research community makes a constant effort in discovering top-accuracy topologies, either manually or employing expensive architecture searches. In this work, we propose a unique narrow-space architecture search that focuses on delivering l… ▽ More

    Submitted 24 September, 2019; originally announced September 2019.

  3. arXiv:1909.10578  [pdf, other

    q-fin.CP q-fin.ST

    PAGAN: Portfolio Analysis with Generative Adversarial Networks

    Authors: Giovanni Mariani, Yada Zhu, Jianbo Li, Florian Scheidegger, Roxana Istrate, Costas Bekas, A. Cristiano I. Malossi

    Abstract: Since decades, the data science community tries to propose prediction models of financial time series. Yet, driven by the rapid development of information technology and machine intelligence, the velocity of today's information leads to high market efficiency. Sound financial theories demonstrate that in an efficient marketplace all information available today, including expectations on future eve… ▽ More

    Submitted 19 September, 2019; originally announced September 2019.

  4. arXiv:1907.08400  [pdf, other

    cs.IR cs.LG

    An Information Extraction and Knowledge Graph Platform for Accelerating Biochemical Discoveries

    Authors: Matteo Manica, Christoph Auer, Valery Weber, Federico Zipoli, Michele Dolfi, Peter Staar, Teodoro Laino, Costas Bekas, Akihiro Fujita, Hiroki Toda, Shuichi Hirose, Yasumitsu Orii

    Abstract: Information extraction and data mining in biochemical literature is a daunting task that demands resource-intensive computation and appropriate means to scale knowledge ingestion. Being able to leverage this immense source of technical information helps to drastically reduce costs and time to solution in multiple application fields from food safety to pharmaceutics. We present a scalable document… ▽ More

    Submitted 19 July, 2019; originally announced July 2019.

    Comments: 4 pages, 1 figure, Workshop on Applied Data Science for Healthcare at KDD, Anchorage, AK, 2019

  5. arXiv:1901.06261  [pdf, other

    cs.LG cs.SE stat.ML

    NeuNetS: An Automated Synthesis Engine for Neural Network Design

    Authors: Atin Sood, Benjamin Elder, Benjamin Herta, Chao Xue, Costas Bekas, A. Cristiano I. Malossi, Debashish Saha, Florian Scheidegger, Ganesh Venkataraman, Gegi Thomas, Giovanni Mariani, Hendrik Strobelt, Horst Samulowitz, Martin Wistuba, Matteo Manica, Mihir Choudhury, Rong Yan, Roxana Istrate, Ruchir Puri, Tejaswini Pedapati

    Abstract: Application of neural networks to a vast variety of practical applications is transforming the way AI is applied in practice. Pre-trained neural network models available through APIs or capability to custom train pre-built neural network architectures with customer data has made the consumption of AI by developers much simpler and resulted in broad adoption of these complex AI models. While prebui… ▽ More

    Submitted 16 January, 2019; originally announced January 2019.

    Comments: 14 pages, 12 figures. arXiv admin note: text overlap with arXiv:1806.00250

  6. arXiv:1811.02633  [pdf, other

    physics.chem-ph cs.LG

    Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Prediction

    Authors: Philippe Schwaller, Teodoro Laino, Théophile Gaudin, Peter Bolgar, Costas Bekas, Alpha A Lee

    Abstract: Organic synthesis is one of the key stumbling blocks in medicinal chemistry. A necessary yet unsolved step in planning synthesis is solving the forward problem: given reactants and reagents, predict the products. Similar to other work, we treat reaction prediction as a machine translation problem between SMILES strings of reactants-reagents and the products. We show that a multi-head attention Mol… ▽ More

    Submitted 30 May, 2019; v1 submitted 6 November, 2018; originally announced November 2018.

    Comments: Machine Learning for Molecules and Materials workshop, NeurIPS 2018 / Platform: https://rxn.res.ibm.com

    Journal ref: ACS Central Science, 2019

  7. arXiv:1806.02284  [pdf, other

    cs.DL cs.CV cs.DC

    Corpus Conversion Service: A Machine Learning Platform to Ingest Documents at Scale

    Authors: Peter W J Staar, Michele Dolfi, Christoph Auer, Costas Bekas

    Abstract: Over the past few decades, the amount of scientific articles and technical literature has increased exponentially in size. Consequently, there is a great need for systems that can ingest these documents at scale and make the contained knowledge discoverable. Unfortunately, both the format of these documents (e.g. the PDF format or bitmap images) as well as the presentation of the data (e.g. comple… ▽ More

    Submitted 24 May, 2018; originally announced June 2018.

    Comments: Accepted paper at KDD 2018 conference

  8. arXiv:1806.00250  [pdf, other

    cs.LG stat.ML

    TAPAS: Train-less Accuracy Predictor for Architecture Search

    Authors: R. Istrate, F. Scheidegger, G. Mariani, D. Nikolopoulos, C. Bekas, A. C. I. Malossi

    Abstract: In recent years an increasing number of researchers and practitioners have been suggesting algorithms for large-scale neural network architecture search: genetic algorithms, reinforcement learning, learning curve extrapolation, and accuracy predictors. None of them, however, demonstrated high-performance without training new experiments in the presence of unseen datasets. We propose a new deep neu… ▽ More

    Submitted 1 June, 2018; originally announced June 2018.

  9. arXiv:1805.09687  [pdf, other

    cs.DL cs.CL cs.CV cs.DC cs.IR

    Corpus Conversion Service: A machine learning platform to ingest documents at scale [Poster abstract]

    Authors: Peter W J Staar, Michele Dolfi, Christoph Auer, Costas Bekas

    Abstract: Over the past few decades, the amount of scientific articles and technical literature has increased exponentially in size. Consequently, there is a great need for systems that can ingest these documents at scale and make their content discoverable. Unfortunately, both the format of these documents (e.g. the PDF format or bitmap images) as well as the presentation of the data (e.g. complex tables)… ▽ More

    Submitted 15 May, 2018; originally announced May 2018.

    Comments: Accepted in SysML 2018 (www.sysml.cc)

  10. arXiv:1803.10232  [pdf, other

    cs.LG stat.ML

    Incremental Training of Deep Convolutional Neural Networks

    Authors: Roxana Istrate, Adelmo Cristiano Innocenza Malossi, Costas Bekas, Dimitrios Nikolopoulos

    Abstract: We propose an incremental training method that partitions the original network into sub-networks, which are then gradually incorporated in the running network during the training process. To allow for a smooth dynamic growth of the network, we introduce a look-ahead initialization that outperforms the random initialization. We demonstrate that our incremental approach reaches the reference network… ▽ More

    Submitted 27 March, 2018; originally announced March 2018.

    Journal ref: http://ceur-ws.org/Vol-1998

  11. arXiv:1803.09655  [pdf, other

    cs.CV cs.LG stat.ML

    BAGAN: Data Augmentation with Balancing GAN

    Authors: Giovanni Mariani, Florian Scheidegger, Roxana Istrate, Costas Bekas, Cristiano Malossi

    Abstract: Image classification datasets are often imbalanced, characteristic that negatively affects the accuracy of deep-learning classifiers. In this work we propose balancing GAN (BAGAN) as an augmentation tool to restore balance in imbalanced datasets. This is challenging because the few minority-class images may not be enough to train a GAN. We overcome this issue by including during the adversarial tr… ▽ More

    Submitted 5 June, 2018; v1 submitted 26 March, 2018; originally announced March 2018.

  12. arXiv:1803.09588  [pdf, other

    cs.CV

    Efficient Image Dataset Classification Difficulty Estimation for Predicting Deep-Learning Accuracy

    Authors: Florian Scheidegger, Roxana Istrate, Giovanni Mariani, Luca Benini, Costas Bekas, Cristiano Malossi

    Abstract: In the deep-learning community new algorithms are published at an incredible pace. Therefore, solving an image classification problem for new datasets becomes a challenging task, as it requires to re-evaluate published algorithms and their different configurations in order to find a close to optimal classifier. To facilitate this process, before biasing our decision towards a class of neural netwo… ▽ More

    Submitted 26 March, 2018; originally announced March 2018.

  13. arXiv:1711.04810  [pdf, other

    cs.LG stat.ML

    "Found in Translation": Predicting Outcomes of Complex Organic Chemistry Reactions using Neural Sequence-to-Sequence Models

    Authors: Philippe Schwaller, Theophile Gaudin, David Lanyi, Costas Bekas, Teodoro Laino

    Abstract: There is an intuitive analogy of an organic chemist's understanding of a compound and a language speaker's understanding of a word. Consequently, it is possible to introduce the basic concepts and analyze potential impacts of linguistic analysis to the world of organic chemistry. In this work, we cast the reaction prediction task as a translation problem by introducing a template-free sequence-to-… ▽ More

    Submitted 15 November, 2017; v1 submitted 13 November, 2017; originally announced November 2017.

  14. Mixed-Precision In-Memory Computing

    Authors: Manuel Le Gallo, Abu Sebastian, Roland Mathis, Matteo Manica, Heiner Giefers, Tomas Tuma, Costas Bekas, Alessandro Curioni, Evangelos Eleftheriou

    Abstract: As CMOS scaling reaches its technological limits, a radical departure from traditional von Neumann systems, which involve separate processing and memory units, is needed in order to significantly extend the performance of today's computers. In-memory computing is a promising approach in which nanoscale resistive memory devices, organized in a computational memory unit, are used for both processing… ▽ More

    Submitted 4 October, 2018; v1 submitted 16 January, 2017; originally announced January 2017.

    Journal ref: Nature Electronics volume 1, pages 246-253 (2018)

  15. arXiv:1503.06974  [pdf, other

    cs.DC

    Challenges and Recommendations for Preparing HPC Applications for Exascale

    Authors: Erika Abraham, Costas Bekas, Ivona Brandic, Samir Genaim, Einar Broch Johnsen, Ivan Kondov, Sabri Pllana, Achim Streit

    Abstract: While the HPC community is working towards the development of the first Exaflop computer (expected around 2020), after reaching the Petaflop milestone in 2008 still only few HPC applications are able to fully exploit the capabilities of Petaflop systems. In this paper we argue that efforts for preparing HPC applications for Exascale should start before such systems become available. We identify ch… ▽ More

    Submitted 9 June, 2015; v1 submitted 24 March, 2015; originally announced March 2015.

    Comments: 18th International Conference on Network-Based Information Systems (NBiS 2015). 2-4 September 2015 in Tamkang, Taiwan

  16. Changing Computing Paradigms Towards Power Efficiency

    Authors: Pavel Klavík, A. Cristiano I. Malossi, Constantin Bekas, Alessandro Curioni

    Abstract: Power awareness is fast becoming immensely important in computing, ranging from the traditional High Performance Computing applications, to the new generation of data centric workloads. In this work we describe our efforts towards a power efficient computing paradigm that combines low precision and high precision arithmetic. We showcase our ideas for the widely used kernel of solving systems of… ▽ More

    Submitted 19 May, 2014; originally announced May 2014.

    Journal ref: Philosophical Transactions of the Royal Society A: Physical, Mathematical and Engineering Sciences. 372(2018)

  17. arXiv:1302.2889  [pdf, other

    physics.acc-ph

    A Parallel General Purpose Multi-Objective Optimization Framework, with Application to Beam Dynamics

    Authors: N. Neveu, L. Spentzouris, A. Adelmann, Y. Ineichen, A. Kolano, C. Metzger-Kraus, C. Bekas, A. Curioni, P. Arbenz

    Abstract: Particle accelerators are invaluable tools for research in the basic and applied sciences, in fields such as materials science, chemistry, the biosciences, particle physics, nuclear physics and medicine. The design, commissioning, and operation of accelerator facilities is a non-trivial task, due to the large number of control parameters and the complex interplay of several conflicting design goal… ▽ More

    Submitted 23 February, 2019; v1 submitted 12 February, 2013; originally announced February 2013.