Showing 1–15 of 15 results for author: Renoust, B

3D-Morphomics, Morphological Features on CT scans for lung nodule malignancy diagnosis

Authors: Elias Munoz, Pierre Baudot, Van-Khoa Le, Charles Voyton, Benjamin Renoust, Danny Francis, Vladimir Groza, Jean-Christophe Brisset, Ezequiel Geremia, Antoine Iannessi, Yan Liu, Benoit Huet

Abstract: Pathologies systematically induce morphological changes, thus providing a major but yet insufficiently quantified source of observables for diagnosis. The study develops a predictive model of the pathological states based on morphological features (3D-morphomics) on Computed Tomography (CT) volumes. A complete workflow for mesh extraction and simplification of an organ's surface is developed, and… ▽ More Pathologies systematically induce morphological changes, thus providing a major but yet insufficiently quantified source of observables for diagnosis. The study develops a predictive model of the pathological states based on morphological features (3D-morphomics) on Computed Tomography (CT) volumes. A complete workflow for mesh extraction and simplification of an organ's surface is developed, and coupled with an automatic extraction of morphological features given by the distribution of mean curvature and mesh energy. An XGBoost supervised classifier is then trained and tested on the 3D-morphomics to predict the pathological states. This framework is applied to the prediction of the malignancy of lung's nodules. On a subset of NLST database with malignancy confirmed biopsy, using 3D-morphomics only, the classification model of lung nodules into malignant vs. benign achieves 0.964 of AUC. Three other sets of classical features are trained and tested, (1) clinical relevant features gives an AUC of 0.58, (2) 111 radiomics gives an AUC of 0.976, (3) radiologist ground truth (GT) containing the nodule size, attenuation and spiculation qualitative annotations gives an AUC of 0.979. We also test the Brock model and obtain an AUC of 0.826. Combining 3D-morphomics and radiomics features achieves state-of-the-art results with an AUC of 0.978 where the 3D-morphomics have some of the highest predictive powers. As a validation on a public independent cohort, models are applied to the LIDC dataset, the 3D-morphomics achieves an AUC of 0.906 and the 3D-morphomics+radiomics achieves an AUC of 0.958, which ranks second in the challenge among deep models. It establishes the curvature distributions as efficient features for predicting lung nodule malignancy and a new method that can be applied directly to arbitrary computer aided diagnosis task. △ Less

Submitted 27 July, 2022; originally announced July 2022.

Comments: 10 pages, 7 figures

Built Year Prediction from Buddha Face with Heterogeneous Labels

Authors: Yiming Qian, Cheikh Brahim El Vaigh, Yuta Nakashima, Benjamin Renoust, Hajime Nagahara, Yutaka Fujioka

Abstract: Buddha statues are a part of human culture, especially of the Asia area, and they have been alongside human civilisation for more than 2,000 years. As history goes by, due to wars, natural disasters, and other reasons, the records that show the built years of Buddha statues went missing, which makes it an immense work for historians to estimate the built years. In this paper, we pursue the idea of… ▽ More Buddha statues are a part of human culture, especially of the Asia area, and they have been alongside human civilisation for more than 2,000 years. As history goes by, due to wars, natural disasters, and other reasons, the records that show the built years of Buddha statues went missing, which makes it an immense work for historians to estimate the built years. In this paper, we pursue the idea of building a neural network model that automatically estimates the built years of Buddha statues based only on their face images. Our model uses a loss function that consists of three terms: an MSE loss that provides the basis for built year estimation; a KL divergence-based loss that handles the samples with both an exact built year and a possible range of built years (e.g., dynasty or centuries) estimated by historians; finally a regularisation that utilises both labelled and unlabelled samples based on manifold assumption. By combining those three terms in the training process, we show that our method is able to estimate built years for given images with 37.5 years of a mean absolute error on the test set. △ Less

Submitted 2 September, 2021; originally announced September 2021.

GCNBoost: Artwork Classification by Label Propagation through a Knowledge Graph

Authors: Cheikh Brahim El Vaigh, Noa Garcia, Benjamin Renoust, Chenhui Chu, Yuta Nakashima, Hajime Nagahara

Abstract: The rise of digitization of cultural documents offers large-scale contents, opening the road for development of AI systems in order to preserve, search, and deliver cultural heritage. To organize such cultural content also means to classify them, a task that is very familiar to modern computer science. Contextual information is often the key to structure such real world data, and we propose to use… ▽ More The rise of digitization of cultural documents offers large-scale contents, opening the road for development of AI systems in order to preserve, search, and deliver cultural heritage. To organize such cultural content also means to classify them, a task that is very familiar to modern computer science. Contextual information is often the key to structure such real world data, and we propose to use it in form of a knowledge graph. Such a knowledge graph, combined with content analysis, enhances the notion of proximity between artworks so it improves the performances in classification tasks. In this paper, we propose a novel use of a knowledge graph, that is constructed on annotated data and pseudo-labeled data. With label propagation, we boost artwork classification by training a model using a graph convolutional network, relying on the relationships between entities of the knowledge graph. Following a transductive learning framework, our experiments show that relying on a knowledge graph modeling the relations between labeled data and unlabeled data allows to achieve state-of-the-art results on multiple classification tasks on a dataset of paintings, and on a dataset of Buddha statues. Additionally, we show state-of-the-art results for the difficult case of dealing with unbalanced data, with the limitation of disregarding classes with extremely low degrees in the knowledge graph. △ Less

Submitted 25 May, 2021; originally announced May 2021.

Layer entanglement in multiplex, temporal multiplex, and coupled multilayer networks

Authors: Blaž Škrlj, Benjamin Renoust

Abstract: Complex networks, such as transportation networks, social networks, or biological networks, capture the complex system they model often by representing only one type of interactions. In real world systems, there may be many different aspects that connect entities together. These can be captured using multilayer networks, which combine different modalities of interactions in a single model. Couplin… ▽ More Complex networks, such as transportation networks, social networks, or biological networks, capture the complex system they model often by representing only one type of interactions. In real world systems, there may be many different aspects that connect entities together. These can be captured using multilayer networks, which combine different modalities of interactions in a single model. Coupling in multilayer networks may exhibit different properties which can be related to the very nature of the data they model (or to events in time-dependant data). We hypothesise that such properties may be reflected in the way layers are intertwined. In this paper, we investigated these through the prism of layer entanglement in coupled multilayer networks. We test over 30 real-life networks in 6 different disciplines (social, genetic, transport, co-authorship, trade, and neuronal networks). We further propose a random generator, displaying comparable patterns of elementary layer entanglement and transition coupling entanglement across 1,329,696 synthetic coupled multilayer networks. Our experiments demonstrate difference of layer entanglement across disciplines, and even suggest a link between entanglement intensity and homophily. We additionally study entanglement in 3 real world temporal datasets displaying a potential rise in entanglement activity prior to other network activity. △ Less

Submitted 15 October, 2020; v1 submitted 2 April, 2020; originally announced April 2020.

Comments: Accepted to ANS. arXiv admin note: text overlap with arXiv:1910.05300

Movienet: A Movie Multilayer Network Model using Visual and Textual Semantic Cues

Authors: Youssef Mourchid, Benjamin Renoust, Olivier Roupin, Le Van, Hocine Cherifi, Mohammed El Hassouni

Abstract: Discovering content and stories in movies is one of the most important concepts in multimedia content research studies. Network models have proven to be an efficient choice for this purpose. When an audience watches a movie, they usually compare the characters and the relationships between them. For this reason, most of the models developed so far are based on social networks analysis. They focus… ▽ More Discovering content and stories in movies is one of the most important concepts in multimedia content research studies. Network models have proven to be an efficient choice for this purpose. When an audience watches a movie, they usually compare the characters and the relationships between them. For this reason, most of the models developed so far are based on social networks analysis. They focus essentially on the characters at play. By analyzing characters' interactions, we can obtain a broad picture of the narration's content. Other works have proposed to exploit semantic elements such as scenes, dialogues, etc. However, they are always captured from a single facet. Motivated by these limitations, we introduce in this work a multilayer network model to capture the narration of a movie based on its script, its subtitles, and the movie content. After introducing the model and the extraction process from the raw data, we perform a comparative analysis of the whole 6-movie cycle of the Star Wars saga. Results demonstrate the effectiveness of the proposed framework for video content representation and analysis. △ Less

Submitted 18 October, 2019; originally announced October 2019.

Patterns of Multiplex Layer Entanglement across Real and Synthetic Networks

Authors: Blaž Škrlj, Benjamin Renoust

Abstract: Real world complex networks often exhibit multiplex structure, connecting entities from different aspects of physical systems such as social, transportation and biological networks. Little is known about general properties of such networks across disciplines. In this work, we first investigate how consistent are connectivity patterns across 35 real world multiplex networks. We demonstrate that ent… ▽ More Real world complex networks often exhibit multiplex structure, connecting entities from different aspects of physical systems such as social, transportation and biological networks. Little is known about general properties of such networks across disciplines. In this work, we first investigate how consistent are connectivity patterns across 35 real world multiplex networks. We demonstrate that entanglement homogeneity and intensity, two measures of layer consistency, indicate apparent differences between social and biological networks. We also investigate trade, co-authorship and transport networks. We show that real networks can be separated in the joint space of homogeneity and intensity, demonstrating the usefulness of the two measures for categorization of real multiplex networks. Finally, we design a multiplex network generator, where similar patterns (as observed in real networks), are emerging over the analysis of 11{,}905 synthetic multiplex networks with various topological properties. △ Less

Submitted 11 October, 2019; originally announced October 2019.

Comments: Accepted at Complex Networks 2019

Journal ref: Complex Networks 2019

Introducing multilayer stream graphs and layer centralities

Authors: Pimprenelle Parmentier, Tiphaine Viard, Benjamin Renoust, Jean-François Baffier

Abstract: Graphs are commonly used in mathematics to represent some relationships between items. However, as simple objects, they sometimes fail to capture all relevant aspects of real-world data. To address this problem, we generalize them and model interactions over time with multilayer structure. We build and test several centralities to assess the importance of layers of such structures. In order to sho… ▽ More Graphs are commonly used in mathematics to represent some relationships between items. However, as simple objects, they sometimes fail to capture all relevant aspects of real-world data. To address this problem, we generalize them and model interactions over time with multilayer structure. We build and test several centralities to assess the importance of layers of such structures. In order to showcase the relevance of this new model with centralities, we give examples on two large-scale datasets of interactions, involving individuals and flights, and show that we are able to explain subtle behaviour patterns in both cases. △ Less

Submitted 3 October, 2019; originally announced October 2019.

Comments: 12 pages

BUDA.ART: A Multimodal Content-Based Analysis and Retrieval System for Buddha Statues

Authors: Benjamin Renoust, Matheus Oliveira Franca, Jacob Chan, Van Le, Ayaka Uesaka, Yuta Nakashima, Hajime Nagahara, Jueren Wang, Yutaka Fujioka

Abstract: We introduce BUDA.ART, a system designed to assist researchers in Art History, to explore and analyze an archive of pictures of Buddha statues. The system combines different CBIR and classical retrieval techniques to assemble 2D pictures, 3D statue scans and meta-data, that is focused on the Buddha facial characteristics. We build the system from an archive of 50,000 Buddhism pictures, identify un… ▽ More We introduce BUDA.ART, a system designed to assist researchers in Art History, to explore and analyze an archive of pictures of Buddha statues. The system combines different CBIR and classical retrieval techniques to assemble 2D pictures, 3D statue scans and meta-data, that is focused on the Buddha facial characteristics. We build the system from an archive of 50,000 Buddhism pictures, identify unique Buddha statues, extract contextual information, and provide specific facial embedding to first index the archive. The system allows for mobile, on-site search, and to explore similarities of statues in the archive. In addition, we provide search visualization and 3D analysis of the statues △ Less

Submitted 17 September, 2019; originally announced September 2019.

Comments: Demo video at: https://www.youtube.com/watch?v=3XJvLjSWieY

Historical and Modern Features for Buddha Statue Classification

Authors: Benjamin Renoust, Matheus Oliveira Franca, Jacob Chan, Noa Garcia, Van Le, Ayaka Uesaka, Yuta Nakashima, Hajime Nagahara, Jueren Wang, Yutaka Fujioka

Abstract: While Buddhism has spread along the Silk Roads, many pieces of art have been displaced. Only a few experts may identify these works, subjectively to their experience. The construction of Buddha statues was taught through the definition of canon rules, but the applications of those rules greatly varies across time and space. Automatic art analysis aims at supporting these challenges. We propose to… ▽ More While Buddhism has spread along the Silk Roads, many pieces of art have been displaced. Only a few experts may identify these works, subjectively to their experience. The construction of Buddha statues was taught through the definition of canon rules, but the applications of those rules greatly varies across time and space. Automatic art analysis aims at supporting these challenges. We propose to automatically recover the proportions induced by the construction guidelines, in order to use them and compare between different deep learning features for several classification tasks, in a medium size but rich dataset of Buddha statues, collected with experts of Buddhism art history. △ Less

Submitted 6 October, 2019; v1 submitted 17 September, 2019; originally announced September 2019.

Simulating complex quantum networks with time crystals

Authors: M. P. Estarellas, T. Osada, V. M. Bastidas, B. Renoust, K. Sanaka, W. J. Munro, K. Nemoto

Abstract: Crystals arise as the result of the breaking of a spatial translation symmetry. Similarly, translation symmetries can also be broken in time so that discrete time crystals appear. Here, we introduce a method to describe, characterize, and explore the physical phenomena related to this phase of matter using tools from graph theory. The analysis of the graphs allows to visualizing time-crystalline o… ▽ More Crystals arise as the result of the breaking of a spatial translation symmetry. Similarly, translation symmetries can also be broken in time so that discrete time crystals appear. Here, we introduce a method to describe, characterize, and explore the physical phenomena related to this phase of matter using tools from graph theory. The analysis of the graphs allows to visualizing time-crystalline order and to analyze features of the quantum system. For example, we explore in detail the melting process of a minimal model of a period-2 discrete time crystal and describe it in terms of the evolution of the associated graph structure. We show that during the melting process, the network evolution exhibits an emergent preferential attachment mechanism, directly associated with the existence of scale-free networks. Thus, our strategy allows us to propose a previously unexplored far-reaching application of time crystals as a quantum simulator of complex quantum networks. △ Less

Submitted 12 November, 2020; v1 submitted 30 July, 2019; originally announced July 2019.

Comments: 17 pages, 8 figures

Journal ref: Science Advances, Vol. 6, no. 42, eaay8892 (2020)

Understanding Art through Multi-Modal Retrieval in Paintings

Authors: Noa Garcia, Benjamin Renoust, Yuta Nakashima

Abstract: In computer vision, visual arts are often studied from a purely aesthetics perspective, mostly by analysing the visual appearance of an artistic reproduction to infer its style, its author, or its representative features. In this work, however, we explore art from both a visual and a language perspective. Our aim is to bridge the gap between the visual appearance of an artwork and its underlying m… ▽ More In computer vision, visual arts are often studied from a purely aesthetics perspective, mostly by analysing the visual appearance of an artistic reproduction to infer its style, its author, or its representative features. In this work, however, we explore art from both a visual and a language perspective. Our aim is to bridge the gap between the visual appearance of an artwork and its underlying meaning, by jointly analysing its aesthetics and its semantics. We introduce the use of multi-modal techniques in the field of automatic art analysis by 1) collecting a multi-modal dataset with fine-art paintings and comments, and 2) exploring robust visual and textual representations in artistic images. △ Less

Submitted 23 April, 2019; originally announced April 2019.

Context-Aware Embeddings for Automatic Art Analysis

Authors: Noa Garcia, Benjamin Renoust, Yuta Nakashima

Abstract: Automatic art analysis aims to classify and retrieve artistic representations from a collection of images by using computer vision and machine learning techniques. In this work, we propose to enhance visual representations from neural networks with contextual artistic information. Whereas visual representations are able to capture information about the content and the style of an artwork, our prop… ▽ More Automatic art analysis aims to classify and retrieve artistic representations from a collection of images by using computer vision and machine learning techniques. In this work, we propose to enhance visual representations from neural networks with contextual artistic information. Whereas visual representations are able to capture information about the content and the style of an artwork, our proposed context-aware embeddings additionally encode relationships between different artistic attributes, such as author, school, or historical period. We design two different approaches for using context in automatic art analysis. In the first one, contextual data is obtained through a multi-task learning model, in which several attributes are trained together to find visual relationships between elements. In the second approach, context is obtained through an art-specific knowledge graph, which encodes relationships between artistic attributes. An exhaustive evaluation of both of our models in several art analysis problems, such as author identification, type classification, or cross-modal retrieval, show that performance is improved by up to 7.3% in art classification and 37.24% in retrieval when context-aware embeddings are used. △ Less

Submitted 9 April, 2019; originally announced April 2019.

Animated Drag and Drop Interaction for Dynamic Multidimensional Graphs

Authors: Benjamin Renoust, Haolin Ren, Guy Melançon

Abstract: In this paper, we propose a new drag and drop interaction technique for graphs. We designed this interaction to support analysis in complex multidimensional and temporal graphs. The drag and drop interaction is enhanced with an intuitive and controllable animation, in support of comparison tasks. In this paper, we propose a new drag and drop interaction technique for graphs. We designed this interaction to support analysis in complex multidimensional and temporal graphs. The drag and drop interaction is enhanced with an intuitive and controllable animation, in support of comparison tasks. △ Less

Submitted 5 February, 2019; originally announced February 2019.

Comments: 2 pages, 1 figure

Multilayer Network Model of Movie Script

Authors: Youssef Mourchid, Benjamin Renoust, Hocine Cherifi, Mohammed El Hassouni

Abstract: Network models have been increasingly used in the past years to support summarization and analysis of narratives, such as famous TV series, books and news. Inspired by social network analysis, most of these models focus on the characters at play. The network model well captures all characters interactions, giving a broad picture of the narration's content. A few works went beyond by introducing ad… ▽ More Network models have been increasingly used in the past years to support summarization and analysis of narratives, such as famous TV series, books and news. Inspired by social network analysis, most of these models focus on the characters at play. The network model well captures all characters interactions, giving a broad picture of the narration's content. A few works went beyond by introducing additional semantic elements, always captured in a single layer network. In contrast, we introduce in this work a multilayer network model to capture more elements of the narration of a movie from its script: people, locations, and other semantic elements. This model enables new measures and insights on movies. We demonstrate this model on two very popular movies. △ Less

Submitted 13 December, 2018; originally announced December 2018.

Ergodic-localized junctions in periodically-driven systems

Authors: V. M. Bastidas, B. Renoust, Kae Nemoto, W. J. Munro

Abstract: Quantum phases of matter have many relevant applications in quantum computation and quantum information processing. Current experimental feasibilities in diverse platforms allow us to couple two or more subsystems in different phases. In this letter, we investigate the situation where one couples two domains of a periodically-driven spin chain where one of them is ergodic while the other is fully… ▽ More Quantum phases of matter have many relevant applications in quantum computation and quantum information processing. Current experimental feasibilities in diverse platforms allow us to couple two or more subsystems in different phases. In this letter, we investigate the situation where one couples two domains of a periodically-driven spin chain where one of them is ergodic while the other is fully localized. By combining tools of both graph and Floquet theory, we show that the localized domain remains stable for strong disorder, but as this disorder decreases the localized domain becomes ergodic. △ Less

Submitted 22 December, 2018; v1 submitted 29 June, 2018; originally announced July 2018.

Comments: 10 pages, 5 figures. Published in Physical Review B on December 20 2018

Journal ref: Phys. Rev. B 98, 224307 (2018)