Towards map** the contemporary art world with ArtLM: an art-specific NLP model
Authors:
Qinkai Chen,
Mohamed El-Mennaoui,
Antoine Fosset,
Amine Rebei,
Haoyang Cao,
Philine Bouscasse,
Christy Eóin O'Beirne,
Sasha Shevchenko,
Mathieu Rosenbaum
Abstract:
With an increasing amount of data in the art world, discovering artists and artworks suitable to collectors' tastes becomes a challenge. It is no longer enough to use visual information, as contextual information about the artist has become just as important in contemporary art. In this work, we present a generic Natural Language Processing framework (called ArtLM) to discover the connections amon…
▽ More
With an increasing amount of data in the art world, discovering artists and artworks suitable to collectors' tastes becomes a challenge. It is no longer enough to use visual information, as contextual information about the artist has become just as important in contemporary art. In this work, we present a generic Natural Language Processing framework (called ArtLM) to discover the connections among contemporary artists based on their biographies. In this approach, we first continue to pre-train the existing general English language models with a large amount of unlabelled art-related data. We then fine-tune this new pre-trained model with our biography pair dataset manually annotated by a team of professionals in the art industry. With extensive experiments, we demonstrate that our ArtLM achieves 85.6% accuracy and 84.0% F1 score and outperforms other baseline models. We also provide a visualisation and a qualitative analysis of the artist network built from ArtLM's outputs.
△ Less
Submitted 22 December, 2022; v1 submitted 14 December, 2022;
originally announced December 2022.
Docent: A content-based recommendation system to discover contemporary art
Authors:
Antoine Fosset,
Mohamed El-Mennaoui,
Amine Rebei,
Paul Calligaro,
Elise Farge Di Maria,
Hélène Nguyen-Ban,
Francesca Rea,
Marie-Charlotte Vallade,
Elisabetta Vitullo,
Christophe Zhang,
Guillaume Charpiat,
Mathieu Rosenbaum
Abstract:
Recommendation systems have been widely used in various domains such as music, films, e-shop** etc. After mostly avoiding digitization, the art world has recently reached a technological turning point due to the pandemic, making online sales grow significantly as well as providing quantitative online data about artists and artworks. In this work, we present a content-based recommendation system…
▽ More
Recommendation systems have been widely used in various domains such as music, films, e-shop** etc. After mostly avoiding digitization, the art world has recently reached a technological turning point due to the pandemic, making online sales grow significantly as well as providing quantitative online data about artists and artworks. In this work, we present a content-based recommendation system on contemporary art relying on images of artworks and contextual metadata of artists. We gathered and annotated artworks with advanced and art-specific information to create a completely unique database that was used to train our models. With this information, we built a proximity graph between artworks. Similarly, we used NLP techniques to characterize the practices of the artists and we extracted information from exhibitions and other event history to create a proximity graph between artists. The power of graph analysis enables us to provide an artwork recommendation system based on a combination of visual and contextual information from artworks and artists. After an assessment by a team of art specialists, we get an average final rating of 75% of meaningful artworks when compared to their professional evaluations.
△ Less
Submitted 12 July, 2022;
originally announced July 2022.
