-
Caring Trouble and Musical AI: Considerations towards a Feminist Musical AI
Authors:
Kelsey Cotton,
Kıvanç Tatar
Abstract:
The ethics of AI as both material and medium for interaction remains in murky waters within the context of musical and artistic practice. The interdisciplinarity of the field is revealing matters of concern and care, which necessitate interdisciplinary methodologies for evaluation to trouble and critique the inheritance of "residue-laden" AI-tools in musical applications. Seeking to unsettle these…
▽ More
The ethics of AI as both material and medium for interaction remains in murky waters within the context of musical and artistic practice. The interdisciplinarity of the field is revealing matters of concern and care, which necessitate interdisciplinary methodologies for evaluation to trouble and critique the inheritance of "residue-laden" AI-tools in musical applications. Seeking to unsettle these murky waters, this paper critically examines the example of Holly+, a deep neural network that generates raw audio in the likeness of its creator Holly Herndon. Drawing from theoretical concerns and considerations from speculative feminism and care ethics, we care-fully trouble the structures, frameworks and assumptions that oscillate within and around Holly+. We contribute with several considerations and contemplate future directions for integrating speculative feminism and care into musical-AI agent and system design, derived from our critical feminist examination.
△ Less
Submitted 14 November, 2023;
originally announced November 2023.
-
A Shift In Artistic Practices through Artificial Intelligence
Authors:
Kıvanç Tatar,
Petter Ericson,
Kelsey Cotton,
Paola Torres Núñez del Prado,
Roser Batlle-Roca,
Beatriz Cabrero-Daniel,
Sara Ljungblad,
Georgios Diapoulis,
Jabbar Hussain
Abstract:
The explosion of content generated by artificial intelligence (AI) models has initiated a cultural shift in arts, music, and media, whereby roles are changing, values are shifting, and conventions are challenged. The vast, readily available dataset of the Internet has created an environment for AI models to be trained on any content on the Web. With AI models shared openly and used by many globall…
▽ More
The explosion of content generated by artificial intelligence (AI) models has initiated a cultural shift in arts, music, and media, whereby roles are changing, values are shifting, and conventions are challenged. The vast, readily available dataset of the Internet has created an environment for AI models to be trained on any content on the Web. With AI models shared openly and used by many globally, how does this new paradigm shift challenge the status quo in artistic practices? What kind of changes will AI technology bring to music, arts, and new media?
△ Less
Submitted 10 April, 2024; v1 submitted 13 June, 2023;
originally announced June 2023.
-
Sound Design Strategies for Latent Audio Space Explorations Using Deep Learning Architectures
Authors:
Kıvanç Tatar,
Kelsey Cotton,
Daniel Bisig
Abstract:
The research in Deep Learning applications in sound and music computing have gathered an interest in the recent years; however, there is still a missing link between these new technologies and on how they can be incorporated into real-world artistic practices. In this work, we explore a well-known Deep Learning architecture called Variational Autoencoders (VAEs). These architectures have been used…
▽ More
The research in Deep Learning applications in sound and music computing have gathered an interest in the recent years; however, there is still a missing link between these new technologies and on how they can be incorporated into real-world artistic practices. In this work, we explore a well-known Deep Learning architecture called Variational Autoencoders (VAEs). These architectures have been used in many areas for generating latent spaces where data points are organized so that similar data points locate closer to each other. Previously, VAEs have been used for generating latent timbre spaces or latent spaces of symbolic music excepts. Applying VAE to audio features of timbre requires a vocoder to transform the timbre generated by the network to an audio signal, which is computationally expensive. In this work, we apply VAEs to raw audio data directly while bypassing audio feature extraction. This approach allows the practitioners to use any audio recording while giving flexibility and control over the aesthetics through dataset curation. The lower computation time in audio signal generation allows the raw audio approach to be incorporated into real-time applications. In this work, we propose three strategies to explore latent spaces of audio and timbre for sound design applications. By doing so, our aim is to initiate a conversation on artistic approaches and strategies to utilize latent audio spaces in sound and music practices.
△ Less
Submitted 19 June, 2023; v1 submitted 24 May, 2023;
originally announced May 2023.
-
On the importance of AI research beyond disciplines
Authors:
Virginia Dignum,
Donal Casey,
Teresa Cerratto-Pargman,
Frank Dignum,
Valentina Fantasia,
Bodil Formark,
Björn Hammarfelt,
Gunnar Holmberg,
André Holzapfel,
Stefan Larsson,
Amanda Lagerkvist,
Nicolette Lakemond,
Helena Lindgren,
Fabian Lorig,
Ana Marusic,
Lina Rahm,
Yulia Razmetaeva,
Sverker Sikström,
Kıvanç Tatar,
Jason Tucker
Abstract:
As the impact of AI on various scientific fields is increasing, it is crucial to embrace interdisciplinary knowledge to understand the impact of technology on society. The goal is to foster a research environment beyond disciplines that values diversity and creates, critiques and develops new conceptual and theoretical frameworks. Even though research beyond disciplines is essential for understand…
▽ More
As the impact of AI on various scientific fields is increasing, it is crucial to embrace interdisciplinary knowledge to understand the impact of technology on society. The goal is to foster a research environment beyond disciplines that values diversity and creates, critiques and develops new conceptual and theoretical frameworks. Even though research beyond disciplines is essential for understanding complex societal issues and creating positive impact it is notoriously difficult to evaluate and is often not recognized by current academic career progression. The motivation for this paper is to engage in broad discussion across disciplines and identify guiding principles fir AI research beyond disciplines in a structured and inclusive way, revealing new perspectives and contributing to societal and human wellbeing and sustainability.
△ Less
Submitted 13 February, 2023;
originally announced February 2023.
-
Introducing Latent Timbre Synthesis
Authors:
K. Tatar,
D. Bisig,
P. Pasquier
Abstract:
We present the Latent Timbre Synthesis (LTS), a new audio synthesis method using Deep Learning. The synthesis method allows composers and sound designers to interpolate and extrapolate between the timbre of multiple sounds using the latent space of audio frames. We provide the details of two Variational Autoencoder architectures for LTS, and compare their advantages and drawbacks. The implementati…
▽ More
We present the Latent Timbre Synthesis (LTS), a new audio synthesis method using Deep Learning. The synthesis method allows composers and sound designers to interpolate and extrapolate between the timbre of multiple sounds using the latent space of audio frames. We provide the details of two Variational Autoencoder architectures for LTS, and compare their advantages and drawbacks. The implementation includes a fully working application with graphical user interface, called \textit{interpolate\_two}, which enables practitioners to explore the timbre between two audio excerpts of their selection using interpolation and extrapolation in the latent space of audio frames. Our implementation is open-source, and we aim to improve the accessibility of this technology by providing a guide for users with any technical background.
△ Less
Submitted 30 May, 2020;
originally announced June 2020.
-
Future physics opportunities for high-density QCD at the LHC with heavy-ion and proton beams
Authors:
Z. Citron,
A. Dainese,
J. F. Grosse-Oetringhaus,
J. M. Jowett,
Y. -J. Lee,
U. A. Wiedemann,
M. Winn,
A. Andronic,
F. Bellini,
E. Bruna,
E. Chapon,
H. Dembinski,
D. d'Enterria,
I. Grabowska-Bold,
G. M. Innocenti,
C. Loizides,
S. Mohapatra,
C. A. Salgado,
M. Verweij,
M. Weber,
J. Aichelin,
A. Angerami,
L. Apolinario,
F. Arleo,
N. Armesto
, et al. (160 additional authors not shown)
Abstract:
The future opportunities for high-density QCD studies with ion and proton beams at the LHC are presented. Four major scientific goals are identified: the characterisation of the macroscopic long wavelength Quark-Gluon Plasma (QGP) properties with unprecedented precision, the investigation of the microscopic parton dynamics underlying QGP properties, the development of a unified picture of particle…
▽ More
The future opportunities for high-density QCD studies with ion and proton beams at the LHC are presented. Four major scientific goals are identified: the characterisation of the macroscopic long wavelength Quark-Gluon Plasma (QGP) properties with unprecedented precision, the investigation of the microscopic parton dynamics underlying QGP properties, the development of a unified picture of particle production and QCD dynamics from small (pp) to large (nucleus--nucleus) systems, the exploration of parton densities in nuclei in a broad ($x$, $Q^2$) kinematic range and the search for the possible onset of parton saturation. In order to address these scientific goals, high-luminosity Pb-Pb and p-Pb programmes are considered as priorities for Runs 3 and 4, complemented by high-multiplicity studies in pp collisions and a short run with oxygen ions. High-luminosity runs with intermediate-mass nuclei, for example Ar or Kr, are considered as an appealing case for extending the heavy-ion programme at the LHC beyond Run 4. The potential of the High-Energy LHC to probe QCD matter with newly-available observables, at twice larger center-of-mass energies than the LHC, is investigated.
△ Less
Submitted 25 February, 2019; v1 submitted 17 December, 2018;
originally announced December 2018.
-
Strong Modulation of Infrared Light using Graphene Integration with Plasmonic Fano-Resonant Metasurfaces
Authors:
Nima Dabidian,
Iskandar Kholmanov,
Alexander B. Khanikaev,
Kaya Tatar,
Simeon Trendafilov,
S. Hossein Mousavi,
Carl Magnuson,
Rodney S. Ruoff,
Gennady Shvets
Abstract:
Plasmonic metasurfaces represent a promising platform for enhancing light-matter interaction. Active control of the optical response of metasurfaces is desirable for applications such as beam-steering, modulators and switches, biochemical sensors, and compact optoelectronic devices. Here we use a plasmonic metasurface with two Fano resonances to enhance the interaction of infrared light with elect…
▽ More
Plasmonic metasurfaces represent a promising platform for enhancing light-matter interaction. Active control of the optical response of metasurfaces is desirable for applications such as beam-steering, modulators and switches, biochemical sensors, and compact optoelectronic devices. Here we use a plasmonic metasurface with two Fano resonances to enhance the interaction of infrared light with electrically controllable single layer graphene. It is experimentally shown that the narrow spectral width of these resonances, combined with strong light/graphene coupling, enables reflectivity modulation by nearly an order of magnitude leading to a modulation depth as large as 90%. . Numerical simulations demonstrate the possibility of strong active modulation of the phase of the reflected light while kee** the reflectivity nearly constant, thereby paving the way to tunable infrared lensing and beam steering
△ Less
Submitted 5 May, 2014;
originally announced May 2014.
