Showing 1–14 of 14 results for author: Ginis, V

The Effectiveness of Curvature-Based Rewiring and the Role of Hyperparameters in GNNs Revisited

Authors: Floriano Tori, Vincent Holst, Vincent Ginis

Abstract: Message passing is the dominant paradigm in Graph Neural Networks (GNNs). The efficiency of message passing, however, can be limited by the topology of the graph. This happens when information is lost during propagation due to being oversquashed when travelling through bottlenecks. To remedy this, recent efforts have focused on graph rewiring techniques, which disconnect the input graph originatin… ▽ More Message passing is the dominant paradigm in Graph Neural Networks (GNNs). The efficiency of message passing, however, can be limited by the topology of the graph. This happens when information is lost during propagation due to being oversquashed when travelling through bottlenecks. To remedy this, recent efforts have focused on graph rewiring techniques, which disconnect the input graph originating from the data and the computational graph, on which message passing is performed. A prominent approach for this is to use discrete graph curvature measures, of which several variants have been proposed, to identify and rewire around bottlenecks, facilitating information propagation. While oversquashing has been demonstrated in synthetic datasets, in this work we reevaluate the performance gains that curvature-based rewiring brings to real-world datasets. We show that in these datasets, edges selected during the rewiring process are not in line with theoretical criteria identifying bottlenecks. This implies they do not necessarily oversquash information during message passing. Subsequently, we demonstrate that SOTA accuracies on these datasets are outliers originating from sweeps of hyperparameters -- both the ones for training and dedicated ones related to the rewiring algorithm -- instead of consistent performance gains. In conclusion, our analysis nuances the effectiveness of curvature-based rewiring in real-world datasets and brings a new perspective on the methods to evaluate GNN accuracy improvements. △ Less

Submitted 12 July, 2024; originally announced July 2024.

Comments: 19 pages, 10 figures

Large Language Models Reflect Human Citation Patterns with a Heightened Citation Bias

Authors: Andres Algaba, Carmen Mazijn, Vincent Holst, Floriano Tori, Sylvia Wenmackers, Vincent Ginis

Abstract: Citation practices are crucial in sha** the structure of scientific knowledge, yet they are often influenced by contemporary norms and biases. The emergence of Large Language Models (LLMs) like GPT-4 introduces a new dynamic to these practices. Interestingly, the characteristics and potential biases of references recommended by LLMs that entirely rely on their parametric knowledge, and not on se… ▽ More Citation practices are crucial in sha** the structure of scientific knowledge, yet they are often influenced by contemporary norms and biases. The emergence of Large Language Models (LLMs) like GPT-4 introduces a new dynamic to these practices. Interestingly, the characteristics and potential biases of references recommended by LLMs that entirely rely on their parametric knowledge, and not on search or retrieval-augmented generation, remain unexplored. Here, we analyze these characteristics in an experiment using a dataset of 166 papers from AAAI, NeurIPS, ICML, and ICLR, published after GPT-4's knowledge cut-off date, encompassing 3,066 references in total. In our experiment, GPT-4 was tasked with suggesting scholarly references for the anonymized in-text citations within these papers. Our findings reveal a remarkable similarity between human and LLM citation patterns, but with a more pronounced high citation bias in GPT-4, which persists even after controlling for publication year, title length, number of authors, and venue. Additionally, we observe a large consistency between the characteristics of GPT-4's existing and non-existent generated references, indicating the model's internalization of citation patterns. By analyzing citation graphs, we show that the references recommended by GPT-4 are embedded in the relevant citation context, suggesting an even deeper conceptual internalization of the citation networks. While LLMs can aid in citation generation, they may also amplify existing biases and introduce new ones, potentially skewing scientific knowledge dissemination. Our results underscore the need for identifying the model's biases and for develo** balanced methods to interact with LLMs in general. △ Less

Submitted 29 May, 2024; v1 submitted 24 May, 2024; originally announced May 2024.

Comments: 28 pages, 11 figures

Dataset Artefacts are the Hidden Drivers of the Declining Disruptiveness in Science

Authors: Vincent Holst, Andres Algaba, Floriano Tori, Sylvia Wenmackers, Vincent Ginis

Abstract: Park et al. [1] reported a decline in the disruptiveness of scientific and technological knowledge over time. Their main finding is based on the computation of CD indices, a measure of disruption in citation networks [2], across almost 45 million papers and 3.9 million patents. Due to a factual plotting mistake, database entries with zero references were omitted in the CD index distributions, hidi… ▽ More Park et al. [1] reported a decline in the disruptiveness of scientific and technological knowledge over time. Their main finding is based on the computation of CD indices, a measure of disruption in citation networks [2], across almost 45 million papers and 3.9 million patents. Due to a factual plotting mistake, database entries with zero references were omitted in the CD index distributions, hiding a large number of outliers with a maximum CD index of one, while kee** them in the analysis [1]. Our reanalysis shows that the reported decline in disruptiveness can be attributed to a relative decline of these database entries with zero references. Notably, this was not caught by the robustness checks included in the manuscript. The regression adjustment fails to control for the hidden outliers as they correspond to a discontinuity in the CD index. Proper evaluation of the Monte-Carlo simulations reveals that, because of the preservation of the hidden outliers, even random citation behaviour replicates the observed decline in disruptiveness. Finally, while these papers and patents with supposedly zero references are the hidden drivers of the reported decline, their source documents predominantly do make references, exposing them as pure dataset artefacts. △ Less

Submitted 7 February, 2024; originally announced February 2024.

Comments: 3 pages, 2 figures, 3 extended data figures, and Supplementary Information. In submission to Nature

LUCID-GAN: Conditional Generative Models to Locate Unfairness

Authors: Andres Algaba, Carmen Mazijn, Carina Prunkl, Jan Danckaert, Vincent Ginis

Abstract: Most group fairness notions detect unethical biases by computing statistical parity metrics on a model's output. However, this approach suffers from several shortcomings, such as philosophical disagreement, mutual incompatibility, and lack of interpretability. These shortcomings have spurred the research on complementary bias detection methods that offer additional transparency into the sources of… ▽ More Most group fairness notions detect unethical biases by computing statistical parity metrics on a model's output. However, this approach suffers from several shortcomings, such as philosophical disagreement, mutual incompatibility, and lack of interpretability. These shortcomings have spurred the research on complementary bias detection methods that offer additional transparency into the sources of discrimination and are agnostic towards an a priori decision on the definition of fairness and choice of protected features. A recent proposal in this direction is LUCID (Locating Unfairness through Canonical Inverse Design), where canonical sets are generated by performing gradient descent on the input space, revealing a model's desired input given a preferred output. This information about the model's mechanisms, i.e., which feature values are essential to obtain specific outputs, allows exposing potential unethical biases in its internal logic. Here, we present LUCID-GAN, which generates canonical inputs via a conditional generative model instead of gradient-based inverse design. LUCID-GAN has several benefits, including that it applies to non-differentiable models, ensures that canonical sets consist of realistic inputs, and allows to assess proxy and intersectional discrimination. We empirically evaluate LUCID-GAN on the UCI Adult and COMPAS data sets and show that it allows for detecting unethical biases in black-box models without requiring access to the training data. △ Less

Submitted 28 July, 2023; originally announced July 2023.

Comments: 24 pages, 6 figures, 1st World Conference on eXplainable Artificial Intelligence

Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies

Authors: Hannah Pinson, Joeri Lenaerts, Vincent Ginis

Abstract: We here present a step** stone towards a deeper understanding of convolutional neural networks (CNNs) in the form of a theory of learning in linear CNNs. Through analyzing the gradient descent equations, we discover that the evolution of the network during training is determined by the interplay between the dataset structure and the convolutional network structure. We show that linear CNNs disco… ▽ More We here present a step** stone towards a deeper understanding of convolutional neural networks (CNNs) in the form of a theory of learning in linear CNNs. Through analyzing the gradient descent equations, we discover that the evolution of the network during training is determined by the interplay between the dataset structure and the convolutional network structure. We show that linear CNNs discover the statistical structure of the dataset with non-linear, ordered, stage-like transitions, and that the speed of discovery changes depending on the relationship between the dataset and the convolutional network structure. Moreover, we find that this interplay lies at the heart of what we call the ``dominant frequency bias'', where linear CNNs arrive at these discoveries using only the dominant frequencies of the different structural parts present in the dataset. We furthermore provide experiments that show how our theory relates to deep, non-linear CNNs used in practice. Our findings shed new light on the inner working of CNNs, and can help explain their shortcut learning and their tendency to rely on texture instead of shape. △ Less

Submitted 24 July, 2023; v1 submitted 3 March, 2023; originally announced March 2023.

LUCID: Exposing Algorithmic Bias through Inverse Design

Authors: Carmen Mazijn, Carina Prunkl, Andres Algaba, Jan Danckaert, Vincent Ginis

Abstract: AI systems can create, propagate, support, and automate bias in decision-making processes. To mitigate biased decisions, we both need to understand the origin of the bias and define what it means for an algorithm to make fair decisions. Most group fairness notions assess a model's equality of outcome by computing statistical metrics on the outputs. We argue that these output metrics encounter intr… ▽ More AI systems can create, propagate, support, and automate bias in decision-making processes. To mitigate biased decisions, we both need to understand the origin of the bias and define what it means for an algorithm to make fair decisions. Most group fairness notions assess a model's equality of outcome by computing statistical metrics on the outputs. We argue that these output metrics encounter intrinsic obstacles and present a complementary approach that aligns with the increasing focus on equality of treatment. By Locating Unfairness through Canonical Inverse Design (LUCID), we generate a canonical set that shows the desired inputs for a model given a preferred output. The canonical set reveals the model's internal logic and exposes potential unethical biases by repeatedly interrogating the decision-making process. We evaluate LUCID on the UCI Adult and COMPAS data sets and find that some biases detected by a canonical set differ from those of output metrics. The results show that by shifting the focus towards equality of treatment and looking into the algorithm's internal workings, the canonical sets are a valuable addition to the toolbox of algorithmic fairness evaluation. △ Less

Submitted 26 August, 2022; originally announced August 2022.

Comments: 9 pages, 5 figures

Resonators with tailored optical path by cascaded-mode conversions

Authors: Vincent Ginis, Ileana-Cristina Benea-Chelmus, **sheng Lu, Marco Piccardo, Federico Capasso

Abstract: Optical resonators enable the generation, manipulation, and storage of electromagnetic waves. They are widely used in technology and fundamental research, in telecommunications, lasers and nonlinear optics, ultra-sensitive measurements in cavity optomechanics, and the study of light-matter interactions in the context of cavity QED. The physics underlying their operation is determined by the constr… ▽ More Optical resonators enable the generation, manipulation, and storage of electromagnetic waves. They are widely used in technology and fundamental research, in telecommunications, lasers and nonlinear optics, ultra-sensitive measurements in cavity optomechanics, and the study of light-matter interactions in the context of cavity QED. The physics underlying their operation is determined by the constructive interference of electromagnetic waves at specific frequencies, giving rise to the resonance spectrum. This mechanism causes the limitations and trade-offs of resonator design, such as the difficulty of confining waves larger than the resonator and the fixed relationship between free spectral range, modal linewidth, and the resonator's refractive index and size. Here, we introduce a new class of optical resonators, generating resonances by designing the optical path through transverse mode coupling in a cascaded process created by mode-converting mirrors. The generalized round-trip phase condition leads to resonator characteristics that are markedly different from Fabry-Perot resonators and can be tailored over a wide range, such as the largest resonant wavelength, the free spectral range, the linewidth, and the quality factor. We confirm the existence of these modes experimentally in an integrated waveguide cavity with mode converters coupling two transverse modes into one supermode. The resonance signature of the cascaded-mode resonator is a spectrum resulting from the coherent superposition of the coupled transverse modes. We also demonstrate a transverse mode-independent transmission through the resonator and show that its engineered spectral properties agree with theoretical predictions. Cascaded-mode resonators introduce properties not found in traditional resonators and provide a mechanism to overcome the existing trade-offs in the design of resonators in various application areas. △ Less

Submitted 23 February, 2022; originally announced February 2022.

Data driven design of optical resonators

Authors: Joeri Lenaerts, Hannah Pinson, Vincent Ginis

Abstract: Optical devices lie at the heart of most of the technology we see around us. When one actually wants to make such an optical device, one can predict its optical behavior using computational simulations of Maxwell's equations. If one then asks what the optimal design would be in order to obtain a certain optical behavior, the only way to go further would be to try out all of the possible designs an… ▽ More Optical devices lie at the heart of most of the technology we see around us. When one actually wants to make such an optical device, one can predict its optical behavior using computational simulations of Maxwell's equations. If one then asks what the optimal design would be in order to obtain a certain optical behavior, the only way to go further would be to try out all of the possible designs and compute the electromagnetic spectrum they produce. When there are many design parameters, this brute force approach quickly becomes too computationally expensive. We therefore need other methods to create optimal optical devices. An alternative to the brute force approach is inverse design. In this paradigm, one starts from the desired optical response of a material and then determines the design parameters that are needed to obtain this optical response. There are many algorithms known in the literature that implement this inverse design. Some of the best performing, recent approaches are based on Deep Learning. The central idea is to train a neural network to predict the optical response for given design parameters. Since neural networks are completely differentiable, we can compute gradients of the response with respect to the design parameters. We can use these gradients to update the design parameters and get an optical response closer to the one we want. This allows us to obtain an optimal design much faster compared to the brute force approach. In my thesis, I use Deep Learning for the inverse design of the Fabry-Pérot resonator. This system can be described fully analytically and is therefore ideal to study. △ Less

Submitted 21 December, 2021; originally announced February 2022.

Comments: 85 pages, 68 figures, Master thesis in Physics and Astronomy

Roadmap on multimode light sha**

Authors: Marco Piccardo, Vincent Ginis, Andrew Forbes, Simon Mahler, Asher A. Friesem, Nir Davidson, Haoran Ren, Ahmed H. Dorrah, Federico Capasso, Firehun T. Dullo, Balpreet S. Ahluwalia, Antonio Ambrosio, Sylvain Gigan, Nicolas Treps, Markus Hiekkamäki, Robert Fickler, Michael Kues, David Moss, Roberto Morandotti, Johann Riemensberger, Tobias J. Kippenberg, Jérôme Faist, Giacomo Scalari, Nathalie Picqué, Theodor W. Hänsch , et al. (13 additional authors not shown)

Abstract: Our ability to generate new distributions of light has been remarkably enhanced in recent years. At the most fundamental level, these light patterns are obtained by ingeniously combining different electromagnetic modes. Interestingly, the modal superposition occurs in the spatial, temporal as well as spatio-temporal domain. This generalized concept of structured light is being applied across the e… ▽ More Our ability to generate new distributions of light has been remarkably enhanced in recent years. At the most fundamental level, these light patterns are obtained by ingeniously combining different electromagnetic modes. Interestingly, the modal superposition occurs in the spatial, temporal as well as spatio-temporal domain. This generalized concept of structured light is being applied across the entire spectrum of optics: generating classical and quantum states of light, harnessing linear and nonlinear light-matter interactions, and advancing applications in microscopy, spectroscopy, holography, communication, and synchronization. This Roadmap highlights the common roots of these different techniques and thus establishes links between research areas that complement each other seamlessly. We provide an overview of all these areas, their backgrounds, current research, and future developments. We highlight the power of multimodal light manipulation and want to inspire new eclectic approaches in this vibrant research community. △ Less

Submitted 8 April, 2021; originally announced April 2021.

Comments: Under review in J. Opt

Subfemtonewton Force Spectroscopy at the Thermal Limit in Liquids

Authors: Lulu Liu, Simon Kheifets, Vincent Ginis, Federico Capasso

Abstract: We demonstrate thermally limited force spectroscopy using a probe formed by a dielectric microsphere optically trapped in water near a dielectric surface. We achieve force resolution below 1 fN in 100 s, corresponding to a 2 Å rms displacement of the probe. Our measurement combines a calibrated evanescent wave particle tracking technique and a lock-in detection method. We demonstrate the accuracy… ▽ More We demonstrate thermally limited force spectroscopy using a probe formed by a dielectric microsphere optically trapped in water near a dielectric surface. We achieve force resolution below 1 fN in 100 s, corresponding to a 2 Å rms displacement of the probe. Our measurement combines a calibrated evanescent wave particle tracking technique and a lock-in detection method. We demonstrate the accuracy of our method by measurement of the height-dependent force exerted on the probe by an evanescent wave, the results of which are in agreement with Mie theory calculations. △ Less

Submitted 4 June, 2016; originally announced June 2016.

Comments: 5 pages; 4 figures

Journal ref: Phys. Rev. Lett. 116, 228001 (2016)

Enhancing Optical Gradient Forces with Metamaterials

Authors: Vincent Ginis, Philippe Tassin, Costas M. Soukoulis, Irina Veretennicoff

Abstract: We demonstrate how the optical gradient force between two waveguides can be enhanced using transformation optics. A thin layer of double-negative or single-negative metamaterial can shrink the interwaveguide distance perceived by light, resulting in a more than tenfold enhancement of the optical force. This process is remarkably robust to the dissipative loss normally observed in metamaterials. Ou… ▽ More We demonstrate how the optical gradient force between two waveguides can be enhanced using transformation optics. A thin layer of double-negative or single-negative metamaterial can shrink the interwaveguide distance perceived by light, resulting in a more than tenfold enhancement of the optical force. This process is remarkably robust to the dissipative loss normally observed in metamaterials. Our results provide an alternative way to boost optical gradient forces in nanophotonic actuation systems and may be combined with existing resonator-based enhancement methods to produce optical forces with an unprecedented amplitude. △ Less

Submitted 31 January, 2013; originally announced February 2013.

Comments: 5 pages, 4 figures; supplemental information available from APS

Journal ref: Phys. Rev. Lett. 110, 057401 (2013)

Creating electromagnetic cavities using transformation optics

Authors: Vincent Ginis, Philippe Tassin, Jan Danckaert, Costas M. Soukoulis, Irina Veretennicoff

Abstract: We investigate the potential of transformation optics for the design of novel electromagnetic cavities. First, we determine the dispersion relation of bound modes in a device performing an arbitrary radial coordinate transformation and we discuss a number of such cavity structures. Subsequently, we generalize our study to media that implement azimuthal transformations and we show that such transfo… ▽ More We investigate the potential of transformation optics for the design of novel electromagnetic cavities. First, we determine the dispersion relation of bound modes in a device performing an arbitrary radial coordinate transformation and we discuss a number of such cavity structures. Subsequently, we generalize our study to media that implement azimuthal transformations and we show that such transformations can manipulate the azimuthal mode number. Finally, we discuss how the combination of radial and azimuthal coordinate transformations allows for perfect confinement of subwavelength modes inside a cavity consisting of right-handed materials only. △ Less

Submitted 21 March, 2012; v1 submitted 2 August, 2011; originally announced August 2011.

Comments: 17 pages, 6 figures

Journal ref: New J. Phys. 14, 033007 (2012)

Frequency converter implementing an optical analogue of the cosmological redshift

Authors: V. Ginis, P. Tassin, B. Craps, I. Veretennicoff

Abstract: According to general relativity, the frequency of electromagnetic radiation is altered by the expansion of the universe. This effect--commonly referred to as the cosmological redshift--is of utmost importance for observations in cosmology. Here we show that this redshift can be reproduced on a much smaller scale using an optical analogue inside a dielectric metamaterial with time-dependent mater… ▽ More According to general relativity, the frequency of electromagnetic radiation is altered by the expansion of the universe. This effect--commonly referred to as the cosmological redshift--is of utmost importance for observations in cosmology. Here we show that this redshift can be reproduced on a much smaller scale using an optical analogue inside a dielectric metamaterial with time-dependent material parameters. To this aim, we apply the framework of transformation optics to the Robertson-Walker metric. We demonstrate theoretically how perfect redshifting or blueshifting of an electromagnetic wave can be achieved without the creation of sidebands with a device of finite length. △ Less

Submitted 29 January, 2010; originally announced February 2010.

Comments: 6 pages, 3 figures

Journal ref: Opt. Express 18, 5351-5355 (2010)

Confining Light in Deep Subwavelength Electromagnetic Cavities

Authors: V. Ginis, P. Tassin, C. M. Soukoulis, I. Veretennicoff

Abstract: We demonstrate that it is possible to confine electromagnetic radiation in cavities that are significantly smaller than the wavelength of the radiation it encapsulates. To this aim, we use the techniques of transformation optics. First, we present a "perfect cavity" of arbitrarily small size in which such confined modes can exist. Furthermore, we show that these eigenmodes have a continuous spectr… ▽ More We demonstrate that it is possible to confine electromagnetic radiation in cavities that are significantly smaller than the wavelength of the radiation it encapsulates. To this aim, we use the techniques of transformation optics. First, we present a "perfect cavity" of arbitrarily small size in which such confined modes can exist. Furthermore, we show that these eigenmodes have a continuous spectrum and that bending losses are absent, in contrast to what is observed in traditional microcavities. Finally, we introduce an alternative cavity configuration that is less sensitive to material imperfections and still exhibits deep subwavelength modes combined with high quality factor, even if considerable material losses are included. Such a cavity may be interesting for the storage of information in optical data processing and for applications in quantum optics. △ Less

Submitted 10 September, 2010; v1 submitted 21 November, 2009; originally announced November 2009.

Comments: 5 pages, 4 figures

Journal ref: Phys. Rev. B 82, 113102 (2010)