-
How Does Overparameterization Affect Features?
Authors:
Ahmet Cagri Duzgun,
Samy Jelassi,
Yuanzhi Li
Abstract:
Overparameterization, the condition where models have more parameters than necessary to fit their training loss, is a crucial factor for the success of deep learning. However, the characteristics of the features learned by overparameterized networks are not well understood. In this work, we explore this question by comparing models with the same architecture but different widths. We first examine…
▽ More
Overparameterization, the condition where models have more parameters than necessary to fit their training loss, is a crucial factor for the success of deep learning. However, the characteristics of the features learned by overparameterized networks are not well understood. In this work, we explore this question by comparing models with the same architecture but different widths. We first examine the expressivity of the features of these models, and show that the feature space of overparameterized networks cannot be spanned by concatenating many underparameterized features, and vice versa. This reveals that both overparameterized and underparameterized networks acquire some distinctive features. We then evaluate the performance of these models, and find that overparameterized networks outperform underparameterized networks, even when many of the latter are concatenated. We corroborate these findings using a VGG-16 and ResNet18 on CIFAR-10 and a Transformer on the MNLI classification dataset. Finally, we propose a toy setting to explain how overparameterized networks can learn some important features that the underparamaterized networks cannot learn.
△ Less
Submitted 1 July, 2024;
originally announced July 2024.
-
Entropy-driven order in an array of nanomagnets
Authors:
Hilal Saglam,
Ayhan Duzgun,
Aikaterini Kargioti,
Nikhil Harle,
Xiaoyu Zhang,
Nicholas S. Bingham,
Yuyang Lao,
Ian Gilbert,
Joseph Sklenar,
Justin D. Watts,
Justin Ramberger,
Daniel Bromley,
Rajesh V. Chopdekar,
Liam O'Brien,
Chris Leighton,
Cristiano Nisoli,
Peter Schiffer
Abstract:
Long-range ordering is typically associated with a decrease in entropy. Yet, it can also be driven by increasing entropy in certain special cases. We demonstrate that artificial spin ice arrays of single-domain nanomagnets can be designed to produce entropy-driven order. We focus on the tetris artificial spin ice structure, a highly frustrated array geometry with a zero-point Pauli entropy, which…
▽ More
Long-range ordering is typically associated with a decrease in entropy. Yet, it can also be driven by increasing entropy in certain special cases. We demonstrate that artificial spin ice arrays of single-domain nanomagnets can be designed to produce entropy-driven order. We focus on the tetris artificial spin ice structure, a highly frustrated array geometry with a zero-point Pauli entropy, which is formed by selectively creating regular vacancies on the canonical square ice lattice. We probe thermally active tetris artificial spin ice both experimentally and through simulations, measuring the magnetic moments of the individual nanomagnets. We find two-dimensional magnetic ordering in one subset of these moments, which we demonstrate to be induced by disorder (i.e., increased entropy) in another subset of the moments. In contrast with other entropy-driven systems, the discrete degrees of freedom in tetris artificial spin ice are binary and are both designable and directly observable at the microscale, and the entropy of the system is precisely calculable in simulations. This example, in which the system's interactions and ground state entropy are well-defined, expands the experimental landscape for the study of entropy-driven ordering.
△ Less
Submitted 22 February, 2022;
originally announced February 2022.
-
Directed Motion of Liquid Crystal Skyrmions With Oscillating Fields
Authors:
A. Duzgun,
C. Nisoli,
C. J. O. Reichhardt,
C. Reichhardt
Abstract:
Using continuum simulations, we show that under a sinusoidal electric field, liquid crystal skyrmions undergo periodic shape oscillations which produce controlled directed motion. The speed of the skyrmion is non-monotonic in the frequency of the applied field, and exhibits multiple reversals of the motion as a function of changing frequency. We map out the dynamical regime diagram of the forward…
▽ More
Using continuum simulations, we show that under a sinusoidal electric field, liquid crystal skyrmions undergo periodic shape oscillations which produce controlled directed motion. The speed of the skyrmion is non-monotonic in the frequency of the applied field, and exhibits multiple reversals of the motion as a function of changing frequency. We map out the dynamical regime diagram of the forward and reverse motion for two superimposed ac driving frequencies, and show that the reversals and directed motion can occur even when only a single ac driving frequency is present. Using pulsed ac driving, we demonstrate that the motion arises due to an asymmetry in the relaxation times of the skyrmion shape. We discuss the connection between our results and ratchet effects observed in systems without asymmetric substrates.
△ Less
Submitted 8 December, 2021;
originally announced December 2021.
-
Explicit Kink Solutions in Several One-Parameter Family of Higher Order Field Theory Models
Authors:
Avinash Khare,
Ayhan Duzgun,
Avadh Saxena
Abstract:
We present several one-parameter family of higher order field theory models some of which admit explicit kink solutions with an exponential tail while others admit explicit kink solutions with a power-law tail. Various properties of these families of kink solutions are examined in detail. In particular for models harboring kink solutions with a power-law tail, we show that there is no gap between…
▽ More
We present several one-parameter family of higher order field theory models some of which admit explicit kink solutions with an exponential tail while others admit explicit kink solutions with a power-law tail. Various properties of these families of kink solutions are examined in detail. In particular for models harboring kink solutions with a power-law tail, we show that there is no gap between the zero mode and the beginning of the continuum in the kink stability potential. Further, by applying the recent Manton formalism, we provide estimates for the kink-kink and antikink-kink acceleration and hence the ratio of the corresponding antikink-kink and kink-kink forces.
△ Less
Submitted 8 March, 2021;
originally announced March 2021.
-
String Phase in an Artificial Spin Ice
Authors:
Xiaoyu Zhang,
Ayhan Duzgun,
Yuyang Lao,
Shayaan Subzwari,
Nicholas S. Bingham,
Joseph Sklenar,
Hilal Saglam,
Justin Ramberger,
Joseph T. Batley,
Justin D. Watts,
Daniel Bromley,
Rajesh V. Chopdekar,
Liam O'Brien,
Chris Leighton,
Cristiano Nisoli,
Peter Schiffer
Abstract:
One-dimensional strings of local excitations are a fascinating feature of the physical behavior of strongly correlated topological quantum matter. Here we study strings of local excitations in a classical system of interacting nanomagnets, the Santa Fe Ice geometry of artificial spin ice. We measured the moment configuration of the nanomagnets, both after annealing near the ferromagnetic Curie poi…
▽ More
One-dimensional strings of local excitations are a fascinating feature of the physical behavior of strongly correlated topological quantum matter. Here we study strings of local excitations in a classical system of interacting nanomagnets, the Santa Fe Ice geometry of artificial spin ice. We measured the moment configuration of the nanomagnets, both after annealing near the ferromagnetic Curie point and in a thermally dynamic state. While the Santa Fe Ice lattice structure is complex, we demonstrate that its disordered magnetic state is naturally described within a framework of emergent strings. We show experimentally that the string length follows a simple Boltzmann distribution with an energy scale that is associated with the system's magnetic interactions and is consistent with theoretical predictions. The results demonstrate that string description and associated topological characteristics are not unique to quantum models but can also provide a simplifying description of complex classical systems with non-trivial frustration.
△ Less
Submitted 20 October, 2021; v1 submitted 17 August, 2020;
originally announced August 2020.
-
Alignment induced re-configurable walls for patterning and assembly of liquid crystal skyrmions
Authors:
Ayhan Duzgun,
Avadh Saxena,
Jonathan V. Selinger
Abstract:
Skyrmions have attracted rapidly growing interest due to their topological properties and unique aspects for potential novel applications such as data storage and soft robotics. They can also serve as key elements for materials by design, self-assembly, and functional soft materials. While not real particles, these skyrmions behave like particles-they interact with each other and can be actuated b…
▽ More
Skyrmions have attracted rapidly growing interest due to their topological properties and unique aspects for potential novel applications such as data storage and soft robotics. They can also serve as key elements for materials by design, self-assembly, and functional soft materials. While not real particles, these skyrmions behave like particles-they interact with each other and can be actuated by means of electric field, surface anchoring, and light. On the other hand, they are field configurations which have properties not possessed by real particles. Here, we show that, by means of alignment induced attractive and repulsive walls, skyrmions in chiral nematic liquid crystals can be precisely controlled and programmed to serve as suitable building blocks for the realization of the above goals. Our work may stimulate new experimental efforts and concomitant applications in this direction.
△ Less
Submitted 11 December, 2020; v1 submitted 27 January, 2020;
originally announced January 2020.
-
Commensurate States and Pattern Switching via Liquid Crystal Skyrmions Trapped in a Square Lattice
Authors:
A. Duzgun,
C. Nisoli,
C. J. O. Reichhardt,
C. Reichhardt
Abstract:
Using continuum based simulations we show that a rich variety of skyrmion liquid crystal states can be realized in the presence of a periodic obstacle array. As a function of the number of skyrmions per obstacle we find hexagonal, square, dimer, trimer and quadrimer ordering, where the $n$-mer structures are a realization of a molecular crystal state of skyrmions. As a function of external field a…
▽ More
Using continuum based simulations we show that a rich variety of skyrmion liquid crystal states can be realized in the presence of a periodic obstacle array. As a function of the number of skyrmions per obstacle we find hexagonal, square, dimer, trimer and quadrimer ordering, where the $n$-mer structures are a realization of a molecular crystal state of skyrmions. As a function of external field and obstacle radius we show that there are transitions between the different crystalline states as well as mixed and disordered structures. We discuss how these states are related to commensurate effects seen in other systems, such as vortices in type-II superconductors and colloids interacting with two dimensional substrates.
△ Less
Submitted 22 November, 2019;
originally announced November 2019.
-
Skyrmion Spin Ice in Liquid Crystals
Authors:
Ayhan Duzgun,
Cristiano Nisoli
Abstract:
We propose the first Skyrmion Spin Ice, realized via confined, interacting liquid crystal skyrmions. Skyrmions in a chiral nematic liquid crystal behave as quasi-particles that can be dynamically confined, bound, and created or annihilated individually with ease and precision. We show that these quasi-particles can be employed to realize binary variables that interact to form ice-rule states. Beca…
▽ More
We propose the first Skyrmion Spin Ice, realized via confined, interacting liquid crystal skyrmions. Skyrmions in a chiral nematic liquid crystal behave as quasi-particles that can be dynamically confined, bound, and created or annihilated individually with ease and precision. We show that these quasi-particles can be employed to realize binary variables that interact to form ice-rule states. Because of their unique versatility, liquid crystal skyrmions can open entirely novel avenues in the field of frustrated systems. More broadly, our findings also demonstrate the viability of LC skyrmions as elementary degrees of freedom in the design of collective complex behaviors.
△ Less
Submitted 24 December, 2020; v1 submitted 8 August, 2019;
originally announced August 2019.
-
Active Brownian particles near straight or curved walls: Pressure and boundary layers
Authors:
Ayhan Duzgun,
Jonathan V. Selinger
Abstract:
Unlike equilibrium systems, active matter is not governed by the conventional laws of thermodynamics. Through a series of analytic calculations and Langevin dynamics simulations, we explore how systems cross over from equilibrium to active behavior as the activity is increased. In particular, we calculate the profiles of density and orientational order near straight or circular walls, and show the…
▽ More
Unlike equilibrium systems, active matter is not governed by the conventional laws of thermodynamics. Through a series of analytic calculations and Langevin dynamics simulations, we explore how systems cross over from equilibrium to active behavior as the activity is increased. In particular, we calculate the profiles of density and orientational order near straight or circular walls, and show the characteristic width of the boundary layers. We find a simple relationship between the enhancements of density and pressure near a wall. Based on these results, we determine how the pressure depends on wall curvature, and hence make approximate analytic predictions for the motion of curved tracers, as well as the rectification of active particles around small openings in confined geometries.
△ Less
Submitted 27 December, 2017;
originally announced December 2017.
-
Comparing skyrmions and merons in chiral liquid crystals and magnets
Authors:
Ayhan Duzgun,
Jonathan V. Selinger,
Avadh Saxena
Abstract:
When chiral liquid crystals or magnets are subjected to applied fields or other anisotropic environments, the competition between favored twist and anisotropy leads to the formation of complex defect structures. In some cases, the defects are skyrmions, which have 180° double twist going outward from the center, and hence can pack together without singularities in the orientational order. In other…
▽ More
When chiral liquid crystals or magnets are subjected to applied fields or other anisotropic environments, the competition between favored twist and anisotropy leads to the formation of complex defect structures. In some cases, the defects are skyrmions, which have 180° double twist going outward from the center, and hence can pack together without singularities in the orientational order. In other cases, the defects are merons, which have 90° double twist going outward from the center; packing such merons requires singularities in the orientational order. In the liquid crystal context, a lattice of merons is regarded as a blue phase. Here, we perform theoretical and computational studies of skyrmions and merons in chiral liquid crystals and magnets. Through these studies, we calculate the phase diagrams for liquid crystals and magnets in terms of dimensionless ratios of energetic parameters. We also predict the range of metastability for liquid crystal skyrmions, and show that these skyrmions can move and interact as effective particles. The results show how the properties of skyrmions and merons depend on the vector or tensor nature of the order parameter.
△ Less
Submitted 21 November, 2017;
originally announced November 2017.
-
Dynamic Theory of Polydomain Liquid-Crystal Elastomers
Authors:
Ayhan Duzgun,
Jonathan V. Selinger
Abstract:
When liquid-crystal elastomers are prepared without any alignment, disordered polydomain structures emerge as the materials are cooled into the nematic phase. These polydomain structures have been attributed to quenched disorder in the cross-linked polymer network. As an alternative explanation, we develop a theory for the dynamics of the isotropic-nematic transition in liquid-crystal elastomers,…
▽ More
When liquid-crystal elastomers are prepared without any alignment, disordered polydomain structures emerge as the materials are cooled into the nematic phase. These polydomain structures have been attributed to quenched disorder in the cross-linked polymer network. As an alternative explanation, we develop a theory for the dynamics of the isotropic-nematic transition in liquid-crystal elastomers, and show that the dynamics can induce a polydomain structure with a characteristic length scale, through a mechanism analogous to the Cahn-Hilliard equation for phase separation.
△ Less
Submitted 26 February, 2015;
originally announced February 2015.