Skip to main content

Showing 1–19 of 19 results for author: Buchanan, S

.
  1. arXiv:2404.02446  [pdf, other

    cs.LG stat.ML

    Masked Completion via Structured Diffusion with White-Box Transformers

    Authors: Druv Pai, Ziyang Wu, Sam Buchanan, Yaodong Yu, Yi Ma

    Abstract: Modern learning frameworks often train deep neural networks with massive amounts of unlabeled data to learn representations by solving simple pretext tasks, then use the representations as foundations for downstream tasks. These networks are empirically designed; as such, they are usually not interpretable, their representations are not structured, and their designs are potentially redundant. Whit… ▽ More

    Submitted 3 April, 2024; originally announced April 2024.

    Comments: To be published at ICLR 2024; 44 pages. arXiv admin note: substantial text overlap with arXiv:2311.13110

  2. arXiv:2403.13722  [pdf

    cond-mat.mtrl-sci physics.app-ph

    Magneto-Ionic Vortices: Voltage-Reconfigurable Swirling-Spin Analog-Memory Nanomagnets

    Authors: Irena Spasojevic, Zheng Ma, Aleix Barrera, Federica Celegato, Ana Palau, Paola Tiberto, Kristen S. Buchanan, Jordi Sort

    Abstract: Rapid progress in information technologies has spurred the need for innovative memory concepts, for which advanced data-processing methods and tailor-made materials are required. Here we introduce a previously unexplored nanoscale magnetic object: an analog magnetic vortex controlled by electric-field-induced ion motion, termed magneto-ionic vortex or "vortion". This state arises from paramagnetic… ▽ More

    Submitted 20 March, 2024; originally announced March 2024.

  3. arXiv:2311.13110  [pdf, other

    cs.LG cs.CL cs.CV

    White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?

    Authors: Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Hao Bai, Yuexiang Zhai, Benjamin D. Haeffele, Yi Ma

    Abstract: In this paper, we contend that a natural objective of representation learning is to compress and transform the distribution of the data, say sets of tokens, towards a low-dimensional Gaussian mixture supported on incoherent subspaces. The goodness of such a representation can be evaluated by a principled measure, called sparse rate reduction, that simultaneously maximizes the intrinsic information… ▽ More

    Submitted 24 November, 2023; v1 submitted 21 November, 2023; originally announced November 2023.

    Comments: This paper integrates the works arXiv:2306.01129 and arXiv:2308.16271 into a complete story. In this paper, we improve the writing and organization, and also add conceptual, empirical, and theoretical improvements over the previous work. V2: small typo fixes and formatting improvements

  4. arXiv:2310.14344  [pdf, other

    cs.CV cs.LG

    What's in a Prior? Learned Proximal Networks for Inverse Problems

    Authors: Zhenghan Fang, Sam Buchanan, Jeremias Sulam

    Abstract: Proximal operators are ubiquitous in inverse problems, commonly appearing as part of algorithmic strategies to regularize problems that are otherwise ill-posed. Modern deep learning models have been brought to bear for these tasks too, as in the framework of plug-and-play or deep unrolling, where they loosely resemble proximal operators. Yet, something essential is lost in employing these purely d… ▽ More

    Submitted 27 March, 2024; v1 submitted 22 October, 2023; originally announced October 2023.

  5. arXiv:2308.16271  [pdf, other

    cs.CV cs.LG

    Emergence of Segmentation with Minimalistic White-Box Transformers

    Authors: Yaodong Yu, Tianzhe Chu, Shengbang Tong, Ziyang Wu, Druv Pai, Sam Buchanan, Yi Ma

    Abstract: Transformer-like models for vision tasks have recently proven effective for a wide range of downstream applications such as segmentation and detection. Previous works have shown that segmentation properties emerge in vision transformers (ViTs) trained using self-supervised methods such as DINO, but not in those trained on supervised classification tasks. In this study, we probe whether segmentatio… ▽ More

    Submitted 30 August, 2023; originally announced August 2023.

    Comments: Code: https://github.com/Ma-Lab-Berkeley/CRATE

  6. arXiv:2308.15461  [pdf, other

    cs.CV cs.LG math.OC

    Canonical Factors for Hybrid Neural Fields

    Authors: Brent Yi, Weijia Zeng, Sam Buchanan, Yi Ma

    Abstract: Factored feature volumes offer a simple way to build more compact, efficient, and intepretable neural fields, but also introduce biases that are not necessarily beneficial for real-world data. In this work, we (1) characterize the undesirable biases that these architectures have for axis-aligned signals -- they can lead to radiance field reconstruction differences of as high as 2 PSNR -- and (2) e… ▽ More

    Submitted 29 August, 2023; originally announced August 2023.

    Comments: ICCV 2023. Project webpage: https://brentyi.github.io/tilted/

  7. arXiv:2308.03353  [pdf

    cond-mat.mtrl-sci

    $\textit{In situ}$ electric-field control of ferromagnetic resonance in the low-loss organic-based ferrimagnet V[TCNE]$_{x\sim 2}$

    Authors: Seth W. Kurfman, Andrew Franson, Piyush Shah, Yueguang Shi, Hil Fung Harry Cheung, Katherine E. Nygren, Mitchell Swyt, Kristen S. Buchanan, Gregory D. Fuchs, Michael E. Flatté, Gopalan Srinivasan, Michael Page, Ezekiel Johnston-Halperin

    Abstract: We demonstrate indirect electric-field control of ferromagnetic resonance (FMR) in devices that integrate the low-loss, molecule-based, room-temperature ferrimagnet vanadium tetracyanoethylene (V[TCNE]$_{x \sim 2}$) mechanically coupled to PMN-PT piezoelectric transducers. Upon straining the V[TCNE]$_x$ films, the FMR frequency is tuned by more than 6 times the resonant linewidth with no change in… ▽ More

    Submitted 7 August, 2023; originally announced August 2023.

  8. arXiv:2306.01129  [pdf, other

    cs.LG

    White-Box Transformers via Sparse Rate Reduction

    Authors: Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Benjamin D. Haeffele, Yi Ma

    Abstract: In this paper, we contend that the objective of representation learning is to compress and transform the distribution of the data, say sets of tokens, towards a mixture of low-dimensional Gaussian distributions supported on incoherent subspaces. The quality of the final representation can be measured by a unified objective function called sparse rate reduction. From this perspective, popular deep… ▽ More

    Submitted 1 June, 2023; originally announced June 2023.

    Comments: 33 pages, 11 figures

  9. arXiv:2203.05006  [pdf, other

    cs.CV cs.LG math.OC

    Resource-Efficient Invariant Networks: Exponential Gains by Unrolled Optimization

    Authors: Sam Buchanan, **gkai Yan, Ellie Haber, John Wright

    Abstract: Achieving invariance to nuisance transformations is a fundamental challenge in the construction of robust and reliable vision systems. Existing approaches to invariance scale exponentially with the dimension of the family of transformations, making them unable to cope with natural variabilities in visual data such as changes in pose and perspective. We identify a common limitation of these approac… ▽ More

    Submitted 9 March, 2022; originally announced March 2022.

  10. arXiv:2107.14324  [pdf, other

    stat.ML cs.LG math.OC

    Deep Networks Provably Classify Data on Curves

    Authors: Tingran Wang, Sam Buchanan, Dar Gilboa, John Wright

    Abstract: Data with low-dimensional nonlinear structure are ubiquitous in engineering and scientific problems. We study a model problem with such structure -- a binary classification task that uses a deep fully-connected neural network to classify data drawn from two disjoint smooth curves on the unit sphere. Aside from mild regularity conditions, we place no restrictions on the configuration of the curves.… ▽ More

    Submitted 28 October, 2021; v1 submitted 29 July, 2021; originally announced July 2021.

    Comments: NeurIPS 2021

  11. arXiv:2008.11245  [pdf, other

    stat.ML cs.LG math.OC

    Deep Networks and the Multiple Manifold Problem

    Authors: Sam Buchanan, Dar Gilboa, John Wright

    Abstract: We study the multiple manifold problem, a binary classification task modeled on applications in machine vision, in which a deep fully-connected neural network is trained to separate two low-dimensional submanifolds of the unit sphere. We provide an analysis of the one-dimensional case, proving for a simple manifold configuration that when the network depth $L$ is large relative to certain geometri… ▽ More

    Submitted 6 May, 2021; v1 submitted 25 August, 2020; originally announced August 2020.

    Comments: ICLR 2021

  12. A semi-analytical approach to calculating the dynamic modes of magnetic vortices with Dzyaloshinskii-Moriya interactions

    Authors: Carla Quispe Flores, Casey Chalifour, Jonathon Davidson, Karen L. Livesey, Kristen S. Buchanan

    Abstract: Here we introduce a Landau-Lifshitz based diagonalization (LLD) method, and use this approach to calculate the effects of the interfacial Dzyaloshinskii Moriya interactions (DMI) on the radial-type spin wave modes of magnetic vortices in circular disks. The LLD method is a semi-analytical approach that involves the diagonalization of the magnetostatic kernel, exchange, and DMI contributions to ext… ▽ More

    Submitted 14 December, 2019; originally announced December 2019.

    Comments: 11 pages

  13. arXiv:1910.05325  [pdf, other

    physics.app-ph cond-mat.mes-hall

    Low-Dam** Ferromagnetic Resonance in Electron-Beam Patterned, High-$Q$ Vanadium Tetracyanoethylene Magnon Cavities

    Authors: Andrew Franson, Na Zhu, Seth Kurfman, Michael Chilcote, Denis R. Candido, Kristen S. Buchanan, Michael E. Flatté, Hong X. Tang, Ezekiel Johnston-Halperin

    Abstract: Integrating patterned, low-loss magnetic materials into microwave devices and circuits presents many challenges due to the specific conditions that are required to grow ferrite materials, driving the need for flip-chip and other indirect fabrication techniques. The low-loss ($α= 3.98 \pm 0.22 \times 10^{-5}$), room-temperature ferrimagnetic coordination compound vanadium tetracyanoethylene (… ▽ More

    Submitted 11 October, 2019; originally announced October 2019.

    Comments: 18 pages, 7 figures, submitted to APL Materials

    Journal ref: APL Materials 7, 121113 (2019)

  14. arXiv:1809.10313  [pdf, other

    math.OC

    Efficient Dictionary Learning with Gradient Descent

    Authors: Dar Gilboa, Sam Buchanan, John Wright

    Abstract: Randomly initialized first-order optimization algorithms are the method of choice for solving many high-dimensional nonconvex problems in machine learning, yet general theoretical guarantees cannot rule out convergence to critical points of poor objective value. For some highly structured nonconvex problems however, the success of gradient descent can be understood by studying the geometry of the… ▽ More

    Submitted 26 September, 2018; originally announced September 2018.

  15. arXiv:1504.07121  [pdf

    cond-mat.mtrl-sci

    New Reversal Mode in Exchange Coupled Antiferromagnetic/Ferromagnetic Disks: Distorted Viscous Vortex

    Authors: Dustin A. Gilbert, Li Ye, Aïda Varea, Sebastià Agramunt-Puig, Nuria del Valle, Carles Navau, José Francisco López-Barbera, Kristen S. Buchanan, Axel Hoffmann, Alvar Sánchez, Jordi Sort, Kai Liu, Josep Nogués

    Abstract: Magnetic vortices have generated intense interest in recent years due to their unique reversal mechanisms, fascinating topological properties, and exciting potential applications. Additionally, the exchange coupling of magnetic vortices to antiferromagnets has also been shown to lead to a range of novel phenomena and functionalities. Here we report a new magnetization reversal mode of magnetic vor… ▽ More

    Submitted 27 April, 2015; originally announced April 2015.

    Comments: 27 pages, 4 figures and a supplemental information section

    Journal ref: Nanoscale, 7, 9878 - 9885 (2015)

  16. Behavioral individuality reveals genetic control of phenotypic variability

    Authors: Julien F. Ayroles, Sean M. Buchanan, Chelsea Jenney, Kyobi Skutt-Kakaria, Jennifer Grenier, Andrew G. Clark, Daniel L. Hartl, Benjamin L. de Bivort

    Abstract: Variability is ubiquitous in nature and a fundamental feature of complex systems. Few studies, however, have investigated variance itself as a trait under genetic control. By focusing primarily on trait means and ignoring the effect of alternative alleles on trait variability, we may be missing an important axis of genetic variation contributing to phenotypic differences among individuals. To stud… ▽ More

    Submitted 10 September, 2014; originally announced September 2014.

    Comments: 13 pages, 9 figures, 2 tables

  17. Neuronal control of locomotor handedness in Drosophila

    Authors: Sean Buchanan, Jamey Kain, Benjamin de Bivort

    Abstract: Handedness in humans - better performance using either the left or right hand - is personally familiar, moderately heritable, and regulated by many genes, including those involved in general body symmetry. But behavioral handedness, i.e. lateralization, is a multifaceted phenomenon. For example, people display clockwise or counter-clockwise biases in their walking behavior that is uncorrelated to… ▽ More

    Submitted 28 August, 2014; originally announced August 2014.

    Comments: 14 pages, 13 figures

  18. arXiv:cond-mat/0602509  [pdf

    cond-mat.mtrl-sci cond-mat.mes-hall

    Soliton pair dynamics in patterned ferromagnetic ellipses

    Authors: K. S. Buchanan, P. E. Roy, M. Grimsditch, F. Y. Fradin, K. Yu. Guslienko, S. D. Bader, V. Novosad

    Abstract: Confinement alters the energy landscape of nanoscale magnets, leading to the appearance of unusual magnetic states, such as vortices, for example. Many basic questions concerning dynamical and interaction effects remain unanswered, and nanomagnets are convenient model systems for studying these fundamental physical phenomena. A single vortex in restricted geometry, also known as a non-localized… ▽ More

    Submitted 21 February, 2006; originally announced February 2006.

    Comments: supplemental movies on http://www.nature.com/nphys/journal/v1/n3/suppinfo/nphys173_S1.html

    Journal ref: K. S. Buchanan, P. E. Roy, M. Grimsditch, F. Y. Fradin, K. Yu. Guslienko, S. D. Bader, and V. Novosad, Nature Physics 1, 172-176 (2005)

  19. arXiv:cond-mat/0502469  [pdf

    cond-mat.mes-hall cond-mat.mtrl-sci

    Dynamics of coupled vortices in layered magnetic nanodots

    Authors: K. Yu. Guslienko, K. S. Buchanan, S. D. Bader, V. Novosad

    Abstract: The spin dynamics are calculated for a model system consisting of magnetically soft, layered nanomagnets, in which two ferromagnetic (F) cylindrical dots, each with a magnetic vortex ground state, are separated by a non-magnetic spacer (N). This permits a study of the effects of interlayer magnetostatic interactions on the vortex dynamics. The system was explored by applying the equations of mot… ▽ More

    Submitted 18 February, 2005; originally announced February 2005.

    Comments: One PDF file including text and 4 figures