-
Grid Partitioned Attention: Efficient TransformerApproximation with Inductive Bias for High Resolution Detail Generation
Authors:
Nikolay Jetchev,
Gökhan Yildirim,
Christian Bracher,
Roland Vollgraf
Abstract:
Attention is a general reasoning mechanism than can flexibly deal with image information, but its memory requirements had made it so far impractical for high resolution image generation. We present Grid Partitioned Attention (GPA), a new approximate attention algorithm that leverages a sparse inductive bias for higher computational and memory efficiency in image domains: queries attend only to few…
▽ More
Attention is a general reasoning mechanism than can flexibly deal with image information, but its memory requirements had made it so far impractical for high resolution image generation. We present Grid Partitioned Attention (GPA), a new approximate attention algorithm that leverages a sparse inductive bias for higher computational and memory efficiency in image domains: queries attend only to few keys, spatially close queries attend to close keys due to correlations. Our paper introduces the new attention layer, analyzes its complexity and how the trade-off between memory usage and model power can be tuned by the hyper-parameters.We will show how such attention enables novel deep learning architectures with copying modules that are especially useful for conditional image generation tasks like pose morphing. Our contributions are (i) algorithm and code1of the novel GPA layer, (ii) a novel deep attention-copying architecture, and (iii) new state-of-the art experimental results in human pose morphing generation benchmarks.
△ Less
Submitted 8 July, 2021;
originally announced July 2021.
-
An LSTM-Based Dynamic Customer Model for Fashion Recommendation
Authors:
Sebastian Heinz,
Christian Bracher,
Roland Vollgraf
Abstract:
Online fashion sales present a challenging use case for personalized recommendation: Stores offer a huge variety of items in multiple sizes. Small stocks, high return rates, seasonality, and changing trends cause continuous turnover of articles for sale on all time scales. Customers tend to shop rarely, but often buy multiple items at once. We report on backtest experiments with sales data of 100k…
▽ More
Online fashion sales present a challenging use case for personalized recommendation: Stores offer a huge variety of items in multiple sizes. Small stocks, high return rates, seasonality, and changing trends cause continuous turnover of articles for sale on all time scales. Customers tend to shop rarely, but often buy multiple items at once. We report on backtest experiments with sales data of 100k frequent shoppers at Zalando, Europe's leading online fashion platform. To model changing customer and store environments, our recommendation method employs a pair of neural networks: To overcome the cold start problem, a feedforward network generates article embeddings in "fashion space," which serve as input to a recurrent neural network that predicts a style vector in this space for each client, based on their past purchase sequence. We compare our results with a static collaborative filtering approach, and a popularity ranking baseline.
△ Less
Submitted 24 August, 2017;
originally announced August 2017.
-
Fashion DNA: Merging Content and Sales Data for Recommendation and Article Map**
Authors:
Christian Bracher,
Sebastian Heinz,
Roland Vollgraf
Abstract:
We present a method to determine Fashion DNA, coordinate vectors locating fashion items in an abstract space. Our approach is based on a deep neural network architecture that ingests curated article information such as tags and images, and is trained to predict sales for a large set of frequent customers. In the process, a dual space of customer style preferences naturally arises. Interpretation o…
▽ More
We present a method to determine Fashion DNA, coordinate vectors locating fashion items in an abstract space. Our approach is based on a deep neural network architecture that ingests curated article information such as tags and images, and is trained to predict sales for a large set of frequent customers. In the process, a dual space of customer style preferences naturally arises. Interpretation of the metric of these spaces is straightforward: The product of Fashion DNA and customer style vectors yields the forecast purchase likelihood for the customer-item pair, while the angle between Fashion DNA vectors is a measure of item similarity. Importantly, our models are able to generate unbiased purchase probabilities for fashion items based solely on article information, even in absence of sales data, thus circumventing the "cold-start problem" of collaborative recommendation approaches. Likewise, it generalizes easily and reliably to customers outside the training set. We experiment with Fashion DNA models based on visual and/or tag item data, evaluate their recommendation power, and discuss the resulting article similarities.
△ Less
Submitted 8 September, 2016;
originally announced September 2016.
-
Propagation of charged particle waves in a uniform magnetic field
Authors:
Christian Bracher,
Arnulfo Gonzalez
Abstract:
This paper considers the probability density and current distributions generated by a point-like, isotropic source of monoenergetic charges embedded into a uniform magnetic field environment. Electron sources of this kind have been realized in recent photodetachment microscopy experiments. Unlike the total photocurrent cross section, which is largely understood, the spatial profiles of charge and…
▽ More
This paper considers the probability density and current distributions generated by a point-like, isotropic source of monoenergetic charges embedded into a uniform magnetic field environment. Electron sources of this kind have been realized in recent photodetachment microscopy experiments. Unlike the total photocurrent cross section, which is largely understood, the spatial profiles of charge and current emitted by the source display an unexpected hierarchy of complex patterns, even though the distributions, apart from scaling, depend only on a single physical parameter. We examine the electron dynamics both by solving the quantum problem, i. e., finding the energy Green function, and from a semiclassical perspective based on the simple cyclotron orbits followed by the electron. Simulations suggest that the semiclassical method, which involves here interference between an infinite set of paths, faithfully reproduces the features observed in the quantum solution, even in extreme circumstances, and lends itself to an interpretation of some (though not all) of the rich structure exhibited in this simple problem.
△ Less
Submitted 28 June, 2012;
originally announced June 2012.
-
New Mathematical Tools for Quantum Technology
Authors:
Christian Bracher,
Manfred Kleber,
Tobias Kramer
Abstract:
Progress in manufacturing technology has allowed us to probe the behavior of devices on a smaller and faster scale than ever before. With increasing miniaturization, quantum effects come to dominate the transport properties of these devices, between collisions, carriers undergo ballistic motion under the influence of local electric and magnetic fields. The often surprising propertiesof quantum b…
▽ More
Progress in manufacturing technology has allowed us to probe the behavior of devices on a smaller and faster scale than ever before. With increasing miniaturization, quantum effects come to dominate the transport properties of these devices, between collisions, carriers undergo ballistic motion under the influence of local electric and magnetic fields. The often surprising propertiesof quantum ballistic transport are currently elucidated in clean atomic physics experiments. From a theoretical viewpoint, theelectron dynamics is governed by ballistic propagators and Green functions, intriguing quantities at the crossroads of classical and quantum mechanics. Here, we briefly describe the propagator method, some ballistic Green functions, and their application in a diverse range of problems in atomic and solid state physics, such as photodetachment, atom lasers, scanning tunneling microscopy, and the quantum Hall effect.
△ Less
Submitted 1 March, 2007;
originally announced March 2007.
-
The photoelectric effect in external fields
Authors:
Christian Bracher,
John B. Delos,
Vassiliki Kanellopoulos,
Manfred Kleber,
Tobias Kramer
Abstract:
Atoms and negative ions interacting with laser photons yield a coherent source of photoelectrons. Applying external fields to photoelectrons gives rise to interesting and valuable interference phenomena. We analyze the spatial distribution of the photocurrent using elementary quantum methods. The photoelectric effect is shown to be an interesting example for the use of coherent particle sources…
▽ More
Atoms and negative ions interacting with laser photons yield a coherent source of photoelectrons. Applying external fields to photoelectrons gives rise to interesting and valuable interference phenomena. We analyze the spatial distribution of the photocurrent using elementary quantum methods. The photoelectric effect is shown to be an interesting example for the use of coherent particle sources in quantum mechanics.
△ Less
Submitted 21 January, 2006;
originally announced January 2006.
-
Electron dynamics in parallel electric and magnetic fields
Authors:
Christian Bracher,
Tobias Kramer,
John B. Delos
Abstract:
We examine the spatial distribution of electrons generated by a fixed energy point source in uniform, parallel electric and magnetic fields. This problem is simple enough to permit analytic quantum and semiclassical solution, and it harbors a rich set of features which find their interpretation in the unusual and interesting properties of the classical motion of the electrons: For instance, the…
▽ More
We examine the spatial distribution of electrons generated by a fixed energy point source in uniform, parallel electric and magnetic fields. This problem is simple enough to permit analytic quantum and semiclassical solution, and it harbors a rich set of features which find their interpretation in the unusual and interesting properties of the classical motion of the electrons: For instance, the number of interfering trajectories can be adjusted in this system, and the turning surfaces of classical motion contain a complex array of singularities. We perform a comprehensive analysis of both the semiclassical approximation and the quantum solution, and we make predictions that should serve as a guide for future photodetachment experiments.
△ Less
Submitted 13 October, 2005;
originally announced October 2005.
-
Propagation in crossed electric and magnetic fields: The quantum source approach
Authors:
Tobias Kramer,
Christian Bracher
Abstract:
The propagation of electrons in static and uniform electromagnetic fields is a standard topic of classical electrodynamics. The Hamilton function is given by a quadratic polynomial in the positions and momenta. The corresponding quantum-mechanical problem has been analyzed in great detail and the eigenfunctions and time evolution operators are well-known. Surprisingly, the energy-dependent count…
▽ More
The propagation of electrons in static and uniform electromagnetic fields is a standard topic of classical electrodynamics. The Hamilton function is given by a quadratic polynomial in the positions and momenta. The corresponding quantum-mechanical problem has been analyzed in great detail and the eigenfunctions and time evolution operators are well-known. Surprisingly, the energy-dependent counterpart of the time-evolution operator, the Green function, is not easily accessible. However in many situations one is interested in the evolution of a system that started with emitted particles that carry a specific energy. In the following we present a suitable approach to study this type of matter waves arising from a localized region in space. Two applications are discussed, the photodetachment current in external fields and the quantum Hall effect in a fermionic electron gas.
△ Less
Submitted 18 September, 2003;
originally announced September 2003.
-
Electron propagation in crossed magnetic and electric fields
Authors:
Tobias Kramer,
Christian Bracher,
Manfred Kleber
Abstract:
Laser-atom interaction can be an efficient mechanism for the production of coherent electrons. We analyze the dynamics of monoenergetic electrons in the presence of uniform, perpendicular magnetic and electric fields. The Green function technique is used to derive analytic results for the field--induced quantum mechanical drift motion of i) single electrons and ii) a dilute Fermi gas of electron…
▽ More
Laser-atom interaction can be an efficient mechanism for the production of coherent electrons. We analyze the dynamics of monoenergetic electrons in the presence of uniform, perpendicular magnetic and electric fields. The Green function technique is used to derive analytic results for the field--induced quantum mechanical drift motion of i) single electrons and ii) a dilute Fermi gas of electrons. The method yields the drift current and, at the same time it allows us to quantitatively establish the broadening of the (magnetic) Landau levels due to the electric field: Level number k is split into k+1 sublevels that render the $k$th oscillator eigenstate in energy space. Adjacent Landau levels will overlap if the electric field exceeds a critical strength. Our observations are relevant for quantum Hall configurations whenever electric field effects should be taken into account.
△ Less
Submitted 30 July, 2003;
originally announced July 2003.
-
Observed photodetachment in parallel electric and magnetic fields
Authors:
John N. Yukich,
Tobias Kramer,
Christian Bracher
Abstract:
We investigate photodetachment from negative ions in a homogeneous 1.0-T magnetic field and a parallel electric field of approximately 10 V/cm. A theoretical model for detachment in combined fields is presented. Calculations show that a field of 10 V/cm or more should considerably diminish the Landau structure in the detachment cross section. The ions are produced and stored in a Penning ion tra…
▽ More
We investigate photodetachment from negative ions in a homogeneous 1.0-T magnetic field and a parallel electric field of approximately 10 V/cm. A theoretical model for detachment in combined fields is presented. Calculations show that a field of 10 V/cm or more should considerably diminish the Landau structure in the detachment cross section. The ions are produced and stored in a Penning ion trap and illuminated by a single-mode dye laser. We present preliminary results for detachment from S- showing qualitative agreement with the model. Future directions of the work are also discussed.
△ Less
Submitted 14 October, 2003; v1 submitted 10 April, 2003;
originally announced April 2003.
-
Eigenfunction approach to the persistent random walk in two dimensions
Authors:
Christian Bracher
Abstract:
The Fourier-Bessel expansion of a function on a circular disc yields a simple series representation for the end-to-end probability distribution function w(R,phi) encountered in a planar persistent random walk, where the direction taken in a step depends on the relative orientation towards the preceding step. For all but the shortest walks, the proposed method provides a rapidly converging, numer…
▽ More
The Fourier-Bessel expansion of a function on a circular disc yields a simple series representation for the end-to-end probability distribution function w(R,phi) encountered in a planar persistent random walk, where the direction taken in a step depends on the relative orientation towards the preceding step. For all but the shortest walks, the proposed method provides a rapidly converging, numerically stable algorithm that is particularly useful for the precise study of intermediate-size chains that have not yet approached the diffusion limit. As a practical application, we examine the force-extension diagram of various planar polymer chains. With increasing joint stiffness, a marked transition from rubber-like behaviour to a form of elastic response resembling that of a flexible rod is observed.
△ Less
Submitted 10 April, 2003;
originally announced April 2003.
-
Ballistic matter waves with angular momentum: Exact solutions and applications
Authors:
Christian Bracher,
Tobias Kramer,
Manfred Kleber
Abstract:
An alternative description of quantum scattering processes rests on inhomogeneous terms amended to the Schroedinger equation. We detail the structure of sources that give rise to multipole scattering waves of definite angular momentum, and introduce pointlike multipole sources as their limiting case. Partial wave theory is recovered for freely propagating particles. We obtain novel results for b…
▽ More
An alternative description of quantum scattering processes rests on inhomogeneous terms amended to the Schroedinger equation. We detail the structure of sources that give rise to multipole scattering waves of definite angular momentum, and introduce pointlike multipole sources as their limiting case. Partial wave theory is recovered for freely propagating particles. We obtain novel results for ballistic scattering in an external uniform force field, where we provide analytical solutions for both the scattering waves and the integrated particle flux. Our theory directly applies to p-wave photodetachment in an electric field. Furthermore, illustrating the effects of extended sources, we predict some properties of vortex-bearing atom laser beams outcoupled from a rotating Bose-Einstein condensate under the influence of gravity.
△ Less
Submitted 28 August, 2002; v1 submitted 18 July, 2002;
originally announced July 2002.
-
Matter waves from quantum sources in a force field
Authors:
Tobias Kramer,
Christian Bracher,
Manfred Kleber
Abstract:
Localized scattering phenomena may result in the formation of stationary matter waves originating from a compact region in physical space. Mathematically, such waves are advantageously expressed in terms of quantum sources that are introduced into the Schrödinger equation. The source formalism yields direct access to the scattering wave function, particle distribution, and total current. As an e…
▽ More
Localized scattering phenomena may result in the formation of stationary matter waves originating from a compact region in physical space. Mathematically, such waves are advantageously expressed in terms of quantum sources that are introduced into the Schrödinger equation. The source formalism yields direct access to the scattering wave function, particle distribution, and total current. As an example, we study emission from three-dimensional Gaussian sources into a homogeneous force field. This model describes the behaviour of an atom laser supplied by an ideal Bose-Einstein condensate under the influence of gravity. We predict a strong dependence of the beam profile on the condensate size and the presence of interference phenomena recently observed in photodetachment experiments.
△ Less
Submitted 19 December, 2001; v1 submitted 26 October, 2001;
originally announced October 2001.
-
Four-path interference and uncertainty principle in photodetachment microscopy
Authors:
Tobias Kramer,
Christian Bracher,
Manfred Kleber
Abstract:
We study the quantal motion of electrons emitted by a pointlike monochromatic isotropic source into parallel uniform electric and magnetic fields. The two-path interference pattern in the emerging electron wave due to the electric force is modified by the magnetic lens effect which periodically focuses the beam into narrow filaments along the symmetry axis. There, four classical paths interfere.…
▽ More
We study the quantal motion of electrons emitted by a pointlike monochromatic isotropic source into parallel uniform electric and magnetic fields. The two-path interference pattern in the emerging electron wave due to the electric force is modified by the magnetic lens effect which periodically focuses the beam into narrow filaments along the symmetry axis. There, four classical paths interfere. With increasing electron energy, the current distribution changes from a quantum regime governed by the uncertainty principle, to an intricate spatial pattern that yields to a semiclassical analysis.
△ Less
Submitted 12 June, 2001;
originally announced June 2001.