-
Computing High-Degree Polynomial Gradients in Memory
Authors:
T. Bhattacharya,
G. H. Hutchinson,
G. Pedretti,
X. Sheng,
J. Ignowski,
T. Van Vaerenbergh,
R. Beausoleil,
J. P. Strachan,
D. B. Strukov
Abstract:
Specialized function gradient computing hardware could greatly improve the performance of state-of-the-art optimization algorithms, e.g., based on gradient descent or conjugate gradient methods that are at the core of control, machine learning, and operations research applications. Prior work on such hardware, performed in the context of the Ising Machines and related concepts, is limited to quadr…
▽ More
Specialized function gradient computing hardware could greatly improve the performance of state-of-the-art optimization algorithms, e.g., based on gradient descent or conjugate gradient methods that are at the core of control, machine learning, and operations research applications. Prior work on such hardware, performed in the context of the Ising Machines and related concepts, is limited to quadratic polynomials and not scalable to commonly used higher-order functions. Here, we propose a novel approach for massively parallel gradient calculations of high-degree polynomials, which is conducive to efficient mixed-signal in-memory computing circuit implementations and whose area complexity scales linearly with the number of variables and terms in the function and, most importantly, independent of its degree. Two flavors of such an approach are proposed. The first is limited to binary-variable polynomials typical in combinatorial optimization problems, while the second type is broader at the cost of a more complex periphery. To validate the former approach, we experimentally demonstrated solving a small-scale third-order Boolean satisfiability problem based on integrated metal-oxide memristor crossbar circuits, one of the most prospective in-memory computing device technologies, with a competitive heuristics algorithm. Simulation results for larger-scale, more practical problems show orders of magnitude improvements in the area, and related advantages in speed and energy efficiency compared to the state-of-the-art. We discuss how our work could enable even higher-performance systems after co-designing algorithms to exploit massively parallel gradient computation.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
FPIA: Field-Programmable Ising Arrays with In-Memory Computing
Authors:
George Higgins Hutchinson,
Ethan Sifferman,
Tinish Bhattacharya,
Dmitri B. Strukov
Abstract:
Ising Machine is a promising computing approach for solving combinatorial optimization problems. It is naturally suited for energy-saving and compact in-memory computing implementations with emerging memories. A naïve in-memory computing implementation of a quadratic Ising Machine requires an array of coupling weights that grows quadratically with problem size. However, the resources in such an ap…
▽ More
Ising Machine is a promising computing approach for solving combinatorial optimization problems. It is naturally suited for energy-saving and compact in-memory computing implementations with emerging memories. A naïve in-memory computing implementation of a quadratic Ising Machine requires an array of coupling weights that grows quadratically with problem size. However, the resources in such an approach are used inefficiently due to sparsity in practical optimization problems. We first show that this issue can be addressed by partitioning a coupling array into smaller sub-arrays. This technique, however, requires interconnecting subarrays; hence, we developed in-memory computing architecture for quadratic Ising Machines inspired by island-type field programmable gate arrays, which is the main contribution of our paper. We adapt open-source tools to optimize problem embedding and model routing overhead. Modeling results of benchmark problems for the developed architecture show up to 60x area improvement and faster operation than the baseline approach. Finally, we discuss algorithm/circuit co-design techniques for further improvements.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
Memristor-based hardware and algorithms for higher-order Hopfield optimization solver outperforming quadratic Ising machines
Authors:
Mohammad Hizzani,
Arne Heittmann,
George Hutchinson,
Dmitrii Dobrynin,
Thomas Van Vaerenbergh,
Tinish Bhattacharya,
Adrien Renaudineau,
Dmitri Strukov,
John Paul Strachan
Abstract:
Ising solvers offer a promising physics-based approach to tackle the challenging class of combinatorial optimization problems. However, typical solvers operate in a quadratic energy space, having only pair-wise coupling elements which already dominate area and energy. We show that such quadratization can cause severe problems: increased dimensionality, a rugged search landscape, and misalignment w…
▽ More
Ising solvers offer a promising physics-based approach to tackle the challenging class of combinatorial optimization problems. However, typical solvers operate in a quadratic energy space, having only pair-wise coupling elements which already dominate area and energy. We show that such quadratization can cause severe problems: increased dimensionality, a rugged search landscape, and misalignment with the original objective function. Here, we design and quantify a higher-order Hopfield optimization solver, with 28nm CMOS technology and memristive couplings for lower area and energy computations. We combine algorithmic and circuit analysis to show quantitative advantages over quadratic Ising Machines (IM)s, yielding 48x and 72x reduction in time-to-solution (TTS) and energy-to-solution (ETS) respectively for Boolean satisfiability problems of 150 variables, with favorable scaling.
△ Less
Submitted 2 November, 2023;
originally announced November 2023.
-
A Model for an Irreversible Bias Current in the Superconducting Qubit Measurement Process
Authors:
G. D. Hutchinson,
C. A. Holmes,
T. M. Stace,
T. P. Spiller,
G. J. Milburn,
S. D. Barrett,
D. G. Hasko,
D. A. Williams
Abstract:
The superconducting charge-phase `Quantronium' qubit is considered in order to develop a model for the measurement process used in the experiment of Vion et. al. [Science 296 886 (2002)]. For this model we propose a method for including the bias current in the read-out process in a fundamentally irreversible way, which to first order, is approximated by the Josephson junction tilted-washboard po…
▽ More
The superconducting charge-phase `Quantronium' qubit is considered in order to develop a model for the measurement process used in the experiment of Vion et. al. [Science 296 886 (2002)]. For this model we propose a method for including the bias current in the read-out process in a fundamentally irreversible way, which to first order, is approximated by the Josephson junction tilted-washboard potential phenomenology. The decohering bias current is introduced in the form of a Lindblad operator and the Wigner function for the current biased read-out Josephson junction is derived and analyzed. During the read-out current pulse used in the Quantronium experiment we find that the coherence of the qubit initially prepared in a symmetric superposition state is lost at a time of 0.2 nanoseconds after the bias current pulse has been applied. A timescale which is much shorter than the experimental readout time. Additionally we look at the effect of Johnson-Nyquist noise with zero mean from the current source during the qubit manipulation and show that the decoherence due to the irreversible bias current description is an order of magnitude smaller than that found through adding noise to the reversible tilted washboard potential model. Our irreversible bias current model is also applicable to the persistent current based qubits where the state is measured according to its flux via a small inductance direct current superconducting quantum interference device (DC-SQUID).
△ Less
Submitted 10 October, 2006;
originally announced October 2006.
-
Nonlinear quantum optical computing via measurement
Authors:
G. D. Hutchinson,
G. J. Milburn
Abstract:
We show how the measurement induced model of quantum computation proposed by Raussendorf and Briegel [Phys. Rev. Letts. 86, 5188 (2001)] can be adapted to a nonlinear optical interaction. This optical implementation requires a Kerr nonlinearity, a single photon source, a single photon detector and fast feed forward. Although nondeterministic optical quantum information proposals such as that sug…
▽ More
We show how the measurement induced model of quantum computation proposed by Raussendorf and Briegel [Phys. Rev. Letts. 86, 5188 (2001)] can be adapted to a nonlinear optical interaction. This optical implementation requires a Kerr nonlinearity, a single photon source, a single photon detector and fast feed forward. Although nondeterministic optical quantum information proposals such as that suggested by KLM [Nature 409, 46 (2001)] do not require a Kerr nonlinearity they do require complex reconfigurable optical networks. The proposal in this paper has the benefit of a single static optical layout with fixed device parameters, where the algorithm is defined by the final measurement procedure.
△ Less
Submitted 28 September, 2004;
originally announced September 2004.
