-
Towards Generalized On-Chip Communication for Programmable Accelerators in Heterogeneous Architectures
Authors:
Joseph Zuckerman,
John-David Wellman,
Ajay Vanamali,
Manish Shankar,
Gabriele Tombesi,
Karthik Swaminathan,
Kevin Lee,
Mohit Kapur,
Robert Philhower,
Pradip Bose,
Luca P. Carloni
Abstract:
We present several enhancements to the open-source ESP platform to support flexible and efficient on-chip communication for programmable accelerators in heterogeneous SoCs. These enhancements include 1) a flexible point-to-point communication mechanism between accelerators, 2) a multicast NoC that supports data forwarding to multiple accelerators simultaneously, 3) accelerator synchronization leve…
▽ More
We present several enhancements to the open-source ESP platform to support flexible and efficient on-chip communication for programmable accelerators in heterogeneous SoCs. These enhancements include 1) a flexible point-to-point communication mechanism between accelerators, 2) a multicast NoC that supports data forwarding to multiple accelerators simultaneously, 3) accelerator synchronization leveraging the SoC's coherence protocol, 4) an accelerator interface that offers fine-grained control over the communication mode used, and 5) an example ISA extension to support our enhancements. Our solution adds negligible area to the SoC architecture and requires minimal changes to the accelerators themselves. We have validated most of these features in complex FPGA prototypes and plan to include them in the open-source release of ESP in the coming months.
△ Less
Submitted 4 July, 2024;
originally announced July 2024.
-
Virtual histological staining of unlabeled autopsy tissue
Authors:
Yuzhu Li,
Nir Pillar,
**gxi Li,
Tairan Liu,
Di Wu,
Songyu Sun,
Guangdong Ma,
Kevin de Haan,
Luzhe Huang,
Sepehr Hamidi,
Anatoly Urisman,
Tal Keidar Haran,
William Dean Wallace,
Jonathan E. Zuckerman,
Aydogan Ozcan
Abstract:
Histological examination is a crucial step in an autopsy; however, the traditional histochemical staining of post-mortem samples faces multiple challenges, including the inferior staining quality due to autolysis caused by delayed fixation of cadaver tissue, as well as the resource-intensive nature of chemical staining procedures covering large tissue areas, which demand substantial labor, cost, a…
▽ More
Histological examination is a crucial step in an autopsy; however, the traditional histochemical staining of post-mortem samples faces multiple challenges, including the inferior staining quality due to autolysis caused by delayed fixation of cadaver tissue, as well as the resource-intensive nature of chemical staining procedures covering large tissue areas, which demand substantial labor, cost, and time. These challenges can become more pronounced during global health crises when the availability of histopathology services is limited, resulting in further delays in tissue fixation and more severe staining artifacts. Here, we report the first demonstration of virtual staining of autopsy tissue and show that a trained neural network can rapidly transform autofluorescence images of label-free autopsy tissue sections into brightfield equivalent images that match hematoxylin and eosin (H&E) stained versions of the same samples, eliminating autolysis-induced severe staining artifacts inherent in traditional histochemical staining of autopsied tissue. Our virtual H&E model was trained using >0.7 TB of image data and a data-efficient collaboration scheme that integrates the virtual staining network with an image registration network. The trained model effectively accentuated nuclear, cytoplasmic and extracellular features in new autopsy tissue samples that experienced severe autolysis, such as COVID-19 samples never seen before, where the traditional histochemical staining failed to provide consistent staining quality. This virtual autopsy staining technique can also be extended to necrotic tissue, and can rapidly and cost-effectively generate artifact-free H&E stains despite severe autolysis and cell death, also reducing labor, cost and infrastructure requirements associated with the standard histochemical staining.
△ Less
Submitted 1 August, 2023;
originally announced August 2023.
-
Enabling Heterogeneous, Multicore SoC Research with RISC-V and ESP
Authors:
Joseph Zuckerman,
Paolo Mantovani,
Davide Giri,
Luca P. Carloni
Abstract:
Heterogeneous, multicore SoC architectures are a critical component of today's computing landscape. However, supporting both increasing heterogeneity and multicore execution are significant design challenges. Meanwhile, the growing RISC-V and open-source hardware (OSH) movements have resulted in an increased number of open-source RISC-V processor implementations; however, there are fewer open sour…
▽ More
Heterogeneous, multicore SoC architectures are a critical component of today's computing landscape. However, supporting both increasing heterogeneity and multicore execution are significant design challenges. Meanwhile, the growing RISC-V and open-source hardware (OSH) movements have resulted in an increased number of open-source RISC-V processor implementations; however, there are fewer open source SoC design platforms that integrate these processor cores. We present modifications to ESP, an open-source SoC design platform, to enable multicore execution with the RISC-V CVA6 processor. Our implementation is modular and based on standardized interfaces. These properties simplify the integration of new cores. Our modifications enable RISC-V-based SoCs designed with ESP for FPGA to boot Linux SMP and execute multithreaded applications. Coupled with ESP's emphasis on accelerator-centric architectures, our contributions enable the seamless design of a wide range of heterogeneous, multicore SoCs.
△ Less
Submitted 4 June, 2022;
originally announced June 2022.
-
Cohmeleon: Learning-Based Orchestration of Accelerator Coherence in Heterogeneous SoCs
Authors:
Joseph Zuckerman,
Davide Giri,
Jihye Kwon,
Paolo Mantovani,
Luca P. Carloni
Abstract:
One of the most critical aspects of integrating loosely-coupled accelerators in heterogeneous SoC architectures is orchestrating their interactions with the memory hierarchy, especially in terms of navigating the various cache-coherence options: from accelerators accessing off-chip memory directly, bypassing the cache hierarchy, to accelerators having their own private cache. By running real-size…
▽ More
One of the most critical aspects of integrating loosely-coupled accelerators in heterogeneous SoC architectures is orchestrating their interactions with the memory hierarchy, especially in terms of navigating the various cache-coherence options: from accelerators accessing off-chip memory directly, bypassing the cache hierarchy, to accelerators having their own private cache. By running real-size applications on FPGA-based prototypes of many-accelerator multi-core SoCs, we show that the best cache-coherence mode for a given accelerator varies at runtime, depending on the accelerator's characteristics, the workload size, and the overall SoC status.
Cohmeleon applies reinforcement learning to select the best coherence mode for each accelerator dynamically at runtime, as opposed to statically at design time. It makes these selections adaptively, by continuously observing the system and measuring its performance. Cohmeleon is accelerator-agnostic, architecture-independent, and it requires minimal hardware support. Cohmeleon is also transparent to application programmers and has a negligible software overhead. FPGA-based experiments show that our runtime approach offers, on average, a 38% speedup with a 66% reduction of off-chip memory accesses compared to state-of-the-art design-time approaches. Moreover, it can match runtime solutions that are manually tuned for the target architecture.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
Agile SoC Development with Open ESP
Authors:
Paolo Mantovani,
Davide Giri,
Giuseppe Di Guglielmo,
Luca Piccolboni,
Joseph Zuckerman,
Emilio G. Cota,
Michele Petracca,
Christian Pilato,
Luca P. Carloni
Abstract:
ESP is an open-source research platform for heterogeneous SoC design. The platform combines a modular tile-based architecture with a variety of application-oriented flows for the design and optimization of accelerators. The ESP architecture is highly scalable and strikes a balance between regularity and specialization. The companion methodology raises the level of abstraction to system-level desig…
▽ More
ESP is an open-source research platform for heterogeneous SoC design. The platform combines a modular tile-based architecture with a variety of application-oriented flows for the design and optimization of accelerators. The ESP architecture is highly scalable and strikes a balance between regularity and specialization. The companion methodology raises the level of abstraction to system-level design and enables an automated flow from software and hardware development to full-system prototy** on FPGA. For application developers, ESP offers domain-specific automated solutions to synthesize new accelerators for their software and to map complex workloads onto the SoC architecture. For hardware engineers, ESP offers automated solutions to integrate their accelerator designs into the complete SoC. Conceived as a heterogeneous integration platform and tested through years of teaching at Columbia University, ESP supports the open-source hardware community by providing a flexible platform for agile SoC development.
△ Less
Submitted 2 September, 2020;
originally announced September 2020.
-
Deep learning-based transformation of the H&E stain into special stains
Authors:
Kevin de Haan,
Yijie Zhang,
Jonathan E. Zuckerman,
Tairan Liu,
Anthony E. Sisk,
Miguel F. P. Diaz,
Kuang-Yu Jen,
Alexander Nobori,
Sofia Liou,
Sarah Zhang,
Rana Riahi,
Yair Rivenson,
W. Dean Wallace,
Aydogan Ozcan
Abstract:
Pathology is practiced by visual inspection of histochemically stained slides. Most commonly, the hematoxylin and eosin (H&E) stain is used in the diagnostic workflow and it is the gold standard for cancer diagnosis. However, in many cases, especially for non-neoplastic diseases, additional "special stains" are used to provide different levels of contrast and color to tissue components and allow p…
▽ More
Pathology is practiced by visual inspection of histochemically stained slides. Most commonly, the hematoxylin and eosin (H&E) stain is used in the diagnostic workflow and it is the gold standard for cancer diagnosis. However, in many cases, especially for non-neoplastic diseases, additional "special stains" are used to provide different levels of contrast and color to tissue components and allow pathologists to get a clearer diagnostic picture. In this study, we demonstrate the utility of supervised learning-based computational stain transformation from H&E to different special stains (Masson's Trichrome, periodic acid-Schiff and Jones silver stain) using tissue sections from kidney needle core biopsies. Based on evaluation by three renal pathologists, followed by adjudication by a fourth renal pathologist, we show that the generation of virtual special stains from existing H&E images improves the diagnosis in several non-neoplastic kidney diseases sampled from 58 unique subjects. A second study performed by three pathologists found that the quality of the special stains generated by the stain transformation network was statistically equivalent to those generated through standard histochemical staining. As the transformation of H&E images into special stains can be achieved within 1 min or less per patient core specimen slide, this stain-to-stain transformation framework can improve the quality of the preliminary diagnosis when additional special stains are needed, along with significant savings in time and cost, reducing the burden on healthcare system and patients.
△ Less
Submitted 12 August, 2021; v1 submitted 20 August, 2020;
originally announced August 2020.
-
Mathematical Foundations of Consciousness
Authors:
Willard L. Miranker,
Gregg J. Zuckerman
Abstract:
We employ the Zermelo-Fraenkel Axioms that characterize sets as mathematical primitives. The Anti-foundation Axiom plays a significant role in our development, since among other of its features, its replacement for the Axiom of Foundation in the Zermelo-Fraenkel Axioms motivates Platonic interpretations. These interpretations also depend on such allied notions for sets as pictures, graphs, decor…
▽ More
We employ the Zermelo-Fraenkel Axioms that characterize sets as mathematical primitives. The Anti-foundation Axiom plays a significant role in our development, since among other of its features, its replacement for the Axiom of Foundation in the Zermelo-Fraenkel Axioms motivates Platonic interpretations. These interpretations also depend on such allied notions for sets as pictures, graphs, decorations, labelings and various map**s that we use. A syntax and semantics of operators acting on sets is developed. Such features enable construction of a theory of non-well-founded sets that we use to frame mathematical foundations of consciousness. To do this we introduce a supplementary axiomatic system that characterizes experience and consciousness as primitives. The new axioms proceed through characterization of so- called consciousness operators. The Russell operator plays a central role and is shown to be one example of a consciousness operator. Neural networks supply striking examples of non-well-founded graphs the decorations of which generate associated sets, each with a Platonic aspect. Employing our foundations, we show how the supervening of consciousness on its neural correlates in the brain enables the framing of a theory of consciousness by applying appropriate consciousness operators to the generated sets in question.
△ Less
Submitted 23 October, 2008;
originally announced October 2008.
-
A generating function for Blattner's formula
Authors:
Jeb F. Willenbring,
Gregg J. Zuckerman
Abstract:
Let G be a connected, semisimple Lie group with finite center and let K be a maximal compact subgroup. We investigate a method to compute multiplicities of K-types in the discrete series using a rational expression for a generating function obtained from Blattner's formula. This expression involves a product with a character of an irreducible finite dimensional representation of K and is valid f…
▽ More
Let G be a connected, semisimple Lie group with finite center and let K be a maximal compact subgroup. We investigate a method to compute multiplicities of K-types in the discrete series using a rational expression for a generating function obtained from Blattner's formula. This expression involves a product with a character of an irreducible finite dimensional representation of K and is valid for any discrete series system. Other results include a new proof of a symmetry of Blattner's formula, and a positivity result for certain low rank examples. We consider in detail the situation for G of type split G_2. The motivation for this work came from an attempt to understand pictures coming from Blattner's formula, some of which we include in the paper.
△ Less
Submitted 17 December, 2006; v1 submitted 10 December, 2006;
originally announced December 2006.
-
Homotopy Gerstenhaber algebras and topological field theory
Authors:
Takashi Kimura,
Alexander A. Voronov,
Gregg J. Zuckerman
Abstract:
We prove that the BRST complex of a topological conformal field theory is a homotopy Gerstenhaber algebra, as conjectured by Lian and Zuckerman in 1992. We also suggest a refinement of the original conjecture for topological vertex operator algebras. We illustrate the usefulness of our main tools, operads and "string vertices" by obtaining new results on Vassiliev invariants of knots and double…
▽ More
We prove that the BRST complex of a topological conformal field theory is a homotopy Gerstenhaber algebra, as conjectured by Lian and Zuckerman in 1992. We also suggest a refinement of the original conjecture for topological vertex operator algebras. We illustrate the usefulness of our main tools, operads and "string vertices" by obtaining new results on Vassiliev invariants of knots and double loop spaces.
△ Less
Submitted 18 March, 1996; v1 submitted 2 February, 1996;
originally announced February 1996.
-
From String Backgrounds to Topological Field Theories
Authors:
Bong H. Lian,
Gregg J. Zuckerman
Abstract:
The BRST formalism has played a fundamental role in the construction of bosonic closed string backgrounds, ie. the stringy analogs of classical solutions to the field equations of general relativity. The concept of a string background has been extended to the notion of $W$-strings, where the BRST symmetry is still largely conjectural. More recently, the BRST formalism has entered the constructio…
▽ More
The BRST formalism has played a fundamental role in the construction of bosonic closed string backgrounds, ie. the stringy analogs of classical solutions to the field equations of general relativity. The concept of a string background has been extended to the notion of $W$-strings, where the BRST symmetry is still largely conjectural. More recently, the BRST formalism has entered the construction of two dimensional topological conformal quantum field theories, such as those that arise from Calabi-Yau varieties. In this lecture, we focus on common features of the BRST cohomology algebras of string backgrounds and topological field theories. In this context, we present some new evidence for a remarkable relationship that transports us from bosonic and $W$-string backgrounds to the B-model topological conformal field theories associated to certain noncompact Calabi-Yau varieties. This paper will appear in the proceedings of the {\it Symposium on BRS Symmetry} held at RIMS, September 18-22, 1995.
△ Less
Submitted 15 December, 1995; v1 submitted 6 December, 1995;
originally announced December 1995.
-
Algebraic and Geometric Structures in String Backgrounds
Authors:
Bong H. Lian,
Gregg J. Zuckerman
Abstract:
We give a brief introduction to the study of the algebraic structures -- and their geometrical interpretations -- which arise in the BRST construction of a conformal string background. Starting from the chiral algebra $\cA$ of a string background, we consider a number of elementary but universal operations on the chiral algebra. From these operations we deduce a certain fundamental odd Poisson s…
▽ More
We give a brief introduction to the study of the algebraic structures -- and their geometrical interpretations -- which arise in the BRST construction of a conformal string background. Starting from the chiral algebra $\cA$ of a string background, we consider a number of elementary but universal operations on the chiral algebra. From these operations we deduce a certain fundamental odd Poisson structure, known as a Gerstenhaber algebra, on the BRST cohomology of $\cA$. For the 2D string background, the correponding G-algebra can be partially described in term of a geometrical G-algebra of the affine plane $\bC^2$. This paper will appear in the proceedings of {\it Strings 95}.
△ Less
Submitted 30 June, 1995;
originally announced June 1995.
-
Moonshine Cohomology
Authors:
Bong H. Lian,
Gregg J. Zuckerman
Abstract:
We construct a new cohomology functor from the a certain category of {\it quantum operator algebras} to the category of {\it Batalin-Vilkovisky algebras}. This {\it Moonshine cohomology} has, as a group of natural automorphisms, the Fischer-Griess Monster finite group. We prove a general vanishing theorem for this cohomology. For a certain commutative QOA attached to a rank two hyperbolic lattic…
▽ More
We construct a new cohomology functor from the a certain category of {\it quantum operator algebras} to the category of {\it Batalin-Vilkovisky algebras}. This {\it Moonshine cohomology} has, as a group of natural automorphisms, the Fischer-Griess Monster finite group. We prove a general vanishing theorem for this cohomology. For a certain commutative QOA attached to a rank two hyperbolic lattice, we show that the degree one cohomology is isomorphic to the so-called Lie algebra of physical states. In the case of a rank two unimodular lattice, the degree one cohomology gives a new construction of Borcherd's Monster Lie algebra. As applications, we compute the graded dimensions and signatures of this cohomology as a hermitean Lie algebra graded by a hyperbolic lattice. In the first half of this paper, we give as preparations an exposition of the theory of quantum operator algebras. Some of the results here were announced in lectures given by the first author at the Research Institute for Mathematical Sciences in Kyoto in September 94.
△ Less
Submitted 13 January, 1995;
originally announced January 1995.
-
Commutative Quantum Operator Algebras
Authors:
Bong H. Lian,
Gregg J. Zuckerman
Abstract:
A key notion bridging the gap between {\it quantum operator algebras} \cite{LZ10} and {\it vertex operator algebras} \cite{Bor}\cite{FLM} is the definition of the commutativity of a pair of quantum operators (see section 2 below). This is not commutativity in any ordinary sense, but it is clearly the correct generalization to the quantum context. The main purpose of the current paper is to begin…
▽ More
A key notion bridging the gap between {\it quantum operator algebras} \cite{LZ10} and {\it vertex operator algebras} \cite{Bor}\cite{FLM} is the definition of the commutativity of a pair of quantum operators (see section 2 below). This is not commutativity in any ordinary sense, but it is clearly the correct generalization to the quantum context. The main purpose of the current paper is to begin laying the foundations for a complete mathematical theory of {\it commutative quantum operator algebras.} We give proofs of most of the relevant results announced in \cite{LZ10}, and we carry out some calculations with sufficient detail to enable the interested reader to become proficient with the algebra of commuting quantum operators.
△ Less
Submitted 13 January, 1995;
originally announced January 1995.
-
Some Classical and Quantum Algebras
Authors:
Bong H. Lian,
Gregg J. Zuckerman
Abstract:
We discuss the notion of a Batalin-Vilkovisky (BV) algebra and give several classical examples from differential geometry and Lie theory. We introduce the notion of a quantum operator algebra (QOA) as a generalization of a classical operator algebra. In some examples, we view a QOA as a deformation of a commutative algebra. We then review the notion of a vertex operator algebra (VOA) and show th…
▽ More
We discuss the notion of a Batalin-Vilkovisky (BV) algebra and give several classical examples from differential geometry and Lie theory. We introduce the notion of a quantum operator algebra (QOA) as a generalization of a classical operator algebra. In some examples, we view a QOA as a deformation of a commutative algebra. We then review the notion of a vertex operator algebra (VOA) and show that a vertex operator algebra is a QOA with some additional structures. Finally, we establish a connection between BV algebras and VOAs.
△ Less
Submitted 11 May, 1994; v1 submitted 2 April, 1994;
originally announced April 1994.
-
New Perspectives on the BRST-algebraic Structure of String Theory
Authors:
Bong H. Lian,
Gregg J. Zuckerman
Abstract:
Motivated by the descent equation in string theory, we give a new interpretation for the action of the symmetry charges on the BRST cohomology in terms of what we call {\em the Gerstenhaber bracket}. This bracket is compatible with the graded commutative product in cohomology, and hence gives rise to a new class of examples of what mathematicians call a {\em Gerstenhaber algebra}. The latter str…
▽ More
Motivated by the descent equation in string theory, we give a new interpretation for the action of the symmetry charges on the BRST cohomology in terms of what we call {\em the Gerstenhaber bracket}. This bracket is compatible with the graded commutative product in cohomology, and hence gives rise to a new class of examples of what mathematicians call a {\em Gerstenhaber algebra}. The latter structure was first discussed in the context of Hochschild cohomology theory \cite{Gers1}. Off-shell in the (chiral) BRST complex, all the identities of a Gerstenhaber algebra hold up to homotopy. Applying our theory to the c=1 model, we give a precise conceptual description of the BRST-Gerstenhaber algebra of this model. We are led to a direct connection between the bracket structure here and the anti-bracket formalism in BV theory \cite{W2}. We then discuss the bracket in string backgrounds with both the left and the right movers. We suggest that the homotopy Lie algebra arising from our Gerstenhaber bracket is closely related to the HLA recently constructed by Witten-Zwiebach. Finally, we show that our constructions generalize to any topological conformal field theory.
△ Less
Submitted 16 November, 1992;
originally announced November 1992.