-
Molecular Diffusion Models with Virtual Receptors
Authors:
Matan Halfon,
Eyal Rozenberg,
Ehud Rivlin,
Daniel Freedman
Abstract:
Machine learning approaches to Structure-Based Drug Design (SBDD) have proven quite fertile over the last few years. In particular, diffusion-based approaches to SBDD have shown great promise. We present a technique which expands on this diffusion approach in two crucial ways. First, we address the size disparity between the drug molecule and the target/receptor, which makes learning more challeng…
▽ More
Machine learning approaches to Structure-Based Drug Design (SBDD) have proven quite fertile over the last few years. In particular, diffusion-based approaches to SBDD have shown great promise. We present a technique which expands on this diffusion approach in two crucial ways. First, we address the size disparity between the drug molecule and the target/receptor, which makes learning more challenging and inference slower. We do so through the notion of a Virtual Receptor, which is a compressed version of the receptor; it is learned so as to preserve key aspects of the structural information of the original receptor, while respecting the relevant group equivariance. Second, we incorporate a protein language embedding used originally in the context of protein folding. We experimentally demonstrate the contributions of both the virtual receptors and the protein embeddings: in practice, they lead to both better performance, as well as significantly faster computations.
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
A Theoretical Framework for an Efficient Normalizing Flow-Based Solution to the Schrodinger Equation
Authors:
Daniel Freedman,
Eyal Rozenberg,
Alex Bronstein
Abstract:
A central problem in quantum mechanics involves solving the Electronic Schrodinger Equation for a molecule or material. The Variational Monte Carlo approach to this problem approximates a particular variational objective via sampling, and then optimizes this approximated objective over a chosen parameterized family of wavefunctions, known as the ansatz. Recently neural networks have been used as t…
▽ More
A central problem in quantum mechanics involves solving the Electronic Schrodinger Equation for a molecule or material. The Variational Monte Carlo approach to this problem approximates a particular variational objective via sampling, and then optimizes this approximated objective over a chosen parameterized family of wavefunctions, known as the ansatz. Recently neural networks have been used as the ansatz, with accompanying success. However, sampling from such wavefunctions has required the use of a Markov Chain Monte Carlo approach, which is inherently inefficient. In this work, we propose a solution to this problem via an ansatz which is cheap to sample from, yet satisfies the requisite quantum mechanical properties. We prove that a normalizing flow using the following two essential ingredients satisfies our requirements: (a) a base distribution which is constructed from Determinantal Point Processes; (b) flow layers which are equivariant to a particular subgroup of the permutation group. We then show how to construct both continuous and discrete normalizing flows which satisfy the requisite equivariance. We further demonstrate the manner in which the non-smooth nature ("cusps") of the wavefunction may be captured, and how the framework may be generalized to provide induction across multiple molecules. The resulting theoretical framework entails an efficient approach to solving the Electronic Schrodinger Equation.
△ Less
Submitted 28 May, 2024;
originally announced June 2024.
-
Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Models
Authors:
Regev Cohen,
Idan Kligvasser,
Ehud Rivlin,
Daniel Freedman
Abstract:
The pursuit of high perceptual quality in image restoration has driven the development of revolutionary generative models, capable of producing results often visually indistinguishable from real data. However, as their perceptual quality continues to improve, these models also exhibit a growing tendency to generate hallucinations - realistic-looking details that do not exist in the ground truth im…
▽ More
The pursuit of high perceptual quality in image restoration has driven the development of revolutionary generative models, capable of producing results often visually indistinguishable from real data. However, as their perceptual quality continues to improve, these models also exhibit a growing tendency to generate hallucinations - realistic-looking details that do not exist in the ground truth images. The presence of hallucinations introduces uncertainty regarding the reliability of the models' predictions, raising major concerns about their practical application. In this paper, we employ information-theory tools to investigate this phenomenon, revealing a fundamental tradeoff between uncertainty and perception. We rigorously analyze the relationship between these two factors, proving that the global minimal uncertainty in generative models grows in tandem with perception. In particular, we define the inherent uncertainty of the restoration problem and show that attaining perfect perceptual quality entails at least twice this uncertainty. Additionally, we establish a relation between mean squared-error distortion, uncertainty and perception, through which we prove the aforementioned uncertainly-perception tradeoff induces the well-known perception-distortion tradeoff. This work uncovers fundamental limitations of generative models in achieving both high perceptual quality and reliable predictions for image restoration. We demonstrate our theoretical findings through an analysis of single image super-resolution algorithms. Our work aims to raise awareness among practitioners about this inherent tradeoff, empowering them to make informed decisions and potentially prioritize safety over perceptual performance.
△ Less
Submitted 4 June, 2024; v1 submitted 26 May, 2024;
originally announced May 2024.
-
On the Semantic Latent Space of Diffusion-Based Text-to-Speech Models
Authors:
Miri Varshavsky-Hassid,
Roy Hirsch,
Regev Cohen,
Tomer Golany,
Daniel Freedman,
Ehud Rivlin
Abstract:
The incorporation of Denoising Diffusion Models (DDMs) in the Text-to-Speech (TTS) domain is rising, providing great value in synthesizing high quality speech. Although they exhibit impressive audio quality, the extent of their semantic capabilities is unknown, and controlling their synthesized speech's vocal properties remains a challenge. Inspired by recent advances in image synthesis, we explor…
▽ More
The incorporation of Denoising Diffusion Models (DDMs) in the Text-to-Speech (TTS) domain is rising, providing great value in synthesizing high quality speech. Although they exhibit impressive audio quality, the extent of their semantic capabilities is unknown, and controlling their synthesized speech's vocal properties remains a challenge. Inspired by recent advances in image synthesis, we explore the latent space of frozen TTS models, which is composed of the latent bottleneck activations of the DDM's denoiser. We identify that this space contains rich semantic information, and outline several novel methods for finding semantic directions within it, both supervised and unsupervised. We then demonstrate how these enable off-the-shelf audio editing, without any further training, architectural changes or data requirements. We present evidence of the semantic and acoustic qualities of the edited audio, and provide supplemental samples: https://latent-analysis-grad-tts.github.io/speech-samples/.
△ Less
Submitted 4 June, 2024; v1 submitted 19 February, 2024;
originally announced February 2024.
-
Overcoming Order in Autoregressive Graph Generation
Authors:
Edo Cohen-Karlik,
Eyal Rozenberg,
Daniel Freedman
Abstract:
Graph generation is a fundamental problem in various domains, including chemistry and social networks. Recent work has shown that molecular graph generation using recurrent neural networks (RNNs) is advantageous compared to traditional generative approaches which require converting continuous latent representations into graphs. One issue which arises when treating graph generation as sequential ge…
▽ More
Graph generation is a fundamental problem in various domains, including chemistry and social networks. Recent work has shown that molecular graph generation using recurrent neural networks (RNNs) is advantageous compared to traditional generative approaches which require converting continuous latent representations into graphs. One issue which arises when treating graph generation as sequential generation is the arbitrary order of the sequence which results from a particular choice of graph flattening method. In this work we propose using RNNs, taking into account the non-sequential nature of graphs by adding an Orderless Regularization (OLR) term that encourages the hidden state of the recurrent model to be invariant to different valid orderings present under the training distribution. We demonstrate that sequential graph generation models benefit from our proposed regularization scheme, especially when data is scarce. Our findings contribute to the growing body of research on graph generation and provide a valuable tool for various applications requiring the synthesis of realistic and diverse graph structures.
△ Less
Submitted 4 February, 2024;
originally announced February 2024.
-
Early Time Classification with Accumulated Accuracy Gap Control
Authors:
Liran Ringel,
Regev Cohen,
Daniel Freedman,
Michael Elad,
Yaniv Romano
Abstract:
Early time classification algorithms aim to label a stream of features without processing the full input stream, while maintaining accuracy comparable to that achieved by applying the classifier to the entire input. In this paper, we introduce a statistical framework that can be applied to any sequential classifier, formulating a calibrated stop** rule. This data-driven rule attains finite-sampl…
▽ More
Early time classification algorithms aim to label a stream of features without processing the full input stream, while maintaining accuracy comparable to that achieved by applying the classifier to the entire input. In this paper, we introduce a statistical framework that can be applied to any sequential classifier, formulating a calibrated stop** rule. This data-driven rule attains finite-sample, distribution-free control of the accuracy gap between full and early-time classification. We start by presenting a novel method that builds on the Learn-then-Test calibration framework to control this gap marginally, on average over i.i.d. instances. As this algorithm tends to yield an excessively high accuracy gap for early halt times, our main contribution is the proposal of a framework that controls a stronger notion of error, where the accuracy gap is controlled conditionally on the accumulated halt times. Numerical experiments demonstrate the effectiveness, applicability, and usefulness of our method. We show that our proposed early stop** mechanism reduces up to 94% of timesteps used for classification while achieving rigorous accuracy gap control.
△ Less
Submitted 1 February, 2024;
originally announced February 2024.
-
Spreading primitive groups of diagonal type do not exist
Authors:
John Bamberg,
Saul D. Freedman,
Michael Giudici
Abstract:
The synchronisation hierarchy of finite permutation groups consists of classes of groups lying between 2-transitive groups and primitive groups. This includes the class of spreading groups, which are defined in terms of sets and multisets of permuted points, and which are known to be primitive of almost simple, affine or diagonal type. In this paper, we prove that in fact no spreading group of dia…
▽ More
The synchronisation hierarchy of finite permutation groups consists of classes of groups lying between 2-transitive groups and primitive groups. This includes the class of spreading groups, which are defined in terms of sets and multisets of permuted points, and which are known to be primitive of almost simple, affine or diagonal type. In this paper, we prove that in fact no spreading group of diagonal type exists. As part of our proof, we show that all non-abelian finite simple groups, other than six sporadic groups, have a transitive action in which a proper normal subgroup of a point stabiliser is supplemented by all corresponding two-point stabilisers.
△ Less
Submitted 25 March, 2024; v1 submitted 13 November, 2023;
originally announced November 2023.
-
Weakly-Supervised Surgical Phase Recognition
Authors:
Roy Hirsch,
Regev Cohen,
Mathilde Caron,
Tomer Golany,
Daniel Freedman,
Ehud Rivlin
Abstract:
A key element of computer-assisted surgery systems is phase recognition of surgical videos. Existing phase recognition algorithms require frame-wise annotation of a large number of videos, which is time and money consuming. In this work we join concepts of graph segmentation with self-supervised learning to derive a random-walk solution for per-frame phase prediction. Furthermore, we utilize withi…
▽ More
A key element of computer-assisted surgery systems is phase recognition of surgical videos. Existing phase recognition algorithms require frame-wise annotation of a large number of videos, which is time and money consuming. In this work we join concepts of graph segmentation with self-supervised learning to derive a random-walk solution for per-frame phase prediction. Furthermore, we utilize within our method two forms of weak supervision: sparse timestamps or few-shot learning. The proposed algorithm enjoys low complexity and can operate in lowdata regimes. We validate our method by running experiments with the public Cholec80 dataset of laparoscopic cholecystectomy videos, demonstrating promising performance in multiple setups.
△ Less
Submitted 26 October, 2023;
originally announced October 2023.
-
The relational complexity of linear groups acting on subspaces
Authors:
Saul D. Freedman,
Veronica Kelsey,
Colva M. Roney-Dougal
Abstract:
The relational complexity of a subgroup $G$ of $\mathrm{Sym}(Ω)$ is a measure of the way in which the orbits of $G$ on $Ω^k$ for various $k$ determine the original action of $G$. Very few precise values of relational complexity are known. This paper determines the exact relational complexity of all groups lying between $\mathrm{PSL}_{n}(\mathbb{F})$ and $\mathrm{PGL}_{n}(\mathbb{F})$, for an arbit…
▽ More
The relational complexity of a subgroup $G$ of $\mathrm{Sym}(Ω)$ is a measure of the way in which the orbits of $G$ on $Ω^k$ for various $k$ determine the original action of $G$. Very few precise values of relational complexity are known. This paper determines the exact relational complexity of all groups lying between $\mathrm{PSL}_{n}(\mathbb{F})$ and $\mathrm{PGL}_{n}(\mathbb{F})$, for an arbitrary field $\mathbb{F}$, acting on the set of $1$-dimensional subspaces of $\mathbb{F}^n$. We also bound the relational complexity of all groups lying between $\mathrm{PSL}_{n}(q)$ and $\mathrm{P}Γ\mathrm{L}_{n}(q)$, and generalise these results to the action on $m$-spaces for $m \ge 1$.
△ Less
Submitted 18 January, 2024; v1 submitted 27 September, 2023;
originally announced September 2023.
-
Self-Supervised Learning for Endoscopic Video Analysis
Authors:
Roy Hirsch,
Mathilde Caron,
Regev Cohen,
Amir Livne,
Ron Shapiro,
Tomer Golany,
Roman Goldenberg,
Daniel Freedman,
Ehud Rivlin
Abstract:
Self-supervised learning (SSL) has led to important breakthroughs in computer vision by allowing learning from large amounts of unlabeled data. As such, it might have a pivotal role to play in biomedicine where annotating data requires a highly specialized expertise. Yet, there are many healthcare domains for which SSL has not been extensively explored. One such domain is endoscopy, minimally inva…
▽ More
Self-supervised learning (SSL) has led to important breakthroughs in computer vision by allowing learning from large amounts of unlabeled data. As such, it might have a pivotal role to play in biomedicine where annotating data requires a highly specialized expertise. Yet, there are many healthcare domains for which SSL has not been extensively explored. One such domain is endoscopy, minimally invasive procedures which are commonly used to detect and treat infections, chronic inflammatory diseases or cancer. In this work, we study the use of a leading SSL framework, namely Masked Siamese Networks (MSNs), for endoscopic video analysis such as colonoscopy and laparoscopy. To fully exploit the power of SSL, we create sizable unlabeled endoscopic video datasets for training MSNs. These strong image representations serve as a foundation for secondary training with limited annotated datasets, resulting in state-of-the-art performance in endoscopic benchmarks like surgical phase recognition during laparoscopy and colonoscopic polyp characterization. Additionally, we achieve a 50% reduction in annotated data size without sacrificing performance. Thus, our work provides evidence that SSL can dramatically reduce the need of annotated data in endoscopy.
△ Less
Submitted 23 August, 2023;
originally announced August 2023.
-
Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problems
Authors:
Omer Belhasin,
Yaniv Romano,
Daniel Freedman,
Ehud Rivlin,
Michael Elad
Abstract:
Uncertainty quantification for inverse problems in imaging has drawn much attention lately. Existing approaches towards this task define uncertainty regions based on probable values per pixel, while ignoring spatial correlations within the image, resulting in an exaggerated volume of uncertainty. In this paper, we propose PUQ (Principal Uncertainty Quantification) -- a novel definition and corresp…
▽ More
Uncertainty quantification for inverse problems in imaging has drawn much attention lately. Existing approaches towards this task define uncertainty regions based on probable values per pixel, while ignoring spatial correlations within the image, resulting in an exaggerated volume of uncertainty. In this paper, we propose PUQ (Principal Uncertainty Quantification) -- a novel definition and corresponding analysis of uncertainty regions that takes into account spatial relationships within the image, thus providing reduced volume regions. Using recent advancements in generative models, we derive uncertainty intervals around principal components of the empirical posterior distribution, forming an ambiguity region that guarantees the inclusion of true unseen values with a user-defined confidence probability. To improve computational efficiency and interpretability, we also guarantee the recovery of true unseen values using only a few principal directions, resulting in more informative uncertainty regions. Our approach is verified through experiments on image colorization, super-resolution, and inpainting; its effectiveness is shown through comparison to baseline methods, demonstrating significantly tighter uncertainty regions.
△ Less
Submitted 20 January, 2024; v1 submitted 17 May, 2023;
originally announced May 2023.
-
Designing Nonlinear Photonic Crystals for High-Dimensional Quantum State Engineering
Authors:
Eyal Rozenberg,
Aviv Karnieli,
Ofir Yesharim,
Joshua Foley-Comer,
Sivan Trajtenberg-Mills,
Sarika Mishra,
Shashi Prabhakar,
Ravindra Pratap,
Daniel Freedman,
Alex M. Bronstein,
Ady Arie
Abstract:
We propose a novel, physically-constrained and differentiable approach for the generation of D-dimensional qudit states via spontaneous parametric down-conversion (SPDC) in quantum optics. We circumvent any limitations imposed by the inherently stochastic nature of the physical process and incorporate a set of stochastic dynamical equations governing its evolution under the SPDC Hamiltonian. We de…
▽ More
We propose a novel, physically-constrained and differentiable approach for the generation of D-dimensional qudit states via spontaneous parametric down-conversion (SPDC) in quantum optics. We circumvent any limitations imposed by the inherently stochastic nature of the physical process and incorporate a set of stochastic dynamical equations governing its evolution under the SPDC Hamiltonian. We demonstrate the effectiveness of our model through the design of structured nonlinear photonic crystals (NLPCs) and shaped pump beams; and show, theoretically and experimentally, how to generate maximally entangled states in the spatial degree of freedom. The learning of NLPC structures offers a promising new avenue for sha** and controlling arbitrary quantum states and enables all-optical coherent control of the generated states. We believe that this approach can readily be extended from bulky crystals to thin Metasurfaces and potentially applied to other quantum systems sharing a similar Hamiltonian structures, such as superfluids and superconductors.
△ Less
Submitted 13 April, 2023;
originally announced April 2023.
-
Semi-Equivariant Conditional Normalizing Flows
Authors:
Eyal Rozenberg,
Daniel Freedman
Abstract:
We study the problem of learning conditional distributions of the form $p(G | \hat G)$, where $G$ and $\hat G$ are two 3D graphs, using continuous normalizing flows. We derive a semi-equivariance condition on the flow which ensures that conditional invariance to rigid motions holds. We demonstrate the effectiveness of the technique in the molecular setting of receptor-aware ligand generation.
We study the problem of learning conditional distributions of the form $p(G | \hat G)$, where $G$ and $\hat G$ are two 3D graphs, using continuous normalizing flows. We derive a semi-equivariance condition on the flow which ensures that conditional invariance to rigid motions holds. We demonstrate the effectiveness of the technique in the molecular setting of receptor-aware ligand generation.
△ Less
Submitted 13 April, 2023;
originally announced April 2023.
-
GPT-4 to GPT-3.5: 'Hold My Scalpel' -- A Look at the Competency of OpenAI's GPT on the Plastic Surgery In-Service Training Exam
Authors:
Jonathan D. Freedman,
Ian A. Nappier
Abstract:
The Plastic Surgery In-Service Training Exam (PSITE) is an important indicator of resident proficiency and serves as a useful benchmark for evaluating OpenAI's GPT. Unlike many of the simulated tests or practice questions shown in the GPT-4 Technical Paper, the multiple-choice questions evaluated here are authentic PSITE questions. These questions offer realistic clinical vignettes that a plastic…
▽ More
The Plastic Surgery In-Service Training Exam (PSITE) is an important indicator of resident proficiency and serves as a useful benchmark for evaluating OpenAI's GPT. Unlike many of the simulated tests or practice questions shown in the GPT-4 Technical Paper, the multiple-choice questions evaluated here are authentic PSITE questions. These questions offer realistic clinical vignettes that a plastic surgeon commonly encounters in practice and scores highly correlate with passing the written boards required to become a Board Certified Plastic Surgeon. Our evaluation shows dramatic improvement of GPT-4 (without vision) over GPT-3.5 with both the 2022 and 2021 exams respectively increasing the score from 8th to 88th percentile and 3rd to 99th percentile. The final results of the 2023 PSITE are set to be released on April 11, 2023, and this is an exciting moment to continue our research with a fresh exam. Our evaluation pipeline is ready for the moment that the exam is released so long as we have access via OpenAI to the GPT-4 API. With multimodal input, we may achieve superhuman performance on the 2023.
△ Less
Submitted 3 April, 2023;
originally announced April 2023.
-
Quantum sensing of magnetic fields with molecular color centers
Authors:
Kathleen R. Mullin,
Daniel W. Laorenza,
Danna E. Freedman,
James M. Rondinelli
Abstract:
Molecular color centers, such as $S=1$ Cr($o$-tolyl)$_{4}$, show promise as an adaptable platform for magnetic quantum sensing. Their intrinsically small size, i.e., 1-2 nm, enables them to sense fields at short distances and in various geometries. This feature, in conjunction with tunable optical read-out of spin information, offers the potential for molecular color centers to be a paradigm shift…
▽ More
Molecular color centers, such as $S=1$ Cr($o$-tolyl)$_{4}$, show promise as an adaptable platform for magnetic quantum sensing. Their intrinsically small size, i.e., 1-2 nm, enables them to sense fields at short distances and in various geometries. This feature, in conjunction with tunable optical read-out of spin information, offers the potential for molecular color centers to be a paradigm shifting materials class beyond diamond-NV centers by accessing a distance scale opaque to NVs. This capability could, for example, address ambiguity in the reported magnetic fields arising from two-dimensional magnets by allowing for a single sensing technique to be used over a wider range of distances. Yet, so far, these abilities have only been hypothesized with theoretical validation absent. We show through simulation that Cr($o$-tolyl)$_{4}$ can spatially resolve proximity-exchange versus direct magnetic field effects from monolayer CrI$_{3}$ by quantifying how these interactions impact the excited states of the molecule. At short distances, proximity exchange dominates through molecule-substrate interactions, but at further distances the molecule behaves as a typical magnetic sensor, with magnetostatic effects dominating changes to the energy of the excited state. Our models effectively demonstrate how a molecular color center could be used to measure the magnetic field of a 2D magnet and the role different distance-dependent interactions contribute to the measured field.
△ Less
Submitted 8 February, 2023;
originally announced February 2023.
-
Artificial Neuronal Ensembles with Learned Context Dependent Gating
Authors:
Matthew J. Tilley,
Michelle Miller,
David J. Freedman
Abstract:
Biological neural networks are capable of recruiting different sets of neurons to encode different memories. However, when training artificial neural networks on a set of tasks, typically, no mechanism is employed for selectively producing anything analogous to these neuronal ensembles. Further, artificial neural networks suffer from catastrophic forgetting, where the network's performance rapidly…
▽ More
Biological neural networks are capable of recruiting different sets of neurons to encode different memories. However, when training artificial neural networks on a set of tasks, typically, no mechanism is employed for selectively producing anything analogous to these neuronal ensembles. Further, artificial neural networks suffer from catastrophic forgetting, where the network's performance rapidly deteriorates as tasks are learned sequentially. By contrast, sequential learning is possible for a range of biological organisms. We introduce Learned Context Dependent Gating (LXDG), a method to flexibly allocate and recall `artificial neuronal ensembles', using a particular network structure and a new set of regularization terms. Activities in the hidden layers of the network are modulated by gates, which are dynamically produced during training. The gates are outputs of networks themselves, trained with a sigmoid output activation. The regularization terms we have introduced correspond to properties exhibited by biological neuronal ensembles. The first term penalizes low gate sparsity, ensuring that only a specified fraction of the network is used. The second term ensures that previously learned gates are recalled when the network is presented with input from previously learned tasks. Finally, there is a regularization term responsible for ensuring that new tasks are encoded in gates that are as orthogonal as possible from previously used ones. We demonstrate the ability of this method to alleviate catastrophic forgetting on continual learning benchmarks. When the new regularization terms are included in the model along with Elastic Weight Consolidation (EWC) it achieves better performance on the benchmark `permuted MNIST' than with EWC alone. The benchmark `rotated MNIST' demonstrates how similar tasks recruit similar neurons to the artificial neuronal ensemble.
△ Less
Submitted 19 January, 2023; v1 submitted 17 January, 2023;
originally announced January 2023.
-
The non-commuting, non-generating graph of a finite simple group
Authors:
Saul D. Freedman
Abstract:
Let $G$ be a group such that $G/Z(G)$ is finite and simple. The non-commuting, non-generating graph $Ξ(G)$ of $G$ has vertex set $G \setminus Z(G)$, with edges corresponding to pairs of elements that do not commute and do not generate $G$. We show that $Ξ(G)$ is connected with diameter at most $5$, with smaller upper bounds for certain families of groups. When $G$ itself is simple, we prove that t…
▽ More
Let $G$ be a group such that $G/Z(G)$ is finite and simple. The non-commuting, non-generating graph $Ξ(G)$ of $G$ has vertex set $G \setminus Z(G)$, with edges corresponding to pairs of elements that do not commute and do not generate $G$. We show that $Ξ(G)$ is connected with diameter at most $5$, with smaller upper bounds for certain families of groups. When $G$ itself is simple, we prove that the diameter of the complement of the generating graph of $G$ has a tight upper bound of $4$. In the companion paper arXiv:2211.08869, we consider $Ξ(G)$ when $G/Z(G)$ is not simple.
△ Less
Submitted 3 April, 2024; v1 submitted 3 December, 2022;
originally announced December 2022.
-
What's Behind the Mask: Estimating Uncertainty in Image-to-Image Problems
Authors:
Gilad Kutiel,
Regev Cohen,
Michael Elad,
Daniel Freedman
Abstract:
Estimating uncertainty in image-to-image networks is an important task, particularly as such networks are being increasingly deployed in the biological and medical imaging realms. In this paper, we introduce a new approach to this problem based on masking. Given an existing image-to-image network, our approach computes a mask such that the distance between the masked reconstructed image and the ma…
▽ More
Estimating uncertainty in image-to-image networks is an important task, particularly as such networks are being increasingly deployed in the biological and medical imaging realms. In this paper, we introduce a new approach to this problem based on masking. Given an existing image-to-image network, our approach computes a mask such that the distance between the masked reconstructed image and the masked true image is guaranteed to be less than a specified threshold, with high probability. The mask thus identifies the more certain regions of the reconstructed image. Our approach is agnostic to the underlying image-to-image network, and only requires triples of the input (degraded), reconstructed and true images for training. Furthermore, our method is agnostic to the distance metric used. As a result, one can use $L_p$-style distances or perceptual distances like LPIPS, which contrasts with interval-based approaches to uncertainty. Our theoretical guarantees derive from a conformal calibration procedure. We evaluate our mask-based approach to uncertainty on image colorization, image completion, and super-resolution tasks, demonstrating high quality performance on each.
△ Less
Submitted 28 November, 2022;
originally announced November 2022.
-
The non-commuting, non-generating graph of a non-simple group
Authors:
Saul D. Freedman
Abstract:
Let $G$ be a (finite or infinite) group such that $G/Z(G)$ is not simple. The non-commuting, non-generating graph $Ξ(G)$ of $G$ has vertex set $G \setminus Z(G)$, with vertices $x$ and $y$ adjacent whenever $[x,y] \ne 1$ and $\langle x, y \rangle \ne G$. We investigate the relationship between the structure of $G$ and the connectedness and diameter of $Ξ(G)$. In particular, we prove that the graph…
▽ More
Let $G$ be a (finite or infinite) group such that $G/Z(G)$ is not simple. The non-commuting, non-generating graph $Ξ(G)$ of $G$ has vertex set $G \setminus Z(G)$, with vertices $x$ and $y$ adjacent whenever $[x,y] \ne 1$ and $\langle x, y \rangle \ne G$. We investigate the relationship between the structure of $G$ and the connectedness and diameter of $Ξ(G)$. In particular, we prove that the graph either: (i) is connected with diameter at most $4$; (ii) consists of isolated vertices and a connected component of diameter at most $4$; or (iii) is the union of two connected components of diameter $2$. We also describe in detail the finite groups with graphs of type (iii). In the companion paper arXiv:2212.01616, we consider the case where $G/Z(G)$ is finite and simple.
△ Less
Submitted 7 March, 2023; v1 submitted 16 November, 2022;
originally announced November 2022.
-
Semi-Equivariant Continuous Normalizing Flows for Target-Aware Molecule Generation
Authors:
Eyal Rozenberg,
Daniel Freedman
Abstract:
We propose an algorithm for learning a conditional generative model of a molecule given a target. Specifically, given a receptor molecule that one wishes to bind to, the conditional model generates candidate ligand molecules that may bind to it. The distribution should be invariant to rigid body transformations that act $\textit{jointly}$ on the ligand and the receptor; it should also be invariant…
▽ More
We propose an algorithm for learning a conditional generative model of a molecule given a target. Specifically, given a receptor molecule that one wishes to bind to, the conditional model generates candidate ligand molecules that may bind to it. The distribution should be invariant to rigid body transformations that act $\textit{jointly}$ on the ligand and the receptor; it should also be invariant to permutations of either the ligand or receptor atoms. Our learning algorithm is based on a continuous normalizing flow. We establish semi-equivariance conditions on the flow which guarantee the aforementioned invariance conditions on the conditional distribution. We propose a graph neural network architecture which implements this flow, and which is designed to learn effectively despite the vast differences in size between the ligand and receptor. We evaluate our method on the CrossDocked2020 dataset, attaining a significant improvement in binding affinity over competing methods.
△ Less
Submitted 9 November, 2022;
originally announced November 2022.
-
Accelerating Progress Towards Practical Quantum Advantage: The Quantum Technology Demonstration Project Roadmap
Authors:
Paul Alsing,
Phil Battle,
Joshua C. Bienfang,
Tammie Borders,
Tina Brower-Thomas,
Lincoln D. Carr,
Fred Chong,
Siamak Dadras,
Brian DeMarco,
Ivan Deutsch,
Eden Figueroa,
Danna Freedman,
Henry Everitt,
Daniel Gauthier,
Ezekiel Johnston-Halperin,
Jungsang Kim,
Mackillo Kira,
Prem Kumar,
Paul Kwiat,
John Lekki,
Anjul Loiacono,
Marko Loncar,
John R. Lowell,
Mikhail Lukin,
Celia Merzbacher
, et al. (10 additional authors not shown)
Abstract:
Quantum information science and technology (QIST) is a critical and emerging technology with the potential for enormous world impact and is currently invested in by over 40 nations. To bring these large-scale investments to fruition and bridge the lower technology readiness levels (TRLs) of fundamental research at universities to the high TRLs necessary to realize the promise of practical quantum…
▽ More
Quantum information science and technology (QIST) is a critical and emerging technology with the potential for enormous world impact and is currently invested in by over 40 nations. To bring these large-scale investments to fruition and bridge the lower technology readiness levels (TRLs) of fundamental research at universities to the high TRLs necessary to realize the promise of practical quantum advantage accessible to industry and the public, we present a roadmap for Quantum Technology Demonstration Projects (QTDPs). Such QTDPs, focused on intermediate TRLs, are large-scale public-private partnerships with a high probability of translation from laboratory to practice. They create technology demonstrating a clear 'quantum advantage' for science breakthroughs that are user-motivated and will provide access to a broad and diverse community of scientific users. Successful implementation of a program of QTDPs will have large positive economic impacts.
△ Less
Submitted 20 March, 2023; v1 submitted 26 October, 2022;
originally announced October 2022.
-
RepsNet: Combining Vision with Language for Automated Medical Reports
Authors:
Ajay Kumar Tanwani,
Joelle Barral,
Daniel Freedman
Abstract:
Writing reports by analyzing medical images is error-prone for inexperienced practitioners and time consuming for experienced ones. In this work, we present RepsNet that adapts pre-trained vision and language models to interpret medical images and generate automated reports in natural language. RepsNet consists of an encoder-decoder model: the encoder aligns the images with natural language descri…
▽ More
Writing reports by analyzing medical images is error-prone for inexperienced practitioners and time consuming for experienced ones. In this work, we present RepsNet that adapts pre-trained vision and language models to interpret medical images and generate automated reports in natural language. RepsNet consists of an encoder-decoder model: the encoder aligns the images with natural language descriptions via contrastive learning, while the decoder predicts answers by conditioning on encoded images and prior context of descriptions retrieved by nearest neighbor search. We formulate the problem in a visual question answering setting to handle both categorical and descriptive natural language answers. We perform experiments on two challenging tasks of medical visual question answering (VQA-Rad) and report generation (IU-Xray) on radiology image datasets. Results show that RepsNet outperforms state-of-the-art methods with 81.08 % classification accuracy on VQA-Rad 2018 and 0.58 BLEU-1 score on IU-Xray. Supplementary details are available at https://sites.google.com/view/repsnet
△ Less
Submitted 27 September, 2022;
originally announced September 2022.
-
Finite groups satisfying the independence property
Authors:
Saul D. Freedman,
Andrea Lucchini,
Daniele Nemmi,
Colva M. Roney-Dougal
Abstract:
We say that a finite group $G$ satisfies the independence property if, for every pair of distinct elements $x$ and $y$ of $G$, either $\{x,y\}$ is contained in a minimal generating set for $G$ or one of $x$ and $y$ is a power of the other. We give a complete classification of the finite groups with this property, and in particular prove that every such group is supersoluble. A key ingredient of ou…
▽ More
We say that a finite group $G$ satisfies the independence property if, for every pair of distinct elements $x$ and $y$ of $G$, either $\{x,y\}$ is contained in a minimal generating set for $G$ or one of $x$ and $y$ is a power of the other. We give a complete classification of the finite groups with this property, and in particular prove that every such group is supersoluble. A key ingredient of our proof is a theorem showing that all but three finite almost simple groups $H$ contain an element $s$ such that the maximal subgroups of $H$ containing $s$, but not containing the socle of $H$, are pairwise non-conjugate.
△ Less
Submitted 23 February, 2023; v1 submitted 8 August, 2022;
originally announced August 2022.
-
Moving towards FAIR practices in epidemiological research
Authors:
Montserrat Garcia-Closas,
Thomas U. Ahearn,
Mia M. Gaudet,
Amber N. Hurson,
Jeya Balaji Balasubramanian,
Parichoy Pal Choudhury,
Nicole M. Gerlanc,
Bhaumik Patel,
Daniel Russ,
Mustapha Abubakar,
Neal D. Freedman,
Wendy S. W. Wong,
Stephen J. Chanock,
Amy Berrington de Gonzalez,
Jonas S Almeida
Abstract:
Reproducibility and replicability of research findings are central to the scientific integrity of epidemiology. In addition, many research questions require combiningdata from multiple sources to achieve adequate statistical power. However, barriers related to confidentiality, costs, and incentives often limit the extent and speed of sharing resources, both data and code. Epidemiological practices…
▽ More
Reproducibility and replicability of research findings are central to the scientific integrity of epidemiology. In addition, many research questions require combiningdata from multiple sources to achieve adequate statistical power. However, barriers related to confidentiality, costs, and incentives often limit the extent and speed of sharing resources, both data and code. Epidemiological practices that follow FAIR principles can address these barriers by making resources (F)indable with the necessary metadata , (A)ccessible to authorized users and (I)nteroperable with other data, to optimize the (R)e-use of resources with appropriate credit to its creators. We provide an overview of these principles and describe approaches for implementation in epidemiology. Increasing degrees of FAIRness can be achieved by moving data and code from on-site locations to the Cloud, using machine-readable and non-proprietary files, and develo** open-source code. Adoption of these practices will improve daily work and collaborative analyses, and facilitate compliance with data sharing policies from funders and scientific journals. Achieving a high degree of FAIRness will require funding, training, organizational support, recognition, and incentives for sharing resources. But these costs are amply outweighed by the benefits of making research more reproducible, impactful, and equitable by facilitating the re-use of precious research resources by the scientific community.
△ Less
Submitted 13 June, 2022;
originally announced June 2022.
-
Total closure for permutation actions of finite nonabelian simple groups
Authors:
Saul D. Freedman,
Michael Giudici,
Cheryl Praeger
Abstract:
For a positive integer $k$, a group $G$ is said to be totally $k$-closed if for each set $Ω$ upon which $G$ acts faithfully, $G$ is the largest subgroup of $\mathrm{Sym}(Ω)$ that leaves invariant each of the $G$-orbits in the induced action on $Ω\times\cdots\times Ω=Ω^k$. Each finite group $G$ is totally $|G|$-closed, and $k(G)$ denotes the least integer $k$ such that $G$ is totally $k$-closed. We…
▽ More
For a positive integer $k$, a group $G$ is said to be totally $k$-closed if for each set $Ω$ upon which $G$ acts faithfully, $G$ is the largest subgroup of $\mathrm{Sym}(Ω)$ that leaves invariant each of the $G$-orbits in the induced action on $Ω\times\cdots\times Ω=Ω^k$. Each finite group $G$ is totally $|G|$-closed, and $k(G)$ denotes the least integer $k$ such that $G$ is totally $k$-closed. We address the question of determining the closure number $k(G)$ for finite simple groups $G$. Prior to our work it was known that $k(G)=2$ for cyclic groups of prime order and for precisely six of the sporadic simple groups, and that $k(G)\geq3$ for all other finite simple groups. We determine the value for the alternating groups, namely $k(A_n)=n-1$. In addition, for all simple groups $G$, other than alternating groups and classical groups, we show that $k(G)\leq 7$. Finally, if $G$ is a finite simple classical group with natural module of dimension $n$, we show that $k(G)\leq n+2$ if $n \ge 14$, and $k(G) \le \lfloor n/3 + 12 \rfloor$ otherwise, with smaller bounds achieved by certain families of groups. This is achieved by determining a uniform upper bound (depending on $n$ and the type of $G$) on the base sizes of the primitive actions of $G$, based on known bounds for specific actions. We pose several open problems aimed at completing the determination of the closure numbers for finite simple groups.
△ Less
Submitted 2 February, 2023; v1 submitted 6 June, 2022;
originally announced June 2022.
-
Tournaments and Even Graphs are Equinumerous
Authors:
Gordon F. Royle,
Cheryl E. Praeger,
S. P. Glasby,
Saul D. Freedman,
Alice Devillers
Abstract:
A graph is called odd if there is an orientation of its edges and an automorphism that reverses the sense of an odd number of its edges, and even otherwise. Pontus von Brömssen (né Andersson) showed that the existence of such an automorphism is independent of the orientation, and considered the question of counting pairwise non-isomorphic even graphs. Based on computational evidence, he made the r…
▽ More
A graph is called odd if there is an orientation of its edges and an automorphism that reverses the sense of an odd number of its edges, and even otherwise. Pontus von Brömssen (né Andersson) showed that the existence of such an automorphism is independent of the orientation, and considered the question of counting pairwise non-isomorphic even graphs. Based on computational evidence, he made the rather surprising conjecture that the number of pairwise non-isomorphic even graphs on $n$ vertices is equal to the number of pairwise non-isomorphic tournaments on $n$ vertices. We prove this conjecture using a counting argument with several applications of the Cauchy-Frobenius Theorem.
△ Less
Submitted 18 November, 2022; v1 submitted 4 April, 2022;
originally announced April 2022.
-
Enhancing Spin Coherence in Optically Addressable Molecular Qubits through Host-Matrix Control
Authors:
S. L. Bayliss,
P. Deb,
D. W. Laorenza,
M. Onizhuk,
G. Galli,
D. E. Freedman,
D. D. Awschalom
Abstract:
Optically addressable spins are a promising platform for quantum information science due to their combination of a long-lived qubit with a spin-optical interface for external qubit control and read out. The ability to chemically synthesize such systems - to generate optically addressable molecular spins - offers a modular qubit architecture which can be transported across different environments, a…
▽ More
Optically addressable spins are a promising platform for quantum information science due to their combination of a long-lived qubit with a spin-optical interface for external qubit control and read out. The ability to chemically synthesize such systems - to generate optically addressable molecular spins - offers a modular qubit architecture which can be transported across different environments, and atomistically tailored for targeted applications through bottom-up design and synthesis. Here we demonstrate how the spin coherence in such optically addressable molecular qubits can be controlled through engineering their host environment. By inserting chromium (IV)-based molecular qubits into a non-isostructural host matrix, we generate noise-insensitive clock transitions, through a transverse zero-field splitting, that are not present when using an isostructural host. This host-matrix engineering leads to spin-coherence times of more than 10 microseconds for optically addressable molecular spin qubits in a nuclear and electron-spin rich environment. We model the dependence of spin coherence on transverse zero-field splitting from first principles and experimentally verify the theoretical predictions with four distinct molecular systems. Finally, we explore how to further enhance optical-spin interfaces in molecular qubits by investigating the key parameters of optical linewidth and spin-lattice relaxation time. Our results demonstrate the ability to test qubit structure-function relationships through a tunable molecular platform and highlight opportunities for using molecular qubits for nanoscale quantum sensing in noisy environments.
△ Less
Submitted 31 March, 2022;
originally announced April 2022.
-
The $\mathcal{N} = 2$ Prepotential and the Sphere Free Energy
Authors:
Bernardo Zan,
Daniel Z. Freedman,
Silviu S. Pufu
Abstract:
We study the mass-deformed sphere free energy of three-dimensional $\mathcal{N} = 2$ superconformal field theories with holographic duals. Building on previous observations, we conjecture a proportionality relation between the sphere free energy on the boundary and the prepotential of the four-dimensional $\mathcal{N} = 2$ supergravity theory in the bulk. We verify this formula by explicit computa…
▽ More
We study the mass-deformed sphere free energy of three-dimensional $\mathcal{N} = 2$ superconformal field theories with holographic duals. Building on previous observations, we conjecture a proportionality relation between the sphere free energy on the boundary and the prepotential of the four-dimensional $\mathcal{N} = 2$ supergravity theory in the bulk. We verify this formula by explicit computation in several examples of supergravity theories with vector multiplets and hypermultiplets.
△ Less
Submitted 13 December, 2021;
originally announced December 2021.
-
SPDCinv: Inverse Quantum-Optical Design of High-Dimensional Qudits
Authors:
Eyal Rozenberg,
Aviv Karnieli,
Ofir Yesharim,
Joshua Foley-Comer,
Sivan Trajtenberg-Mills,
Daniel Freedman,
Alex M. Bronstein,
Ady Arie
Abstract:
Spontaneous parametric down-conversion in quantum optics is an invaluable resource for the realization of high-dimensional qudits with spatial modes of light. One of the main open challenges is how to directly generate a desirable qudit state in the SPDC process. This problem can be addressed through advanced computational learning methods; however, due to difficulties in modeling the SPDC process…
▽ More
Spontaneous parametric down-conversion in quantum optics is an invaluable resource for the realization of high-dimensional qudits with spatial modes of light. One of the main open challenges is how to directly generate a desirable qudit state in the SPDC process. This problem can be addressed through advanced computational learning methods; however, due to difficulties in modeling the SPDC process by a fully differentiable algorithm that takes into account all interaction effects, progress has been limited. Here, we overcome these limitations and introduce a physically-constrained and differentiable model, validated against experimental results for shaped pump beams and structured crystals, capable of learning every interaction parameter in the process. We avoid any restrictions induced by the stochastic nature of our physical model and integrate the dynamic equations governing the evolution under the SPDC Hamiltonian. We solve the inverse problem of designing a nonlinear quantum optical system that achieves the desired quantum state of down-converted photon pairs. The desired states are defined using either the second-order correlations between different spatial modes or by specifying the required density matrix. By learning nonlinear volume holograms as well as different pump shapes, we successfully show how to generate maximally entangled states. Furthermore, we simulate all-optical coherent control over the generated quantum state by actively changing the profile of the pump beam. Our work can be useful for applications such as novel designs of high-dimensional quantum key distribution and quantum information processing protocols. In addition, our method can be readily applied for controlling other degrees of freedom of light in the SPDC process, such as the spectral and temporal properties, and may even be used in condensed-matter systems having a similar interaction Hamiltonian.
△ Less
Submitted 11 December, 2021;
originally announced December 2021.
-
The Holographic Contributions to the Sphere Free Energy
Authors:
Damon J. Binder,
Daniel Z. Freedman,
Silviu S. Pufu,
Bernardo Zan
Abstract:
We study which bulk couplings contribute to the $S^3$ free energy $F(\mathfrak{m})$ of three-dimensional ${\cal N} = 2$ superconformal field theories with holographic duals, potentially deformed by boundary real-mass parameters $\mathfrak{m}$. In particular, we show that $F(\mathfrak{m})$ is independent of a large class of bulk couplings that include non-chiral F-terms and all D-terms. On the othe…
▽ More
We study which bulk couplings contribute to the $S^3$ free energy $F(\mathfrak{m})$ of three-dimensional ${\cal N} = 2$ superconformal field theories with holographic duals, potentially deformed by boundary real-mass parameters $\mathfrak{m}$. In particular, we show that $F(\mathfrak{m})$ is independent of a large class of bulk couplings that include non-chiral F-terms and all D-terms. On the other hand, in general, $F(\mathfrak{m})$ does depend non-trivially on bulk chiral F-terms, such as prepotential interactions, and on bulk real-mass terms. These conclusions can be reached solely from properties of the AdS super-algebra, $\mathfrak{osp}(2|4)$. We also consider massive vector multiplets in AdS, which in the dual field theory correspond to long single-trace superconformal multiplets of spin zero. We provide evidence that $F(\mathfrak{m})$ is insensitive to the vector multiplet mass and to the interaction couplings between the massive vector multiplet and massless ones. In particular, this implies that $F(\mathfrak{m})$ does not contain information about scaling dimensions or OPE coefficients of single-trace long scalar ${\cal N} = 2$ superconformal multiplets.
△ Less
Submitted 26 July, 2021;
originally announced July 2021.
-
Deep Unfolding with Normalizing Flow Priors for Inverse Problems
Authors:
Xinyi Wei,
Hans van Gorp,
Lizeth Gonzalez Carabarin,
Daniel Freedman,
Yonina C. Eldar,
Ruud J. G. van Sloun
Abstract:
Many application domains, spanning from computational photography to medical imaging, require recovery of high-fidelity images from noisy, incomplete or partial/compressed measurements. State of the art methods for solving these inverse problems combine deep learning with iterative model-based solvers, a concept known as deep algorithm unfolding. By combining a-priori knowledge of the forward meas…
▽ More
Many application domains, spanning from computational photography to medical imaging, require recovery of high-fidelity images from noisy, incomplete or partial/compressed measurements. State of the art methods for solving these inverse problems combine deep learning with iterative model-based solvers, a concept known as deep algorithm unfolding. By combining a-priori knowledge of the forward measurement model with learned (proximal) map**s based on deep networks, these methods yield solutions that are both physically feasible (data-consistent) and perceptually plausible. However, current proximal map**s only implicitly learn such image priors. In this paper, we propose to make these image priors fully explicit by embedding deep generative models in the form of normalizing flows within the unfolded proximal gradient algorithm. We demonstrate that the proposed method outperforms competitive baselines on various image recovery tasks, spanning from image denoising to inpainting and deblurring.
△ Less
Submitted 24 March, 2022; v1 submitted 6 July, 2021;
originally announced July 2021.
-
Inverse Design of Quantum Holograms in Three-Dimensional Nonlinear Photonic Crystals
Authors:
Eyal Rozenberg,
Aviv Karnieli,
Ofir Yesharim,
Sivan Trajtenberg-Mills,
Daniel Freedman,
Alex M. Bronstein,
Ady Arie
Abstract:
We introduce a systematic approach for designing 3D nonlinear photonic crystals and pump beams for generating desired quantum correlations between structured photon-pairs. Our model is fully differentiable, allowing accurate and efficient learning and discovery of novel designs.
We introduce a systematic approach for designing 3D nonlinear photonic crystals and pump beams for generating desired quantum correlations between structured photon-pairs. Our model is fully differentiable, allowing accurate and efficient learning and discovery of novel designs.
△ Less
Submitted 20 February, 2021;
originally announced February 2021.
-
Learning an optimal PSF-pair for ultra-dense 3D localization microscopy
Authors:
Elias Nehme,
Boris Ferdman,
Lucien E. Weiss,
Tal Naor,
Daniel Freedman,
Tomer Michaeli,
Yoav Shechtman
Abstract:
A long-standing challenge in multiple-particle-tracking is the accurate and precise 3D localization of individual particles at close proximity. One established approach for snapshot 3D imaging is point-spread-function (PSF) engineering, in which the PSF is modified to encode the axial information. However, engineered PSFs are challenging to localize at high densities due to lateral PSF overlaps. H…
▽ More
A long-standing challenge in multiple-particle-tracking is the accurate and precise 3D localization of individual particles at close proximity. One established approach for snapshot 3D imaging is point-spread-function (PSF) engineering, in which the PSF is modified to encode the axial information. However, engineered PSFs are challenging to localize at high densities due to lateral PSF overlaps. Here we suggest using multiple PSFs simultaneously to help overcome this challenge, and investigate the problem of engineering multiple PSFs for dense 3D localization. We implement our approach using a bifurcated optical system that modifies two separate PSFs, and design the PSFs using three different approaches including end-to-end learning. We demonstrate our approach experimentally by volumetric imaging of fluorescently labelled telomeres in cells.
△ Less
Submitted 29 September, 2020;
originally announced September 2020.
-
The intersection graph of a finite simple group has diameter at most 5
Authors:
Saul D. Freedman
Abstract:
Let $G$ be a non-abelian finite simple group. In addition, let $Δ_G$ be the intersection graph of $G$, whose vertices are the proper nontrivial subgroups of $G$, with distinct subgroups joined by an edge if and only if they intersect nontrivially. We prove that the diameter of $Δ_G$ has a tight upper bound of 5, thereby resolving a question posed by Shen (2010). Furthermore, a diameter of 5 is ach…
▽ More
Let $G$ be a non-abelian finite simple group. In addition, let $Δ_G$ be the intersection graph of $G$, whose vertices are the proper nontrivial subgroups of $G$, with distinct subgroups joined by an edge if and only if they intersect nontrivially. We prove that the diameter of $Δ_G$ has a tight upper bound of 5, thereby resolving a question posed by Shen (2010). Furthermore, a diameter of 5 is achieved only by the baby monster group and certain unitary groups of odd prime dimension.
△ Less
Submitted 27 January, 2021; v1 submitted 7 September, 2020;
originally announced September 2020.
-
The non-commuting, non-generating graph of a nilpotent group
Authors:
Peter J. Cameron,
Saul D. Freedman,
Colva M. Roney-Dougal
Abstract:
For a nilpotent group $G$, let $Ξ(G)$ be the difference between the complement of the generating graph of $G$ and the commuting graph of $G$, with vertices corresponding to central elements of $G$ removed. That is, $Ξ(G)$ has vertex set $G \setminus Z(G)$, with two vertices adjacent if and only if they do not commute and do not generate $G$. Additionally, let $Ξ^+(G)$ be the subgraph of $Ξ(G)$ ind…
▽ More
For a nilpotent group $G$, let $Ξ(G)$ be the difference between the complement of the generating graph of $G$ and the commuting graph of $G$, with vertices corresponding to central elements of $G$ removed. That is, $Ξ(G)$ has vertex set $G \setminus Z(G)$, with two vertices adjacent if and only if they do not commute and do not generate $G$. Additionally, let $Ξ^+(G)$ be the subgraph of $Ξ(G)$ induced by its non-isolated vertices. We show that if $Ξ(G)$ has an edge, then $Ξ^+(G)$ is connected with diameter $2$ or $3$, with $Ξ(G) = Ξ^+(G)$ in the diameter $3$ case. In the infinite case, our results apply more generally, to any group with every maximal subgroup normal. When $G$ is finite, we explore the relationship between the structures of $G$ and $Ξ(G)$ in more detail.
△ Less
Submitted 20 August, 2020;
originally announced August 2020.
-
Pressure induced collapse of magnetic order in jarosite
Authors:
Ryan A. Klein,
James P. S. Walsh,
Samantha M. Clarke,
Zhenxian Liu,
E. Ercan Alp,
Wenli Bi,
Yue Meng,
Alison B. Altman,
Paul Chow,
Yuming Xiao,
M. R. Norman,
James M. Rondinelli,
Steven D. Jacobsen,
Danilo Puggioni,
Danna E. Freedman
Abstract:
We report a pressure-induced phase transition in the frustrated kagomé material jarosite at ~45 GPa, which leads to the disappearance of magnetic order. Using a suite of experimental techniques, we characterize the structural, electronic, and magnetic changes in jarosite through this phase transition. Synchrotron powder X-ray diffraction and Fourier transform infrared spectroscopy experiments, ana…
▽ More
We report a pressure-induced phase transition in the frustrated kagomé material jarosite at ~45 GPa, which leads to the disappearance of magnetic order. Using a suite of experimental techniques, we characterize the structural, electronic, and magnetic changes in jarosite through this phase transition. Synchrotron powder X-ray diffraction and Fourier transform infrared spectroscopy experiments, analyzed in aggregate with the results from density functional theory calculations, indicate that the material changes from a R-3m structure to a structure with a R-3c space group. The resulting phase features a rare twisted kagomé lattice in which the integrity of the equilateral Fe3+ triangles persists. Based on symmetry arguments we hypothesize that the resulting structural changes alter the magnetic interactions to favor a possible quantum paramagnetic phase at high pressure.
△ Less
Submitted 23 July, 2020;
originally announced July 2020.
-
SimGANs: Simulator-Based Generative Adversarial Networks for ECG Synthesis to Improve Deep ECG Classification
Authors:
Tomer Golany,
Daniel Freedman,
Kira Radinsky
Abstract:
Generating training examples for supervised tasks is a long sought after goal in AI. We study the problem of heart signal electrocardiogram (ECG) synthesis for improved heartbeat classification. ECG synthesis is challenging: the generation of training examples for such biological-physiological systems is not straightforward, due to their dynamic nature in which the various parts of the system inte…
▽ More
Generating training examples for supervised tasks is a long sought after goal in AI. We study the problem of heart signal electrocardiogram (ECG) synthesis for improved heartbeat classification. ECG synthesis is challenging: the generation of training examples for such biological-physiological systems is not straightforward, due to their dynamic nature in which the various parts of the system interact in complex ways. However, an understanding of these dynamics has been developed for years in the form of mathematical process simulators. We study how to incorporate this knowledge into the generative process by leveraging a biological simulator for the task of ECG classification. Specifically, we use a system of ordinary differential equations representing heart dynamics, and incorporate this ODE system into the optimization process of a generative adversarial network to create biologically plausible ECG training examples. We perform empirical evaluation and show that heart simulation knowledge during the generation process improves ECG classification.
△ Less
Submitted 27 June, 2020;
originally announced June 2020.
-
Optically addressable molecular spins for quantum information processing
Authors:
S. L. Bayliss,
D. W. Laorenza,
P. J. Mintun,
B. Diler,
D. E. Freedman,
D. D. Awschalom
Abstract:
Spin-bearing molecules are promising building blocks for quantum technologies as they can be chemically tuned, assembled into scalable arrays, and readily incorporated into diverse device architectures. In molecular systems, optically addressing ground-state spins would enable a wide range of applications in quantum information science, as has been demonstrated for solid-state defects. However, th…
▽ More
Spin-bearing molecules are promising building blocks for quantum technologies as they can be chemically tuned, assembled into scalable arrays, and readily incorporated into diverse device architectures. In molecular systems, optically addressing ground-state spins would enable a wide range of applications in quantum information science, as has been demonstrated for solid-state defects. However, this important functionality has remained elusive for molecules. Here, we demonstrate such optical addressability in a series of synthesized organometallic, chromium(IV) molecules. These compounds display a ground-state spin that can be initialized and read out using light, and coherently manipulated with microwaves. In addition, through atomistic modification of the molecular structure, we tune the spin and optical properties of these compounds, paving the way for designer quantum systems synthesized from the bottom-up.
△ Less
Submitted 16 April, 2020;
originally announced April 2020.
-
A Bispinor Formalism for Spinning Witten Diagrams
Authors:
Damon J. Binder,
Daniel Z. Freedman,
Silviu S. Pufu
Abstract:
We develop a new embedding-space formalism for AdS$_4$ and CFT$_3$ that is useful for evaluating Witten diagrams for operators with spin. The basic variables are Killing spinors for the bulk AdS$_4$ and conformal Killing spinors for the boundary CFT$_3$. The more conventional embedding space coordinates $X^I$ for the bulk and $P^I$ for the boundary are bilinears in these new variables. We write a…
▽ More
We develop a new embedding-space formalism for AdS$_4$ and CFT$_3$ that is useful for evaluating Witten diagrams for operators with spin. The basic variables are Killing spinors for the bulk AdS$_4$ and conformal Killing spinors for the boundary CFT$_3$. The more conventional embedding space coordinates $X^I$ for the bulk and $P^I$ for the boundary are bilinears in these new variables. We write a simple compact form for the general bulk-boundary propagator, and, for boundary operators of spin $\ell \geq 1$, we determine its conservation properties at the unitarity bound. In our CFT$_3$ formalism, we identify an $\mathfrak{so}(5,5)$ Lie algebra of differential operators that includes the basic weight-shifting operators. These operators, together with a set of differential operators in AdS$_4$, can be used to relate Witten diagrams with spinning external legs to Witten diagrams with only scalar external legs. We provide several applications that include Compton scattering and the evaluation of an $R^4$ contact interaction in AdS$_4$. Finally, we derive bispinor formulas for the bulk-to-bulk propagators of massive spinor and vector gauge fields and evaluate a diagram with spinor exchange.
△ Less
Submitted 16 March, 2020;
originally announced March 2020.
-
Detecting Deficient Coverage in Colonoscopies
Authors:
Daniel Freedman,
Yochai Blau,
Liran Katzir,
Amit Aides,
Ilan Shimshoni,
Danny Veikherman,
Tomer Golany,
Ariel Gordon,
Greg Corrado,
Yossi Matias,
Ehud Rivlin
Abstract:
Colonoscopy is the tool of choice for preventing Colorectal Cancer, by detecting and removing polyps before they become cancerous. However, colonoscopy is hampered by the fact that endoscopists routinely miss 22-28% of polyps. While some of these missed polyps appear in the endoscopist's field of view, others are missed simply because of substandard coverage of the procedure, i.e. not all of the c…
▽ More
Colonoscopy is the tool of choice for preventing Colorectal Cancer, by detecting and removing polyps before they become cancerous. However, colonoscopy is hampered by the fact that endoscopists routinely miss 22-28% of polyps. While some of these missed polyps appear in the endoscopist's field of view, others are missed simply because of substandard coverage of the procedure, i.e. not all of the colon is seen. This paper attempts to rectify the problem of substandard coverage in colonoscopy through the introduction of the C2D2 (Colonoscopy Coverage Deficiency via Depth) algorithm which detects deficient coverage, and can thereby alert the endoscopist to revisit a given area. More specifically, C2D2 consists of two separate algorithms: the first performs depth estimation of the colon given an ordinary RGB video stream; while the second computes coverage given these depth estimates. Rather than compute coverage for the entire colon, our algorithm computes coverage locally, on a segment-by-segment basis; C2D2 can then indicate in real-time whether a particular area of the colon has suffered from deficient coverage, and if so the endoscopist can return to that area. Our coverage algorithm is the first such algorithm to be evaluated in a large-scale way; while our depth estimation technique is the first calibration-free unsupervised method applied to colonoscopies. The C2D2 algorithm achieves state of the art results in the detection of deficient coverage. On synthetic sequences with ground truth, it is 2.4 times more accurate than human experts; while on real sequences, C2D2 achieves a 93.0% agreement with experts.
△ Less
Submitted 29 March, 2020; v1 submitted 23 January, 2020;
originally announced January 2020.
-
Introduction of spin centers in single crystals of Ba$_2$CaWO$_{6-δ}$
Authors:
Mekhola Sinha,
Tyler J. Pearson,
Tim R. Reeder,
Hector K. Vivanco,
Danna E. Freedman,
W. Adam Phelan,
Tyrel M. McQueen
Abstract:
Develo** the field of quantum information science (QIS) hinges upon designing viable qubits, the smallest unit in quantum computing. One approach to creating qubits is introducing paramagnetic defects into semiconductors or insulators. This class of qubits has seen success in the form of nitrogen-vacancy centers in diamond, divacancy defects in SiC, and P doped into Si. These materials feature p…
▽ More
Develo** the field of quantum information science (QIS) hinges upon designing viable qubits, the smallest unit in quantum computing. One approach to creating qubits is introducing paramagnetic defects into semiconductors or insulators. This class of qubits has seen success in the form of nitrogen-vacancy centers in diamond, divacancy defects in SiC, and P doped into Si. These materials feature paramagnetic defects in a low nuclear spin environment to reduce the impact of nuclear spin on electronic spin coherence. In this work, we report single crystal growth of Ba$_2$CaWO$_{6-δ}$, and the coherence properties of controllably introduced W$^{5+}$ spin centers generated by oxygen vacancies. Ba$_2$CaWO$_{6-δ}$ ($δ$ = 0) is a B-site ordered double perovskite with a temperature-dependent octahedral tilting wherein oxygen vacancies generate W$^{5+}$ (d$^1$), $S = \frac{1}{2}, I$ = 0, centers. We characterized these defects by measuring the spin-lattice ($T_1$) and spin-spin relaxation ($T_2$) times from T = 5 to 150 K. At T = 5 K, $T_1$ = 310 ms and $T_2$ = 4 $μ$s, establishing the viability of these qubit candidates. With increasing temperature, $T_2$ remains constant up to T = 60 K and then decreases to $T_2$ $\approx$ 1 $μ$s at T = 90 K, and remains roughly constant until T = 150 K, demonstrating the remarkable stability of $T_2$ with increasing temperature. Together, these results demonstrate that controlled defect generation in double perovskite structures can generate viable paramagnetic point centers for quantum applications and expand the field of potential materials for QIS.
△ Less
Submitted 1 January, 2020;
originally announced January 2020.
-
Detecting muscle activation using ultrasound speed of sound inversion with deep learning
Authors:
Micha Feigin,
Manuel Zwecker,
Daniel Freedman,
Brian W. Anthony
Abstract:
Functional muscle imaging is essential for diagnostics of a multitude of musculoskeletal afflictions such as degenerative muscle diseases, muscle injuries, muscle atrophy, and neurological related issues such as spasticity. However, there is currently no solution, imaging or otherwise, capable of providing a map of active muscles over a large field of view in dynamic scenarios. In this work, we lo…
▽ More
Functional muscle imaging is essential for diagnostics of a multitude of musculoskeletal afflictions such as degenerative muscle diseases, muscle injuries, muscle atrophy, and neurological related issues such as spasticity. However, there is currently no solution, imaging or otherwise, capable of providing a map of active muscles over a large field of view in dynamic scenarios. In this work, we look at the feasibility of longitudinal sound speed measurements to the task of dynamic muscle imaging of contraction or activation. We perform the assessment using a deep learning network applied to pre-beamformed ultrasound channel data for sound speed inversion. Preliminary results show that dynamic muscle contraction can be detected in the calf and that this contraction can be positively assigned to the operating muscles. Potential frame rates in the hundreds to thousands of frames per second are necessary to accomplish this.
△ Less
Submitted 21 October, 2019; v1 submitted 20 October, 2019;
originally announced October 2019.
-
Localization with Limited Annotation for Chest X-rays
Authors:
Eyal Rozenberg,
Daniel Freedman,
Alex Bronstein
Abstract:
Localization of an object within an image is a common task in medical imaging. Learning to localize or detect objects typically requires the collection of data which has been labelled with bounding boxes or similar annotations, which can be very time consuming and expensive. A technique which could perform such learning with much less annotation would, therefore, be quite valuable. We present such…
▽ More
Localization of an object within an image is a common task in medical imaging. Learning to localize or detect objects typically requires the collection of data which has been labelled with bounding boxes or similar annotations, which can be very time consuming and expensive. A technique which could perform such learning with much less annotation would, therefore, be quite valuable. We present such a technique for localization with limited annotation, in which the number of images with bounding boxes can be a small fraction of the total dataset (e.g. less than 1%); all other images only possess a whole image label and no bounding box. We propose a novel loss function for tackling this problem; the loss is a continuous relaxation of a well-defined discrete formulation of weakly supervised learning and is numerically well-posed. Furthermore, we propose a new architecture which accounts for both patch dependence and shift-invariance, through the inclusion of CRF layers and anti-aliasing filters, respectively. We apply our technique to the localization of thoracic diseases in chest X-ray images and demonstrate state-of-the-art localization performance on the ChestX-ray14 dataset.
△ Less
Submitted 10 October, 2019; v1 submitted 19 September, 2019;
originally announced September 2019.
-
DeepSTORM3D: dense three dimensional localization microscopy and point spread function design by deep learning
Authors:
Elias Nehme,
Daniel Freedman,
Racheli Gordon,
Boris Ferdman,
Lucien E. Weiss,
Onit Alalouf,
Reut Orange,
Tomer Michaeli,
Yoav Shechtman
Abstract:
Localization microscopy is an imaging technique in which the positions of individual nanoscale point emitters (e.g. fluorescent molecules) are determined at high precision from their images. This is the key ingredient in single/multiple-particle-tracking and several super-resolution microscopy approaches. Localization in three-dimensions (3D) can be performed by modifying the image that a point-so…
▽ More
Localization microscopy is an imaging technique in which the positions of individual nanoscale point emitters (e.g. fluorescent molecules) are determined at high precision from their images. This is the key ingredient in single/multiple-particle-tracking and several super-resolution microscopy approaches. Localization in three-dimensions (3D) can be performed by modifying the image that a point-source creates on the camera, namely, the point-spread function (PSF). The PSF is engineered using additional optical elements to vary distinctively with the depth of the point-source. However, localizing multiple adjacent emitters in 3D poses a significant algorithmic challenge, due to the lateral overlap of their PSFs. Here, we train a neural network to receive an image containing densely overlap** PSFs of multiple emitters over a large axial range and output a list of their 3D positions. Furthermore, we then use the network to design the optimal PSF for the multi-emitter case. We demonstrate our approach numerically as well as experimentally by 3D STORM imaging of mitochondria, and volumetric imaging of dozens of fluorescently-labeled telomeres occupying a mammalian nucleus in a single snapshot.
△ Less
Submitted 12 September, 2019; v1 submitted 21 June, 2019;
originally announced June 2019.
-
$T \bar{T}$-Deformed Actions and (1,1) Supersymmetry
Authors:
Evan A. Coleman,
Jeremias Aguilera-Damia,
Daniel Z. Freedman,
Ronak M. Soni
Abstract:
We describe an algorithmic method to calculate the $T\bar{T}$ deformed Lagrangian of a given seed theory by solving an algebraic system of equations. This method is derived from the topological gravity formulation of the deformation. This algorithm is far simpler than the direct partial differential equations needed in most earlier proposals. We present several examples, including the deformed Lag…
▽ More
We describe an algorithmic method to calculate the $T\bar{T}$ deformed Lagrangian of a given seed theory by solving an algebraic system of equations. This method is derived from the topological gravity formulation of the deformation. This algorithm is far simpler than the direct partial differential equations needed in most earlier proposals. We present several examples, including the deformed Lagrangian of (1,1) supersymmetry. We show that this Lagrangian is off-shell invariant through order $λ^2$ in the deformation parameter and verify its SUSY algebra through order $λ$.
△ Less
Submitted 12 June, 2019;
originally announced June 2019.
-
Learning Deep Generative Models with Annealed Importance Sampling
Authors:
Xinqiang Ding,
David J. Freedman
Abstract:
Variational inference (VI) and Markov chain Monte Carlo (MCMC) are two main approximate approaches for learning deep generative models by maximizing marginal likelihood. In this paper, we propose using annealed importance sampling for learning deep generative models. Our proposed approach bridges VI with MCMC. It generalizes VI methods such as variational auto-encoders and importance weighted auto…
▽ More
Variational inference (VI) and Markov chain Monte Carlo (MCMC) are two main approximate approaches for learning deep generative models by maximizing marginal likelihood. In this paper, we propose using annealed importance sampling for learning deep generative models. Our proposed approach bridges VI with MCMC. It generalizes VI methods such as variational auto-encoders and importance weighted auto-encoders (IWAE) and the MCMC method proposed in (Hoffman, 2017). It also provides insights into why running multiple short MCMC chains can help learning deep generative models. Through experiments, we show that our approach yields better density models than IWAE and can effectively trade computation for model accuracy without increasing memory cost.
△ Less
Submitted 29 November, 2020; v1 submitted 11 June, 2019;
originally announced June 2019.
-
Unsupervised Single Image Dehazing Using Dark Channel Prior Loss
Authors:
Alona Golts,
Daniel Freedman,
Michael Elad
Abstract:
Single image dehazing is a critical stage in many modern-day autonomous vision applications. Early prior-based methods often involved a time-consuming minimization of a hand-crafted energy function. Recent learning-based approaches utilize the representational power of deep neural networks (DNNs) to learn the underlying transformation between hazy and clear images. Due to inherent limitations in c…
▽ More
Single image dehazing is a critical stage in many modern-day autonomous vision applications. Early prior-based methods often involved a time-consuming minimization of a hand-crafted energy function. Recent learning-based approaches utilize the representational power of deep neural networks (DNNs) to learn the underlying transformation between hazy and clear images. Due to inherent limitations in collecting matching clear and hazy images, these methods resort to training on synthetic data; constructed from indoor images and corresponding depth information. This may result in a possible domain shift when treating outdoor scenes. We propose a completely unsupervised method of training via minimization of the well-known, Dark Channel Prior (DCP) energy function. Instead of feeding the network with synthetic data, we solely use real-world outdoor images and tune the network's parameters by directly minimizing the DCP. Although our "Deep DCP" technique can be regarded as a fast approximator of DCP, it actually improves its results significantly. This suggests an additional regularization obtained via the network and learning process. Experiments show that our method performs on par with large-scale supervised methods.
△ Less
Submitted 20 August, 2019; v1 submitted 6 December, 2018;
originally announced December 2018.
-
On $p$-groups with automorphism groups related to the exceptional Chevalley groups
Authors:
Saul D. Freedman
Abstract:
Let $\hat G$ be the finite simply connected version of an exceptional Chevalley group, and let $V$ be a nontrivial irreducible module, of minimal dimension, for $\hat G$ over its field of definition. We explore the overgroup structure of $\hat G$ in $\mathrm{GL}(V)$, and the submodule structure of the exterior square (and sometimes the third Lie power) of $V$. When $\hat G$ is defined over a field…
▽ More
Let $\hat G$ be the finite simply connected version of an exceptional Chevalley group, and let $V$ be a nontrivial irreducible module, of minimal dimension, for $\hat G$ over its field of definition. We explore the overgroup structure of $\hat G$ in $\mathrm{GL}(V)$, and the submodule structure of the exterior square (and sometimes the third Lie power) of $V$. When $\hat G$ is defined over a field of odd prime order $p$, this allows us to construct the smallest (with respect to certain properties) $p$-groups $P$ such that the group induced by $\mathrm{Aut}(P)$ on $P/Φ(P)$ is either $\hat G$ or its normaliser in $\mathrm{GL}(V)$.
△ Less
Submitted 6 May, 2020; v1 submitted 19 October, 2018;
originally announced October 2018.
-
A Deep Learning Framework for Single-Sided Sound Speed Inversion in Medical Ultrasound
Authors:
Micha Feigin,
Daniel Freedman,
Brian W. Anthony
Abstract:
Objective: Ultrasound elastography is gaining traction as an accessible and useful diagnostic tool for such things as cancer detection and differentiation and thyroid disease diagnostics. Unfortunately, state of the art shear wave imaging techniques, essential to promote this goal, are limited to high-end ultrasound hardware due to high power requirements; are extremely sensitive to patient and so…
▽ More
Objective: Ultrasound elastography is gaining traction as an accessible and useful diagnostic tool for such things as cancer detection and differentiation and thyroid disease diagnostics. Unfortunately, state of the art shear wave imaging techniques, essential to promote this goal, are limited to high-end ultrasound hardware due to high power requirements; are extremely sensitive to patient and sonographer motion, and generally, suffer from low frame rates. Motivated by research and theory showing that longitudinal wave sound speed carries similar diagnostic abilities to shear wave imaging, we present an alternative approach using single sided pressure-wave sound speed measurements from channel data.
Methods: In this paper, we present a single-sided sound speed inversion solution using a fully convolutional deep neural network. We use simulations for training, allowing the generation of limitless ground truth data.
Results: We show that it is possible to invert for longitudinal sound speed in soft tissue at high frame rates. We validate the method on simulated data. We present highly encouraging results on limited real data.
Conclusion: Sound speed inversion on channel data has significant potential, made possible in real time with deep learning technologies.
Significance: Specialized shear wave ultrasound systems remain inaccessible in many locations. longitudinal sound speed and deep learning technologies enable an alternative approach to diagnosis based on tissue elasticity. High frame rates are possible.
△ Less
Submitted 30 July, 2019; v1 submitted 30 September, 2018;
originally announced October 2018.
-
Duality Constraints on Counterterms in $\mathcal N=5,\ 6$ Supergravities
Authors:
Daniel Z. Freedman,
Renata Kallosh,
Yusuke Yamada
Abstract:
The UV finiteness found in calculations of the 4-point amplitude in $\mathcal N=5$ supergravity at loop order $L=3, 4$ has not been explained, which motivates our study of the relevant superspace invariants and on-shell superamplitudes for both $\mathcal N=5$ and $\mathcal N=6$. The local 4-point superinvariants for $L = 3,4$ are expected to have nonlinear completions whose 6-point amplitudes have…
▽ More
The UV finiteness found in calculations of the 4-point amplitude in $\mathcal N=5$ supergravity at loop order $L=3, 4$ has not been explained, which motivates our study of the relevant superspace invariants and on-shell superamplitudes for both $\mathcal N=5$ and $\mathcal N=6$. The local 4-point superinvariants for $L = 3,4$ are expected to have nonlinear completions whose 6-point amplitudes have non-vanishing SSL's (soft scalar limits), violating the behavior required of Goldstone bosons. For $\mathcal N=5$, we find at $L=3$ that local 6-point superinvariant and superamplitudes, which might cancel these SSL's, do not exist. This rules out the candidate 4-point counterterm and thus gives a plausible explanation of the observed $L=3$ finiteness. However, at $L= 4$ we construct a local 6-point superinvariant with non-vanishing SSL's, so the SSL argument does not explain the observed $L=4$ $\mathcal N=5$ UV finiteness. For $\mathcal N=6$ supergravity there are no 6-point invariants at either $L= 3$ or 4, so the SSL argument predicts UV finiteness.
△ Less
Submitted 15 August, 2018; v1 submitted 17 July, 2018;
originally announced July 2018.