Skip to main content

Showing 1–18 of 18 results for author: Tesileanu, T

.
  1. arXiv:2310.03024  [pdf, other

    astro-ph.IM cs.AI cs.LG

    AstroCLIP: A Cross-Modal Foundation Model for Galaxies

    Authors: Liam Parker, Francois Lanusse, Siavash Golkar, Leopoldo Sarra, Miles Cranmer, Alberto Bietti, Michael Eickenberg, Geraud Krawezik, Michael McCabe, Ruben Ohana, Mariel Pettee, Bruno Regaldo-Saint Blancard, Tiberiu Tesileanu, Kyunghyun Cho, Shirley Ho

    Abstract: We present AstroCLIP, a single, versatile model that can embed both galaxy images and spectra into a shared, physically meaningful latent space. These embeddings can then be used - without any model fine-tuning - for a variety of downstream tasks including (1) accurate in-modality and cross-modality semantic similarity search, (2) photometric redshift estimation, (3) galaxy property estimation fro… ▽ More

    Submitted 14 June, 2024; v1 submitted 4 October, 2023; originally announced October 2023.

    Comments: 18 pages, accepted in Monthly Notices of the Royal Astronomical Society, Presented at the NeurIPS 2023 AI4Science Workshop

  2. arXiv:2310.02994  [pdf, other

    cs.LG cs.AI stat.ML

    Multiple Physics Pretraining for Physical Surrogate Models

    Authors: Michael McCabe, Bruno Régaldo-Saint Blancard, Liam Holden Parker, Ruben Ohana, Miles Cranmer, Alberto Bietti, Michael Eickenberg, Siavash Golkar, Geraud Krawezik, Francois Lanusse, Mariel Pettee, Tiberiu Tesileanu, Kyunghyun Cho, Shirley Ho

    Abstract: We introduce multiple physics pretraining (MPP), an autoregressive task-agnostic pretraining approach for physical surrogate modeling. MPP involves training large surrogate models to predict the dynamics of multiple heterogeneous physical systems simultaneously by learning features that are broadly useful across diverse physical tasks. In order to learn effectively in this setting, we introduce a… ▽ More

    Submitted 4 October, 2023; originally announced October 2023.

  3. arXiv:2310.02989  [pdf, other

    stat.ML cs.AI cs.CL cs.LG

    xVal: A Continuous Number Encoding for Large Language Models

    Authors: Siavash Golkar, Mariel Pettee, Michael Eickenberg, Alberto Bietti, Miles Cranmer, Geraud Krawezik, Francois Lanusse, Michael McCabe, Ruben Ohana, Liam Parker, Bruno Régaldo-Saint Blancard, Tiberiu Tesileanu, Kyunghyun Cho, Shirley Ho

    Abstract: Large Language Models have not yet been broadly adapted for the analysis of scientific datasets due in part to the unique difficulties of tokenizing numbers. We propose xVal, a numerical encoding scheme that represents any real number using just a single token. xVal represents a given real number by scaling a dedicated embedding vector by the number value. Combined with a modified number-inference… ▽ More

    Submitted 4 October, 2023; originally announced October 2023.

    Comments: 10 pages 7 figures. Supplementary: 5 pages 2 figures

  4. arXiv:2309.16645  [pdf, other

    cs.LG

    Reusability report: Prostate cancer stratification with diverse biologically-informed neural architectures

    Authors: Christian Pedersen, Tiberiu Tesileanu, Tinghui Wu, Siavash Golkar, Miles Cranmer, Zijun Zhang, Shirley Ho

    Abstract: In Elmarakeby et al., "Biologically informed deep neural network for prostate cancer discovery", a feedforward neural network with biologically informed, sparse connections (P-NET) was presented to model the state of prostate cancer. We verified the reproducibility of the study conducted by Elmarakeby et al., using both their original codebase, and our own re-implementation using more up-to-date l… ▽ More

    Submitted 30 October, 2023; v1 submitted 28 September, 2023; originally announced September 2023.

    Comments: 9 pages, 3 figures. Submitted to Nature Machine Intelligence

  5. arXiv:2211.07723  [pdf, other

    stat.ML cs.LG cs.NE

    An online algorithm for contrastive Principal Component Analysis

    Authors: Siavash Golkar, David Lipshutz, Tiberiu Tesileanu, Dmitri B. Chklovskii

    Abstract: Finding informative low-dimensional representations that can be computed efficiently in large datasets is an important problem in data analysis. Recently, contrastive Principal Component Analysis (cPCA) was proposed as a more informative generalization of PCA that takes advantage of contrastive learning. However, the performance of cPCA is sensitive to hyper-parameter choice and there is currently… ▽ More

    Submitted 14 November, 2022; originally announced November 2022.

    Comments: 5 pages, 4 figures

  6. arXiv:2210.15752  [pdf, other

    q-bio.NC

    Constrained Predictive Coding as a Biologically Plausible Model of the Cortical Hierarchy

    Authors: Siavash Golkar, Tiberiu Tesileanu, Yanis Bahroun, Anirvan M. Sengupta, Dmitri B. Chklovskii

    Abstract: Predictive coding has emerged as an influential normative model of neural computation, with numerous extensions and applications. As such, much effort has been put into map** PC faithfully onto the cortex, but there are issues that remain unresolved or controversial. In particular, current implementations often involve separate value and error neurons and require symmetric forward and backward w… ▽ More

    Submitted 4 March, 2023; v1 submitted 27 October, 2022; originally announced October 2022.

    Comments: 24 pages, 9 figures; accepted in NeurIPS 2022

  7. arXiv:2104.11852  [pdf, other

    q-bio.NC physics.bio-ph

    Neural circuits for dynamics-based segmentation of time series

    Authors: Tiberiu Tesileanu, Siavash Golkar, Samaneh Nasiri, Anirvan M. Sengupta, Dmitri B. Chklovskii

    Abstract: The brain must extract behaviorally relevant latent variables from the signals streamed by the sensory organs. Such latent variables are often encoded in the dynamics that generated the signal rather than in the specific realization of the waveform. Therefore, one problem faced by the brain is to segment time series based on underlying dynamics. We present two algorithms for performing this segmen… ▽ More

    Submitted 5 October, 2021; v1 submitted 23 April, 2021; originally announced April 2021.

    Comments: v2.1; 34 pages, 14 figures

  8. arXiv:1912.05433  [pdf, other

    q-bio.NC

    Efficient coding of natural scene statistics predicts discrimination thresholds for grayscale textures

    Authors: Tiberiu Tesileanu, Mary M. Conte, John J. Briguglio, Ann M. Hermundstad, Jonathan D. Victor, Vijay Balasubramanian

    Abstract: Previously, in (Hermundstad et al., 2014), we showed that when sampling is limiting, the efficient coding principle leads to a "variance is salience" hypothesis, and that this hypothesis accounts for visual sensitivity to binary image statistics. Here, using extensive new psychophysical data and image analysis, we show that this hypothesis accounts for visual sensitivity to a large set of grayscal… ▽ More

    Submitted 10 July, 2020; v1 submitted 11 December, 2019; originally announced December 2019.

    Comments: 33 pages, 12 figures

  9. arXiv:1801.09300  [pdf, other

    q-bio.NC physics.bio-ph

    Adaptation of olfactory receptor abundances for efficient coding

    Authors: Tiberiu Tesileanu, Simona Cocco, Remi Monasson, Vijay Balasubramanian

    Abstract: Olfactory receptor usage is highly heterogeneous, with some receptor types being orders of magnitude more abundant than others. We propose an explanation for this striking fact: the receptor distribution is tuned to maximally represent information about the olfactory environment in a regime of efficient coding that is sensitive to the global context of correlated sensor responses. This model predi… ▽ More

    Submitted 22 January, 2019; v1 submitted 28 January, 2018; originally announced January 2018.

    Comments: 36 pages, 13 figures

  10. arXiv:1608.08040  [pdf, other

    q-bio.NC physics.bio-ph

    Rules and mechanisms for efficient two-stage learning in neural circuits

    Authors: Tiberiu Tesileanu, Bence Ölveczky, Vijay Balasubramanian

    Abstract: Trial-and-error learning requires evaluating variable actions and reinforcing successful variants. In songbirds, vocal exploration is induced by LMAN, the output of a basal ganglia-circuit that also contributes a corrective bias to the vocal output. This bias is gradually consolidated in RA, a motor cortex analogue downstream of LMAN. We develop a new model of such two-stage learning. Using stocha… ▽ More

    Submitted 8 March, 2017; v1 submitted 29 August, 2016; originally announced August 2016.

    Comments: 27 pages including appendices, 10 figures; to appear in eLife

  11. arXiv:1510.06082  [pdf, other

    physics.bio-ph q-bio.PE

    Dynamics of adaptive immunity against phage in bacterial populations

    Authors: Serena Bradde, Marija Vucelja, Tiberiu Tesileanu, Vijay Balasubramanian

    Abstract: The CRISPR (clustered regularly interspaced short palindromic repeats) mechanism allows bacteria to adaptively defend against phages by acquiring short genomic sequences (spacers) that target specific sequences in the viral genome. We propose a population dynamical model where immunity can be both acquired and lost. The model predicts regimes where bacterial and phage populations can co-exist, oth… ▽ More

    Submitted 24 May, 2017; v1 submitted 20 October, 2015; originally announced October 2015.

    Comments: 17 pages, 4 Figures and Supplementary Materials

  12. Protein sectors: statistical coupling analysis versus conservation

    Authors: Tiberiu Tesileanu, Lucy J. Colwell, Stanislas Leibler

    Abstract: Statistical coupling analysis (SCA) is a method for analyzing multiple sequence alignments that was used to identify groups of coevolving residues termed "sectors". The method applies spectral analysis to a matrix obtained by combining correlation information with sequence conservation. It has been asserted that the protein sectors identified by SCA are functionally significant, with different sec… ▽ More

    Submitted 16 December, 2014; v1 submitted 27 May, 2014; originally announced May 2014.

    Comments: 36 pages, 17 figures

  13. Multi-Matrix Models and Tri-Sasaki Einstein Spaces

    Authors: Christopher P. Herzog, Igor R. Klebanov, Silviu S. Pufu, Tiberiu Tesileanu

    Abstract: Localization methods reduce the path integrals in {\cal N} >= 2 supersymmetric Chern-Simons gauge theories on S^3 to multi-matrix integrals. A recent evaluation of such a two-matrix integral for the {\cal N}=6 superconformal U(N) x U(N) ABJM theory produced detailed agreement with the AdS/CFT correspondence, explaining, in particular the N^{3/2} scaling of the free energy. We study a class of p-ma… ▽ More

    Submitted 19 March, 2011; v1 submitted 24 November, 2010; originally announced November 2010.

    Comments: 36 pages, 8 figures; v2 improved section 4, refs added; v3 minor improvements, ref added, PRD version

    Report number: PUPT-2359

    Journal ref: Phys.Rev.D83:046001,2011

  14. Membranes with Topological Charge and AdS4/CFT3 Correspondence

    Authors: Igor R. Klebanov, Silviu S. Pufu, Tiberiu Tesileanu

    Abstract: If the second Betti number b_2 of a Sasaki-Einstein manifold Y^7 does not vanish, then M-theory on AdS_4 x Y^7 possesses "topological" U(1)^{b_2} gauge symmetry. The corresponding Abelian gauge fields come from three-form fluctuations with one index in AdS_4 and the other two in Y^7. We find black membrane solutions carrying one of these U(1) charges. In the zero temperature limit, our solutions… ▽ More

    Submitted 2 April, 2010; originally announced April 2010.

    Comments: 57 pages, 7 figures

    Report number: PUPT-2336

    Journal ref: Phys.Rev.D81:125011,2010

  15. Emergent Quantum Near-Criticality from Baryonic Black Branes

    Authors: Christopher P. Herzog, Igor R. Klebanov, Silviu S. Pufu, Tiberiu Tesileanu

    Abstract: We find new black 3-brane solutions describing the "conifold gauge theory" at nonzero temperature and baryonic chemical potential. Of particular interest is the low-temperature limit where we find a new kind of weakly curved near-horizon geometry; it is a warped product AdS_2 x R^3 x T^{1,1} with warp factors that are powers of the logarithm of the AdS radius. Thus, our solution encodes a new ty… ▽ More

    Submitted 5 April, 2010; v1 submitted 2 November, 2009; originally announced November 2009.

    Comments: 29 pages, 4 figures; v2 discussion of entropy revised, minor changes; v3 note added, minor improvements, version published in JHEP

    Report number: PUPT-2318

    Journal ref: JHEP 1003:093,2010

  16. Superconductors from Superstrings

    Authors: Steven S. Gubser, Christopher P. Herzog, Silviu S. Pufu, Tiberiu Tesileanu

    Abstract: We establish that in a large class of strongly coupled 3+1 dimensional N=1 quiver conformal field theories with gravity duals, adding a chemical potential for the R-charge leads to the existence of superfluid states in which a chiral primary operator of the schematic form O = λλ+ W condenses. Here λis a gluino and W is the superpotential. Our argument is based on the construction of a consistent… ▽ More

    Submitted 19 August, 2009; v1 submitted 20 July, 2009; originally announced July 2009.

    Comments: 5 pages, 2 figures; v2 improved figure, small changes

    Report number: PUPT-2306

    Journal ref: Phys.Rev.Lett.103:141601,2009

  17. CMB statistical anisotropy, multipole vectors and the influence of the dipole

    Authors: Robert C. Helling, Peter Schupp, Tiberiu Tesileanu

    Abstract: A simple algorithm which gives the multipole vectors in terms of the roots of a polynomial is given. We find that the reported alignmet of the low l multipole vectors can be summarised as an anti-alignmet of these with the dipole direction. This anti-alignment is not only present in l=2 and 3 but also for l=5 and higher. This alignment is likely due to non-linearity in the data processing. Our r… ▽ More

    Submitted 30 March, 2006; v1 submitted 22 March, 2006; originally announced March 2006.

    Comments: V2: Added references and minor changes

    Report number: IUB-TH-0601

    Journal ref: Phys.Rev.D74:063004,2006

  18. Competition of Languages and their Hamming Distance

    Authors: Tiberiu Teşileanu, Hildegard Meyer-Ortmanns

    Abstract: We consider the spreading and competition of languages that are spoken by a population of individuals. The individuals can change their mother tongue during their lifespan, pass on their language to their offspring and finally die. The languages are described by bitstrings, their mutual difference is expressed in terms of their Hamming distance. Language evolution is determined by mutation and a… ▽ More

    Submitted 31 August, 2005; originally announced August 2005.

    Comments: 18 pages, 19 figures