-
Pretraining and the Lasso
Authors:
Erin Craig,
Mert Pilanci,
Thomas Le Menestrel,
Balasubramanian Narasimhan,
Manuel Rivas,
Roozbeh Dehghannasiri,
Julia Salzman,
Jonathan Taylor,
Robert Tibshirani
Abstract:
Pretraining is a popular and powerful paradigm in machine learning. As an example, suppose one has a modest-sized dataset of images of cats and dogs, and plans to fit a deep neural network to classify them from the pixel features. With pretraining, we start with a neural network trained on a large corpus of images, consisting of not just cats and dogs but hundreds of other image types. Then we fix…
▽ More
Pretraining is a popular and powerful paradigm in machine learning. As an example, suppose one has a modest-sized dataset of images of cats and dogs, and plans to fit a deep neural network to classify them from the pixel features. With pretraining, we start with a neural network trained on a large corpus of images, consisting of not just cats and dogs but hundreds of other image types. Then we fix all of the network weights except for the top layer (which makes the final classification) and train (or "fine tune") those weights on our dataset. This often results in dramatically better performance than the network trained solely on our smaller dataset.
In this paper, we ask the question "Can pretraining help the lasso?". We develop a framework for the lasso in which an overall model is fit to a large set of data, and then fine-tuned to a specific task on a smaller dataset. This latter dataset can be a subset of the original dataset, but does not need to be. We find that this framework has a wide variety of applications, including stratified models, multinomial targets, multi-response models, conditional average treatment estimation and even gradient boosting.
In the stratified model setting, the pretrained lasso pipeline estimates the coefficients common to all groups at the first stage, and then group specific coefficients at the second "fine-tuning" stage. We show that under appropriate assumptions, the support recovery rate of the common coefficients is superior to that of the usual lasso trained only on individual groups. This separate identification of common and individual coefficients can also be useful for scientific understanding.
△ Less
Submitted 18 April, 2024; v1 submitted 23 January, 2024;
originally announced January 2024.
-
Characterization of Three-Dimensional Microstructures in Single Crystal Diamond
Authors:
P. Olivero,
S. Rubanov,
P. Reichart,
B. C. Gibson,
S. T. Huntington,
J. R. Rabeau,
A. D. Greentree,
J. Salzman,
D. Moore,
D. N. Jamieson,
S. Prawer
Abstract:
We report on the Raman and photoluminescence characterization of three-dimensional microstructures created in single crystal diamond with a Focused Ion Beam (FIB) assisted lift-off technique. The method is based on MeV ion implantation to create a buried etchable layer, followed by FIB patterning and selective etching. In the applications of such microstructures where the properties of high qualit…
▽ More
We report on the Raman and photoluminescence characterization of three-dimensional microstructures created in single crystal diamond with a Focused Ion Beam (FIB) assisted lift-off technique. The method is based on MeV ion implantation to create a buried etchable layer, followed by FIB patterning and selective etching. In the applications of such microstructures where the properties of high quality single crystal diamond are most relevant, residual damage after the fabrication process represents a critical technological issue. The results of Raman and photoluminescence characterization indicate that the partial distortion of the sp3-bonded lattice and the formation of isolated point defects are effectively removed after thermal annealing, leaving low amounts of residual damage in the final structures. Three-dimensional microstructures in single-crystal diamond offer a large range of applications, such as quantum optics devices and fully integrated opto mechanical assemblies.
△ Less
Submitted 1 September, 2016;
originally announced September 2016.
-
The Plateau Problem in the Heteroskedastic Probit Model
Authors:
Eric Freeman,
Luke Keele,
David Park,
Julia Salzman,
Brendan Weickert
Abstract:
In parameter determination for the heteroskedastic probit model, both in simulated data and in actual data, we observe a failure of traditional local search methods to converge consistently to a single parameter vector, in contrast to the typical situation for the regular probit model. We identify features of the heteroskedastic probit log likelihood function that we argue tend to lead to this fai…
▽ More
In parameter determination for the heteroskedastic probit model, both in simulated data and in actual data, we observe a failure of traditional local search methods to converge consistently to a single parameter vector, in contrast to the typical situation for the regular probit model. We identify features of the heteroskedastic probit log likelihood function that we argue tend to lead to this failure, and suggest ways to amend the local search methods to remedy the problem.
△ Less
Submitted 13 August, 2015;
originally announced August 2015.
-
Fabrication of Triangular Nanobeam Waveguide Networks in Bulk diamond Using Single-Crystal Silicon Hard Masks
Authors:
I. Bayn,
S. Mouradian,
L. Li,
J. A. Goldstein,
T. Schröder,
J. Zhang,
E. H. Chen,
O. Gaathon,
M. Lu,
A. Stein,
C. A. Ruggiero,
J. Salzman,
R. Kalish,
D. Englund
Abstract:
A scalable approach for integrated photonic networks in single-crystal diamond using triangular etching of bulk samples is presented. We describe designs of high quality factor (Q=2.51x10^6) photonic crystal cavities with low mode volume (Vm=1.062x(λ/n)^3), which are connected via waveguides supported by suspension structures with predicted transmission loss of only 0.05 dB. We demonstrate the fab…
▽ More
A scalable approach for integrated photonic networks in single-crystal diamond using triangular etching of bulk samples is presented. We describe designs of high quality factor (Q=2.51x10^6) photonic crystal cavities with low mode volume (Vm=1.062x(λ/n)^3), which are connected via waveguides supported by suspension structures with predicted transmission loss of only 0.05 dB. We demonstrate the fabrication of these structures using transferred single-crystal silicon hard masks and angular dry etching, yielding photonic crystal cavities in the visible spectrum with measured quality factors in excess of Q=3x103.
△ Less
Submitted 13 November, 2014;
originally announced November 2014.
-
A penalized likelihood approach for robust estimation of isoform expression
Authors:
Hui Jiang,
Julia Salzman
Abstract:
Ultra high-throughput sequencing of transcriptomes (RNA-Seq) has enabled the accurate estimation of gene expression at individual isoform level. However, systematic biases introduced during the sequencing and map** processes as well as incompleteness of the transcript annotation databases may cause the estimates of isoform abundances to be unreliable, and in some cases, highly inaccurate. This p…
▽ More
Ultra high-throughput sequencing of transcriptomes (RNA-Seq) has enabled the accurate estimation of gene expression at individual isoform level. However, systematic biases introduced during the sequencing and map** processes as well as incompleteness of the transcript annotation databases may cause the estimates of isoform abundances to be unreliable, and in some cases, highly inaccurate. This paper introduces a penalized likelihood approach to detect and correct for such biases in a robust manner. Our model extends those previously proposed by introducing bias parameters for reads. An L1 penalty is used for the selection of non-zero bias parameters. We introduce an efficient algorithm for model fitting and analyze the statistical properties of the proposed model. Our experimental studies on both simulated and real datasets suggest that the model has the potential to improve isoform-specific gene expression estimates and identify incompletely annotated gene models.
△ Less
Submitted 1 October, 2013;
originally announced October 2013.
-
Diamond Processing by Focused Ion Beam - Surface Damage and Recovery
Authors:
Igal Bayn,
Asaf Bolker,
Catherine Cytermann,
Boris Meyler,
Vladimir Richter,
Joseph Salzman,
Rafi Kalish
Abstract:
The Nitrogen Vacancy color center (NV-) in diamond is of great interest for novel photonic applications. Diamond nano-photonic structures are often implemented using Focused-Ion-Beam (FIB) processing, leaving a damaged surface which has a detrimental effect on the color center luminescence. The FIB processing effect on single crystal diamond surfaces and their photonic properties is studied by Tim…
▽ More
The Nitrogen Vacancy color center (NV-) in diamond is of great interest for novel photonic applications. Diamond nano-photonic structures are often implemented using Focused-Ion-Beam (FIB) processing, leaving a damaged surface which has a detrimental effect on the color center luminescence. The FIB processing effect on single crystal diamond surfaces and their photonic properties is studied by Time of Flight Secondary Ion Mass Spectrometry (TOF-SIMS) and photoluminescence (PL). Exposing the processed surface to hydrogen plasma, followed by chemical etching, drastically decreases implanted Ga concentration, resulting in a recovery of the NV- photo-emission and in a significant increase of the NV-/NV0 ratio.
△ Less
Submitted 3 August, 2011;
originally announced August 2011.
-
Statistical Modeling of RNA-Seq Data
Authors:
Julia Salzman,
Hui Jiang,
Wing Hung Wong
Abstract:
Recently, ultra high-throughput sequencing of RNA (RNA-Seq) has been developed as an approach for analysis of gene expression. By obtaining tens or even hundreds of millions of reads of transcribed sequences, an RNA-Seq experiment can offer a comprehensive survey of the population of genes (transcripts) in any sample of interest. This paper introduces a statistical model for estimating isoform abu…
▽ More
Recently, ultra high-throughput sequencing of RNA (RNA-Seq) has been developed as an approach for analysis of gene expression. By obtaining tens or even hundreds of millions of reads of transcribed sequences, an RNA-Seq experiment can offer a comprehensive survey of the population of genes (transcripts) in any sample of interest. This paper introduces a statistical model for estimating isoform abundance from RNA-Seq data and is flexible enough to accommodate both single end and paired end RNA-Seq data and sampling bias along the length of the transcript. Based on the derivation of minimal sufficient statistics for the model, a computationally feasible implementation of the maximum likelihood estimator of the model is provided. Further, it is shown that using paired end RNA-Seq provides more accurate isoform abundance estimates than single end sequencing at fixed sequencing depth. Simulation studies are also given.
△ Less
Submitted 16 June, 2011;
originally announced June 2011.
-
Triangular nanobeam photonic cavities in single crystal diamond
Authors:
Igal Bayn,
Boris Meyler,
Joseph Salzman,
Rafi Kalish
Abstract:
Diamond photonics provides an attractive architecture to explore room temperature cavity quantum electrodynamics and to realize scalable multi-qubit computing. Here we review the present state of diamond photonic technology. The design, fabrication and characterization of a novel triangular cross section nanobeam cavity produced in a single crystal diamond is demonstrated. The present cavity desig…
▽ More
Diamond photonics provides an attractive architecture to explore room temperature cavity quantum electrodynamics and to realize scalable multi-qubit computing. Here we review the present state of diamond photonic technology. The design, fabrication and characterization of a novel triangular cross section nanobeam cavity produced in a single crystal diamond is demonstrated. The present cavity design, based on a triangular cross section allows vertical confinement and better signal collection efficiency than that of slab-based nanocavities, and eliminates the need for a pre-existing membrane. The nanobeam is fabricated by Focused-Ion-Beam (FIB) patterning. The cavity is characterized by a confocal photoluminescence. The modes display quality factors of Q ~220 and are deviated in wavelength by only ~1.7nm from the NV- color center zero phonon line (ZPL). The measured results are found in good agreement with 3D Finite-Difference-Time-Domain (FDTD) calculations. A more advanced cavity design with Q=22,000 is modeled, showing the potential for high-Q implementations using the triangular cavity design. The prospects of this concept and its application to spin non-demolition measurement and quantum computing are discussed.
△ Less
Submitted 7 January, 2011;
originally announced January 2011.
-
Processing of Photonic Crystal Nanocavity for Quantum Information in Diamond
Authors:
Igal Bayn,
Boris Meyler,
Alex Lahav,
Joseph Salzman,
Rafi Kalish,
Barbara A. Fairchild,
Steven Prawer,
Michael Barth,
Oliver Benson,
Thomas Wolf,
Petr Siyushev,
Fedor Jelezko,
Jorg Wrachtrup
Abstract:
The realization of photonic crystals (PC) in diamond is of major importance for the entire field of spintronics based on fluorescent centers in diamond. The processing steps for the case of diamond differ from those commonly used, due to the extreme chemical and mechanical properties of this material. The present work summarizes the state of the art in the realization of PC's in diamond. It is bas…
▽ More
The realization of photonic crystals (PC) in diamond is of major importance for the entire field of spintronics based on fluorescent centers in diamond. The processing steps for the case of diamond differ from those commonly used, due to the extreme chemical and mechanical properties of this material. The present work summarizes the state of the art in the realization of PC's in diamond. It is based on the creation of a free standing diamond membrane into which the desired nano-sized patterns are milled by the use of Focused-Ion-Beam (FIB). The optimal fabrication-oriented structure parameters are predicted by simulations. The milling strategies, the method of formation the diamond membrane, recipes for dielectric material-manipulation in FIB and optical characterization constraints are discussed in conjunction with their implication on PC cavity design. The thus produced structures are characterized via confocal photoluminescence.
△ Less
Submitted 29 December, 2010;
originally announced December 2010.
-
Ultra-high-Q nanobeam cavity design in Diamond
Authors:
Igal Bayn,
Joseph Salzman,
Rafi Kalish
Abstract:
A novel nanobeam design with a triangular cross-section is proposed. This design makes possible implementing nanocavities with improved optical properties. The dependence of a diamond-based cavity quality factor Q and mode volume Vm on geometry parameter space are studied via 3D FDTD computations. An ultra-high-Q cavity with Q\aprox 2.51 \times 10^6 and Vm=1.06 \times (λ/n)^3 is predicted. The mod…
▽ More
A novel nanobeam design with a triangular cross-section is proposed. This design makes possible implementing nanocavities with improved optical properties. The dependence of a diamond-based cavity quality factor Q and mode volume Vm on geometry parameter space are studied via 3D FDTD computations. An ultra-high-Q cavity with Q\aprox 2.51 \times 10^6 and Vm=1.06 \times (λ/n)^3 is predicted. The mode preferential radiation is upward. The implications on the potential applications are discussed. The proposed nanobeam enables fabrication of the cavity without relying on a pre-existing free-standing diamond membrane as required in most previous approaches.
△ Less
Submitted 25 December, 2010;
originally announced December 2010.
-
Tuning Leaky Nanocavity Resonances - Perturbation Treatment
Authors:
Michael Shlafman,
Igal Bayn,
Joseph Salzman
Abstract:
Adiabatic frequency tuning of finite-lifetime-nanocavity electromagnetic modes affects also their quality-factor (Q). Perturbative Q change resulting from (real) frequency tuning, is a controllable parameter. Here, the influence of dielectric constant modulation (DCM) on cavity resonances is presented, by first order perturbation analysis for a 3D cavity with radiation losses. Semi-analytical ex…
▽ More
Adiabatic frequency tuning of finite-lifetime-nanocavity electromagnetic modes affects also their quality-factor (Q). Perturbative Q change resulting from (real) frequency tuning, is a controllable parameter. Here, the influence of dielectric constant modulation (DCM) on cavity resonances is presented, by first order perturbation analysis for a 3D cavity with radiation losses. Semi-analytical expressions for DCM induced cavity mode frequency and Q changes are derived. The obtained results are in good agreement with numerical calculations.
△ Less
Submitted 3 March, 2010;
originally announced March 2010.
-
Projection pursuit for discrete data
Authors:
Persi Diaconis,
Julia Salzman
Abstract:
This paper develops projection pursuit for discrete data using the discrete Radon transform. Discrete projection pursuit is presented as an exploratory method for finding informative low dimensional views of data such as binary vectors, rankings, phylogenetic trees or graphs. We show that for most data sets, most projections are close to uniform. Thus, informative summaries are ones deviating fr…
▽ More
This paper develops projection pursuit for discrete data using the discrete Radon transform. Discrete projection pursuit is presented as an exploratory method for finding informative low dimensional views of data such as binary vectors, rankings, phylogenetic trees or graphs. We show that for most data sets, most projections are close to uniform. Thus, informative summaries are ones deviating from uniformity. Syllabic data from several of Plato's great works is used to illustrate the methods. Along with some basic distribution theory, an automated procedure for computing informative projections is introduced.
△ Less
Submitted 20 May, 2008;
originally announced May 2008.
-
Ultra high-Q photonic crystal nanocavity design: The effect of a low-epsilon slab material
Authors:
Igal Bayn,
Joseph Salzman
Abstract:
We analyze the influence of the dielectric constant of the slab on the quality factor (Q) in slab photonic crystal cavities with a minimized vertical losses model. The higher value of Q in high-epsilon cavity is attributed to the lower mode frequency. The Q ratio in a high-epsilon (silicon) vs. low-epsilon (diamond) slab is examined as a function of mode volume (Vm). The mode volume compensation…
▽ More
We analyze the influence of the dielectric constant of the slab on the quality factor (Q) in slab photonic crystal cavities with a minimized vertical losses model. The higher value of Q in high-epsilon cavity is attributed to the lower mode frequency. The Q ratio in a high-epsilon (silicon) vs. low-epsilon (diamond) slab is examined as a function of mode volume (Vm). The mode volume compensation technique is discussed. Finally, diamond cavity design is addressed. The analytical results are compared to 3D FDTD calculations. In a double heterostructure design, a Q=2.6*10^5 is obtained. The highest Q=1.3*10^6 with Vm=1.77*(lambda/n)^3 in a local width modulation design is derived.
△ Less
Submitted 22 February, 2008;
originally announced February 2008.
-
The Effect of Electric Fields In A Classic Introductory Physics Treatment of Eddy Current Forces
Authors:
P. J. Salzman,
John Robert Burke,
Susan M. Lea
Abstract:
A simple model of eddy currents in which current is computed solely from magnetic forces acting on electrons proves accessible to introductory students and gives a good qualitative account of eddy current forces. However, this model cannot be complete; it ignores the electric fields that drive current outside regions of significant magnetic field. In this paper we show how to extend the model to…
▽ More
A simple model of eddy currents in which current is computed solely from magnetic forces acting on electrons proves accessible to introductory students and gives a good qualitative account of eddy current forces. However, this model cannot be complete; it ignores the electric fields that drive current outside regions of significant magnetic field. In this paper we show how to extend the model to obtain a boundary value problem for current density. Solution of this problem in polar coordinates shows that the electric field significantly affects the quantitative results and presents an exercise suitable for upper division students. We apply elliptic cylindrical coordinates to generalize the result and offer an exercise useful for teaching graduate students how to use non-standard coordinate systems.
△ Less
Submitted 23 July, 2006;
originally announced July 2006.
-
A possible experimental test of quantized gravity
Authors:
P. J. Salzman,
S. Carlip
Abstract:
While it is widely believed that gravity should ultimately be treated as a quantum theory, there remains a possibility that general relativity should not be quantized. If this is the case, the coupling of classical gravity to the expectation value of the quantum stress-energy tensor will naturally lead to nonlinearities in the Schrodinger equation. By numerically investigating time evolution in…
▽ More
While it is widely believed that gravity should ultimately be treated as a quantum theory, there remains a possibility that general relativity should not be quantized. If this is the case, the coupling of classical gravity to the expectation value of the quantum stress-energy tensor will naturally lead to nonlinearities in the Schrodinger equation. By numerically investigating time evolution in the nonrelativistic "Schrodinger-Newton" approximation, we show that such nonlinearities may be observable in the next generation of molecular interferometry experiments.
△ Less
Submitted 28 June, 2006;
originally announced June 2006.
-
Quantum gate for Q switching in monolithic photonic bandgap cavities containing two-level atoms
Authors:
Andrew D. Greentree,
J. Salzman,
Steven Prawer,
Lloyd C. L. Hollenberg
Abstract:
Photonic bandgap cavities are prime solid-state systems to investigate light-matter interactions in the strong coupling regime. However, as the cavity is defined by the geometry of the periodic dielectric pattern, cavity control in a monolithic structure can be problematic. Thus, either the state coherence is limited by the read-out channel, or in a high Q cavity, it is nearly decoupled from the…
▽ More
Photonic bandgap cavities are prime solid-state systems to investigate light-matter interactions in the strong coupling regime. However, as the cavity is defined by the geometry of the periodic dielectric pattern, cavity control in a monolithic structure can be problematic. Thus, either the state coherence is limited by the read-out channel, or in a high Q cavity, it is nearly decoupled from the external world, making measurement of the state extremely challenging. We present here a method for ameliorating these difficulties by using a coupled cavity arrangement, where one cavity acts as a switch for the other cavity, tuned by control of the atomic transition.
△ Less
Submitted 10 November, 2005;
originally announced November 2005.
-
On communication over an entanglement-assisted quantum channel
Authors:
Ashwin Nayak,
Julia Salzman
Abstract:
Shared entanglement is a resource available to parties communicating over a quantum channel, much akin to public coins in classical communication protocols. Whereas shared randomness does not help in the transmission of information, or significantly reduce the classical complexity of computing functions (as compared to private-coin protocols), shared entanglement leads to startling phenomena suc…
▽ More
Shared entanglement is a resource available to parties communicating over a quantum channel, much akin to public coins in classical communication protocols. Whereas shared randomness does not help in the transmission of information, or significantly reduce the classical complexity of computing functions (as compared to private-coin protocols), shared entanglement leads to startling phenomena such as ``quantum teleportation'' and ``superdense coding.''
The problem of characterising the power of prior entanglement has puzzled many researchers. In this paper, we revisit the problem of transmitting classical bits over an entanglement-assisted quantum channel. We derive a new, optimal bound on the number of quantum bits required for this task, for any given probability of error. All known lower bounds in the setting of bounded error entanglement-assisted communication are based on sophisticated information theoretic arguments. In contrast, our result is derived from first principles, using a simple linear algebraic technique.
△ Less
Submitted 18 June, 2002;
originally announced June 2002.
