-
Optimal Size-Performance Tradeoffs: Weighing PoS Tagger Models
Authors:
Magnus Jacobsen,
Mikkel H. Sørensen,
Leon Derczynski
Abstract:
Improvement in machine learning-based NLP performance are often presented with bigger models and more complex code. This presents a trade-off: better scores come at the cost of larger tools; bigger models tend to require more during training and inference time. We present multiple methods for measuring the size of a model, and for comparing this with the model's performance.
In a case study over…
▽ More
Improvement in machine learning-based NLP performance are often presented with bigger models and more complex code. This presents a trade-off: better scores come at the cost of larger tools; bigger models tend to require more during training and inference time. We present multiple methods for measuring the size of a model, and for comparing this with the model's performance.
In a case study over part-of-speech tagging, we then apply these techniques to taggers for eight languages and present a novel analysis identifying which taggers are size-performance optimal. Results indicate that some classical taggers place on the size-performance skyline across languages. Further, although the deep models have highest performance for multiple scores, it is often not the most complex of these that reach peak performance.
△ Less
Submitted 16 April, 2021;
originally announced April 2021.
-
Screening model for nanowire surface-charge sensors in liquid
Authors:
Martin H. Sorensen,
Niels Asger Mortensen,
Mads Brandbyge
Abstract:
The conductance change of nanowire field-effect transistors is considered a highly sensitive probe for surface charge. However, Debye screening of relevant physiological liquid environments challenge device performance due to competing screening from the ionic liquid and nanowire charge carriers. We discuss this effect within Thomas-Fermi and Debye-Huckel theory and derive analytical results for…
▽ More
The conductance change of nanowire field-effect transistors is considered a highly sensitive probe for surface charge. However, Debye screening of relevant physiological liquid environments challenge device performance due to competing screening from the ionic liquid and nanowire charge carriers. We discuss this effect within Thomas-Fermi and Debye-Huckel theory and derive analytical results for cylindrical wires which can be used to estimate the sensitivity of nanowire surface-charge sensors. We study the interplay between the nanowire radius, the Thomas-Fermi and Debye screening lengths, and the length of the functionalization molecules. The analytical results are compared to finite-element calculations on a realistic geometry.
△ Less
Submitted 17 August, 2007; v1 submitted 15 August, 2007;
originally announced August 2007.
-
A Note on Shortest Developments
Authors:
Morten Heine Sørensen
Abstract:
De Vrijer has presented a proof of the finite developments theorem which, in addition to showing that all developments are finite, gives an effective reduction strategy computing longest developments as well as a simple formula computing their length.
We show that by applying a rather simple and intuitive principle of duality to de Vrijer's approach one arrives at a proof that some development…
▽ More
De Vrijer has presented a proof of the finite developments theorem which, in addition to showing that all developments are finite, gives an effective reduction strategy computing longest developments as well as a simple formula computing their length.
We show that by applying a rather simple and intuitive principle of duality to de Vrijer's approach one arrives at a proof that some developments are finite which in addition yields an effective reduction strategy computing shortest developments as well as a simple formula computing their length. The duality fails for general beta-reduction.
Our results simplify previous work by Khasidashvili.
△ Less
Submitted 5 November, 2007; v1 submitted 1 August, 2007;
originally announced August 2007.
