-
Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements
Authors:
Leandro von Werra,
Lewis Tunstall,
Abhishek Thakur,
Alexandra Sasha Luccioni,
Tristan Thrush,
Aleksandra Piktus,
Felix Marty,
Nazneen Rajani,
Victor Mustar,
Helen Ngo,
Omar Sanseviero,
Mario Šaško,
Albert Villanova,
Quentin Lhoest,
Julien Chaumond,
Margaret Mitchell,
Alexander M. Rush,
Thomas Wolf,
Douwe Kiela
Abstract:
Evaluation is a key part of machine learning (ML), yet there is a lack of support and tooling to enable its informed and systematic practice. We introduce Evaluate and Evaluation on the Hub --a set of tools to facilitate the evaluation of models and datasets in ML. Evaluate is a library to support best practices for measurements, metrics, and comparisons of data and models. Its goal is to support…
▽ More
Evaluation is a key part of machine learning (ML), yet there is a lack of support and tooling to enable its informed and systematic practice. We introduce Evaluate and Evaluation on the Hub --a set of tools to facilitate the evaluation of models and datasets in ML. Evaluate is a library to support best practices for measurements, metrics, and comparisons of data and models. Its goal is to support reproducibility of evaluation, centralize and document the evaluation process, and broaden evaluation to cover more facets of model performance. It includes over 50 efficient canonical implementations for a variety of domains and scenarios, interactive documentation, and the ability to easily share implementations and outcomes. The library is available at https://github.com/huggingface/evaluate. In addition, we introduce Evaluation on the Hub, a platform that enables the large-scale evaluation of over 75,000 models and 11,000 datasets on the Hugging Face Hub, for free, at the click of a button. Evaluation on the Hub is available at https://huggingface.co/autoevaluate.
△ Less
Submitted 6 October, 2022; v1 submitted 30 September, 2022;
originally announced October 2022.
-
A High Power Density Electrostatic Vibration-to-Electric Energy Converter Based On An In-Plane Overlap Plate (IPOP) Mechanism
Authors:
A. M. Paracha,
Ph. Basset,
F. Marty,
A. Vaisman Chasin,
P. Poulichet,
T. Bourouina
Abstract:
In this paper, design, fabrication and characterization issues of a bulk silicon-based, vibration powered, electric energy generator are addressed. The converter is based on an In-Plane Overlap Plate (IPOP) configuration [1]. Measurements have shown that with a theoretically lossless electronics and a starting voltage of 5 V, power density of 58 $μ$W/cm3 is achievable at the resonance frequency…
▽ More
In this paper, design, fabrication and characterization issues of a bulk silicon-based, vibration powered, electric energy generator are addressed. The converter is based on an In-Plane Overlap Plate (IPOP) configuration [1]. Measurements have shown that with a theoretically lossless electronics and a starting voltage of 5 V, power density of 58 $μ$W/cm3 is achievable at the resonance frequency of 290 Hz. It can be further improved by reducing the parasitic capacitance, which can be achieved by silicon etching, but a considerable mass is lost. In [2], it is shown that 19% of mass reduction improves power density from 12.95 $μ$W/cm3 to 59 $μ$W/cm3. Hence an enhancement in fabrication process is proposed, which is termed as Backside DRIE. It helps in increasing power density without loosing an important quantity of mass. Simulations have shown that 2.5% of mass removal improves power density up to 76.71 $μ$W/cm3. Initial simulation results and problems of associated electronics are also discussed.
△ Less
Submitted 21 February, 2008;
originally announced February 2008.
-
Electrostatically-Driven Resonator on Soi with Improved Temperature Stability
Authors:
A. Giridhar,
F. Verjus,
F. Marty,
A. Bosseboeuf,
T. Bourouina
Abstract:
This paper deals with a single-crystal-silicon (SCS) MEMS resonator with improved temperature stability. While simulations have shown that the temperature coefficient of resonant frequency can be down to 1 ppm/degrees C, preliminary measurements on non-optimised structures gave evidence of a temperature coefficient of 29 ppm/degrees C. Design, optimisation, experimental results with post process…
▽ More
This paper deals with a single-crystal-silicon (SCS) MEMS resonator with improved temperature stability. While simulations have shown that the temperature coefficient of resonant frequency can be down to 1 ppm/degrees C, preliminary measurements on non-optimised structures gave evidence of a temperature coefficient of 29 ppm/degrees C. Design, optimisation, experimental results with post process simulation and prospective work are presented.
△ Less
Submitted 21 November, 2007;
originally announced November 2007.
