-
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Authors:
BigScience Workshop,
:,
Teven Le Scao,
Angela Fan,
Christopher Akiki,
Ellie Pavlick,
Suzana Ilić,
Daniel Hesslow,
Roman Castagné,
Alexandra Sasha Luccioni,
François Yvon,
Matthias Gallé,
Jonathan Tow,
Alexander M. Rush,
Stella Biderman,
Albert Webson,
Pawan Sasanka Ammanamanchi,
Thomas Wang,
Benoît Sagot,
Niklas Muennighoff,
Albert Villanova del Moral,
Olatunji Ruwase,
Rachel Bawden,
Stas Bekman,
Angelina McMillan-Major
, et al. (369 additional authors not shown)
Abstract:
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access…
▽ More
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License.
△ Less
Submitted 27 June, 2023; v1 submitted 9 November, 2022;
originally announced November 2022.
-
Low Dimensional Assemblies of Magnetic MnFe$_2$O$_4$ Nanoparticles and Direct In Vitro Measurements of Enhanced Heating Driven by Dipolar Interactions: Implications for Magnetic Hyperthermia
Authors:
Beatriz Sanz,
Rafael Cabreira-Gomes,
Teobaldo E. Torres,
Daniela P. Valdés,
Enio Lima Jr.,
Emilio De Biasi,
Roberto D. Zysler,
M. Ricardo Ibarra,
Gerardo F. Goya
Abstract:
Magnetic fluid hyperthermia (MFH), the procedure of raising the temperature of tumor cells using magnetic nanoparticles (MNPs) as heating agents, has proven successful in treating some types of cancer. However, the low heating power generated under physiological conditions makes necessary a high local concentration of MNPs at tumor sites. Here, we report how the in vitro heating power of magnetica…
▽ More
Magnetic fluid hyperthermia (MFH), the procedure of raising the temperature of tumor cells using magnetic nanoparticles (MNPs) as heating agents, has proven successful in treating some types of cancer. However, the low heating power generated under physiological conditions makes necessary a high local concentration of MNPs at tumor sites. Here, we report how the in vitro heating power of magnetically soft MnFe$_2$O$_4$ nanoparticles can be enhanced by intracellular low-dimensional clusters through a strategy that includes: a) the design of the MNPs to retain Néel magnetic relaxation in high viscosity media, and b) culturing MNP-loaded cells under magnetic fields to produce elongated intracellular agglomerates. Our direct in vitro measurements demonstrated that the specific loss power (SLP) of elongated agglomerates ($SLP=576\pm33$ W/g) induced by culturing BV2 cells in situ under a dc magnetic field was increased by a factor of 2 compared to the $SLP=305\pm25$ W/g measured in aggregates freely formed within cells. A numerical mean-field model that included dipolar interactions quantitatively reproduced the SLPs of these clusters both in phantoms and in vitro, suggesting that it captures the relevant mechanisms behind power losses under high-viscosity conditions. These results indicate that in situ assembling of MNPs into low-dimensional structures is a sound possible way to improve the heating performance in MFH.
△ Less
Submitted 15 November, 2020;
originally announced November 2020.
-
Differential Galois Theory and Isomonodromic Deformations
Authors:
David Blázquez Sanz,
Guy Casale,
Juan Sebastián Díaz Arboleda
Abstract:
We present a geometric setting for the differential Galois theory of $G$-invariant connections with parameters. As an application of some classical results on differential algebraic groups and Lie algebra bundles, we see that the Galois group of a connection with parameters with simple structural group $G$ is determined by its isomonodromic deformations. This allows us to compute the Galois groups…
▽ More
We present a geometric setting for the differential Galois theory of $G$-invariant connections with parameters. As an application of some classical results on differential algebraic groups and Lie algebra bundles, we see that the Galois group of a connection with parameters with simple structural group $G$ is determined by its isomonodromic deformations. This allows us to compute the Galois groups with parameters of the general Fuchsian special linear system and of Gauss hypergeometric equation.
△ Less
Submitted 5 August, 2019; v1 submitted 19 October, 2018;
originally announced October 2018.
-
Hybrid Surface Patterns Mimicking the Design of the Adhesive Toe Pad of Tree Frog
Authors:
Longjian Xue,
Belén Sanz,
Aoyi Luo,
Kevin T. Turner,
Xin Wang,
Di Tan,
Rui Zhang,
Hang Du,
Martin Steinhart,
Carmen Mijangos,
Markus Guttmann,
Michael Kappl,
Aránzazu del Campo
Abstract:
Biological materials achieve directional reinforcement with oriented assemblies of anisotropic building blocks. One such example is the nanocomposite structure of keratinized epithelium on the toe pad of tree frogs, in which hexagonal arrays of (soft) epithelial cells are crossed by densely packed and oriented (hard) keratin nanofibrils. Here, a method is established to fabricate arrays of tree-fr…
▽ More
Biological materials achieve directional reinforcement with oriented assemblies of anisotropic building blocks. One such example is the nanocomposite structure of keratinized epithelium on the toe pad of tree frogs, in which hexagonal arrays of (soft) epithelial cells are crossed by densely packed and oriented (hard) keratin nanofibrils. Here, a method is established to fabricate arrays of tree-frog-inspired composite micropatterns composed of polydimethylsiloxane (PDMS) micropillars embedded with polystyrene (PS) nanopillars. Adhesive and frictional studies of these synthetic materials reveal a benefit of the hierarchical and anisotropic design for both adhesion and friction, in particular, at high matrix-fiber interfacial strengths. The presence of PS nanopillars alters the stress distribution at the contact interface of micropillars and therefore enhances the adhesion and friction of the composite micropattern. The results suggest a design principle for bioinspired structural adhesives, especially for wet environments.
△ Less
Submitted 24 November, 2017;
originally announced November 2017.
-
Magnetic hyperthermia enhances cell toxicity with respect to exogenous heating
Authors:
Beatriz Sanz,
M. Pilar Calatayud,
Teobaldo E. Torres,
Mónica L. Fanarraga,
M. Ricardo Ibarra,
Gerardo F. Goya
Abstract:
Magnetic hyperthermia is a new type of cancer treatment designed for overcoming resistance to chemotherapy during the treatment of solid, inaccessible human tumors. The main challenge of this technology is increasing the local tumoral temperature with minimal side effects on the surrounding healthy tissue. This work consists of an in vitro study that compared the effect of hyperthermia in response…
▽ More
Magnetic hyperthermia is a new type of cancer treatment designed for overcoming resistance to chemotherapy during the treatment of solid, inaccessible human tumors. The main challenge of this technology is increasing the local tumoral temperature with minimal side effects on the surrounding healthy tissue. This work consists of an in vitro study that compared the effect of hyperthermia in response to the application of exogenous heating (EHT) sources with the corresponding effect produced by magnetic hyperthermia (MHT) at the same target temperatures. Human neuroblastoma SH-SY5Y cells were loaded with magnetic nanoparticles (MNPs) and packed into dense pellets to generate an environment that is crudely similar to that expected in solid micro-tumors, and the above-mentioned protocols were applied to these cells. These experiments showed that for the same target temperatures, MHT induces a decrease in cell viability that is larger than the corresponding EHT, up to a maximum difference of approximately 45\% at T = 46°C. An analysis of the data in terms of temperature efficiency demonstrated that MHT requires an average temperature that is 6°C lower than that required with EHT to produce a similar cytotoxic effect. An analysis of electron microscopy images of the cells after the EHT and MHT treatments indicated that the enhanced effectiveness observed with MHT is associated with local cell destruction triggered by the magnetic nano-heaters. The present study is an essential step toward the development of innovative adjuvant anti-cancer therapies based on local hyperthermia treatments using magnetic particles as nano-heaters.
△ Less
Submitted 7 November, 2016;
originally announced November 2016.
-
Long term stability and reproducibility of magnetic colloids are key issues for steady values of Specific Power Absorption through time
Authors:
B. Sanz,
M. P. Calatayud,
N. Cassinelli,
M. R. Ibarra,
G. F. Goya
Abstract:
Virtually all clinical applications of magnetic nanoparticles (MNPs) require the formulation of biocompatible, water-based magnetic colloids. For magnetic hyperthermia, the requirements also include a high colloidal stability against precipitation and agglomeration of the constituent MNPs, in order to keep the heating efficiency of the ferrofluid in the long term. The specific power absorption (SP…
▽ More
Virtually all clinical applications of magnetic nanoparticles (MNPs) require the formulation of biocompatible, water-based magnetic colloids. For magnetic hyperthermia, the requirements also include a high colloidal stability against precipitation and agglomeration of the constituent MNPs, in order to keep the heating efficiency of the ferrofluid in the long term. The specific power absorption (SPA) of single-domain MNPs depends critically on the average particle size and size distribution width, therefore first-rate reproducibility among different batches regarding these parameters are also needed. We have studied the evolution of the SPA of highly reproducible and stable water-based colloid composed of polymer coated $Fe_{3}O_{4}$ magnetic nanoparticles. By measuring the specific power absorption (SPA) values along one year as a function of field amplitude and frequencies ($H \leq 24 kA/m$; $260 \leq f \leq 830 kHz$), we demonstrated that SPA in these samples can be made reproducible between successive synthesis, and stable along several months, due to the in situ polymer coating that provides colloidal stability and keeps dipolar interactions negligible.
△ Less
Submitted 25 August, 2016;
originally announced September 2016.
-
Protein adsorption onto Fe3O4 nanoparticles with opposite surface charge and its impact on cell uptake
Authors:
M. P. Catalayud,
B. Sanz,
V. Raffa,
C. Riggio,
M. R. Ibarra,
G. F. Goya
Abstract:
Nanoparticles (NPs) engineered for biomedical applications are meant to be in contact with protein-rich physiological fluids. These proteins are usually adsorbed onto the NP surface, forming a swaddling layer called protein corona that influences cell internalization. We present a study on protein adsorption onto different magnetic NPs (MNPs) when immersed in cell culture medium, and how these cha…
▽ More
Nanoparticles (NPs) engineered for biomedical applications are meant to be in contact with protein-rich physiological fluids. These proteins are usually adsorbed onto the NP surface, forming a swaddling layer called protein corona that influences cell internalization. We present a study on protein adsorption onto different magnetic NPs (MNPs) when immersed in cell culture medium, and how these changes affect the cellular uptake. Two colloids with magnetite cores of 25 nm, same hydrodynamic size and opposite surface charge were in situ coated with (a) positive polyethyleneimine (PEI-MNPs) and (b) negative poly(acrylic acid) (PAA-MNPs). After few minutes of incubation in cell culture medium the wrap** of the MNPs by protein adsorption resulted in a 5-fold size increase. After 24 h of incubation large MNP-protein aggregates with hydrodynamic sizes 1500 to 3000 nm (PAA-MNPs and PEI-MNPs respectively) were observed. Each cluster contained an estimated number of magnetic cores between 450 and 1000, indicating the formation of large aggregates with a "plum pudding" structure of MNPs embedded into a protein network of negative surface charge irrespective of the MNP_core charge. We demonstrated that PEI-MNPs are incorporated in much larger amounts than the PAA-MNPs units. Quantitative analysis showed that SH-SY5Y cells can incorporate 100 per cent of the added PEI-MNPs up to about 100 pg per cell, whereas for PAA-MNPs the uptake was less than 50 percent. The final cellular distribution showed also notable differences regarding partial attachment to the cell membrane. These results highlight the need to characterize the final properties of MNPs after protein adsorption in biological media, and demonstrate the impact of these properties on the internalization mechanisms in neural cells.
△ Less
Submitted 24 March, 2014; v1 submitted 16 March, 2014;
originally announced March 2014.
-
Viscosity solutions to second order partial differential equations on Riemannian manifolds
Authors:
Daniel Azagra,
Juan Ferrera,
Beatriz Sanz
Abstract:
We prove comparison, uniqueness and existence results for viscosity solutions to a wide class of fully nonlinear second order partial differential equations $F(x, u, du, d^{2}u)=0$ defined on a finite-dimensional Riemannian manifold $M$. Finest results (with hypothesis that require the function $F$ to be degenerate elliptic, that is nonincreasing in the second order derivative variable, and unif…
▽ More
We prove comparison, uniqueness and existence results for viscosity solutions to a wide class of fully nonlinear second order partial differential equations $F(x, u, du, d^{2}u)=0$ defined on a finite-dimensional Riemannian manifold $M$. Finest results (with hypothesis that require the function $F$ to be degenerate elliptic, that is nonincreasing in the second order derivative variable, and uniformly continuous with respect to the variable $x$) are obtained under the assumption that $M$ has nonnegative sectional curvature, while, if one additionally requires $F$ to depend on $d^{2}u$ in a uniformly continuous manner, then comparison results are established with no restrictive assumptions on curvature.
△ Less
Submitted 12 March, 2008; v1 submitted 23 December, 2006;
originally announced December 2006.
