-
Making Contextual Decisions with Low Technical Debt
Authors:
Alekh Agarwal,
Sarah Bird,
Markus Cozowicz,
Luong Hoang,
John Langford,
Stephen Lee,
Jiaji Li,
Dan Melamed,
Gal Oshri,
Oswaldo Ribas,
Siddhartha Sen,
Alex Slivkins
Abstract:
Applications and systems are constantly faced with decisions that require picking from a set of actions based on contextual information. Reinforcement-based learning algorithms such as contextual bandits can be very effective in these settings, but applying them in practice is fraught with technical debt, and no general system exists that supports them completely. We address this and create the fi…
▽ More
Applications and systems are constantly faced with decisions that require picking from a set of actions based on contextual information. Reinforcement-based learning algorithms such as contextual bandits can be very effective in these settings, but applying them in practice is fraught with technical debt, and no general system exists that supports them completely. We address this and create the first general system for contextual learning, called the Decision Service.
Existing systems often suffer from technical debt that arises from issues like incorrect data collection and weak debuggability, issues we systematically address through our ML methodology and system abstractions. The Decision Service enables all aspects of contextual bandit learning using four system abstractions which connect together in a loop: explore (the decision space), log, learn, and deploy. Notably, our new explore and log abstractions ensure the system produces correct, unbiased data, which our learner uses for online learning and to enable real-time safeguards, all in a fully reproducible manner.
The Decision Service has a simple user interface and works with a variety of applications: we present two live production deployments for content recommendation that achieved click-through improvements of 25-30%, another with 18% revenue lift in the landing page, and ongoing applications in tech support and machine failure handling. The service makes real-time decisions and learns continuously and scalably, while significantly lowering technical debt.
△ Less
Submitted 9 May, 2017; v1 submitted 13 June, 2016;
originally announced June 2016.
-
Cosmological model with fermion and tachyon fields interacting via Yukawa-type potential
Authors:
Marlos O. Ribas,
Fernando P. Devecchi,
Gilberto M. Kremer
Abstract:
A model for the universe with tachyonic and fermionic fields interacting through a Yukawa-type potential is investigated. It is shown that the tachyonic field answers for the initial accelerated regime and for the subsequent decelerated regime so that it behaves as an inflaton at early times and as a matter field at intermediate times, while the fermionic field has the role of a dark energy consti…
▽ More
A model for the universe with tachyonic and fermionic fields interacting through a Yukawa-type potential is investigated. It is shown that the tachyonic field answers for the initial accelerated regime and for the subsequent decelerated regime so that it behaves as an inflaton at early times and as a matter field at intermediate times, while the fermionic field has the role of a dark energy constituent, since it leads to an accelerated regime at later times. The interaction between the fields via a Yukawa-type potential controls the duration of the decelerated era, since a stronger coupling makes a shorter decelerated period.
△ Less
Submitted 22 February, 2016;
originally announced February 2016.
-
Isotropization in Bianchi type-I cosmological model with fermions and bosons interacting via Yukawa potential
Authors:
M. O. Ribas,
L. L. Samojeden,
F. P. Devecchi,
G. M. Kremer
Abstract:
In this work we investigate a model for the early Universe in a Bianchi type-I metric, where the sources of the gravitational field are a fermionic and a bosonic field, interacting through a Yukawa potential, following the standard model of elementary particles. It is shown that the fermionic field has a negative pressure, while the boson has a small positive pressure. The fermionic field is the r…
▽ More
In this work we investigate a model for the early Universe in a Bianchi type-I metric, where the sources of the gravitational field are a fermionic and a bosonic field, interacting through a Yukawa potential, following the standard model of elementary particles. It is shown that the fermionic field has a negative pressure, while the boson has a small positive pressure. The fermionic field is the responsible for an accelerated regime at early times, but since the total pressure tends to zero for large times, a transition to a decelerated regime occurs. Here the Yukawa potential answers for the duration of the accelerated regime, since by decreasing the value of its coupling constant the transition accelerated-decelerated occurs in later times. The isotropization which occurs for late times is due to the presence of the fermionic field as one of the sources of the gravitational field.
△ Less
Submitted 5 October, 2015;
originally announced October 2015.
-
Exit from accelerated regimes by symmetry breaking in a universe filled with fermionic and bosonic sources
Authors:
Marlos O. Ribas,
Pedro Zambianchi Jr.,
Fernando P. Devecchi,
Gilberto M. Kremer
Abstract:
In this work we investigate a universe filled with a fermionic field and a complex scalar field, exchanging energy through a Yukawa potential; the model encodes a symmetry breaking mechanism (on the bosonic sector). In a first case, when the mechanism is not included, the cosmological model furnishes a pure accelerated regime. In a second case, when including the symmetry breaking mechanism, we ve…
▽ More
In this work we investigate a universe filled with a fermionic field and a complex scalar field, exchanging energy through a Yukawa potential; the model encodes a symmetry breaking mechanism (on the bosonic sector). In a first case, when the mechanism is not included, the cosmological model furnishes a pure accelerated regime. In a second case, when including the symmetry breaking mechanism, we verify that the fermion and one of the bosons, of Higgs type, become massive, while the other boson is massless. Besides, the mechanism shows to be responsible for a transition from an accelerated to a decelerated regime, which certifies the importance, in cosmological terms, of its role. After symmetry breaking, the total pressure of the fields change its sign from negative to positive corresponding to the accelerated-decelerated transition. For large times the universe becomes a dust (pressureless) dominated Universe.
△ Less
Submitted 11 April, 2014;
originally announced April 2014.
-
Fermions in a Walecka-type cosmology
Authors:
Marlos O. Ribas,
Pedro Zambianchi Jr.,
Fernando P. Devecchi,
Gilberto M. Kremer
Abstract:
A simplified Walecka-type model is investigated in a cosmological scenario. The model includes fermionic, scalar and vector fields as sources. It is shown that their interactions, taking place in a Robertson-Walker metric, could be responsible for the transition of accelerated-decelerated periods in the early universe and a current accelerated regime. It is also discussed the role of the fermionic…
▽ More
A simplified Walecka-type model is investigated in a cosmological scenario. The model includes fermionic, scalar and vector fields as sources. It is shown that their interactions, taking place in a Robertson-Walker metric, could be responsible for the transition of accelerated-decelerated periods in the early universe and a current accelerated regime. It is also discussed the role of the fermionic field as the promoter of the accelerated regimes in the early and the late stages of the universe.
△ Less
Submitted 13 January, 2012;
originally announced January 2012.
-
Fermionic cosmologies with Yukawa type interactions
Authors:
Marlos O. Ribas,
Fernando P. Devecchi,
Gilberto M. Kremer
Abstract:
In this work we discuss if fermionic sources could be responsible for accelerated periods in a Friedmann-Robertson-Walker spatially flat universe, including a usual self-interaction potential of the Nambu-Jona-Lasinio type together with a fermion-scalar interaction potential of the Yukawa type. The results show that the combination of these potentials could promote an initially accelerated period,…
▽ More
In this work we discuss if fermionic sources could be responsible for accelerated periods in a Friedmann-Robertson-Walker spatially flat universe, including a usual self-interaction potential of the Nambu-Jona-Lasinio type together with a fermion-scalar interaction potential of the Yukawa type. The results show that the combination of these potentials could promote an initially accelerated period, going through a middle decelerated era, with a final eternal accelerated period, where the self-interaction contribution dominates.
△ Less
Submitted 27 December, 2010;
originally announced December 2010.
-
Fermion fields in Einstein-Cartan theory and the accelerated-decelerated transition in a primordial Universe
Authors:
Marlos O. Ribas,
Gilberto M. Kremer
Abstract:
In this work the accelerated-decelerated transition in a primordial Universe is investigated by using the dynamics of fermion fields within the context of Einstein-Cartan theory, where apart from the curvature the space-time is also described by a torsion field. The model analyzed here has only a fermion field as the source of the gravitational field. The term associated with the spin of the fer…
▽ More
In this work the accelerated-decelerated transition in a primordial Universe is investigated by using the dynamics of fermion fields within the context of Einstein-Cartan theory, where apart from the curvature the space-time is also described by a torsion field. The model analyzed here has only a fermion field as the source of the gravitational field. The term associated with the spin of the fermion field plays the role of the inflaton which contributes to an accelerated regime whereas the one related to the fermion mass behaves as a matter field and is the responsible for a decelerated regime. Hence, by taking into account the spin of a massive fermion field it is possible to characterize the transition from the accelerated to the decelerated periods of the primordial Universe.
△ Less
Submitted 17 February, 2010; v1 submitted 16 February, 2009;
originally announced February 2009.
-
Tachyonization of the $\La$CDM cosmological model
Authors:
Luis P. Chimento,
Mónica Forte,
Gilberto M. Kremer,
Marlos O. Ribas
Abstract:
In this work a tachyonization of the $Λ$CDM model for a spatially flat Friedmann-Robertson-Walker space-time is proposed. A tachyon field and a cosmological constant are considered as the sources of the gravitational field. Starting from a stability analysis and from the exact solutions for a standard tachyon field driven by a given potential, the search for a large set of cosmological models wh…
▽ More
In this work a tachyonization of the $Λ$CDM model for a spatially flat Friedmann-Robertson-Walker space-time is proposed. A tachyon field and a cosmological constant are considered as the sources of the gravitational field. Starting from a stability analysis and from the exact solutions for a standard tachyon field driven by a given potential, the search for a large set of cosmological models which contain the $Λ$CDM model is investigated. By the use of internal transformations two new kinds of tachyon fields are derived from the standard tachyon field, namely, a complementary and a phantom tachyon fields. Numerical solutions for the three kinds of tachyon fields are determined and it is shown that the standard and complementary tachyon fields reproduces the $Λ$CDM model as a limiting case. The standard tachyon field can also describe a transition from an accelerated to a decelerated regime, behaving as an inflaton field at early times and as a matter field at late times. The complementary tachyon field always behaves as a matter field. The phantom tachyon field is characterized by a rapid expansion where its energy density increases with time.
△ Less
Submitted 18 December, 2009; v1 submitted 11 September, 2008;
originally announced September 2008.
-
Cosmological model with non-minimally coupled fermionic field
Authors:
M. O. Ribas,
F. P. Devecchi,
G. M. Kremer
Abstract:
A model for the Universe is proposed whose constituents are: (a) a dark energy field modeled by a fermionic field non-minimally coupled with the gravitational field, (b) a matter field which consists of pressureless baryonic and dark matter fields and (c) a field which represents the radiation and the neutrinos. The coupled system of Dirac's equations and Einstein field equations is solved numer…
▽ More
A model for the Universe is proposed whose constituents are: (a) a dark energy field modeled by a fermionic field non-minimally coupled with the gravitational field, (b) a matter field which consists of pressureless baryonic and dark matter fields and (c) a field which represents the radiation and the neutrinos. The coupled system of Dirac's equations and Einstein field equations is solved numerically by considering a spatially flat homogeneous and isotropic Universe. It is shown that the proposed model can reproduce the expected red-shift behaviors of the deceleration parameter, of the density parameters of each constituent and of the luminosity distance. Furthermore, for small values of the red-shift the constant which couples the fermionic and gravitational fields has a remarkable influence on the density and deceleration parameters.
△ Less
Submitted 26 October, 2007;
originally announced October 2007.
-
Fermions as sources of accelerated regimes in cosmology
Authors:
M. O. Ribas,
F. P. Devecchi,
G. M. Kremer
Abstract:
In this work it is investigated if fermionic sources could be responsible for accelerated periods during the evolution of a universe where a matter field would answer for the decelerated period. The self-interaction potential of the fermionic field is considered as a function of the scalar and pseudo-scalar invariants. Irreversible processes of energy transfer between the matter and gravitationa…
▽ More
In this work it is investigated if fermionic sources could be responsible for accelerated periods during the evolution of a universe where a matter field would answer for the decelerated period. The self-interaction potential of the fermionic field is considered as a function of the scalar and pseudo-scalar invariants. Irreversible processes of energy transfer between the matter and gravitational fields are also considered. It is shown that the fermionic field could behave like an inflaton field in the early universe and as dark energy for an old universe.
△ Less
Submitted 17 November, 2005;
originally announced November 2005.
