-
Conversion-Based Dynamic-Creative-Optimization in Native Advertising
Authors:
Yohay Kaplan,
Yair Koren,
Alex Shtoff,
Tomer Shadi,
Oren Somekh
Abstract:
Yahoo Gemini native advertising marketplace serves billions of impressions daily, to hundreds millions of unique users, and reaches a yearly revenue of many hundreds of millions USDs. Powering Gemini native models for predicting advertise (ad) event probabilities, such as conversions and clicks, is OFFSET - a feature enhanced collaborative-filtering (CF) based event prediction algorithm. The predi…
▽ More
Yahoo Gemini native advertising marketplace serves billions of impressions daily, to hundreds millions of unique users, and reaches a yearly revenue of many hundreds of millions USDs. Powering Gemini native models for predicting advertise (ad) event probabilities, such as conversions and clicks, is OFFSET - a feature enhanced collaborative-filtering (CF) based event prediction algorithm. The predicted probabilities are then used in Gemini native auctions to determine which ads to present for every serving event (impression). Dynamic creative optimization (DCO) is a recent Gemini native product that was launched two years ago and is increasingly gaining more attention from advertisers. The DCO product enables advertisers to issue several assets per each native ad attribute, creating multiple combinations for each DCO ad. Since different combinations may appeal to different crowds, it may be beneficial to present certain combinations more frequently than others to maximize revenue while kee** advertisers and users satisfied. The initial DCO offer was to optimize click-through rates (CTR), however as the marketplace shifts more towards conversion based campaigns, advertisers also ask for a {conversion based solution. To accommodate this request, we present a post-auction solution, where DCO ads combinations are favored according to their predicted conversion rate (CVR). The predictions are provided by an auxiliary OFFSET based combination CVR prediction model, and used to generate the combination distributions for DCO ad rendering during serving time. An online evaluation of this explore-exploit solution, via online bucket A/B testing, serving Gemini native DCO traffic, showed a 53.5% CVR lift, when compared to a control bucket serving all combinations uniformly at random.
△ Less
Submitted 13 November, 2022;
originally announced November 2022.
-
Mitigating Divergence of Latent Factors via Dual Ascent for Low Latency Event Prediction Models
Authors:
Alex Shtoff,
Yair Koren
Abstract:
Real-world content recommendation marketplaces exhibit certain behaviors and are imposed by constraints that are not always apparent in common static offline data sets. One example that is common in ad marketplaces is swift ad turnover. New ads are introduced and old ads disappear at high rates every day. Another example is ad discontinuity, where existing ads may appear and disappear from the mar…
▽ More
Real-world content recommendation marketplaces exhibit certain behaviors and are imposed by constraints that are not always apparent in common static offline data sets. One example that is common in ad marketplaces is swift ad turnover. New ads are introduced and old ads disappear at high rates every day. Another example is ad discontinuity, where existing ads may appear and disappear from the market for non negligible amounts of time due to a variety of reasons (e.g., depletion of budget, pausing by the advertiser, flagging by the system, and more). These behaviors sometimes cause the model's loss surface to change dramatically over short periods of time. To address these behaviors, fresh models are highly important, and to achieve this (and for several other reasons) incremental training on small chunks of past events is often employed. These behaviors and algorithmic optimizations occasionally cause model parameters to grow uncontrollably large, or \emph{diverge}. In this work present a systematic method to prevent model parameters from diverging by imposing a carefully chosen set of constraints on the model's latent vectors. We then devise a method inspired by primal-dual optimization algorithms to fulfill these constraints in a manner which both aligns well with incremental model training, and does not require any major modifications to the underlying model training algorithm.
We analyze, demonstrate, and motivate our method on OFFSET, a collaborative filtering algorithm which drives Yahoo native advertising, which is one of VZM's largest and faster growing businesses, reaching a run-rate of many hundreds of millions USD per year. Finally, we conduct an online experiment which shows a substantial reduction in the number of diverging instances, and a significant improvement to both user experience and revenue.
△ Less
Submitted 15 November, 2021;
originally announced November 2021.
-
iALS++: Speeding up Matrix Factorization with Subspace Optimization
Authors:
Steffen Rendle,
Walid Krichene,
Li Zhang,
Yehuda Koren
Abstract:
iALS is a popular algorithm for learning matrix factorization models from implicit feedback with alternating least squares. This algorithm was invented over a decade ago but still shows competitive quality compared to recent approaches like VAE, EASE, SLIM, or NCF. Due to a computational trick that avoids negative sampling, iALS is very efficient especially for large item catalogues. However, iALS…
▽ More
iALS is a popular algorithm for learning matrix factorization models from implicit feedback with alternating least squares. This algorithm was invented over a decade ago but still shows competitive quality compared to recent approaches like VAE, EASE, SLIM, or NCF. Due to a computational trick that avoids negative sampling, iALS is very efficient especially for large item catalogues. However, iALS does not scale well with large embedding dimensions, d, due to its cubic runtime dependency on d. Coordinate descent variations, iCD, have been proposed to lower the complexity to quadratic in d. In this work, we show that iCD approaches are not well suited for modern processors and can be an order of magnitude slower than a careful iALS implementation for small to mid scale embedding sizes (d ~ 100) and only perform better than iALS on large embeddings d ~ 1000. We propose a new solver iALS++ that combines the advantages of iALS in terms of vector processing with a low computational complexity as in iCD. iALS++ is an order of magnitude faster than iCD both for small and large embedding dimensions. It can solve benchmark problems like Movielens 20M or Million Song Dataset even for 1000 dimensional embedding vectors in a few minutes.
△ Less
Submitted 26 October, 2021;
originally announced October 2021.
-
Revisiting the Performance of iALS on Item Recommendation Benchmarks
Authors:
Steffen Rendle,
Walid Krichene,
Li Zhang,
Yehuda Koren
Abstract:
Matrix factorization learned by implicit alternating least squares (iALS) is a popular baseline in recommender system research publications. iALS is known to be one of the most computationally efficient and scalable collaborative filtering methods. However, recent studies suggest that its prediction quality is not competitive with the current state of the art, in particular autoencoders and other…
▽ More
Matrix factorization learned by implicit alternating least squares (iALS) is a popular baseline in recommender system research publications. iALS is known to be one of the most computationally efficient and scalable collaborative filtering methods. However, recent studies suggest that its prediction quality is not competitive with the current state of the art, in particular autoencoders and other item-based collaborative filtering methods. In this work, we revisit the iALS algorithm and present a bag of tricks that we found useful when applying iALS. We revisit four well-studied benchmarks where iALS was reported to perform poorly and show that with proper tuning, iALS is highly competitive and outperforms any method on at least half of the comparisons. We hope that these high quality results together with iALS's known scalability spark new interest in applying and further improving this decade old technique.
△ Less
Submitted 26 October, 2021;
originally announced October 2021.
-
Elastic Anisotropy Governs the Decay of Cell-induced Displacements
Authors:
Shahar Goren,
Yoni Koren,
Xinpeng Xu,
Ayelet Lesman
Abstract:
The unique nonlinear mechanics of the fibrous extracellular matrix (ECM) facilitates long-range cell-cell mechanical communications that would be impossible on linear elastic substrates. Past research has described the contribution of two separated effects on the range of force transmission, including ECM elastic non-linearity and fiber alignment. However, the relation between these different effe…
▽ More
The unique nonlinear mechanics of the fibrous extracellular matrix (ECM) facilitates long-range cell-cell mechanical communications that would be impossible on linear elastic substrates. Past research has described the contribution of two separated effects on the range of force transmission, including ECM elastic non-linearity and fiber alignment. However, the relation between these different effects is unclear, and how they combine to dictate force transmission range is still elusive. Here, we combine discrete fiber simulations with continuum modeling to study the decay of displacements induced by a contractile cell in fibrous networks. We demonstrate that fiber non-linearity and fiber reorientation both contribute to the strain-induced anisotropy of the elastic moduli of the cell local environment. This elastic anisotropy is a parameter that governs the slow decay of the displacements, and it depends on the magnitude of applied strain, either an external tension or an internal contraction as a model of the cell. Furthermore, we show that accounting for artificially-prescribed elastic anisotropy dictates the displacement decay induced by a contracting cell. Our findings unify previous single effects into a mechanical theory that explains force transmission in fibrous networks. This work provides important insights into biological processes that involve the coordinated action of distant cells mediated by the ECM, such that occur in morphogenesis, wound healing, angiogenesis, and cancer metastasis. It may also provide design parameters for biomaterials to control force transmission between cells, as a way to guide morphogenesis in tissue engineering.
△ Less
Submitted 10 May, 2019;
originally announced May 2019.
-
On the Difficulty of Evaluating Baselines: A Study on Recommender Systems
Authors:
Steffen Rendle,
Li Zhang,
Yehuda Koren
Abstract:
Numerical evaluations with comparisons to baselines play a central role when judging research in recommender systems. In this paper, we show that running baselines properly is difficult. We demonstrate this issue on two extensively studied datasets. First, we show that results for baselines that have been used in numerous publications over the past five years for the Movielens 10M benchmark are su…
▽ More
Numerical evaluations with comparisons to baselines play a central role when judging research in recommender systems. In this paper, we show that running baselines properly is difficult. We demonstrate this issue on two extensively studied datasets. First, we show that results for baselines that have been used in numerous publications over the past five years for the Movielens 10M benchmark are suboptimal. With a careful setup of a vanilla matrix factorization baseline, we are not only able to improve upon the reported results for this baseline but even outperform the reported results of any newly proposed method. Secondly, we recap the tremendous effort that was required by the community to obtain high quality results for simple methods on the Netflix Prize. Our results indicate that empirical findings in research papers are questionable unless they were obtained on standardized benchmarks where baselines have been tuned extensively by the research community.
△ Less
Submitted 3 May, 2019;
originally announced May 2019.
-
Recommender Systems for the Conference Paper Assignment Problem
Authors:
Don Conry,
Yehuda Koren,
Naren Ramakrishnan
Abstract:
Conference paper assignment, i.e., the task of assigning paper submissions to reviewers, presents multi-faceted issues for recommender systems research. Besides the traditional goal of predicting `who likes what?', a conference management system must take into account aspects such as: reviewer capacity constraints, adequate numbers of reviews for papers, expertise modeling, conflicts of interest…
▽ More
Conference paper assignment, i.e., the task of assigning paper submissions to reviewers, presents multi-faceted issues for recommender systems research. Besides the traditional goal of predicting `who likes what?', a conference management system must take into account aspects such as: reviewer capacity constraints, adequate numbers of reviews for papers, expertise modeling, conflicts of interest, and an overall distribution of assignments that balances reviewer preferences with conference objectives. Among these, issues of modeling preferences and tastes in reviewing have traditionally been studied separately from the optimization of paper-reviewer assignment. In this paper, we present an integrated study of both these aspects. First, due to the paucity of data per reviewer or per paper (relative to other recommender systems applications) we show how we can integrate multiple sources of information to learn paper-reviewer preference models. Second, our models are evaluated not just in terms of prediction accuracy but in terms of the end-assignment quality. Using a linear programming-based assignment optimization formulation, we show how our approach better explores the space of unsupplied assignments to maximize the overall affinities of papers assigned to reviewers. We demonstrate our results on real reviewer preference data from the IEEE ICDM 2007 conference.
△ Less
Submitted 22 June, 2009;
originally announced June 2009.
