-
Unifying distillation and privileged information
Abstract: Distillation (Hinton et al., 2015) and privileged information (Vapnik & Izmailov, 2015) are two techniques that enable machines to learn from other machines. This paper unifies these two techniques into generalized distillation, a framework to learn from multiple machines and data representations. We provide theoretical and causal insight about the inner workings of generalized distillation, exten… ▽ More
Submitted 25 February, 2016; v1 submitted 11 November, 2015; originally announced November 2015.
Journal ref: Proceedings of the International Conference on Learning Representations (2016) 1-10
-
Learning by Transduction
Abstract: We describe a method for predicting a classification of an object given classifications of the objects in the training set, assuming that the pairs object/classification are generated by an i.i.d. process from a continuous probability distribution. Our method is a modification of Vapnik's support-vector machine; its main novelty is that it gives not only the prediction itself but also a practicabl… ▽ More
Submitted 30 January, 2013; originally announced January 2013.
Comments: Appears in Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI1998)
Report number: UAI-P-1998-PG-148-155