Showing 1–2 of 2 results for author: Katzhendler, G

Approximate Description Length, Covering Numbers, and VC Dimension

Authors: Amit Daniely, Gal Katzhendler

Abstract: Recently, Daniely and Granot [arXiv:1910.05697] introduced a new notion of complexity called Approximate Description Length (ADL). They used it to derive novel generalization bounds for neural networks, that despite substantial work, were out of reach for more classical techniques such as discretization, Covering Numbers and Rademacher Complexity. In this paper we explore how ADL relates to classi… ▽ More Recently, Daniely and Granot [arXiv:1910.05697] introduced a new notion of complexity called Approximate Description Length (ADL). They used it to derive novel generalization bounds for neural networks, that despite substantial work, were out of reach for more classical techniques such as discretization, Covering Numbers and Rademacher Complexity. In this paper we explore how ADL relates to classical notions of function complexity such as Covering Numbers and VC Dimension. We find that for functions whose range is the reals, ADL is essentially equivalent to these classical complexity measures. However, this equivalence breaks for functions with high dimensional range. △ Less

Submitted 26 September, 2022; originally announced September 2022.

Blurred Images Lead to Bad Local Minima

Authors: Gal Katzhendler, Daphna Weinshall

Abstract: Blurred Images Lead to Bad Local Minima Blurred Images Lead to Bad Local Minima △ Less

Submitted 30 January, 2019; originally announced January 2019.