Showing 1–2 of 2 results for author: Klimenko, D
-
On limitations of learning algorithms in competitive environments
Authors:
Alexander Y Klimenko,
Dimitri A Klimenko
Abstract:
We discuss conceptual limitations of generic learning algorithms pursuing adversarial goals in competitive environments, and prove that they are subject to limitations that are analogous to the constraints on knowledge imposed by the famous theorems of Gödel and Turing. These limitations are shown to be related to intransitivity, which is commonly present in competitive environments.
We discuss conceptual limitations of generic learning algorithms pursuing adversarial goals in competitive environments, and prove that they are subject to limitations that are analogous to the constraints on knowledge imposed by the famous theorems of Gödel and Turing. These limitations are shown to be related to intransitivity, which is commonly present in competitive environments.
△ Less
Submitted 18 June, 2021; v1 submitted 25 November, 2020;
originally announced November 2020.
-
A Stochastic Process Model of Classical Search
Authors:
Dimitri Klimenko,
Hanna Kurniawati,
Marcus Gallagher
Abstract:
Among classical search algorithms with the same heuristic information, with sufficient memory A* is essentially as fast as possible in finding a proven optimal solution. However, in many situations optimal solutions are simply infeasible, and thus search algorithms that trade solution quality for speed are desirable. In this paper, we formalize the process of classical search as a metalevel decisi…
▽ More
Among classical search algorithms with the same heuristic information, with sufficient memory A* is essentially as fast as possible in finding a proven optimal solution. However, in many situations optimal solutions are simply infeasible, and thus search algorithms that trade solution quality for speed are desirable. In this paper, we formalize the process of classical search as a metalevel decision problem, the Abstract Search MDP. For any given optimization criterion, this establishes a well-defined notion of the best possible behaviour for a search algorithm and offers a theoretical approach to the design of algorithms for that criterion. We proceed to approximately solve a version of the Abstract Search MDP for anytime algorithms and thus derive a novel search algorithm, Search by Maximizing the Incremental Rate of Improvement (SMIRI). SMIRI is shown to outperform current state-of-the-art anytime search algorithms on a parametrized stochastic tree model for most of the tested parameter values.
△ Less
Submitted 27 November, 2015;
originally announced November 2015.
