Understanding and Estimating Domain Complexity Across Domains
Authors:
Katarina Doctor,
Mayank Kejriwal,
Lawrence Holder,
Eric Kildebeck,
Emma Resmini,
Christopher Pereyda,
Robert J. Steininger,
Daniel V. Olivença
Abstract:
Artificial Intelligence (AI) systems, trained in controlled environments, often struggle in real-world complexities. We propose a general framework for estimating domain complexity across diverse environments, like open-world learning and real-world applications. This framework distinguishes between intrinsic complexity (inherent to the domain) and extrinsic complexity (dependent on the AI agent).…
▽ More
Artificial Intelligence (AI) systems, trained in controlled environments, often struggle in real-world complexities. We propose a general framework for estimating domain complexity across diverse environments, like open-world learning and real-world applications. This framework distinguishes between intrinsic complexity (inherent to the domain) and extrinsic complexity (dependent on the AI agent). By analyzing dimensionality, sparsity, and diversity within these categories, we offer a comprehensive view of domain challenges. This approach enables quantitative predictions of AI difficulty during environment transitions, avoids bias in novel situations, and helps navigate the vast search spaces of open-world domains.
△ Less
Submitted 20 December, 2023;
originally announced December 2023.
