-
No More Pesky Hyperparameters: Offline Hyperparameter Tuning for RL
Authors:
Han Wang,
Archit Sakhadeo,
Adam White,
James Bell,
Vincent Liu,
Xutong Zhao,
Puer Liu,
Tadashi Kozuno,
Alona Fyshe,
Martha White
Abstract:
The performance of reinforcement learning (RL) agents is sensitive to the choice of hyperparameters. In real-world settings like robotics or industrial control systems, however, testing different hyperparameter configurations directly on the environment can be financially prohibitive, dangerous, or time consuming. We propose a new approach to tune hyperparameters from offline logs of data, to full…
▽ More
The performance of reinforcement learning (RL) agents is sensitive to the choice of hyperparameters. In real-world settings like robotics or industrial control systems, however, testing different hyperparameter configurations directly on the environment can be financially prohibitive, dangerous, or time consuming. We propose a new approach to tune hyperparameters from offline logs of data, to fully specify the hyperparameters for an RL agent that learns online in the real world. The approach is conceptually simple: we first learn a model of the environment from the offline data, which we call a calibration model, and then simulate learning in the calibration model to identify promising hyperparameters. We identify several criteria to make this strategy effective, and develop an approach that satisfies these criteria. We empirically investigate the method in a variety of settings to identify when it is effective and when it fails.
△ Less
Submitted 18 May, 2022;
originally announced May 2022.
-
Commonsense Properties from Query Logs and Question Answering Forums
Authors:
Julien Romero,
Simon Razniewski,
Koninika Pal,
Jeff Z. Pan,
Archit Sakhadeo,
Gerhard Weikum
Abstract:
Commonsense knowledge about object properties, human behavior and general concepts is crucial for robust AI applications. However, automatic acquisition of this knowledge is challenging because of sparseness and bias in online sources. This paper presents Quasimodo, a methodology and tool suite for distilling commonsense properties from non-standard web sources. We devise novel ways of tap** int…
▽ More
Commonsense knowledge about object properties, human behavior and general concepts is crucial for robust AI applications. However, automatic acquisition of this knowledge is challenging because of sparseness and bias in online sources. This paper presents Quasimodo, a methodology and tool suite for distilling commonsense properties from non-standard web sources. We devise novel ways of tap** into search-engine query logs and QA forums, and combining the resulting candidate assertions with statistical cues from encyclopedias, books and image tags in a corroboration step. Unlike prior work on commonsense knowledge bases, Quasimodo focuses on salient properties that are typically associated with certain objects or concepts. Extensive evaluations, including extrinsic use-case studies, show that Quasimodo provides better coverage than state-of-the-art baselines with comparable quality.
△ Less
Submitted 10 February, 2021; v1 submitted 27 May, 2019;
originally announced May 2019.
-
GMRT Archive Processing Project
Authors:
Shubhankar Deshpande,
Yogesh Wadadekar,
Huib Intema,
B. Ratnakumar,
Lijo George,
Rathin Desai,
Archit Sakhadeo,
Shadab Shaikh,
C. H. Ishwara-Chandra,
Divya Oberoi
Abstract:
The GMRT Online Archive now houses over 120 terabytes of interferometric observations obtained with the GMRT since the observatory began operating as a facility in 2002. The utility of this vast data archive, likely the largest of any Indian telescope, can be significantly enhanced if first look (and where possible, science ready) processed images can be made available to the user community. We ha…
▽ More
The GMRT Online Archive now houses over 120 terabytes of interferometric observations obtained with the GMRT since the observatory began operating as a facility in 2002. The utility of this vast data archive, likely the largest of any Indian telescope, can be significantly enhanced if first look (and where possible, science ready) processed images can be made available to the user community. We have initiated a project to pipeline process GMRT images in the 150, 240, 325 and 610 MHz bands. The thousands of processed continuum images that we will produce will prove useful in studies of distant galaxy clusters, radio AGN, as well as nearby galaxies and star forming regions. Besides the scientific returns, a uniform data processing pipeline run on a large volume of data can be used in other interesting ways. For example, we will be able to measure various performance characteristics of the GMRT telescope and their dependence on waveband, time of day, RFI environment, backend, galactic latitude etc. in a systematic way. A variety of data products such as calibrated UVFITS data, sky images and AIPS processing logs will be delivered to users via a web-based interface. Data products will be compatible with standard Virtual Observatory protocols.
△ Less
Submitted 6 December, 2018;
originally announced December 2018.
-
Effective extractive summarization using frequency-filtered entity relationship graphs
Authors:
Archit Sakhadeo,
Nisheeth Srivastava
Abstract:
Word frequency-based methods for extractive summarization are easy to implement and yield reasonable results across languages. However, they have significant limitations - they ignore the role of context, they offer uneven coverage of topics in a document, and sometimes are disjointed and hard to read. We use a simple premise from linguistic typology - that English sentences are complete descripto…
▽ More
Word frequency-based methods for extractive summarization are easy to implement and yield reasonable results across languages. However, they have significant limitations - they ignore the role of context, they offer uneven coverage of topics in a document, and sometimes are disjointed and hard to read. We use a simple premise from linguistic typology - that English sentences are complete descriptors of potential interactions between entities, usually in the order subject-verb-object - to address a subset of these difficulties. We have developed a hybrid model of extractive summarization that combines word-frequency based keyword identification with information from automatically generated entity relationship graphs to select sentences for summaries. Comparative evaluation with word-frequency and topic word-based methods shows that the proposed method is competitive by conventional ROUGE standards, and yields moderately more informative summaries on average, as assessed by a large panel (N=94) of human raters.
△ Less
Submitted 24 October, 2018;
originally announced October 2018.
