-
The Eighth Dialog System Technology Challenge
Authors:
Seokhwan Kim,
Michel Galley,
Chulaka Gunasekara,
Sung** Lee,
Adam Atkinson,
Baolin Peng,
Hannes Schulz,
Jianfeng Gao,
**chao Li,
Mahmoud Adada,
Minlie Huang,
Luis Lastras,
Jonathan K. Kummerfeld,
Walter S. Lasecki,
Chiori Hori,
Anoop Cherian,
Tim K. Marks,
Abhinav Rastogi,
Xiaoxue Zang,
Srinivas Sunkara,
Raghav Gupta
Abstract:
This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, and eval…
▽ More
This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.
△ Less
Submitted 14 November, 2019;
originally announced November 2019.
-
Improving Neural Question Generation using World Knowledge
Authors:
Deepak Gupta,
Kaheer Suleman,
Mahmoud Adada,
Andrew McNamara,
Justin Harris
Abstract:
In this paper, we propose a method for incorporating world knowledge (linked entities and fine-grained entity types) into a neural question generation model. This world knowledge helps to encode additional information related to the entities present in the passage required to generate human-like questions. We evaluate our models on both SQuAD and MS MARCO to demonstrate the usefulness of the world…
▽ More
In this paper, we propose a method for incorporating world knowledge (linked entities and fine-grained entity types) into a neural question generation model. This world knowledge helps to encode additional information related to the entities present in the passage required to generate human-like questions. We evaluate our models on both SQuAD and MS MARCO to demonstrate the usefulness of the world knowledge features. The proposed world knowledge enriched question generation model is able to outperform the vanilla neural question generation model by 1.37 and 1.59 absolute BLEU 4 score on SQuAD and MS MARCO test dataset respectively.
△ Less
Submitted 10 September, 2019; v1 submitted 9 September, 2019;
originally announced September 2019.
-
TextWorld: A Learning Environment for Text-based Games
Authors:
Marc-Alexandre Côté,
Ákos Kádár,
Xingdi Yuan,
Ben Kybartas,
Tavian Barnes,
Emery Fine,
James Moore,
Ruo Yu Tao,
Matthew Hausknecht,
Layla El Asri,
Mahmoud Adada,
Wendy Tay,
Adam Trischler
Abstract:
We introduce TextWorld, a sandbox learning environment for the training and evaluation of RL agents on text-based games. TextWorld is a Python library that handles interactive play-through of text games, as well as backend functions like state tracking and reward assignment. It comes with a curated list of games whose features and challenges we have analyzed. More significantly, it enables users t…
▽ More
We introduce TextWorld, a sandbox learning environment for the training and evaluation of RL agents on text-based games. TextWorld is a Python library that handles interactive play-through of text games, as well as backend functions like state tracking and reward assignment. It comes with a curated list of games whose features and challenges we have analyzed. More significantly, it enables users to handcraft or automatically generate new games. Its generative mechanisms give precise control over the difficulty, scope, and language of constructed games, and can be used to relax challenges inherent to commercial text games like partial observability and sparse rewards. By generating sets of varied but similar games, TextWorld can also be used to study generalization and transfer learning. We cast text-based games in the Reinforcement Learning formalism, use our framework to develop a set of benchmark games, and evaluate several baseline agents on this set and the curated list.
△ Less
Submitted 8 November, 2019; v1 submitted 29 June, 2018;
originally announced June 2018.
