Efficient Natural Language Response Suggestion for Smart Reply
Authors:
Matthew Henderson,
Rami Al-Rfou,
Brian Strope,
Yun-hsuan Sung,
Laszlo Lukacs,
Ruiqi Guo,
Sanjiv Kumar,
Balint Miklos,
Ray Kurzweil
Abstract:
This paper presents a computationally efficient machine-learned method for natural language response suggestion. Feed-forward neural networks using n-gram embedding features encode messages into vectors which are optimized to give message-response pairs a high dot-product value. An optimized search finds response suggestions. The method is evaluated in a large-scale commercial e-mail application,…
▽ More
This paper presents a computationally efficient machine-learned method for natural language response suggestion. Feed-forward neural networks using n-gram embedding features encode messages into vectors which are optimized to give message-response pairs a high dot-product value. An optimized search finds response suggestions. The method is evaluated in a large-scale commercial e-mail application, Inbox by Gmail. Compared to a sequence-to-sequence approach, the new system achieves the same quality at a small fraction of the computational requirements and latency.
△ Less
Submitted 1 May, 2017;
originally announced May 2017.
Smart Reply: Automated Response Suggestion for Email
Authors:
Anjuli Kannan,
Karol Kurach,
Sujith Ravi,
Tobias Kaufmann,
Andrew Tomkins,
Balint Miklos,
Greg Corrado,
Laszlo Lukacs,
Marina Ganea,
Peter Young,
Vivek Ramavajjala
Abstract:
In this paper we propose and investigate a novel end-to-end method for automatically generating short email responses, called Smart Reply. It generates semantically diverse suggestions that can be used as complete email responses with just one tap on mobile. The system is currently used in Inbox by Gmail and is responsible for assisting with 10% of all mobile responses. It is designed to work at v…
▽ More
In this paper we propose and investigate a novel end-to-end method for automatically generating short email responses, called Smart Reply. It generates semantically diverse suggestions that can be used as complete email responses with just one tap on mobile. The system is currently used in Inbox by Gmail and is responsible for assisting with 10% of all mobile responses. It is designed to work at very high throughput and process hundreds of millions of messages daily. The system exploits state-of-the-art, large-scale deep learning.
We describe the architecture of the system as well as the challenges that we faced while building it, like response diversity and scalability. We also introduce a new method for semantic clustering of user-generated content that requires only a modest amount of explicitly labeled data.
△ Less
Submitted 15 June, 2016;
originally announced June 2016.
