-
Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy
Authors:
Stanislav Nikolov,
Sam Blackwell,
Alexei Zverovitch,
Ruheena Mendes,
Michelle Livne,
Jeffrey De Fauw,
Yojan Patel,
Clemens Meyer,
Harry Askham,
Bernardino Romera-Paredes,
Christopher Kelly,
Alan Karthikesalingam,
Carlton Chu,
Dawn Carnell,
Cheng Boon,
Derek D'Souza,
Syed Ali Moinuddin,
Bethany Garie,
Yasmin McQuinlan,
Sarah Ireland,
Kiarna Hampton,
Krystle Fuller,
Hugh Montgomery,
Geraint Rees,
Mustafa Suleyman
, et al. (4 additional authors not shown)
Abstract:
Over half a million individuals are diagnosed with head and neck cancer each year worldwide. Radiotherapy is an important curative treatment for this disease, but it requires manual time consuming delineation of radio-sensitive organs at risk (OARs). This planning process can delay treatment, while also introducing inter-operator variability with resulting downstream radiation dose differences. Wh…
▽ More
Over half a million individuals are diagnosed with head and neck cancer each year worldwide. Radiotherapy is an important curative treatment for this disease, but it requires manual time consuming delineation of radio-sensitive organs at risk (OARs). This planning process can delay treatment, while also introducing inter-operator variability with resulting downstream radiation dose differences. While auto-segmentation algorithms offer a potentially time-saving solution, the challenges in defining, quantifying and achieving expert performance remain. Adopting a deep learning approach, we demonstrate a 3D U-Net architecture that achieves expert-level performance in delineating 21 distinct head and neck OARs commonly segmented in clinical practice. The model was trained on a dataset of 663 deidentified computed tomography (CT) scans acquired in routine clinical practice and with both segmentations taken from clinical practice and segmentations created by experienced radiographers as part of this research, all in accordance with consensus OAR definitions. We demonstrate the model's clinical applicability by assessing its performance on a test set of 21 CT scans from clinical practice, each with the 21 OARs segmented by two independent experts. We also introduce surface Dice similarity coefficient (surface DSC), a new metric for the comparison of organ delineation, to quantify deviation between OAR surface contours rather than volumes, better reflecting the clinical task of correcting errors in the automated organ segmentations. The model's generalisability is then demonstrated on two distinct open source datasets, reflecting different centres and countries to model training. With appropriate validation studies and regulatory approvals, this system could improve the efficiency, consistency, and safety of radiotherapy pathways.
△ Less
Submitted 13 January, 2021; v1 submitted 12 September, 2018;
originally announced September 2018.
-
The Kinetics Human Action Video Dataset
Authors:
Will Kay,
Joao Carreira,
Karen Simonyan,
Brian Zhang,
Chloe Hillier,
Sudheendra Vijayanarasimhan,
Fabio Viola,
Tim Green,
Trevor Back,
Paul Natsev,
Mustafa Suleyman,
Andrew Zisserman
Abstract:
We describe the DeepMind Kinetics human action video dataset. The dataset contains 400 human action classes, with at least 400 video clips for each action. Each clip lasts around 10s and is taken from a different YouTube video. The actions are human focussed and cover a broad range of classes including human-object interactions such as playing instruments, as well as human-human interactions such…
▽ More
We describe the DeepMind Kinetics human action video dataset. The dataset contains 400 human action classes, with at least 400 video clips for each action. Each clip lasts around 10s and is taken from a different YouTube video. The actions are human focussed and cover a broad range of classes including human-object interactions such as playing instruments, as well as human-human interactions such as shaking hands. We describe the statistics of the dataset, how it was collected, and give some baseline performance figures for neural network architectures trained and tested for human action classification on this dataset. We also carry out a preliminary analysis of whether imbalance in the dataset leads to bias in the classifiers.
△ Less
Submitted 19 May, 2017;
originally announced May 2017.
-
Massively Parallel Methods for Deep Reinforcement Learning
Authors:
Arun Nair,
Praveen Srinivasan,
Sam Blackwell,
Cagdas Alcicek,
Rory Fearon,
Alessandro De Maria,
Vedavyas Panneershelvam,
Mustafa Suleyman,
Charles Beattie,
Stig Petersen,
Shane Legg,
Volodymyr Mnih,
Koray Kavukcuoglu,
David Silver
Abstract:
We present the first massively distributed architecture for deep reinforcement learning. This architecture uses four main components: parallel actors that generate new behaviour; parallel learners that are trained from stored experience; a distributed neural network to represent the value function or behaviour policy; and a distributed store of experience. We used our architecture to implement the…
▽ More
We present the first massively distributed architecture for deep reinforcement learning. This architecture uses four main components: parallel actors that generate new behaviour; parallel learners that are trained from stored experience; a distributed neural network to represent the value function or behaviour policy; and a distributed store of experience. We used our architecture to implement the Deep Q-Network algorithm (DQN). Our distributed algorithm was applied to 49 games from Atari 2600 games from the Arcade Learning Environment, using identical hyperparameters. Our performance surpassed non-distributed DQN in 41 of the 49 games and also reduced the wall-time required to achieve these results by an order of magnitude on most games.
△ Less
Submitted 16 July, 2015; v1 submitted 15 July, 2015;
originally announced July 2015.
-
Teaching Machines to Read and Comprehend
Authors:
Karl Moritz Hermann,
Tomáš Kočiský,
Edward Grefenstette,
Lasse Espeholt,
Will Kay,
Mustafa Suleyman,
Phil Blunsom
Abstract:
Teaching machines to read natural language documents remains an elusive challenge. Machine reading systems can be tested on their ability to answer questions posed on the contents of documents that they have seen, but until now large scale training and test datasets have been missing for this type of evaluation. In this work we define a new methodology that resolves this bottleneck and provides la…
▽ More
Teaching machines to read natural language documents remains an elusive challenge. Machine reading systems can be tested on their ability to answer questions posed on the contents of documents that they have seen, but until now large scale training and test datasets have been missing for this type of evaluation. In this work we define a new methodology that resolves this bottleneck and provides large scale supervised reading comprehension data. This allows us to develop a class of attention based deep neural networks that learn to read real documents and answer complex questions with minimal prior knowledge of language structure.
△ Less
Submitted 19 November, 2015; v1 submitted 10 June, 2015;
originally announced June 2015.
-
Learning to Transduce with Unbounded Memory
Authors:
Edward Grefenstette,
Karl Moritz Hermann,
Mustafa Suleyman,
Phil Blunsom
Abstract:
Recently, strong results have been demonstrated by Deep Recurrent Neural Networks on natural language transduction problems. In this paper we explore the representational power of these models using synthetic grammars designed to exhibit phenomena similar to those found in real transduction problems such as machine translation. These experiments lead us to propose new memory-based recurrent networ…
▽ More
Recently, strong results have been demonstrated by Deep Recurrent Neural Networks on natural language transduction problems. In this paper we explore the representational power of these models using synthetic grammars designed to exhibit phenomena similar to those found in real transduction problems such as machine translation. These experiments lead us to propose new memory-based recurrent networks that implement continuously differentiable analogues of traditional data structures such as Stacks, Queues, and DeQues. We show that these architectures exhibit superior generalisation performance to Deep RNNs and are often able to learn the underlying generating algorithms in our transduction experiments.
△ Less
Submitted 3 November, 2015; v1 submitted 8 June, 2015;
originally announced June 2015.