Low Dimensional State Representation Learning with Reward-shaped Priors
Authors:
Nicolò Botteghi,
Ruben Obbink,
Daan Geijs,
Mannes Poel,
Beril Sirmacek,
Christoph Brune,
Abeje Mersha,
Stefano Stramigioli
Abstract:
Reinforcement Learning has been able to solve many complicated robotics tasks without any need for feature engineering in an end-to-end fashion. However, learning the optimal policy directly from the sensory inputs, i.e the observations, often requires processing and storage of a huge amount of data. In the context of robotics, the cost of data from real robotics hardware is usually very high, thu…
▽ More
Reinforcement Learning has been able to solve many complicated robotics tasks without any need for feature engineering in an end-to-end fashion. However, learning the optimal policy directly from the sensory inputs, i.e the observations, often requires processing and storage of a huge amount of data. In the context of robotics, the cost of data from real robotics hardware is usually very high, thus solutions that achieve high sample-efficiency are needed. We propose a method that aims at learning a map** from the observations into a lower-dimensional state space. This map** is learned with unsupervised learning using loss functions shaped to incorporate prior knowledge of the environment and the task. Using the samples from the state space, the optimal policy is quickly and efficiently learned. We test the method on several mobile robot navigation tasks in a simulation environment and also on a real robot.
△ Less
Submitted 7 January, 2021; v1 submitted 29 July, 2020;
originally announced July 2020.
Comparison of Different Methods for Tissue Segmentation in Histopathological Whole-Slide Images
Authors:
Péter Bándi,
Rob van de Loo,
Milad Intezar,
Daan Geijs,
Francesco Ciompi,
Bram van Ginneken,
Jeroen van der Laak,
Geert Litjens
Abstract:
Tissue segmentation is an important pre-requisite for efficient and accurate diagnostics in digital pathology. However, it is well known that whole-slide scanners can fail in detecting all tissue regions, for example due to the tissue type, or due to weak staining because their tissue detection algorithms are not robust enough. In this paper, we introduce two different convolutional neural network…
▽ More
Tissue segmentation is an important pre-requisite for efficient and accurate diagnostics in digital pathology. However, it is well known that whole-slide scanners can fail in detecting all tissue regions, for example due to the tissue type, or due to weak staining because their tissue detection algorithms are not robust enough. In this paper, we introduce two different convolutional neural network architectures for whole slide image segmentation to accurately identify the tissue sections. We also compare the algorithms to a published traditional method. We collected 54 whole slide images with differing stains and tissue types from three laboratories to validate our algorithms. We show that while the two methods do not differ significantly they outperform their traditional counterpart (Jaccard index of 0.937 and 0.929 vs. 0.870, p < 0.01).
△ Less
Submitted 3 April, 2017; v1 submitted 17 March, 2017;
originally announced March 2017.
