-
Forecasting Precipitable Water Vapor Using LSTMs
Authors:
Mayank Jain,
Shilpa Manandhar,
Yee Hui Lee,
Stefan Winkler,
Soumyabrata Dev
Abstract:
Long-Short-Term-Memory (LSTM) networks have been used extensively for time series forecasting in recent years due to their ability of learning patterns over different periods of time. In this paper, this ability is applied to learning the pattern of Global Positioning System (GPS)-based Precipitable Water Vapor (PWV) measurements over a period of 4 hours. The trained model was evaluated on more th…
▽ More
Long-Short-Term-Memory (LSTM) networks have been used extensively for time series forecasting in recent years due to their ability of learning patterns over different periods of time. In this paper, this ability is applied to learning the pattern of Global Positioning System (GPS)-based Precipitable Water Vapor (PWV) measurements over a period of 4 hours. The trained model was evaluated on more than 1500 hours of recorded data. It achieves a root mean square error (RMSE) of 0.098 mm for a forecasting interval of 5 minutes in the future, and outperforms the naive approach for a lead-time of up to 40 minutes.
△ Less
Submitted 26 June, 2020;
originally announced June 2020.
-
FocusNet++: Attentive Aggregated Transformations for Efficient and Accurate Medical Image Segmentation
Authors:
Chaitanya Kaul,
Nick Pears,
Hang Dai,
Roderick Murray-Smith,
Suresh Manandhar
Abstract:
We propose a new residual block for convolutional neural networks and demonstrate its state-of-the-art performance in medical image segmentation. We combine attention mechanisms with group convolutions to create our group attention mechanism, which forms the fundamental building block of our network, FocusNet++. We employ a hybrid loss based on balanced cross entropy, Tversky loss and the adaptive…
▽ More
We propose a new residual block for convolutional neural networks and demonstrate its state-of-the-art performance in medical image segmentation. We combine attention mechanisms with group convolutions to create our group attention mechanism, which forms the fundamental building block of our network, FocusNet++. We employ a hybrid loss based on balanced cross entropy, Tversky loss and the adaptive logarithmic loss to enhance the performance along with fast convergence. Our results show that FocusNet++ achieves state-of-the-art results across various benchmark metrics for the ISIC 2018 melanoma segmentation and the cell nuclei segmentation datasets with fewer parameters and FLOPs.
△ Less
Submitted 7 April, 2021; v1 submitted 4 December, 2019;
originally announced December 2019.
-
Penalizing small errors using an Adaptive Logarithmic Loss
Authors:
Chaitanya Kaul,
Nick Pears,
Hang Dai,
Roderick Murray-Smith,
Suresh Manandhar
Abstract:
Loss functions are error metrics that quantify the difference between a prediction and its corresponding ground truth. Fundamentally, they define a functional landscape for traversal by gradient descent. Although numerous loss functions have been proposed to date in order to handle various machine learning problems, little attention has been given to enhancing these functions to better traverse th…
▽ More
Loss functions are error metrics that quantify the difference between a prediction and its corresponding ground truth. Fundamentally, they define a functional landscape for traversal by gradient descent. Although numerous loss functions have been proposed to date in order to handle various machine learning problems, little attention has been given to enhancing these functions to better traverse the loss landscape. In this paper, we simultaneously and significantly mitigate two prominent problems in medical image segmentation namely: i) class imbalance between foreground and background pixels and ii) poor loss function convergence. To this end, we propose an adaptive logarithmic loss function. We compare this loss function with the existing state-of-the-art on the ISIC 2018 dataset, the nuclei segmentation dataset as well as the DRIVE retinal vessel segmentation dataset. We measure the performance of our methodology on benchmark metrics and demonstrate state-of-the-art performance. More generally, we show that our system can be used as a framework for better training of deep neural networks.
△ Less
Submitted 7 April, 2021; v1 submitted 21 October, 2019;
originally announced October 2019.
