-
Learning multiplane images from single views with self-supervision
Authors:
Gustavo Sutter P. Carvalho,
Diogo C. Luvizon,
Antonio Joia Neto,
Andre G. C. Pacheco,
Otavio A. B. Penatti
Abstract:
Generating static novel views from an already captured image is a hard task in computer vision and graphics, in particular when the single input image has dynamic parts such as persons or moving objects. In this paper, we tackle this problem by proposing a new framework, called CycleMPI, that is capable of learning a multiplane image representation from single images through a cyclic training stra…
▽ More
Generating static novel views from an already captured image is a hard task in computer vision and graphics, in particular when the single input image has dynamic parts such as persons or moving objects. In this paper, we tackle this problem by proposing a new framework, called CycleMPI, that is capable of learning a multiplane image representation from single images through a cyclic training strategy for self-supervision. Our framework does not require stereo data for training, therefore it can be trained with massive visual data from the Internet, resulting in a better generalization capability even for very challenging cases. Although our method does not require stereo data for supervision, it reaches results on stereo datasets comparable to the state of the art in a zero-shot scenario. We evaluated our method on RealEstate10K and Mannequin Challenge datasets for view synthesis and presented qualitative results on Places II dataset.
△ Less
Submitted 19 October, 2021; v1 submitted 18 October, 2021;
originally announced October 2021.
-
A Smartphone based Application for Skin Cancer Classification Using Deep Learning with Clinical Images and Lesion Information
Authors:
Breno Krohling,
Pedro B. C. Castro,
Andre G. C. Pacheco,
Renato A. Krohling
Abstract:
Over the last decades, the incidence of skin cancer, melanoma and non-melanoma, has increased at a continuous rate. In particular for melanoma, the deadliest type of skin cancer, early detection is important to increase patient prognosis. Recently, deep neural networks (DNNs) have become viable to deal with skin cancer detection. In this work, we present a smartphone-based application to assist on…
▽ More
Over the last decades, the incidence of skin cancer, melanoma and non-melanoma, has increased at a continuous rate. In particular for melanoma, the deadliest type of skin cancer, early detection is important to increase patient prognosis. Recently, deep neural networks (DNNs) have become viable to deal with skin cancer detection. In this work, we present a smartphone-based application to assist on skin cancer detection. This application is based on a Convolutional Neural Network(CNN) trained on clinical images and patients demographics, both collected from smartphones. Also, as skin cancer datasets are imbalanced, we present an approach, based on the mutation operator of Differential Evolution (DE) algorithm, to balance data. In this sense, beyond provides a flexible tool to assist doctors on skin cancer screening phase, the method obtains promising results with a balanced accuracy of 85% and a recall of 96%.
△ Less
Submitted 28 April, 2021;
originally announced April 2021.
-
Improving Deep Learning Sound Events Classifiers using Gram Matrix Feature-wise Correlations
Authors:
Antonio Joia Neto,
Andre G C Pacheco,
Diogo C Luvizon
Abstract:
In this paper, we propose a new Sound Event Classification (SEC) method which is inspired in recent works for out-of-distribution detection. In our method, we analyse all the activations of a generic CNN in order to produce feature representations using Gram Matrices. The similarity metrics are evaluated considering all possible classes, and the final prediction is defined as the class that minimi…
▽ More
In this paper, we propose a new Sound Event Classification (SEC) method which is inspired in recent works for out-of-distribution detection. In our method, we analyse all the activations of a generic CNN in order to produce feature representations using Gram Matrices. The similarity metrics are evaluated considering all possible classes, and the final prediction is defined as the class that minimizes the deviation with respect to the features seeing during training. The proposed approach can be applied to any CNN and our experimental evaluation of four different architectures on two datasets demonstrated that our method consistently improves the baseline models.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Recent advances in deep learning applied to skin cancer detection
Authors:
Andre G. C. Pacheco,
Renato A. Krohling
Abstract:
Skin cancer is a major public health problem around the world. Its early detection is very important to increase patient prognostics. However, the lack of qualified professionals and medical instruments are significant issues in this field. In this context, over the past few years, deep learning models applied to automated skin cancer detection have become a trend. In this paper, we present an ove…
▽ More
Skin cancer is a major public health problem around the world. Its early detection is very important to increase patient prognostics. However, the lack of qualified professionals and medical instruments are significant issues in this field. In this context, over the past few years, deep learning models applied to automated skin cancer detection have become a trend. In this paper, we present an overview of the recent advances reported in this field as well as a discussion about the challenges and opportunities for improvement in the current models. In addition, we also present some important aspects regarding the use of these models in smartphones and indicate future directions we believe the field will take.
△ Less
Submitted 6 December, 2019;
originally announced December 2019.
-
The impact of patient clinical information on automated skin cancer detection
Authors:
Andre G. C. Pacheco,
Renato A. Krohling
Abstract:
Skin cancer is one of the most common types of cancer around the world. For this reason, over the past years, different approaches have been proposed to assist detect it. Nonetheless, most of them are based only on dermoscopy images and do not take into account the patient clinical information. In this work, first, we present a new dataset that contains clinical images, acquired from smartphones,…
▽ More
Skin cancer is one of the most common types of cancer around the world. For this reason, over the past years, different approaches have been proposed to assist detect it. Nonetheless, most of them are based only on dermoscopy images and do not take into account the patient clinical information. In this work, first, we present a new dataset that contains clinical images, acquired from smartphones, and patient clinical information of the skin lesions. Next, we introduce a straightforward approach to combine the clinical data and the images using different well-known deep learning models. These models are applied to the presented dataset using only the images and combining them with the patient clinical information. We present a comprehensive study to show the impact of the clinical data on the final predictions. The results obtained by combining both sets of information show a general improvement of around 7% in the balanced accuracy for all models. In addition, the statistical test indicates significant differences between the models with and without considering both data. The improvement achieved shows the potential of using patient clinical information in skin cancer detection and indicates that this piece of information is important to leverage skin cancer detection systems.
△ Less
Submitted 16 September, 2019;
originally announced September 2019.
-
Skin cancer detection based on deep learning and entropy to detect outlier samples
Authors:
Andre G. C. Pacheco,
Abder-Rahman Ali,
Thomas Trappenberg
Abstract:
We describe our methods that achieved the 3rd and 4th places in tasks 1 and 2, respectively, at ISIC challenge 2019. The goal of this challenge is to provide the diagnostic for skin cancer using images and meta-data. There are nine classes in the dataset, nonetheless, one of them is an outlier and is not present on it. To tackle the challenge, we apply an ensemble of classifiers, which has 13 conv…
▽ More
We describe our methods that achieved the 3rd and 4th places in tasks 1 and 2, respectively, at ISIC challenge 2019. The goal of this challenge is to provide the diagnostic for skin cancer using images and meta-data. There are nine classes in the dataset, nonetheless, one of them is an outlier and is not present on it. To tackle the challenge, we apply an ensemble of classifiers, which has 13 convolutional neural networks (CNN), we develop two approaches to handle the outlier class and we propose a straightforward method to use the meta-data along with the images. Throughout this report, we detail each methodology and parameters to make it easy to replicate our work. The results obtained are in accordance with the previous challenges and the approaches to detect the outlier class and to address the meta-data seem to be work properly.
△ Less
Submitted 5 January, 2020; v1 submitted 10 September, 2019;
originally announced September 2019.
-
Classificação de espécies de peixe utilizando redes neurais convolucional
Authors:
Andre G. C. Pacheco
Abstract:
Data classification is present in different real problems, such as recognizing patterns in images, differentiating defective parts in a production line, classifying benign and malignant tumors, among many others. Many of these problems have data patterns that are hard to identify, which requires more advanced techniques for resolution. Recently, several works addressing different artificial neural…
▽ More
Data classification is present in different real problems, such as recognizing patterns in images, differentiating defective parts in a production line, classifying benign and malignant tumors, among many others. Many of these problems have data patterns that are hard to identify, which requires more advanced techniques for resolution. Recently, several works addressing different artificial neural network architectures have been applied to solve classification problems. When the classification problem must be obtained through images, currently, the standard methodology is the use of convolutional neural networks. Thus, in this report convolutional neural networks are used to classify fish species.
Classificação de dados está presente em diversos problemas reais, tais como: reconhecer padrões em imagens, diferenciar peças defeituosas em uma linha de produção, classificar tumores benignos e malignos, dentre diversas outras. Muitos desses problemas possuem padrões de dados difíceis de serem identificados, o que requer, consequentemente, técnicas mais avançadas para sua resolução. Recentemente, diversos trabalhos abordando diferentes arquiteturas de redes neurais artificiais vêm sendo aplicados para solucionar problemas de classificação. Quando a classificação do problema deve ser obtida por meio de imagens, atualmente a metodologia padrão é uso de redes neurais convolucionais. Sendo assim, neste trabalho são utilizadas redes neurais convolucionais para classificação de espécies de peixes.
△ Less
Submitted 9 May, 2019;
originally announced May 2019.
-
Multiplicação de matrizes: uma comparação entre as abordagens sequencial (CPU) e paralela (GPU)
Authors:
Andre G. C. Pacheco
Abstract:
Designing problems using matrices is very important in Computer Science. Fields like graph computer, graphs theory, and machine learning use matrices very often to solve their own problems. The most often matrix operation is the multiplication. It may be time-consuming if the matrices to be multiplied are large. For this reason, the parallel computer became a must to tackle this problem. In this r…
▽ More
Designing problems using matrices is very important in Computer Science. Fields like graph computer, graphs theory, and machine learning use matrices very often to solve their own problems. The most often matrix operation is the multiplication. It may be time-consuming if the matrices to be multiplied are large. For this reason, the parallel computer became a must to tackle this problem. In this report, it is presented a comparison between sequential and parallel approaches to computing the matrix multiplication using CUDA and openMP. The results show the importance of parallelizing mainly when the matrices are large.
A modelagem de problemas utilizando matrizes é de extrema importância para Ciência da Computação. Áreas como computação gráfica, grafos e aprendizado de máquina utilizam matrizes com alta frequência para solucionar seus respectivos problemas. Dessa forma, operar matrizes de maneira eficiente é muito importante para o desempenho de algoritmos. Uma das operações de matrizes mais utilizadas é a multiplicação, que se torna um empecilho para o desempenho computacional de algoritmos na medida que o tamanho das matrizes a serem multiplicadas aumentam. Por conta disso, a computação paralela se tornou uma solução padrão para abordar tal problema. Neste trabalho é apresentado uma comparação entre as abordagens sequencial e paralela para multiplicação de matrizes utilizando CUDA e OpenMP. O resultado da análise realizada entre o tamanho da matriz e o desempenho da multiplicação mostra a importância da paralelização principalmente para matrizes de ordem elevada.
△ Less
Submitted 9 May, 2019;
originally announced May 2019.
-
Ranking of classification algorithms in terms of mean-standard deviation using A-TOPSIS
Authors:
Andre G. C. Pacheco,
Renato A. Krohling
Abstract:
In classification problems when multiples algorithms are applied to different benchmarks a difficult issue arises, i.e., how can we rank the algorithms? In machine learning it is common run the algorithms several times and then a statistic is calculated in terms of means and standard deviations. In order to compare the performance of the algorithms, it is very common to employ statistical tests. H…
▽ More
In classification problems when multiples algorithms are applied to different benchmarks a difficult issue arises, i.e., how can we rank the algorithms? In machine learning it is common run the algorithms several times and then a statistic is calculated in terms of means and standard deviations. In order to compare the performance of the algorithms, it is very common to employ statistical tests. However, these tests may also present limitations, since they consider only the means and not the standard deviations of the obtained results. In this paper, we present the so called A-TOPSIS, based on TOPSIS (Technique for Order Preference by Similarity to Ideal Solution), to solve the problem of ranking and comparing classification algorithms in terms of means and standard deviations. We use two case studies to illustrate the A-TOPSIS for ranking classification algorithms and the results show the suitability of A-TOPSIS to rank the algorithms. The presented approach is general and can be applied to compare the performance of stochastic algorithms in machine learning. Finally, to encourage researchers to use the A-TOPSIS for ranking algorithms we also presented in this work an easy-to-use A-TOPSIS web framework.
△ Less
Submitted 22 October, 2016;
originally announced October 2016.
-
TODIM and TOPSIS with Z-numbers
Authors:
R. A. Krohling,
Artem dos Santos,
A. G. C. Pacheco
Abstract:
In this paper, we present an approach that is able to handle with Z-numbers in the context of Multi-Criteria Decision Making (MCDM) problems. Z-numbers are composed of two parts, the first one is a restriction on the values that can be assumed, and the second part is the reliability of the information. As human beings we communicate with other people by means of natural language using sentences li…
▽ More
In this paper, we present an approach that is able to handle with Z-numbers in the context of Multi-Criteria Decision Making (MCDM) problems. Z-numbers are composed of two parts, the first one is a restriction on the values that can be assumed, and the second part is the reliability of the information. As human beings we communicate with other people by means of natural language using sentences like: the journey time from home to university takes about half hour, very likely. Firstly, Z-numbers are converted to fuzzy numbers using a standard procedure. Next, the Z-TODIM and Z-TOPSIS are presented as a direct extension of the fuzzy TODIM and fuzzy TOPSIS, respectively. The proposed methods are applied to two case studies and compared with the standard approach using crisp values. Results obtained show the feasibility of the approach. In addition, a graphical interface was built to handle with both methods Z- TODIM and Z-TOPSIS allowing ease of use for user in other areas of knowledge.
△ Less
Submitted 19 September, 2016;
originally announced September 2016.
