-
Toward Improving Robustness of Object Detectors Against Domain Shift
Authors:
Le-Anh Tran,
Chung Nguyen Tran,
Dong-Chul Park,
Jordi Carrabina,
David Castells-Rufas
Abstract:
This paper proposes a data augmentation method for improving the robustness of driving object detectors against domain shift. Domain shift problem arises when there is a significant change between the distribution of the source data domain used in the training phase and that of the target data domain in the deployment phase. Domain shift is known as one of the most popular reasons resulting in the…
▽ More
This paper proposes a data augmentation method for improving the robustness of driving object detectors against domain shift. Domain shift problem arises when there is a significant change between the distribution of the source data domain used in the training phase and that of the target data domain in the deployment phase. Domain shift is known as one of the most popular reasons resulting in the considerable drop in the performance of deep neural network models. In order to address this problem, one effective approach is to increase the diversity of training data. To this end, we propose a data synthesis module that can be utilized to train more robust and effective object detectors. By adopting YOLOv4 as a base object detector, we have witnessed a remarkable improvement in performance on both the source and target domain data. The code of this work is publicly available at https://github.com/tranleanh/haze-synthesis.
△ Less
Submitted 1 December, 2023;
originally announced March 2024.
-
BronchoPose: an analysis of data and model configuration for vision-based bronchoscopy pose estimation
Authors:
Juan Borrego-Carazo,
Carles Sánchez,
David Castells-Rufas,
Jordi Carrabina,
Débora Gil
Abstract:
Vision-based bronchoscopy (VB) models require the registration of the virtual lung model with the frames from the video bronchoscopy to provide effective guidance during the biopsy. The registration can be achieved by either tracking the position and orientation of the bronchoscopy camera or by calibrating its deviation from the pose (position and orientation) simulated in the virtual lung model.…
▽ More
Vision-based bronchoscopy (VB) models require the registration of the virtual lung model with the frames from the video bronchoscopy to provide effective guidance during the biopsy. The registration can be achieved by either tracking the position and orientation of the bronchoscopy camera or by calibrating its deviation from the pose (position and orientation) simulated in the virtual lung model. Recent advances in neural networks and temporal image processing have provided new opportunities for guided bronchoscopy. However, such progress has been hindered by the lack of comparative experimental conditions.
In the present paper, we share a novel synthetic dataset allowing for a fair comparison of methods. Moreover, this paper investigates several neural network architectures for the learning of temporal information at different levels of subject personalization. In order to improve orientation measurement, we also present a standardized comparison framework and a novel metric for camera orientation learning. Results on the dataset show that the proposed metric and architectures, as well as the standardized conditions, provide notable improvements to current state-of-the-art camera pose estimation in video bronchoscopy.
△ Less
Submitted 25 April, 2022;
originally announced April 2022.
-
OpenCL-based FPGA accelerator for disparity map generation with stereoscopic event cameras
Authors:
David Castells-Rufas,
Jordi Carrabina
Abstract:
Although event-based cameras are already commercially available. Vision algorithms based on them are still not common. As a consequence, there are few Hardware Accelerators for them. In this work we present some experiments to create FPGA accelerators for a well-known vision algorithm using event-based cameras. We present a stereo matching algorithm to create a stream of disparity events disparity…
▽ More
Although event-based cameras are already commercially available. Vision algorithms based on them are still not common. As a consequence, there are few Hardware Accelerators for them. In this work we present some experiments to create FPGA accelerators for a well-known vision algorithm using event-based cameras. We present a stereo matching algorithm to create a stream of disparity events disparity map and implement several accelerators using the Intel FPGA OpenCL tool-chain. The results show that multiple designs can be easily tested and that a performance speedup of more than 8x can be achieved with simple code transformations.
△ Less
Submitted 8 March, 2019;
originally announced March 2019.
-
The Regulation of Unlicensed Sub-GHz bands: Are Stronger Restrictions Required for LPWAN-based IoT Success?
Authors:
David Castells-Rufas,
Adrià Galin-Pons,
Jordi Carrabina
Abstract:
Radio communications using the unlicensed Sub-GHz bands are expected to play an important role in the deployment of the Internet of Things (IoT). The regulations of the sub-GHz unlicensed bands can affect the deployment of LPWAN networks in a similar way to how they affected the deployment of WLAN networks at the end of the twenty's century. This paper reviews the current regulations and labeling…
▽ More
Radio communications using the unlicensed Sub-GHz bands are expected to play an important role in the deployment of the Internet of Things (IoT). The regulations of the sub-GHz unlicensed bands can affect the deployment of LPWAN networks in a similar way to how they affected the deployment of WLAN networks at the end of the twenty's century. This paper reviews the current regulations and labeling requirements affecting LPWAN-based IoT devices for the most relevant markets worldwide (US, Europe, China, Japan, India, Brazil and Canada) and identify the main roadblocks for massive adaption of the technology. Finally, some suggestions are given to regulators to address the open challenges.
△ Less
Submitted 30 November, 2018;
originally announced December 2018.
-
A High-Performance HOG Extractor on FPGA
Authors:
Vinh Ngo,
Arnau Casadevall,
Marc Codina,
David Castells-Rufas,
Jordi Carrabina
Abstract:
Pedestrian detection is one of the key problems in emerging self-driving car industry. And HOG algorithm has proven to provide good accuracy for pedestrian detection. There are plenty of research works have been done in accelerating HOG algorithm on FPGA because of its low-power and high-throughput characteristics. In this paper, we present a high-performance HOG architecture for pedestrian detect…
▽ More
Pedestrian detection is one of the key problems in emerging self-driving car industry. And HOG algorithm has proven to provide good accuracy for pedestrian detection. There are plenty of research works have been done in accelerating HOG algorithm on FPGA because of its low-power and high-throughput characteristics. In this paper, we present a high-performance HOG architecture for pedestrian detection on a low-cost FPGA platform. It achieves a maximum throughput of 526 FPS with 640x480 input images, which is 3.25 times faster than the state of the art design. The accelerator is integrated with SVM-based prediction in realizing a pedestrian detection system. And the power consumption of the whole system is comparable with the best existing implementations.
△ Less
Submitted 12 January, 2018;
originally announced February 2018.
-
Energy Efficiency of Many-Soft-Core Processors
Authors:
David Castells-Rufas,
Albert Saa-Garriga,
Jordi Carrabina
Abstract:
The growing capacity of integration allows to instantiate hundreds of soft-core processors in a single FPGA to create a reconfigurable multiprocessing system. Lately, FPGAs have been proven to give a higher energy efficiency than alternative platforms like CPUs and GPGPUs for certain workloads and are increasingly used in data-centers. In this paper we investigate whether many-soft-core processors…
▽ More
The growing capacity of integration allows to instantiate hundreds of soft-core processors in a single FPGA to create a reconfigurable multiprocessing system. Lately, FPGAs have been proven to give a higher energy efficiency than alternative platforms like CPUs and GPGPUs for certain workloads and are increasingly used in data-centers. In this paper we investigate whether many-soft-core processors can achieve similar levels of energy efficiency while providing a general purpose environment, more easily programmed, and allowing to run other applications without reconfiguring the device. With a simple application example we are able to create a reconfigurable multiprocessing system achieving an energy efficiency 58 times higher than a recent ultra-low-power processor and 124 times higher than a recent high performance GPGPU.
△ Less
Submitted 26 January, 2016;
originally announced January 2016.
-
OMP2HMPP: Compiler Framework for Energy Performance Trade-off Analysis of Automatically Generated Codes
Authors:
Albert Saà-Garriga,
David Castells-Rufas,
Jordi Carrabina
Abstract:
We present OMP2HMPP, a tool that, in a first step, automatically translates OpenMP code into various possible transformations of HMPP. In a second step OMP2HMPP executes all variants to obtain the performance and power consumption of each transformation. The resulting trade-off can be used to choose the more convenient version. After running the tool on a set of codes from the Polybench benchmark…
▽ More
We present OMP2HMPP, a tool that, in a first step, automatically translates OpenMP code into various possible transformations of HMPP. In a second step OMP2HMPP executes all variants to obtain the performance and power consumption of each transformation. The resulting trade-off can be used to choose the more convenient version. After running the tool on a set of codes from the Polybench benchmark we show that the best automatic transformation is equivalent to a manual one done by an expert. Compared with original OpenMP code running in 2 quad-core processors we obtain an average speed-up of 31x and 5.86x factor in operations per watt.
△ Less
Submitted 9 June, 2015;
originally announced June 2015.
-
OMP2MPI: Automatic MPI code generation from OpenMP programs
Authors:
Albert Saa-Garriga,
David Castells-Rufas,
Jordi Carrabina
Abstract:
In this paper, we present OMP2MPI a tool that generates automatically MPI source code from OpenMP. With this transformation the original program can be adapted to be able to exploit a larger number of processors by surpassing the limits of the node level on large HPC clusters. The transformation can also be useful to adapt the source code to execute in distributed memory many-cores with message pa…
▽ More
In this paper, we present OMP2MPI a tool that generates automatically MPI source code from OpenMP. With this transformation the original program can be adapted to be able to exploit a larger number of processors by surpassing the limits of the node level on large HPC clusters. The transformation can also be useful to adapt the source code to execute in distributed memory many-cores with message passing support. In addition, the resulting MPI code can be used as an starting point that still can be further optimized by software engineers. The transformation process is focused on detecting OpenMP parallel loops and distributing them in a master/worker pattern. A set of micro-benchmarks have been used to verify the correctness of the the transformation and to measure the resulting performance. Surprisingly not only the automatically generated code is correct by construction, but also it often performs faster even when executed with MPI.
△ Less
Submitted 11 June, 2015; v1 submitted 10 February, 2015;
originally announced February 2015.
-
Proceedings of the Workshop on High Performance Energy Efficient Embedded Systems (HIP3ES) 2015
Authors:
Francisco Corbera,
Andrés Rodríguez,
Rafael Asenjo,
Angeles Navarro,
Antonio Vilches,
Maria Garzaran,
Ismat Chaib Draa,
Jamel Tayeb,
Smail Niar,
Mikael Desertot,
Daniel Gregorek,
Robert Schmidt,
Alberto Garcia-Ortiz,
Pedro Lopez-Garcia,
Rémy Haemmerlé,
Maximiliano Klemen,
Umer Liqat,
Manuel V. Hermenegildo,
Radim Vavřík,
Albert Saà-Garriga,
David Castells-Rufas,
Jordi Carrabina
Abstract:
Proceedings of the Workshop on High Performance Energy Efficient Embedded Systems (HIP3ES) 2015. Amsterdam, January 21st. Collocated with HIPEAC 2015 Conference.
Proceedings of the Workshop on High Performance Energy Efficient Embedded Systems (HIP3ES) 2015. Amsterdam, January 21st. Collocated with HIPEAC 2015 Conference.
△ Less
Submitted 13 January, 2015;
originally announced January 2015.
-
OMP2HMPP: HMPP Source Code Generation from Programs with Pragma Extensions
Authors:
Albert Saà-Garriga,
David Castells-Rufas,
Jordi Carrabina
Abstract:
High-performance computing are based more and more in heterogeneous architectures and GPGPUs have become one of the main integrated blocks in these, as the recently emerged Mali GPU in embedded systems or the NVIDIA GPUs in HPC servers. In both GPGPUs, programming could become a hurdle that can limit their adoption, since the programmer has to learn the hardware capabilities and the language to wo…
▽ More
High-performance computing are based more and more in heterogeneous architectures and GPGPUs have become one of the main integrated blocks in these, as the recently emerged Mali GPU in embedded systems or the NVIDIA GPUs in HPC servers. In both GPGPUs, programming could become a hurdle that can limit their adoption, since the programmer has to learn the hardware capabilities and the language to work with these. We present OMP2HMPP, a tool that, automatically trans-lates a high-level C source code(OpenMP) code into HMPP. The generated version rarely will differs from a hand-coded HMPP version, and will provide an important speedup, near 113%, that could be later improved by hand-coded CUDA. The generated code could be transported either to HPC servers and to embedded GPUs, due to the commonalities between them.
△ Less
Submitted 25 July, 2014;
originally announced July 2014.
-
Fast Trace Generation of Many-Core Embedded Systems with Native Simulation
Authors:
David Castells-Rufas,
Jordi Carrabina,
Pablo González de Aledo Marugán,
Pablo Sánchez Espeso
Abstract:
Embedded Software development and optimization are complex tasks. Late availably of hardware platforms, their usual low visibility and controllability, and their limiting resource constraints makes early performance estimation an attractive option instead of using the final execution platform. With early performance estimation, software development can progress although the real hardware is not ye…
▽ More
Embedded Software development and optimization are complex tasks. Late availably of hardware platforms, their usual low visibility and controllability, and their limiting resource constraints makes early performance estimation an attractive option instead of using the final execution platform. With early performance estimation, software development can progress although the real hardware is not yet available or it is too complex to interact with. In this paper, we present how the native simulation framework SCoPE is extended to generate OTF trace files. Those trace files can be later visualized with trace visualization tools, which recently were only used to optimize HPC workloads in order to iterate in the development process.
△ Less
Submitted 18 June, 2014;
originally announced June 2014.
