-
The Wizard of Curiosities: Enriching Dialogues with Fun Facts
Authors:
Frederico Vicente,
Rafael Ferreira,
David Semedo,
João Magalhães
Abstract:
Introducing curiosities in a conversation is a way to teach something new to the person in a pleasant and enjoyable way. Enriching dialogues with contextualized curiosities can improve the users' perception of a dialog system and their overall user experience. In this paper, we introduce a set of curated curiosities, targeting dialogues in the cooking and DIY domains. In particular, we use real hu…
▽ More
Introducing curiosities in a conversation is a way to teach something new to the person in a pleasant and enjoyable way. Enriching dialogues with contextualized curiosities can improve the users' perception of a dialog system and their overall user experience. In this paper, we introduce a set of curated curiosities, targeting dialogues in the cooking and DIY domains. In particular, we use real human-agent conversations collected in the context of the Amazon Alexa TaskBot challenge, a multimodal and multi-turn conversational setting. According to an A/B test with over 1000 conversations, curiosities not only increase user engagement, but provide an average relative rating improvement of 9.7%.
△ Less
Submitted 20 September, 2023;
originally announced September 2023.
-
Reinforcement Learning in System Identification
Authors:
Jose Antonio Martin H.,
Oscar Fernandez Vicente,
Sergio Perez,
Anas Belfadil,
Cristina Ibanez-Llano,
Freddy Jose Perozo Rondon,
Jose Javier Valle,
Javier Arechalde Pelaz
Abstract:
System identification, also known as learning forward models, transfer functions, system dynamics, etc., has a long tradition both in science and engineering in different fields. Particularly, it is a recurring theme in Reinforcement Learning research, where forward models approximate the state transition function of a Markov Decision Process by learning a map** function from current state and a…
▽ More
System identification, also known as learning forward models, transfer functions, system dynamics, etc., has a long tradition both in science and engineering in different fields. Particularly, it is a recurring theme in Reinforcement Learning research, where forward models approximate the state transition function of a Markov Decision Process by learning a map** function from current state and action to the next state. This problem is commonly defined as a Supervised Learning problem in a direct way. This common approach faces several difficulties due to the inherent complexities of the dynamics to learn, for example, delayed effects, high non-linearity, non-stationarity, partial observability and, more important, error accumulation when using bootstrapped predictions (predictions based on past predictions), over large time horizons. Here we explore the use of Reinforcement Learning in this problem. We elaborate on why and how this problem fits naturally and sound as a Reinforcement Learning problem, and present some experimental results that demonstrate RL is a promising technique to solve these kind of problems.
△ Less
Submitted 14 December, 2022;
originally announced December 2022.
-
Deep Q-Learning Market Makers in a Multi-Agent Simulated Stock Market
Authors:
Oscar Fernández Vicente,
Fernando Fernández Rebollo,
Francisco Javier García Polo
Abstract:
Market makers play a key role in financial markets by providing liquidity. They usually fill order books with buy and sell limit orders in order to provide traders alternative price levels to operate. This paper focuses precisely on the study of these markets makers strategies from an agent-based perspective. In particular, we propose the application of Reinforcement Learning (RL) for the creation…
▽ More
Market makers play a key role in financial markets by providing liquidity. They usually fill order books with buy and sell limit orders in order to provide traders alternative price levels to operate. This paper focuses precisely on the study of these markets makers strategies from an agent-based perspective. In particular, we propose the application of Reinforcement Learning (RL) for the creation of intelligent market markers in simulated stock markets. This research analyzes how RL market maker agents behaves in non-competitive (only one RL market maker learning at the same time) and competitive scenarios (multiple RL market markers learning at the same time), and how they adapt their strategies in a Sim2Real scope with interesting results. Furthermore, it covers the application of policy transfer between different experiments, describing the impact of competing environments on RL agents performance. RL and deep RL techniques are proven as profitable market maker approaches, leading to a better understanding of their behavior in stock markets.
△ Less
Submitted 8 December, 2021;
originally announced December 2021.
-
ABO: Dataset and Benchmarks for Real-World 3D Object Understanding
Authors:
Jasmine Collins,
Shubham Goel,
Kenan Deng,
Achleshwar Luthra,
Leon Xu,
Erhan Gundogdu,
Xi Zhang,
Tomas F. Yago Vicente,
Thomas Dideriksen,
Himanshu Arora,
Matthieu Guillaumin,
Jitendra Malik
Abstract:
We introduce Amazon Berkeley Objects (ABO), a new large-scale dataset designed to help bridge the gap between real and virtual 3D worlds. ABO contains product catalog images, metadata, and artist-created 3D models with complex geometries and physically-based materials that correspond to real, household objects. We derive challenging benchmarks that exploit the unique properties of ABO and measure…
▽ More
We introduce Amazon Berkeley Objects (ABO), a new large-scale dataset designed to help bridge the gap between real and virtual 3D worlds. ABO contains product catalog images, metadata, and artist-created 3D models with complex geometries and physically-based materials that correspond to real, household objects. We derive challenging benchmarks that exploit the unique properties of ABO and measure the current limits of the state-of-the-art on three open problems for real-world 3D object understanding: single-view 3D reconstruction, material estimation, and cross-domain multi-view object retrieval.
△ Less
Submitted 24 June, 2022; v1 submitted 12 October, 2021;
originally announced October 2021.
-
Road Curb Detection and Localization with Monocular Forward-view Vehicle Camera
Authors:
Stanislav Panev,
Francisco Vicente,
Fernando De la Torre,
Véronique Prinet
Abstract:
We propose a robust method for estimating road curb 3D parameters (size, location, orientation) using a calibrated monocular camera equipped with a fisheye lens. Automatic curb detection and localization is particularly important in the context of Advanced Driver Assistance System (ADAS), i.e. to prevent possible collision and damage of the vehicle's bumper during perpendicular and diagonal parkin…
▽ More
We propose a robust method for estimating road curb 3D parameters (size, location, orientation) using a calibrated monocular camera equipped with a fisheye lens. Automatic curb detection and localization is particularly important in the context of Advanced Driver Assistance System (ADAS), i.e. to prevent possible collision and damage of the vehicle's bumper during perpendicular and diagonal parking maneuvers. Combining 3D geometric reasoning with advanced vision-based detection methods, our approach is able to estimate the vehicle to curb distance in real time with mean accuracy of more than 90%, as well as its orientation, height and depth.
Our approach consists of two distinct components - curb detection in each individual video frame and temporal analysis. The first part comprises of sophisticated curb edges extraction and parametrized 3D curb template fitting. Using a few assumptions regarding the real world geometry, we can thus retrieve the curb's height and its relative position w.r.t. the moving vehicle on which the camera is mounted. Support Vector Machine (SVM) classifier fed with Histograms of Oriented Gradients (HOG) is used for appearance-based filtering out outliers. In the second part, the detected curb regions are tracked in the temporal domain, so as to perform a second pass of false positives rejection.
We have validated our approach on a newly collected database of 11 videos under different conditions. We have used point-wise LIDAR measurements and manual exhaustive labels as a ground truth.
△ Less
Submitted 27 February, 2020;
originally announced February 2020.
-
A+D Net: Training a Shadow Detector with Adversarial Shadow Attenuation
Authors:
Hieu Le,
Tomas F. Yago Vicente,
Vu Nguyen,
Minh Hoai,
Dimitris Samaras
Abstract:
We propose a novel GAN-based framework for detecting shadows in images, in which a shadow detection network (D-Net) is trained together with a shadow attenuation network (A-Net) that generates adversarial training examples. The A-Net modifies the original training images constrained by a simplified physical shadow model and is focused on fooling the D-Net's shadow predictions. Hence, it is effecti…
▽ More
We propose a novel GAN-based framework for detecting shadows in images, in which a shadow detection network (D-Net) is trained together with a shadow attenuation network (A-Net) that generates adversarial training examples. The A-Net modifies the original training images constrained by a simplified physical shadow model and is focused on fooling the D-Net's shadow predictions. Hence, it is effectively augmenting the training data for D-Net with hard-to-predict cases. The D-Net is trained to predict shadows in both original images and generated images from the A-Net. Our experimental results show that the additional training data from A-Net significantly improves the shadow detection accuracy of D-Net. Our method outperforms the state-of-the-art methods on the most challenging shadow detection benchmark (SBU) and also obtains state-of-the-art results on a cross-dataset task, testing on UCF. Furthermore, the proposed method achieves accurate real-time shadow detection at 45 frames per second.
△ Less
Submitted 27 July, 2018; v1 submitted 4 December, 2017;
originally announced December 2017.
-
Maturity Model for IT Service Outsourcing in Higher Education Institutions
Authors:
Victoriano Valencia García,
Eugenio J. Fernández Vicente,
Luis Usero Aragonés
Abstract:
The current success of organizations depends on the successful implementation of Information and Comunication Technologies (ICTs). Good governance and ICT management are essential for delivering value, managing technological risks, managing resources and performance measurement. In addition, outsourcing is a strategic option which complements IT services provided internally in organizations. This…
▽ More
The current success of organizations depends on the successful implementation of Information and Comunication Technologies (ICTs). Good governance and ICT management are essential for delivering value, managing technological risks, managing resources and performance measurement. In addition, outsourcing is a strategic option which complements IT services provided internally in organizations. This paper proposes the design of a new holistic maturity model based on standards ISO/IEC 20000 and ISO/IEC 38500, the frameworks and best practices of ITIL and COBIT, with a specific focus on IT outsourcing. This model is validated by practices in the field of higher education, using a questionnaire and a metrics table among other measurement tools. Models, standards and guidelines are proposed in the model for facilitating adaptation to universities and achieving excellence in the outsourcing of IT services. The applicability of the model allows an effective transition to a model of good governance and management of outsourced IT services which, aligned with the core business of universities (teaching, research and innovation), affect the effectiveness and efficiency of its management, optimizes its value and minimizes risks.
△ Less
Submitted 10 December, 2013;
originally announced December 2013.
