-
Telling stories with data -- A systematic review
Authors:
Kay Schröder,
Wiebke Eberhardt,
Poornima Belavadi,
Batoul Ajdadilish,
Nanette van Haften,
Ed Overes,
Taryn Brouns,
André Calero Valdez
Abstract:
The exponential growth of data has outpaced human ability to process information, necessitating innovative approaches for effective human-data interaction. To transform raw data into meaningful insights, storytelling, and visualization have emerged as powerful techniques for communicating complex information to decision-makers. This article offers a comprehensive, systematic review of the utilizat…
▽ More
The exponential growth of data has outpaced human ability to process information, necessitating innovative approaches for effective human-data interaction. To transform raw data into meaningful insights, storytelling, and visualization have emerged as powerful techniques for communicating complex information to decision-makers. This article offers a comprehensive, systematic review of the utilization of storytelling in visualizations. It organizes the existing literature into distinct categories, encompassing frameworks, data and visualization types, application domains, narrative structures, outcome measurements, and design principles. By providing a well-structured overview of this rapidly evolving field, the article serves as a valuable guide for educators, researchers, and practitioners seeking to harness the power of storytelling in data visualization.
△ Less
Submitted 2 December, 2023;
originally announced December 2023.
-
AI-Driven Road Maintenance Inspection v2: Reducing Data Dependency & Quantifying Road Damage
Authors:
Haris Iqbal,
Hemang Chawla,
Arnav Varma,
Terence Brouns,
Ahmed Badar,
Elahe Arani,
Bahram Zonooz
Abstract:
Road infrastructure maintenance inspection is typically a labor-intensive and critical task to ensure the safety of all road users. Existing state-of-the-art techniques in Artificial Intelligence (AI) for object detection and segmentation help automate a huge chunk of this task given adequate annotated data. However, annotating videos from scratch is cost-prohibitive. For instance, it can take an…
▽ More
Road infrastructure maintenance inspection is typically a labor-intensive and critical task to ensure the safety of all road users. Existing state-of-the-art techniques in Artificial Intelligence (AI) for object detection and segmentation help automate a huge chunk of this task given adequate annotated data. However, annotating videos from scratch is cost-prohibitive. For instance, it can take an annotator several days to annotate a 5-minute video recorded at 30 FPS. Hence, we propose an automated labelling pipeline by leveraging techniques like few-shot learning and out-of-distribution detection to generate labels for road damage detection. In addition, our pipeline includes a risk factor assessment for each damage by instance quantification to prioritize locations for repairs which can lead to optimal deployment of road maintenance machinery. We show that the AI models trained with these techniques can not only generalize better to unseen real-world data with reduced requirement for human annotation but also provide an estimate of maintenance urgency, thereby leading to safer roads.
△ Less
Submitted 7 October, 2022;
originally announced October 2022.
-
AI Driven Road Maintenance Inspection
Authors:
Ratnajit Mukherjee,
Haris Iqbal,
Shabbir Marzban,
Ahmed Badar,
Terence Brouns,
Shruthi Gowda,
Elahe Arani,
Bahram Zonooz
Abstract:
Road infrastructure maintenance inspection is typically a labour-intensive and critical task to ensure the safety of all the road users. In this work, we propose a detailed methodology to use state-of-the-art techniques in artificial intelligence and computer vision to automate a sizeable portion of the maintenance inspection subtasks and reduce the labour costs. The proposed methodology uses stat…
▽ More
Road infrastructure maintenance inspection is typically a labour-intensive and critical task to ensure the safety of all the road users. In this work, we propose a detailed methodology to use state-of-the-art techniques in artificial intelligence and computer vision to automate a sizeable portion of the maintenance inspection subtasks and reduce the labour costs. The proposed methodology uses state-of-the-art computer vision techniques such as object detection and semantic segmentation to automate inspections on primary road structures such as the road surface, markings, barriers (guardrails) and traffic signs. The models are mostly trained on commercially viable datasets and augmented with proprietary data. We demonstrate that our AI models can not only automate and scale maintenance inspections on primary road structures but also result in higher recall compared to traditional manual inspections.
△ Less
Submitted 4 June, 2021;
originally announced June 2021.
-
Crowdsourced 3D Map**: A Combined Multi-View Geometry and Self-Supervised Learning Approach
Authors:
Hemang Chawla,
Matti Jukola,
Terence Brouns,
Elahe Arani,
Bahram Zonooz
Abstract:
The ability to efficiently utilize crowdsourced visual data carries immense potential for the domains of large scale dynamic map** and autonomous driving. However, state-of-the-art methods for crowdsourced 3D map** assume prior knowledge of camera intrinsics. In this work, we propose a framework that estimates the 3D positions of semantically meaningful landmarks such as traffic signs without…
▽ More
The ability to efficiently utilize crowdsourced visual data carries immense potential for the domains of large scale dynamic map** and autonomous driving. However, state-of-the-art methods for crowdsourced 3D map** assume prior knowledge of camera intrinsics. In this work, we propose a framework that estimates the 3D positions of semantically meaningful landmarks such as traffic signs without assuming known camera intrinsics, using only monocular color camera and GPS. We utilize multi-view geometry as well as deep learning based self-calibration, depth, and ego-motion estimation for traffic sign positioning, and show that combining their strengths is important for increasing the map coverage. To facilitate research on this task, we construct and make available a KITTI based 3D traffic sign ground truth positioning dataset. Using our proposed framework, we achieve an average single-journey relative and absolute positioning accuracy of 39cm and 1.26m respectively, on this dataset.
△ Less
Submitted 25 July, 2020;
originally announced July 2020.
-
Robust Video-Based Eye Tracking Using Recursive Estimation of Pupil Characteristics
Authors:
Terence Brouns
Abstract:
Video-based eye tracking is a valuable technique in various research fields. Numerous open-source eye tracking algorithms have been developed in recent years, primarily designed for general application with many different camera types. These algorithms do not, however, capitalize on the high frame rate of eye tracking cameras often employed in psychophysical studies. We present a pupil detection m…
▽ More
Video-based eye tracking is a valuable technique in various research fields. Numerous open-source eye tracking algorithms have been developed in recent years, primarily designed for general application with many different camera types. These algorithms do not, however, capitalize on the high frame rate of eye tracking cameras often employed in psychophysical studies. We present a pupil detection method that utilizes this high-speed property to obtain reliable predictions through recursive estimation about certain pupil characteristics in successive camera frames. These predictions are subsequently used to carry out novel image segmentation and classification routines to improve pupil detection performance. Based on results from hand-labelled eye images, our approach was found to have a greater detection rate, accuracy and speed compared to other recently published open-source pupil detection algorithms. The program's source code, together with a graphical user interface, can be downloaded at https://github.com/tbrouns/eyestalker
△ Less
Submitted 27 June, 2017; v1 submitted 25 June, 2017;
originally announced June 2017.
