-
VINCY: A Smart-contract based Data Integrity and Validation Tooling for Automated Vehicle Incident Investigation
Authors:
André Budel,
Reem Alhabib,
Mark Nicholson,
Poonam Yadav
Abstract:
Automated Driving Systems (ADSs) are being manufactured at an accelerated rate, leading to improvements in traffic safety, reduced energy consumption, pollution, and congestion. ADS relies on various data streams from onboard sensors, external road infrastructure, and other vehicles to make driving decisions. For effective traffic accident reconstruction, investigators must produce, collect, store…
▽ More
Automated Driving Systems (ADSs) are being manufactured at an accelerated rate, leading to improvements in traffic safety, reduced energy consumption, pollution, and congestion. ADS relies on various data streams from onboard sensors, external road infrastructure, and other vehicles to make driving decisions. For effective traffic accident reconstruction, investigators must produce, collect, store, and access real-time data. To ensure meaningful investigation, the data used by investigators must be accurate and maintain its integrity.
In this paper, we propose a smart-contract based data integrity and validation tool for automated vehicle incident investigation during road trials, considering uncertainties in a real-world environment.
△ Less
Submitted 22 November, 2023;
originally announced November 2023.
-
Architecting Safer Autonomous Aviation Systems
Authors:
Jane Fenn,
Mark Nicholson,
Ganesh Pai,
Michael Wilkinson
Abstract:
The aviation literature gives relatively little guidance to practitioners about the specifics of architecting systems for safety, particularly the impact of architecture on allocating safety requirements, or the relative ease of system assurance resulting from system or subsystem level architectural choices. As an exemplar, this paper considers common architectural patterns used within traditional…
▽ More
The aviation literature gives relatively little guidance to practitioners about the specifics of architecting systems for safety, particularly the impact of architecture on allocating safety requirements, or the relative ease of system assurance resulting from system or subsystem level architectural choices. As an exemplar, this paper considers common architectural patterns used within traditional aviation systems and explores their safety and safety assurance implications when applied in the context of integrating artificial intelligence (AI) and machine learning (ML) based functionality. Considering safety as an architectural property, we discuss both the allocation of safety requirements and the architectural trade-offs involved early in the design lifecycle. This approach could be extended to other assured properties, similar to safety, such as security. We conclude with a discussion of the safety considerations that emerge in the context of candidate architectural patterns that have been proposed in the recent literature for enabling autonomy capabilities by integrating AI and ML. A recommendation is made for the generation of a property-driven architectural pattern catalogue.
△ Less
Submitted 9 January, 2023;
originally announced January 2023.
-
Title detection: a novel approach to automatically finding retractions and other editorial notices in the scholarly literature
Authors:
Ashish Uppala,
Domenic Rosati,
Josh M. Nicholson,
Milo Mordaunt,
Peter Grabitz,
Sean C. Rife
Abstract:
Despite being a key element in the process of disseminating scientific knowledge, editorial notices are often obscured and not clearly linked to the papers to which they refer. In the present paper, we describe established methods of aggregating notice data, and introduce a novel method of finding editorial notices in the scientific literature. Specifically, we describe how article titles denote n…
▽ More
Despite being a key element in the process of disseminating scientific knowledge, editorial notices are often obscured and not clearly linked to the papers to which they refer. In the present paper, we describe established methods of aggregating notice data, and introduce a novel method of finding editorial notices in the scientific literature. Specifically, we describe how article titles denote notices to existing publications, and how this information can be used to tie notices to papers in an automated fashion. Finally, as part of a broader movement to make science more transparent, we make notices detected through this and other methods publicly available and describe this dataset and how it can be accessed.
△ Less
Submitted 17 October, 2022;
originally announced October 2022.
-
Guidance on the Safety Assurance of Autonomous Systems in Complex Environments (SACE)
Authors:
Richard Hawkins,
Matt Osborne,
Mike Parsons,
Mark Nicholson,
John McDermid,
Ibrahim Habli
Abstract:
Autonomous systems (AS) are systems that have the capability to take decisions free from direct human control. AS are increasingly being considered for adoption for applications where their behaviour may cause harm, such as when used for autonomous driving, medical applications or in domestic environments. For such applications, being able to ensure and demonstrate (assure) the safety of the opera…
▽ More
Autonomous systems (AS) are systems that have the capability to take decisions free from direct human control. AS are increasingly being considered for adoption for applications where their behaviour may cause harm, such as when used for autonomous driving, medical applications or in domestic environments. For such applications, being able to ensure and demonstrate (assure) the safety of the operation of the AS is crucial for their adoption. This can be particularly challenging where AS operate in complex and changing real-world environments. Establishing justified confidence in the safety of AS requires the creation of a compelling safety case. This document introduces a methodology for the Safety Assurance of Autonomous Systems in Complex Environments (SACE). SACE comprises a set of safety case patterns and a process for (1) systematically integrating safety assurance into the development of the AS and (2) for generating the evidence base for explicitly justifying the acceptable safety of the AS.
△ Less
Submitted 1 August, 2022;
originally announced August 2022.
-
An Advert Creation System for 3D Product Placements
Authors:
Ivan Bacher,
Hossein Javidnia,
Soumyabrata Dev,
Rahul Agrahari,
Murhaf Hossari,
Matthew Nicholson,
Clare Conran,
Jian Tang,
Peng Song,
David Corrigan,
François Pitié
Abstract:
Over the past decade, the evolution of video-sharing platforms has attracted a significant amount of investments on contextual advertising. The common contextual advertising platforms utilize the information provided by users to integrate 2D visual ads into videos. The existing platforms face many technical challenges such as ad integration with respect to occluding objects and 3D ad placement. Th…
▽ More
Over the past decade, the evolution of video-sharing platforms has attracted a significant amount of investments on contextual advertising. The common contextual advertising platforms utilize the information provided by users to integrate 2D visual ads into videos. The existing platforms face many technical challenges such as ad integration with respect to occluding objects and 3D ad placement. This paper presents a Video Advertisement Placement & Integration (Adverts) framework, which is capable of perceiving the 3D geometry of the scene and camera motion to blend 3D virtual objects in videos and create the illusion of reality. The proposed framework contains several modules such as monocular depth estimation, object segmentation, background-foreground separation, alpha matting and camera tracking. Our experiments conducted using Adverts framework indicates the significant potential of this system in contextual ad integration, and pushing the limits of advertising industry using mixed reality technologies.
△ Less
Submitted 26 June, 2020;
originally announced June 2020.
-
Identifying Candidate Spaces for Advert Implantation
Authors:
Soumyabrata Dev,
Hossein Javidnia,
Murhaf Hossari,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
Virtual advertising is an important and promising feature in the area of online advertising. It involves integrating adverts onto live or recorded videos for product placements and targeted advertisements. Such integration of adverts is primarily done by video editors in the post-production stage, which is cumbersome and time-consuming. Therefore, it is important to automatically identify candidat…
▽ More
Virtual advertising is an important and promising feature in the area of online advertising. It involves integrating adverts onto live or recorded videos for product placements and targeted advertisements. Such integration of adverts is primarily done by video editors in the post-production stage, which is cumbersome and time-consuming. Therefore, it is important to automatically identify candidate spaces in a video frame, wherein new adverts can be implanted. The candidate space should match the scene perspective, and also have a high quality of experience according to human subjective judgment. In this paper, we propose the use of a bespoke neural net that can assist the video editors in identifying candidate spaces. We benchmark our approach against several deep-learning architectures on a large-scale image dataset of candidate spaces of outdoor scenes. Our work is the first of its kind in this area of multimedia and augmented reality applications, and achieves the best results.
△ Less
Submitted 8 October, 2019;
originally announced October 2019.
-
Localizing Adverts in Outdoor Scenes
Authors:
Soumyabrata Dev,
Murhaf Hossari,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
Online videos have witnessed an unprecedented growth over the last decade, owing to wide range of content creation. This provides the advertisement and marketing agencies plethora of opportunities for targeted advertisements. Such techniques involve replacing an existing advertisement in a video frame, with a new advertisement. However, such post-processing of online videos is mostly done manually…
▽ More
Online videos have witnessed an unprecedented growth over the last decade, owing to wide range of content creation. This provides the advertisement and marketing agencies plethora of opportunities for targeted advertisements. Such techniques involve replacing an existing advertisement in a video frame, with a new advertisement. However, such post-processing of online videos is mostly done manually by video editors. This is cumbersome and time-consuming. In this paper, we propose DeepAds -- a deep neural network, based on the simple encoder-decoder architecture, that can accurately localize the position of an advert in a video frame. Our approach of localizing billboards in outdoor scenes using neural nets, is the first of its kind, and achieves the best performance. We benchmark our proposed method with other semantic segmentation algorithms, on a public dataset of outdoor scenes with manually annotated billboard binary maps.
△ Less
Submitted 6 May, 2019;
originally announced May 2019.
-
The ALOS Dataset for Advert Localization in Outdoor Scenes
Authors:
Soumyabrata Dev,
Murhaf Hossari,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
The rapid increase in the number of online videos provides the marketing and advertising agents ample opportunities to reach out to their audience. One of the most widely used strategies is product placement, or embedded marketing, wherein new advertisements are integrated seamlessly into existing advertisements in videos. Such strategies involve accurately localizing the position of the advert in…
▽ More
The rapid increase in the number of online videos provides the marketing and advertising agents ample opportunities to reach out to their audience. One of the most widely used strategies is product placement, or embedded marketing, wherein new advertisements are integrated seamlessly into existing advertisements in videos. Such strategies involve accurately localizing the position of the advert in the image frame, either manually in the video editing phase, or by using machine learning frameworks. However, these machine learning techniques and deep neural networks need a massive amount of data for training. In this paper, we propose and release the first large-scale dataset of advertisement billboards, captured in outdoor scenes. We also benchmark several state-of-the-art semantic segmentation algorithms on our proposed dataset.
△ Less
Submitted 16 April, 2019;
originally announced April 2019.
-
The CASE Dataset of Candidate Spaces for Advert Implantation
Authors:
Soumyabrata Dev,
Murhaf Hossari,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
With the advent of faster internet services and growth of multimedia content, we observe a massive growth in the number of online videos. The users generate these video contents at an unprecedented rate, owing to the use of smart-phones and other hand-held video capturing devices. This creates immense potential for the advertising and marketing agencies to create personalized content for the users…
▽ More
With the advent of faster internet services and growth of multimedia content, we observe a massive growth in the number of online videos. The users generate these video contents at an unprecedented rate, owing to the use of smart-phones and other hand-held video capturing devices. This creates immense potential for the advertising and marketing agencies to create personalized content for the users. In this paper, we attempt to assist the video editors to generate augmented video content, by proposing candidate spaces in video frames. We propose and release a large-scale dataset of outdoor scenes, along with manually annotated maps for candidate spaces. We also benchmark several deep-learning based semantic segmentation algorithms on this proposed dataset.
△ Less
Submitted 29 April, 2019; v1 submitted 21 March, 2019;
originally announced March 2019.
-
ADNet: A Deep Network for Detecting Adverts
Authors:
Murhaf Hossari,
Soumyabrata Dev,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
Online video advertising gives content providers the ability to deliver compelling content, reach a growing audience, and generate additional revenue from online media. Recently, advertising strategies are designed to look for original advert(s) in a video frame, and replacing them with new adverts. These strategies, popularly known as product placement or embedded marketing, greatly help the mark…
▽ More
Online video advertising gives content providers the ability to deliver compelling content, reach a growing audience, and generate additional revenue from online media. Recently, advertising strategies are designed to look for original advert(s) in a video frame, and replacing them with new adverts. These strategies, popularly known as product placement or embedded marketing, greatly help the marketing agencies to reach out to a wider audience. However, in the existing literature, such detection of candidate frames in a video sequence for the purpose of advert integration, is done manually. In this paper, we propose a deep-learning architecture called ADNet, that automatically detects the presence of advertisements in video frames. Our approach is the first of its kind that automatically detects the presence of adverts in a video frame, and achieves state-of-the-art results on a public dataset.
△ Less
Submitted 9 November, 2018;
originally announced November 2018.
-
An Advert Creation System for Next-Gen Publicity
Authors:
Atul Nautiyal,
Killian McCabe,
Murhaf Hossari,
Soumyabrata Dev,
Matthew Nicholson,
Clare Conran,
Declan McKibben,
Jian Tang,
Xu Wei,
Francois Pitie
Abstract:
With the rapid proliferation of multimedia data in the internet, there has been a fast rise in the creation of videos for the viewers. This enables the viewers to skip the advertisement breaks in the videos, using ad blockers and 'skip ad' buttons -- bringing online marketing and publicity to a stall. In this paper, we demonstrate a system that can effectively integrate a new advertisement into a…
▽ More
With the rapid proliferation of multimedia data in the internet, there has been a fast rise in the creation of videos for the viewers. This enables the viewers to skip the advertisement breaks in the videos, using ad blockers and 'skip ad' buttons -- bringing online marketing and publicity to a stall. In this paper, we demonstrate a system that can effectively integrate a new advertisement into a video sequence. We use state-of-the-art techniques from deep learning and computational photogrammetry, for effective detection of existing adverts, and seamless integration of new adverts into video sequences. This is helpful for targeted advertisement, paving the path for next-gen publicity.
△ Less
Submitted 1 August, 2018;
originally announced August 2018.
