Showing 1–2 of 2 results for author: Doan, N A V

Butterfly Effect Attack: Tiny and Seemingly Unrelated Perturbations for Object Detection

Authors: Nguyen Anh Vu Doan, Arda Yüksel, Chih-Hong Cheng

Abstract: This work aims to explore and identify tiny and seemingly unrelated perturbations of images in object detection that will lead to performance degradation. While tininess can naturally be defined using $L_p$ norms, we characterize the degree of "unrelatedness" of an object by the pixel distance between the occurred perturbation and the object. Triggering errors in prediction while satisfying two ob… ▽ More This work aims to explore and identify tiny and seemingly unrelated perturbations of images in object detection that will lead to performance degradation. While tininess can naturally be defined using $L_p$ norms, we characterize the degree of "unrelatedness" of an object by the pixel distance between the occurred perturbation and the object. Triggering errors in prediction while satisfying two objectives can be formulated as a multi-objective optimization problem where we utilize genetic algorithms to guide the search. The result successfully demonstrates that (invisible) perturbations on the right part of the image can drastically change the outcome of object detection on the left. An extensive evaluation reaffirms our conjecture that transformer-based object detection networks are more susceptible to butterfly effects in comparison to single-stage object detection networks such as YOLOv5. △ Less

Submitted 14 November, 2022; originally announced November 2022.

Facilitating Change Implementation for Continuous ML-Safety Assurance

Authors: Chih-Hong Cheng, Nguyen Anh Vu Doan, Balahari Balu, Franziska Schwaiger, Emmanouil Seferis, Simon Burton, Yassine Qamsane, Ankit Shukla, Yinchong Yang, Zhiliang Wu, Andreas Hapfelmeier, Ingo Thon

Abstract: We propose a method for deploying a safety-critical machine-learning component into continuously evolving environments where an increased degree of automation in the engineering process is desired. We associate semantic tags with the safety case argumentation and turn each piece of evidence into a quantitative metric or a logic formula. With proper tool support, the impact can be characterized by… ▽ More We propose a method for deploying a safety-critical machine-learning component into continuously evolving environments where an increased degree of automation in the engineering process is desired. We associate semantic tags with the safety case argumentation and turn each piece of evidence into a quantitative metric or a logic formula. With proper tool support, the impact can be characterized by a query over the safety argumentation tree to highlight evidence turning invalid. The concept is exemplified using a vision-based emergency braking system of an autonomous guided vehicle for factory automation. △ Less

Submitted 23 September, 2022; originally announced September 2022.