Showing 1–17 of 17 results for author: Martin, A

Forensic Camera Identification: Effects of Off-Nominal Exposures

Authors: Abby Martin, Roy Maxion, Jennifer Newman

Abstract: Photo response non-uniformity (PRNU) is a technology that can match a digital photograph to the camera that took it. Due to its use in forensic investigations and use by forensic experts in court, it is important that error rates for this technology are reliable for a wide range of evidence image types. In particular, images with off-nominal exposures are not uncommon. This paper presents a prelim… ▽ More Photo response non-uniformity (PRNU) is a technology that can match a digital photograph to the camera that took it. Due to its use in forensic investigations and use by forensic experts in court, it is important that error rates for this technology are reliable for a wide range of evidence image types. In particular, images with off-nominal exposures are not uncommon. This paper presents a preliminary investigation of the impact that images with different exposure types - too dark or too light - have on error rates for PRNU source camera identification. We construct a new dataset comprised of 8400 carefully collected images ranging from under-exposed (too dark) to nominally exposed to over-exposed (too bright). We first establish baseline error rates using only nominally exposed images, resulting in a true-positive rate of 100% and a true-negative rate of 99.92%. When off-nominal images are tested, we find striking results: the true-negative rate for under-exposed images is 99.46% (a false-positive rate of roughly one in two hundred, typically unacceptable in a forensic context), and for over-exposed images the true-positive rate falls to 82.90%. Our results highlight the importance of continued study of error rates for the PRNU source camera identification to assure adherence to the high standards set for admissibility of forensic evidence in court. △ Less

Submitted 29 June, 2024; originally announced July 2024.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Learning to optimize with convergence guarantees using nonlinear system theory

Authors: Andrea Martin, Luca Furieri

Abstract: The increasing reliance on numerical methods for controlling dynamical systems and training machine learning models underscores the need to devise algorithms that dependably and efficiently navigate complex optimization landscapes. Classical gradient descent methods offer strong theoretical guarantees for convex problems; however, they demand meticulous hyperparameter tuning for non-convex ones. T… ▽ More The increasing reliance on numerical methods for controlling dynamical systems and training machine learning models underscores the need to devise algorithms that dependably and efficiently navigate complex optimization landscapes. Classical gradient descent methods offer strong theoretical guarantees for convex problems; however, they demand meticulous hyperparameter tuning for non-convex ones. The emerging paradigm of learning to optimize (L2O) automates the discovery of algorithms with optimized performance leveraging learning models and data - yet, it lacks a theoretical framework to analyze convergence of the learned algorithms. In this paper, we fill this gap by harnessing nonlinear system theory. Specifically, we propose an unconstrained parametrization of all convergent algorithms for smooth non-convex objective functions. Notably, our framework is directly compatible with automatic differentiation tools, ensuring convergence by design while learning to optimize. △ Less

Submitted 3 June, 2024; v1 submitted 14 March, 2024; originally announced March 2024.

Comments: Published in the IEEE Control Systems Letters

Artificial Bee Colony optimization of Deep Convolutional Neural Networks in the context of Biomedical Imaging

Authors: Adri Gomez Martin, Carlos Fernandez del Cerro, Monica Abella Garcia, Manuel Desco Menendez

Abstract: Most efforts in Computer Vision focus on natural images or artwork, which differ significantly both in size and contents from the kind of data biomedical image processing deals with. Thus, Transfer Learning models often prove themselves suboptimal for these tasks, even after manual finetuning. The development of architectures from scratch is oftentimes unfeasible due to the vastness of the hyperpa… ▽ More Most efforts in Computer Vision focus on natural images or artwork, which differ significantly both in size and contents from the kind of data biomedical image processing deals with. Thus, Transfer Learning models often prove themselves suboptimal for these tasks, even after manual finetuning. The development of architectures from scratch is oftentimes unfeasible due to the vastness of the hyperparameter space and a shortage of time, computational resources and Deep Learning experts in most biomedical research laboratories. An alternative to manually defining the models is the use of Neuroevolution, which employs metaheuristic techniques to optimize Deep Learning architectures. However, many algorithms proposed in the neuroevolutive literature are either too unreliable or limited to a small, predefined region of the hyperparameter space. To overcome these shortcomings, we propose the Chimera Algorithm, a novel, hybrid neuroevolutive algorithm that integrates the Artificial Bee Colony Algorithm with Evolutionary Computation tools to generate models from scratch, as well as to refine a given previous architecture to better fit the task at hand. The Chimera Algorithm has been validated with two datasets of natural and medical images, producing models that surpassed the performance of those coming from Transfer Learning. △ Less

Submitted 23 February, 2024; originally announced February 2024.

Distributionally Robust Infinite-horizon Control: from a pool of samples to the design of dependable controllers

Authors: Jean-Sébastien Brouillon, Andrea Martin, John Lygeros, Florian Dörfler, Giancarlo Ferrari Trecate

Abstract: We study control of constrained linear systems when faced with only partial statistical information about the disturbance processes affecting the system dynamics and the sensor measurements. Specifically, given a finite collection of disturbance realizations, we consider the problem of designing a stabilizing control policy with provable safety and performance guarantees in face of the inevitable… ▽ More We study control of constrained linear systems when faced with only partial statistical information about the disturbance processes affecting the system dynamics and the sensor measurements. Specifically, given a finite collection of disturbance realizations, we consider the problem of designing a stabilizing control policy with provable safety and performance guarantees in face of the inevitable mismatch between the true and the empirical distributions. We capture this discrepancy using Wasserstein ambiguity sets, and we formulate a distributionally robust (DR) optimal control problem, which provides guarantees on the expected cost, safety, and stability of the system. To solve this problem, we first present new results for DR optimization of quadratic objectives using convex programming, showing that strong duality holds under mild conditions. Then, by combining our results with the system level parametrization (SLP) of linear feedback policies, we show that the design problem can be reduced to a semidefinite optimization problem (SDP). △ Less

Submitted 12 December, 2023; originally announced December 2023.

Closing the Gap to Quadratic Invariance: a Regret Minimization Approach to Optimal Distributed Control

Authors: Daniele Martinelli, Andrea Martin, Giancarlo Ferrari-Trecate, Luca Furieri

Abstract: In this work, we focus on the design of optimal controllers that must comply with an information structure. State-of-the-art approaches do so based on the H2 or Hinfty norm to minimize the expected or worst-case cost in the presence of stochastic or adversarial disturbances. Large-scale systems often experience a combination of stochastic and deterministic disruptions (e.g., sensor failures, envir… ▽ More In this work, we focus on the design of optimal controllers that must comply with an information structure. State-of-the-art approaches do so based on the H2 or Hinfty norm to minimize the expected or worst-case cost in the presence of stochastic or adversarial disturbances. Large-scale systems often experience a combination of stochastic and deterministic disruptions (e.g., sensor failures, environmental fluctuations) that spread across the system and are difficult to model precisely, leading to sub-optimal closed-loop behaviors. Hence, we propose improving performance for these scenarios by minimizing the regret with respect to an ideal policy that complies with less stringent sensor-information constraints. This endows our controller with the ability to approach the improved behavior of a more informed policy, which would detect and counteract heterogeneous and localized disturbances more promptly. Specifically, we derive convex relaxations of the resulting regret minimization problem that are compatible with any desired controller sparsity, while we reveal a renewed role of the Quadratic Invariance (QI) condition in designing informative benchmarks to measure regret. Last, we validate our proposed method through numerical simulations on controlling a multi-agent distributed system, comparing its performance with traditional H2 and Hinfty policies. △ Less

Submitted 26 March, 2024; v1 submitted 3 November, 2023; originally announced November 2023.

Comments: Accepted for presentation and publication in the proceedings of the 2024 European Control Conference (ECC)

On the Guarantees of Minimizing Regret in Receding Horizon

Authors: Andrea Martin, Luca Furieri, Florian Dörfler, John Lygeros, Giancarlo Ferrari-Trecate

Abstract: Towards bridging classical optimal control and online learning, regret minimization has recently been proposed as a control design criterion. This competitive paradigm penalizes the loss relative to the optimal control actions chosen by a clairvoyant policy, and allows tracking the optimal performance in hindsight no matter how disturbances are generated. In this paper, we propose the first recedi… ▽ More Towards bridging classical optimal control and online learning, regret minimization has recently been proposed as a control design criterion. This competitive paradigm penalizes the loss relative to the optimal control actions chosen by a clairvoyant policy, and allows tracking the optimal performance in hindsight no matter how disturbances are generated. In this paper, we propose the first receding horizon scheme based on the repeated computation of finite horizon regret-optimal policies, and we establish stability and safety guarantees for the resulting closed-loop system. Our derivations combine novel monotonicity properties of clairvoyant policies with suitable terminal ingredients. We prove that our scheme is recursively feasible, stabilizing, and that it achieves bounded regret relative to the infinite horizon clairvoyant policy. Last, we show that the policy optimization problem can be solved efficiently through convex-concave programming. Our numerical experiments show that minimizing regret can outperform standard receding horizon approaches when the disturbances poorly fit classical design assumptions - even when the finite horizon planning is recomputed less frequently. △ Less

Submitted 26 June, 2023; originally announced June 2023.

Regret Optimal Control for Uncertain Stochastic Systems

Authors: Andrea Martin, Luca Furieri, Florian Dörfler, John Lygeros, Giancarlo Ferrari-Trecate

Abstract: We consider control of uncertain linear time-varying stochastic systems from the perspective of regret minimization. Specifically, we focus on the problem of designing a feedback controller that minimizes the loss relative to a clairvoyant optimal policy that has foreknowledge of both the system dynamics and the exogenous disturbances. In this competitive framework, establishing robustness guarant… ▽ More We consider control of uncertain linear time-varying stochastic systems from the perspective of regret minimization. Specifically, we focus on the problem of designing a feedback controller that minimizes the loss relative to a clairvoyant optimal policy that has foreknowledge of both the system dynamics and the exogenous disturbances. In this competitive framework, establishing robustness guarantees proves challenging as, differently from the case where the model is known, the clairvoyant optimal policy is not only inapplicable, but also impossible to compute without knowledge of the system parameters. To address this challenge, we embrace a scenario optimization approach, and we propose minimizing regret robustly over a finite set of randomly sampled system parameters. We prove that this policy optimization problem can be solved through semidefinite programming, and that the corresponding solution retains strong probabilistic out-of-sample regret guarantees in face of the uncertain dynamics. Our method naturally extends to include satisfaction of safety constraints with high probability. We validate our theoretical results and showcase the potential of our approach by means of numerical simulations. △ Less

Submitted 19 March, 2024; v1 submitted 28 April, 2023; originally announced April 2023.

Using Decoupled Features for Photo-realistic Style Transfer

Authors: Trevor D. Canham, Adrián Martín, Marcelo Bertalmío, Javier Portilla

Abstract: In this work we propose a photorealistic style transfer method for image and video that is based on vision science principles and on a recent mathematical formulation for the deterministic decoupling of sample statistics. The novel aspects of our approach include matching decoupled moments of higher order than in common style transfer approaches, and matching a descriptor of the power spectrum so… ▽ More In this work we propose a photorealistic style transfer method for image and video that is based on vision science principles and on a recent mathematical formulation for the deterministic decoupling of sample statistics. The novel aspects of our approach include matching decoupled moments of higher order than in common style transfer approaches, and matching a descriptor of the power spectrum so as to characterize and transfer diffusion effects between source and target, which is something that has not been considered before in the literature. The results are of high visual quality, without spatio-temporal artifacts, and validation tests in the form of observer preference experiments show that our method compares very well with the state-of-the-art. The computational complexity of the algorithm is low, and we propose a numerical implementation that is amenable for real-time video application. Finally, another contribution of our work is to point out that current deep learning approaches for photorealistic style transfer don't really achieve photorealistic quality outside of limited examples, because the results too often show unacceptable visual artifacts. △ Less

Submitted 7 April, 2023; v1 submitted 5 December, 2022; originally announced December 2022.

Follow the Clairvoyant: an Imitation Learning Approach to Optimal Control

Authors: Andrea Martin, Luca Furieri, Florian Dörfler, John Lygeros, Giancarlo Ferrari-Trecate

Abstract: We consider control of dynamical systems through the lens of competitive analysis. Most prior work in this area focuses on minimizing regret, that is, the loss relative to an ideal clairvoyant policy that has noncausal access to past, present, and future disturbances. Motivated by the observation that the optimal cost only provides coarse information about the ideal closed-loop behavior, we instea… ▽ More We consider control of dynamical systems through the lens of competitive analysis. Most prior work in this area focuses on minimizing regret, that is, the loss relative to an ideal clairvoyant policy that has noncausal access to past, present, and future disturbances. Motivated by the observation that the optimal cost only provides coarse information about the ideal closed-loop behavior, we instead propose directly minimizing the tracking error relative to the optimal trajectories in hindsight, i.e., imitating the clairvoyant policy. By embracing a system level perspective, we present an efficient optimization-based approach for computing follow-the-clairvoyant (FTC) safe controllers. We prove that these attain minimal regret if no constraints are imposed on the noncausal benchmark. In addition, we present numerical experiments to show that our policy retains the hallmark of competitive algorithms of interpolating between classical $\mathcal{H}_2$ and $\mathcal{H}_\infty$ control laws - while consistently outperforming regret minimization methods in constrained scenarios thanks to the superior ability to chase the clairvoyant. △ Less

Submitted 14 November, 2022; originally announced November 2022.

Safe Control with Minimal Regret

Authors: Andrea Martin, Luca Furieri, Florian Dörfler, John Lygeros, Giancarlo Ferrari-Trecate

Abstract: As we move towards safety-critical cyber-physical systems that operate in non-stationary and uncertain environments, it becomes crucial to close the gap between classical optimal control algorithms and adaptive learning-based methods. In this paper, we present an efficient optimization-based approach for computing a finite-horizon robustly safe control policy that minimizes dynamic regret, in the… ▽ More As we move towards safety-critical cyber-physical systems that operate in non-stationary and uncertain environments, it becomes crucial to close the gap between classical optimal control algorithms and adaptive learning-based methods. In this paper, we present an efficient optimization-based approach for computing a finite-horizon robustly safe control policy that minimizes dynamic regret, in the sense of the loss relative to the optimal sequence of control actions selected in hindsight by a clairvoyant controller. By leveraging the system level synthesis framework (SLS), our method extends recent results on regret minimization for the linear quadratic regulator to optimal control subject to hard safety constraints, and allows competing against a safety-aware clairvoyant policy with minor modifications. Numerical experiments confirm superior performance with respect to finite-horizon constrained $\mathcal{H}_2$ and $\mathcal{H}_\infty$ control laws when the disturbance realizations poorly fit classical assumptions. △ Less

Submitted 14 November, 2022; v1 submitted 1 March, 2022; originally announced March 2022.

Can Social Robots Effectively Elicit Curiosity in STEM Topics from K-1 Students During Oral Assessments?

Authors: Alexander Johnson, Alejandra Martin, Marlen Quintero, Alison Bailey, Abeer Alwan

Abstract: This paper presents the results of a pilot study that introduces social robots into kindergarten and first-grade classroom tasks. This study aims to understand 1) how effective social robots are in administering educational activities and assessments, and 2) if these interactions with social robots can serve as a gateway into learning about robotics and STEM for young children. We administered a c… ▽ More This paper presents the results of a pilot study that introduces social robots into kindergarten and first-grade classroom tasks. This study aims to understand 1) how effective social robots are in administering educational activities and assessments, and 2) if these interactions with social robots can serve as a gateway into learning about robotics and STEM for young children. We administered a commonly-used assessment (GFTA3) of speech production using a social robot and compared the quality of recorded responses to those obtained with a human assessor. In a comparison done between 40 children, we found no significant differences in the student responses between the two conditions over the three metrics used: word repetition accuracy, number of times additional help was needed, and similarity of prosody to the assessor. We also found that interactions with the robot were successfully able to stimulate curiosity in robotics, and therefore STEM, from a large number of the 164 student participants. △ Less

Submitted 19 February, 2022; originally announced February 2022.

Comments: 6 pages, 2 figures

Journal ref: IEEE Educon 2022

Performance and limitations of dual-comb based ranging systems

Authors: Bruno Martin, Patrick Feneyrou, Daniel Dolfi, Aude Martin

Abstract: Dual-comb LiDARs have the potential to perform high-resolution ranging at high speed. Here, through an implementation involving electro-optic modulators and heterodyne detection, we quantify the ranging systems trade-off between precision and non-ambiguity range (NAR) using a unique performance factor. We highlight the influence of the comb amplitude envelope on the precision with a distance measu… ▽ More Dual-comb LiDARs have the potential to perform high-resolution ranging at high speed. Here, through an implementation involving electro-optic modulators and heterodyne detection, we quantify the ranging systems trade-off between precision and non-ambiguity range (NAR) using a unique performance factor. We highlight the influence of the comb amplitude envelope on the precision with a distance measurement limited by the repetition rate of the optical comb. The influence of the combs repetition rate on the NAR and on the precision is illustrated through a setup allowing distance measurement with a tunable NAR. Finally, we demonstrate the impossibility to resolve different targets, quantify the impact on the measured distance and develop on the conditions in which non-linear effects of the interference make the measurement impossible. △ Less

Submitted 11 February, 2022; originally announced February 2022.

Comments: The authors acknowledge financial support by the Qombs Project (FET Flagship on Quantum Technologies grant No 820419) Quantum simulation and entanglement engineering in quantum cascade laser frequency combs

Journal ref: Opt. Express 30, 4005-4016 (2022)

Learning Football Body-Orientation as a Matter of Classification

Authors: Adrià Arbués-Sangüesa, Adrián Martín, Paulino Granero, Coloma Ballester, Gloria Haro

Abstract: Orientation is a crucial skill for football players that becomes a differential factor in a large set of events, especially the ones involving passes. However, existing orientation estimation methods, which are based on computer-vision techniques, still have a lot of room for improvement. To the best of our knowledge, this article presents the first deep learning model for estimating orientation d… ▽ More Orientation is a crucial skill for football players that becomes a differential factor in a large set of events, especially the ones involving passes. However, existing orientation estimation methods, which are based on computer-vision techniques, still have a lot of room for improvement. To the best of our knowledge, this article presents the first deep learning model for estimating orientation directly from video footage. By approaching this challenge as a classification problem where classes correspond to orientation bins, and by introducing a cyclic loss function, a well-known convolutional network is refined to provide player orientation data. The model is trained by using ground-truth orientation data obtained from wearable EPTS devices, which are individually compensated with respect to the perceived orientation in the current frame. The obtained results outperform previous methods; in particular, the absolute median error is less than 12 degrees per player. An ablation study is included in order to show the potential generalization to any kind of football video footage. △ Less

Submitted 1 June, 2021; originally announced June 2021.

Comments: Accepted in the AI for Sports Analytics Workshop at ICJAI 2021

Near-Optimal Design of Safe Output Feedback Controllers from Noisy Data

Authors: Luca Furieri, Baiwei Guo, Andrea Martin, Giancarlo Ferrari-Trecate

Abstract: As we transition towards the deployment of data-driven controllers for black-box cyberphysical systems, complying with hard safety constraints becomes a primary concern. Two key aspects should be addressed when input-output data are corrupted by noise: how much uncertainty can one tolerate without compromising safety, and to what extent is the control performance affected? By focusing on finite-ho… ▽ More As we transition towards the deployment of data-driven controllers for black-box cyberphysical systems, complying with hard safety constraints becomes a primary concern. Two key aspects should be addressed when input-output data are corrupted by noise: how much uncertainty can one tolerate without compromising safety, and to what extent is the control performance affected? By focusing on finite-horizon constrained linear-quadratic problems, we provide an answer to these questions in terms of the model mismatch incurred during a preliminary identification phase. We propose a control design procedure based on a quasiconvex relaxation of the original robust problem and we prove that, if the uncertainty is sufficiently small, the synthesized controller is safe and near-optimal, in the sense that the suboptimality gap increases linearly with the model mismatch level. Since the proposed method is independent of the specific identification procedure, our analysis holds in combination with state-of-the-art behavioral estimators beyond standard least-squares. The main theoretical results are validated by numerical experiments. △ Less

Submitted 12 September, 2022; v1 submitted 21 May, 2021; originally announced May 2021.

Comments: Baiwei Guo and Andrea Martin contributed equally to this work. in IEEE Transactions on Automatic Control, 2022

Intermittent control as a model of mouse movements

Authors: J. Alberto Álvarez Martín, Henrik Gollee, Jörg Müller, Roderick Murray-Smith

Abstract: We present Intermittent Control (IC) models as a candidate framework for modelling human input movements in Human--Computer Interaction (HCI). IC differs from continuous control in that users are not assumed to use feedback to adjust their movements continuously, but only when the difference between the observed pointer position and predicted pointer positions become large. We use a parameter opti… ▽ More We present Intermittent Control (IC) models as a candidate framework for modelling human input movements in Human--Computer Interaction (HCI). IC differs from continuous control in that users are not assumed to use feedback to adjust their movements continuously, but only when the difference between the observed pointer position and predicted pointer positions become large. We use a parameter optimisation approach to identify the parameters of an intermittent controller from experimental data, where users performed one-dimensional mouse movements in a reciprocal pointing task. Compared to previous published work with continuous control models, based on the Kullback-Leibler divergence from the experimental observations, IC is better able to generatively reproduce the distinctive dynamical features and variability of the pointing task across participants and over repeated tasks. IC is compatible with current physiological and psychological theory and provides insight into the source of variability in HCI tasks. △ Less

Submitted 15 March, 2021; originally announced March 2021.

Comments: 42 pages, 26 figures

A Behavioral Input-Output Parametrization of Control Policies with Suboptimality Guarantees

Authors: Luca Furieri, Baiwei Guo, Andrea Martin, Giancarlo Ferrari-Trecate

Abstract: Recent work in data-driven control has revived behavioral theory to perform a variety of complex control tasks, by directly plugging libraries of past input-output trajectories into optimal control problems. Despite recent advances, a key aspect remains unclear: how and to what extent do noise-corrupted data impact control performance? In this work, we provide a quantitative answer to this questio… ▽ More Recent work in data-driven control has revived behavioral theory to perform a variety of complex control tasks, by directly plugging libraries of past input-output trajectories into optimal control problems. Despite recent advances, a key aspect remains unclear: how and to what extent do noise-corrupted data impact control performance? In this work, we provide a quantitative answer to this question. We formulate a Behavioral version of the Input-Output Parametrization (BIOP) for the optimal predictive control of unknown systems using output-feedback dynamic control policies. The main advantages of the proposed framework are that 1) the state-space parameters and the initial state need not be specified for controller synthesis, 2) it can be used in combination with state-of-the-art impulse response estimators, and 3) it allows to recover suboptimality results on learning the Linear Quadratic Gaussian (LQG) controller, therefore revealing, in a quantitative way, how the level of noise in the data affects the performance of behavioral methods. Specifically, it is shown that the performance degrades linearly with the prediction error of the behavioral model. We conclude the paper with numerical experiments to validate our results. △ Less

Submitted 24 March, 2021; v1 submitted 26 February, 2021; originally announced February 2021.

Comments: Baiwei Guo and Andrea Martin contributed equally to this work

Real-time digital holography of the retina by principal component analysis

Authors: Leo Puyo, Loic Bellonnet-Mottet, Antoine Martin, Francois Te, Michel Paques, Michael Atlan

Abstract: We demonstrate the feasibility of high-quality digital holography of the human retina in real-time with a fast camera and commodity computer hardware. High throughput rendering of digital Fresnel holograms from optically-acquired inline interferograms is performed in conjunction with temporal demodulation by projection of hologram sequences onto a data-derived basis in order to discriminate local… ▽ More We demonstrate the feasibility of high-quality digital holography of the human retina in real-time with a fast camera and commodity computer hardware. High throughput rendering of digital Fresnel holograms from optically-acquired inline interferograms is performed in conjunction with temporal demodulation by projection of hologram sequences onto a data-derived basis in order to discriminate local narrowband coherent detection contrasts, mostly due to blood flow and optical absorption, from spurious interferometric contributions. Digital holograms are calculated from a sustained input stream of 16-bit, 1024-by-1024-pixel interferograms recorded at up to 500 frames per second, processed by principal component analysis. This temporal signal demodulation scheme consists in the projection of stacks of 32 consecutive holograms onto a basis calculated by eigendecomposition of the matrix of their time-lagged covariance; it is performed up to 20 times per second with commodity computer hardware. △ Less

Submitted 2 April, 2020; originally announced April 2020.