-
Physics-Informed Neural Network for Multirotor Slung Load Systems Modeling
Authors:
Gil Serrano,
Marcelo Jacinto,
Jose Ribeiro-Gomes,
Joao Pinto,
Bruno J. Guerreiro,
Alexandre Bernardino,
Rita Cunha
Abstract:
Recent advances in aerial robotics have enabled the use of multirotor vehicles for autonomous payload transportation. Resorting only to classical methods to reliably model a quadrotor carrying a cable-slung load poses significant challenges. On the other hand, purely data-driven learning methods do not comply by design with the problem's physical constraints, especially in states that are not dens…
▽ More
Recent advances in aerial robotics have enabled the use of multirotor vehicles for autonomous payload transportation. Resorting only to classical methods to reliably model a quadrotor carrying a cable-slung load poses significant challenges. On the other hand, purely data-driven learning methods do not comply by design with the problem's physical constraints, especially in states that are not densely represented in training data. In this work, we explore the use of physics informed neural networks to learn an end-to-end model of the multirotor-slung-load system and, at a given time, estimate a sequence of the future system states. An LSTM encoder decoder with an attention mechanism is used to capture the dynamics of the system. To guarantee the cohesiveness between the multiple predicted states of the system, we propose the use of a physics-based term in the loss function, which includes a discretized physical model derived from first principles together with slack variables that allow for a small mismatch between expected and predicted values. To train the model, a dataset using a real-world quadrotor carrying a slung load was curated and is made available. Prediction results are presented and corroborate the feasibility of the approach. The proposed method outperforms both the first principles physical model and a comparable neural network model trained without the physics regularization proposed.
△ Less
Submitted 15 May, 2024;
originally announced May 2024.
-
LayoutFlow: Flow Matching for Layout Generation
Authors:
Julian Jorge Andrade Guerreiro,
Naoto Inoue,
Kento Masui,
Mayu Otani,
Hideki Nakayama
Abstract:
Finding a suitable layout represents a crucial task for diverse applications in graphic design. Motivated by simpler and smoother sampling trajectories, we explore the use of Flow Matching as an alternative to current diffusion-based layout generation models. Specifically, we propose LayoutFlow, an efficient flow-based model capable of generating high-quality layouts. Instead of progressively deno…
▽ More
Finding a suitable layout represents a crucial task for diverse applications in graphic design. Motivated by simpler and smoother sampling trajectories, we explore the use of Flow Matching as an alternative to current diffusion-based layout generation models. Specifically, we propose LayoutFlow, an efficient flow-based model capable of generating high-quality layouts. Instead of progressively denoising the elements of a noisy layout, our method learns to gradually move, or flow, the elements of an initial sample until it reaches its final prediction. In addition, we employ a conditioning scheme that allows us to handle various generation tasks with varying degrees of conditioning with a single model. Empirically, LayoutFlow performs on par with state-of-the-art models while being significantly faster.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
My Zelda Cane: Strategies Used by Blind Players to Play Visual-Centric Digital Games
Authors:
David Gonçalves,
Manuel Piçarra,
Pedro Pais,
João Guerreiro,
André Rodrigues
Abstract:
Mainstream games are typically designed around the visual experience, with behaviors and interactions highly dependent on vision. Despite this, blind people are playing mainstream games while dealing with and overcoming inaccessible content, often together with friends and audiences. In this work, we analyze over 70 hours of YouTube videos, where blind content-creators play visual-centric games. W…
▽ More
Mainstream games are typically designed around the visual experience, with behaviors and interactions highly dependent on vision. Despite this, blind people are playing mainstream games while dealing with and overcoming inaccessible content, often together with friends and audiences. In this work, we analyze over 70 hours of YouTube videos, where blind content-creators play visual-centric games. We point out the various strategies employed by players to overcome barriers that permeate mainstream games. We reflect on ways to enable and improve blind players experience with these games, shedding light on the positive and negative consequences of apparently benign design choices. Our observations underline how game elements are appropriated for accessibility, the incidental consequences of audio design, and the trade-offs between accessibility, agency, and engagement.
△ Less
Submitted 19 January, 2023;
originally announced January 2023.
-
Barriers and Opportunities to Accessible Social Media Content Authoring
Authors:
Letícia Seixas Pereira,
José Coelho,
André Rodrigues,
João Guerreiro,
Tiago Guerreiro,
Carlos Duarte
Abstract:
User-generated content plays a key role in social networking, allowing a more active participation, socialisation, and collaboration among users. In particular, media content has been gaining a lot of ground, allowing users to express themselves through different types of formats such as images, GIFs and videos. The majority of this growing type of online content remains inaccessible to a part of…
▽ More
User-generated content plays a key role in social networking, allowing a more active participation, socialisation, and collaboration among users. In particular, media content has been gaining a lot of ground, allowing users to express themselves through different types of formats such as images, GIFs and videos. The majority of this growing type of online content remains inaccessible to a part of the population, despite available tools to mitigate this source of exclusion. We sought to understand how people are perceiving these online contents in their networks and how to support tools are being used. To do so, we performed an online survey of 258 social network users and a follow-up interview conducted with 20 of them - 7 of them self-reporting blind and 13 sighted users without a disability. Results show how the different approaches being employed by major platforms are still not sufficient to properly address this issue. Our findings reveal that mainstream users are not aware of the possibility and the benefits of adopting accessible practices. From the general perspectives of end-users experiencing accessible practices, concerning barriers encountered, and motivational factors, we also discuss further approaches to create more user engagement and awareness.
△ Less
Submitted 22 April, 2021;
originally announced April 2021.
-
Open Challenges of Blind People using Smartphones
Authors:
André Rodrigues,
Hugo Nicolau,
Kyle Montague,
João Guerreiro,
Tiago Guerreiro
Abstract:
Blind people face significant challenges when using smartphones. The focus on improving non-visual mobile accessibility has been at the level of touchscreen access. Our research investigates the challenges faced by blind people in their everyday usage of mobile phones. In this paper, we present a set of studies performed with the target population, novices and experts, using a variety of methods,…
▽ More
Blind people face significant challenges when using smartphones. The focus on improving non-visual mobile accessibility has been at the level of touchscreen access. Our research investigates the challenges faced by blind people in their everyday usage of mobile phones. In this paper, we present a set of studies performed with the target population, novices and experts, using a variety of methods, targeted at identifying and verifying challenges; and co** mechanisms. Through a multiple methods approach we identify and validate challenges locally with a diverse set of user expertise and devices, and at scale through the analyses of the largest Android and iOS dedicate forums for blind people. We contribute with a prioritized corpus of smartphone challenges for blind people, and a discussion on a set of directions for future research that tackle the open and often overlooked challenges.
△ Less
Submitted 30 October, 2019; v1 submitted 19 September, 2019;
originally announced September 2019.
-
LiDAR-based Control of Autonomous Rotorcraft for the Inspection of Pier-like Structures: Proofs
Authors:
Bruno J. Guerreiro,
Carlos Silvestre,
Rita Cunha,
David Cabecinhas
Abstract:
This is a complementary document to the paper presented in [1], to provide more detailed proofs for some results. The main paper addresses the problem of trajectory tracking control of autonomous rotorcraft in operation scenarios where only relative position measurements obtained from LiDAR sensors are possible. The proposed approach defines an alternative kinematic model, directly based on LiDAR…
▽ More
This is a complementary document to the paper presented in [1], to provide more detailed proofs for some results. The main paper addresses the problem of trajectory tracking control of autonomous rotorcraft in operation scenarios where only relative position measurements obtained from LiDAR sensors are possible. The proposed approach defines an alternative kinematic model, directly based on LiDAR measurements, and uses a trajectory-dependent error space to express the dynamic model of the vehicle. An LPV representation with piecewise affine dependence on the parameters is adopted to describe the error dynamics over a set of predefined operating regions, and a continuous-time $H_2$ control problem is solved using LMIs and implemented within the scope of gain-scheduling control theory.
△ Less
Submitted 3 May, 2017;
originally announced May 2017.
-
Stressing the Boundaries of Mobile Accessibility
Authors:
Hugo Nicolau,
João Guerreiro,
Tiago Guerreiro
Abstract:
Mobile devices gather the communication capabilities as no other gadget. Plus, they now comprise a wider set of applications while still maintaining reduced size and weight. They have started to include accessibility features that enable the inclusion of disabled people. However, these inclusive efforts still fall short considering the possibilities of such devices. This is mainly due to the lack…
▽ More
Mobile devices gather the communication capabilities as no other gadget. Plus, they now comprise a wider set of applications while still maintaining reduced size and weight. They have started to include accessibility features that enable the inclusion of disabled people. However, these inclusive efforts still fall short considering the possibilities of such devices. This is mainly due to the lack of interoperability and extensibility of current mobile operating systems (OS). In this paper, we present a case study of a multi-impaired person where access to basic mobile applications was provided in an applicational basis. We outline the main flaws in current mobile OS and suggest how these could further empower developers to provide accessibility components. These could then be compounded to provide system-wide inclusion to a wider range of (multi)-impairments.
△ Less
Submitted 5 February, 2014;
originally announced February 2014.
