-
Nearest neighbor recurrence relations for Meixner-Angelesco multiple orthogonal polynomials of the second kind
Authors:
Jorge Arvesú Carballo,
Alejandro J. Quintero Roba
Abstract:
This paper studies a new family of Angelesco multiple orthogonal polynomials with shared orthogonality conditions with respect to a system of weight functions, which are complex analogues of Pascal distributions on a legged star-like set. The emphasis is placed on the algebraic properties such as the raising operators, the Rodrigues-type formula, the explicit expression of the polynomials, and the…
▽ More
This paper studies a new family of Angelesco multiple orthogonal polynomials with shared orthogonality conditions with respect to a system of weight functions, which are complex analogues of Pascal distributions on a legged star-like set. The emphasis is placed on the algebraic properties such as the raising operators, the Rodrigues-type formula, the explicit expression of the polynomials, and the nearest neighbor recurrence relations.
△ Less
Submitted 22 December, 2023;
originally announced December 2023.
-
On two families of discrete multiple orthogonal polynomials on a star-like set
Authors:
Jorge Arvesú Carballo,
Alejandro J. Quintero Roba
Abstract:
We study two families of type II discrete multiple orthogonal polynomials on an $r$-legged star-like set with respect to $r$ weight functions of Charlier (Poisson distributions) and Meixner (negative binomial distributions), respectively. We focus our attention on the structural properties such as the raising operators, the Rodrigues-type formulas, and the explicit expressions of the polynomial fa…
▽ More
We study two families of type II discrete multiple orthogonal polynomials on an $r$-legged star-like set with respect to $r$ weight functions of Charlier (Poisson distributions) and Meixner (negative binomial distributions), respectively. We focus our attention on the structural properties such as the raising operators, the Rodrigues-type formulas, and the explicit expressions of the polynomial families as well as the coefficients of the nearest neighbor recurrence relation. A limit relation between these families is given.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
DRUformer: Enhancing the driving scene Important object detection with driving relationship self-understanding
Authors:
Yingjie Niu,
Ming Ding,
Keisuke Fujii,
Kento Ohtani,
Alexander Carballo,
Kazuya Takeda
Abstract:
Traffic accidents frequently lead to fatal injuries, contributing to over 50 million deaths until 2023. To mitigate driving hazards and ensure personal safety, it is crucial to assist vehicles in anticipating important objects during travel. Previous research on important object detection primarily assessed the importance of individual participants, treating them as independent entities and freque…
▽ More
Traffic accidents frequently lead to fatal injuries, contributing to over 50 million deaths until 2023. To mitigate driving hazards and ensure personal safety, it is crucial to assist vehicles in anticipating important objects during travel. Previous research on important object detection primarily assessed the importance of individual participants, treating them as independent entities and frequently overlooking the connections between these participants. Unfortunately, this approach has proven less effective in detecting important objects in complex scenarios. In response, we introduce Driving scene Relationship self-Understanding transformer (DRUformer), designed to enhance the important object detection task. The DRUformer is a transformer-based multi-modal important object detection model that takes into account the relationships between all the participants in the driving scenario. Recognizing that driving intention also significantly affects the detection of important objects during driving, we have incorporated a module for embedding driving intention. To assess the performance of our approach, we conducted a comparative experiment on the DRAMA dataset, pitting our model against other state-of-the-art (SOTA) models. The results demonstrated a noteworthy 16.2\% improvement in mIoU and a substantial 12.3\% boost in ACC compared to SOTA methods. Furthermore, we conducted a qualitative analysis of our model's ability to detect important objects across different road scenarios and classes, highlighting its effectiveness in diverse contexts. Finally, we conducted various ablation studies to assess the efficiency of the proposed modules in our DRUformer model.
△ Less
Submitted 13 December, 2023; v1 submitted 11 November, 2023;
originally announced November 2023.
-
Learning to Predict Navigational Patterns from Partial Observations
Authors:
Robin Karlsson,
Alexander Carballo,
Francisco Lepe-Salazar,
Keisuke Fujii,
Kento Ohtani,
Kazuya Takeda
Abstract:
Human beings cooperatively navigate rule-constrained environments by adhering to mutually known navigational patterns, which may be represented as directional pathways or road lanes. Inferring these navigational patterns from incompletely observed environments is required for intelligent mobile robots operating in unmapped locations. However, algorithmically defining these navigational patterns is…
▽ More
Human beings cooperatively navigate rule-constrained environments by adhering to mutually known navigational patterns, which may be represented as directional pathways or road lanes. Inferring these navigational patterns from incompletely observed environments is required for intelligent mobile robots operating in unmapped locations. However, algorithmically defining these navigational patterns is nontrivial. This paper presents the first self-supervised learning (SSL) method for learning to infer navigational patterns in real-world environments from partial observations only. We explain how geometric data augmentation, predictive world modeling, and an information-theoretic regularizer enables our model to predict an unbiased local directional soft lane probability (DSLP) field in the limit of infinite data. We demonstrate how to infer global navigational patterns by fitting a maximum likelihood graph to the DSLP field. Experiments show that our SSL model outperforms two SOTA supervised lane graph prediction models on the nuScenes dataset. We propose our SSL method as a scalable and interpretable continual learning paradigm for navigation by perception. Code is available at https://github.com/robin-karlsson0/dslp.
△ Less
Submitted 5 July, 2023; v1 submitted 25 April, 2023;
originally announced April 2023.
-
Predictive World Models from Real-World Partial Observations
Authors:
Robin Karlsson,
Alexander Carballo,
Keisuke Fujii,
Kento Ohtani,
Kazuya Takeda
Abstract:
Cognitive scientists believe adaptable intelligent agents like humans perform reasoning through learned causal mental simulations of agents and environments. The problem of learning such simulations is called predictive world modeling. Recently, reinforcement learning (RL) agents leveraging world models have achieved SOTA performance in game environments. However, understanding how to apply the wo…
▽ More
Cognitive scientists believe adaptable intelligent agents like humans perform reasoning through learned causal mental simulations of agents and environments. The problem of learning such simulations is called predictive world modeling. Recently, reinforcement learning (RL) agents leveraging world models have achieved SOTA performance in game environments. However, understanding how to apply the world modeling approach in complex real-world environments relevant to mobile robots remains an open question. In this paper, we present a framework for learning a probabilistic predictive world model for real-world road environments. We implement the model using a hierarchical VAE (HVAE) capable of predicting a diverse set of fully observed plausible worlds from accumulated sensor observations. While prior HVAE methods require complete states as ground truth for learning, we present a novel sequential training method to allow HVAEs to learn to predict complete states from partially observed states only. We experimentally demonstrate accurate spatial structure prediction of deterministic regions achieving 96.21 IoU, and close the gap to perfect prediction by 62% for stochastic regions using the best prediction. By extending HVAEs to cases where complete ground truth states do not exist, we facilitate continual learning of spatial prediction as a step towards realizing explainable and comprehensive predictive world models for real-world mobile robotics applications. Code is available at https://github.com/robin-karlsson0/predictive-world-models.
△ Less
Submitted 23 May, 2023; v1 submitted 11 January, 2023;
originally announced January 2023.
-
RSG-Net: Towards Rich Sematic Relationship Prediction for Intelligent Vehicle in Complex Environments
Authors:
Yafu Tian,
Alexander Carballo,
Ruifeng Li,
Kazuya Takeda
Abstract:
Behavioral and semantic relationships play a vital role on intelligent self-driving vehicles and ADAS systems. Different from other research focused on trajectory, position, and bounding boxes, relationship data provides a human understandable description of the object's behavior, and it could describe an object's past and future status in an amazingly brief way. Therefore it is a fundamental meth…
▽ More
Behavioral and semantic relationships play a vital role on intelligent self-driving vehicles and ADAS systems. Different from other research focused on trajectory, position, and bounding boxes, relationship data provides a human understandable description of the object's behavior, and it could describe an object's past and future status in an amazingly brief way. Therefore it is a fundamental method for tasks such as risk detection, environment understanding, and decision making. In this paper, we propose RSG-Net (Road Scene Graph Net): a graph convolutional network designed to predict potential semantic relationships from object proposals, and produces a graph-structured result, called "Road Scene Graph". The experimental results indicate that this network, trained on Road Scene Graph dataset, could efficiently predict potential semantic relationships among objects around the ego-vehicle.
△ Less
Submitted 16 July, 2022;
originally announced July 2022.
-
Perception and Sensing for Autonomous Vehicles Under Adverse Weather Conditions: A Survey
Authors:
Yuxiao Zhang,
Alexander Carballo,
Hanting Yang,
Kazuya Takeda
Abstract:
Automated Driving Systems (ADS) open up a new domain for the automotive industry and offer new possibilities for future transportation with higher efficiency and comfortable experiences. However, autonomous driving under adverse weather conditions has been the problem that keeps autonomous vehicles (AVs) from going to level 4 or higher autonomy for a long time. This paper assesses the influences a…
▽ More
Automated Driving Systems (ADS) open up a new domain for the automotive industry and offer new possibilities for future transportation with higher efficiency and comfortable experiences. However, autonomous driving under adverse weather conditions has been the problem that keeps autonomous vehicles (AVs) from going to level 4 or higher autonomy for a long time. This paper assesses the influences and challenges that weather brings to ADS sensors in an analytic and statistical way, and surveys the solutions against inclement weather conditions. State-of-the-art techniques on perception enhancement with regard to each kind of weather are thoroughly reported. External auxiliary solutions, weather conditions coverage in currently available datasets, simulators, and experimental facilities with weather chambers are distinctly sorted out. Additionally, potential future ADS sensors candidates and approaches beyond common senses are provided. By looking into all kinds of major weather problems the autonomous driving field is currently facing, and reviewing both hardware and computer science solutions in recent years, this survey points out the main moving trends of adverse weather problems in autonomous driving, i.e., advanced sensor fusions, more sophisticated networks, and V2X & IoT technologies; and also the limitations brought by emerging 1550 nm LiDARs. In general, this work contributes a holistic overview of the obstacles and directions of ADS development in terms of adverse weather driving conditions.
△ Less
Submitted 17 January, 2023; v1 submitted 16 December, 2021;
originally announced December 2021.
-
ViCE: Improving Dense Representation Learning by Superpixelization and Contrasting Cluster Assignment
Authors:
Robin Karlsson,
Tomoki Hayashi,
Keisuke Fujii,
Alexander Carballo,
Kento Ohtani,
Kazuya Takeda
Abstract:
Recent self-supervised models have demonstrated equal or better performance than supervised methods, opening for AI systems to learn visual representations from practically unlimited data. However, these methods are typically classification-based and thus ineffective for learning high-resolution feature maps that preserve precise spatial information. This work introduces superpixels to improve sel…
▽ More
Recent self-supervised models have demonstrated equal or better performance than supervised methods, opening for AI systems to learn visual representations from practically unlimited data. However, these methods are typically classification-based and thus ineffective for learning high-resolution feature maps that preserve precise spatial information. This work introduces superpixels to improve self-supervised learning of dense semantically rich visual concept embeddings. Decomposing images into a small set of visually coherent regions reduces the computational complexity by $\mathcal{O}(1000)$ while preserving detail. We experimentally show that contrasting over regions improves the effectiveness of contrastive learning methods, extends their applicability to high-resolution images, improves overclustering performance, superpixels are better than grids, and regional masking improves performance. The expressiveness of our dense embeddings is demonstrated by improving the SOTA unsupervised semantic segmentation benchmark on Cityscapes, and for convolutional models on COCO.
△ Less
Submitted 7 October, 2022; v1 submitted 24 November, 2021;
originally announced November 2021.
-
Road Scene Graph: A Semantic Graph-Based Scene Representation Dataset for Intelligent Vehicles
Authors:
Yafu Tian,
Alexander Carballo,
Ruifeng Li,
Kazuya Takeda
Abstract:
Rich semantic information extraction plays a vital role on next-generation intelligent vehicles. Currently there is great amount of research focusing on fundamental applications such as 6D pose detection, road scene semantic segmentation, etc. And this provides us a great opportunity to think about how shall these data be organized and exploited.
In this paper we propose road scene graph,a speci…
▽ More
Rich semantic information extraction plays a vital role on next-generation intelligent vehicles. Currently there is great amount of research focusing on fundamental applications such as 6D pose detection, road scene semantic segmentation, etc. And this provides us a great opportunity to think about how shall these data be organized and exploited.
In this paper we propose road scene graph,a special scene-graph for intelligent vehicles. Different to classical data representation, this graph provides not only object proposals but also their pair-wise relationships. By organizing them in a topological graph, these data are explainable, fully-connected, and could be easily processed by GCNs (Graph Convolutional Networks). Here we apply scene graph on roads using our Road Scene Graph dataset, including the basic graph prediction model. This work also includes experimental evaluations using the proposed model.
△ Less
Submitted 27 November, 2020;
originally announced November 2020.
-
Characterization of Multiple 3D LiDARs for Localization and Map** using Normal Distributions Transform
Authors:
Alexander Carballo,
Abraham Monrroy,
David Wong,
Patiphon Narksri,
Jacob Lambert,
Yuki Kitsukawa,
Eijiro Takeuchi,
Shinpei Kato,
Kazuya Takeda
Abstract:
In this work, we present a detailed comparison of ten different 3D LiDAR sensors, covering a range of manufacturers, models, and laser configurations, for the tasks of map** and vehicle localization, using as common reference the Normal Distributions Transform (NDT) algorithm implemented in the self-driving open source platform Autoware. LiDAR data used in this study is a subset of our LiDAR Ben…
▽ More
In this work, we present a detailed comparison of ten different 3D LiDAR sensors, covering a range of manufacturers, models, and laser configurations, for the tasks of map** and vehicle localization, using as common reference the Normal Distributions Transform (NDT) algorithm implemented in the self-driving open source platform Autoware. LiDAR data used in this study is a subset of our LiDAR Benchmarking and Reference (LIBRE) dataset, captured independently from each sensor, from a vehicle driven on public urban roads multiple times, at different times of the day. In this study, we analyze the performance and characteristics of each LiDAR for the tasks of (1) 3D map** including an assessment map quality based on mean map entropy, and (2) 6-DOF localization using a ground truth reference map.
△ Less
Submitted 3 April, 2020;
originally announced April 2020.
-
LIBRE: The Multiple 3D LiDAR Dataset
Authors:
Alexander Carballo,
Jacob Lambert,
Abraham Monrroy-Cano,
David Robert Wong,
Patiphon Narksri,
Yuki Kitsukawa,
Eijiro Takeuchi,
Shinpei Kato,
Kazuya Takeda
Abstract:
In this work, we present LIBRE: LiDAR Benchmarking and Reference, a first-of-its-kind dataset featuring 10 different LiDAR sensors, covering a range of manufacturers, models, and laser configurations. Data captured independently from each sensor includes three different environments and configurations: static targets, where objects were placed at known distances and measured from a fixed position…
▽ More
In this work, we present LIBRE: LiDAR Benchmarking and Reference, a first-of-its-kind dataset featuring 10 different LiDAR sensors, covering a range of manufacturers, models, and laser configurations. Data captured independently from each sensor includes three different environments and configurations: static targets, where objects were placed at known distances and measured from a fixed position within a controlled environment; adverse weather, where static obstacles were measured from a moving vehicle, captured in a weather chamber where LiDARs were exposed to different conditions (fog, rain, strong light); and finally, dynamic traffic, where dynamic objects were captured from a vehicle driven on public urban roads, multiple times at different times of the day, and including supporting sensors such as cameras, infrared imaging, and odometry devices. LIBRE will contribute to the research community to (1) provide a means for a fair comparison of currently available LiDARs, and (2) facilitate the improvement of existing self-driving vehicles and robotics-related software, in terms of development and tuning of LiDAR-based perception algorithms.
△ Less
Submitted 24 June, 2020; v1 submitted 13 March, 2020;
originally announced March 2020.
-
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Authors:
Ekim Yurtsever,
Jacob Lambert,
Alexander Carballo,
Kazuya Takeda
Abstract:
Automated driving systems (ADSs) promise a safe, comfortable and efficient driving experience. However, fatalities involving vehicles equipped with ADSs are on the rise. The full potential of ADSs cannot be realized unless the robustness of state-of-the-art improved further. This paper discusses unsolved problems and surveys the technical aspect of automated driving. Studies regarding present chal…
▽ More
Automated driving systems (ADSs) promise a safe, comfortable and efficient driving experience. However, fatalities involving vehicles equipped with ADSs are on the rise. The full potential of ADSs cannot be realized unless the robustness of state-of-the-art improved further. This paper discusses unsolved problems and surveys the technical aspect of automated driving. Studies regarding present challenges, high-level system architectures, emerging methodologies and core functions: localization, map**, perception, planning, and human machine interface, were thoroughly reviewed. Furthermore, the state-of-the-art was implemented on our own platform and various algorithms were compared in a real-world driving setting. The paper concludes with an overview of available datasets and tools for ADS development.
△ Less
Submitted 2 April, 2020; v1 submitted 12 June, 2019;
originally announced June 2019.
-
New approach for solar tracking systems based on computer vision, low cost hardware and deep learning
Authors:
Jose A. Carballo,
Javier Bonilla,
Manuel Berenguel,
Jesús Fernández-Reche,
Ginés García
Abstract:
In this work, a new approach for Sun tracking systems is presented. Due to the current system limitations regarding costs and operational problems, a new approach based on low cost, computer vision open hardware and deep learning has been developed. The preliminary tests carried out successfully in Plataforma solar de Almeria (PSA), reveal the great potential and show the new approach as a good al…
▽ More
In this work, a new approach for Sun tracking systems is presented. Due to the current system limitations regarding costs and operational problems, a new approach based on low cost, computer vision open hardware and deep learning has been developed. The preliminary tests carried out successfully in Plataforma solar de Almeria (PSA), reveal the great potential and show the new approach as a good alternative to traditional systems. The proposed approach can provide key variables for the Sun tracking system control like cloud movements prediction, block and shadow detection, atmospheric attenuation or measures of concentrated solar radiation, which can improve the control strategies of the system and therefore the system performance.
△ Less
Submitted 19 September, 2018;
originally announced September 2018.
-
The most powerful quasar outflows as revealed by the Civ λ1549 resonance line
Authors:
P. Marziani,
M. A. Martinez Carballo,
J. W. Sulentic,
A. del Olmo,
G. M. Stirpe,
D. Dultzin
Abstract:
While quasar outflows may be quasi-ubiquitous, there are significant differences on a source-by- source basis. These differences can be organized along the 4D Eigenvector 1 sequence: at least at low z, with only Population A sources radiating at relatively high Eddington ratio and showing prominent high-velocity outflows in Civ λ1549 line profiles. We discuss in this paper VLT-FORS observations of…
▽ More
While quasar outflows may be quasi-ubiquitous, there are significant differences on a source-by- source basis. These differences can be organized along the 4D Eigenvector 1 sequence: at least at low z, with only Population A sources radiating at relatively high Eddington ratio and showing prominent high-velocity outflows in Civ λ1549 line profiles. We discuss in this paper VLT-FORS observations of Civ λ1549 emission line profiles for a high-luminosity sample of Hamburg- ESO quasars and how they are affected by outflow motion as a function of quasar luminosity. Our high- luminosity sample has the notable advantage that the rest frame has been accurately determined from previous VLT-ISAAC observations of Hβ in the J, H, and K bands. This makes measures of inter-line velocity shifts accurate and free of systemic biases. As the redshift increases and the luminosity of the brightest quasars increases, powerful, high-velocity outflows become more frequent. We discuss the outflow contextualisation, fol- lowing the 4DE1 formalism, as a tool for understanding the nature of the so-called weak lined quasars (WLQ) discovered in recent years as a new, poorly understood class of quasars. We estimate the kinetic power associ- ated with Civ λ1549 outflows and suggest that the host galaxies in the most luminous sources likely experience significant feedback.
△ Less
Submitted 1 December, 2015;
originally announced December 2015.
-
UV spectral diagnostics for low redshift quasars: estimating physical conditions and radius of the Broad Line Region
Authors:
P. Marziani,
J. W. Sulentic,
C. A. Negrete,
D. Dultzin,
A. Del Olmo,
M. A. Martínez Carballo,
T. Zwitter,
R. Bachev
Abstract:
The UV spectral range (1100 - 3000 A) contains the strongest resonance lines observed in active galactic nuclei (AGN). Analysis of UV line intensity ratios and profile shapes in quasar spectra provide diagnostics of physical and dynamical conditions in the broad line emitting region. This paper discusses properties of UV lines in type-1 AGN spectra, and how they lead an estimate of ionizing photon…
▽ More
The UV spectral range (1100 - 3000 A) contains the strongest resonance lines observed in active galactic nuclei (AGN). Analysis of UV line intensity ratios and profile shapes in quasar spectra provide diagnostics of physical and dynamical conditions in the broad line emitting region. This paper discusses properties of UV lines in type-1 AGN spectra, and how they lead an estimate of ionizing photon flux, chemical abundances, radius of the broad line emitting region and central black hole mass. These estimates are meaningfully contextualised through the 4D "eigenvector-1" (4DE1) formalism.
△ Less
Submitted 12 October, 2014;
originally announced October 2014.
-
A high order $q$-difference equation for $q$-Hahn multiple orthogonal polynomials
Authors:
Jorge Arvesú Carballo,
Chiara Esposito
Abstract:
A high order linear $q$-difference equation with polynomial coefficients having $q$-Hahn multiple orthogonal polynomials as eigenfunctions is given. The order of the equation is related to the number of orthogonality conditions that these polynomials satisfy. Some limiting situations when $q\to1$ are studied. Indeed, the difference equation for Hahn multiple orthogonal polynomials given in \cite…
▽ More
A high order linear $q$-difference equation with polynomial coefficients having $q$-Hahn multiple orthogonal polynomials as eigenfunctions is given. The order of the equation is related to the number of orthogonality conditions that these polynomials satisfy. Some limiting situations when $q\to1$ are studied. Indeed, the difference equation for Hahn multiple orthogonal polynomials given in \cite{Lee} is corrected and obtained as a limiting case.
△ Less
Submitted 21 October, 2009;
originally announced October 2009.