Showing 1–7 of 7 results for author: Schnelle, S

ADS Standardization Landscape: Making Sense of its Status and of the Associated Research Questions

Authors: Scott Schnelle, Francesca M. Favaro

Abstract: Automated Driving Systems (ADS) hold great potential to increase safety, mobility, and equity. However, without public acceptance, none of these promises can be fulfilled. To engender public trust, many entities in the ADS community participate in standards development organizations (SDOs) with the goal of enhancing safety for the entire industry through a collaborative approach. The breadth and d… ▽ More Automated Driving Systems (ADS) hold great potential to increase safety, mobility, and equity. However, without public acceptance, none of these promises can be fulfilled. To engender public trust, many entities in the ADS community participate in standards development organizations (SDOs) with the goal of enhancing safety for the entire industry through a collaborative approach. The breadth and depth of the ADS safety standardization landscape is vast and constantly changing, as often is the case for novel technologies in rapid evolution. The pace of development of the ADS industry makes it hard for the public and interested parties to keep track of ongoing SDO efforts, including the topics touched by each standard and the committees addressing each topic, as well as make sense of the wealth of documentation produced. Therefore, the authors present here a simplified framework for abstracting and organizing the current landscape of ADS safety standards into high-level, long term themes. This framework is then utilized to develop and organize associated research questions that have not yet reached widely adopted industry positions, along with identifying potential gaps where further research and standardization is needed. △ Less

Submitted 30 June, 2023; originally announced June 2023.

Comments: 13 pages, 1 figure

Interpreting Safety Outcomes: Waymo's Performance Evaluation in the Context of a Broader Determination of Safety Readiness

Authors: Francesca M. Favaro, Trent Victor, Henning Hohnhold, Scott Schnelle

Abstract: This paper frames recent publications from Waymo within the broader context of the safety readiness determination for an Automated Driving System (ADS). Starting from a brief overview of safety performance outcomes reported by Waymo (i.e., contact events experienced during fully autonomous operations), this paper highlights the need for a diversified approach to safety determination that complemen… ▽ More This paper frames recent publications from Waymo within the broader context of the safety readiness determination for an Automated Driving System (ADS). Starting from a brief overview of safety performance outcomes reported by Waymo (i.e., contact events experienced during fully autonomous operations), this paper highlights the need for a diversified approach to safety determination that complements the analysis of observed safety outcomes with other estimation techniques. Our discussion highlights: the presentation of a "credibility paradox" within the comparison between ADS crash data and human-derived baselines; the recognition of continuous confidence growth through in-use monitoring; and the need to supplement any aggregate statistical analysis with appropriate event-level reasoning. △ Less

Submitted 23 June, 2023; originally announced June 2023.

Building a Credible Case for Safety: Waymo's Approach for the Determination of Absence of Unreasonable Risk

Authors: Francesca Favaro, Laura Fraade-Blanar, Scott Schnelle, Trent Victor, Mauricio Peña, Johan Engstrom, John Scanlon, Kris Kusano, Dan Smith

Abstract: This paper presents an overview of Waymo's approach to building a reliable case for safety - a novel and thorough blueprint for use by any company building fully autonomous driving systems. A safety case for fully autonomous operations is a formal way to explain how a company determines that an AV system is safe enough to be deployed on public roads without a human driver, and it includes evidence… ▽ More This paper presents an overview of Waymo's approach to building a reliable case for safety - a novel and thorough blueprint for use by any company building fully autonomous driving systems. A safety case for fully autonomous operations is a formal way to explain how a company determines that an AV system is safe enough to be deployed on public roads without a human driver, and it includes evidence to support that determination. It involves an explanation of the system, the methodologies used to develop it, the metrics used to validate it and the actual results of validation tests. Yet, in order to develop a worthwhile safety case, it is first important to understand what makes one credible and well crafted, and align on evaluation criteria. This paper helps enabling such alignment by providing foundational thinking into not only how a system is determined to be ready for deployment but also into justifying that the set of acceptance criteria employed in such determination is sufficient and that their evaluation (and associated methods) is credible. The publication is structured around three complementary perspectives on safety that build upon content published by Waymo since 2020: a layered approach to safety; a dynamic approach to safety; and a credible approach to safety. The proposed approach is methodology-agnostic, so that anyone in the space could employ portions or all of it. △ Less

Submitted 2 June, 2023; originally announced June 2023.

Collision Avoidance Testing of the Waymo Automated Driving System

Authors: Kristofer D. Kusano, Kurt Beatty, Scott Schnelle, Francesca Favaro, Cam Crary, Trent Victor

Abstract: This paper describes Waymo's Collision Avoidance Testing (CAT) methodology: a scenario-based testing method that evaluates the safety of the Waymo Driver Automated Driving Systems' (ADS) intended functionality in conflict situations initiated by other road users that require urgent evasive maneuvers. Because SAE Level 4 ADS are responsible for the dynamic driving task (DDT), when engaged, without… ▽ More This paper describes Waymo's Collision Avoidance Testing (CAT) methodology: a scenario-based testing method that evaluates the safety of the Waymo Driver Automated Driving Systems' (ADS) intended functionality in conflict situations initiated by other road users that require urgent evasive maneuvers. Because SAE Level 4 ADS are responsible for the dynamic driving task (DDT), when engaged, without immediate human intervention, evaluating a Level 4 ADS using scenario-based testing is difficult due to the potentially infinite number of operational scenarios in which hazardous situations may unfold. To that end, in this paper we first describe the safety test objectives for the CAT methodology, including the collision and serious injury metrics and the reference behavior model representing a non-impaired eyes on conflict human driver used to form an acceptance criterion. Afterward, we introduce the process for identifying potentially hazardous situations from a combination of human data, ADS testing data, and expert knowledge about the product design and associated Operational Design Domain (ODD). The test allocation and execution strategy is presented next, which exclusively utilize simulations constructed from sensor data collected on a test track, real-world driving, or from simulated sensor data. The paper concludes with the presentation of results from applying CAT to the fully autonomous ride-hailing service that Waymo operates in San Francisco, California and Phoenix, Arizona. The iterative nature of scenario identification, combined with over ten years of experience of on-road testing, results in a scenario database that converges to a representative set of responder role scenarios for a given ODD. Using Waymo's virtual test platform, which is calibrated to data collected as part of many years of ADS development, the CAT methodology provides a robust and scalable safety evaluation. △ Less

Submitted 15 December, 2022; originally announced December 2022.

Model Predictive Instantaneous Safety Metric for Evaluation of Automated Driving Systems

Authors: Bowen Weng, Sughosh J. Rao, Eeshan Deosthale, Scott Schnelle, Frank Barickman

Abstract: Vehicles with Automated Driving Systems (ADS) operate in a high-dimensional continuous system with multi-agent interactions. This continuous system features various types of traffic agents (non-homogeneous) governed by continuous-motion ordinary differential equations (differential-drive). Each agent makes decisions independently that may lead to conflicts with the subject vehicle (SV), as well as… ▽ More Vehicles with Automated Driving Systems (ADS) operate in a high-dimensional continuous system with multi-agent interactions. This continuous system features various types of traffic agents (non-homogeneous) governed by continuous-motion ordinary differential equations (differential-drive). Each agent makes decisions independently that may lead to conflicts with the subject vehicle (SV), as well as other participants (non-cooperative). A typical vehicle safety evaluation procedure that uses various safety-critical scenarios and observes resultant collisions (or near collisions), is not sufficient enough to evaluate the performance of the ADS in terms of operational safety status maintenance. In this paper, we introduce a Model Predictive Instantaneous Safety Metric (MPrISM), which determines the safety status of the SV, considering the worst-case safety scenario for a given traffic snapshot. The method then analyzes the SV's closeness to a potential collision within a certain evaluation time period. The described metric induces theoretical guarantees of safety in terms of the time to collision under standard assumptions. Through formulating the solution as a series of minimax quadratic optimization problems of a specific structure, the method is tractable for real-time safety evaluation applications. Its capabilities are demonstrated with synthesized examples and cases derived from real-world tests. △ Less

Submitted 20 May, 2020; originally announced May 2020.

Comments: Accepted at IEEE Intelligent Vehicles Symposium (IV), 2020

Growth dynamics of a Bose-Einstein condensate in a dimple trap without cooling

Authors: Michael C. Garrett, Adrian Ratnapala, Eikbert D. van Ooijen, Christopher J. Vale, Kristian Weegink, Sebastian K. Schnelle, Otto Vainio, Norman R. Heckenberg, Halina Rubinsztein-Dunlop, Matthew J. Davis

Abstract: We study the formation of a Bose-Einstein condensate in a cigar-shaped three-dimensional harmonic trap, induced by the controlled addition of an attractive "dimple" potential along the weak axis. In this manner we are able to induce condensation without cooling due to a localized increase in the phase space density. We perform a quantitative analysis of the thermodynamic transformation in both the… ▽ More We study the formation of a Bose-Einstein condensate in a cigar-shaped three-dimensional harmonic trap, induced by the controlled addition of an attractive "dimple" potential along the weak axis. In this manner we are able to induce condensation without cooling due to a localized increase in the phase space density. We perform a quantitative analysis of the thermodynamic transformation in both the sudden and adiabatic regimes for a range of dimple widths and depths. We find good agreement with equilibrium calculations based on self-consistent semiclassical Hartree-Fock theory describing the condensate and thermal cloud. We observe there is an optimal dimple depth that results in a maximum in the condensate fraction. We also study the non-equilibrium dynamics of condensate formation in the sudden turn-on regime, finding good agreement for the observed time dependence of the condensate fraction with calculations based on quantum kinetic theory. △ Less

Submitted 31 January, 2011; v1 submitted 1 November, 2010; originally announced November 2010.

Comments: v1: 9 pages, 7 figures, submitted to Phys. Rev. A; v2: 10 pages, 8 figures, fixed typos, added references, additional details on experimental procedure, values of phase-space density, new figure and discussion on effects of three-body loss in Appendix B (replaced with published version)

Journal ref: Phys. Rev. A 83, 013630 (2011)

Versatile two-dimensional potentials for ultra-cold atoms

Authors: S. K. Schnelle, E. D. van Ooijen, M. J. Davis, N. R. Heckenberg, H. Rubinsztein-Dunlop

Abstract: We propose and investigate a technique for generating smooth two-dimensional potentials for ultra-cold atoms based on the rapid scanning of a far-detuned laser beam using a two-dimensional acousto-optical modulator (AOM). We demonstrate the implementation of a feed-forward mechanism for fast and accurate control of the spatial intensity of the laser beam, resulting in improved homogeneity for th… ▽ More We propose and investigate a technique for generating smooth two-dimensional potentials for ultra-cold atoms based on the rapid scanning of a far-detuned laser beam using a two-dimensional acousto-optical modulator (AOM). We demonstrate the implementation of a feed-forward mechanism for fast and accurate control of the spatial intensity of the laser beam, resulting in improved homogeneity for the atom trap. This technique could be used to generate a smooth toroidal trap that would be useful for static and dynamic experiments on superfluidity and persistent currents with ultra-cold atoms. △ Less

Submitted 17 January, 2008; originally announced January 2008.

Comments: 8 pages, 5 figures