-
Update on the German and Australasian Optical Ground Station Networks
Authors:
Nicholas J. Rattenbury,
Joseph Ashby,
Francis Bennet,
Marcus Birch,
John E. Cater,
Kate Ferguson,
Dirk Giggenbach,
Ken Grant,
Andreas Knopp,
Marcus T. Knopp,
Ed Kruzins,
Andrew Lambert,
Kerry Mudge,
Catherine Qualtrough,
Samuele Raffa,
Jonas Rittershofer,
Mikhael Sayat,
Sascha Schediwy,
Robert T. Schwarz,
Matthew Sellars,
Oliver Thearle,
Tony Travouillon,
Kevin Walker,
Shane Walsh,
Stephen Weddell
Abstract:
Networks of ground stations designed to transmit and receive at optical wavelengths through the atmosphere offer an opportunity to provide on-demand, high-bandwidth, secure communications with spacecraft in Earth orbit and beyond. This work describes the operation and activities of current Free Space Optical Communication (FSOC) ground stations in Germany and Australasia. In Germany, FSOC faciliti…
▽ More
Networks of ground stations designed to transmit and receive at optical wavelengths through the atmosphere offer an opportunity to provide on-demand, high-bandwidth, secure communications with spacecraft in Earth orbit and beyond. This work describes the operation and activities of current Free Space Optical Communication (FSOC) ground stations in Germany and Australasia. In Germany, FSOC facilities are located at the Oberpfaffenhofen campus of the Deutsches Zentrum fur Luft- und Raumfahrt (German Aerospace Center, DLR), the Laser-Bodenstation in Trauen (Responsive Space Cluster Competence Center, DLR), and the Research Center Space of the University of the Bundeswehr Munich in Neubiberg. The DLR also operates a ground station in Almeria, Spain as part of the European Optical Nucleus Network. The Australasian Optical Ground Station Network (AOGSN) is a proposed network of 0.5 -- 0.7m class optical telescopes located across Australia and New Zealand. The development and progress for each node of the AOGSN is reported, along with optimisation of future site locations based on cloud cover analysis.
△ Less
Submitted 13 March, 2024; v1 submitted 18 February, 2024;
originally announced February 2024.
-
Towards a Simple Approach to Multi-step Model-based Reinforcement Learning
Authors:
Kavosh Asadi,
Evan Cater,
Dipendra Misra,
Michael L. Littman
Abstract:
When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a multi-step model that predicts the outcome of an action sequence with variable length. We show that this model is easy to learn, and that the model can make po…
▽ More
When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a multi-step model that predicts the outcome of an action sequence with variable length. We show that this model is easy to learn, and that the model can make policy-conditional predictions. We report preliminary results that show a clear advantage for the multi-step model compared to its one-step counterpart.
△ Less
Submitted 31 October, 2018;
originally announced November 2018.
-
Personalized Education at Scale
Authors:
Sam Saarinen,
Evan Cater,
Michael Littman
Abstract:
Tailoring the presentation of information to the needs of individual students leads to massive gains in student outcomes~\cite{bloom19842}. This finding is likely due to the fact that different students learn differently, perhaps as a result of variation in ability, interest or other factors~\cite{schiefele1992interest}. Adapting presentations to the educational needs of an individual has traditio…
▽ More
Tailoring the presentation of information to the needs of individual students leads to massive gains in student outcomes~\cite{bloom19842}. This finding is likely due to the fact that different students learn differently, perhaps as a result of variation in ability, interest or other factors~\cite{schiefele1992interest}. Adapting presentations to the educational needs of an individual has traditionally been the domain of experts, making it expensive and logistically challenging to do at scale, and also leading to inequity in educational outcomes. Increased course sizes and large MOOC enrollments provide an unprecedented access to student data. We propose that emerging technologies in reinforcement learning (RL), as well as semi-supervised learning, natural language processing, and computer vision are critical to leveraging this data to provide personalized education at scale.
△ Less
Submitted 24 September, 2018;
originally announced September 2018.
-
Equivalence Between Wasserstein and Value-Aware Loss for Model-based Reinforcement Learning
Authors:
Kavosh Asadi,
Evan Cater,
Dipendra Misra,
Michael L. Littman
Abstract:
Learning a generative model is a key component of model-based reinforcement learning. Though learning a good model in the tabular setting is a simple task, learning a useful model in the approximate setting is challenging. In this context, an important question is the loss function used for model learning as varying the loss function can have a remarkable impact on effectiveness of planning. Recen…
▽ More
Learning a generative model is a key component of model-based reinforcement learning. Though learning a good model in the tabular setting is a simple task, learning a useful model in the approximate setting is challenging. In this context, an important question is the loss function used for model learning as varying the loss function can have a remarkable impact on effectiveness of planning. Recently Farahmand et al. (2017) proposed a value-aware model learning (VAML) objective that captures the structure of value function during model learning. Using tools from Asadi et al. (2018), we show that minimizing the VAML objective is in fact equivalent to minimizing the Wasserstein metric. This equivalence improves our understanding of value-aware models, and also creates a theoretical foundation for applications of Wasserstein in model-based reinforcement~learning.
△ Less
Submitted 8 July, 2018; v1 submitted 1 June, 2018;
originally announced June 2018.
