-
Neural Automated Writing Evaluation with Corrective Feedback
Authors:
Izia Xiaoxiao Wang,
Xihan Wu,
Edith Coates,
Min Zeng,
Jiexin Kuang,
Siliang Liu,
Mengyang Qiu,
Jungyeul Park
Abstract:
The utilization of technology in second language learning and teaching has become ubiquitous. For the assessment of writing specifically, automated writing evaluation (AWE) and grammatical error correction (GEC) have become immensely popular and effective methods for enhancing writing proficiency and delivering instant and individualized feedback to learners. By leveraging the power of natural lan…
▽ More
The utilization of technology in second language learning and teaching has become ubiquitous. For the assessment of writing specifically, automated writing evaluation (AWE) and grammatical error correction (GEC) have become immensely popular and effective methods for enhancing writing proficiency and delivering instant and individualized feedback to learners. By leveraging the power of natural language processing (NLP) and machine learning algorithms, AWE and GEC systems have been developed separately to provide language learners with automated corrective feedback and more accurate and unbiased scoring that would otherwise be subject to examiners. In this paper, we propose an integrated system for automated writing evaluation with corrective feedback as a means of bridging the gap between AWE and GEC results for second language learners. This system enables language learners to simulate the essay writing tests: a student writes and submits an essay, and the system returns the assessment of the writing along with suggested grammatical error corrections. Given that automated scoring and grammatical correction are more efficient and cost-effective than human grading, this integrated system would also alleviate the burden of manually correcting innumerable essays.
△ Less
Submitted 6 May, 2024; v1 submitted 27 February, 2024;
originally announced February 2024.
-
Dim Wihl Gat Tun: The Case for Linguistic Expertise in NLP for Underdocumented Languages
Authors:
Clarissa Forbes,
Farhan Samir,
Bruce Harold Oliver,
Changbing Yang,
Edith Coates,
Garrett Nicolai,
Miikka Silfverberg
Abstract:
Recent progress in NLP is driven by pretrained models leveraging massive datasets and has predominantly benefited the world's political and economic superpowers. Technologically underserved languages are left behind because they lack such resources. Hundreds of underserved languages, nevertheless, have available data sources in the form of interlinear glossed text (IGT) from language documentation…
▽ More
Recent progress in NLP is driven by pretrained models leveraging massive datasets and has predominantly benefited the world's political and economic superpowers. Technologically underserved languages are left behind because they lack such resources. Hundreds of underserved languages, nevertheless, have available data sources in the form of interlinear glossed text (IGT) from language documentation efforts. IGT remains underutilized in NLP work, perhaps because its annotations are only semi-structured and often language-specific. With this paper, we make the case that IGT data can be leveraged successfully provided that target language expertise is available. We specifically advocate for collaboration with documentary linguists. Our paper provides a roadmap for successful projects utilizing IGT data: (1) It is essential to define which NLP tasks can be accomplished with the given IGT data and how these will benefit the speech community. (2) Great care and target language expertise is required when converting the data into structured formats commonly employed in NLP. (3) Task-specific and user-specific evaluation can help to ascertain that the tools which are created benefit the target language speech community. We illustrate each step through a case study on develo** a morphological reinflection system for the Tsimchianic language Gitksan.
△ Less
Submitted 17 March, 2022;
originally announced March 2022.
-
Data-Efficient Deep Reinforcement Learning for Attitude Control of Fixed-Wing UAVs: Field Experiments
Authors:
Eivind Bøhn,
Erlend M. Coates,
Dirk Reinhardt,
Tor Arne Johansen
Abstract:
Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art autopilots are based on linear control and are thus limited in their effectiveness and performance. Deep reinforcement learning (DRL) is a machine learning method to au…
▽ More
Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art autopilots are based on linear control and are thus limited in their effectiveness and performance. Deep reinforcement learning (DRL) is a machine learning method to automatically discover optimal control laws through interaction with the controlled system, which can handle complex nonlinear dynamics. We show in this paper that DRL can successfully learn to perform attitude control of a fixed-wing UAV operating directly on the original nonlinear dynamics, requiring as little as three minutes of flight data. We initially train our model in a simulation environment and then deploy the learned controller on the UAV in flight tests, demonstrating comparable performance to the state-of-the-art ArduPlane proportional-integral-derivative (PID) attitude controller with no further online learning required. Learning with significant actuation delay and diversified simulated dynamics were found to be crucial for successful transfer to control of the real UAV. In addition to a qualitative comparison with the ArduPlane autopilot, we present a quantitative assessment based on linear analysis to better understand the learning controller's behavior.
△ Less
Submitted 19 April, 2023; v1 submitted 7 November, 2021;
originally announced November 2021.
-
Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs Using Proximal Policy Optimization
Authors:
Eivind Bøhn,
Erlend M. Coates,
Signe Moe,
Tor Arne Johansen
Abstract:
Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they can accomplish autonomously. This paper proposes a deep reinforcement learning (DRL) controller to handle the nonlinear attitude control problem, enabling exten…
▽ More
Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they can accomplish autonomously. This paper proposes a deep reinforcement learning (DRL) controller to handle the nonlinear attitude control problem, enabling extended flight envelopes for fixed-wing UAVs. A proof-of-concept controller using the proximal policy optimization (PPO) algorithm is developed, and is shown to be capable of stabilizing a fixed-wing UAV from a large set of initial conditions to reference roll, pitch and airspeed values. The training process is outlined and key factors for its progression rate are considered, with the most important factor found to be limiting the number of variables in the observation vector, and including values for several previous time steps for these variables. The trained reinforcement learning (RL) controller is compared to a proportional-integral-derivative (PID) controller, and is found to converge in more cases than the PID controller, with comparable performance. Furthermore, the RL controller is shown to generalize well to unseen disturbances in the form of wind and turbulence, even in severe disturbance conditions.
△ Less
Submitted 13 November, 2019;
originally announced November 2019.
-
Carrier Lifetime Enhancement in a Tellurium Nanowire/PEDOT:PSS Nanocomposite by Sulfur Passivation
Authors:
James N. Heyman,
Ayaskanta Sahu,
Nelson E. Coates,
Brittany Ehmann,
Jeffery J. Urban
Abstract:
We report static and time-resolved terahertz (THz) conductivity measurements of a high- performance thermoelectric material containing tellurium nanowires in a PEDOT:PSS matrix. Composites were made with and without sulfur passivation of the nanowires surfaces. The material with sulfur linkers (TeNW/PD-S) is less conductive but has a longer carrier lifetime than the formulation without (TeNW/PD).…
▽ More
We report static and time-resolved terahertz (THz) conductivity measurements of a high- performance thermoelectric material containing tellurium nanowires in a PEDOT:PSS matrix. Composites were made with and without sulfur passivation of the nanowires surfaces. The material with sulfur linkers (TeNW/PD-S) is less conductive but has a longer carrier lifetime than the formulation without (TeNW/PD). We find real conductivities at f = 1THz of σ(TeNW/PD) = 160 S/cm and σ(TeNW/PD-S) = 5.1 S/cm. These values are much larger than the corresponding DC conductivities, suggesting DC conductivity is limited by structural defects. The free-carrier lifetime in the nanowires is controlled by recombination and trap** at the nanowire surfaces. We find surface recombination velocities in bare tellurium nanowires (22m/s) and TeNW/PD-S (40m/s) that are comparable to evaporated tellurium thin films. The surface recombination velocity in TeNW/PD (509m/s) is much larger, indicating a higher interface trap density.
△ Less
Submitted 21 November, 2014;
originally announced November 2014.
