-
Image-based Data Representations of Time Series: A Comparative Analysis in EEG Artifact Detection
Authors:
Aaron Maiwald,
Leon Ackermann,
Maximilian Kalcher,
Daniel J. Wu
Abstract:
Alternative data representations are powerful tools that augment the performance of downstream models. However, there is an abundance of such representations within the machine learning toolbox, and the field lacks a comparative understanding of the suitability of each representation method.
In this paper, we propose artifact detection and classification within EEG data as a testbed for profilin…
▽ More
Alternative data representations are powerful tools that augment the performance of downstream models. However, there is an abundance of such representations within the machine learning toolbox, and the field lacks a comparative understanding of the suitability of each representation method.
In this paper, we propose artifact detection and classification within EEG data as a testbed for profiling image-based data representations of time series data. We then evaluate eleven popular deep learning architectures on each of six commonly-used representation methods.
We find that, while the choice of representation entails a choice within the tradeoff between bias and variance, certain representations are practically more effective in highlighting features which increase the signal-to-noise ratio of the data. We present our results on EEG data, and open-source our testing framework to enable future comparative analyses in this vein.
△ Less
Submitted 21 December, 2023;
originally announced January 2024.
-
The Update-Equivalence Framework for Decision-Time Planning
Authors:
Samuel Sokota,
Gabriele Farina,
David J. Wu,
Hengyuan Hu,
Kevin A. Wang,
J. Zico Kolter,
Noam Brown
Abstract:
The process of revising (or constructing) a policy at execution time -- known as decision-time planning -- has been key to achieving superhuman performance in perfect-information games like chess and Go. A recent line of work has extended decision-time planning to imperfect-information games, leading to superhuman performance in poker. However, these methods involve solving subgames whose sizes gr…
▽ More
The process of revising (or constructing) a policy at execution time -- known as decision-time planning -- has been key to achieving superhuman performance in perfect-information games like chess and Go. A recent line of work has extended decision-time planning to imperfect-information games, leading to superhuman performance in poker. However, these methods involve solving subgames whose sizes grow quickly in the amount of non-public information, making them unhelpful when the amount of non-public information is large. Motivated by this issue, we introduce an alternative framework for decision-time planning that is not based on solving subgames, but rather on update equivalence. In this update-equivalence framework, decision-time planning algorithms replicate the updates of last-iterate algorithms, which need not rely on public information. This facilitates scalability to games with large amounts of non-public information. Using this framework, we derive a provably sound search algorithm for fully cooperative games based on mirror descent and a search algorithm for adversarial games based on magnetic mirror descent. We validate the performance of these algorithms in cooperative and adversarial domains, notably in Hanabi, the standard benchmark for search in fully cooperative imperfect-information games. Here, our mirror descent approach exceeds or matches the performance of public information-based search while using two orders of magnitude less search time. This is the first instance of a non-public-information-based algorithm outperforming public-information-based approaches in a domain they have historically dominated.
△ Less
Submitted 13 May, 2024; v1 submitted 25 April, 2023;
originally announced April 2023.
-
Abstracting Imperfect Information Away from Two-Player Zero-Sum Games
Authors:
Samuel Sokota,
Ryan D'Orazio,
Chun Kai Ling,
David J. Wu,
J. Zico Kolter,
Noam Brown
Abstract:
In their seminal work, Nayyar et al. (2013) showed that imperfect information can be abstracted away from common-payoff games by having players publicly announce their policies as they play. This insight underpins sound solvers and decision-time planning algorithms for common-payoff games. Unfortunately, a naive application of the same insight to two-player zero-sum games fails because Nash equili…
▽ More
In their seminal work, Nayyar et al. (2013) showed that imperfect information can be abstracted away from common-payoff games by having players publicly announce their policies as they play. This insight underpins sound solvers and decision-time planning algorithms for common-payoff games. Unfortunately, a naive application of the same insight to two-player zero-sum games fails because Nash equilibria of the game with public policy announcements may not correspond to Nash equilibria of the original game. As a consequence, existing sound decision-time planning algorithms require complicated additional mechanisms that have unappealing properties. The main contribution of this work is showing that certain regularized equilibria do not possess the aforementioned non-correspondence problem -- thus, computing them can be treated as perfect-information problems. Because these regularized equilibria can be made arbitrarily close to Nash equilibria, our result opens the door to a new perspective to solving two-player zero-sum games and yields a simplified framework for decision-time planning in two-player zero-sum games, void of the unappealing properties that plague existing decision-time planning approaches.
△ Less
Submitted 31 July, 2023; v1 submitted 22 January, 2023;
originally announced January 2023.
-
Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planning
Authors:
Anton Bakhtin,
David J Wu,
Adam Lerer,
Jonathan Gray,
Athul Paul Jacob,
Gabriele Farina,
Alexander H Miller,
Noam Brown
Abstract:
No-press Diplomacy is a complex strategy game involving both cooperation and competition that has served as a benchmark for multi-agent AI research. While self-play reinforcement learning has resulted in numerous successes in purely adversarial games like chess, Go, and poker, self-play alone is insufficient for achieving optimal performance in domains involving cooperation with humans. We address…
▽ More
No-press Diplomacy is a complex strategy game involving both cooperation and competition that has served as a benchmark for multi-agent AI research. While self-play reinforcement learning has resulted in numerous successes in purely adversarial games like chess, Go, and poker, self-play alone is insufficient for achieving optimal performance in domains involving cooperation with humans. We address this shortcoming by first introducing a planning algorithm we call DiL-piKL that regularizes a reward-maximizing policy toward a human imitation-learned policy. We prove that this is a no-regret learning algorithm under a modified utility function. We then show that DiL-piKL can be extended into a self-play reinforcement learning algorithm we call RL-DiL-piKL that provides a model of human play while simultaneously training an agent that responds well to this human model. We used RL-DiL-piKL to train an agent we name Diplodocus. In a 200-game no-press Diplomacy tournament involving 62 human participants spanning skill levels from beginner to expert, two Diplodocus agents both achieved a higher average score than all other participants who played more than two games, and ranked first and third according to an Elo ratings model.
△ Less
Submitted 11 October, 2022;
originally announced October 2022.
-
Human-AI Coordination via Human-Regularized Search and Learning
Authors:
Hengyuan Hu,
David J Wu,
Adam Lerer,
Jakob Foerster,
Noam Brown
Abstract:
We consider the problem of making AI agents that collaborate well with humans in partially observable fully cooperative environments given datasets of human behavior. Inspired by piKL, a human-data-regularized search method that improves upon a behavioral cloning policy without diverging far away from it, we develop a three-step algorithm that achieve strong performance in coordinating with real h…
▽ More
We consider the problem of making AI agents that collaborate well with humans in partially observable fully cooperative environments given datasets of human behavior. Inspired by piKL, a human-data-regularized search method that improves upon a behavioral cloning policy without diverging far away from it, we develop a three-step algorithm that achieve strong performance in coordinating with real humans in the Hanabi benchmark. We first use a regularized search algorithm and behavioral cloning to produce a better human model that captures diverse skill levels. Then, we integrate the policy regularization idea into reinforcement learning to train a human-like best response to the human model. Finally, we apply regularized search on top of the best response policy at test time to handle out-of-distribution challenges when playing with humans. We evaluate our method in two large scale experiments with humans. First, we show that our method outperforms experts when playing with a group of diverse human players in ad-hoc teams. Second, we show that our method beats a vanilla best response to behavioral cloning baseline by having experts play repeatedly with the two agents.
△ Less
Submitted 10 October, 2022;
originally announced October 2022.
-
Practical Deepfake Detection: Vulnerabilities in Global Contexts
Authors:
Yang A. Chuming,
Daniel J. Wu,
Ken Hong
Abstract:
Recent advances in deep learning have enabled realistic digital alterations to videos, known as deepfakes. This technology raises important societal concerns regarding disinformation and authenticity, galvanizing the development of numerous deepfake detection algorithms. At the same time, there are significant differences between training data and in-the-wild video data, which may undermine their…
▽ More
Recent advances in deep learning have enabled realistic digital alterations to videos, known as deepfakes. This technology raises important societal concerns regarding disinformation and authenticity, galvanizing the development of numerous deepfake detection algorithms. At the same time, there are significant differences between training data and in-the-wild video data, which may undermine their practical efficacy. We simulate data corruption techniques and examine the performance of a state-of-the-art deepfake detection algorithm on corrupted variants of the FaceForensics++ dataset.
While deepfake detection models are robust against video corruptions that align with training-time augmentations, we find that they remain vulnerable to video corruptions that simulate decreases in video quality. Indeed, in the controversial case of the video of Gabonese President Bongo's new year address, the algorithm, which confidently authenticates the original video, judges highly corrupted variants of the video to be fake. Our work opens up both technical and ethical avenues of exploration into practical deepfake detection in global contexts.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
-
Modeling Strong and Human-Like Gameplay with KL-Regularized Search
Authors:
Athul Paul Jacob,
David J. Wu,
Gabriele Farina,
Adam Lerer,
Hengyuan Hu,
Anton Bakhtin,
Jacob Andreas,
Noam Brown
Abstract:
We consider the task of building strong but human-like policies in multi-agent decision-making problems, given examples of human behavior. Imitation learning is effective at predicting human actions but may not match the strength of expert humans, while self-play learning and search techniques (e.g. AlphaZero) lead to strong performance but may produce policies that are difficult for humans to und…
▽ More
We consider the task of building strong but human-like policies in multi-agent decision-making problems, given examples of human behavior. Imitation learning is effective at predicting human actions but may not match the strength of expert humans, while self-play learning and search techniques (e.g. AlphaZero) lead to strong performance but may produce policies that are difficult for humans to understand and coordinate with. We show in chess and Go that regularizing search based on the KL divergence from an imitation-learned policy results in higher human prediction accuracy and stronger performance than imitation learning alone. We then introduce a novel regret minimization algorithm that is regularized based on the KL divergence from an imitation-learned policy, and show that using this algorithm for search in no-press Diplomacy yields a policy that matches the human prediction accuracy of imitation learning while being substantially stronger.
△ Less
Submitted 16 February, 2022; v1 submitted 14 December, 2021;
originally announced December 2021.
-
CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU
Authors:
Sijun Tan,
Brian Knott,
Yuan Tian,
David J. Wu
Abstract:
We introduce CryptGPU, a system for privacy-preserving machine learning that implements all operations on the GPU (graphics processing unit). Just as GPUs played a pivotal role in the success of modern deep learning, they are also essential for realizing scalable privacy-preserving deep learning. In this work, we start by introducing a new interface to losslessly embed cryptographic operations ove…
▽ More
We introduce CryptGPU, a system for privacy-preserving machine learning that implements all operations on the GPU (graphics processing unit). Just as GPUs played a pivotal role in the success of modern deep learning, they are also essential for realizing scalable privacy-preserving deep learning. In this work, we start by introducing a new interface to losslessly embed cryptographic operations over secret-shared values (in a discrete domain) into floating-point operations that can be processed by highly-optimized CUDA kernels for linear algebra. We then identify a sequence of "GPU-friendly" cryptographic protocols to enable privacy-preserving evaluation of both linear and non-linear operations on the GPU. Our microbenchmarks indicate that our private GPU-based convolution protocol is over 150x faster than the analogous CPU-based protocol; for non-linear operations like the ReLU activation function, our GPU-based protocol is around 10x faster than its CPU analog.
With CryptGPU, we support private inference and private training on convolutional neural networks with over 60 million parameters as well as handle large datasets like ImageNet. Compared to the previous state-of-the-art, when considering large models and datasets, our protocols achieve a 2x to 8x improvement in private inference and a 6x to 36x improvement for private training. Our work not only showcases the viability of performing secure multiparty computation (MPC) entirely on the GPU to enable fast privacy-preserving machine learning, but also highlights the importance of designing new MPC primitives that can take full advantage of the GPU's computing capabilities.
△ Less
Submitted 22 April, 2021;
originally announced April 2021.
-
Binarized Neural Networks for Resource-Constrained On-Device Gait Identification
Authors:
Daniel J. Wu,
Avoy Datta,
Vinay Prabhu
Abstract:
User authentication through gait analysis is a promising application of discriminative neural networks -- particularly due to the ubiquity of the primary sources of gait accelerometry, in-pocket cellphones. However, conventional machine learning models are often too large and computationally expensive to enable inference on low-resource mobile devices. We propose that binarized neural networks can…
▽ More
User authentication through gait analysis is a promising application of discriminative neural networks -- particularly due to the ubiquity of the primary sources of gait accelerometry, in-pocket cellphones. However, conventional machine learning models are often too large and computationally expensive to enable inference on low-resource mobile devices. We propose that binarized neural networks can act as robust discriminators, maintaining both an acceptable level of accuracy while also dramatically decreasing memory requirements, thereby enabling on-device inference. To this end, we propose BiPedalNet, a compact CNN that nearly matches the state-of-the-art on the Padova gait dataset, with only 1/32 of the memory overhead.
△ Less
Submitted 30 March, 2021;
originally announced March 2021.
-
Continuous Weight Balancing
Authors:
Daniel J. Wu,
Avoy Datta
Abstract:
We propose a simple method by which to choose sample weights for problems with highly imbalanced or skewed traits. Rather than naively discretizing regression labels to find binned weights, we take a more principled approach -- we derive sample weights from the transfer function between an estimated source and specified target distributions. Our method outperforms both unweighted and discretely-we…
▽ More
We propose a simple method by which to choose sample weights for problems with highly imbalanced or skewed traits. Rather than naively discretizing regression labels to find binned weights, we take a more principled approach -- we derive sample weights from the transfer function between an estimated source and specified target distributions. Our method outperforms both unweighted and discretely-weighted models on both regression and classification tasks. We also open-source our implementation of this method (https://github.com/Daniel-Wu/Continuous-Weight-Balancing) to the scientific community.
△ Less
Submitted 30 March, 2021;
originally announced March 2021.
-
Afro-MNIST: Synthetic generation of MNIST-style datasets for low-resource languages
Authors:
Daniel J Wu,
Andrew C Yang,
Vinay U Prabhu
Abstract:
We present Afro-MNIST, a set of synthetic MNIST-style datasets for four orthographies used in Afro-Asiatic and Niger-Congo languages: Ge`ez (Ethiopic), Vai, Osmanya, and N'Ko. These datasets serve as "drop-in" replacements for MNIST. We also describe and open-source a method for synthetic MNIST-style dataset generation from single examples of each digit. These datasets can be found at https://gith…
▽ More
We present Afro-MNIST, a set of synthetic MNIST-style datasets for four orthographies used in Afro-Asiatic and Niger-Congo languages: Ge`ez (Ethiopic), Vai, Osmanya, and N'Ko. These datasets serve as "drop-in" replacements for MNIST. We also describe and open-source a method for synthetic MNIST-style dataset generation from single examples of each digit. These datasets can be found at https://github.com/Daniel-Wu/AfroMNIST. We hope that MNIST-style datasets will be developed for other numeral systems, and that these datasets vitalize machine learning education in underrepresented nations in the research community.
△ Less
Submitted 28 September, 2020;
originally announced September 2020.
-
Magnetic helicity signature and its role in regulating magnetic energy spectra and proton temperatures in the solar wind
Authors:
G. Q. Zhao,
Y. Lin,
X. Y. Wang,
H. Q. Feng,
D. J. Wu,
H. B. Li,
A. Zhao,
Q. Liu
Abstract:
In a previous paper, we found that proton temperatures are clearly associated with the proton-scale turbulence in the solar wind, and magnetic helicity signature appears to be an important indicator in the association. Based on 15 years of in situ measurements, the present paper further investigates the magnetic helicity of solar wind turbulence and its role in regulating magnetic energy spectra a…
▽ More
In a previous paper, we found that proton temperatures are clearly associated with the proton-scale turbulence in the solar wind, and magnetic helicity signature appears to be an important indicator in the association. Based on 15 years of in situ measurements, the present paper further investigates the magnetic helicity of solar wind turbulence and its role in regulating magnetic energy spectra and proton temperatures. Results show that the presence of the helicity signature is very common in solar wind turbulence at scales $0.3 \lesssim kρ_p \lesssim 1$, with $k$ being the wavenumber and $ρ_p$ the proton gyroradius. The sign of the helicity is mostly positive, indicating the dominance of right-handed polarization of the turbulence. The helicity magnitude usually increases with $k$ and $β_{{\parallel}p}$ (the proton parallel beta) when $kρ_p$ and $β_{{\parallel}p}$ are less than unity. As helicity magnitude increases, the power index of the energy spectrum becomes more negative, and the proton temperatures $T_{{\perp}p}$ and $T_{{\parallel}p}$ rise significantly, where $T_{{\perp}p}$ and $T_{{\parallel}p}$ are the perpendicular and parallel temperatures with respect to the background magnetic field. In particular, the rise of $T_{{\perp}p}$ is faster than $T_{{\parallel}p}$ when $β_{{\parallel}p} < 1$ is satisfied. The faster rise of $T_{{\perp}p}$ with the helicity magnitude may be interpreted as the result of the preferentially perpendicular heating of solar wind protons by kinetic Alfvén wave (KAW) turbulence.
△ Less
Submitted 8 September, 2020;
originally announced September 2020.
-
Observational evidence for solar wind proton heating by ion-scale turbulence
Authors:
G. Q. Zhao,
Y. Lin,
X. Y. Wang,
D. J. Wu,
H. Q. Feng,
Q. Liu,
A. Zhao,
H. B. Li
Abstract:
Based on in-situ measurements by Wind spacecraft from 2005 to 2015, this letter reports for the first time a clearly scale-dependent connection between proton temperatures and the turbulence in the solar wind. A statistical analysis of proton-scale turbulence shows that increasing helicity magnitudes correspond to steeper magnetic energy spectra. In particular, there exists a positive power-law co…
▽ More
Based on in-situ measurements by Wind spacecraft from 2005 to 2015, this letter reports for the first time a clearly scale-dependent connection between proton temperatures and the turbulence in the solar wind. A statistical analysis of proton-scale turbulence shows that increasing helicity magnitudes correspond to steeper magnetic energy spectra. In particular, there exists a positive power-law correlation (with a slope $\sim 0.4$) between the proton perpendicular temperature and the turbulent magnetic energy at scales $0.3 \lesssim kρ_p \lesssim 1$, with $k$ being the wavenumber and $ρ_p$ being the proton gyroradius. These findings present evidence of solar wind heating by the proton-scale turbulence. They also provide insight and observational constraint on the physics of turbulent dissipation in the solar wind.
△ Less
Submitted 31 August, 2020;
originally announced September 2020.
-
Dependence of ion temperatures on alpha-proton differential flow vector and heating mechanisms in the solar wind
Authors:
G. Q. Zhao,
H. Q. Feng,
D. J. Wu,
J. Huang,
Y. Zhao,
Q. Liu,
Z. J. Tian
Abstract:
According to \emph{Wind} observations between June 2004 and May 2019, this Letter investigates the proton and alpha particle temperatures in the space of ($θ_d$, $V_d/V_A$) for the first time, where $θ_d$ and $V_d$ are the radial angle and magnitude of alpha$-$proton differential flow vector respectively, $V_A$ is the local Alfvén speed. Results show that the temperatures significantly depend on…
▽ More
According to \emph{Wind} observations between June 2004 and May 2019, this Letter investigates the proton and alpha particle temperatures in the space of ($θ_d$, $V_d/V_A$) for the first time, where $θ_d$ and $V_d$ are the radial angle and magnitude of alpha$-$proton differential flow vector respectively, $V_A$ is the local Alfvén speed. Results show that the temperatures significantly depend on $θ_d$ as well as $V_d/V_A$. In case of low proton parallel beta ($β_{p{\parallel}} < 1$), it is found that the proton perpendicular temperature is clearly enhanced when $θ_d$ is small ($\lesssim 45^\circ$) and $V_d/V_A \gtrsim 0.5$. On the contrary, the perpendicular temperature of alpha particles is considerably enhanced when $θ_d$ is large ($\gtrsim 90^\circ$) or $V_d/V_A$ is sufficiently small. The maximum of proton parallel temperature takes place at $θ_d \sim 90^\circ$ accompanied by higher $β_{p{\parallel}}$ and by larger turbulence amplitude of magnetic fluctuations in inertial range. This study should present strong evidence for cyclotron resonance heating of protons and alpha particles in the solar wind. Other mechanisms including Landau resonance and stochastic heating are also proposed, which tend to have different ($θ_d$, $V_d/V_A$) spaces than cyclotron resonance heating.
△ Less
Submitted 20 January, 2020;
originally announced January 2020.
-
Effects of alpha-proton differential flow on proton temperature anisotropy instabilities in the solar wind: Wind observations
Authors:
G. Q. Zhao,
H. Li,
H. Q. Feng,
D. J. Wu,
H. B. Li,
A. Zhao
Abstract:
Plasma kinetic waves and alpha-proton differential flow are two important subjects on the topic of evolution of the solar wind. Based on the Wind data during 2005-2015, this paper reports that the occurrence of electromagnetic cyclotron waves (ECWs) near the proton cyclotron frequency significantly depends on the direction of alpha-proton differential flow Vd. As Vd rotates from anti-Sunward direc…
▽ More
Plasma kinetic waves and alpha-proton differential flow are two important subjects on the topic of evolution of the solar wind. Based on the Wind data during 2005-2015, this paper reports that the occurrence of electromagnetic cyclotron waves (ECWs) near the proton cyclotron frequency significantly depends on the direction of alpha-proton differential flow Vd. As Vd rotates from anti-Sunward direction to Sunward direction, the occurrence rate of ECWs as well as the percentage of left-handed (LH) polarized ECWs decreases considerably. In particular, it is shown that the dominant polarization changes from LH polarization to right-handed polarization during the rotation. The investigation on proton and alpha particle parameters ordered by the direction of Vd further illustrates that large kinetic energies of alpha-proton differential flow correspond to high occurrence rates of ECWs. These results are well consistent with theoretical predictions for effects of alpha-proton differential flow on proton temperature anisotropy instabilities.
△ Less
Submitted 20 August, 2019;
originally announced August 2019.
-
Accelerating Self-Play Learning in Go
Authors:
David J. Wu
Abstract:
By introducing several improvements to the AlphaZero process and architecture, we greatly accelerate self-play learning in Go, achieving a 50x reduction in computation over comparable methods. Like AlphaZero and replications such as ELF OpenGo and Leela Zero, our bot KataGo only learns from neural-net-guided Monte Carlo tree search self-play. But whereas AlphaZero required thousands of TPUs over s…
▽ More
By introducing several improvements to the AlphaZero process and architecture, we greatly accelerate self-play learning in Go, achieving a 50x reduction in computation over comparable methods. Like AlphaZero and replications such as ELF OpenGo and Leela Zero, our bot KataGo only learns from neural-net-guided Monte Carlo tree search self-play. But whereas AlphaZero required thousands of TPUs over several days and ELF required thousands of GPUs over two weeks, KataGo surpasses ELF's final model after only 19 days on fewer than 30 GPUs. Much of the speedup involves non-domain-specific improvements that might directly transfer to other problems. Further gains from domain-specific techniques reveal the remaining efficiency gap between the best methods and purely general methods such as AlphaZero. Our work is a step towards making learning in state spaces as large as Go possible without large-scale computational resources.
△ Less
Submitted 9 November, 2020; v1 submitted 27 February, 2019;
originally announced February 2019.
-
Deep Learning and Glaucoma Specialists: The Relative Importance of Optic Disc Features to Predict Glaucoma Referral in Fundus Photos
Authors:
Sonia Phene,
R. Carter Dunn,
Naama Hammel,
Yun Liu,
Jonathan Krause,
Naho Kitade,
Mike Schaekermann,
Rory Sayres,
Derek J. Wu,
Ashish Bora,
Christopher Semturs,
Anita Misra,
Abigail E. Huang,
Arielle Spitze,
Felipe A. Medeiros,
April Y. Maa,
Monica Gandhi,
Greg S. Corrado,
Lily Peng,
Dale R. Webster
Abstract:
Glaucoma is the leading cause of preventable, irreversible blindness world-wide. The disease can remain asymptomatic until severe, and an estimated 50%-90% of people with glaucoma remain undiagnosed. Glaucoma screening is recommended for early detection and treatment. A cost-effective tool to detect glaucoma could expand screening access to a much larger patient population, but such a tool is curr…
▽ More
Glaucoma is the leading cause of preventable, irreversible blindness world-wide. The disease can remain asymptomatic until severe, and an estimated 50%-90% of people with glaucoma remain undiagnosed. Glaucoma screening is recommended for early detection and treatment. A cost-effective tool to detect glaucoma could expand screening access to a much larger patient population, but such a tool is currently unavailable. We trained a deep learning algorithm using a retrospective dataset of 86,618 images, assessed for glaucomatous optic nerve head features and referable glaucomatous optic neuropathy (GON). The algorithm was validated using 3 datasets. For referable GON, the algorithm had an AUC of 0.945 (95% CI, 0.929-0.960) in dataset A (1205 images, 1 image/patient; 18.1% referable), images adjudicated by panels of Glaucoma Specialists (GSs); 0.855 (95% CI, 0.841-0.870) in dataset B (9642 images, 1 image/patient; 9.2% referable), images from Atlanta Veterans Affairs Eye Clinic diabetic teleretinal screening program; and 0.881 (95% CI, 0.838-0.918) in dataset C (346 images, 1 image/patient; 81.7% referable), images from Dr. Shroff's Charity Eye Hospital's glaucoma clinic. The algorithm showed significantly higher sensitivity than 7 of 10 graders not involved in determining the reference standard, including 2 of 3 GSs, and showed higher specificity than 3 graders, while remaining comparable to others. For both GSs and the algorithm, the most crucial features related to referable GON were: presence of vertical cup-to-disc ratio of 0.7 or more, neuroretinal rim notching, retinal nerve fiber layer defect, and bared circumlinear vessels. An algorithm trained on fundus images alone can detect referable GON with higher sensitivity than and comparable specificity to eye care providers. The algorithm maintained good performance on an independent dataset with diagnoses based on a full glaucoma workup.
△ Less
Submitted 30 August, 2019; v1 submitted 20 December, 2018;
originally announced December 2018.
-
On the generation mechanism of electromagnetic cyclotron waves in the solar wind: statistical results from Wind observations
Authors:
G. Q. Zhao,
H. Q. Feng,
D. J. Wu,
G. Pi,
J. Huang
Abstract:
Electromagnetic cyclotron waves (ECWs) near the proton cyclotron frequency are frequently observed in the solar wind, yet their generation mechanism is still an open question. Based on the Wind data during the years 2005$-$2015, this paper carries out a statistical study on plasma characteristics associated with the occurrence of ECWs. The probability density distributions (PDDs) of proton tempera…
▽ More
Electromagnetic cyclotron waves (ECWs) near the proton cyclotron frequency are frequently observed in the solar wind, yet their generation mechanism is still an open question. Based on the Wind data during the years 2005$-$2015, this paper carries out a statistical study on plasma characteristics associated with the occurrence of ECWs. The probability density distributions (PDDs) of proton temperature anisotropy ($T_\perp/T_\parallel$) and proton parallel beta ($β_\parallel$) are investigated, where $\perp$ and $\parallel$ refer to perpendicular and parallel to the background magnetic field, respectively. The PDDs depend on solar wind types as well as wave polarizations, and those for ECWs with left-handed (LH) polarization exhibit considerable differences from the PDDs for ambient solar winds. The distributions of occurrence rates of LH ECWs in ($β_\parallel$, $T_\perp/T_\parallel$) space show a tendency that the occurrence rates increase with proton temperature anisotropies. The $β_\parallel$ with maximum of occurrence rates is near 0.1 when $T_\perp/T_\parallel > 1$ while it is around 1 when $T_\perp/T_\parallel < 1$. The presence of alpha$-$proton differential flow with large kinetic energy corresponds to a much high occurrence rate as well as the domination of LH polarization of ECWs. Based on these observations and existing theories, we propose that the proton cyclotron and parallel firehose instabilities with effects of alpha$-$proton differential flow are likely responsible for the local generation of LH ECWs in the solar wind. The generation mechanism of right-handed ECWs seems to be complicated and more discussions are needed in future researches.
△ Less
Submitted 13 December, 2018;
originally announced December 2018.
-
Time-dependent occurrence rate of electromagnetic cyclotron waves in the solar wind: evidence for effect of alpha particles?
Authors:
G. Q. Zhao,
H. Q. Feng,
D. J. Wu,
Y. H. Chu,
J. Huang
Abstract:
Previous studies revealed that electromagnetic cyclotron waves (ECWs) near the proton cyclotron frequency exist widely in the solar wind, and the majority of ECWs are left-handed (LH) polarized waves. Using the magnetic field data from the STEREO mission, this Letter carries out a survey of ECWs over a long period of 7 years, and calculates the occurrence rates of ECWs with different polarization…
▽ More
Previous studies revealed that electromagnetic cyclotron waves (ECWs) near the proton cyclotron frequency exist widely in the solar wind, and the majority of ECWs are left-handed (LH) polarized waves. Using the magnetic field data from the STEREO mission, this Letter carries out a survey of ECWs over a long period of 7 years, and calculates the occurrence rates of ECWs with different polarization senses. Results show that the occurrence rate is nearly a constant for the ECWs with right-handed polarization, but it varies significantly for the ECWs with LH polarization. Further investigation of plasma conditions reveals that the LH ECWs take place preferentially in a plasma characterized by higher temperature, lower density, and larger velocity. Some considerable correlations between the occurrence rate of LH ECWs and the properties of ambient plasmas are discussed. The present research may provide evidence for effect of alpha particles on generation of ECWs.
△ Less
Submitted 3 September, 2017;
originally announced September 2017.
-
The effect of electron holes on cyclotron maser emission driven by horseshoe distributions
Authors:
G. Q. Zhao,
Y. H. Chu,
H. Q. Feng,
D. J. Wu
Abstract:
This Brief Communication presents a quantitative investigation for the effect of electron holes on electron-cyclotron maser (ECM) driven by horseshoe distributions. The investigation is based on an integrated distribution function for the horseshoe distributions with electron holes. Results show that the presence of electron holes can significantly enhance the ECM growth rate by 2-3 times in a ver…
▽ More
This Brief Communication presents a quantitative investigation for the effect of electron holes on electron-cyclotron maser (ECM) driven by horseshoe distributions. The investigation is based on an integrated distribution function for the horseshoe distributions with electron holes. Results show that the presence of electron holes can significantly enhance the ECM growth rate by 2-3 times in a very narrow waveband. The present study suggests that these electron holes probably are responsible for some fine structures of radiations, such as narrowband events in auroral kilometric radiation and solar microwave spikes.
△ Less
Submitted 7 November, 2016;
originally announced November 2016.
-
Privacy, Discovery, and Authentication for the Internet of Things
Authors:
David J. Wu,
Ankur Taly,
Asim Shankar,
Dan Boneh
Abstract:
Automatic service discovery is essential to realizing the full potential of the Internet of Things (IoT). While discovery protocols like Multicast DNS, Apple AirDrop, and Bluetooth Low Energy have gained widespread adoption across both IoT and mobile devices, most of these protocols do not offer any form of privacy control for the service, and often leak sensitive information such as service type,…
▽ More
Automatic service discovery is essential to realizing the full potential of the Internet of Things (IoT). While discovery protocols like Multicast DNS, Apple AirDrop, and Bluetooth Low Energy have gained widespread adoption across both IoT and mobile devices, most of these protocols do not offer any form of privacy control for the service, and often leak sensitive information such as service type, device hostname, device owner's identity, and more in the clear.
To address the need for better privacy in both the IoT and the mobile landscape, we develop two protocols for private service discovery and private mutual authentication. Our protocols provide private and authentic service advertisements, zero round-trip (0-RTT) mutual authentication, and are provably secure in the Canetti-Krawczyk key-exchange model. In contrast to alternatives, our protocols are lightweight and require minimal modification to existing key-exchange protocols. We integrate our protocols into an existing open-source distributed applications framework, and provide benchmarks on multiple hardware platforms: Intel Edisons, Raspberry Pis, smartphones, laptops, and desktops. Finally, we discuss some privacy limitations of the Apple AirDrop protocol (a peer-to-peer file sharing mechanism) and show how to improve the privacy of Apple AirDrop using our private mutual authentication protocol.
△ Less
Submitted 28 February, 2017; v1 submitted 23 April, 2016;
originally announced April 2016.
-
Electron Cyclotron Maser Emissions from Evolving Fast Electron Beams
Authors:
J. F. Tang,
D. J. Wu,
L. Chen,
G. Q. Zhao,
C. M. Tan
Abstract:
Fast electron beams (FEBs) are common products of solar active phenomena. Solar radio bursts are an important diagnostic tool in the understanding of FEBs as well as the solar plasma environment in which they are propagating along solar magnetic fields. In particular, the evolutions of the energy spectrum and velocity distribution of FEBs due to the interaction with the ambient plasma and field wh…
▽ More
Fast electron beams (FEBs) are common products of solar active phenomena. Solar radio bursts are an important diagnostic tool in the understanding of FEBs as well as the solar plasma environment in which they are propagating along solar magnetic fields. In particular, the evolutions of the energy spectrum and velocity distribution of FEBs due to the interaction with the ambient plasma and field when propagating can significantly influence the efficiency and property of their emissions. In this paper, we discuss some possible evolutions of the energy spectrum and velocity distribution of FEBs due to the energy loss processes and the pitch-angle effect caused by the magnetic field inhomogeneity, and analyze the effects of these evolutions on electron cyclotron maser (ECM) emission, which is one of the most important mechanisms of producing solar radio bursts by FEBs. The results show that the growth rates all decrease with the energy loss factor $Q$, but increase with the magnetic mirror ratio $σ$ as well as with the steepness index $δ$. Moreover, the evolution of FEBs also can significantly influence the fastest growing mode and the fastest growing phase angle. This leads to the change of the polarization sense of ECM emission. In particular, our results also reveal that FEB that undergoes different evolution processes will generate different types of ECM emission. We believe the present results to be very helpful on more comprehensive understanding of dynamic spectra of solar radio bursts.
△ Less
Submitted 14 March, 2016;
originally announced March 2016.
-
Cyclotron maser emission from power-law electrons with strong pitch-angle anisotropy
Authors:
G. Q. Zhao,
H. Q. Feng,
D. J. Wu,
L. Chen,
J. F. Tang,
Q. Liu
Abstract:
Energetic electrons with power-law spectrum are most commonly observed in astrophysics. This paper investigates electron cyclotron maser emission (ECME) from the power-law electrons, in which strong pitch-angle anisotropy is emphasized. The electron distribution function proposed in this paper can describe various types of pitch-angle anisotropy. Results show that the emission properties of ECME,…
▽ More
Energetic electrons with power-law spectrum are most commonly observed in astrophysics. This paper investigates electron cyclotron maser emission (ECME) from the power-law electrons, in which strong pitch-angle anisotropy is emphasized. The electron distribution function proposed in this paper can describe various types of pitch-angle anisotropy. Results show that the emission properties of ECME, including radiation growth, propagation, and frequency properties, depend considerably on the types of electron pitch-angle anisotropy, and different wave modes show different dependences on the pitch angle of electrons. In particular, the maximum growth rate of X2 mode rapidly decreases with respect to the electron pitch-angle cosine $μ_0$ at which the electron distribution peaks, while the growth rates for other modes (X1, O1, O2) initially increase before decreasing as $μ_0$ increases. Moreover, the O mode as well as the X mode can be the fastest growth mode, in terms of not only the plasma parameter but also the type of electron pitch-angle distribution. This result presents a significant extension of the recent researches on ECME driven by the lower-energy cutoff of power-law electrons, in which the X mode is generally the fastest growth mode.
△ Less
Submitted 6 March, 2016;
originally announced March 2016.
-
Privacy-Preserving Shortest Path Computation
Authors:
David J. Wu,
Joe Zimmerman,
Jérémy Planul,
John C. Mitchell
Abstract:
Navigation is one of the most popular cloud computing services. But in virtually all cloud-based navigation systems, the client must reveal her location and destination to the cloud service provider in order to learn the fastest route. In this work, we present a cryptographic protocol for navigation on city streets that provides privacy for both the client's location and the service provider's rou…
▽ More
Navigation is one of the most popular cloud computing services. But in virtually all cloud-based navigation systems, the client must reveal her location and destination to the cloud service provider in order to learn the fastest route. In this work, we present a cryptographic protocol for navigation on city streets that provides privacy for both the client's location and the service provider's routing data. Our key ingredient is a novel method for compressing the next-hop routing matrices in networks such as city street maps. Applying our compression method to the map of Los Angeles, for example, we achieve over tenfold reduction in the representation size. In conjunction with other cryptographic techniques, this compressed representation results in an efficient protocol suitable for fully-private real-time navigation on city streets. We demonstrate the practicality of our protocol by benchmarking it on real street map data for major cities such as San Francisco and Washington, D.C.
△ Less
Submitted 10 January, 2016;
originally announced January 2016.
-
Kinetic Alfvén turbulence below and above ion-cyclotron frequency
Authors:
J. S. Zhao,
Y. M. Voitenko,
D. J. Wu,
M. Y. Yu
Abstract:
Alfvénic turbulent cascade perpendicular and parallel to the background magnetic field is studied accounting for anisotropic dispersive effects and turbulent intermittency. The perpendicular dispersion and intermittency make the perpendicular-wavenumber magnetic spectra steeper and speed up production of high ion-cyclotron frequencies by the turbulent cascade. On the contrary, the parallel dispers…
▽ More
Alfvénic turbulent cascade perpendicular and parallel to the background magnetic field is studied accounting for anisotropic dispersive effects and turbulent intermittency. The perpendicular dispersion and intermittency make the perpendicular-wavenumber magnetic spectra steeper and speed up production of high ion-cyclotron frequencies by the turbulent cascade. On the contrary, the parallel dispersion makes the spectra flatter and decelerate the frequency cascade above the ion-cyclotron frequency. Competition of the above factors results in spectral indices distributed in the interval [-2,-3], where -2 is the index of high-frequency space-filling turbulence, and -3 is the index of low-frequency intermittent turbulence formed by tube-like fluctuations. Spectra of fully intermittent turbulence fill a narrower range of spectral indices [-7/3,-3], which almost coincides with the range of indexes measured in the solar wind. This suggests that the kinetic-scale turbulent spectra are shaped mainly by dispersion and intermittency. A small mismatch with measured indexes of about 0.1 can be associated with dam** effects not studied here.
△ Less
Submitted 28 September, 2015;
originally announced September 2015.
-
A study of line widths and kinetic parameters of ions in the solar corona
Authors:
G. Q. Zhao,
D. J. Wu,
C. B. Wang
Abstract:
Solar extreme-ultraviolet (EUV) lines emitted by highly charged ions have been extensively studied to discuss the issue of coronal heating and solar wind acceleration. Based on observations of the polar corona by the SUMER/SOHO spectrometer, this paper investigates the relation between the line widths and kinetic parameters of ions. It is shown that there exists a strongly linear correlation betwe…
▽ More
Solar extreme-ultraviolet (EUV) lines emitted by highly charged ions have been extensively studied to discuss the issue of coronal heating and solar wind acceleration. Based on observations of the polar corona by the SUMER/SOHO spectrometer, this paper investigates the relation between the line widths and kinetic parameters of ions. It is shown that there exists a strongly linear correlation between two variables $(σ/λ)^2$ and $M^{-1}$, where $σ$, $λ$ and $M$ are the half-width of the observed line profile at $1/\sqrt{e}$, the wavelength and the ion mass, respectively. The Pearson product-moment correlation coefficients exceed 0.9. This finding tends to suggest that the ions from a given height of polar corona have a common temperature and a common non-thermal velocity in terms of existing equation. The temperature and non-thermal velocity are obtained by linear least-square fit. The temperature is around $2.8$ MK at heights of 57$''$ and 102$''$. The non-thermal velocity is typical 21.6 km s$^{-1}$ at height of 57$''$ and 25.2 km s$^{-1}$ at height of 102$''$.
△ Less
Submitted 19 July, 2014;
originally announced July 2014.
-
Properties of Short-wavelength Oblique Alfven and Slow Waves
Authors:
J. S. Zhao,
Y. Voitenko,
M. Y. Yu,
J. Y. Lu,
D. J Wu
Abstract:
Linear properties of kinetic Alfvén waves (KAWs) and kinetic slow waves (KSWs) are studied in the framework of two-fluid magnetohydrodynamics. We obtain the wave dispersion relations that are valid in a wide range of the wave frequency $ω$ and plasma-to-magnetic pressure ratio $β$. The KAW frequency can reach and exceed the ion cyclotron frequency at ion kinetic scales, whereas the KSW frequency r…
▽ More
Linear properties of kinetic Alfvén waves (KAWs) and kinetic slow waves (KSWs) are studied in the framework of two-fluid magnetohydrodynamics. We obtain the wave dispersion relations that are valid in a wide range of the wave frequency $ω$ and plasma-to-magnetic pressure ratio $β$. The KAW frequency can reach and exceed the ion cyclotron frequency at ion kinetic scales, whereas the KSW frequency remains sub-cyclotron. At $β\sim 1$, the plasma and magnetic pressure perturbations of both modes are in anti-phase, so that there is nearly no total pressure perturbations. However, these modes exhibit also several opposite properties. At high $% β$, the electric polarization ratios of KAWs and KSWs are opposite at the ion gyroradius scale, where KAWs are polarized in sense of electron gyration (right-hand polarized) and KSWs are left-hand polarized. The magnetic helicity $σ\sim 1$ for KAWs and $σ\sim -1$ for KSWs, and the ion Alfvén ratio $R_{Ai}\ll 1$ for KAWs and $R_{Ai}\gg 1$ for KSWs. We also found transition wavenumbers where KAWs change their polarization from left- to right-hand. These new properties can be used to discriminate KAWs and KSWs when interpreting kinetic-scale electromagnetic fluctuations observed in various solar-terrestrial plasmas. This concerns, in particular, identification of modes responsible for kinetic-scale pressure-balanced fluctuations and turbulence in the solar wind.
△ Less
Submitted 13 September, 2014; v1 submitted 4 May, 2014;
originally announced May 2014.
-
A Model for Radio Emission from Solar Coronal Shocks
Authors:
G. Q. Zhao,
L. Chen,
D. J. Wu
Abstract:
Solar coronal shocks are very common phenomena in the solar atmosphere and are believed to be the drivers of solar type II radio bursts. However, the microphysical nature of these emissions is still an open problem. This paper proposes that electron cyclotron maser (ECM) emission is responsible for the generation of radiations from the coronal shocks. In the present model, an energetic ion beam ac…
▽ More
Solar coronal shocks are very common phenomena in the solar atmosphere and are believed to be the drivers of solar type II radio bursts. However, the microphysical nature of these emissions is still an open problem. This paper proposes that electron cyclotron maser (ECM) emission is responsible for the generation of radiations from the coronal shocks. In the present model, an energetic ion beam accelerated by the shock excites first Alfvén wave (AW) and then the excited AW leads to the formation of a density-depleted duct along the foreshock boundary of the shock. In this density-depleted duct, the energetic electron beam produced via the shock acceleration can effectively excite radio emission by the ECM instability. Our results show that this model may have potential application to solar type II radio bursts.
△ Less
Submitted 23 March, 2014; v1 submitted 20 March, 2014;
originally announced March 2014.
