The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfaces
Authors:
Kyle Lo,
Joseph Chee Chang,
Andrew Head,
Jonathan Bragg,
Amy X. Zhang,
Cassidy Trier,
Chloe Anastasiades,
Tal August,
Russell Authur,
Danielle Bragg,
Erin Bransom,
Isabel Cachola,
Stefan Candra,
Yoganand Chandrasekhar,
Yen-Sung Chen,
Evie Yu-Yen Cheng,
Yvonne Chou,
Doug Downey,
Rob Evans,
Raymond Fok,
Fangzhou Hu,
Regan Huff,
Dongyeop Kang,
Tae Soo Kim,
Rodney Kinney
, et al. (30 additional authors not shown)
Abstract:
Scholarly publications are key to the transfer of knowledge from scholars to others. However, research papers are information-dense, and as the volume of the scientific literature grows, the need for new technology to support the reading process grows. In contrast to the process of finding papers, which has been transformed by Internet technology, the experience of reading research papers has chan…
▽ More
Scholarly publications are key to the transfer of knowledge from scholars to others. However, research papers are information-dense, and as the volume of the scientific literature grows, the need for new technology to support the reading process grows. In contrast to the process of finding papers, which has been transformed by Internet technology, the experience of reading research papers has changed little in decades. The PDF format for sharing research papers is widely used due to its portability, but it has significant downsides including: static content, poor accessibility for low-vision readers, and difficulty reading on mobile devices. This paper explores the question "Can recent advances in AI and HCI power intelligent, interactive, and accessible reading interfaces -- even for legacy PDFs?" We describe the Semantic Reader Project, a collaborative effort across multiple institutions to explore automatic creation of dynamic reading interfaces for research papers. Through this project, we've developed ten research prototype interfaces and conducted usability studies with more than 300 participants and real-world users showing improved reading experiences for scholars. We've also released a production reading interface for research papers that will incorporate the best features as they mature. We structure this paper around challenges scholars and the public face when reading research papers -- Discovery, Efficiency, Comprehension, Synthesis, and Accessibility -- and present an overview of our progress and remaining open challenges.
△ Less
Submitted 23 April, 2023; v1 submitted 24 March, 2023;
originally announced March 2023.
Out-Of-Bag Anomaly Detection
Authors:
Egor Klevak,
Sangdi Lin,
Andy Martin,
Ondrej Linda,
Eric Ringger
Abstract:
Data anomalies are ubiquitous in real world datasets, and can have an adverse impact on machine learning (ML) systems, such as automated home valuation. Detecting anomalies could make ML applications more responsible and trustworthy. However, the lack of labels for anomalies and the complex nature of real-world datasets make anomaly detection a challenging unsupervised learning problem. In this pa…
▽ More
Data anomalies are ubiquitous in real world datasets, and can have an adverse impact on machine learning (ML) systems, such as automated home valuation. Detecting anomalies could make ML applications more responsible and trustworthy. However, the lack of labels for anomalies and the complex nature of real-world datasets make anomaly detection a challenging unsupervised learning problem. In this paper, we propose a novel model-based anomaly detection method, that we call Out-of- Bag anomaly detection, which handles multi-dimensional datasets consisting of numerical and categorical features. The proposed method decomposes the unsupervised problem into the training of a set of ensemble models. Out-of-Bag estimates are leveraged to derive an effective measure for anomaly detection. We not only demonstrate the state-of-the-art performance of our method through comprehensive experiments on benchmark datasets, but also show our model can improve the accuracy and reliability of an ML system as data pre-processing step via a case study on home valuation.
△ Less
Submitted 20 September, 2020;
originally announced September 2020.
Charge transfer satellites in x-ray spectra of transition metal oxides
Authors:
E. Klevak,
J. J. Kas,
J. J. Rehr
Abstract:
Strongly correlated materials such as transition metal oxides (TMOs) often exhibit large satellites in their x-ray photoemission (XPS) and x-ray absorption spectra (XAS). These satellites arise from localized charge-transfer (CT) excitations that accompany the sudden creation of a core hole. Here we use a two-step approach to treat such excitations in a localized system embedded in a condensed sys…
▽ More
Strongly correlated materials such as transition metal oxides (TMOs) often exhibit large satellites in their x-ray photoemission (XPS) and x-ray absorption spectra (XAS). These satellites arise from localized charge-transfer (CT) excitations that accompany the sudden creation of a core hole. Here we use a two-step approach to treat such excitations in a localized system embedded in a condensed system and coupled to a photoelectron. The total XAS is then given by a convolution of a spectral function representing the localized excitations and the XAS of the extended system. The local system is modeled roughly in terms of a simple three-level model, leading to a double-pole approximation for the spectral function that represents dynamically weighted contributions from the dominant neutral and charge-transfer excitations. This method is implemented using a resolvent approach, with potentials, radial wave-functions and matrix elements from the real-space Green's function code FEFF, and parameters fitted to XPS experiments. Representative calculations for several TMOs are found to be in reasonable agreement with experiment.
△ Less
Submitted 19 November, 2013;
originally announced November 2013.
