Showing 1–22 of 22 results for author: Wagstaff, K

Evaluating Terrain-Dependent Performance for Martian Frost Detection in Visible Satellite Observations

Authors: Gary Doran, Serina Diniega, Steven Lu, Mark Wronkiewicz, Kiri L. Wagstaff

Abstract: Seasonal frosting and defrosting on the surface of Mars is hypothesized to drive both climate processes and the formation and evolution of geomorphological features such as gullies. Past studies have focused on manually analyzing the behavior of the frost cycle in the northern mid-latitude region of Mars using high-resolution visible observations from orbit. Extending these studies globally requir… ▽ More Seasonal frosting and defrosting on the surface of Mars is hypothesized to drive both climate processes and the formation and evolution of geomorphological features such as gullies. Past studies have focused on manually analyzing the behavior of the frost cycle in the northern mid-latitude region of Mars using high-resolution visible observations from orbit. Extending these studies globally requires automating the detection of frost using data science techniques such as convolutional neural networks. However, visible indications of frost presence can vary significantly depending on the geologic context on which the frost is superimposed. In this study, we (1) present a novel approach for spatially partitioning data to reduce biases in model performance estimation, (2) illustrate how geologic context affects automated frost detection, and (3) propose mitigations to observed biases in automated frost detection. △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in: SIGKDD DeepSpatial '22, August 15, 2022, Washington, DC

Interactive Mars Image Content-Based Search with Interpretable Machine Learning

Authors: Bhavan Vasu, Steven Lu, Emily Dunkel, Kiri L. Wagstaff, Kevin Grimes, Michael McAuley

Abstract: The NASA Planetary Data System (PDS) hosts millions of images of planets, moons, and other bodies collected throughout many missions. The ever-expanding nature of data and user engagement demands an interpretable content classification system to support scientific discovery and individual curiosity. In this paper, we leverage a prototype-based architecture to enable users to understand and validat… ▽ More The NASA Planetary Data System (PDS) hosts millions of images of planets, moons, and other bodies collected throughout many missions. The ever-expanding nature of data and user engagement demands an interpretable content classification system to support scientific discovery and individual curiosity. In this paper, we leverage a prototype-based architecture to enable users to understand and validate the evidence used by a classifier trained on images from the Mars Science Laboratory (MSL) Curiosity rover mission. In addition to providing explanations, we investigate the diversity and correctness of evidence used by the content-based classifier. The work presented in this paper will be deployed on the PDS Image Atlas, replacing its non-interpretable counterpart. △ Less

Submitted 19 January, 2024; originally announced February 2024.

Comments: 7 pages, 6 figures

Data-Driven Approaches to Searches for the Technosignatures of Advanced Civilizations

Authors: T. Joseph W. Lazio, S. G. Djorgovski, Andrew Howard, Curt Cutler, Sofia Z. Sheikh, Stefano Cavuoti, Denise Herzing, Kiri Wagstaff, Jason T. Wright, Vishal Gajjar, Kevin Hand, Umaa Rebbapragada, Bruce Allen, Erica Cartmill, Jacob Foster, Dawn Gelino, Matthew J. Graham, Giuseppe Longo, Ashish A. Mahabal, Lior Pachter, Vikram Ravi, Gerald Sussman

Abstract: Humanity has wondered whether we are alone for millennia. The discovery of life elsewhere in the Universe, particularly intelligent life, would have profound effects, comparable to those of recognizing that the Earth is not the center of the Universe and that humans evolved from previous species. There has been rapid growth in the fields of extrasolar planets and data-driven astronomy. In a relati… ▽ More Humanity has wondered whether we are alone for millennia. The discovery of life elsewhere in the Universe, particularly intelligent life, would have profound effects, comparable to those of recognizing that the Earth is not the center of the Universe and that humans evolved from previous species. There has been rapid growth in the fields of extrasolar planets and data-driven astronomy. In a relatively short interval, we have seen a change from knowing of no extrasolar planets to now knowing more potentially habitable extrasolar planets than there are planets in the Solar System. In approximately the same interval, astronomy has transitioned to a field in which sky surveys can generate 1 PB or more of data. The Data-Driven Approaches to Searches for the Technosignatures of Advanced Civilizations_ study at the W. M. Keck Institute for Space Studies was intended to revisit searches for evidence of alien technologies in light of these developments. Data-driven searches, being able to process volumes of data much greater than a human could, and in a reproducible manner, can identify *anomalies* that could be clues to the presence of technosignatures. A key outcome of this workshop was that technosignature searches should be conducted in a manner consistent with Freeman Dyson's "First Law of SETI Investigations," namely "every search for alien civilizations should be planned to give interesting results even when no aliens are discovered." This approach to technosignatures is commensurate with NASA's approach to biosignatures in that no single observation or measurement can be taken as providing full certainty for the detection of life. Areas of particular promise identified during the workshop were (*) Data Mining of Large Sky Surveys, (*) All-Sky Survey at Far-Infrared Wavelengths, (*) Surveys with Radio Astronomical Interferometers, and (*) Artifacts in the Solar System. △ Less

Submitted 29 August, 2023; originally announced August 2023.

Comments: Final Report prepared for the W. M. Keck Institute for Space Studies (KISS), http://kiss.caltech.edu/workshops/technosignatures/technosignatures.html ; eds. Lazio, Djorgovski, Howard, & Cutler; The study leads gratefully acknowledge the outstanding support of Michele Judd, KISS Executive Director, and her dedicated staff, who made the study experience invigorating and enormously productive

Cosmic Microwave Background Recovery: A Graph-Based Bayesian Convolutional Network Approach

Authors: Jadie Adams, Steven Lu, Krzysztof M. Gorski, Graca Rocha, Kiri L. Wagstaff

Abstract: The cosmic microwave background (CMB) is a significant source of knowledge about the origin and evolution of our universe. However, observations of the CMB are contaminated by foreground emissions, obscuring the CMB signal and reducing its efficacy in constraining cosmological parameters. We employ deep learning as a data-driven approach to CMB cleaning from multi-frequency full-sky maps. In parti… ▽ More The cosmic microwave background (CMB) is a significant source of knowledge about the origin and evolution of our universe. However, observations of the CMB are contaminated by foreground emissions, obscuring the CMB signal and reducing its efficacy in constraining cosmological parameters. We employ deep learning as a data-driven approach to CMB cleaning from multi-frequency full-sky maps. In particular, we develop a graph-based Bayesian convolutional neural network based on the U-Net architecture that predicts cleaned CMB with pixel-wise uncertainty estimates. We demonstrate the potential of this technique on realistic simulated data based on the Planck mission. We show that our model accurately recovers the cleaned CMB sky map and resulting angular power spectrum while identifying regions of uncertainty. Finally, we discuss the current challenges and the path forward for deploying our model for CMB recovery on real observations. △ Less

Submitted 23 February, 2023; originally announced February 2023.

Comments: Published at the Thirty-fifth Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-23). 7 pages, 6 figures

Using Machine Learning to Reduce Observational Biases When Detecting New Impacts on Mars

Authors: Kiri L. Wagstaff, Ingrid J. Daubar, Gary Doran, Michael J. Munje, Valentin T. Bickel, Annabelle Gao, Joe Pate, Daniel Wexler

Abstract: The current inventory of recent (fresh) impacts on Mars shows a strong bias towards areas of low thermal inertia. These areas are generally visually bright, and impacts create dark scours and rays that make them easier to detect. It is expected that impacts occur at a similar rate in areas of higher thermal inertia, but those impacts are under-detected. This study investigates the use of a trained… ▽ More The current inventory of recent (fresh) impacts on Mars shows a strong bias towards areas of low thermal inertia. These areas are generally visually bright, and impacts create dark scours and rays that make them easier to detect. It is expected that impacts occur at a similar rate in areas of higher thermal inertia, but those impacts are under-detected. This study investigates the use of a trained machine learning classifier to increase the detection of fresh impacts on Mars using CTX data. This approach discovered 69 new fresh impacts that have been confirmed with follow-up HiRISE images. We found that examining candidates partitioned by thermal inertia (TI) values, which is only possible due to the large number of machine learning candidates, helps reduce the observational bias and increase the number of known high-TI impacts. △ Less

Submitted 12 July, 2022; originally announced July 2022.

Comments: 17 pages, 10 figures, 2 tables (Author's preprint, accepted version)

Journal ref: Icarus, vol. 386 (2022)

Hidden Heterogeneity: When to Choose Similarity-Based Calibration

Authors: Kiri L. Wagstaff, Thomas G. Dietterich

Abstract: Trustworthy classifiers are essential to the adoption of machine learning predictions in many real-world settings. The predicted probability of possible outcomes can inform high-stakes decision making, particularly when assessing the expected value of alternative decisions or the risk of bad outcomes. These decisions require well-calibrated probabilities, not just the correct prediction of the mos… ▽ More Trustworthy classifiers are essential to the adoption of machine learning predictions in many real-world settings. The predicted probability of possible outcomes can inform high-stakes decision making, particularly when assessing the expected value of alternative decisions or the risk of bad outcomes. These decisions require well-calibrated probabilities, not just the correct prediction of the most likely class. Black-box classifier calibration methods can improve the reliability of a classifier's output without requiring retraining. However, these methods are unable to detect subpopulations where calibration could also improve prediction accuracy. Such subpopulations are said to exhibit "hidden heterogeneity" (HH), because the original classifier did not detect them. This paper proposes a quantitative measure for HH. It also introduces two similarity-weighted calibration methods that can address HH by adapting locally to each test item: SWC weights the calibration set by similarity to the test item, and SWC-HH explicitly incorporates hidden heterogeneity to filter the calibration set. Experiments show that the improvements in calibration achieved by similarity-based calibration methods correlate with the amount of HH present and, given sufficient calibration data, generally exceed calibration achieved by global methods. HH can therefore serve as a useful diagnostic tool for identifying when local calibration methods would be beneficial. △ Less

Submitted 20 February, 2023; v1 submitted 3 February, 2022; originally announced February 2022.

Comments: 22 pages, 8 figures

ACM Class: I.2.6

Journal ref: Transactions on Machine Learning Research, January 2023

Integrating Novelty Detection Capabilities with MSL Mastcam Operations to Enhance Data Analysis

Authors: Paul Horton, Hannah R. Kerner, Samantha Jacob, Ernest Cisneros, Kiri L. Wagstaff, James Bell

Abstract: While innovations in scientific instrumentation have pushed the boundaries of Mars rover mission capabilities, the increase in data complexity has pressured Mars Science Laboratory (MSL) and future Mars rover operations staff to quickly analyze complex data sets to meet progressively shorter tactical and strategic planning timelines. MSLWEB is an internal data tracking tool used by operations staf… ▽ More While innovations in scientific instrumentation have pushed the boundaries of Mars rover mission capabilities, the increase in data complexity has pressured Mars Science Laboratory (MSL) and future Mars rover operations staff to quickly analyze complex data sets to meet progressively shorter tactical and strategic planning timelines. MSLWEB is an internal data tracking tool used by operations staff to perform first pass analysis on MSL image sequences, a series of products taken by the Mast camera, Mastcam. Mastcam's multiband multispectral image sequences require more complex analysis compared to standard 3-band RGB images. Typically, these are analyzed using traditional methods to identify unique features within the sequence. Given the short time frame of tactical planning in which downlinked images might need to be analyzed (within 5-10 hours before the next uplink), there exists a need to triage analysis time to focus on the most important sequences and parts of a sequence. We address this need by creating products for MSLWEB that use novelty detection to help operations staff identify unusual data that might be diagnostic of new or atypical compositions or mineralogies detected within an imaging scene. This was achieved in two ways: 1) by creating products for each sequence to identify novel regions in the image, and 2) by assigning multispectral sequences a sortable novelty score. These new products provide colorized heat maps of inferred novelty that operations staff can use to rapidly review downlinked data and focus their efforts on analyzing potentially new kinds of diagnostic multispectral signatures. This approach has the potential to guide scientists to new discoveries by quickly drawing their attention to often subtle variations not detectable with simple color composites. △ Less

Submitted 23 March, 2021; originally announced March 2021.

Comments: 8 pages, 5 figure, accepted and presented at IEEE Aerospace Conference 2021

ACM Class: J.2; I.2.1

Mars Image Content Classification: Three Years of NASA Deployment and Recent Advances

Authors: Kiri Wagstaff, Steven Lu, Emily Dunkel, Kevin Grimes, Brandon Zhao, Jesse Cai, Shoshanna B. Cole, Gary Doran, Raymond Francis, Jake Lee, Lukas Mandrake

Abstract: The NASA Planetary Data System hosts millions of images acquired from the planet Mars. To help users quickly find images of interest, we have developed and deployed content-based classification and search capabilities for Mars orbital and surface images. The deployed systems are publicly accessible using the PDS Image Atlas. We describe the process of training, evaluating, calibrating, and deployi… ▽ More The NASA Planetary Data System hosts millions of images acquired from the planet Mars. To help users quickly find images of interest, we have developed and deployed content-based classification and search capabilities for Mars orbital and surface images. The deployed systems are publicly accessible using the PDS Image Atlas. We describe the process of training, evaluating, calibrating, and deploying updates to two CNN classifiers for images collected by Mars missions. We also report on three years of deployment including usage statistics, lessons learned, and plans for the future. △ Less

Submitted 9 February, 2021; originally announced February 2021.

Comments: Published at the Thirty-Third Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-21). IAAI Innovative Application Award. 10 pages, 11 figures, 6 tables

Visualizing Image Content to Explain Novel Image Discovery

Authors: Jake H. Lee, Kiri L. Wagstaff

Abstract: The initial analysis of any large data set can be divided into two phases: (1) the identification of common trends or patterns and (2) the identification of anomalies or outliers that deviate from those trends. We focus on the goal of detecting observations with novel content, which can alert us to artifacts in the data set or, potentially, the discovery of previously unknown phenomena. To aid in… ▽ More The initial analysis of any large data set can be divided into two phases: (1) the identification of common trends or patterns and (2) the identification of anomalies or outliers that deviate from those trends. We focus on the goal of detecting observations with novel content, which can alert us to artifacts in the data set or, potentially, the discovery of previously unknown phenomena. To aid in interpreting and diagnosing the novel aspect of these selected observations, we recommend the use of novelty detection methods that generate explanations. In the context of large image data sets, these explanations should highlight what aspect of a given image is new (color, shape, texture, content) in a human-comprehensible form. We propose DEMUD-VIS, the first method for providing visual explanations of novel image content by employing a convolutional neural network (CNN) to extract image features, a method that uses reconstruction error to detect novel content, and an up-convolutional network to convert CNN feature representations back into image space. We demonstrate this approach on diverse images from ImageNet, freshwater streams, and the surface of Mars. △ Less

Submitted 12 September, 2022; v1 submitted 14 August, 2019; originally announced August 2019.

Comments: Published in DMKD

Journal ref: Data Mining and Knowledge Discovery, vol. 34, pp. 1777-1804, 2020

Interpretable Discovery in Large Image Data Sets

Authors: Kiri L. Wagstaff, Jake Lee

Abstract: Automated detection of new, interesting, unusual, or anomalous images within large data sets has great value for applications from surveillance (e.g., airport security) to science (observations that don't fit a given theory can lead to new discoveries). Many image data analysis systems are turning to convolutional neural networks (CNNs) to represent image content due to their success in achieving… ▽ More Automated detection of new, interesting, unusual, or anomalous images within large data sets has great value for applications from surveillance (e.g., airport security) to science (observations that don't fit a given theory can lead to new discoveries). Many image data analysis systems are turning to convolutional neural networks (CNNs) to represent image content due to their success in achieving high classification accuracy rates. However, CNN representations are notoriously difficult for humans to interpret. We describe a new strategy that combines novelty detection with CNN image features to achieve rapid discovery with interpretable explanations of novel image content. We applied this technique to familiar images from ImageNet as well as to a scientific image collection from planetary science. △ Less

Submitted 21 June, 2018; originally announced June 2018.

Comments: Presented at the 2018 ICML Workshop on Human Interpretability in Machine Learning (WHI 2018), Stockholm, Sweden

A Machine Learning Classifier for Fast Radio Burst Detection at the VLBA

Authors: Kiri L. Wagstaff, Benyang Tang, David R. Thompson, Shakeh Khudikyan, Jane Wyngaard, Adam T. Deller, Divya Palaniswamy, Steven J. Tingay, Randall B. Wayth

Abstract: Time domain radio astronomy observing campaigns frequently generate large volumes of data. Our goal is to develop automated methods that can identify events of interest buried within the larger data stream. The V-FASTR fast transient system was designed to detect rare fast radio bursts (FRBs) within data collected by the Very Long Baseline Array. The resulting event candidates constitute a signifi… ▽ More Time domain radio astronomy observing campaigns frequently generate large volumes of data. Our goal is to develop automated methods that can identify events of interest buried within the larger data stream. The V-FASTR fast transient system was designed to detect rare fast radio bursts (FRBs) within data collected by the Very Long Baseline Array. The resulting event candidates constitute a significant burden in terms of subsequent human reviewing time. We have trained and deployed a machine learning classifier that marks each candidate detection as a pulse from a known pulsar, an artifact due to radio frequency interference, or a potential new discovery. The classifier maintains high reliability by restricting its predictions to those with at least 90% confidence. We have also implemented several efficiency and usability improvements to the V-FASTR web-based candidate review system. Overall, we found that time spent reviewing decreased and the fraction of interesting candidates increased. The classifier now classifies (and therefore filters) 80-90% of the candidates, with an accuracy greater than 98%, leaving only the 10-20% most promising candidates to be reviewed by humans. △ Less

Submitted 28 June, 2016; originally announced June 2016.

Comments: Published in PASP

Limits on Fast Radio Bursts from Four Years of the V-FASTR Experiment

Authors: Sarah Burke-Spolaor, Cathryn M. Trott, Walter F. Brisken, Adam T. Deller, Walid A. Majid, Divya Palaniswamy, David R. Thompson, Steven J. Tingay, Kiri L. Wagstaff, Randall B. Wayth

Abstract: The V-FASTR experiment on the Very Long Baseline Array was designed to detect dispersed pulses of milliseconds duration, such as fast radio bursts (FRBs). We use all V-FASTR data through February 2015 to report V-FASTR's upper limits on the rates of FRBs, and compare these with re-derived rates from Parkes FRB detection experiments. V-FASTR's operation at lambda=20 cm allows direct comparison with… ▽ More The V-FASTR experiment on the Very Long Baseline Array was designed to detect dispersed pulses of milliseconds duration, such as fast radio bursts (FRBs). We use all V-FASTR data through February 2015 to report V-FASTR's upper limits on the rates of FRBs, and compare these with re-derived rates from Parkes FRB detection experiments. V-FASTR's operation at lambda=20 cm allows direct comparison with the 20 cm Parkes rate, and we derive a power-law limit of γ<-0.4 (95% confidence limit) on the index of FRB source counts, N(>S)\propto S^γ. Using the previously measured FRB rate and the unprecedented amount of survey time spent searching for FRBs at a large range of wavelengths (0.3 cm > λ> 90 cm), we also place frequency-dependent limits on the spectral distribution of FRBs. The most constraining frequencies place two-point spectral index limits of α_{20cm}^{4cm} < 5.8 and α_{90cm}^{20cm} > -7.6, where fluence F \propto f^αif we assume true the burst rate reported by Champion et al. (2016) of R(F~0.6 Jy ms) = 7 x 10^3 sky^{-1} day^{-1} (for bursts of ~3 ms duration). This upper limit on αsuggests that if FRBs are extragalactic but non-cosmological, that on average they are not experiencing excessive free-free absorption due to a medium with high optical depth (assuming temperature ~8,000 K), which excessively invert their low-frequency spectrum. This in turn implies that the dispersion of FRBs arises in either or both of the intergalactic medium or the host galaxy, rather than from the source itself. △ Less

Submitted 23 May, 2016; originally announced May 2016.

Comments: Accepted for publication in ApJ

Online classification for time-domain astronomy

Authors: Kitty K. Lo, Tara Murphy, Umaa Rebbapragada, Kiri Wagstaff

Abstract: The advent of synoptic sky surveys has spurred the development of techniques for real-time classification of astronomical sources in order to ensure timely follow-up with appropriate instruments. Previous work has focused on algorithm selection or improved light curve representations, and naively convert light curves into structured feature sets without regard for the time span or phase of the lig… ▽ More The advent of synoptic sky surveys has spurred the development of techniques for real-time classification of astronomical sources in order to ensure timely follow-up with appropriate instruments. Previous work has focused on algorithm selection or improved light curve representations, and naively convert light curves into structured feature sets without regard for the time span or phase of the light curves. In this paper, we highlight the violation of a fundamental machine learning assumption that occurs when archival light curves with long observational time spans are used to train classifiers that are applied to light curves with fewer observations. We propose two solutions to deal with the mismatch in the time spans of training and test light curves. The first is the use of classifier committees where each classifier is trained on light curves of different observational time spans. Only the committee member whose training set matches the test light curve time span is invoked for classification. The second solution uses hierarchical classifiers that are able to predict source types both individually and by sub-group, so that the user can trade-off an earlier, more robust classification with classification granularity. We test both methods using light curves from the MACHO survey, and demonstrate their usefulness in improving performance over similar methods that naively train on all available archival data. △ Less

Submitted 28 February, 2014; originally announced February 2014.

Comments: Astroinformatics workshop, IEEE International Conference on Data Mining 2013

Comparing the WFC3 IR Grism Stare and Spatial-Scan Observations for Exoplanet Characterization

Authors: Mark R. Swain, Pieter Deroo, Kiri L. Wagstaff

Abstract: We report on a detailed study of the measurement stability for WFC3 IR grism stare and spatial scan observations. The excess measurement noise for both modes is established by comparing the observed and theoretical measurement uncertainties. We find that the stare-mode observations produce differential measurements that are consistent and achieve $\sim\,1.3$ times photon-limited measurement precis… ▽ More We report on a detailed study of the measurement stability for WFC3 IR grism stare and spatial scan observations. The excess measurement noise for both modes is established by comparing the observed and theoretical measurement uncertainties. We find that the stare-mode observations produce differential measurements that are consistent and achieve $\sim\,1.3$ times photon-limited measurement precision. In contrast, the spatial-scan mode observations produce measurements which are inconsistent, non-Gaussian, and have higher excess noise corresponding to $\sim\,2$ times the photon-limited precision. The inferior quality of the spatial scan observations is due to spatial-temporal variability in the detector performance which we measure and map. The non-Gaussian nature of spatial scan measurements makes the use of $χ^2$ and the determination of formal confidence intervals problematic and thus renders the comparison of spatial scan data with theoretical models or other measurements difficult. With better measurement stability and no evidence for non-Gaussianity, stare mode observations offer a significant advantage for characterizing transiting exoplanet systems. △ Less

Submitted 15 November, 2013; originally announced November 2013.

Comments: 9 pages, 5 figures, submitted to PASP

Real Time Event Detection in Astronomical Data Streams: Lessons from the VLBA

Authors: David R. Thompson, Sarah Burke-Spolaor, Adam T. Deller, Walid A. Majid, Divya Palaniswamy, Steven J. Tingay, Kiri L. Wagstaff, Randall B. Wayth

Abstract: A new generation of observational science instruments is dramatically increasing collected data volumes in a range of fields. These instruments include the Square Kilometre Array (SKA), Large Synoptic Survey Telescope (LSST), terrestrial sensor networks, and NASA satellites participating in "decadal survey" missions. Their unprecedented coverage and sensitivity will likely reveal wholly new catego… ▽ More A new generation of observational science instruments is dramatically increasing collected data volumes in a range of fields. These instruments include the Square Kilometre Array (SKA), Large Synoptic Survey Telescope (LSST), terrestrial sensor networks, and NASA satellites participating in "decadal survey" missions. Their unprecedented coverage and sensitivity will likely reveal wholly new categories of unexpected and transient events. Commensal methods passively analyze these data streams, recognizing anomalous events of scientific interest and reacting in real time. We report on a case example: V-FASTR, an ongoing commensal experiment at the Very Long Baseline Array (VLBA) that uses online adaptive pattern recognition to search for anomalous fast radio transients. V-FASTR triages a millisecond-resolution stream of data and promotes candidate anomalies for further offline analysis. It tunes detection parameters in real time, injecting synthetic events to continually retrain itself for optimum performance. This self-tuning approach retains sensitivity to weak signals while adapting to changing instrument configurations and noise conditions. The system has operated since July 2011, making it the longest-running real time commensal radio transient experiment to date. △ Less

Submitted 26 January, 2013; originally announced January 2013.

A framework for interpreting fast radio transients search experiments: application to the V-FASTR experiment

Authors: Cathryn M. Trott, Steven J. Tingay, Randall B. Wayth, David R. Thompson, Adam T. Deller, Walter F. Brisken, Kiri L. Wagstaff, Walid A. Majid, Sarah Burke-Spolaor, Jean-Pierre R. Macquart, Divya Palaniswamy

Abstract: We define a framework for determining constraints on the detection rate of fast transient events from a population of underlying sources, with a view to incorporating beam shape, frequency effects, scattering effects, and detection efficiency into the metric. We then demonstrate a method for combining independent datasets into a single event rate constraint diagram, using a probabilistic approach… ▽ More We define a framework for determining constraints on the detection rate of fast transient events from a population of underlying sources, with a view to incorporating beam shape, frequency effects, scattering effects, and detection efficiency into the metric. We then demonstrate a method for combining independent datasets into a single event rate constraint diagram, using a probabilistic approach to the limits on parameter space. We apply this new framework to present the latest results from the V-FASTR experiment, a commensal fast transients search using the Very Long Baseline Array (VLBA). In the 20 cm band, V-FASTR now has the ability to probe the regions of parameter space of importance for the observed Lorimer and Keane fast radio transient candidates, by combining the information from observations with differing bandwidths, and properly accounting for the source dispersion measure, VLBA antenna beam shape, experiment time sampling, and stochastic nature of events. We then apply the framework to combine the results of the V-FASTR and ATA Fly's Eye experiments, demonstrating their complementarity. Expectations for fast transients experiments for the SKA Phase I dish array are then computed, and the impact of large differential bandwidths is discussed. △ Less

Submitted 24 January, 2013; originally announced January 2013.

Comments: 23 pages, 6 figures. Accepted for publication in The Astrophysical Journal

VAST: An ASKAP Survey for Variables and Slow Transients

Authors: Tara Murphy, Shami Chatterjee, David L. Kaplan, Jay Banyer, Martin E. Bell, Hayley E. Bignall, Geoffrey C. Bower, Robert Cameron, David M. Coward, James M. Cordes, Steve Croft, James R. Curran, S. G. Djorgovski, Sean A. Farrell, Dale A. Frail, B. M. Gaensler, Duncan K. Galloway, Bruce Gendre, Anne J. Green, Paul J. Hancock, Simon Johnston, Atish Kamble, Casey J. Law, T. Joseph W. Lazio, Kitty K. Lo , et al. (14 additional authors not shown)

Abstract: The Australian Square Kilometre Array Pathfinder (ASKAP) will give us an unprecedented opportunity to investigate the transient sky at radio wavelengths. In this paper we present VAST, an ASKAP survey for Variables and Slow Transients. VAST will exploit the wide-field survey capabilities of ASKAP to enable the discovery and investigation of variable and transient phenomena from the local to the co… ▽ More The Australian Square Kilometre Array Pathfinder (ASKAP) will give us an unprecedented opportunity to investigate the transient sky at radio wavelengths. In this paper we present VAST, an ASKAP survey for Variables and Slow Transients. VAST will exploit the wide-field survey capabilities of ASKAP to enable the discovery and investigation of variable and transient phenomena from the local to the cosmological, including flare stars, intermittent pulsars, X-ray binaries, magnetars, extreme scattering events, interstellar scintillation, radio supernovae and orphan afterglows of gamma ray bursts. In addition, it will allow us to probe unexplored regions of parameter space where new classes of transient sources may be detected. In this paper we review the known radio transient and variable populations and the current results from blind radio surveys. We outline a comprehensive program based on a multi-tiered survey strategy to characterise the radio transient sky through detection and monitoring of transient and variable sources on the ASKAP imaging timescales of five seconds and greater. We also present an analysis of the expected source populations that we will be able to detect with VAST. △ Less

Submitted 6 July, 2012; originally announced July 2012.

Comments: 29 pages, 8 figures. Submitted for publication in Pub. Astron. Soc. Australia

Machine Learning that Matters

Authors: Kiri Wagstaff

Abstract: Much of current machine learning (ML) research has lost its connection to problems of import to the larger world of science and society. From this perspective, there exist glaring limitations in the data sets we investigate, the metrics we employ for evaluation, and the degree to which results are communicated back to their originating domains. What changes are needed to how we conduct research to… ▽ More Much of current machine learning (ML) research has lost its connection to problems of import to the larger world of science and society. From this perspective, there exist glaring limitations in the data sets we investigate, the metrics we employ for evaluation, and the degree to which results are communicated back to their originating domains. What changes are needed to how we conduct research to increase the impact that ML has? We present six Impact Challenges to explicitly focus the field?s energy and attention, and we discuss existing obstacles that must be addressed. We aim to inspire ongoing discussion and focus on ML that matters. △ Less

Submitted 18 June, 2012; originally announced June 2012.

Comments: ICML2012

Journal ref: Proceedings of the Twenty-Ninth International Conference on Machine Learning (ICML), p. 529-536

Limits on the event rates of fast radio transients from the V-FASTR experiment

Authors: Randall B. Wayth, Steven J. Tingay, Adam T. Deller, Walter F. Brisken, David R. Thompson, Kiri L. Wagstaff, Walid A. Majid

Abstract: We present the first results from the V-FASTR experiment, a commensal search for fast transient radio bursts using the Very Long Baseline Array (VLBA). V-FASTR is unique in that the widely spaced VLBA antennas provide a discriminant against non-astronomical signals and a mechanism for the localization and identification of events that is not possible with single dishes or short baseline interferom… ▽ More We present the first results from the V-FASTR experiment, a commensal search for fast transient radio bursts using the Very Long Baseline Array (VLBA). V-FASTR is unique in that the widely spaced VLBA antennas provide a discriminant against non-astronomical signals and a mechanism for the localization and identification of events that is not possible with single dishes or short baseline interferometers. Thus far V-FASTR has accumulated over 1300 hours of observation time with the VLBA, between 90 cm and 3 mm wavelength (327 MHz - 86 GHz), providing the first limits on fast transient event rates at high radio frequencies (>1.4 GHz). V-FASTR has blindly detected bright individual pulses from seven known pulsars but has not detected any single-pulse events that would indicate high redshift impulsive bursts of radio emission. At 1.4 GHz, V-FASTR puts limits on fast transient event rates comparable with the PALFA survey at the Arecibo telescope, but generally at lower sensitivities, and comparable to the "fly's eye" survey at the Allen Telescope Array, but with less sky coverage. We also illustrate the likely performance of the Phase 1 SKA dish array for an incoherent fast transient search fashioned on V-FASTR. △ Less

Submitted 25 May, 2012; originally announced May 2012.

Comments: Accepted for publication in ApJL. 3 figures, 1 table

V-FASTR: The VLBA Fast Radio Transients Experiment

Authors: Randall B. Wayth, Walter F. Brisken, Adam T. Deller, Walid A. Majid, David R. Thompson, Steven J. Tingay, Kiri L. Wagstaff

Abstract: Recent discoveries of dispersed, non-periodic impulsive radio signals with single-dish radio telescopes have sparked significant interest in exploring the relatively uncharted space of fast transient radio signals. Here we describe V-FASTR, an experiment to perform a blind search for fast transient radio signals using the Very Long Baseline Array (VLBA). The experiment runs entirely in a commensal… ▽ More Recent discoveries of dispersed, non-periodic impulsive radio signals with single-dish radio telescopes have sparked significant interest in exploring the relatively uncharted space of fast transient radio signals. Here we describe V-FASTR, an experiment to perform a blind search for fast transient radio signals using the Very Long Baseline Array (VLBA). The experiment runs entirely in a commensal mode, alongside normal VLBA observations and operations. It is made possible by the features and flexibility of the DiFX software correlator that is used to process VLBA data. Using the VLBA for this type of experiment offers significant advantages over single-dish experiments, including a larger field of view, the ability to easily distinguish local radio-frequency interference from real signals and the possibility to localize detected events on the sky to milliarcsecond accuracy. We describe our software pipeline, which accepts short integration (~ms) spectrometer data from each antenna in real time during correlation and performs an incoherent dedispersion separately for each antenna, over a range of trial dispersion measures. The dedispersed data are processed by a sophisticated detector and candidate events are recorded. At the end of the correlation, small snippets of the raw data at the time of the events are stored for further analysis. We present the results of our event detection pipeline from some test observations of the pulsars B0329+54 and B0531+21 (the Crab pulsar). △ Less

Submitted 25 May, 2011; v1 submitted 26 April, 2011; originally announced April 2011.

Comments: 14 pages, 6 figures. Accepted to ApJ. Minor updates to match journal proofs

Detection of fast radio transients with multiple stations: a case study using the Very Long Baseline Array

Authors: David R. Thompson, Kiri L. Wagstaff, Walter Brisken, Adam T. Deller, Walid A. Majid, Steven J. Tingay, Randall B. Wayth

Abstract: Recent investigations reveal an important new class of transient radio phenomena that occur on sub-millisecond timescales. Often transient surveys' data volumes are too large to archive exhaustively. Instead, an on-line automatic system must excise impulsive interference and detect candidate events in real-time. This work presents a case study using data from multiple geographically distributed st… ▽ More Recent investigations reveal an important new class of transient radio phenomena that occur on sub-millisecond timescales. Often transient surveys' data volumes are too large to archive exhaustively. Instead, an on-line automatic system must excise impulsive interference and detect candidate events in real-time. This work presents a case study using data from multiple geographically distributed stations to perform simultaneous interference excision and transient detection. We present several algorithms that incorporate dedispersed data from multiple sites, and report experiments with a commensal real-time transient detection system on the Very Long Baseline Array (VLBA). We test the system using observations of pulsar B0329+54. The multiple-station algorithms enhanced sensitivity for detection of individual pulses. These strategies could improve detection performance for a future generation of geographically distributed arrays such as the Australian Square Kilometre Array Pathfinder and the Square Kilometre Array. △ Less

Submitted 26 April, 2011; originally announced April 2011.

Comments: 12 pages, 14 figures. Accepted for ApJ

The Commensal Real-time ASKAP Fast Transients (CRAFT) survey

Authors: Jean-Pierre Macquart, the CRAFT collaboration, :, M. Bailes, N. D. R. Bhat, G. C. Bower, J. D. Bunton, S. Chatterjee, T. Colegate, J. M. Cordes, L. D'Addario, A. Deller, R. Dodson, R. Fender, K. Haines, P. Hall, C. Harris, A. Hotan, S. Johnston, D. L. Jones, M. Keith, J. Y. Koay, T. J. W. Lazio, W. Majid, T. Murphy , et al. (15 additional authors not shown)

Abstract: We are develo** a purely commensal survey experiment for fast (<5s) transient radio sources. Short-timescale transients are associated with the most energetic and brightest single events in the Universe. Our objective is to cover the enormous volume of transients parameter space made available by ASKAP, with an unprecedented combination of sensitivity and field of view. Fast timescale transien… ▽ More We are develo** a purely commensal survey experiment for fast (<5s) transient radio sources. Short-timescale transients are associated with the most energetic and brightest single events in the Universe. Our objective is to cover the enormous volume of transients parameter space made available by ASKAP, with an unprecedented combination of sensitivity and field of view. Fast timescale transients open new vistas on the physics of high brightness temperature emission, extreme states of matter and the physics of strong gravitational fields. In addition, the detection of extragalactic objects affords us an entirely new and extremely sensitive probe on the huge reservoir of baryons present in the IGM. We outline here our approach to the considerable challenge involved in detecting fast transients, particularly the development of hardware fast enough to dedisperse and search the ASKAP data stream at or near real-time rates. Through CRAFT, ASKAP will provide the testbed of many of the key technologies and survey modes proposed for high time resolution science with the SKA. △ Less

Submitted 18 January, 2010; originally announced January 2010.

Comments: accepted for publication in PASA