-
Differentially Private Stream Processing at Scale
Authors:
Bing Zhang,
Vadym Doroshenko,
Peter Kairouz,
Thomas Steinke,
Abhradeep Thakurta,
Ziyin Ma,
Eidan Cohen,
Himani Apte,
Jodi Spacek
Abstract:
We design, to the best of our knowledge, the first differentially private (DP) stream aggregation processing system at scale. Our system -- Differential Privacy SQL Pipelines (DP-SQLP) -- is built using a streaming framework similar to Spark streaming, and is built on top of the Spanner database and the F1 query engine from Google.
Towards designing DP-SQLP we make both algorithmic and systemic…
▽ More
We design, to the best of our knowledge, the first differentially private (DP) stream aggregation processing system at scale. Our system -- Differential Privacy SQL Pipelines (DP-SQLP) -- is built using a streaming framework similar to Spark streaming, and is built on top of the Spanner database and the F1 query engine from Google.
Towards designing DP-SQLP we make both algorithmic and systemic advances, namely, we (i) design a novel (user-level) DP key selection algorithm that can operate on an unbounded set of possible keys, and can scale to one billion keys that users have contributed, (ii) design a preemptive execution scheme for DP key selection that avoids enumerating all the keys at each triggering time, and (iii) use algorithmic techniques from DP continual observation to release a continual DP histogram of user contributions to different keys over the stream length. We empirically demonstrate the efficacy by obtaining at least $16\times$ reduction in error over meaningful baselines we consider. We implemented a streaming differentially private user impressions for Google Shop** with DP-SQLP. The streaming DP algorithms are further applied to Google Trends.
△ Less
Submitted 4 April, 2024; v1 submitted 31 March, 2023;
originally announced March 2023.
-
Deducing the Composition of Venus Cloud Particles with the Autofluorescence Nephelometer (AFN)
Authors:
Darrel Baumgardner,
Ted Fisher,
Roy Newton,
Chris Roden,
Pat Zmarzly,
Sara Seager,
Janusz J. Petkowski,
Christopher E. Carr,
Jan Špaček,
Steven A. Benner,
Margaret A. Tolbert,
Kevin Jansen,
David H. Grinspoon,
Christophe Mandy
Abstract:
The composition, sizes and shapes of particles in the clouds of Venus have previously been studied with a variety of in situ and remote sensor measurements. A number of major questions remain unresolved, however, motivating the development of an exploratory mission that will drop a small probe, instrumented with a single-particle autofluorescence nephelometer (AFN), into Venus' atmosphere. The AFN…
▽ More
The composition, sizes and shapes of particles in the clouds of Venus have previously been studied with a variety of in situ and remote sensor measurements. A number of major questions remain unresolved, however, motivating the development of an exploratory mission that will drop a small probe, instrumented with a single-particle autofluorescence nephelometer (AFN), into Venus' atmosphere. The AFN is specifically designed to address uncertainties associated with the asphericity and complex refractive indices of cloud particles. The AFN projects a collimated, focused, linearly polarized, 440 nm wavelength laser beam through a window of the capsule into the airstream and measures the polarized components of some of the light that is scattered by individual particles that pass through the laser beam. The AFN also measures fluorescence from those particles that contain material that fluoresce when excited at a wavelength of 440 nm and emit at 470-520 nm. Fluorescence is expected from some organic molecules if present in the particles. AFN measurements during probe passage through the Venus clouds are intended to provide constraints on particle number concentration, size, shape, and composition. Hypothesized organics, if present in Venus aerosols, may be detected by the AFN as a precursor to precise identification via future missions. The AFN has been chosen as the primary science instrument for the upcoming Rocket Lab mission to Venus, to search for organic molecules in the cloud particles and constrain the particle composition.
△ Less
Submitted 5 September, 2022;
originally announced September 2022.
-
Organic Carbon Cycle in the Atmosphere of Venus
Authors:
Jan Spacek
Abstract:
The community commonly assumes that the Venusian atmosphere lacks organic (reduced) carbon. This is reflected in the literature, which now for almost a half a century does not mention organic carbon in connection with the Venus atmosphere. This assumption persists despite the failure of models that exclude organic carbon to account for many well-established observed features of the Venusian atmosp…
▽ More
The community commonly assumes that the Venusian atmosphere lacks organic (reduced) carbon. This is reflected in the literature, which now for almost a half a century does not mention organic carbon in connection with the Venus atmosphere. This assumption persists despite the failure of models that exclude organic carbon to account for many well-established observed features of the Venusian atmosphere. Here is presented a model summarizing reactions that almost certainly are occurring in the Venusian atmosphere. The model relies on reactions of reduced carbon compounds known to occur in concentrated sulfuric acid (CSA), under high pressure and high temperature, many used in industrial processes. Inclusion of this known chemistry into a model for the Venus atmosphere accounts for several as yet unexplained observations. These include the upper haze, the lower haze, and the "mysterious" UV-blue absorber. This article also suggests, as a historical perspective, that a long-forgotten dispute is responsible for the persistent assumption of absence of interesting organic chemistry in the clouds of Venus.
△ Less
Submitted 4 August, 2021;
originally announced August 2021.
-
Chemical Guidance in the Search for Past and Extant Life on Mars
Authors:
Steven A. Benner,
Elisa Biondi,
Hyo-Joong Kim,
Jan Špaček
Abstract:
NASA should design missions to Mars for the purpose of generating "Aha!" discoveries to jolt scientists contemplating the molecular origins of life. These missions should be designed with an understanding of the privileged chemistry that likely created RNA prebiotically on Earth, and universal chemical principles that constrain the structure of Darwinian molecules generally.
NASA should design missions to Mars for the purpose of generating "Aha!" discoveries to jolt scientists contemplating the molecular origins of life. These missions should be designed with an understanding of the privileged chemistry that likely created RNA prebiotically on Earth, and universal chemical principles that constrain the structure of Darwinian molecules generally.
△ Less
Submitted 1 September, 2020;
originally announced September 2020.
