-
Generating 2D and 3D Master Faces for Dictionary Attacks with a Network-Assisted Latent Space Evolution
Authors:
Tomer Friedlander,
Ron Shmelkin,
Lior Wolf
Abstract:
A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user information. We optimize these faces for 2D and 3D face verification models, by using an evolutionary algorithm in the latent embedding space of the StyleGAN face…
▽ More
A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user information. We optimize these faces for 2D and 3D face verification models, by using an evolutionary algorithm in the latent embedding space of the StyleGAN face generator. For 2D face verification, multiple evolutionary strategies are compared, and we propose a novel approach that employs a neural network to direct the search toward promising samples, without adding fitness evaluations. The results we present demonstrate that it is possible to obtain a considerable coverage of the identities in the LFW or RFW datasets with less than 10 master faces, for six leading deep face recognition systems. In 3D, we generate faces using the 2D StyleGAN2 generator and predict a 3D structure using a deep 3D face reconstruction network. When employing two different 3D face recognition systems, we are able to obtain a coverage of 40%-50%. Additionally, we present the generation of paired 2D RGB and 3D master faces, which simultaneously match 2D and 3D models with high impersonation rates.
△ Less
Submitted 28 November, 2022; v1 submitted 25 November, 2022;
originally announced November 2022.
-
Dynamically-Scaled Deep Canonical Correlation Analysis
Authors:
Tomer Friedlander,
Lior Wolf
Abstract:
Canonical Correlation Analysis (CCA) is a method for feature extraction of two views by finding maximally correlated linear projections of them. Several variants of CCA have been introduced in the literature, in particular, variants based on deep neural networks for learning highly correlated nonlinear transformations of two views. As these models are parameterized conventionally, their learnable…
▽ More
Canonical Correlation Analysis (CCA) is a method for feature extraction of two views by finding maximally correlated linear projections of them. Several variants of CCA have been introduced in the literature, in particular, variants based on deep neural networks for learning highly correlated nonlinear transformations of two views. As these models are parameterized conventionally, their learnable parameters remain independent of the inputs after the training process, which may limit their capacity for learning highly correlated representations. We introduce a novel dynamic scaling method for training an input-dependent canonical correlation model. In our deep-CCA models, the parameters of the last layer are scaled by a second neural network that is conditioned on the model's input, resulting in a parameterization that is dependent on the input samples. We evaluate our model on multiple datasets and demonstrate that the learned representations are more correlated in comparison to the conventionally-parameterized CCA-based models and also obtain preferable retrieval results. Our code is available at https://github.com/tomerfr/DynamicallyScaledDeepCCA.
△ Less
Submitted 24 March, 2022; v1 submitted 23 March, 2022;
originally announced March 2022.
-
Generating Master Faces for Dictionary Attacks with a Network-Assisted Latent Space Evolution
Authors:
Ron Shmelkin,
Tomer Friedlander,
Lior Wolf
Abstract:
A master face is a face image that passes face-based identity-authentication for a large portion of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user-information. We optimize these faces, by using an evolutionary algorithm in the latent embedding space of the StyleGAN face generator. Multiple evolutionary strateg…
▽ More
A master face is a face image that passes face-based identity-authentication for a large portion of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user-information. We optimize these faces, by using an evolutionary algorithm in the latent embedding space of the StyleGAN face generator. Multiple evolutionary strategies are compared, and we propose a novel approach that employs a neural network in order to direct the search in the direction of promising samples, without adding fitness evaluations. The results we present demonstrate that it is possible to obtain a high coverage of the LFW identities (over 40%) with less than 10 master faces, for three leading deep face recognition systems.
△ Less
Submitted 19 August, 2021; v1 submitted 1 August, 2021;
originally announced August 2021.
-
Evolution of new regulatory functions on biophysically realistic fitness landscapes
Authors:
Tamar Friedlander,
Roshan Prizak,
Nicholas H. Barton,
Gašper Tkačik
Abstract:
Regulatory networks consist of interacting molecules with a high degree of mutual chemical specificity. How can these molecules evolve when their function depends on maintenance of interactions with cognate partners and simultaneous avoidance of deleterious "crosstalk" with non-cognate molecules? Although physical models of molecular interactions provide a framework in which co-evolution of networ…
▽ More
Regulatory networks consist of interacting molecules with a high degree of mutual chemical specificity. How can these molecules evolve when their function depends on maintenance of interactions with cognate partners and simultaneous avoidance of deleterious "crosstalk" with non-cognate molecules? Although physical models of molecular interactions provide a framework in which co-evolution of network components can be analyzed, most theoretical studies have focused on the evolution of individual alleles, neglecting the network. In contrast, we study the elementary step in the evolution of gene regulatory networks: duplication of a transcription factor followed by selection for TFs to specialize their inputs as well as the regulation of their downstream genes. We show how to coarse grain the complete, biophysically realistic genotype-phenotype map for this process into macroscopic functional outcomes and quantify the probability of attaining each. We determine which evolutionary and biophysical parameters bias evolutionary trajectories towards fast emergence of new functions and show that this can be greatly facilitated by the availability of "promiscuity-promoting" mutations that affect TF specificity.
△ Less
Submitted 27 February, 2017; v1 submitted 10 October, 2016;
originally announced October 2016.
-
Intrinsic limits to gene regulation by global crosstalk
Authors:
Tamar Friedlander,
Roshan Prizak,
Călin C. Guet,
Nicholas H. Barton,
Gašper Tkačik
Abstract:
Gene regulation relies on the specificity of transcription factor (TF) - DNA interactions. In equilibrium, limited specificity may lead to crosstalk: a regulatory state in which a gene is either incorrectly activated due to noncognate TF-DNA interactions or remains erroneously inactive. We present a tractable biophysical model of global crosstalk, where many genes are simultaneously regulated by m…
▽ More
Gene regulation relies on the specificity of transcription factor (TF) - DNA interactions. In equilibrium, limited specificity may lead to crosstalk: a regulatory state in which a gene is either incorrectly activated due to noncognate TF-DNA interactions or remains erroneously inactive. We present a tractable biophysical model of global crosstalk, where many genes are simultaneously regulated by many TFs. We show that in the simplest regulatory scenario, a lower bound on crosstalk severity can be analytically derived solely from the number of (co)regulated genes and a suitable parameter that describes binding site similarity. Estimates show that crosstalk could present a significant challenge for organisms with low-specificity TFs, such as metazoans, unless they use appropriate regulation schemes. Strong cooperativity substantially decreases crosstalk, while joint regulation by activators and repressors, surprisingly, does not; moreover, certain microscopic details about promoter architecture emerge as globally important determinants of crosstalk strength. Our results suggest that crosstalk imposes a new type of global constraint on the functioning and evolution of regulatory networks, which is qualitatively distinct from the known constraints acting at the level of individual gene regulatory elements.
△ Less
Submitted 3 May, 2016; v1 submitted 23 June, 2015;
originally announced June 2015.
-
Evolution of bow-tie architectures in biology
Authors:
Tamar Friedlander,
Avraham E. Mayo,
Tsvi Tlusty,
Uri Alon
Abstract:
Bow-tie or hourglass structure is a common architectural feature found in biological and technological networks. A bow-tie in a multi-layered structure occurs when intermediate layers have much fewer components than the input and output layers. Examples include metabolism where a handful of building blocks mediate between multiple input nutrients and multiple output biomass components, and signali…
▽ More
Bow-tie or hourglass structure is a common architectural feature found in biological and technological networks. A bow-tie in a multi-layered structure occurs when intermediate layers have much fewer components than the input and output layers. Examples include metabolism where a handful of building blocks mediate between multiple input nutrients and multiple output biomass components, and signaling networks where information from numerous receptor types passes through a small set of signaling pathways to regulate multiple output genes. Little is known, however, about how bow-tie architectures evolve. Here, we address the evolution of bow-tie architectures using simulations of multi-layered systems evolving to fulfill a given input-output goal. We find that bow-ties spontaneously evolve when two conditions are met: (i) the evolutionary goal is rank deficient, where the rank corresponds to the minimal number of input features on which the outputs depend, and (ii) The effects of mutations on interaction intensities between components are described by product rule - namely the mutated element is multiplied by a random number. Product-rule mutations are more biologically realistic than the commonly used sum-rule mutations that add a random number to the mutated element. These conditions robustly lead to bow-tie structures. The minimal width of the intermediate network layers (the waist or knot of the bow-tie) equals the rank of the evolutionary goal. These findings can help explain the presence of bow-ties in diverse biological systems, and can also be relevant for machine learning applications that employ multi-layered networks.
△ Less
Submitted 30 April, 2014;
originally announced April 2014.
-
Mutation Rules and the Evolution of Sparseness and Modularity in Biological Systems
Authors:
Tamar Friedlander,
Avraham E. Mayo,
Tsvi Tlusty,
Uri Alon
Abstract:
Biological systems exhibit two structural features on many levels of organization: sparseness, in which only a small fraction of possible interactions between components actually occur; and modularity - the near decomposability of the system into modules with distinct functionality. Recent work suggests that modularity can evolve in a variety of circumstances, including goals that vary in time suc…
▽ More
Biological systems exhibit two structural features on many levels of organization: sparseness, in which only a small fraction of possible interactions between components actually occur; and modularity - the near decomposability of the system into modules with distinct functionality. Recent work suggests that modularity can evolve in a variety of circumstances, including goals that vary in time such that they share the same subgoals (modularly varying goals), or when connections are costly. Here, we studied the origin of modularity and sparseness focusing on the nature of the mutation process, rather than on connection cost or variations in the goal. We use simulations of evolution with different mutation rules. We found that commonly used sum-rule mutations, in which interactions are mutated by adding random numbers, do not lead to modularity or sparseness except for in special situations. In contrast, product-rule mutations in which interactions are mutated by multiplying by random numbers - a better model for the effects of biological mutations - led to sparseness naturally. When the goals of evolution are modular, in the sense that specific groups of inputs affect specific groups of outputs, product-rule mutations also lead to modular structure; sum-rule mutations do not. Product-rule mutations generate sparseness and modularity because they tend to reduce interactions, and to keep small interaction terms small.
△ Less
Submitted 13 June, 2013; v1 submitted 18 February, 2013;
originally announced February 2013.
-
Adaptive response and enlargement of dynamic range
Authors:
Tamar Friedlander,
Naama Brenner
Abstract:
Many membrane channels and receptors exhibit adaptive, or desensitized, response to a strong sustained input stimulus, often supported by protein activity-dependent inactivation. Adaptive response is thought to be related to various cellular functions such as homeostasis and enlargement of dynamic range by background compensation. Here we study the quantitative relation between adaptive response a…
▽ More
Many membrane channels and receptors exhibit adaptive, or desensitized, response to a strong sustained input stimulus, often supported by protein activity-dependent inactivation. Adaptive response is thought to be related to various cellular functions such as homeostasis and enlargement of dynamic range by background compensation. Here we study the quantitative relation between adaptive response and background compensation within a modeling framework. We show that any particular type of adaptive response is neither sufficient nor necessary for adaptive enlargement of dynamic range. In particular a precise adaptive response, where system activity is maintained at a constant level at steady state, does not ensure a large dynamic range neither in input signal nor in system output. A general mechanism for input dynamic range enlargement can come about from the activity-dependent modulation of protein responsiveness by multiple biochemical modification, regardless of the type of adaptive response it induces. Therefore hierarchical biochemical processes such as methylation and phosphorylation are natural candidates to induce this property in signaling systems.
△ Less
Submitted 26 June, 2011; v1 submitted 14 March, 2010;
originally announced March 2010.
-
From cellular properties to population asymptotics in the Population Balance Equation
Authors:
Tamar Friedlander,
Naama Brenner
Abstract:
Proliferating cell populations at steady state growth often exhibit broad protein distributions with exponential tails. The sources of this variation and its universality are of much theoretical interest. Here we address the problem by asymptotic analysis of the Population Balance Equation. We show that the steady state distribution tail is determined by a combination of protein production and c…
▽ More
Proliferating cell populations at steady state growth often exhibit broad protein distributions with exponential tails. The sources of this variation and its universality are of much theoretical interest. Here we address the problem by asymptotic analysis of the Population Balance Equation. We show that the steady state distribution tail is determined by a combination of protein production and cell division and is insensitive to other model details. Under general conditions this tail is exponential with a dependence on parameters consistent with experiment. We discuss the conditions for this effect to be dominant over other sources of variation and the relation to experiments.
△ Less
Submitted 24 July, 2008; v1 submitted 30 April, 2008;
originally announced April 2008.