Showing 1–46 of 46 results for author: Kujala, J

Elementary methods provide more replicable results in microbial differential abundance analysis

Authors: Juho Pelto, Kari Auranen, Janne Kujala, Leo Lahti

Abstract: Differential abundance analysis is a key component of microbiome studies. While dozens of methods for it exist, currently, there is no consensus on the preferred methods. Correctness of results in differential abundance analysis is an ambiguous concept that cannot be evaluated without employing simulated data, but we argue that consistency of results across datasets should be considered as an esse… ▽ More Differential abundance analysis is a key component of microbiome studies. While dozens of methods for it exist, currently, there is no consensus on the preferred methods. Correctness of results in differential abundance analysis is an ambiguous concept that cannot be evaluated without employing simulated data, but we argue that consistency of results across datasets should be considered as an essential quality of a well-performing method. We compared the performance of 14 differential abundance analysis methods employing datasets from 54 taxonomic profiling studies based on 16S rRNA gene or shotgun sequencing. For each method, we examined how the results replicated between random partitions of each dataset and between datasets from independent studies. While certain methods showed good consistency, some widely used methods were observed to produce a substantial number of conflicting findings. Overall, the highest consistency without unnecessary reduction in sensitivity was attained by analyzing relative abundances with a non-parametric method (Wilcoxon test or ordinal regression model) or linear regression (MaAsLin2). Comparable performance was also attained by analyzing presence/absence of taxa with logistic regression. △ Less

Submitted 30 May, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Quantum mechanics is compatible with counterfactual definiteness

Authors: Janne V. Kujala, Ehtibar N. Dzhafarov

Abstract: Counterfactual definiteness (CFD) means that if some property is measured in some context, then the outcome of the measurement would have been the same had this property been measured in a different context. A context includes all other measurements made together with the one in question, and the spatiotemporal relations among them. The proviso for CFD is non-disturbance: any physical influence of… ▽ More Counterfactual definiteness (CFD) means that if some property is measured in some context, then the outcome of the measurement would have been the same had this property been measured in a different context. A context includes all other measurements made together with the one in question, and the spatiotemporal relations among them. The proviso for CFD is non-disturbance: any physical influence of the contexts on the property being measured is excluded by the laws of nature, so that no one measuring this property has a way of ascertaining its context. It is usually claimed that in quantum mechanics CFD does not hold, because if one assigns the same value to a property in all contexts it is measured in, one runs into a logical contradiction, or at least contravenes quantum theory and experimental evidence. We show that this claim is not substantiated if one takes into account that only one of the possible contexts can be a factual context, all other contexts being counterfactual. With this in mind, any system of random variables can be viewed as satisfying CFD. The concept of CFD is closely related to but distinct from that of noncontextuality, and it is the latter property that may or may not hold for a system, in particular being contravened by some quantum systems △ Less

Submitted 21 September, 2023; v1 submitted 24 August, 2023; originally announced August 2023.

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Entropy 25,1356; 2023

Contextuality with disturbance and without: Neither can violate substantive requirements the other satisfies

Authors: Ehtibar Dzhafarov, Janne V. Kujala

Abstract: Contextuality was originally defined only for consistently connected systems of random variables (those without disturbance/signaling). Contextuality-by-Default theory (CbD) offers an extension of the notion of contextuality to inconsistently connected systems (those with disturbance), by defining it in terms of the systems' couplings subject to certain constraints. Such extensions are sometimes m… ▽ More Contextuality was originally defined only for consistently connected systems of random variables (those without disturbance/signaling). Contextuality-by-Default theory (CbD) offers an extension of the notion of contextuality to inconsistently connected systems (those with disturbance), by defining it in terms of the systems' couplings subject to certain constraints. Such extensions are sometimes met with skepticism. We pose the question of whether it is possible to develop a set of substantive requirements (i.e., those addressing a notion itself rather than its presentation form) such that (1) for any consistently connected system these requirements are satisfied, but (2) they are violated for some inconsistently connected systems. We show that no such set of requirements is possible, not only for CbD but for all possible CbD-like extensions of contextuality. This follows from the fact that any extended contextuality theory \T is contextually equivalent to a theory \T' in which all systems are consistently connected. The contextual equivalence means the following: there is a bijective correspondence between the systems in \T and \T' such that the corresponding systems in \T and \T' are, in a well-defined sense, mere reformulations of each other, and they are contextual or noncontextual together. △ Less

Submitted 27 March, 2023; v1 submitted 23 February, 2023; originally announced February 2023.

Comments: 13 pp, edited in proofreading. To appear in Entropy, 2023

MSC Class: 81P13; 81Q99; 60A99

Contextuality and Informational Redundancy

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: A noncontextual system of random variables may become contextual if one adds to it a set of new variables, even if each of them is obtained by the same context-wise function of the old variables. This fact follows from the definition of contextuality, and its demonstration is trivial for inconsistently connected systems (i.e. systems with disturbance). However, it also holds for consistently conne… ▽ More A noncontextual system of random variables may become contextual if one adds to it a set of new variables, even if each of them is obtained by the same context-wise function of the old variables. This fact follows from the definition of contextuality, and its demonstration is trivial for inconsistently connected systems (i.e. systems with disturbance). However, it also holds for consistently connected (and even strongly consistently connected) systems, provided one acknowledges that if a given property was not measured in a given context, this information can be used in defining functions among the random variables. Moreover, every inconsistently connected system can be presented as a (strongly) consistently connected system with essentially the same contextuality characteristics. △ Less

Submitted 11 December, 2022; v1 submitted 6 November, 2022; originally announced November 2022.

Comments: 13 pp

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Entropy 2023, 25, 6

Contextuality and dichotomizations of random variables

Authors: Janne V. Kujala, Ehtibar N. Dzhafarov

Abstract: The Contextuality-by-Default approach to determining and measuring the (non)contextuality of a system of random variables requires that every random variable in the system be represented by an equivalent set of dichotomous random variables. In this paper we present general principles that justify the use of dichotomizations and determine their choice. The main idea in choosing dichotomizations is… ▽ More The Contextuality-by-Default approach to determining and measuring the (non)contextuality of a system of random variables requires that every random variable in the system be represented by an equivalent set of dichotomous random variables. In this paper we present general principles that justify the use of dichotomizations and determine their choice. The main idea in choosing dichotomizations is that if the set of possible values of a random variable is endowed with a pre-topology (V-space), then the allowable dichotomizations split the space of possible values into two linked subsets ("linkednes" being a weak form of pre-topological connectedness). We primarily focus on two types of random variables most often encountered in practice: categorical and real-valued ones (including continuous random variables, greatly underrepresented in the contextuality literature). A categorical variable (one with a finite number of unordered values) is represented by all of its possible dichotomizations. If the values of a random variable are real numbers, then they are dichotomized by intervals above and below a variable cut point. △ Less

Submitted 12 December, 2021; v1 submitted 8 May, 2021; originally announced May 2021.

Comments: To be published in Foundations of Physcis

MSC Class: 81P13

Systems of random variables and the Free Will Theorem

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: The title refers to the Free Will Theorem by Conway and Kochen whose flashy formulation is: if experimenters possess free will, then so do particles. In more modest terms, the theorem says that individual pairs of spacelike separated particles cannot be described by deterministic systems provided their mixture is the same for all choices of measurement settings. We reformulate and generalize the F… ▽ More The title refers to the Free Will Theorem by Conway and Kochen whose flashy formulation is: if experimenters possess free will, then so do particles. In more modest terms, the theorem says that individual pairs of spacelike separated particles cannot be described by deterministic systems provided their mixture is the same for all choices of measurement settings. We reformulate and generalize the Free Will Theorem theorem in terms of systems of random variables, and show that the proof is based on two observations: (1) some compound systems are contextual (non-local), and (2) any deterministic system with spacelike separated components is non-signaling. The contradiction between the two is obtained by showing that a mixture of non-signaling deterministic systems, if they exist, is always noncontextual. The "experimenters' free will" (independence) assumption is not needed for the proof: it is made redundant by the assumption (1) above, critical for the proof. We next argue that the reason why an individual pair of particles is not described by a deterministic system is more elementary than in the Free Will Theorem. A system, contextual or not and deterministic or not, includes several choices of settings, each of which can be factually used without changing the system. An individual pair of particles can only afford a single realization of random variables for a single choice of settings. With this conceptualization, the "free will of experimenters" cannot be even meaningfully formulated, and the choice between the determinism and "free will of particles" becomes arbitrary and inconsequential. △ Less

Submitted 11 November, 2020; v1 submitted 26 July, 2020; originally announced July 2020.

Comments: To be published in Physical Review Research

MSC Class: 81P13

Journal ref: Physical Review Research 2:043288, 2020

Epistemic Odds of Contextuality in Cyclic Systems

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala, Víctor H. Cervantes

Abstract: Beginning with the Bell theorem, cyclic systems of dichotomous random variables have been the object of many foundational findings in quantum mechanics. Here, we ask the question: if one chooses a cyclic system "at random" (uniformly within the hyperbox of all possible systems with given marginals), what are the odds that it will be contextual? We show that the odds of contextuality rapidly tend t… ▽ More Beginning with the Bell theorem, cyclic systems of dichotomous random variables have been the object of many foundational findings in quantum mechanics. Here, we ask the question: if one chooses a cyclic system "at random" (uniformly within the hyperbox of all possible systems with given marginals), what are the odds that it will be contextual? We show that the odds of contextuality rapidly tend to zero as the size of the system increases. The result is based on the Contextuality-by-Default theory, in which we do not have to assume that the systems are subject to the no-disturbance/no-signaling constraints. △ Less

Submitted 9 April, 2021; v1 submitted 18 February, 2020; originally announced February 2020.

Comments: 7 pp, version 6 has a typo corrected, in press in European Physics Journal Special Topics

MSC Class: 81P13; 81Q99; 60A99

Contextuality and Noncontextuality Measures and Generalized Bell Inequalities for Cyclic Systems

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala, Víctor H. Cervantes

Abstract: Cyclic systems of dichotomous random variables have played a prominent role in contextuality research, describing such experimental paradigms as the Klyachko-Can-Binicoglu-Shumovky, Einstein-Podolsky-Rosen-Bell, and Leggett-Garg ones in physics, as well as conjoint binary choices in human decision making. Here, we understand contextuality within the framework of the Contextuality-by-Default (CbD)… ▽ More Cyclic systems of dichotomous random variables have played a prominent role in contextuality research, describing such experimental paradigms as the Klyachko-Can-Binicoglu-Shumovky, Einstein-Podolsky-Rosen-Bell, and Leggett-Garg ones in physics, as well as conjoint binary choices in human decision making. Here, we understand contextuality within the framework of the Contextuality-by-Default (CbD) theory, based on the notion of probabilistic couplings satisfying certain constraints. CbD allows us to drop the commonly made assumption that systems of random variables are consistently connected. Consistently connected systems constitute a special case in which CbD essentially reduces to the conventional understanding of contextuality. We present a theoretical analysis of the degree of contextuality in cyclic systems (if they are contextual) and the degree of noncontextuality in them (if they are not). By contrast, all previously proposed measures of contextuality are confined to consistently connected systems, and most of them cannot be extended to measures of noncontextuality. Our measures of (non)contextuality are defined by the L_{1}-distance between a point representing a cyclic system and the surface of the polytope representing all possible noncontextual cyclic systems with the same single-variable marginals. We completely characterize this polytope, as well as the polytope of all possible probabilistic couplings for cyclic systems with given single-variable marginals.[...] △ Less

Submitted 17 May, 2021; v1 submitted 7 July, 2019; originally announced July 2019.

Comments: As pubished in Phys. Rev. A 101, 042119 (2020), but corrected in accordance with Erratum note in Physical Review A 101:069902, 2020 and Erratum note in Physical Review Review A Physical Review Review A 103:059901, 2021

MSC Class: 81P13

Journal ref: Phys. Rev. A 101, 042119 (2020)

Measures of Contextuality and Noncontextuality

Authors: Janne V. Kujala, Ehtibar N. Dzhafarov

Abstract: We discuss three measures of the degree of contextuality in contextual systems of dichotomous random variables. These measures are developed within the framework of the Contextuality-by-Default (CbD) theory, and apply to inconsistently connected systems (those with "disturbance" allowed). For one of these measures of contextuality, presented here for the first time, we construct a corresponding me… ▽ More We discuss three measures of the degree of contextuality in contextual systems of dichotomous random variables. These measures are developed within the framework of the Contextuality-by-Default (CbD) theory, and apply to inconsistently connected systems (those with "disturbance" allowed). For one of these measures of contextuality, presented here for the first time, we construct a corresponding measure of the degree of noncontextuality in noncontextual systems. The other two CbD-based measures do not suggest ways in which degree of noncontextuality of a noncontextual system can be quantified. We find the same to be true for the contextual fraction measure developed by Abramsky, Barbosa, and Mansfield. This measure of contextuality is confined to consistently connected systems, but CbD allows one to generalize it to arbitrary systems. △ Less

Submitted 1 August, 2019; v1 submitted 17 March, 2019; originally announced March 2019.

Comments: To be published in the Philosophical Transactions of the Royal Society A

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Philosophical Transactions of the Royal Society A 377:20190149, 2019

Testing Selective Influence Directly Using Trackball Movement Tasks

Authors: Ru Zhang, Cheng-Ta Yang, Janne V. Kujala

Abstract: Systems factorial technology (SFT; Townsend & Nozawa, 1995) is regarded as a useful tool to diagnose if features (or dimensions) of the investigated stimulus are processed in a parallel or serial fashion. In order to use SFT, one has to assume the speed to process each feature is influenced by that feature only, termed as selective influence (Sternberg, 1969). This assumption is usually untestable… ▽ More Systems factorial technology (SFT; Townsend & Nozawa, 1995) is regarded as a useful tool to diagnose if features (or dimensions) of the investigated stimulus are processed in a parallel or serial fashion. In order to use SFT, one has to assume the speed to process each feature is influenced by that feature only, termed as selective influence (Sternberg, 1969). This assumption is usually untestable as the processing time for a stimulus feature is not observable. Stochastic dominance is traditionally used as an indirect evidence for selective influence (e.g., Townsend & Fifić, 2004). However, one should keep in mind that selective influence may be violated even when stochastic dominance holds. The current study proposes a trackball movement paradigm for a direct test of selective influence. The participants were shown a reference stimulus and a test stimulus simultaneously on a computer screen. They were asked to use the trackball to adjust the test stimulus until it appeared to match the position or shape of the reference stimulus. We recorded the reaction time, the parameters defined the reference stimulus (denoted as αand β), and the parameters defined the test stimulus (denoted as A and B). We tested selective influence of αand βon the amount of time to adjust A and B through testing selective influence of αand βon the values of A and B using the linear feasibility test (Dzhafarov & Kujala, 2010). We found that when the test was passed and stochastic dominance held, the inferred architecture was as expected, which was further confirmed by the trajectory of A and B observed in each trial. However, with stochastic dominance only SFT can suggest a prohibited architecture. Our results indicate the proposed method is more reliable for testing selective influence on the processing speed than examining stochastic dominance only. △ Less

Submitted 18 September, 2018; originally announced September 2018.

Contextuality Analysis of the Double Slit Experiment (With a Glimpse Into Three Slits)

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: The Contextuality-by-Default theory is illustrated on contextuality analysis of the idealized double-slit experiment. The experiment is described by a system of contextually labeled binary random variables each of which answers the question: has the particle hit the detector, having passed through a given slit (left or right) in a given state (open or closed)? This system of random variables is a… ▽ More The Contextuality-by-Default theory is illustrated on contextuality analysis of the idealized double-slit experiment. The experiment is described by a system of contextually labeled binary random variables each of which answers the question: has the particle hit the detector, having passed through a given slit (left or right) in a given state (open or closed)? This system of random variables is a cyclic system of rank 4, formally the same as the system describing the EPR/Bell paradigm with signaling. Unlike the latter, however, the system describing the double-slit experiment is always noncontextual, i.e., the context-dependence in it is entirely explainable in terms of direct influences of contexts (closed-open arrangements of the slits) upon the marginal distributions of the random variables involved. The analysis presented is entirely within the framework of abstract classical probability theory (with contextually labeled random variables). The only physical constraint used in the analysis is that a particle cannot pass through a closed slit. The noncontextuality of the double-slit system does not generalize to systems describing experiments with more than two slits: in an abstract triple-slit system, almost any set of observable detection probabilities is compatible with both a contextual scenario and a noncontextual scenario of the particle passing though various combinations of open and closed slits (although the issue of physical realizability of these scenarios remains open). △ Less

Submitted 12 April, 2018; v1 submitted 31 January, 2018; originally announced January 2018.

Comments: Entropy 2018, 20, 278; doi:10.3390/e20040278

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Entropy 20, 278, 2018

Contextuality in Canonical Systems of Random Variables

Authors: Ehtibar N. Dzhafarov, Víctor H. Cervantes, Janne V. Kujala

Abstract: Random variables representing measurements, broadly understood to include any responses to any inputs, form a system in which each of them is uniquely identified by its content (that which it measures) and its context (the conditions under which it is recorded). Two random variables are jointly distributed if and only if they share a context. In a canonical representation of a system, all random v… ▽ More Random variables representing measurements, broadly understood to include any responses to any inputs, form a system in which each of them is uniquely identified by its content (that which it measures) and its context (the conditions under which it is recorded). Two random variables are jointly distributed if and only if they share a context. In a canonical representation of a system, all random variables are binary, and every content-sharing pair of random variables has a unique maximal coupling (the joint distribution imposed on them so that they coincide with maximal possible probability). The system is contextual if these maximal couplings are incompatible with the joint distributions of the context-sharing random variables. We propose to represent any system of measurements in a canonical form and to consider the system contextual if and only if its canonical representation is contextual. As an illustration, we establish a criterion for contextuality of the canonical system consisting of all dichotomizations of a single pair of content-sharing categorical random variables. △ Less

Submitted 19 July, 2017; v1 submitted 3 March, 2017; originally announced March 2017.

Comments: 12 pages of main text + 8 pages of supplementary text with proofs (version 4 is a minor revision). To be published in Philosophical Transactions of the Royal Society A

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Philosophical Transactions of the Royal Society A A 375: 20160389, 2018

Classifying and sorting cluttered piles of unknown objects with robots: a learning approach

Authors: Janne V. Kujala, Tuomas J. Lukka, Harri Holopainen

Abstract: We consider the problem of sorting a densely cluttered pile of unknown objects using a robot. This yet unsolved problem is relevant in the robotic waste sorting business. By extending previous active learning approaches to gras**, we show a system that learns the task autonomously. Instead of predicting just whether a grasp succeeds, we predict the classes of the objects that end up being pick… ▽ More We consider the problem of sorting a densely cluttered pile of unknown objects using a robot. This yet unsolved problem is relevant in the robotic waste sorting business. By extending previous active learning approaches to gras**, we show a system that learns the task autonomously. Instead of predicting just whether a grasp succeeds, we predict the classes of the objects that end up being picked and thrown onto the target conveyor. Segmenting and identifying objects from the uncluttered target conveyor, as opposed to the working area, is easier due to the added structure since the thrown objects will be the only ones present. Instead of trying to segment or otherwise understand the cluttered working area in any way, we simply allow the controller to learn a map** from an RGBD image in the neighborhood of the grasp to a predicted result---all segmentation etc. in the working area is implicit in the learned function. The grasp selection operates in two stages: The first stage is hardcoded and outputs a distribution of possible grasps that sometimes succeed. The second stage uses a purely learned criterion to choose the grasp to make from the proposal distribution created by the first stage. In an experiment, the system quickly learned to make good pickups and predict correctly, in advance, which class of object it was going to pick up and was able to sort the objects from a densely cluttered pile by color. △ Less

Submitted 5 September, 2016; originally announced September 2016.

Comments: 8 pages, 14 figures (pagination changed in arXiv version); accepted for the International Conference on Intelligent Robots and Systems (IROS) 2016

Probabilistic Foundations of Contextuality

Authors: Ehtibar Dzhafarov, Janne Kujala

Abstract: Contextuality is usually defined as absence of a joint distribution for a set of measurements (random variables) with known joint distributions of some of its subsets. However, if these subsets of measurements are not disjoint, contextuality is mathematically impossible even if one generally allows (as one must) for random variables not to be jointly distributed. To avoid contradictions one has to… ▽ More Contextuality is usually defined as absence of a joint distribution for a set of measurements (random variables) with known joint distributions of some of its subsets. However, if these subsets of measurements are not disjoint, contextuality is mathematically impossible even if one generally allows (as one must) for random variables not to be jointly distributed. To avoid contradictions one has to adopt the Contextuality-by-Default approach: measurements made in different contexts are always distinct and stochastically unrelated to each other. Contextuality is reformulated then in terms of the (im)possibility of imposing on all the measurements in a system a joint distribution of a particular kind: such that any measurements of one and the same property made in different contexts satisfy a specified property, $\mathcal{C}$. In the traditional analysis of contextuality $\mathcal{C}$ means "are equal to each other with probability 1". However, if the system of measurements violates the "no-disturbance principle", due to signaling or experimental biases, then the meaning of $\mathcal{C}$ has to be generalized, and the proposed generalization is "are equal to each other with maximal possible probability" (applied to any set of measurements of one and the same property). This approach is illustrated on arbitrary systems of binary measurements, including most of quantum systems of traditional interest in contextuality studies (irrespective of whether "no-disturbance" principle holds in them). △ Less

Submitted 7 November, 2016; v1 submitted 28 April, 2016; originally announced April 2016.

Comments: To be published in Fortschritte der Physik - Progress of Physics. The last version corrects a typo

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Fortschritte der Physik - Progress of Physics 65, 1600040 (1-11), 2017

Contextuality-by-Default 2.0: Systems with Binary Random Variables

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: The paper outlines a new development in the Contextuality-by-Default theory as applied to finite systems of binary random variables. The logic and principles of the original theory remain unchanged, but the definition of contextuality of a system of random variables is now based on multimaximal rather than maximal couplings of the variables that measure the same property in different contexts: a s… ▽ More The paper outlines a new development in the Contextuality-by-Default theory as applied to finite systems of binary random variables. The logic and principles of the original theory remain unchanged, but the definition of contextuality of a system of random variables is now based on multimaximal rather than maximal couplings of the variables that measure the same property in different contexts: a system is considered noncontextual if these multimaximal couplings are compatible with the distributions of the random variables sharing contexts. A multimaximal coupling is one that is a maximal coupling of any subset (equivalently, of any pair) of the random variables being coupled. Arguments are presented for why this modified theory is a superior generalization of the traditional understanding of contextuality in quantum mechanics. The modified theory coincides with the previous version in the important case of cyclic systems, which include the systems whose contextuality was most intensively studied in quantum physics and behavioral sciences. △ Less

Submitted 24 October, 2016; v1 submitted 16 April, 2016; originally announced April 2016.

Comments: to be published in Lecture Notes in Computer Science; version 4 has some typos corrected

MSC Class: 81P13; 81Q99; 60A99

Minimal Distance to Approximating Noncontextual System as a Measure of Contextuality

Authors: Janne V. Kujala

Abstract: Let random vectors $R^c=\{R_p^c:p\in P_c\}$ represent joint measurements of certain subsets $P_c$ of properties $p\in P$ in different contexts $c\in C$. Such a system is traditionally called noncontextual if there exists a jointly distributed set $\{Q_p:p\in P\}$ of random variables such that $R^c$ has the same distribution as $\{Q_p:p\in P_c\}$ for all $c\in C$. A trivial necessary condition for… ▽ More Let random vectors $R^c=\{R_p^c:p\in P_c\}$ represent joint measurements of certain subsets $P_c$ of properties $p\in P$ in different contexts $c\in C$. Such a system is traditionally called noncontextual if there exists a jointly distributed set $\{Q_p:p\in P\}$ of random variables such that $R^c$ has the same distribution as $\{Q_p:p\in P_c\}$ for all $c\in C$. A trivial necessary condition for noncontextuality and a precondition for most approaches to measuring contextuality is that the system is consistently connected, i.e., all $R_p^c,R_p^{c'},\dots$ measuring the same property $p$ have the same distribution. The Contextuality-by-Default (CbD) approach allows detecting and measuring "true" contextuality on top of inconsistent connectedness, but at the price of a higher computational cost. In this paper we propose a novel approach to measuring contextuality that shares the generality and basic definitions of the CbD approach and the computational benefits of the previously proposed Negative Probability (NP) approach. The present approach differs from CbD in that instead of considering all possible joints of the double-indexed random variables $R_p^c$, it considers all possible approximating single-indexed systems $\{Q_p:p\in P\}$. The degree of contextuality is defined based on the minimum possible probabilistic distance of the actual measurements $R^c$ from $\{Q_p:p\in P_c$}. We show that the defined measure agrees with a certain measure of contextuality of the CbD approach for all systems where each property enters in exactly two contexts and that this measure can be calculated far more efficiently than the CbD measure and even more efficiently than the NP measure for sufficiently large systems. The present approach can be modified so as to agree with the NP measure of contextuality on all consistently connected systems while extending it to inconsistently connected systems. △ Less

Submitted 8 December, 2015; originally announced December 2015.

Comments: 19 pages

Picking a Conveyor Clean by an Autonomously Learning Robot

Authors: Janne V. Kujala, Tuomas J. Lukka, Harri Holopainen

Abstract: We present a research picking prototype related to our company's industrial waste sorting application. The goal of the prototype is to be as autonomous as possible and it both calibrates itself and improves its picking with minimal human intervention. The system learns to pick objects better based on a feedback sensor in its gripper and uses machine learning to choosing the best proposal from a ra… ▽ More We present a research picking prototype related to our company's industrial waste sorting application. The goal of the prototype is to be as autonomous as possible and it both calibrates itself and improves its picking with minimal human intervention. The system learns to pick objects better based on a feedback sensor in its gripper and uses machine learning to choosing the best proposal from a random sample produced by simple hard-coded geometric models. We show experimentally the system improving its picking autonomously by measuring the pick success rate as function of time. We also show how this system can pick a conveyor belt clean, depositing 70 out of 80 objects in a difficult to manipulate pile of novel objects into the correct chute. We discuss potential improvements and next steps in this direction. △ Less

Submitted 24 November, 2015; originally announced November 2015.

Comments: 6 pages, 8 figures

Context-Content Systems of Random Variables: The Contextuality-by-Default Theory

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: This paper provides a systematic yet accessible presentation of the Contextuality-by-Default theory. The consideration is confined to finite systems of categorical random variables, which allows us to focus on the basics of the theory without using full-scale measure-theoretic language. Contextuality-by-Default is a theory of random variables identified by their contents and their contexts, so tha… ▽ More This paper provides a systematic yet accessible presentation of the Contextuality-by-Default theory. The consideration is confined to finite systems of categorical random variables, which allows us to focus on the basics of the theory without using full-scale measure-theoretic language. Contextuality-by-Default is a theory of random variables identified by their contents and their contexts, so that two variables have a joint distribution if and only if they share a context. Intuitively, the content of a random variable is the entity the random variable measures or responds to, while the context is formed by the conditions under which these measurements or responses are obtained. A system of random variables consists of stochastically unrelated "bunches," each of which is a set of jointly distributed random variables sharing a context. The variables that have the same content in different contexts form "connections" between the bunches. A probabilistic coupling of this system is a set of random variables obtained by imposing a joint distribution on the stochastically unrelated bunches. A system is considered noncontextual or contextual according to whether it can or cannot be coupled so that the joint distributions imposed on its connections possess a certain property (in the present version of the theory, "maximality"). We present a criterion of contextuality for a special class of systems of random variables, called cyclic systems. We also introduce a general measure of contextuality that makes use of (quasi-)couplings whose distributions may involve negative numbers or numbers greater than 1 in place of probabilities. △ Less

Submitted 27 May, 2016; v1 submitted 11 November, 2015; originally announced November 2015.

Comments: to be published in Journal of Mathematical Psychology

Negative Probabilities and Contextuality

Authors: J. Acacio de Barros, Janne Kujala, Gary Oas

Abstract: There has been a growing interest, both in physics and psychology, in understanding contextuality in experimentally observed quantities. Different approaches have been proposed to deal with contextual systems, and a promising one is contextuality-by-default, put forth by Dzhafarov and Kujala. The goal of this paper is to present a tutorial on a different approach: negative probabilities. We do so… ▽ More There has been a growing interest, both in physics and psychology, in understanding contextuality in experimentally observed quantities. Different approaches have been proposed to deal with contextual systems, and a promising one is contextuality-by-default, put forth by Dzhafarov and Kujala. The goal of this paper is to present a tutorial on a different approach: negative probabilities. We do so by presenting the overall theory of negative probabilities in a way that is consistent with contextuality-by-default and by examining with this theory some simple examples where contextuality appears, both in physics and psychology. △ Less

Submitted 9 November, 2015; originally announced November 2015.

Comments: 28 pages, 5 figures

On Contextuality in Behavioral Data

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala, Victor H. Cervantes, Ru Zhang, Matt Jones

Abstract: Dzhafarov, Zhang, and Kujala (Phil. Trans. Roy. Soc. A 374, 20150099) reviewed several behavioral data sets imitating the formal design of the quantum-mechanical contextuality experiments. The conclusion was that none of these data sets exhibited contextuality if understood in the generalized sense proposed in Dzhafarov, Kujala, and Larsson (Found. Phys. 7, 762-782, 2015), while the traditional de… ▽ More Dzhafarov, Zhang, and Kujala (Phil. Trans. Roy. Soc. A 374, 20150099) reviewed several behavioral data sets imitating the formal design of the quantum-mechanical contextuality experiments. The conclusion was that none of these data sets exhibited contextuality if understood in the generalized sense proposed in Dzhafarov, Kujala, and Larsson (Found. Phys. 7, 762-782, 2015), while the traditional definition of contextuality does not apply to these data because they violate the condition of consistent connectedness (also known as marginal selectivity, no-signaling condition, no-disturbance principle, etc.). In this paper we clarify the relationship between (in)consistent connectedness and (non)contextuality, as well as between the traditional and extended definitions of (non)contextuality, using as an example the Clauser-Horn-Shimony-Holt (CHSH) inequalities originally designed for detecting contextuality in entangled particles. △ Less

Submitted 24 March, 2016; v1 submitted 18 August, 2015; originally announced August 2015.

Comments: to be published in April 2016 in vol. 374 issue 2066 of Philosophical Transactions of the Royal Society A

MSC Class: 81P13; 81Q99; 60A99; 81P13; 81Q99; 60A99; 81P13; 81Q99; 60A99

Conversations on Contextuality

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: In the form of a dialogue (imitating in style Lakatos's Proof and Refutation), this chapter presents and explains the main points of the approach to contextuality dubbed Contextuality-by-Default. In the form of a dialogue (imitating in style Lakatos's Proof and Refutation), this chapter presents and explains the main points of the approach to contextuality dubbed Contextuality-by-Default. △ Less

Submitted 30 November, 2015; v1 submitted 3 August, 2015; originally announced August 2015.

Comments: Opening chapter (pp. 1-22) in "Contextuality from Quantum Physics to Psychology," edited by E. Dzhafarov, S. Jordan, R. Zhang, V. Cervantes. New Jersey: World Scientific Press, 2015

MSC Class: 81P13; 81Q99; 60A99; 81P13; 81Q99; 60A99; 81P13; 81Q99; 60A99

Asymptotic optimality of myopic information-based strategies for Bayesian adaptive estimation

Authors: Janne V. Kujala

Abstract: This paper presents a general asymptotic theory of sequential Bayesian estimation giving results for the strongest, almost sure convergence. We show that under certain smoothness conditions on the probability model, the greedy information gain maximization algorithm for adaptive Bayesian estimation is asymptotically optimal in the sense that the determinant of the posterior covariance in a certain… ▽ More This paper presents a general asymptotic theory of sequential Bayesian estimation giving results for the strongest, almost sure convergence. We show that under certain smoothness conditions on the probability model, the greedy information gain maximization algorithm for adaptive Bayesian estimation is asymptotically optimal in the sense that the determinant of the posterior covariance in a certain neighborhood of the true parameter value is asymptotically minimal. Using this result, we also obtain an asymptotic expression for the posterior entropy based on a novel definition of almost sure convergence on "most trials" (meaning that the convergence holds on a fraction of trials that converges to one). Then, we extend the results to a recently published framework, which generalizes the usual adaptive estimation setting by allowing different trial placements to be associated with different, random costs of observation. For this setting, the author has proposed the heuristic of maximizing the expected information gain divided by the expected cost of that placement. In this paper, we show that this myopic strategy satisfies an analogous asymptotic optimality result when the convergence of the posterior distribution is considered as a function of the total cost (as opposed to the number of observations). △ Less

Submitted 8 January, 2016; v1 submitted 17 June, 2015; originally announced June 2015.

Comments: Published at http://dx.doi.org/10.3150/14-BEJ670 in the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Report number: IMS-BEJ-BEJ670

Journal ref: Bernoulli 2016, Vol. 22, No. 1, 615-651

Is there contextuality in behavioral and social systems?

Authors: Ehtibar Dzhafarov, Ru Zhang, Janne Kujala

Abstract: Most behavioral and social experiments aimed at revealing contextuality are confined to cyclic systems with binary outcomes. In quantum physics, this broad class of systems includes as special cases Klyachko-Can-Binicioglu-Shumovsky-type, Einstein-Podolsky-Rosen-Bell-type, and Suppes-Zanotti-Leggett-Garg-type systems. The theory of contextuality known as Contextuality-by-Default allows one to defi… ▽ More Most behavioral and social experiments aimed at revealing contextuality are confined to cyclic systems with binary outcomes. In quantum physics, this broad class of systems includes as special cases Klyachko-Can-Binicioglu-Shumovsky-type, Einstein-Podolsky-Rosen-Bell-type, and Suppes-Zanotti-Leggett-Garg-type systems. The theory of contextuality known as Contextuality-by-Default allows one to define and measure contextuality in all such system, even if there are context-dependent errors in measurements, or if something in the contexts directly interacts with the measurements. This makes the theory especially suitable for behavioral and social systems, where direct interactions of "everything with everything" are ubiquitous. For cyclic systems with binary outcomes the theory provides necessary and sufficient conditions for noncontextuality, and these conditions are known to be breached in certain quantum systems. We review several behavioral and social data sets (from polls of public opinion to visual illusions to conjoint choices to word combinations to psychophysical matching), and none of these data provides any evidence for contextuality. Our working hypothesis is that this may be a broadly applicable rule: behavioral and social systems are noncontextual, i.e., all "contextual effects" in them result from the ubiquitous dependence of response distributions on the elements of contexts other than the ones to which the response is presumably or normatively directed. △ Less

Submitted 23 August, 2015; v1 submitted 28 April, 2015; originally announced April 2015.

Comments: To be published in Phil. Trans. R. Soc. A, text with supplementary files is not the journal's format

MSC Class: 81P13; 81Q99; 60A99; 81P13; 81Q99; 60A99; 81P13; 81Q99; 60A99

Journal ref: Phil. Trans. R. Soc. A 374: 20150099, 2015

Contextuality-by-Default: A Brief Overview of Ideas, Concepts, and Terminology

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala, Victor H. Cervantes

Abstract: This paper is a brief overview of the concepts involved in measuring the degree of contextuality and detecting contextuality in systems of binary measurements of a finite number of objects. We discuss and clarify the main concepts and terminology of the theory called "contextuality-by-default," and then discuss a possible generalization of the theory from binary to arbitrary measurements. This paper is a brief overview of the concepts involved in measuring the degree of contextuality and detecting contextuality in systems of binary measurements of a finite number of objects. We discuss and clarify the main concepts and terminology of the theory called "contextuality-by-default," and then discuss a possible generalization of the theory from binary to arbitrary measurements. △ Less

Submitted 18 December, 2015; v1 submitted 2 April, 2015; originally announced April 2015.

Comments: Lecture Notes in Computer Science 9535 (with the corrected list of authors) (2016)

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Lecture Notes in Computer Science 9535, 12-23, 2016

Proof of a Conjecture on Contextuality in Cyclic Systems with Binary Variables

Authors: Janne V. Kujala, Ehtibar N. Dzhafarov

Abstract: We present a proof for a conjecture previously formulated by Dzhafarov, Kujala, and Larsson (Foundations of Physics, in press, arXiv:1411.2244). The conjecture specifies a measure for the degree of contextuality and a criterion (necessary and sufficient condition) for contextuality in a broad class of quantum systems. This class includes Leggett-Garg, EPR/Bell, and Klyachko-Can-Binicioglu-Shumovsk… ▽ More We present a proof for a conjecture previously formulated by Dzhafarov, Kujala, and Larsson (Foundations of Physics, in press, arXiv:1411.2244). The conjecture specifies a measure for the degree of contextuality and a criterion (necessary and sufficient condition) for contextuality in a broad class of quantum systems. This class includes Leggett-Garg, EPR/Bell, and Klyachko-Can-Binicioglu-Shumovsky type systems as special cases. In a system of this class certain physical properties $q_{1},...,q_{n}$ are measured in pairs $(q_{i},q_{j})$; every property enters in precisely two such pairs; and each measurement outcome is a binary random variable. Denoting the measurement outcomes for a property $q_{i}$ in the two pairs it enters by $V_{i}$ and $W_{i}$, the pair of measurement outcomes for $(q_{i},q_{j})$ is $(V_{i},W_{j})$. Contextuality is defined as follows: one computes the minimal possible value $Δ_{0}$ for the sum of $\Pr[V_{i}\not=W_{i}]$ (over $i=1,...,n$) that is allowed by the individual distributions of $V_{i}$ and $W_{i}$; one computes the minimal possible value $Δ_{\min}$ for the sum of $\Pr[V_{i}\not=W_{i}]$ across all possible couplings of (i.e., joint distributions imposed on) the entire set of random variables $V_{1},W_{1},...,V_{n},W_{n}$ in the system; and the system is considered contextual if $Δ_{\min}>Δ_{0}$ (otherwise $Δ_{\min}=Δ_{0}$). This definition has its justification in the general approach dubbed Contextuality-by-Default, and it allows for measurement errors and signaling among the measured properties. The conjecture proved in this paper specifies the value of $Δ_{\min}-Δ_{0}$ in terms of the distributions of the measurement outcomes $(V_{i},W_{j})$. △ Less

Submitted 12 September, 2019; v1 submitted 7 March, 2015; originally announced March 2015.

Comments: This version has two typos found in the published article corrected (Foundations of Physics 46, 282-299, 2016; Eq. 7 and Section 1.4.)

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Foundations of Physics 46, 282-299, 2016

Necessary and Sufficient Conditions for Extended Noncontextuality in a Broad Class of Quantum Mechanical Systems

Authors: Janne V. Kujala, Ehtibar N. Dzhafarov, Jan-Åke Larsson

Abstract: The notion of (non)contextuality pertains to sets of properties measured one subset (context) at a time. We extend this notion to include so-called inconsistently connected systems, in which the measurements of a given property in different contexts may have different distributions, due to contextual biases in experimental design or physical interactions (signaling): a system of measurements has a… ▽ More The notion of (non)contextuality pertains to sets of properties measured one subset (context) at a time. We extend this notion to include so-called inconsistently connected systems, in which the measurements of a given property in different contexts may have different distributions, due to contextual biases in experimental design or physical interactions (signaling): a system of measurements has a maximally noncontextual description if they can be imposed a joint distribution on in which the measurements of any one property in different contexts are equal to each other with the maximal probability allowed by their different distributions. We derive necessary and sufficient conditions for the existence of such a description in a broad class of systems including Klyachko-Can-Binicioğlu-Shumvosky-type (KCBS), EPR-Bell-type, and Leggett-Garg-type systems. Because these conditions allow for inconsistent connectedness, they are applicable to real experiments. We illustrate this by analyzing an experiment by Lapkiewicz and colleagues aimed at testing contextuality in a KCBS-type system. △ Less

Submitted 14 November, 2015; v1 submitted 15 December, 2014; originally announced December 2014.

Comments: Phys. Rev. Lett. 115, 150401 (2015)

MSC Class: 81P13; 81Q99; 60A99

Journal ref: Phys. Rev. Lett. 115, 150401 (2015)

Contextuality in Three Types of Quantum-Mechanical Systems

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala, Jan-Åke Larsson

Abstract: We present a formal theory of contextuality for a set of random variables grouped into different subsets (contexts) corresponding to different, mutually incompatible conditions. Within each context the random variables are jointly distributed, but across different contexts they are stochastically unrelated. The theory of contextuality is based on the analysis of the extent to which some of these r… ▽ More We present a formal theory of contextuality for a set of random variables grouped into different subsets (contexts) corresponding to different, mutually incompatible conditions. Within each context the random variables are jointly distributed, but across different contexts they are stochastically unrelated. The theory of contextuality is based on the analysis of the extent to which some of these random variables can be viewed as preserving their identity across different contexts when one considers all possible joint distributions imposed on the entire set of the random variables. We illustrate the theory on three systems of traditional interest in quantum physics (and also in non-physical, e.g., behavioral studies). These are systems of the Klyachko-Can-Binicioglu-Shumovsky-type, Einstein-Podolsky-Rosen-Bell-type, and Suppes-Zanotti-Leggett-Garg-type. Listed in this order, each of them is formally a special case of the previous one. For each of them we derive necessary and sufficient conditions for contextuality while allowing for experimental errors and contextual biases or signaling. Based on the same principles that underly these derivations we also propose a measure for the degree of contextuality and compute it for the three systems in question. △ Less

Submitted 29 August, 2015; v1 submitted 9 November, 2014; originally announced November 2014.

Comments: Foundations of Physics 7, 762-782

MSC Class: 81P13; 81Q99; 60A99

PinView: Implicit Feedback in Content-Based Image Retrieval

Authors: Zakria Hussain, Arto Klami, Jussi Kujala, Alex P. Leung, Kitsuchart Pasupa, Peter Auer, Samuel Kaski, Jorma Laaksonen, John Shawe-Taylor

Abstract: This paper describes PinView, a content-based image retrieval system that exploits implicit relevance feedback collected during a search session. PinView contains several novel methods to infer the intent of the user. From relevance feedback, such as eye movements or pointer clicks, and visual features of images, PinView learns a similarity metric between images which depends on the current intere… ▽ More This paper describes PinView, a content-based image retrieval system that exploits implicit relevance feedback collected during a search session. PinView contains several novel methods to infer the intent of the user. From relevance feedback, such as eye movements or pointer clicks, and visual features of images, PinView learns a similarity metric between images which depends on the current interests of the user. It then retrieves images with a specialized online learning algorithm that balances the tradeoff between exploring new images and exploiting the already inferred interests of the user. We have integrated PinView to the content-based image retrieval system PicSOM, which enables applying PinView to real-world image databases. With the new algorithms PinView outperforms the original PicSOM, and in online experiments with real users the combination of implicit and explicit feedback gives the best results. △ Less

Submitted 2 October, 2014; originally announced October 2014.

Comments: 12 pages

Generalizing Bell-type and Leggett-Garg-type Inequalities to Systems with Signaling

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: Contextuality means non-existence of a joint distribution for random variables recorded under mutually incompatible conditions, subject to certain constraints imposed on how the identity of these variables may change across these conditions. In simple quantum systems contextuality is indicated by violations of Bell-type or Leggett-Garg-type inequalities. These inequalities, however, are predicated… ▽ More Contextuality means non-existence of a joint distribution for random variables recorded under mutually incompatible conditions, subject to certain constraints imposed on how the identity of these variables may change across these conditions. In simple quantum systems contextuality is indicated by violations of Bell-type or Leggett-Garg-type inequalities. These inequalities, however, are predicated on the assumption of no-signaling, defined as invariance of the distributions of measurement results with respect to other (e.g., earlier in time) measurements' settings. Signaling makes the inequalities inapplicable: a non-signaling system with any degree of contextuality, however high, loses any relation to this concept as soon as it exhibits any degree of signaling, however small. This is unsatisfactory. We describe a principled way of defining and measuring contextuality in arbitrary systems with random outputs, whether signaling is absent or present. △ Less

Submitted 4 February, 2015; v1 submitted 10 July, 2014; originally announced July 2014.

Comments: 5 pp., 1 fig. In vv. 4 and 5 minor typos are corrected

MSC Class: 81P13; 81Q99; 60A99

Measuring Observable Quantum Contextuality

Authors: J. Acacio de Barros, Ehtibar N. Dzhafarov, Janne V. Kujala, Gary Oas

Abstract: Contextuality is a central property in comparative analysis of classical, quantum, and supercorrelated systems. We examine and compare two well-motivated approaches to contextuality. One approach ("contextuality-by-default") is based on the idea that one and the same physical property measured under different conditions (contexts) is represented by different random variables. The other approach is… ▽ More Contextuality is a central property in comparative analysis of classical, quantum, and supercorrelated systems. We examine and compare two well-motivated approaches to contextuality. One approach ("contextuality-by-default") is based on the idea that one and the same physical property measured under different conditions (contexts) is represented by different random variables. The other approach is based on the idea that while a physical property is represented by a single random variable irrespective of its context, the joint distributions of the random variables describing the system can involve negative (quasi-)probabilities. We show that in the Leggett-Garg and EPR-Bell systems, the two measures essentially coincide. △ Less

Submitted 17 June, 2015; v1 submitted 11 June, 2014; originally announced June 2014.

Comments: 12 pages

MSC Class: 81P13; 60A99

Journal ref: Lecture Notes in Computer Science 9535, 36-47, 2016

Probabilistic Contextuality in EPR/Bohm-type Systems with Signaling Allowed

Authors: Janne V. Kujala, Ehtibar N. Dzhafarov

Abstract: In this chapter, we review a principled way of defining and measuring contextuality in systems with deterministic inputs and random outputs, recently proposed and developed in \citep{KujalaDzhafarovLarsson2015,DKL2015FooP}. In this chapter, we review a principled way of defining and measuring contextuality in systems with deterministic inputs and random outputs, recently proposed and developed in \citep{KujalaDzhafarovLarsson2015,DKL2015FooP}. △ Less

Submitted 30 November, 2015; v1 submitted 2 June, 2014; originally announced June 2014.

Comments: a chapter (pp. 287-308) in "Contextuality from Quantum Physics to Psychology", edited by E. Dzhafarov, S. Jordan, R. Zhang, and V. Cervantes. New Jersey: World Scientific, 2015

MSC Class: 81P13; 81Q99; 60A99

Contextuality is About Identity of Random Variables

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: Contextual situations are those in which seemingly "the same" random variable changes its identity depending on the conditions under which it is recorded. Such a change of identity is observed whenever the assumption that the variable is one and the same under different conditions leads to contradictions when one considers its joint distribution with other random variables (this is the essence of… ▽ More Contextual situations are those in which seemingly "the same" random variable changes its identity depending on the conditions under which it is recorded. Such a change of identity is observed whenever the assumption that the variable is one and the same under different conditions leads to contradictions when one considers its joint distribution with other random variables (this is the essence of all Bell-type theorems). In our Contextuality-by-Default approach, instead of asking why or how the conditions force "one and the same" random variable to change "its" identity, any two random variables recorded under different conditions are considered different "automatically". They are never the same, nor are they jointly distributed, but one can always impose on them a joint distribution (probabilistic coupling). The special situations when there is a coupling in which these random variables are equal with probability 1 are considered non-contextual. Contextuality means that such couplings do not exist. We argue that the determination of the identity of random variables by conditions under which they are recorded is not a causal relationship and cannot violate laws of physics. △ Less

Submitted 29 January, 2015; v1 submitted 8 May, 2014; originally announced May 2014.

MSC Class: 81P13; 81P05; 60A99

Journal ref: Physica Scripta T163, 014009 (2014)

Probability, Random Variables, and Selectivity

Authors: Ehtibar Dzhafarov, Janne Kujala

Abstract: This is a chapter for the forthcoming New Handbook of Mathematical Psychology, to be published by Cambridge University Press. A systematic theory of random variables and joint distributions under varying conditions is presented. This is a Kolmogorovian theory most generally understood, in which random variables recorded under mutually exclusive conditions do not possess joint distributions but can… ▽ More This is a chapter for the forthcoming New Handbook of Mathematical Psychology, to be published by Cambridge University Press. A systematic theory of random variables and joint distributions under varying conditions is presented. This is a Kolmogorovian theory most generally understood, in which random variables recorded under mutually exclusive conditions do not possess joint distributions but can be coupled in multiple ways. △ Less

Submitted 8 December, 2013; originally announced December 2013.

Comments: This version may differ from the published one

MSC Class: 60A99; 81P13

Embedding Quantum into Classical: Contextualization vs Conditionalization

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: We compare two approaches to embedding joint distributions of random variables recorded under different conditions (such as spins of entangled particles for different settings) into the framework of classical, Kolmogorovian probability theory. In the contextualization approach each random variable is "automatically" labeled by all conditions under which it is recorded, and the random variables acr… ▽ More We compare two approaches to embedding joint distributions of random variables recorded under different conditions (such as spins of entangled particles for different settings) into the framework of classical, Kolmogorovian probability theory. In the contextualization approach each random variable is "automatically" labeled by all conditions under which it is recorded, and the random variables across a set of mutually exclusive conditions are probabilistically coupled (imposed a joint distribution upon). Analysis of all possible probabilistic couplings for a given set of random variables allows one to characterize various relations between their separate distributions (such as Bell-type inequalities or quantum-mechanical constraints). In the conditionalization approach one considers the conditions under which the random variables are recorded as if they were values of another random variable, so that the observed distributions are interpreted as conditional ones. This approach is uninformative with respect to relations between the distributions observed under different conditions, because any set of such distributions is compatible with any distribution assigned to the conditions. △ Less

Submitted 23 January, 2015; v1 submitted 30 November, 2013; originally announced December 2013.

Comments: PLoS One 9(3): e92818 (2014)

MSC Class: 60A99; 81P13

Random Variables Recorded under Mutually Exclusive Conditions: Contextuality-by-Default

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: We present general principles underlying analysis of the dependence of random variables (outputs) on deterministic conditions (inputs). Random outputs recorded under mutually exclusive input values are labeled by these values and considered stochastically unrelated, possessing no joint distribution. An input that does not directly influence an output creates a context for the latter. Any constrain… ▽ More We present general principles underlying analysis of the dependence of random variables (outputs) on deterministic conditions (inputs). Random outputs recorded under mutually exclusive input values are labeled by these values and considered stochastically unrelated, possessing no joint distribution. An input that does not directly influence an output creates a context for the latter. Any constraint imposed on the dependence of random outputs on inputs can be characterized by considering all possible couplings (joint distributions) imposed on stochastically unrelated outputs. The target application of these principles is a quantum mechanical system of entangled particles, with directions of spin measurements chosen for each particle being inputs and the spins recorded outputs. The sphere of applicability, however, spans systems across physical, biological, and behavioral sciences. △ Less

Submitted 23 January, 2015; v1 submitted 4 September, 2013; originally announced September 2013.

Comments: In H. Liljenström (Ed.) Advances in Cognitive Neurodynamics IV (pp. 405-410) (2015)

MSC Class: 60A99; 81P13

No-Forcing and No-Matching Theorems for Classical Probability Applied to Quantum Mechanics

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: Correlations of spins in a system of entangled particles are inconsistent with Kolmogorov's probability theory (KPT), provided the system is assumed to be non-contextual. In the Alice-Bob EPR paradigm, non-contextuality means that the identity of Alice's spin (i.e., the probability space on which it is defined as a random variable) is determined only by the axis \alphai chosen by Alice, irrespecti… ▽ More Correlations of spins in a system of entangled particles are inconsistent with Kolmogorov's probability theory (KPT), provided the system is assumed to be non-contextual. In the Alice-Bob EPR paradigm, non-contextuality means that the identity of Alice's spin (i.e., the probability space on which it is defined as a random variable) is determined only by the axis \alphai chosen by Alice, irrespective of Bob's axis \betaj (and vice versa). Here, we study contextual KPT models, with two properties: (1) Alice's and Bob's spins are identified as Aij and Bij, even though their distributions are determined by, respectively, \alphai alone and \betaj alone, in accordance with the no-signaling requirement; and (2) the joint distributions of the spins Aij,Bij across all values of \alphai,\betaj are constrained by fixing distributions of some subsets thereof. Of special interest among these subsets is the set of probabilistic connections, defined as the pairs \left(Aij,Aij'\right) and \left(Bij,Bi'j\right) with \alphai\not=\alphai' and \betaj\not=\betaj' (the non-contextuality assumption is obtained as a special case of connections, with zero probabilities of Aij\not=Aij' and Bij\not=Bi'j). Thus, one can achieve a complete KPT characterization bof the Bell-type inequalities, or Tsirelson's inequalities, by specifying the distributions of probabilistic connections compatible with those and only those spin pairs \left(Aij,Bij\right) that are subject to these inequalities. We show, however, that quantum-mechanical (QM) constraints are special. No-forcing theorem says that if a set of probabilistic connections is not compatible with correlations violating QM, then it is compatible only with the classical-mechanical correlations. No-matching theorem says that there are no subsets of the spin variables Aij,Bij whose distributions can be fixed to be compatible with and only with QM-compliant correlations. △ Less

Submitted 23 January, 2015; v1 submitted 15 May, 2013; originally announced May 2013.

Comments: Foundations of Physics, 44, 248-265 (2014)

MSC Class: 60A99; 81P13

A Qualified Kolmogorovian Account of Probabilistic Contextuality

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: We describe a mathematical language for determining all possible patterns of contextuality in the dependence of stochastic outputs of a system on its deterministic inputs. The central notion is that of all possible couplings for stochastically unrelated outputs indexed by mutually incompatible values of inputs. A system is characterized by a pattern of which outputs can be "directly influenced" by… ▽ More We describe a mathematical language for determining all possible patterns of contextuality in the dependence of stochastic outputs of a system on its deterministic inputs. The central notion is that of all possible couplings for stochastically unrelated outputs indexed by mutually incompatible values of inputs. A system is characterized by a pattern of which outputs can be "directly influenced" by which inputs (a primitive relation, hypothetical or normative), and by certain constraints imposed on the outputs (such as Bell-type inequalities or their quantum analogues). The set of couplings compatible with these constraints represents a form of contextuality in the dependence of outputs on inputs with respect to the declared pattern of direct influences. △ Less

Submitted 23 January, 2015; v1 submitted 16 April, 2013; originally announced April 2013.

Comments: Lecture Notes in Computer Science 8369, 201-212 (2014)

On selective influences, marginal selectivity, and Bell/CHSH inequalities

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: The Bell/CHSH inequalities of quantum physics are identical with the inequalities derived in mathematical psychology for the problem of selective influences in cases involving two bi- nary experimental factors and two binary random variables recorded in response to them. The following points are made regarding cognitive science applications: (1) compliance of data with these inequalities is inform… ▽ More The Bell/CHSH inequalities of quantum physics are identical with the inequalities derived in mathematical psychology for the problem of selective influences in cases involving two bi- nary experimental factors and two binary random variables recorded in response to them. The following points are made regarding cognitive science applications: (1) compliance of data with these inequalities is informative only if the data satisfy the requirement known as marginal selectivity; (2) both violations of marginal selectivity and violations of the Bell/CHSH inequalities are interpretable as indicating that at least one of the two responses is influenced by both experimental factors. △ Less

Submitted 27 August, 2013; v1 submitted 10 November, 2012; originally announced November 2012.

Comments: This is an invited commentary for a special issue of Topics in Cognitive Science, dedicated to the use of quantum physical formalisms in cognitive science. Currently is in press

MSC Class: 60B99 (Primary) 81Q99; 91E45 (Secondary)

Journal ref: Topics in Cognitive Psychology 6, pp. 121-128 (2014)

All-Possible-Couplings Approach to Measuring Probabilistic Context

Authors: E. N. Dzhafarov, J. V. Kujala

Abstract: From behavioral sciences to biology to quantum mechanics, one encounters situations where (i) a system outputs several random variables in response to several inputs, (ii) for each of these responses only some of the inputs may "directly" influence them, but (iii) other inputs provide a "context" for this response by influencing its probabilistic relations to other responses. These contextual infl… ▽ More From behavioral sciences to biology to quantum mechanics, one encounters situations where (i) a system outputs several random variables in response to several inputs, (ii) for each of these responses only some of the inputs may "directly" influence them, but (iii) other inputs provide a "context" for this response by influencing its probabilistic relations to other responses. These contextual influences are very different, say, in classical kinetic theory and in the entanglement paradigm of quantum mechanics, which are traditionally interpreted as representing different forms of physical determinism. One can mathematically construct systems with other types of contextuality, whether or not empirically realizable: those that form special cases of the classical type, those that fall between the classical and quantum ones, and those that violate the quantum type. We show how one can quantify and classify all logically possible contextual influences by studying various sets of probabilistic couplings, i.e., sets of joint distributions imposed on random outputs recorded at different (mutually incompatible) values of inputs. △ Less

Submitted 29 August, 2015; v1 submitted 15 September, 2012; originally announced September 2012.

Comments: PLoS ONE 8(5): e61712 (2013)

MSC Class: 60B99 (Primary) 81Q99; 91E45 (Secondary)

Journal ref: PLoS ONE 8(5): e61712 (2013)

Quantum Entanglement and the Issue of Selective Influences in Psychology: An Overview

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: Similar formalisms have been independently developed in psychology, to deal with the issue of selective influences (deciding which of several experimental manipulations selectively influences each of several, generally non-independent, response variables), and in quantum mechanics (QM), to deal with the EPR entanglement phenomena (deciding whether an EPR experiment allows for a "classical" account… ▽ More Similar formalisms have been independently developed in psychology, to deal with the issue of selective influences (deciding which of several experimental manipulations selectively influences each of several, generally non-independent, response variables), and in quantum mechanics (QM), to deal with the EPR entanglement phenomena (deciding whether an EPR experiment allows for a "classical" account). The parallels between these problems are established by observing that any two noncommuting measurements in QM are mutually exclusive and can therefore be treated as analogs of different values of one and the same input. Both problems reduce to that of the existence of a jointly distributed system of random variables, one variable for every value of every input (in psychology) or every measurement on every particle involved (in an EPR experiment). We overview three classes of necessary conditions (some of them also sufficient under additional constraints) for the existence of such joint distributions. △ Less

Submitted 31 August, 2012; originally announced September 2012.

Comments: to appear in Lecture Notes in Computer Science

MSC Class: Primary 60B99; Secondary 81Q99; 91E45

Journal ref: Lecture Notes in Computer Science 7620, 184-195 (2012)

Selectivity in Probabilistic Causality: Where Psychology Runs Into Quantum Physics

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: Given a set of several inputs into a system (e.g., independent variables characterizing stimuli) and a set of several stochastically non-independent outputs (e.g., random variables describing different aspects of responses), how can one determine, for each of the outputs, which of the inputs it is influenced by? The problem has applications ranging from modeling pairwise comparisons to reconstruct… ▽ More Given a set of several inputs into a system (e.g., independent variables characterizing stimuli) and a set of several stochastically non-independent outputs (e.g., random variables describing different aspects of responses), how can one determine, for each of the outputs, which of the inputs it is influenced by? The problem has applications ranging from modeling pairwise comparisons to reconstructing mental processing architectures to conjoint testing. A necessary and sufficient condition for a given pattern of selective influences is provided by the Joint Distribution Criterion, according to which the problem of "what influences what" is equivalent to that of the existence of a joint distribution for a certain set of random variables. For inputs and outputs with finite sets of values this criterion translates into a test of consistency of a certain system of linear equations and inequalities (Linear Feasibility Test) which can be performed by means of linear programming. While new in the behavioral context, both this test and the Joint Distribution Criterion on which it is based have been previously proposed in quantum physics, in dealing with generalizations of Bell inequalities for the quantum entanglement problem. The parallels between this problem and that of selective influences in behavioral sciences is established by observing that noncommuting measurements in quantum physics are mutually exclusive and can therefore be treated as different levels of one and the same factor. △ Less

Submitted 13 January, 2012; v1 submitted 10 October, 2011; originally announced October 2011.

Comments: 12 pages; in the second version some typos were corrected; minor revision in the third version; typos corrected in the fourth version. arXiv admin note: substantial text overlap with arXiv:1108.3074

MSC Class: 81P05 (Primary); 91E99 (Secondary)

Journal ref: Journal of Mathematical Psychology 56 (2012) 54-63

Order-distance and other metric-like functions on jointly distributed random variables

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: We construct a class of real-valued nonnegative binary functions on a set of jointly distributed random variables, which satisfy the triangle inequality and vanish at identical arguments (pseudo-quasi-metrics). These functions are useful in dealing with the problem of selective probabilistic causality encountered in behavioral sciences and in quantum physics. The problem reduces to that of ascerta… ▽ More We construct a class of real-valued nonnegative binary functions on a set of jointly distributed random variables, which satisfy the triangle inequality and vanish at identical arguments (pseudo-quasi-metrics). These functions are useful in dealing with the problem of selective probabilistic causality encountered in behavioral sciences and in quantum physics. The problem reduces to that of ascertaining the existence of a joint distribution for a set of variables with known distributions of certain subsets of this set. Any violation of the triangle inequality or its consequences by one of our functions when applied to such a set rules out the existence of this joint distribution. We focus on an especially versatile and widely applicable pseudo-quasi-metric called an order-distance and its special case called a classification distance. △ Less

Submitted 31 August, 2012; v1 submitted 6 October, 2011; originally announced October 2011.

Comments: 14 pages, to appear in Proc. Amer. Math. Soc

MSC Class: 60B99 (Primary) 81Q99; 91E45 (Secondary)

Journal ref: Proc. Amer. Math. Soc, 141, 3291-3301, 2013

A Probabilistic Approach to Pronunciation by Analogy

Authors: Janne V. Kujala, Aleksi Keurulainen

Abstract: The relationship between written and spoken words is convoluted in languages with a deep orthography such as English and therefore it is difficult to devise explicit rules for generating the pronunciations for unseen words. Pronunciation by analogy (PbA) is a data-driven method of constructing pronunciations for novel words from concatenated segments of known words and their pronunciations. PbA pe… ▽ More The relationship between written and spoken words is convoluted in languages with a deep orthography such as English and therefore it is difficult to devise explicit rules for generating the pronunciations for unseen words. Pronunciation by analogy (PbA) is a data-driven method of constructing pronunciations for novel words from concatenated segments of known words and their pronunciations. PbA performs relatively well with English and outperforms several other proposed methods. However, the best published word accuracy of 65.5% (for the 20,000 word NETtalk corpus) suggests there is much room for improvement in it. Previous PbA algorithms have used several different scoring strategies such as the product of the frequencies of the component pronunciations of the segments, or the number of different segmentations that yield the same pronunciation, and different combinations of these methods, to evaluate the candidate pronunciations. In this article, we instead propose to use a probabilistically justified scoring rule. We show that this principled approach alone yields better accuracy (66.21% for the NETtalk corpus) than any previously published PbA algorithm. Furthermore, combined with certain ad hoc modifications motivated by earlier algorithms, the performance climbs up to 66.6%, and further improvements are possible by combining this method with other methods. △ Less

Submitted 21 September, 2011; originally announced September 2011.

MSC Class: 68T50

Selectivity in Probabilistic Causality: Drawing Arrows from Inputs to Stochastic Outputs

Authors: Ehtibar N. Dzhafarov, Janne V. Kujala

Abstract: Given a set of several inputs into a system (e.g., independent variables characterizing stimuli) and a set of several stochastically non-independent outputs (e.g., random variables describing different aspects of responses), how can one determine, for each of the outputs, which of the inputs it is influenced by? The problem has applications ranging from modeling pairwise comparisons to reconstruct… ▽ More Given a set of several inputs into a system (e.g., independent variables characterizing stimuli) and a set of several stochastically non-independent outputs (e.g., random variables describing different aspects of responses), how can one determine, for each of the outputs, which of the inputs it is influenced by? The problem has applications ranging from modeling pairwise comparisons to reconstructing mental processing architectures to conjoint testing. A necessary and sufficient condition for a given pattern of selective influences is provided by the Joint Distribution Criterion, according to which the problem of "what influences what" is equivalent to that of the existence of a joint distribution for a certain set of random variables. For inputs and outputs with finite sets of values this criterion translates into a test of consistency of a certain system of linear equations and inequalities (Linear Feasibility Test) which can be performed by means of linear programming. The Joint Distribution Criterion also leads to a metatheoretical principle for generating a broad class of necessary conditions (tests) for diagrams of selective influences. Among them is the class of distance-type tests based on the observation that certain functionals on jointly distributed random variables satisfy triangle inequality. △ Less

Submitted 27 August, 2011; v1 submitted 15 August, 2011; originally announced August 2011.

Comments: 25 pages; minor corrections with respect to the first version

MSC Class: 91E45 (Primary); 60A05 (Secondary)

A Remark on the Assumptions of Bayes' Theorem

Authors: Janne V. Kujala

Abstract: We formulate simple equivalent conditions for the validity of Bayes' formula for conditional densities. We show that for any random variables X and Y (with values in arbitrary measurable spaces), the following are equivalent: 1. X and Y have a joint density w.r.t. a product measure μx ν, 2. P_{X,Y} << P_X x P_Y, (here P_{.} denotes the distribution of {.}) 3. X has a conditional density p(x… ▽ More We formulate simple equivalent conditions for the validity of Bayes' formula for conditional densities. We show that for any random variables X and Y (with values in arbitrary measurable spaces), the following are equivalent: 1. X and Y have a joint density w.r.t. a product measure μx ν, 2. P_{X,Y} << P_X x P_Y, (here P_{.} denotes the distribution of {.}) 3. X has a conditional density p(x | y) w.r.t. a sigma-finite measure μ, 4. X has a conditional distribution P_{X|Y} such that P_{X|y} << P_X for all y, 5. X has a conditional distribution P_{X|Y} and a marginal density p(x) w.r.t. a measure μsuch that P_{X|y} << μfor all y. Furthermore, given random variables X and Y with a conditional density p(y | x) w.r.t. νand a marginal density p(x) w.r.t. μ, we show that Bayes' formula p(x | y) = p(y | x)p(x) / \int p(y | x)p(x)dμ(x) yields a conditional density p(x | y) w.r.t. μif and only if X and Y satisfy the above conditions. Counterexamples illustrating the nontriviality of the results are given, and implications for sequential adaptive estimation are considered. △ Less

Submitted 31 March, 2011; originally announced March 2011.

Comments: 10 pages

MSC Class: 60A05; 60A10

Exact limiting solutions for certain deterministic traffic rules

Authors: Janne V. Kujala, Tuomas J. Lukka

Abstract: We analyze the steady-state flow as a function of the initial density for a class of deterministic cellular automata rules (``traffic rules'') with periodic boundary conditions [H. Fuks and N. Boccara, Int. J. Mod. Phys. C 9, 1 (1998)]. We are able to predict from simple considerations the observed, unexpected cutoff of the average flow at unity. We also present an efficient algorithm for determ… ▽ More We analyze the steady-state flow as a function of the initial density for a class of deterministic cellular automata rules (``traffic rules'') with periodic boundary conditions [H. Fuks and N. Boccara, Int. J. Mod. Phys. C 9, 1 (1998)]. We are able to predict from simple considerations the observed, unexpected cutoff of the average flow at unity. We also present an efficient algorithm for determining the exact final flow from a given finite initial state. We analyze the behavior of this algorithm in the infinite limit to obtain for R_m,k an exact polynomial equation maximally of 2(m+k)th degree in the flow and density. △ Less

Submitted 21 May, 2001; originally announced May 2001.

Comments: 25 pages, 8 figures