Showing 51–100 of 104 results for author: Frey, J

Interactive Narrative in Virtual Reality

Authors: Gilad Ostrin, Jérémy Frey, Jessica Cauchard

Abstract: Interactive fiction is a literary genre that is rapidly gaining popularity. In this genre, readers are able to explicitly take actions in order to guide the course of the story. With the recent popularity of narrative focused games, we propose to design and develop an interactive narrative tool for content creators. In this extended abstract, we show how we leverage this interactive medium to pres… ▽ More Interactive fiction is a literary genre that is rapidly gaining popularity. In this genre, readers are able to explicitly take actions in order to guide the course of the story. With the recent popularity of narrative focused games, we propose to design and develop an interactive narrative tool for content creators. In this extended abstract, we show how we leverage this interactive medium to present a tool for interactive storytelling in virtual reality. Using a simple markup language, content creators and researchers are now able to create interactive narratives in a virtual reality environment. We further discuss the potential future directions for a virtual reality storytelling engine. △ Less

Submitted 8 January, 2019; originally announced January 2019.

Journal ref: MUM 2018 Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia, Nov 2018, Cairo, Egypt. pp.463-467

Extended polarized semiclassical model for quantum-dot cavity QED and its application to single-photon sources

Authors: H. J. Snijders, D. N. L. Kok, M. F. van de Stolpe, J. A. Frey, J. Norman, A. C. Gossard, J. E. Bowers, M. P. van Exter, D. Bouwmeester, W. Löffler

Abstract: We present a simple extension of the semi-classical model for a two-level system in a cavity, in order to incorporate multiple polarized transitions, such as those appearing in neutral and charged quantum dots (QDs), and two nondegenerate linearly polarized cavity modes. We verify the model by exact quantum master equation calculations, and experimentally using a neutral QD in a polarization non-d… ▽ More We present a simple extension of the semi-classical model for a two-level system in a cavity, in order to incorporate multiple polarized transitions, such as those appearing in neutral and charged quantum dots (QDs), and two nondegenerate linearly polarized cavity modes. We verify the model by exact quantum master equation calculations, and experimentally using a neutral QD in a polarization non-degenerate micro-cavity, in both cases we observe excellent agreement. Finally, the usefulness of this approach is demonstrated by optimizing a single-photon source based on polarization postselection, where we find an increase in the brightness for optimal polarization conditions as predicted by the model. △ Less

Submitted 5 May, 2020; v1 submitted 26 November, 2018; originally announced November 2018.

Comments: 8 pages, for simple code see https://doi.org/10.5281/zenodo.3476660

Journal ref: Phys. Rev. A 101, 053811 (2020)

Remote Biofeedback Sharing, Opportunities and Challenges

Authors: Jérémy Frey, Jessica Cauchard

Abstract: Biofeedback is commonly used to regulate one's state, for example to manage stress. The underlying idea is that by perceiving a feedback about their physiological activity, a user can act upon it. In this paper we describe through two recent projects how biofeedback could be leveraged to share one's state at distance. Such extension of biofeedback could answer to the need of belonging, further wid… ▽ More Biofeedback is commonly used to regulate one's state, for example to manage stress. The underlying idea is that by perceiving a feedback about their physiological activity, a user can act upon it. In this paper we describe through two recent projects how biofeedback could be leveraged to share one's state at distance. Such extension of biofeedback could answer to the need of belonging, further widening the applications of the technology in terms of well-being. △ Less

Submitted 27 August, 2018; originally announced August 2018.

Comments: WellComp - UbiComp/ISWC'18 Adjunct, Oct 2018, Singapore, Singapore. http://ubicomp.org/ubicomp2018/

Exploring Biofeedback with a Tangible Interface Designed for Relaxation

Authors: Morgane Hamon, Rémy Ramadour, Jérémy Frey

Abstract: Anxiety is a common health issue that can occur throughout one's existence. In this pilot study we explore an alternative technique to regulate it: biofeedback. The long-term objective is to offer an ecological device that could help people cope with anxiety, by exposing their inner state in a comprehensive manner. We propose a first iteration of this device, "Inner Flower", that uses heart rate t… ▽ More Anxiety is a common health issue that can occur throughout one's existence. In this pilot study we explore an alternative technique to regulate it: biofeedback. The long-term objective is to offer an ecological device that could help people cope with anxiety, by exposing their inner state in a comprehensive manner. We propose a first iteration of this device, "Inner Flower", that uses heart rate to adapt a breathing guide to the user, and we investigate its efficiency and usability. Traditionally, such device requires user's full attention. We propose an ambient modality during which the device operates in the peripheral vision. Beside comparing "Ambient" and "Focus" conditions, we also compare the biofeedback with a sham feedback (fixed breathing guide). We found that the Focus group demonstrated higher relaxation and performance on a cognitive task (N-back). However, there was no noticeable effect of the Ambient feedback, and the biofeedback condition did not yield any significant difference when compared to the sham feedback. These results, while promising, highlight the pitfalls of any research related to biofeedback, where it is difficult to fully comprehend the underlying mechanisms of such technique. △ Less

Submitted 27 August, 2018; originally announced August 2018.

Comments: PhyCS - International Conference on Physiological Computing Systems, Sep 2018, Seville, Spain. SCITEPRESS, 2018, http://www.phycs.org/?y=2018

Active Inference for Adaptive BCI: application to the P300 Speller

Authors: Jelena Mladenović, Jérémy Frey, Emmanuel Maby, Mateus Joffily, Fabien Lotte, Jeremie Mattout

Abstract: Adaptive Brain-Computer interfaces (BCIs) have shown to improve performance, however a general and flexible framework to implement adaptive features is still lacking. We appeal to a generic Bayesian approach, called Active Inference (AI), to infer user's intentions or states and act in a way that optimizes performance. In realistic P300-speller simulations, AI outperforms traditional algorithms wi… ▽ More Adaptive Brain-Computer interfaces (BCIs) have shown to improve performance, however a general and flexible framework to implement adaptive features is still lacking. We appeal to a generic Bayesian approach, called Active Inference (AI), to infer user's intentions or states and act in a way that optimizes performance. In realistic P300-speller simulations, AI outperforms traditional algorithms with an increase in bit rate between 18% and 59%, while offering a possibility of unifying various adaptive implementations within one generic framework. △ Less

Submitted 22 May, 2018; originally announced May 2018.

Journal ref: International BCI meeting, May 2018, Asilomar, United States. 2018, http://bcisociety.org/

Evaluation of a congruent auditory feedback for Motor Imagery BCI

Authors: Emmanuel Christophe, Jérémy Frey, Richard Kronland-Martinet, Jean-Arthur Micoulaud-Franchi, Jelena Mladenović, Gaëlle Mougin, Jean Vion-Dury, Solvi Ystad, Mitsuko Aramaki

Abstract: Designing a feedback that helps participants to achieve higher performances is an important concern in brain-computer interface (BCI) research. In a pilot study, we demonstrate how a congruent auditory feedback could improve classification in a electroencephalography (EEG) motor imagery BCI. This is a promising result for creating alternate feedback modality. Designing a feedback that helps participants to achieve higher performances is an important concern in brain-computer interface (BCI) research. In a pilot study, we demonstrate how a congruent auditory feedback could improve classification in a electroencephalography (EEG) motor imagery BCI. This is a promising result for creating alternate feedback modality. △ Less

Submitted 22 May, 2018; v1 submitted 18 May, 2018; originally announced May 2018.

Journal ref: International BCI meeting, May 2018, Asilomar, United States. http://bcisociety.org/

Electro-optic polarization tuning of microcavities with a single quantum dot

Authors: J. A. Frey, H. J. Snijders, J. Norman, A. C. Gossard, J. E. Bowers, W. Loffler, D. Bouwmeester

Abstract: We present an oxide aperture microcavity with embedded quantum dots that utilizes a three contact design to independently tune the quantum dot wavelength and birefringence of the cavity modes. A polarization splitting tuning of $\sim$5 GHz is observed. For typical microcavity polarization splittings, the method can be used to achieve perfect polarization degeneracy that is required for many polari… ▽ More We present an oxide aperture microcavity with embedded quantum dots that utilizes a three contact design to independently tune the quantum dot wavelength and birefringence of the cavity modes. A polarization splitting tuning of $\sim$5 GHz is observed. For typical microcavity polarization splittings, the method can be used to achieve perfect polarization degeneracy that is required for many polarization-based implementations of photonic quantum gates. The embedded quantum dot wavelength can be tuned into resonance with the cavity, independent of the polarization tuning. △ Less

Submitted 9 May, 2018; originally announced May 2018.

Single photons and unconventional photon blockade in quantum dot cavity-QED

Authors: H. J. Snijders, J. A. Frey, J. Norman, H. Flayac, V. Savona, A. C. Gossard, J. E. Bowers, M. P. van Exter, D. Bouwmeester, W. Löffler

Abstract: We observe the unconventional photon blockade effect in quantum dot cavity QED, which, in contrast to conventional photon blockade, operates in the weak coupling regime. A single quantum dot transition is simultaneously coupled to two orthogonally polarized optical cavity modes, and by careful tuning of the input and output state of polarization, the unconventional photon blockade effect is observ… ▽ More We observe the unconventional photon blockade effect in quantum dot cavity QED, which, in contrast to conventional photon blockade, operates in the weak coupling regime. A single quantum dot transition is simultaneously coupled to two orthogonally polarized optical cavity modes, and by careful tuning of the input and output state of polarization, the unconventional photon blockade effect is observed. We find a minimum second-order correlation $g^{(2)}(0)\approx0.37$ which corresponds to $g^{(2)}(0)\approx0.005$ when corrected for detector jitter, and observe the expected polarization dependency and photon bunching and anti-bunching very close-by in parameter space, which indicates the abrupt change from phase to amplitude squeezing. △ Less

Submitted 29 March, 2018; originally announced March 2018.

Comments: 5 pages

Journal ref: Phys. Rev. Lett. 121, 043601 (2018)

Dišimo: Anchoring Our Breath

Authors: Jelena Mladenovic, Jérémy Frey, Jessica Cauchard

Abstract: We present a system that raises awareness about users' inner state. Dišimo is a multimodal ambient display that provides feedback about one's stress level, which is assessed through heart rate monitoring. Upon detecting a low heart rate variability for a prolonged period of time, Dišimo plays an audio track, setting the pace of a regular and deep breathing. Users can then choose to take a moment t… ▽ More We present a system that raises awareness about users' inner state. Dišimo is a multimodal ambient display that provides feedback about one's stress level, which is assessed through heart rate monitoring. Upon detecting a low heart rate variability for a prolonged period of time, Dišimo plays an audio track, setting the pace of a regular and deep breathing. Users can then choose to take a moment to focus on their breath. By doing so, they will activate the Dišimo devices belonging to their close ones, who can then join for a shared relaxation session. △ Less

Submitted 1 March, 2018; originally announced March 2018.

Journal ref: CHI '18 Interactivity - SIGCHI Conference on Human Factors in Computing System, Apr 2018, Montreal, Canada

Breeze: Sharing Biofeedback Through Wearable Technologies

Authors: Jérémy Frey, May Grabli, Ronit Slyper, Jessica Cauchard

Abstract: Digitally presenting physiological signals as biofeedback to users raises awareness of both body and mind. This paper describes the effectiveness of conveying a physiological signal often overlooked for communication: breathing. We present the design and development of digital breathing patterns and their evaluation along three output modalities: visual, audio, and haptic. We also present Breeze,… ▽ More Digitally presenting physiological signals as biofeedback to users raises awareness of both body and mind. This paper describes the effectiveness of conveying a physiological signal often overlooked for communication: breathing. We present the design and development of digital breathing patterns and their evaluation along three output modalities: visual, audio, and haptic. We also present Breeze, a wearable pendant placed around the neck that measures breathing and sends biofeedback in real-time. We evaluated how the breathing patterns were interpreted in a fixed environment and gathered qualitative data on the wearable device's design. We found that participants intentionally modified their own breathing to match the biofeedback, as a technique for understanding the underlying emotion. Our results describe how the features of the breathing patterns and the feedback modalities influenced participants' perception. We include guidelines and suggested use cases, such as Breeze being used by loved ones to increase connectedness and empathy. △ Less

Submitted 14 February, 2018; originally announced February 2018.

Journal ref: CHI '18 - SIGCHI Conference on Human Factors in Computing System, Apr 2018, Montreal, Canada. 2018, https://chi2018.acm.org/

Impredicative Encodings of (Higher) Inductive Types

Authors: Steve Awodey, Jonas Frey, Sam Speight

Abstract: Postulating an impredicative universe in dependent type theory allows System F style encodings of finitary inductive types, but these fail to satisfy the relevant η-equalities and consequently do not admit dependent eliminators. To recover η and dependent elimination, we present a method to construct refinements of these impredicative encodings, using ideas from homotopy type theory. We then exten… ▽ More Postulating an impredicative universe in dependent type theory allows System F style encodings of finitary inductive types, but these fail to satisfy the relevant η-equalities and consequently do not admit dependent eliminators. To recover η and dependent elimination, we present a method to construct refinements of these impredicative encodings, using ideas from homotopy type theory. We then extend our method to construct impredicative encodings of some higher inductive types, such as 1-truncation and the unit circle S1. △ Less

Submitted 8 February, 2018; originally announced February 2018.

Generating and designing DNA with deep generative models

Authors: Nathan Killoran, Leo J. Lee, Andrew Delong, David Duvenaud, Brendan J. Frey

Abstract: We propose generative neural network methods to generate DNA sequences and tune them to have desired properties. We present three approaches: creating synthetic DNA sequences using a generative adversarial network; a DNA-based variant of the activation maximization ("deep dream") design method; and a joint procedure which combines these two approaches together. We show that these tools capture imp… ▽ More We propose generative neural network methods to generate DNA sequences and tune them to have desired properties. We present three approaches: creating synthetic DNA sequences using a generative adversarial network; a DNA-based variant of the activation maximization ("deep dream") design method; and a joint procedure which combines these two approaches together. We show that these tools capture important structures of the data and, when applied to designing probes for protein binding microarrays, allow us to generate new sequences whose properties are estimated to be superior to those found in the training data. We believe that these results open the door for applying deep generative models to advance genomics research. △ Less

Submitted 17 December, 2017; originally announced December 2017.

Comments: NIPS 2017 Computational Biology Workshop

The Impact of Flow in an EEG-based Brain Computer Interface

Authors: Jelena Mladenović, Jérémy Frey, Manon Bonnet-Save, Jérémie Mattout, Fabien Lotte

Abstract: Major issues in Brain Computer Interfaces (BCIs) include low usability and poor user performance. This paper tackles them by ensuring the users to be in a state of immersion, control and motivation, called state of flow. Indeed, in various disciplines, being in the state of flow was shown to improve performances and learning. Hence, we intended to draw BCI users in a flow state to improve both the… ▽ More Major issues in Brain Computer Interfaces (BCIs) include low usability and poor user performance. This paper tackles them by ensuring the users to be in a state of immersion, control and motivation, called state of flow. Indeed, in various disciplines, being in the state of flow was shown to improve performances and learning. Hence, we intended to draw BCI users in a flow state to improve both their subjective experience and their performances. In a Motor Imagery BCI game, we manipulated flow in two ways: 1) by adapting the task difficulty and 2) by using background music. Results showed that the difficulty adaptation induced a higher flow state, however music had no effect. There was a positive correlation between subjective flow scores and offline performance, although the flow factors had no effect (adaptation) or negative effect (music) on online performance. Overall, favouring the flow state seems a promising approach for enhancing users' satisfaction, although its complexity requires more thorough investigations. △ Less

Submitted 6 June, 2017; originally announced June 2017.

A fiber coupled cavity QED source of identical single photons

Authors: H. J. Snijders, J. A. Frey, J. Norman, V. P. Post, A. C. Gossard, J. E. Bowers, M. P. van Exter, W. Löffler, D. Bouwmeester

Abstract: A high-fidelity source of identical single photons is essential for numerous quantum technologies such as quantum repeaters and optical quantum information processing. Hallmarks thereof are a near-unity single-photon purity, near-unity indistinguishability of consecutively emitted photons, and high brightness through a near-unity number of photons per time bin. In order to embed such sources in qu… ▽ More A high-fidelity source of identical single photons is essential for numerous quantum technologies such as quantum repeaters and optical quantum information processing. Hallmarks thereof are a near-unity single-photon purity, near-unity indistinguishability of consecutively emitted photons, and high brightness through a near-unity number of photons per time bin. In order to embed such sources in quantum networks, optical fiber integration is essential but complicated by cryogenic compatability and noise. Here we demonstrate a resonantly pumped, quantum dot (QD) based, transmission operated, single-mode fiber coupled single photon source with a purity of 97%, indistinguishability of 90%, and a brightness of 17%. This is achieved by deploying a unique micropillar cavity design in a closed-cycle cryostat, which is operated using a through-fiber cross-polarization technique to remove the pump laser light from the resonantly scattered single photons. These results pave the way for fully fiber integrated photonic quantum networks, as our technology is equally applicable for cavity-QED based photonic quantum gates. △ Less

Submitted 16 May, 2017; originally announced May 2017.

Comments: 10 pages, 10 figures

Journal ref: Phys. Rev. Applied 9, 031002 (2018)

Scientific Outreach with Teegi, a Tangible EEG Interface to Talk about Neurotechnologies

Authors: Jérémy Frey, Renaud Gervais, Thibault Lainé, Maxime Duluc, Hugo Germain, Stéphanie Fleck, Fabien Lotte, Martin Hachet

Abstract: Teegi is an anthropomorphic and tangible avatar exposing a users' brain activity in real time. It is connected to a device sensing the brain by means of electroencephalog-raphy (EEG). Teegi moves its hands and feet and closes its eyes along with the person being monitored. It also displays on its scalp the associated EEG signals, thanks to a semi-spherical display made of LEDs. Attendees can inter… ▽ More Teegi is an anthropomorphic and tangible avatar exposing a users' brain activity in real time. It is connected to a device sensing the brain by means of electroencephalog-raphy (EEG). Teegi moves its hands and feet and closes its eyes along with the person being monitored. It also displays on its scalp the associated EEG signals, thanks to a semi-spherical display made of LEDs. Attendees can interact directly with Teegi -- e.g. move its limbs -- to discover by themselves the underlying brain processes. Teegi can be used for scientific outreach to introduce neurotechnologies in general and brain-computer interfaces (BCI) in particular. △ Less

Submitted 7 March, 2017; originally announced March 2017.

Journal ref: CHI '17 Interactivity - SIGCHI Conference on Human Factors in Computing System, May 2017, Denver, United States

Comparison of an open-hardware electroencephalography amplifier with medical grade device in brain-computer interface applications

Authors: Jérémy Frey

Abstract: Brain-computer interfaces (BCI) are promising communication devices between humans and machines. BCI based on non-invasive neuroimaging techniques such as electroencephalography (EEG) have many applications , however the dissemination of the technology is limited, in part because of the price of the hardware. In this paper we compare side by side two EEG amplifiers, the consumer grade OpenBCI and… ▽ More Brain-computer interfaces (BCI) are promising communication devices between humans and machines. BCI based on non-invasive neuroimaging techniques such as electroencephalography (EEG) have many applications , however the dissemination of the technology is limited, in part because of the price of the hardware. In this paper we compare side by side two EEG amplifiers, the consumer grade OpenBCI and the medical grade g.tec g.USBamp. For this purpose, we employed an original montage, based on the simultaneous recording of the same set of electrodes. Two set of recordings were performed. During the first experiment a simple adapter with a direct connection between the amplifiers and the electrodes was used. Then, in a second experiment, we attempted to discard any possible interference that one amplifier could cause to the other by adding "ideal" diodes to the adapter. Both spectral and temporal features were tested -- the former with a workload monitoring task, the latter with an visual P300 speller task. Overall, the results suggest that the OpenBCI board -- or a similar solution based on the Texas Instrument ADS1299 chip -- could be an effective alternative to traditional EEG devices. Even though a medical grade equipment still outperforms the OpenBCI, the latter gives very close EEG readings, resulting in practice in a classification accuracy that may be suitable for popularizing BCI uses. △ Less

Submitted 8 June, 2016; originally announced June 2016.

Comments: PhyCS - International Conference on Physiological Computing Systems, Jul 2016, Lisbon, Portugal. SCITEPRESS, 2016

VIF: Virtual Interactive Fiction (with a twist)

Authors: Jérémy Frey

Abstract: Nowadays computer science can create digital worlds that deeply immerse users; it can also process in real time brain activity to infer their inner states. What marvels can we achieve with such technologies? Go back to displaying text. And unfold a story that follows and molds users as never before. Nowadays computer science can create digital worlds that deeply immerse users; it can also process in real time brain activity to infer their inner states. What marvels can we achieve with such technologies? Go back to displaying text. And unfold a story that follows and molds users as never before. △ Less

Submitted 8 June, 2016; originally announced June 2016.

Comments: Pervasive Play - CHI '16 Workshop, May 2016, San Jose, United States

Purification of a single photon nonlinearity

Authors: H. Snijders, J. A. Frey, J. Norman, M. P. Bakker, A. Gossard, J. E. Bowers, M. P. van Exter, D. Bouwmeester, W. Löffler

Abstract: We show that the lifetime-reduced fidelity of a semiconductor quantum dot-cavity single photon nonlinearity can be restored by polarization pre- and postselection. This is realized with a polarization degenerate microcavity in the weak coupling regime, where an output polarizer enables quantum interference of the two orthogonally polarized transmission amplitudes. This allows us to transform incid… ▽ More We show that the lifetime-reduced fidelity of a semiconductor quantum dot-cavity single photon nonlinearity can be restored by polarization pre- and postselection. This is realized with a polarization degenerate microcavity in the weak coupling regime, where an output polarizer enables quantum interference of the two orthogonally polarized transmission amplitudes. This allows us to transform incident coherent light into a stream of strongly correlated photons with a second-order correlation function of g2(0)~40, larger than previous experimental results even in the strong-coupling regime. This purification technique might also be useful to improve the fidelity of quantum dot based logic gates. △ Less

Submitted 2 April, 2016; originally announced April 2016.

Comments: 5 pages + supplemental material

Journal ref: Nat. Commun. 7, 12578 (2016)

Introspectibles: Tangible Interaction to Foster Introspection

Authors: Renaud Gervais, Joan Sol Roo, Jérémy Frey, Martin Hachet

Abstract: Digital devices are now ubiquitous and have the potential to be used to support positive changes in human lives and promote psychological well-being. This paper presents three interactive systems that we created focusing on introspection activities, leveraging tangible interaction and spatial augmented reality. More specifically, we describe anthropomorphic augmented avatars that display the use… ▽ More Digital devices are now ubiquitous and have the potential to be used to support positive changes in human lives and promote psychological well-being. This paper presents three interactive systems that we created focusing on introspection activities, leveraging tangible interaction and spatial augmented reality. More specifically, we describe anthropomorphic augmented avatars that display the users' inner states using physiological sensors. We also present a first prototype of an augmented sandbox specifically dedicated to promoting mindfulness activities. △ Less

Submitted 15 March, 2016; originally announced March 2016.

Comments: in CHI '16 - SIGCHI Conference on Human Factors in Computing System - Computing and Mental Health Workshop, May 2016, San Jose, United States

Remote Heart Rate Sensing and Projection to Renew Traditional Board Games and Foster Social Interactions

Authors: Jérémy Frey

Abstract: While physiological sensors enter the mass market and reach the general public, they are still mainly employed to monitor health -- whether it is for medical purpose or sports. We describe an application that uses heart rate feedback as an incentive for social interactions. A traditional board game has been "augmented" through remote physiological sensing, using webcams. Projection helped to conce… ▽ More While physiological sensors enter the mass market and reach the general public, they are still mainly employed to monitor health -- whether it is for medical purpose or sports. We describe an application that uses heart rate feedback as an incentive for social interactions. A traditional board game has been "augmented" through remote physiological sensing, using webcams. Projection helped to conceal the technological aspects from users. We detail how players reacted -- stressful situations could emerge when users are deprived from their own signals -- and we give directions for game designers to integrate physiological sensors. △ Less

Submitted 26 February, 2016; originally announced February 2016.

Journal ref: CHI '16 Extended Abstracts, May 2016, San Jose, United States. 2016

Framework for Electroencephalography-based Evaluation of User Experience

Authors: Jérémy Frey, Maxime Daniel, Julien Castet, Martin Hachet, Fabien Lotte

Abstract: Measuring brain activity with electroencephalography (EEG) is mature enough to assess mental states. Combined with existing methods, such tool can be used to strengthen the understanding of user experience. We contribute a set of methods to estimate continuously the user's mental workload, attention and recognition of interaction errors during different interaction tasks. We validate these measure… ▽ More Measuring brain activity with electroencephalography (EEG) is mature enough to assess mental states. Combined with existing methods, such tool can be used to strengthen the understanding of user experience. We contribute a set of methods to estimate continuously the user's mental workload, attention and recognition of interaction errors during different interaction tasks. We validate these measures on a controlled virtual environment and show how they can be used to compare different interaction techniques or devices, by comparing here a keyboard and a touch-based interface. Thanks to such a framework, EEG becomes a promising method to improve the overall usability of complex computer systems. △ Less

Submitted 12 January, 2016; originally announced January 2016.

Comments: in ACM. CHI '16 - SIGCHI Conference on Human Factors in Computing System, May 2016, San Jose, United States

TOBE: Tangible Out-of-Body Experience

Authors: Renaud Gervais, Jérémy Frey, Alexis Gay, Fabien Lotte, Martin Hachet

Abstract: We propose a toolkit for creating Tangible Out-of-Body Experiences: exposing the inner states of users using physiological signals such as heart rate or brain activity. Tobe can take the form of a tangible avatar displaying live physiological readings to reflect on ourselves and others. Such a toolkit could be used by researchers and designers to create a multitude of potential tangible applicatio… ▽ More We propose a toolkit for creating Tangible Out-of-Body Experiences: exposing the inner states of users using physiological signals such as heart rate or brain activity. Tobe can take the form of a tangible avatar displaying live physiological readings to reflect on ourselves and others. Such a toolkit could be used by researchers and designers to create a multitude of potential tangible applications, including (but not limited to) educational tools about Science Technologies Engineering and Mathematics (STEM) and cognitive science, medical applications or entertainment and social experiences with one or several users or Tobes involved. Through a co-design approach, we investigated how everyday people picture their physiology and we validated the acceptability of Tobe in a scientific museum. We also give a practical example where two users relax together, with insights on how Tobe helped them to synchronize their signals and share a moment. △ Less

Submitted 20 November, 2015; originally announced November 2015.

Journal ref: Tangible, Embedded and Embodied Interaction (TEI), Feb 2016, Eindhoven, Netherlands. 2016, \<http://www.tei-conf.org/16/\>. \<10.1145/2839462.2839486\>

Continuous Mental Effort Evaluation during 3D Object Manipulation Tasks based on Brain and Physiological Signals

Authors: Dennis Wobrock, Jérémy Frey, Delphine Graeff, Jean-Baptiste De La Rivière, Julien Castet, Fabien Lotte

Abstract: Designing 3D User Interfaces (UI) requires adequate evaluation tools to ensure good usability and user experience. While many evaluation tools are already available and widely used, existing approaches generally cannot provide continuous and objective measures of usa-bility qualities during interaction without interrupting the user. In this paper, we propose to use brain (with ElectroEncephaloGrap… ▽ More Designing 3D User Interfaces (UI) requires adequate evaluation tools to ensure good usability and user experience. While many evaluation tools are already available and widely used, existing approaches generally cannot provide continuous and objective measures of usa-bility qualities during interaction without interrupting the user. In this paper, we propose to use brain (with ElectroEncephaloGraphy) and physiological (ElectroCardioGraphy, Galvanic Skin Response) signals to continuously assess the mental effort made by the user to perform 3D object manipulation tasks. We first show how this mental effort (a.k.a., mental workload) can be estimated from such signals, and then measure it on 8 participants during an actual 3D object manipulation task with an input device known as the CubTile. Our results suggest that monitoring workload enables us to continuously assess the 3DUI and/or interaction technique ease-of-use. Overall, this suggests that this new measure could become a useful addition to the repertoire of available evaluation tools, enabling a finer grain assessment of the ergonomic qualities of a given 3D user interface. △ Less

Submitted 29 May, 2015; originally announced May 2015.

Comments: Published in INTERACT, Sep 2015, Bamberg, Germany

Estimating Visual Comfort in Stereoscopic Displays Using Electroencephalography: A Proof-of-Concept

Authors: Jérémy Frey, Aurélien Appriou, Fabien Lotte, Martin Hachet

Abstract: With stereoscopic displays, a depth sensation that is too strong could impede visual comfort and result in fatigue or pain. Electroencephalography (EEG) is a technology which records brain activity. We used it to develop a novel brain-computer interface that monitors users' states in order to reduce visual strain. We present the first proof-of-concept system that discriminates comfortable conditio… ▽ More With stereoscopic displays, a depth sensation that is too strong could impede visual comfort and result in fatigue or pain. Electroencephalography (EEG) is a technology which records brain activity. We used it to develop a novel brain-computer interface that monitors users' states in order to reduce visual strain. We present the first proof-of-concept system that discriminates comfortable conditions from uncomfortable ones during stereoscopic vision using EEG. It reacts within 1s to depth variations, achieving 63% accuracy on average and 74% when 7 consecutive variations are measured. This study could lead to adaptive systems that automatically suit stereoscopic displays to users and viewing conditions. △ Less

Submitted 28 May, 2015; originally announced May 2015.

Comments: INTERACT, Sep 2015, Bamberg, Germany

Realizability Toposes from Specifications

Authors: Jonas Frey

Abstract: We investigate a framework of Krivine realizability with I/O effects, and present a method of associating realizability models to specifications on the I/O behavior of processes, by using adequate interpretations of the central concepts of `pole' and `proof-like term'. This method does in particular allow to associate realizability models to computable functions. Following recent work of Streich… ▽ More We investigate a framework of Krivine realizability with I/O effects, and present a method of associating realizability models to specifications on the I/O behavior of processes, by using adequate interpretations of the central concepts of `pole' and `proof-like term'. This method does in particular allow to associate realizability models to computable functions. Following recent work of Streicher and others we show how these models give rise to triposes and toposes. △ Less

Submitted 24 April, 2015; originally announced April 2015.

MSC Class: 03F03 (Primary); 03G30 (Secondary)

Teegi: Tangible EEG Interface

Authors: Jérémy Frey, Renaud Gervais, Stéphanie Fleck, Fabien Lotte, Martin Hachet

Abstract: We introduce Teegi, a Tangible ElectroEncephaloGraphy (EEG) Interface that enables novice users to get to know more about something as complex as brain signals, in an easy, en- gaging and informative way. To this end, we have designed a new system based on a unique combination of spatial aug- mented reality, tangible interaction and real-time neurotech- nologies. With Teegi, a user can visualize a… ▽ More We introduce Teegi, a Tangible ElectroEncephaloGraphy (EEG) Interface that enables novice users to get to know more about something as complex as brain signals, in an easy, en- gaging and informative way. To this end, we have designed a new system based on a unique combination of spatial aug- mented reality, tangible interaction and real-time neurotech- nologies. With Teegi, a user can visualize and analyze his or her own brain activity in real-time, on a tangible character that can be easily manipulated, and with which it is possible to interact. An exploration study has shown that interacting with Teegi seems to be easy, motivating, reliable and infor- mative. Overall, this suggests that Teegi is a promising and relevant training and mediation tool for the general public. △ Less

Submitted 4 December, 2014; originally announced December 2014.

Comments: to appear in UIST-ACM User Interface Software and Technology Symposium, Oct 2014, Honolulu, United States

Heart Rate Monitoring as an Easy Way to Increase Engagement in Human-Agent Interaction

Authors: Jérémy Frey

Abstract: Physiological sensors are gaining the attention of manufacturers and users. As denoted by devices such as smartwatches or the newly released Kinect 2 -- which can covertly measure heartbeats -- or by the popularity of smartphone apps that track heart rate during fitness activities. Soon, physiological monitoring could become widely accessible and transparent to users. We demonstrate how one could… ▽ More Physiological sensors are gaining the attention of manufacturers and users. As denoted by devices such as smartwatches or the newly released Kinect 2 -- which can covertly measure heartbeats -- or by the popularity of smartphone apps that track heart rate during fitness activities. Soon, physiological monitoring could become widely accessible and transparent to users. We demonstrate how one could take advantage of this situation to increase users' engagement and enhance user experience in human-agent interaction. We created an experimental protocol involving embodied agents -- "virtual avatars". Those agents were displayed alongside a beating heart. We compared a condition in which this feedback was simply duplicating the heart rates of users to another condition in which it was set to an average heart rate. Results suggest a superior social presence of agents when they display feedback similar to users' internal state. This physiological "similarity-attraction" effect may lead, with little effort, to a better acceptance of agents and robots by the general public. △ Less

Submitted 4 December, 2014; originally announced December 2014.

Comments: PhyCS - International Conference on Physiological Computing Systems, Feb 2015, Angers, France. SCITEPRESS, \<http://www.phycs.org/\&gt

Ordered combinatory algebras and realizability

Authors: Walter Ferrer Santos, Jonas Frey, Mauricio Guillermo, Octavio Malherbe, Alexandre Miquel

Abstract: We consider different classes of combinatory structures related to Krivine realizability. We show, in the precise sense that they give rise to the same class of triposes, that they are equivalent for the purpose of modeling higher-order logic. We center our attentions in the role of a special kind of Ordered Combinatory Algebras-- that we call the "Krivine ordered combinatory algebras" (… ▽ More We consider different classes of combinatory structures related to Krivine realizability. We show, in the precise sense that they give rise to the same class of triposes, that they are equivalent for the purpose of modeling higher-order logic. We center our attentions in the role of a special kind of Ordered Combinatory Algebras-- that we call the "Krivine ordered combinatory algebras" ($\mathcal{KOCA}$s)-- that we propose as the foundational pillars for the categorical perspective of Krivine's classical realizability as presented by Streicher. Our procedure is the following: we show that each of the considered combinatory structures gives rise to an indexed preorder, and describe a way to transform the different structures into each other that preserves the associated indexed preorders up to equivalence. Since all structures give rise to the same indexed preorders, we only prove that they are triposes once: for the class of $\mathcal{KOCA}$s. We finish showing that in $\mathcal{KOCA}$s, one can define realizability in every higher-order language and in particular in higher-order arithmetic. △ Less

Submitted 19 October, 2014; originally announced October 2014.

Magneto-Optical Imaging of Vortex Domain Deformation in Pinning Sites

Authors: Robert Badea, Johnathon A. Frey, Jesse Berezovsky

Abstract: We use a sensitive magneto-optical microscopy technique to image the magnetization response of micron-scale ferromagnetic disks to changes in applied magnetic field. This differential technique relies on a modulated applied magnetic field which allows us to measure changes in magnetization <1% with sub-micron resolution. The disks are magnetized in single vortex domains, with defects in the materi… ▽ More We use a sensitive magneto-optical microscopy technique to image the magnetization response of micron-scale ferromagnetic disks to changes in applied magnetic field. This differential technique relies on a modulated applied magnetic field which allows us to measure changes in magnetization <1% with sub-micron resolution. The disks are magnetized in single vortex domains, with defects in the material serving to pin the vortex core at particular positions. By applying a small AC magnetic field, we measure the deformation of the magnetization while the core remains pinned. We can also characterize the strength of the pinning site by increasing the AC magnetic field to unpin the vortex core. While pinned, we find that the magnetization away from the core reorients slightly to better align with an applied field. Additionally, an applied field causes the pinned core itself to tilt in the direction of the field. Once the field is large enough to unpin the core, this tilt disappears, and the core instead translates across the disk. △ Less

Submitted 16 October, 2014; originally announced October 2014.

Comments: 6 pages, 4 figures

Characterizing partitioned assemblies and realizability toposes

Authors: Jonas Frey

Abstract: We give simple characterizations of the category PAsm(A) of partitioned assemblies, and of the realizability topos RT(A) over a partial combinatory algebra A. This answers the question for an 'extensional characterization' of realizability toposes. We give simple characterizations of the category PAsm(A) of partitioned assemblies, and of the realizability topos RT(A) over a partial combinatory algebra A. This answers the question for an 'extensional characterization' of realizability toposes. △ Less

Submitted 2 August, 2018; v1 submitted 28 April, 2014; originally announced April 2014.

Assessing the Zone of Comfort in Stereoscopic Displays using EEG

Authors: Jérémy Frey, Léonard Pommereau, Fabien Lotte, Martin Hachet

Abstract: The conflict between vergence (eye movement) and accommodation (crystalline lens deformation) occurs in every stereoscopic display. It could cause important stress outside the "zone of comfort", when stereoscopic effect is too strong. This conflict has already been studied using questionnaires, during viewing sessions of several minutes. The present pilot study describes an experimental protocol w… ▽ More The conflict between vergence (eye movement) and accommodation (crystalline lens deformation) occurs in every stereoscopic display. It could cause important stress outside the "zone of comfort", when stereoscopic effect is too strong. This conflict has already been studied using questionnaires, during viewing sessions of several minutes. The present pilot study describes an experimental protocol which compares two different comfort conditions using electroencephalography (EEG) over short viewing sequences. Analyses showed significant differences both in event-related potentials (ERP) and in frequency bands power. An uncomfortable stereoscopy correlates with a weaker negative component and a delayed positive component in ERP. It also induces a power decrease in the alpha band and increases in theta and beta bands. With fast responses to stimuli, EEG is likely to enable the conception of adaptive systems, which could tune the stereoscopic experience according to each viewer. △ Less

Submitted 24 April, 2014; originally announced April 2014.

Journal ref: ACM SIGCHI Conference on Human Factors in Computing Systems (2014)

A fibrational study of realizability toposes

Authors: Jonas Frey

Abstract: This is the author's PhD thesis. It is a contribution to categorical logic, in particular to the theory of realizability toposes. While the tools of categorical logic have proven very successful in analyzing and organizing proof theoretic realizability interpretations, it was remarked by experts (notably Peter Johnstone) that the field of realizability toposes itself was not clearly delineated,… ▽ More This is the author's PhD thesis. It is a contribution to categorical logic, in particular to the theory of realizability toposes. While the tools of categorical logic have proven very successful in analyzing and organizing proof theoretic realizability interpretations, it was remarked by experts (notably Peter Johnstone) that the field of realizability toposes itself was not clearly delineated, and lacked a powerful theory analogous to that of Grothendieck toposes. The present work sets out to remedy this situation to a certain extent. We argue that realizability toposes are best understood using Grothendieck fibrations, and develop a framework of fibrational cocompletions, which allows to view certain constructions from realizability in precise analogy to constructions of presheaf and sheaf toposes. Using these techniques, and a class of posetal fibrations that we call uniform preorders, we are able to give an extensional characterization of partial combinatory algebras and of the realizability toposes that are constructed from these algebras. Striving to develop the analogy to Grothendieck toposes further, we outline how to apply our techniques on arbitrary base toposes, and give a decomposition theorem for constant objects functors induced by triposes, analogous to the known decompositions of geometric morphisms. Finally, we sketch an approach of how to find a unified framework for Grothendieck toposes and realizability toposes, based on the observation that uniform preorders can be identified with preorders internal to a category of sheaves. △ Less

Submitted 14 March, 2014; originally announced March 2014.

Review of the Use of Electroencephalography as an Evaluation Method for Human-Computer Interaction

Authors: Jérémy Frey, Christian Mühl, Fabien Lotte, Martin Hachet

Abstract: Evaluating human-computer interaction is essential as a broadening population uses machines, sometimes in sensitive contexts. However, traditional evaluation methods may fail to combine real-time measures, an "objective" approach and data contextualization. In this review we look at how adding neuroimaging techniques can respond to such needs. We focus on electroencephalography (EEG), as it could… ▽ More Evaluating human-computer interaction is essential as a broadening population uses machines, sometimes in sensitive contexts. However, traditional evaluation methods may fail to combine real-time measures, an "objective" approach and data contextualization. In this review we look at how adding neuroimaging techniques can respond to such needs. We focus on electroencephalography (EEG), as it could be handled effectively during a dedicated evaluation phase. We identify workload, attention, vigilance, fatigue, error recognition, emotions, engagement, flow and immersion as being recognizable by EEG. We find that workload, attention and emotions assessments would benefit the most from EEG. Moreover, we advocate to study further error recognition through neuroimaging to enhance usability and increase user experience. △ Less

Submitted 9 November, 2013; originally announced November 2013.

Comments: PhyCS 2014 - International Conference on Physiological Computing Systems (2014)

Variational Learning in Mixed-State Dynamic Graphical Models

Authors: Vladimir Pavlovic, Brendan J. Frey, Thomas S. Huang

Abstract: Many real-valued stochastic time-series are locally linear (Gassian), but globally non-linear. For example, the trajectory of a human hand gesture can be viewed as a linear dynamic system driven by a nonlinear dynamic system that represents muscle actions. We present a mixed-state dynamic graphical model in which a hidden Markov model drives a linear dynamic system. This combination allows us t… ▽ More Many real-valued stochastic time-series are locally linear (Gassian), but globally non-linear. For example, the trajectory of a human hand gesture can be viewed as a linear dynamic system driven by a nonlinear dynamic system that represents muscle actions. We present a mixed-state dynamic graphical model in which a hidden Markov model drives a linear dynamic system. This combination allows us to model both the discrete and continuous causes of trajectories such as human gestures. The number of computations needed for exact inference is exponential in the sequence length, so we derive an approximate variational inference technique that can also be used to learn the parameters of the discrete and continuous models. We show how the mixed-state model and the variational technique can be used to classify human hand gestures made with a computer mouse. △ Less

Submitted 23 January, 2013; originally announced January 2013.

Comments: Appears in Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence (UAI1999)

Report number: UAI-P-1999-PG-522-530

Learning Graphical Models of Images, Videos and Their Spatial Transformations

Authors: Brendan J. Frey, Nebojsa Jojic

Abstract: Mixtures of Gaussians, factor analyzers (probabilistic PCA) and hidden Markov models are staples of static and dynamic data modeling and image and video modeling in particular. We show how topographic transformations in the input, such as translation and shearing in images, can be accounted for in these models by including a discrete transformation variable. The resulting models perform clustering… ▽ More Mixtures of Gaussians, factor analyzers (probabilistic PCA) and hidden Markov models are staples of static and dynamic data modeling and image and video modeling in particular. We show how topographic transformations in the input, such as translation and shearing in images, can be accounted for in these models by including a discrete transformation variable. The resulting models perform clustering, dimensionality reduction and time-series analysis in a way that is invariant to transformations in the input. Using the EM algorithm, these transformation-invariant models can be fit to static data and time series. We give results on filtering microscopy images, face and facial pose clustering, handwritten digit modeling and recognition, video clustering, object tracking, and removal of distractions from video sequences. △ Less

Submitted 16 January, 2013; originally announced January 2013.

Comments: Appears in Proceedings of the Sixteenth Conference on Uncertainty in Artificial Intelligence (UAI2000)

Report number: UAI-P-2000-PG-184-191

A Factorized Variational Technique for Phase Unwrap** in Markov Random Fields

Authors: Kannan Achan, Brendan J. Frey, Ralf Koetter

Abstract: Some types of medical and topographic imaging device produce images in which the pixel values are "phase-wrapped", i.e. measured modulus a known scalar. Phase unwrap** can be viewed as the problem of inferring the number of shifts between each and every pair of neighboring pixels, subject to an a priori preference for smooth surfaces, and subject to a zero curl constraint, which requires that th… ▽ More Some types of medical and topographic imaging device produce images in which the pixel values are "phase-wrapped", i.e. measured modulus a known scalar. Phase unwrap** can be viewed as the problem of inferring the number of shifts between each and every pair of neighboring pixels, subject to an a priori preference for smooth surfaces, and subject to a zero curl constraint, which requires that the shifts must sum to 0 around every loop. We formulate phase unwrap** as a mean field inference problem in a Markov network, where the prior favors the zero curl constraint. We compare our mean field technique with the least squares method on a synthetic 100x100 image, and give results on a 512x512 synthetic aperture radar image from Sandia National Laboratories.<Long Text> △ Less

Submitted 10 January, 2013; originally announced January 2013.

Comments: Appears in Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (UAI2001)

Report number: UAI-P-2001-PG-1-6

Learning Generative Models of Similarity Matrices

Authors: Romer Rosales, Brendan J. Frey

Abstract: We describe a probabilistic (generative) view of affinity matrices along with inference algorithms for a subclass of problems associated with data clustering. This probabilistic view is helpful in understanding different models and algorithms that are based on affinity functions OF the data. IN particular, we show how(greedy) inference FOR a specific probabilistic model IS equ… ▽ More We describe a probabilistic (generative) view of affinity matrices along with inference algorithms for a subclass of problems associated with data clustering. This probabilistic view is helpful in understanding different models and algorithms that are based on affinity functions OF the data. IN particular, we show how(greedy) inference FOR a specific probabilistic model IS equivalent TO the spectral clustering algorithm.It also provides a framework FOR develo** new algorithms AND extended models. AS one CASE, we present new generative data clustering models that allow us TO infer the underlying distance measure suitable for the clustering problem at hand. These models seem to perform well in a larger class of problems for which other clustering algorithms (including spectral clustering) usually fail. Experimental evaluation was performed in a variety point data sets, showing excellent performance. △ Less

Submitted 19 October, 2012; originally announced December 2012.

Comments: Appears in Proceedings of the Nineteenth Conference on Uncertainty in Artificial Intelligence (UAI2003)

Report number: UAI-P-2003-PG-485-492

Extending Factor Graphs so as to Unify Directed and Undirected Graphical Models

Authors: Brendan J. Frey

Abstract: The two most popular types of graphical model are directed models (Bayesian networks) and undirected models (Markov random fields, or MRFs). Directed and undirected models offer complementary properties in model construction, expressing conditional independencies, expressing arbitrary factorizations of joint distributions, and formulating message-passing inference algorithms. We… ▽ More The two most popular types of graphical model are directed models (Bayesian networks) and undirected models (Markov random fields, or MRFs). Directed and undirected models offer complementary properties in model construction, expressing conditional independencies, expressing arbitrary factorizations of joint distributions, and formulating message-passing inference algorithms. We show that the strengths of these two representations can be combined in a single type of graphical model called a 'factor graph'. Every Bayesian network or MRF can be easily converted to a factor graph that expresses the same conditional independencies, expresses the same factorization of the joint distribution, and can be used for probabilistic inference through application of a single, simple message-passing algorithm. In contrast to chain graphs, where message-passing is implemented on a hypergraph, message-passing can be directly implemented on the factor graph. We describe a modified 'Bayes-ball' algorithm for establishing conditional independence in factor graphs, and we show that factor graphs form a strict superset of Bayesian networks and MRFs. In particular, we give an example of a commonly-used 'mixture of experts' model fragment, whose independencies cannot be represented in a Bayesian network or an MRF, but can be represented in a factor graph. We finish by giving examples of real-world problems that are not well suited to representation in Bayesian networks and MRFs, but are well-suited to representation in factor graphs. △ Less

Submitted 19 October, 2012; originally announced December 2012.

Comments: Appears in Proceedings of the Nineteenth Conference on Uncertainty in Artificial Intelligence (UAI2003)

Report number: UAI-P-2003-PG-257-264

Fast Exact Inference for Recursive Cardinality Models

Authors: Daniel Tarlow, Kevin Swersky, Richard S. Zemel, Ryan Prescott Adams, Brendan J. Frey

Abstract: Cardinality potentials are a generally useful class of high order potential that affect probabilities based on how many of D binary variables are active. Maximum a posteriori (MAP) inference for cardinality potential models is well-understood, with efficient computations taking O(DlogD) time. Yet efficient marginalization and sampling have not been addressed as thoroughly in the machine learning c… ▽ More Cardinality potentials are a generally useful class of high order potential that affect probabilities based on how many of D binary variables are active. Maximum a posteriori (MAP) inference for cardinality potential models is well-understood, with efficient computations taking O(DlogD) time. Yet efficient marginalization and sampling have not been addressed as thoroughly in the machine learning community. We show that there exists a simple algorithm for computing marginal probabilities and drawing exact joint samples that runs in O(Dlog2 D) time, and we show how to frame the algorithm as efficient belief propagation in a low order tree-structured model that includes additional auxiliary variables. We then develop a new, more general class of models, termed Recursive Cardinality models, which take advantage of this efficiency. Finally, we show how to do efficient exact inference in models composed of a tree structure and a cardinality potential. We explore the expressive power of Recursive Cardinality models and empirically demonstrate their utility. △ Less

Submitted 16 October, 2012; originally announced October 2012.

Comments: Appears in Proceedings of the Twenty-Eighth Conference on Uncertainty in Artificial Intelligence (UAI2012)

Report number: UAI-P-2012-PG-825-834

Convolutional Factor Graphs as Probabilistic Models

Authors: Yongyi Mao, Frank Kschischang, Brendan J. Frey

Abstract: Based on a recent development in the area of error control coding, we introduce the notion of convolutional factor graphs (CFGs) as a new class of probabilistic graphical models. In this context, the conventional factor graphs are referred to as multiplicative factor graphs (MFGs). This paper shows that CFGs are natural models for probability functions when summation of independent latent random v… ▽ More Based on a recent development in the area of error control coding, we introduce the notion of convolutional factor graphs (CFGs) as a new class of probabilistic graphical models. In this context, the conventional factor graphs are referred to as multiplicative factor graphs (MFGs). This paper shows that CFGs are natural models for probability functions when summation of independent latent random variables is involved. In particular, CFGs capture a large class of linear models, where the linearity is in the sense that the observed variables are obtained as a linear ransformation of the latent variables taking arbitrary distributions. We use Gaussian models and independent factor models as examples to emonstrate the use of CFGs. The requirement of a linear transformation between latent variables (with certain independence restriction) and the bserved variables, to an extent, limits the modelling flexibility of CFGs. This structural restriction however provides a powerful analytic tool to the framework of CFGs; that is, upon taking the Fourier transform of the function represented by the CFG, the resulting function is represented by a FG with identical structure. This Fourier transform duality allows inference problems on a CFG to be solved on the corresponding dual MFG. △ Less

Submitted 11 July, 2012; originally announced July 2012.

Comments: Appears in Proceedings of the Twentieth Conference on Uncertainty in Artificial Intelligence (UAI2004)

Report number: UAI-P-2004-PG-374-381

Matrix Tile Analysis

Authors: Inmar Givoni, Vincent Cheung, Brendan J. Frey

Abstract: Many tasks require finding groups of elements in a matrix of numbers, symbols or class likelihoods. One approach is to use efficient bi- or tri-linear factorization techniques including PCA, ICA, sparse matrix factorization and plaid analysis. These techniques are not appropriate when addition and multiplication of matrix elements are not sensibly defined. More directly, methods like bi-clustering… ▽ More Many tasks require finding groups of elements in a matrix of numbers, symbols or class likelihoods. One approach is to use efficient bi- or tri-linear factorization techniques including PCA, ICA, sparse matrix factorization and plaid analysis. These techniques are not appropriate when addition and multiplication of matrix elements are not sensibly defined. More directly, methods like bi-clustering can be used to classify matrix elements, but these methods make the overly-restrictive assumption that the class of each element is a function of a row class and a column class. We introduce a general computational problem, `matrix tile analysis' (MTA), which consists of decomposing a matrix into a set of non-overlap** tiles, each of which is defined by a subset of usually nonadjacent rows and columns. MTA does not require an algebra for combining tiles, but must search over discrete combinations of tile assignments. Exact MTA is a computationally intractable integer programming problem, but we describe an approximate iterative technique and a computationally efficient sum-product relaxation of the integer program. We compare the effectiveness of these methods to PCA and plaid on hundreds of randomly generated tasks. Using double-gene-knockout data, we show that MTA finds groups of interacting yeast genes that have biologically-related functions. △ Less

Submitted 27 June, 2012; originally announced June 2012.

Comments: Appears in Proceedings of the Twenty-Second Conference on Uncertainty in Artificial Intelligence (UAI2006)

Report number: UAI-P-2006-PG-200-207

Flexible Priors for Exemplar-based Clustering

Authors: Daniel Tarlow, Richard S. Zemel, Brendan J. Frey

Abstract: Exemplar-based clustering methods have been shown to produce state-of-the-art results on a number of synthetic and real-world clustering problems. They are appealing because they offer computational benefits over latent-mean models and can handle arbitrary pairwise similarity measures between data points. However, when trying to recover underlying structure in clustering problems, tailored similar… ▽ More Exemplar-based clustering methods have been shown to produce state-of-the-art results on a number of synthetic and real-world clustering problems. They are appealing because they offer computational benefits over latent-mean models and can handle arbitrary pairwise similarity measures between data points. However, when trying to recover underlying structure in clustering problems, tailored similarity measures are often not enough; we also desire control over the distribution of cluster sizes. Priors such as Dirichlet process priors allow the number of clusters to be unspecified while expressing priors over data partitions. To our knowledge, they have not been applied to exemplar-based models. We show how to incorporate priors, including Dirichlet process priors, into the recently introduced affinity propagation algorithm. We develop an efficient maxproduct belief propagation algorithm for our new model and demonstrate experimentally how the expanded range of clustering priors allows us to better recover true clusterings in situations where we have some information about the generating process. △ Less

Submitted 13 June, 2012; originally announced June 2012.

Comments: Appears in Proceedings of the Twenty-Fourth Conference on Uncertainty in Artificial Intelligence (UAI2008)

Report number: UAI-P-2008-PG-537-545

Cumulative distribution networks and the derivative-sum-product algorithm

Authors: Jim Huang, Brendan J. Frey

Abstract: We introduce a new type of graphical model called a "cumulative distribution network" (CDN), which expresses a joint cumulative distribution as a product of local functions. Each local function can be viewed as providing evidence about possible orderings, or rankings, of variables. Interestingly, we find that the conditional independence properties of CDNs are quite different from other graphical… ▽ More We introduce a new type of graphical model called a "cumulative distribution network" (CDN), which expresses a joint cumulative distribution as a product of local functions. Each local function can be viewed as providing evidence about possible orderings, or rankings, of variables. Interestingly, we find that the conditional independence properties of CDNs are quite different from other graphical models. We also describe a messagepassing algorithm that efficiently computes conditional cumulative distributions. Due to the unique independence properties of the CDN, these messages do not in general have a one-to-one correspondence with messages exchanged in standard algorithms, such as belief propagation. We demonstrate the application of CDNs for structured ranking learning using a previously-studied multi-player gaming dataset. △ Less

Submitted 13 June, 2012; originally announced June 2012.

Comments: Appears in Proceedings of the Twenty-Fourth Conference on Uncertainty in Artificial Intelligence (UAI2008)

Report number: UAI-P-2008-PG-290-297

Hierarchical Affinity Propagation

Authors: Inmar Givoni, Clement Chung, Brendan J. Frey

Abstract: Affinity propagation is an exemplar-based clustering algorithm that finds a set of data-points that best exemplify the data, and associates each datapoint with one exemplar. We extend affinity propagation in a principled way to solve the hierarchical clustering problem, which arises in a variety of domains including biology, sensor networks and decision making in operational research. We derive an… ▽ More Affinity propagation is an exemplar-based clustering algorithm that finds a set of data-points that best exemplify the data, and associates each datapoint with one exemplar. We extend affinity propagation in a principled way to solve the hierarchical clustering problem, which arises in a variety of domains including biology, sensor networks and decision making in operational research. We derive an inference algorithm that operates by propagating information up and down the hierarchy, and is efficient despite the high-order potentials required for the graphical model formulation. We demonstrate that our method outperforms greedy techniques that cluster one layer at a time. We show that on an artificial dataset designed to mimic the HIV-strain mutation dynamics, our method outperforms related methods. For real HIV sequences, where the ground truth is not available, we show our method achieves better results, in terms of the underlying objective function, and show the results correspond meaningfully to geographical location and strain subtypes. Finally we report results on using the method for the analysis of mass spectra, showing it performs favorably compared to state-of-the-art methods. △ Less

Submitted 14 February, 2012; originally announced February 2012.

Report number: UAI-P-2011-PG-238-246

Interpreting Graph Cuts as a Max-Product Algorithm

Authors: Daniel Tarlow, Inmar E. Givoni, Richard S. Zemel, Brendan J. Frey

Abstract: The maximum a posteriori (MAP) configuration of binary variable models with submodular graph-structured energy functions can be found efficiently and exactly by graph cuts. Max-product belief propagation (MP) has been shown to be suboptimal on this class of energy functions by a canonical counterexample where MP converges to a suboptimal fixed point (Kulesza & Pereira, 2008). In this work, we sh… ▽ More The maximum a posteriori (MAP) configuration of binary variable models with submodular graph-structured energy functions can be found efficiently and exactly by graph cuts. Max-product belief propagation (MP) has been shown to be suboptimal on this class of energy functions by a canonical counterexample where MP converges to a suboptimal fixed point (Kulesza & Pereira, 2008). In this work, we show that under a particular scheduling and dam** scheme, MP is equivalent to graph cuts, and thus optimal. We explain the apparent contradiction by showing that with proper scheduling and dam**, MP always converges to an optimal fixed point. Thus, the canonical counterexample only shows the suboptimality of MP with a particular suboptimal choice of schedule and dam**. With proper choices, MP is optimal. △ Less

Submitted 5 May, 2011; originally announced May 2011.

A 2-Categorical Analysis of the Tripos-to-Topos Construction

Authors: Jonas Frey

Abstract: We characterize the tripos-to-topos construction of Hyland, Johnstone and Pitts as a biadjunction in a bicategory enriched category of equipment-like structures. These abstract concepts are necessary to handle the presence of oplax constructs --- the construction is only oplax functorial on certain classes of cartesian functors between triposes. A by-product of our analysis is the decomposition of… ▽ More We characterize the tripos-to-topos construction of Hyland, Johnstone and Pitts as a biadjunction in a bicategory enriched category of equipment-like structures. These abstract concepts are necessary to handle the presence of oplax constructs --- the construction is only oplax functorial on certain classes of cartesian functors between triposes. A by-product of our analysis is the decomposition of the tripos-to-topos construction into two steps, the intermediate step being a weakened version of quasitoposes. △ Less

Submitted 14 April, 2011; originally announced April 2011.

MSC Class: 03G30 (Primary) 18D05; 18D30 (Secondary)

Nonlinear response of dense colloidal suspensions under oscillatory shear: Mode-coupling theory and FT-rheology experiments

Authors: J. M. Brader, M. Siebenbuerger, M. Ballauff, K. Reinheimer, M. Wilhelm, S. J. Frey, F. Weysser, M. Fuchs

Abstract: Using a combination of theory, experiment and simulation we investigate the nonlinear response of dense colloidal suspensions to large amplitude oscillatory shear flow. The time-dependent stress response is calculated using a recently developed schematic mode-coupling-type theory describing colloidal suspensions under externally applied flow. For finite strain amplitudes the theory generates a non… ▽ More Using a combination of theory, experiment and simulation we investigate the nonlinear response of dense colloidal suspensions to large amplitude oscillatory shear flow. The time-dependent stress response is calculated using a recently developed schematic mode-coupling-type theory describing colloidal suspensions under externally applied flow. For finite strain amplitudes the theory generates a nonlinear response, characterized by significant higher harmonic contributions. An important feature of the theory is the prediction of an ideal glass transition at sufficiently strong coupling, which is accompanied by the discontinuous appearance of a dynamic yield stress. For the oscillatory shear flow under consideration we find that the yield stress plays an important role in determining the non linearity of the time-dependent stress response. Our theoretical findings are strongly supported by both large amplitude oscillatory (LAOS) experiments (with FT-rheology analysis) on suspensions of thermosensitive core-shell particles dispersed in water and Brownian dynamics simulations performed on a two-dimensional binary hard-disc mixture. In particular, theory predicts nontrivial values of the exponents governing the final decay of the storage and loss moduli as a function of strain amplitude which are in excellent agreement with both simulation and experiment. A consistent set of parameters in the presented schematic model achieves to jointly describe linear moduli, nonlinear flow curves and large amplitude oscillatory spectroscopy. △ Less

Submitted 13 October, 2010; originally announced October 2010.

Temperature-dependent refractive index of CaF2 and Infrasil 301

Authors: Douglas B. Leviton, Bradley J. Frey, Timothy J. Madison

Abstract: In order to enable high quality lens designs using calcium fluoride (CaF2) and Heraeus Infrasil 301 (Infrasil) for cryogenic operating temperatures, we have measured the absolute refractive index of these two materials as a function of both wavelength and temperature using the Cryogenic, High-Accuracy Refraction Measuring System (CHARMS) at NASA's Goddard Space Flight Center. For CaF2, we report… ▽ More In order to enable high quality lens designs using calcium fluoride (CaF2) and Heraeus Infrasil 301 (Infrasil) for cryogenic operating temperatures, we have measured the absolute refractive index of these two materials as a function of both wavelength and temperature using the Cryogenic, High-Accuracy Refraction Measuring System (CHARMS) at NASA's Goddard Space Flight Center. For CaF2, we report absolute refractive index and thermo-optic coefficient (dn/dT) at temperatures ranging from 25 to 300 K at wavelengths from 0.4 to 5.6 microns, while for Infrasil, we cover temperatures ranging from 35 to 300 K and wavelengths from 0.4 to 3.6 microns. For CaF2, we compare our index measurements to measurements of other investigators. For Infrasil, we compare our measurements to the material manufacturer's data at room temperature and to cryogenic measurements for fused silica from previous investigations including one of our own. Finally, we provide temperature-dependent Sellmeier coefficients based on our measured data to allow accurate interpolation of index to other wavelengths and temperatures. △ Less

Submitted 1 May, 2008; originally announced May 2008.

Comments: 11 pages

Temperature-dependent absolute refractive index measurements of synthetic fused silica

Authors: Douglas B. Leviton, Bradley J. Frey

Abstract: Using the Cryogenic, High-Accuracy Refraction Measuring System (CHARMS) at NASA's Goddard Space Flight Center, we have measured the absolute refractive index of five specimens taken from a very large boule of Corning 7980 fused silica from temperatures ranging from 30 to 310 K at wavelengths from 0.4 to 2.6 microns with an absolute uncertainty of +/-1 x 10^-5. Statistical variations in derived v… ▽ More Using the Cryogenic, High-Accuracy Refraction Measuring System (CHARMS) at NASA's Goddard Space Flight Center, we have measured the absolute refractive index of five specimens taken from a very large boule of Corning 7980 fused silica from temperatures ranging from 30 to 310 K at wavelengths from 0.4 to 2.6 microns with an absolute uncertainty of +/-1 x 10^-5. Statistical variations in derived values of the thermo-optic coefficient (dn/dT) are at the +/-2 x 10^-8/K level. Graphical and tabulated data for absolute refractive index, dispersion, and thermo-optic coefficient are presented for selected wavelengths and temperatures along with estimates of uncertainty in index. Coefficients for temperature-dependent Sellmeier fits of measured refractive index are also presented to allow accurate interpolation of index to other wavelengths and temperatures. We compare our results to those from an independent investigation (which used an interferometric technique for measuring index changes as a function of temperature) whose samples were prepared from the same slugs of material from which our prisms were prepared in support of the Kepler mission. We also compare our results with sparse cryogenic index data from measurements of this material from the literature. △ Less

Submitted 1 May, 2008; originally announced May 2008.

Comments: 11 pages

High accuracy, absolute, cryogenic refractive index measurements of infrared lens materials for JWST NIRCam using CHARMS

Authors: Douglas B. Leviton, Bradley J. Frey, Todd Kvamme

Abstract: The refractive optical design of the James Webb Space Telescope (JWST) Near Infrared Camera (NIRCam) uses three infrared materials in its lenses: LiF, BaF2, and ZnSe. In order to provide the instrument's optical designers with accurate, heretofore unavailable data for absolute refractive index based on actual cryogenic measurements, two prismatic samples of each material were measured using the… ▽ More The refractive optical design of the James Webb Space Telescope (JWST) Near Infrared Camera (NIRCam) uses three infrared materials in its lenses: LiF, BaF2, and ZnSe. In order to provide the instrument's optical designers with accurate, heretofore unavailable data for absolute refractive index based on actual cryogenic measurements, two prismatic samples of each material were measured using the cryogenic, high accuracy, refraction measuring system (CHARMS) at NASA's Goddard Space Flight Center (GSFC), densely covering the temperature range from 15 to 320 K and wavelength range from 0.4 to 5.6 microns. Data reduction methods are discussed and graphical and tabulated data for absolute refractive index, dispersion, and thermo-optic coefficient for these three materials are presented for selected wavelengths and temperatures along with estimates of index uncertainty. Coefficients for temperature-dependent Sellmeier fits of measured index are also presented with an example of their usage to predict absolute index at any wavelength or temperature within the applicable range of those parameters. △ Less

Submitted 1 May, 2008; originally announced May 2008.

Comments: 12 pages