-
Photonic Quantum Policy Learning in OpenAI Gym
Authors:
Dániel Nagy,
Zsolt Tabi,
Péter Hága,
Zsófia Kallus,
Zoltán Zimborás
Abstract:
In recent years, near-term noisy intermediate scale quantum (NISQ) computing devices have become available. One of the most promising application areas to leverage such NISQ quantum computer prototypes is quantum machine learning. While quantum neural networks are widely studied for supervised learning, quantum reinforcement learning is still just an emerging field of this area. To solve a classic…
▽ More
In recent years, near-term noisy intermediate scale quantum (NISQ) computing devices have become available. One of the most promising application areas to leverage such NISQ quantum computer prototypes is quantum machine learning. While quantum neural networks are widely studied for supervised learning, quantum reinforcement learning is still just an emerging field of this area. To solve a classical continuous control problem, we use a continuous-variable quantum machine learning approach. We introduce proximal policy optimization for photonic variational quantum agents and also study the effect of the data re-uploading. We present performance assessment via empirical study using Strawberry Fields, a photonic simulator Fock backend and a hybrid training framework connected to an OpenAI Gym environment and TensorFlow. For the restricted CartPole problem, the two variations of the photonic policy learning achieve comparable performance levels and a faster convergence than the baseline classical neural network of same number of trainable parameters.
△ Less
Submitted 29 August, 2021;
originally announced August 2021.
-
Video Pandemics: Worldwide Viral Spreading of Psy's Gangnam Style Video
Authors:
Zsofia Kallus,
Daniel Kondor,
Jozsef Steger,
Istvan Csabai,
Eszter Bokanyi,
Gabor Vattay
Abstract:
Viral videos can reach global penetration traveling through international channels of communication similarly to real diseases starting from a well-localized source. In past centuries, disease fronts propagated in a concentric spatial fashion from the the source of the outbreak via the short range human contact network. The emergence of long-distance air-travel changed these ancient patterns. Howe…
▽ More
Viral videos can reach global penetration traveling through international channels of communication similarly to real diseases starting from a well-localized source. In past centuries, disease fronts propagated in a concentric spatial fashion from the the source of the outbreak via the short range human contact network. The emergence of long-distance air-travel changed these ancient patterns. However, recently, Brockmann and Helbing have shown that concentric propagation waves can be reinstated if propagation time and distance is measured in the flight-time and travel volume weighted underlying air-travel network. Here, we adopt this method for the analysis of viral meme propagation in Twitter messages, and define a similar weighted network distance in the communication network connecting countries and states of the World. We recover a wave-like behavior on average and assess the randomizing effect of non-locality of spreading. We show that similar result can be recovered from Google Trends data as well.
△ Less
Submitted 14 July, 2017;
originally announced July 2017.
-
Regional properties of global communication as reflected in aggregated Twitter data
Authors:
Zsofia Kallus,
Norbert Barankai,
Daniel Kondor,
Laszlo Dobos,
Tamas Hanyecz,
Janos Szule,
Jozsef Steger,
Tamas Sebok,
Gabor Vattay,
Istvan Csabai
Abstract:
Twitter is a popular public conversation platform with world-wide audience and diverse forms of connections between users. In this paper we introduce the concept of aggregated regional Twitter networks in order to characterize communication between geopolitical regions. We present the study of a follower and a mention graph created from an extensive data set collected during the second half of the…
▽ More
Twitter is a popular public conversation platform with world-wide audience and diverse forms of connections between users. In this paper we introduce the concept of aggregated regional Twitter networks in order to characterize communication between geopolitical regions. We present the study of a follower and a mention graph created from an extensive data set collected during the second half of the year of $2012$. With a k-shell decomposition the global core-periphery structure is revealed and by means of a modified Regional-SIR model we also consider basic information spreading properties.
△ Less
Submitted 6 November, 2013;
originally announced November 2013.
-
Using Robust PCA to estimate regional characteristics of language use from geo-tagged Twitter messages
Authors:
Dániel Kondor,
István Csabai,
László Dobos,
János Szüle,
Norbert Barankai,
Tamás Hanyecz,
Tamás Sebők,
Zsófia Kallus,
Gábor Vattay
Abstract:
Principal component analysis (PCA) and related techniques have been successfully employed in natural language processing. Text mining applications in the age of the online social media (OSM) face new challenges due to properties specific to these use cases (e.g. spelling issues specific to texts posted by users, the presence of spammers and bots, service announcements, etc.). In this paper, we emp…
▽ More
Principal component analysis (PCA) and related techniques have been successfully employed in natural language processing. Text mining applications in the age of the online social media (OSM) face new challenges due to properties specific to these use cases (e.g. spelling issues specific to texts posted by users, the presence of spammers and bots, service announcements, etc.). In this paper, we employ a Robust PCA technique to separate typical outliers and highly localized topics from the low-dimensional structure present in language use in online social networks. Our focus is on identifying geospatial features among the messages posted by the users of the Twitter microblogging service. Using a dataset which consists of over 200 million geolocated tweets collected over the course of a year, we investigate whether the information present in word usage frequencies can be used to identify regional features of language use and topics of interest. Using the PCA pursuit method, we are able to identify important low-dimensional features, which constitute smoothly varying functions of the geographic location.
△ Less
Submitted 5 November, 2013;
originally announced November 2013.
-
A multi-terabyte relational database for geo-tagged social network data
Authors:
László Dobos,
János Szüle,
Tamás Bodnár,
Tamás Hanyecz,
Tamás Sebők,
Dániel Kondor,
Zsófia Kallus,
József Stéger,
István Csabai,
Gábor Vattay
Abstract:
Despite their relatively low sampling factor, the freely available, randomly sampled status streams of Twitter are very useful sources of geographically embedded social network data. To statistically analyze the information Twitter provides via these streams, we have collected a year's worth of data and built a multi-terabyte relational database from it. The database is designed for fast data load…
▽ More
Despite their relatively low sampling factor, the freely available, randomly sampled status streams of Twitter are very useful sources of geographically embedded social network data. To statistically analyze the information Twitter provides via these streams, we have collected a year's worth of data and built a multi-terabyte relational database from it. The database is designed for fast data loading and to support a wide range of studies focusing on the statistics and geographic features of social networks, as well as on the linguistic analysis of tweets. In this paper we present the method of data collection, the database design, the data loading procedure and special treatment of geo-tagged and multi-lingual data. We also provide some SQL recipes for computing network statistics.
△ Less
Submitted 5 November, 2013; v1 submitted 4 November, 2013;
originally announced November 2013.