-
Correctness Comparison of ChatGPT-4, Gemini, Claude-3, and Copilot for Spatial Tasks
Authors:
Hartwig H. Hochmair,
Levente Juhasz,
Takoda Kemp
Abstract:
Generative AI including large language models (LLMs) has recently gained significant interest in the geo-science community through its versatile task-solving capabilities including programming, arithmetic reasoning, generation of sample data, time-series forecasting, toponym recognition, or image classification. Most existing performance assessments of LLMs for spatial tasks have primarily focused…
▽ More
Generative AI including large language models (LLMs) has recently gained significant interest in the geo-science community through its versatile task-solving capabilities including programming, arithmetic reasoning, generation of sample data, time-series forecasting, toponym recognition, or image classification. Most existing performance assessments of LLMs for spatial tasks have primarily focused on ChatGPT, whereas other chatbots received less attention. To narrow this research gap, this study conducts a zero-shot correctness evaluation for a set of 76 spatial tasks across seven task categories assigned to four prominent chatbots, i.e., ChatGPT-4, Gemini, Claude-3, and Copilot. The chatbots generally performed well on tasks related to spatial literacy, GIS theory, and interpretation of programming code and functions, but revealed weaknesses in map**, code writing, and spatial reasoning. Furthermore, there was a significant difference in correctness of results between the four chatbots. Responses from repeated tasks assigned to each chatbot showed a high level of consistency in responses with matching rates of over 80% for most task categories in the four chatbots.
△ Less
Submitted 1 June, 2024; v1 submitted 4 January, 2024;
originally announced January 2024.
-
ChatGPT as a map** assistant: A novel method to enrich maps with generative AI and content derived from street-level photographs
Authors:
Levente Juhász,
Peter Mooney,
Hartwig H. Hochmair,
Boyuan Guan
Abstract:
This paper explores the concept of leveraging generative AI as a map** assistant for enhancing the efficiency of collaborative map**. We present results of an experiment that combines multiple sources of volunteered geographic information (VGI) and large language models (LLMs). Three analysts described the content of crowdsourced Mapillary street-level photographs taken along roads in a small…
▽ More
This paper explores the concept of leveraging generative AI as a map** assistant for enhancing the efficiency of collaborative map**. We present results of an experiment that combines multiple sources of volunteered geographic information (VGI) and large language models (LLMs). Three analysts described the content of crowdsourced Mapillary street-level photographs taken along roads in a small test area in Miami, Florida. GPT-3.5-turbo was instructed to suggest the most appropriate tagging for each road in OpenStreetMap (OSM). The study also explores the utilization of BLIP-2, a state-of-the-art multimodal pre-training method as an artificial analyst of street-level photographs in addition to human analysts. Results demonstrate two ways to effectively increase the accuracy of map** suggestions without modifying the underlying AI models: by (1) providing a more detailed description of source photographs, and (2) combining prompt engineering with additional context (e.g. location and objects detected along a road). The first approach increases the suggestion accuracy by up to 29%, and the second one by up to 20%.
△ Less
Submitted 15 March, 2024; v1 submitted 5 June, 2023;
originally announced June 2023.
-
'I think I discovered a military base in the middle of the ocean' -- Null Island, the most real of fictional places
Authors:
Levente Juhasz,
Peter Mooney
Abstract:
This paper explores Null Island, a fictional place located at 0$^\circ$ latitude and 0$^\circ$ longitude in the WGS84 geographic coordinate system. Null Island is erroneously associated with large amounts of geographic data in a wide variety of location-based services, place databases, social media and web-based maps. While it was originally considered a joke within the geospatial community, this…
▽ More
This paper explores Null Island, a fictional place located at 0$^\circ$ latitude and 0$^\circ$ longitude in the WGS84 geographic coordinate system. Null Island is erroneously associated with large amounts of geographic data in a wide variety of location-based services, place databases, social media and web-based maps. While it was originally considered a joke within the geospatial community, this article will demonstrate implications of its existence, both technological and social in nature, promoting Null Island as a fundamental issue of geographic information that requires more widespread awareness. The article summarizes error sources that lead to data being associated with Null Island. We identify four evolutionary phases which help explain how this fictional place evolved and established itself as an entity reaching beyond the geospatial profession to the point of being discovered by the visual arts and the general population. After providing an accurate account of data that can be found at (0, 0), geospatial, technological and social implications of Null Island are discussed. Guidelines to avoid misplacing data to Null Island are provided. Since data will likely continue to appear at this location, our contribution is aimed at both GIScientists and the general population to promote awareness of this error source.
△ Less
Submitted 9 August, 2022; v1 submitted 18 April, 2022;
originally announced April 2022.
-
OpenStreetMap data use cases during the early months of the COVID-19 pandemic
Authors:
Peter Mooney,
A. Yair Grinberger,
Marco Minghini,
Serena Coetzee,
Levente Juhasz,
Godwin Yeboah
Abstract:
Created by volunteers since 2004, OpenStreetMap (OSM) is a global geographic database available under an open access license and currently used by a multitude of actors worldwide. This chapter describes the role played by OSM during the early months (from January to July 2020) of the ongoing COVID-19 pandemic, which - in contrast to past disasters and epidemics - is a global event impacting both d…
▽ More
Created by volunteers since 2004, OpenStreetMap (OSM) is a global geographic database available under an open access license and currently used by a multitude of actors worldwide. This chapter describes the role played by OSM during the early months (from January to July 2020) of the ongoing COVID-19 pandemic, which - in contrast to past disasters and epidemics - is a global event impacting both developed and develo** countries. A large number of COVID-19-related OSM use cases were collected and grouped into a number of research frameworks which are analyzed separately: dashboards and services simply using OSM as a basemap, applications using raw OSM data, initiatives to collect new OSM data, imports of authoritative data into OSM, and traditional academic research on OSM in the COVID-19 response. The wealth of examples provided in the chapter, including an analysis of OSM tile usage in two countries (Italy and China) deeply affected in the earliest months of 2020, prove that OSM has been and still is heavily used to address the COVID-19 crisis, although with types and mechanisms that are often different depending on the affected area or country and the related communities.
△ Less
Submitted 4 February, 2022; v1 submitted 6 August, 2020;
originally announced August 2020.
-
Information Propagation in Stochastic Networks
Authors:
Peter Laszlo Juhasz
Abstract:
In this paper, a network-based stochastic information propagation model is developed. The information flow is modeled by a probabilistic differential equation system. The numerical solution of these equations leads to the expected number of informed nodes as a function of time and reveals the relationship between the degrees of the nodes and their reception time. The validity of the model is justi…
▽ More
In this paper, a network-based stochastic information propagation model is developed. The information flow is modeled by a probabilistic differential equation system. The numerical solution of these equations leads to the expected number of informed nodes as a function of time and reveals the relationship between the degrees of the nodes and their reception time. The validity of the model is justified by Monte Carlo network simulation through the analysis of information propagation in scale-free and Erdos-Renyi networks. It has been found that the developed model provides more accurate results compared to the widely used network-based SI mean-field model, especially in sparse networks.
△ Less
Submitted 30 April, 2021; v1 submitted 2 May, 2020;
originally announced May 2020.
-
A Bayesian Approach to Identify Bitcoin Users
Authors:
Péter L. Juhász,
József Stéger,
Dániel Kondor,
Gábor Vattay
Abstract:
Bitcoin is a digital currency and electronic payment system operating over a peer-to-peer network on the Internet. One of its most important properties is the high level of anonymity it provides for its users. The users are identified by their Bitcoin addresses, which are random strings in the public records of transactions, the blockchain. When a user initiates a Bitcoin-transaction, his Bitcoin…
▽ More
Bitcoin is a digital currency and electronic payment system operating over a peer-to-peer network on the Internet. One of its most important properties is the high level of anonymity it provides for its users. The users are identified by their Bitcoin addresses, which are random strings in the public records of transactions, the blockchain. When a user initiates a Bitcoin-transaction, his Bitcoin client program relays messages to other clients through the Bitcoin network. Monitoring the propagation of these messages and analyzing them carefully reveal hidden relations. In this paper, we develop a mathematical model using a probabilistic approach to link Bitcoin addresses and transactions to the originator IP address. To utilize our model, we carried out experiments by installing more than a hundred modified Bitcoin clients distributed in the network to observe as many messages as possible. During a two month observation period we were able to identify several thousand Bitcoin clients and bind their transactions to geographical locations.
△ Less
Submitted 9 March, 2017; v1 submitted 20 December, 2016;
originally announced December 2016.
-
Porous Alumina Based Capacitive MEMS RH Sensor
Authors:
L. Juhasz,
A. Vass-Varnai,
Veronika Timar-Horvath,
Marc Desmulliez,
Resh Dhariwal
Abstract:
The aim of a joint research and development project at the BME and HWU is to produce a cheap, reliable, low-power and CMOS-MEMS process compatible capacitive type relative humidity (RH) sensor that can be incorporated into a state-of-the-art, wireless sensor network. In this paper we discuss the preparation of our new capacitive structure based on post-CMOS MEMS processes and the methods which w…
▽ More
The aim of a joint research and development project at the BME and HWU is to produce a cheap, reliable, low-power and CMOS-MEMS process compatible capacitive type relative humidity (RH) sensor that can be incorporated into a state-of-the-art, wireless sensor network. In this paper we discuss the preparation of our new capacitive structure based on post-CMOS MEMS processes and the methods which were used to characterize the thin film porous alumina sensing layer. The average sensitivity is approx. 15 pF/RH% which is more than a magnitude higher than the values found in the literature. The sensor is equipped with integrated resistive heating, which can be used for maintenance to reduce drift, or for kee** the sensing layer at elevated temperature, as an alternative method for temperature-dependence cancellation.
△ Less
Submitted 7 May, 2008;
originally announced May 2008.
-
Usage of Porous Al2O3 Layers for RH Sensing
Authors:
Veronika Timár-Horváth,
László Juhász,
András Vass-Várnai,
Gergely Perlaky
Abstract:
At the Department of Electron Devices a cheap, more or less CMOS process compatible capacitive type RH sensor has been developed. Capacitive sensors are based on dielectric property changes of thin films upon water vapour uptake which depends on the surrounding media's relative humidity content. Because of the immense surface-to-volume ratio and the abundant void fraction, very high sensitivitie…
▽ More
At the Department of Electron Devices a cheap, more or less CMOS process compatible capacitive type RH sensor has been developed. Capacitive sensors are based on dielectric property changes of thin films upon water vapour uptake which depends on the surrounding media's relative humidity content. Because of the immense surface-to-volume ratio and the abundant void fraction, very high sensitivities can be obtained with porous ceramics. One of the ceramics to be used is porous Al2O3, obtained by electrochemical oxidation of aluminium under anodic bias. The average pore sizes are between 6...9 nm. In our paper we intend to demonstrate images representing the influence of the technological parameters on the porous structure and the device sensitivity.
△ Less
Submitted 21 February, 2008;
originally announced February 2008.
