-
Pre-trained Transformer Uncovers Meaningful Patterns in Human Mobility Data
Authors:
Alameen Najjar
Abstract:
We empirically demonstrate that a transformer pre-trained on country-scale unlabeled human mobility data learns embeddings capable, through fine-tuning, of develo** a deep understanding of the target geography and its corresponding mobility patterns. Utilizing an adaptation framework, we evaluate the performance of our pre-trained embeddings in encapsulating a broad spectrum of concepts directly…
▽ More
We empirically demonstrate that a transformer pre-trained on country-scale unlabeled human mobility data learns embeddings capable, through fine-tuning, of develo** a deep understanding of the target geography and its corresponding mobility patterns. Utilizing an adaptation framework, we evaluate the performance of our pre-trained embeddings in encapsulating a broad spectrum of concepts directly and indirectly related to human mobility. This includes basic notions, such as geographic location and distance, and extends to more complex constructs, such as administrative divisions and land cover. Our extensive empirical analysis reveals a substantial performance boost gained from pre-training, reaching up to 38% in tasks such as tree-cover regression. We attribute this result to the ability of the pre-training to uncover meaningful patterns hidden in the raw data, beneficial for modeling relevant high-level concepts. The pre-trained embeddings emerge as robust representations of regions and trajectories, potentially valuable for a wide range of downstream applications.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
Towards A Foundation Model For Trajectory Intelligence
Authors:
Alameen Najjar
Abstract:
We present the results of training a large trajectory model using real-world user check-in data. Our approach follows a pre-train and fine-tune paradigm, where a base model is pre-trained via masked trajectory modeling and then adapted through fine-tuning for various downstream tasks. To address challenges posed by noisy data and large spatial vocabularies, we propose a novel spatial tokenization…
▽ More
We present the results of training a large trajectory model using real-world user check-in data. Our approach follows a pre-train and fine-tune paradigm, where a base model is pre-trained via masked trajectory modeling and then adapted through fine-tuning for various downstream tasks. To address challenges posed by noisy data and large spatial vocabularies, we propose a novel spatial tokenization block. Our empirical analysis utilizes a comprehensive dataset of over 2 billion check-ins generated by more than 6 million users. Through fine-tuning on 3 downstream tasks we demonstrate that our base model has effectively learned valuable underlying patterns in raw data, enabling its application in meaningful trajectory intelligence tasks. Despite some limitations, we believe this work represents an important step forward in the realization of a foundation model for trajectory intelligence.
△ Less
Submitted 29 November, 2023;
originally announced December 2023.
-
Phase-Based Breathing Rate Monitoring in Patient Rooms Using 6G Terahertz Technology
Authors:
Simon Haeger,
Akram Najjar,
Caner Bektas,
Dien Lessy,
Mohammed El-Absi,
Fawad Sheikh,
Stefan Boecker,
Thomas Kaiser,
Christian Wietfeld
Abstract:
The 6G standard aims to be an integral part of the future economy by providing high-performance communication and sensing services. At terahertz (THz) frequencies, indoor campus networks can offer the highest sensing quality. Health monitoring in hospitals is expected to be an application site for these. This work outlines a monostatic phase-based system for breathing rate monitoring. Our feasibil…
▽ More
The 6G standard aims to be an integral part of the future economy by providing high-performance communication and sensing services. At terahertz (THz) frequencies, indoor campus networks can offer the highest sensing quality. Health monitoring in hospitals is expected to be an application site for these. This work outlines a monostatic phase-based system for breathing rate monitoring. Our feasibility study observes motion measurement accuracy down to the micrometer level. However, we also find that the patient's pose needs to be considered for generalized applicability. Thus, a solution that leverages multiple propagation paths and beam orientations is proposed.
△ Less
Submitted 14 June, 2023; v1 submitted 25 May, 2023;
originally announced May 2023.
-
Where You Are Is What You Do: On Inferring Offline Activities From Location Data
Authors:
Alameen Najjar,
Kyle Mede
Abstract:
In this paper we investigate the ability of modern machine learning algorithms in inferring basic offline activities,~e.g., shop** and dining, from location data. Using anonymized data of thousands of users of a prominent location-based social network, we empirically demonstrate that not only state-of-the-art machine learning excels at the task at hand~(F1 score>0.9) but also tabular models are…
▽ More
In this paper we investigate the ability of modern machine learning algorithms in inferring basic offline activities,~e.g., shop** and dining, from location data. Using anonymized data of thousands of users of a prominent location-based social network, we empirically demonstrate that not only state-of-the-art machine learning excels at the task at hand~(F1 score>0.9) but also tabular models are among the best performers. The findings we report here not only fill an existing gap in the literature, but also highlight the potential risks of such capabilities given the ubiquity of location data and the high accessibility of tabular machine learning models.
△ Less
Submitted 25 September, 2023; v1 submitted 31 January, 2023;
originally announced January 2023.
-
Trajectory-User Linking Is Easier Than You Think
Authors:
Alameen Najjar,
Kyle Mede
Abstract:
Trajectory-User Linking (TUL) is a relatively new mobility classification task in which anonymous trajectories are linked to the users who generated them. With applications ranging from personalized recommendations to criminal activity detection, TUL has received increasing attention over the past five years. While research has focused mainly on learning deep representations that capture complex s…
▽ More
Trajectory-User Linking (TUL) is a relatively new mobility classification task in which anonymous trajectories are linked to the users who generated them. With applications ranging from personalized recommendations to criminal activity detection, TUL has received increasing attention over the past five years. While research has focused mainly on learning deep representations that capture complex spatio-temporal mobility patterns unique to individual users, we demonstrate that visit patterns are highly unique among users and thus simple heuristics applied directly to the raw data are sufficient to solve TUL. More specifically, we demonstrate that a single check-in per trajectory is enough to correctly predict the identity of the user up to 85% of the time. Moreover, by using a non-parametric classifier, we scale up TUL to over 100k users which is an increase over state-of-the-art by three orders of magnitude. Extensive empirical analysis on four real-world datasets (Brightkite, Foursquare, Gowalla and Weeplaces) compares our findings to state-of-the-art results, and more importantly validates our claim that TUL is easier than commonly believed.
△ Less
Submitted 14 December, 2022;
originally announced December 2022.
-
Rethinking Trust in Social Robotics
Authors:
Rachele Carli,
Amro Najjar
Abstract:
In 2018 the European Commission highlighted the demand of a human-centered approach to AI. Such a claim is gaining even more relevance considering technologies specifically designed to directly interact and physically collaborate with human users in the real world. This is notably the case of social robots. The domain of Human-Robot Interaction (HRI) emerged to investigate these issues. "Human-rob…
▽ More
In 2018 the European Commission highlighted the demand of a human-centered approach to AI. Such a claim is gaining even more relevance considering technologies specifically designed to directly interact and physically collaborate with human users in the real world. This is notably the case of social robots. The domain of Human-Robot Interaction (HRI) emerged to investigate these issues. "Human-robot trust" has been highlighted as one of the most challenging and intriguing factors influencing HRI. On the one hand, user studies and technical experts underline how trust is a key element to facilitate users' acceptance, consequently increasing the chances to pursue the given task. On the other hand, such a phenomenon raises also ethical and philosophical concerns leading scholars in these domains to argue that humans should not trust robots. However, trust in HRI is not an index of fragility, it is rooted in anthropomorphism, and it is a natural characteristic of every human being. Thus, instead of focusing solely on how to inspire user trust in social robots, this paper argues that what should be investigated is to what extent and for which purpose it is suitable to trust robots. Such an endeavour requires an interdisciplinary approach taking into account (i) technical needs and (ii) psychological implications.
△ Less
Submitted 14 September, 2021;
originally announced September 2021.
-
Explanations of Black-Box Model Predictions by Contextual Importance and Utility
Authors:
Sule Anjomshoae,
Kary Främling,
Amro Najjar
Abstract:
The significant advances in autonomous systems together with an immensely wider application domain have increased the need for trustable intelligent systems. Explainable artificial intelligence is gaining considerable attention among researchers and developers to address this requirement. Although there is an increasing number of works on interpretable and transparent machine learning algorithms,…
▽ More
The significant advances in autonomous systems together with an immensely wider application domain have increased the need for trustable intelligent systems. Explainable artificial intelligence is gaining considerable attention among researchers and developers to address this requirement. Although there is an increasing number of works on interpretable and transparent machine learning algorithms, they are mostly intended for the technical users. Explanations for the end-user have been neglected in many usable and practical applications. In this work, we present the Contextual Importance (CI) and Contextual Utility (CU) concepts to extract explanations that are easily understandable by experts as well as novice users. This method explains the prediction results without transforming the model into an interpretable one. We present an example of providing explanations for linear and non-linear models to demonstrate the generalizability of the method. CI and CU are numerical values that can be represented to the user in visuals and natural language form to justify actions and explain reasoning for individual instances, situations, and contexts. We show the utility of explanations in car selection example and Iris flower classification by presenting complete (i.e. the causes of an individual prediction) and contrastive explanation (i.e. contrasting instance against the instance of interest). The experimental results show the feasibility and validity of the provided explanation methods.
△ Less
Submitted 30 May, 2020;
originally announced June 2020.
-
Ethics of Food Recommender Applications
Authors:
Daniel Karpati,
Amro Najjar,
Diego Agustin Ambrossio
Abstract:
The recent unprecedented popularity of food recommender applications has raised several issues related to the ethical, societal and legal implications of relying on these applications. In this paper, in order to assess the relevant ethical issues, we rely on the emerging principles across the AI\&Ethics community and define them tailored context specifically. Considering the popular Food Recommend…
▽ More
The recent unprecedented popularity of food recommender applications has raised several issues related to the ethical, societal and legal implications of relying on these applications. In this paper, in order to assess the relevant ethical issues, we rely on the emerging principles across the AI\&Ethics community and define them tailored context specifically. Considering the popular Food Recommender Systems (henceforth F-RS) in the European market cannot be regarded as personalised F-RS, we show how merely this lack of feature shifts the relevance of the focal ethical concerns. We identify the major challenges and propose a scheme for how explicit ethical agendas should be explained. We also argue how a multi-stakeholder approach is indispensable to ensure producing long-term benefits for all stakeholders. After proposing eight ethical desiderata points for F-RS, we present a case-study and assess it based on our proposed desiderata points.
△ Less
Submitted 2 February, 2020;
originally announced February 2020.
-
Towards Explainability for a Civilian UAV Fleet Management using an Agent-based Approach
Authors:
Yazan Mualla,
Amro Najjar,
Timotheus Kampik,
Igor Tchappi,
Stéphane Galland,
Christophe Nicolle
Abstract:
This paper presents an initial design concept and specification of a civilian Unmanned Aerial Vehicle (UAV) management simulation system that focuses on explainability for the human-in-the-loop control of semi-autonomous UAVs. The goal of the system is to facilitate the operator intervention in critical scenarios (e.g. avoid safety issues or financial risks). Explainability is supported via user-f…
▽ More
This paper presents an initial design concept and specification of a civilian Unmanned Aerial Vehicle (UAV) management simulation system that focuses on explainability for the human-in-the-loop control of semi-autonomous UAVs. The goal of the system is to facilitate the operator intervention in critical scenarios (e.g. avoid safety issues or financial risks). Explainability is supported via user-friendly abstractions on Belief-Desire-Intention agents. To evaluate the effectiveness of the system, a human-computer interaction study is proposed.
△ Less
Submitted 22 September, 2019;
originally announced September 2019.
-
Crime Map** from Satellite Imagery via Deep Learning
Authors:
Alameen Najjar,
Shun'ichi Kaneko,
Yoshikazu Miyanaga
Abstract:
Ensuring urban safety is an essential part of develo** sustainable cities. An urban safety map can assist cities to prevent future crimes. However, map** is costly in terms of both time and money due to the need for manual data collection. On the other hand, satellite imagery is becoming increasingly abundant and accessible with higher resolution. Given the outstanding success deep learning ha…
▽ More
Ensuring urban safety is an essential part of develo** sustainable cities. An urban safety map can assist cities to prevent future crimes. However, map** is costly in terms of both time and money due to the need for manual data collection. On the other hand, satellite imagery is becoming increasingly abundant and accessible with higher resolution. Given the outstanding success deep learning has achieved in the field of computer vision and pattern recognition over the past 5 years, in this paper we attempt to investigate the use of deep learning to predict crime rate directly from raw satellite imagery. To this end, we have trained a deep Convolutional Neural Network on satellite images obtained from over one million crime-incident reports collected by the Chicago Police Department. The best performing model predicted crime rate from raw satellite imagery with an accuracy of 79%. To test their reusability, we used the learned Chicago models to predict for the cities of Denver and San Francisco city-scale maps indicating crime rate in three different levels. Compared to maps made from years' worth of data collected by the corresponding police departments, our maps have an accuracy of 72% and 70%, respectively.
△ Less
Submitted 17 December, 2018;
originally announced December 2018.
-
Towards Refactoring of DMARF and GIPSY Case Studies -- A Team 5 SOEN6471-S14 Project Report
Authors:
Pavan Kumar Polu,
Amjad Al Najjar,
Biswajit Banik,
Ajay Sujit Kumar,
Gustavo Pereira,
Prince Japhlet,
Bhanu Prakash R.,
Sabari Krishna Raparla
Abstract:
This paper presents an analysis of the architectural design of two distributed open source systems (OSS) developed in Java: Distributed Modular Audio Recognition Framework (DMARF) and General Intensional Programming System (GIPSY). The research starts with a background study of these frameworks to determine their overall architectures. Afterwards, we identify the actors and stakeholders and draft…
▽ More
This paper presents an analysis of the architectural design of two distributed open source systems (OSS) developed in Java: Distributed Modular Audio Recognition Framework (DMARF) and General Intensional Programming System (GIPSY). The research starts with a background study of these frameworks to determine their overall architectures. Afterwards, we identify the actors and stakeholders and draft a domain model for each framework. Next, we evaluated and proposed a fused DMARF over GIPSY Run-time Architecture (DoGRTA) as a domain concept. Later on, the team extracted and studied the actual class diagrams and determined classes of interest. Next, we identified design patterns that were present within the code of each framework. Finally, code smells in the source code were detected using popular tools and a selected number of those identified smells were refactored using established techniques and implemented in the final source code. Tests were written and ran prior and after the refactoring to check for any behavioral changes.
△ Less
Submitted 23 December, 2014;
originally announced December 2014.
