-
XAI for All: Can Large Language Models Simplify Explainable AI?
Authors:
Philip Mavrepis,
Georgios Makridis,
Georgios Fatouros,
Vasileios Koukos,
Maria Margarita Separdani,
Dimosthenis Kyriazis
Abstract:
The field of Explainable Artificial Intelligence (XAI) often focuses on users with a strong technical background, making it challenging for non-experts to understand XAI methods. This paper presents "x-[plAIn]", a new approach to make XAI more accessible to a wider audience through a custom Large Language Model (LLM), developed using ChatGPT Builder. Our goal was to design a model that can generat…
▽ More
The field of Explainable Artificial Intelligence (XAI) often focuses on users with a strong technical background, making it challenging for non-experts to understand XAI methods. This paper presents "x-[plAIn]", a new approach to make XAI more accessible to a wider audience through a custom Large Language Model (LLM), developed using ChatGPT Builder. Our goal was to design a model that can generate clear, concise summaries of various XAI methods, tailored for different audiences, including business professionals and academics. The key feature of our model is its ability to adapt explanations to match each audience group's knowledge level and interests. Our approach still offers timely insights, facilitating the decision-making process by the end users. Results from our use-case studies show that our model is effective in providing easy-to-understand, audience-specific explanations, regardless of the XAI method used. This adaptability improves the accessibility of XAI, bridging the gap between complex AI technologies and their practical applications. Our findings indicate a promising direction for LLMs in making advanced AI concepts more accessible to a diverse range of users.
△ Less
Submitted 23 January, 2024;
originally announced January 2024.
-
Can Large Language Models Beat Wall Street? Unveiling the Potential of AI in Stock Selection
Authors:
Georgios Fatouros,
Konstantinos Metaxas,
John Soldatos,
Dimosthenis Kyriazis
Abstract:
This paper introduces MarketSenseAI, an innovative framework leveraging GPT-4's advanced reasoning for selecting stocks in financial markets. By integrating Chain of Thought and In-Context Learning, MarketSenseAI analyzes diverse data sources, including market trends, news, fundamentals, and macroeconomic factors, to emulate expert investment decision-making. The development, implementation, and v…
▽ More
This paper introduces MarketSenseAI, an innovative framework leveraging GPT-4's advanced reasoning for selecting stocks in financial markets. By integrating Chain of Thought and In-Context Learning, MarketSenseAI analyzes diverse data sources, including market trends, news, fundamentals, and macroeconomic factors, to emulate expert investment decision-making. The development, implementation, and validation of the framework are elaborately discussed, underscoring its capability to generate actionable and interpretable investment signals. A notable feature of this work is employing GPT-4 both as a predictive mechanism and signal evaluator, revealing the significant impact of the AI-generated explanations on signal accuracy, reliability and acceptance. Through empirical testing on the competitive S&P 100 stocks over a 15-month period, MarketSenseAI demonstrated exceptional performance, delivering excess alpha of 10% to 30% and achieving a cumulative return of up to 72% over the period, while maintaining a risk profile comparable to the broader market. Our findings highlight the transformative potential of Large Language Models in financial decision-making, marking a significant leap in integrating generative AI into financial analytics and investment strategies.
△ Less
Submitted 4 April, 2024; v1 submitted 8 January, 2024;
originally announced January 2024.
-
Enhancing Explainability in Mobility Data Science through a combination of methods
Authors:
Georgios Makridis,
Vasileios Koukos,
Georgios Fatouros,
Dimosthenis Kyriazis
Abstract:
In the domain of Mobility Data Science, the intricate task of interpreting models trained on trajectory data, and elucidating the spatio-temporal movement of entities, has persistently posed significant challenges. Conventional XAI techniques, although brimming with potential, frequently overlook the distinct structure and nuances inherent within trajectory data. Observing this deficiency, we intr…
▽ More
In the domain of Mobility Data Science, the intricate task of interpreting models trained on trajectory data, and elucidating the spatio-temporal movement of entities, has persistently posed significant challenges. Conventional XAI techniques, although brimming with potential, frequently overlook the distinct structure and nuances inherent within trajectory data. Observing this deficiency, we introduced a comprehensive framework that harmonizes pivotal XAI techniques: LIME (Local Interpretable Model-agnostic Explanations), SHAP (SHapley Additive exPlanations), Saliency maps, attention mechanisms, direct trajectory visualization, and Permutation Feature Importance (PFI). Unlike conventional strategies that deploy these methods singularly, our unified approach capitalizes on the collective efficacy of these techniques, yielding deeper and more granular insights for models reliant on trajectory data. In crafting this synthesis, we effectively address the multifaceted essence of trajectories, achieving not only amplified interpretability but also a nuanced, contextually rich comprehension of model decisions. To validate and enhance our framework, we undertook a survey to gauge preferences and reception among various user demographics. Our findings underscored a dichotomy: professionals with academic orientations, particularly those in roles like Data Scientist, IT Expert, and ML Engineer, showcased a profound, technical understanding and often exhibited a predilection for amalgamated methods for interpretability. Conversely, end-users or individuals less acquainted with AI and Data Science showcased simpler inclinations, such as bar plots indicating timestep significance or visual depictions pinpointing pivotal segments of a vessel's trajectory.
△ Less
Submitted 1 December, 2023;
originally announced December 2023.
-
XAI for time-series classification leveraging image highlight methods
Authors:
Georgios Makridis,
Georgios Fatouros,
Vasileios Koukos,
Dimitrios Kotios,
Dimosthenis Kyriazis,
Ioannis Soldatos
Abstract:
Although much work has been done on explainability in the computer vision and natural language processing (NLP) fields, there is still much work to be done to explain methods applied to time series as time series by nature can not be understood at first sight. In this paper, we present a Deep Neural Network (DNN) in a teacher-student architecture (distillation model) that offers interpretability i…
▽ More
Although much work has been done on explainability in the computer vision and natural language processing (NLP) fields, there is still much work to be done to explain methods applied to time series as time series by nature can not be understood at first sight. In this paper, we present a Deep Neural Network (DNN) in a teacher-student architecture (distillation model) that offers interpretability in time-series classification tasks. The explainability of our approach is based on transforming the time series to 2D plots and applying image highlight methods (such as LIME and GradCam), making the predictions interpretable. At the same time, the proposed approach offers increased accuracy competing with the baseline model with the trade-off of increasing the training time.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
-
Transforming Sentiment Analysis in the Financial Domain with ChatGPT
Authors:
Georgios Fatouros,
John Soldatos,
Kalliopi Kouroumali,
Georgios Makridis,
Dimosthenis Kyriazis
Abstract:
Financial sentiment analysis plays a crucial role in decoding market trends and guiding strategic trading decisions. Despite the deployment of advanced deep learning techniques and language models to refine sentiment analysis in finance, this study breaks new ground by investigating the potential of large language models, particularly ChatGPT 3.5, in financial sentiment analysis, with a strong emp…
▽ More
Financial sentiment analysis plays a crucial role in decoding market trends and guiding strategic trading decisions. Despite the deployment of advanced deep learning techniques and language models to refine sentiment analysis in finance, this study breaks new ground by investigating the potential of large language models, particularly ChatGPT 3.5, in financial sentiment analysis, with a strong emphasis on the foreign exchange market (forex). Employing a zero-shot prompting approach, we examine multiple ChatGPT prompts on a meticulously curated dataset of forex-related news headlines, measuring performance using metrics such as precision, recall, f1-score, and Mean Absolute Error (MAE) of the sentiment class. Additionally, we probe the correlation between predicted sentiment and market returns as an additional evaluation approach. ChatGPT, compared to FinBERT, a well-established sentiment analysis model for financial texts, exhibited approximately 35\% enhanced performance in sentiment classification and a 36\% higher correlation with market returns. By underlining the significance of prompt engineering, particularly in zero-shot contexts, this study spotlights ChatGPT's potential to substantially boost sentiment analysis in financial applications. By sharing the utilized dataset, our intention is to stimulate further research and advancements in the field of financial services.
△ Less
Submitted 13 August, 2023;
originally announced August 2023.
-
Human-Centric Artificial Intelligence Architecture for Industry 5.0 Applications
Authors:
Jože M. Rožanec,
Inna Novalija,
Patrik Zajec,
Klemen Kenda,
Hooman Tavakoli,
Sungho Suh,
Entso Veliou,
Dimitrios Papamartzivanos,
Thanassis Giannetsos,
Sofia Anna Menesidou,
Ruben Alonso,
Nino Cauli,
Antonello Meloni,
Diego Reforgiato Recupero,
Dimosthenis Kyriazis,
Georgios Sofianidis,
Spyros Theodoropoulos,
Blaž Fortuna,
Dunja Mladenić,
John Soldatos
Abstract:
Human-centricity is the core value behind the evolution of manufacturing towards Industry 5.0. Nevertheless, there is a lack of architecture that considers safety, trustworthiness, and human-centricity at its core. Therefore, we propose an architecture that integrates Artificial Intelligence (Active Learning, Forecasting, Explainable Artificial Intelligence), simulated reality, decision-making, an…
▽ More
Human-centricity is the core value behind the evolution of manufacturing towards Industry 5.0. Nevertheless, there is a lack of architecture that considers safety, trustworthiness, and human-centricity at its core. Therefore, we propose an architecture that integrates Artificial Intelligence (Active Learning, Forecasting, Explainable Artificial Intelligence), simulated reality, decision-making, and users' feedback, focusing on synergies between humans and machines. Furthermore, we align the proposed architecture with the Big Data Value Association Reference Architecture Model. Finally, we validate it on three use cases from real-world case studies.
△ Less
Submitted 19 October, 2022; v1 submitted 21 March, 2022;
originally announced March 2022.
-
PolicyCLOUD: A prototype of a Cloud Serverless Ecosystem for Policy Analytics
Authors:
Ofer Biran,
Oshrit Feder,
Yosef Moatti,
Athanasios Kiourtis,
Dimosthenis Kyriazis,
George Manias,
Argyro Mavrogiorgou,
Nikitas M. Sgouros,
Martim Taborda Barata,
Isabella Oldani,
María Angeles Sanguino,
Pavlos Kranas
Abstract:
We present PolicyCLOUD, a prototype for an extensible, serverless cloud-based system that supports evidence-based elaboration and analysis of policies. PolicyCLOUD allows flexible exploitation and management of policy-relevant dataflows by enabling the practitioner to register datasets and specify a sequence of transformations and/or information extraction through registered ingest functions. Once…
▽ More
We present PolicyCLOUD, a prototype for an extensible, serverless cloud-based system that supports evidence-based elaboration and analysis of policies. PolicyCLOUD allows flexible exploitation and management of policy-relevant dataflows by enabling the practitioner to register datasets and specify a sequence of transformations and/or information extraction through registered ingest functions. Once a possibly transformed dataset has been ingested, additional insights can be retrieved by further applying registered analytic functions. PolicyCLOUD was built as an extensible framework toward the creation of an analytic ecosystem. As of now, we developed several essential ingest and analytic functions that are built-in within the framework. They include data cleaning, enhanced interoperability, and sentiment analysis generic functions. PolicyCLOUD has also the ability to tap on the analytic capabilities of external tools. We demonstrate this with a Social Analytics tool implemented in conjunction with PolicyCLOUD and show how to benefit from policy modeling, design and simulation capabilities. Furthermore, PolicyCLOUD has developed a first of its kind legal and ethical framework that covers the usage and dissemination of datasets and analytic functions throughout its policy-relevant dataflows. The article describes and evaluates the application of PolicyCLOUD to four families of pilots that cover a wide range of policy scenarios.
△ Less
Submitted 16 January, 2022;
originally announced January 2022.
-
A Review of Explainable Artificial Intelligence in Manufacturing
Authors:
Georgios Sofianidis,
Jože M. Rožanec,
Dunja Mladenić,
Dimosthenis Kyriazis
Abstract:
The implementation of Artificial Intelligence (AI) systems in the manufacturing domain enables higher production efficiency, outstanding performance, and safer operations, leveraging powerful tools such as deep learning and reinforcement learning techniques. Despite the high accuracy of these models, they are mostly considered black boxes: they are unintelligible to the human. Opaqueness affects t…
▽ More
The implementation of Artificial Intelligence (AI) systems in the manufacturing domain enables higher production efficiency, outstanding performance, and safer operations, leveraging powerful tools such as deep learning and reinforcement learning techniques. Despite the high accuracy of these models, they are mostly considered black boxes: they are unintelligible to the human. Opaqueness affects trust in the system, a factor that is critical in the context of decision-making. We present an overview of Explainable Artificial Intelligence (XAI) techniques as a means of boosting the transparency of models. We analyze different metrics to evaluate these techniques and describe several application scenarios in the manufacturing domain.
△ Less
Submitted 5 July, 2021;
originally announced July 2021.
-
STARdom: an architecture for trusted and secure human-centered manufacturing systems
Authors:
Jože M. Rožanec,
Patrik Zajec,
Klemen Kenda,
Inna Novalija,
Blaž Fortuna,
Dunja Mladenić,
Entso Veliou,
Dimitrios Papamartzivanos,
Thanassis Giannetsos,
Sofia Anna Menesidou,
Rubén Alonso,
Nino Cauli,
Diego Reforgiato Recupero,
Dimosthenis Kyriazis,
Georgios Sofianidis,
Spyros Theodoropoulos,
John Soldatos
Abstract:
There is a lack of a single architecture specification that addresses the needs of trusted and secure Artificial Intelligence systems with humans in the loop, such as human-centered manufacturing systems at the core of the evolution towards Industry 5.0. To realize this, we propose an architecture that integrates forecasts, Explainable Artificial Intelligence, supports collecting users' feedback,…
▽ More
There is a lack of a single architecture specification that addresses the needs of trusted and secure Artificial Intelligence systems with humans in the loop, such as human-centered manufacturing systems at the core of the evolution towards Industry 5.0. To realize this, we propose an architecture that integrates forecasts, Explainable Artificial Intelligence, supports collecting users' feedback, and uses Active Learning and Simulated Reality to enhance forecasts and provide decision-making recommendations. The architecture security is addressed as a general concern. We align the proposed architecture with the Big Data Value Association Reference Architecture Model. We tailor it for the domain of demand forecasting and validate it on a real-world case study.
△ Less
Submitted 2 April, 2021;
originally announced April 2021.
