-
Exploring patient trust in clinical advice from AI-driven LLMs like ChatGPT for self-diagnosis
Authors:
Delong Du,
Richard Paluch,
Gunnar Stevens,
Claudia Müller
Abstract:
Trustworthy clinical advice is crucial but burdensome when seeking health support from professionals. Inaccessibility and financial burdens present obstacles to obtaining professional clinical advice, even when healthcare is available. Consequently, individuals often resort to self-diagnosis, utilizing medical materials to validate the health conditions of their families and friends. However, the…
▽ More
Trustworthy clinical advice is crucial but burdensome when seeking health support from professionals. Inaccessibility and financial burdens present obstacles to obtaining professional clinical advice, even when healthcare is available. Consequently, individuals often resort to self-diagnosis, utilizing medical materials to validate the health conditions of their families and friends. However, the convenient method of self-diagnosis requires a commitment to learning and is often not effective, presenting risks when individuals seek self-care approaches or treatment strategies without professional guidance. Artificial Intelligence (AI), supported by Large Language Models (LLM), may become a powerful yet risky self-diagnosis tool for clinical advice due to the hallucination of LLM, where it produces inaccurate yet deceiving information. Thus, can we trust the clinical advice from AI-driven LLMs like ChatGPT like ChatGPT4 for self-diagnosis? We examined this issue through a think-aloud observation: a patient uses GPT4 for self-diagnosis and clinical advice while a doctor assesses ChatGPT responses with their own expertise. After that, we conducted a semi-structured interview with the patient to understand their trust in AI-driven LLMs for clinical advice. we have concluded that the confounding factors influencing a patient's trust revolve around their competency-evaluation. Essentially, trust is equated with efficacy, which is determined by whether decisions made based on the AI agent's clinical advice and suggestion will effectively achieve the patient health goals. Patients tend to trust doctors more than AI agents due to this strategy, believing that educated, authorized doctors can provide effective medical guidance. This competency-based trust also explains why patients often perceive more experienced doctors as more trustworthy compared to less experienced ones.
△ Less
Submitted 2 February, 2024;
originally announced February 2024.
-
Heteromated Decision-Making: Integrating Socially Assistive Robots in Care Relationships
Authors:
Richard Paluch,
Tanja Aal,
Katerina Cerna,
Dave Randall,
Claudia Müller
Abstract:
Technological development continues to advance, with consequences for the use of robots in health care. For this reason, this workshop contribution aims at consideration of how socially assistive robots can be integrated into care and what tasks they can take on. This also touches on the degree of autonomy of these robots and the balance of decision support and decision making in different situati…
▽ More
Technological development continues to advance, with consequences for the use of robots in health care. For this reason, this workshop contribution aims at consideration of how socially assistive robots can be integrated into care and what tasks they can take on. This also touches on the degree of autonomy of these robots and the balance of decision support and decision making in different situations. We want to show that decision making by robots is mediated by the balance between autonomy and safety. Our results are based on Design Fiction and Zine-Making workshops we conducted with scientific experts. Ultimately, we show that robots' actions take place in social groups. A robot does not typically decide alone, but its decision-making is embedded in group processes. The concept of heteromation, which describes the interconnection of human and machine actions, offers fruitful possibilities for exploring how robots can be integrated into caring relationships.
△ Less
Submitted 20 April, 2023;
originally announced April 2023.
-
Impact of network topology changes on information source localization
Authors:
Piotr Machura,
Robert Paluch
Abstract:
Well-established methods of locating the source of information in a complex network are usually derived with the assumption of complete and exact knowledge of network topology. We study the performance of three such algorithms (LPTVA, GMLA and Pearson correlation algorithm) in scenarios that do not fulfill this assumption by modifying the network prior to localization. This is done by adding super…
▽ More
Well-established methods of locating the source of information in a complex network are usually derived with the assumption of complete and exact knowledge of network topology. We study the performance of three such algorithms (LPTVA, GMLA and Pearson correlation algorithm) in scenarios that do not fulfill this assumption by modifying the network prior to localization. This is done by adding superfluous new links, hiding existing ones, or reattaching links in accordance with the network's structural Hamiltonian. We find that GMLA is highly resilient to the addition of superfluous edges, as its precision falls by more than statistical uncertainty only when the number of links is approximately doubled. On the other hand, if the edge set is underestimated or reattachment has taken place, the performance of GMLA drops significantly. In such a scenario the Pearson algorithm is preferable, retaining most of its performance when other simulation parameters favor localization (high density of observers, highly deterministic propagation). It is also generally more accurate than LPTVA, as well as orders of magnitude faster. The aforementioned differences between localization algorithms can be intuitively explained, although a need for further theoretical research is noted.
△ Less
Submitted 26 October, 2022;
originally announced October 2022.
-
Locating the source of interacting signal in complex networks
Authors:
Robert Paluch,
Krzysztof Suchecki,
Janusz A. Hołyst
Abstract:
We investigate the problem of locating the source of a self-interacting signal spreading in a complex networks. We use a well-known rumour model as an example of the process with self-interaction. According to this model based on the SIR epidemic dynamics, the infected nodes may interact and discourage each other from gossi** with probability $α$. We compare three algorithms of source localizati…
▽ More
We investigate the problem of locating the source of a self-interacting signal spreading in a complex networks. We use a well-known rumour model as an example of the process with self-interaction. According to this model based on the SIR epidemic dynamics, the infected nodes may interact and discourage each other from gossi** with probability $α$. We compare three algorithms of source localization: Limited Pinto-Thiran-Vettarli (LPTV), Gradient Maximum Likelihood (GMLA) and one based on Pearson correlation between time and distance. The results of numerical simulations show that additional interactions between infected nodes decrease the quality of LPTV and Pearson. GMLA is the most resistant to harmful effects of the self-interactions, which is especially visible for medium and high level of stochasticity of the process, when spreading rate is below 0.5. The reason for this may be the fact that GMLA uses only the nearest observers, which are much less likely affected by the interactions between infected nodes, because these contacts become important as the epidemics develops and the number of infected agents increases.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Source location on multilayer networks
Authors:
Robert Paluch,
Łukasz G. Gajewski,
K. Suchecki,
Janusz A. Hołyst
Abstract:
Nowadays it is not uncommon to have to deal with dissemination on multi-layered networks and often finding the source of said propagation can be a crucial task. In this paper we tackle this exact problem with a maximum likelihood approach that we extend to be operational on multi-layered graphs. We test our method for source location estimation on synthetic networks and outline its potential stren…
▽ More
Nowadays it is not uncommon to have to deal with dissemination on multi-layered networks and often finding the source of said propagation can be a crucial task. In this paper we tackle this exact problem with a maximum likelihood approach that we extend to be operational on multi-layered graphs. We test our method for source location estimation on synthetic networks and outline its potential strengths and limitations. We also observe some non-trivial and perhaps surprising phenomena where the more of the system one observes the worse the results become whereas increased problem complexity in the form of more layers can actually improve our performance.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Optimizing sensors placement in complex networks for localization of hidden signal source: A review
Authors:
Robert Paluch,
Łukasz G. Gajewski,
Janusz A. Hołyst,
Boleslaw K. Szymanski
Abstract:
As the world becomes more and more interconnected, our everyday objects become part of the Internet of Things, and our lives get more and more mirrored in virtual reality, where every piece of~information, including misinformation, fake news and malware, can spread very fast practically anonymously. To suppress such uncontrolled spread, efficient computer systems and algorithms capable to~track do…
▽ More
As the world becomes more and more interconnected, our everyday objects become part of the Internet of Things, and our lives get more and more mirrored in virtual reality, where every piece of~information, including misinformation, fake news and malware, can spread very fast practically anonymously. To suppress such uncontrolled spread, efficient computer systems and algorithms capable to~track down such malicious information spread have to be developed. Currently, the most effective methods for source localization are based on sensors which provide the times at which they detect the~spread. We investigate the problem of the optimal placement of such sensors in complex networks and propose a new graph measure, called Collective Betweenness, which we compare against four other metrics. Extensive numerical tests are performed on different types of complex networks over the wide ranges of densities of sensors and stochasticities of signal. In these tests, we discovered clear difference in comparative performance of the investigated optimal placement methods between real or scale-free synthetic networks versus narrow degree distribution networks. The former have a clear region for any given method's dominance in contrast to the latter where the performance maps are less homogeneous. We find that while choosing the best method is very network and spread dependent, there are two methods that consistently stand out. High Variance Observers seem to do very well for spread with low stochasticity whereas Collective Betwenness, introduced in this paper, thrives when the spread is highly unpredictable.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Models of random graph hierarchies
Authors:
Robert Paluch,
Krzysztof Suchecki,
Janusz Holyst
Abstract:
We introduce two models of inclusion hierarchies: Random Graph Hierarchy (RGH) and Limited Random Graph Hierarchy (LRGH). In both models a set of nodes at a given hierarchy level is connected randomly, as in the Erdős-Rényi random graph, with a fixed average degree equal to a system parameter $c$. Clusters of the resulting network are treated as nodes at the next hierarchy level and they are conne…
▽ More
We introduce two models of inclusion hierarchies: Random Graph Hierarchy (RGH) and Limited Random Graph Hierarchy (LRGH). In both models a set of nodes at a given hierarchy level is connected randomly, as in the Erdős-Rényi random graph, with a fixed average degree equal to a system parameter $c$. Clusters of the resulting network are treated as nodes at the next hierarchy level and they are connected again at this level and so on, until the process cannot continue. In the RGH model we use all clusters, including those of size $1$, when building the next hierarchy level, while in the LRGH model clusters of size $1$ stop participating in further steps. We find that in both models the number of nodes at a given hierarchy level $h$ decreases approximately exponentially with $h$. The height of the hierarchy $H$, i.e. the number of all hierarchy levels, increases logarithmically with the system size $N$, i.e. with the number of nodes at the first level. The height $H$ decreases monotonically with the connectivity parameter $c$ in the RGH model and it reaches a maximum for a certain $c_{max}$ in the LRGH model. The distribution of separate cluster sizes in the LRGH model is a power law with an exponent about $-1.25$. The above results follow from approximate analytical calculations and have been confirmed by numerical simulations.
△ Less
Submitted 31 July, 2015; v1 submitted 5 May, 2015;
originally announced May 2015.
