-
Trends in Practical Student Peer-review
Authors:
Helen C. Purchase,
John Hamer
Abstract:
While much of the literature on student peer-review focusses on the success (or otherwise) of individual activities in specific classes (often implemented as part of scholarly research projects) there is little by way of published data giving an overview of the range and variety of such activities as used in practice. As the creators, administrators and maintainers of the Aropa Peer review tool, w…
▽ More
While much of the literature on student peer-review focusses on the success (or otherwise) of individual activities in specific classes (often implemented as part of scholarly research projects) there is little by way of published data giving an overview of the range and variety of such activities as used in practice. As the creators, administrators and maintainers of the Aropa Peer review tool, we have unique access to meta-information about peer-review assessments conducted in classes in institutions across the world, together with the variety of class sizes, subjects, rubric design etc. We reported on some of the key assessment configuration data in a 2018 publication covering a period of eight years; here we provide an update on this data, five years later, with particular comment on trends, academic discipline coverage and the possible effect of online delivery during the COVID-19 pandemic.
△ Less
Submitted 1 January, 2024;
originally announced January 2024.
-
On the Perception of Small Sub-graphs
Authors:
Jacob Miller,
Mohammad Ghoniem,
Hsiang-Yun Wu,
Helen C. Purchase
Abstract:
Interpreting a node-link graph is enhanced if similar subgraphs (or motifs) are depicted in a similar manner; that is, they have the same visual form. Small motifs within graphs may be perceived to be identical when they are structurally dissimilar, or may be perceived to be dissimilar when they are identical. This issue primarily relates to the Gestalt principle of similarity, but may also includ…
▽ More
Interpreting a node-link graph is enhanced if similar subgraphs (or motifs) are depicted in a similar manner; that is, they have the same visual form. Small motifs within graphs may be perceived to be identical when they are structurally dissimilar, or may be perceived to be dissimilar when they are identical. This issue primarily relates to the Gestalt principle of similarity, but may also include an element of quick, low-level pattern-matching. We believe that if motifs are identical, they should be depicted identically; if they are nearly-identical, they should be depicted nearly-identically. This principle is particularly important in domains where motifs hold meaning and where their identification is important. We identified five small motifs: bi-cliques, cliques, cycles, double-cycles, and stars. For each, we defined visual variations on two dimensions: same or different structure, same or different shape. We conducted a crowd-sourced empirical study to test the perception of similarity of these varied motifs, and found that determining whether motifs are identical or similar is affected by both shape and structure.
△ Less
Submitted 9 August, 2023; v1 submitted 7 August, 2023;
originally announced August 2023.
-
Extending adjacency matrices to 3D with triangles
Authors:
Rusheng Pan,
Helen C. Purchase,
Tim Dwyer,
Wei Chen
Abstract:
Social networks are the fabric of society and the subject of frequent visual analysis. Closed triads represent triangular relationships between three people in a social network and are significant for understanding inherent interconnections and influence within the network. The most common methods for representing social networks (node-link diagrams and adjacency matrices) are not optimal for unde…
▽ More
Social networks are the fabric of society and the subject of frequent visual analysis. Closed triads represent triangular relationships between three people in a social network and are significant for understanding inherent interconnections and influence within the network. The most common methods for representing social networks (node-link diagrams and adjacency matrices) are not optimal for understanding triangles. We propose extending the adjacency matrix form to 3D for better visualization of network triads. We design a 3D matrix reordering technique and implement an immersive interactive system to assist in visualizing and analyzing closed triads in social networks. A user study and usage scenarios demonstrate that our method provides substantial added value over node-link diagrams in improving the efficiency and accuracy of manipulating and understanding the social network triads.
△ Less
Submitted 19 February, 2024; v1 submitted 13 June, 2023;
originally announced June 2023.
-
The Turing Test for Graph Drawing Algorithms
Authors:
Helen C. Purchase,
Daniel Archambault,
Stephen Kobourov,
Martin Nöllenburg,
Sergey Pupyrev,
Hsiang-Yun Wu
Abstract:
Do algorithms for drawing graphs pass the Turing Test? That is, are their outputs indistinguishable from graphs drawn by humans? We address this question through a human-centred experiment, focusing on `small' graphs, of a size for which it would be reasonable for someone to choose to draw the graph manually. Overall, we find that hand-drawn layouts can be distinguished from those generated by gra…
▽ More
Do algorithms for drawing graphs pass the Turing Test? That is, are their outputs indistinguishable from graphs drawn by humans? We address this question through a human-centred experiment, focusing on `small' graphs, of a size for which it would be reasonable for someone to choose to draw the graph manually. Overall, we find that hand-drawn layouts can be distinguished from those generated by graph drawing algorithms, although this is not always the case for graphs drawn by force-directed or multi-dimensional scaling algorithms, making these good candidates for Turing Test success. We show that, in general, hand-drawn graphs are judged to be of higher quality than automatically generated ones, although this result varies with graph size and algorithm.
△ Less
Submitted 19 August, 2020; v1 submitted 11 August, 2020;
originally announced August 2020.
-
Exploring the Limits of Complexity: A Survey of Empirical Studies on Graph Visualisation
Authors:
Vahan Yoghourdjian,
Daniel Archambault,
Stephan Diehl,
Tim Dwyer,
Karsten Klein,
Helen C. Purchase,
Hsiang-Yun Wu
Abstract:
For decades, researchers in information visualisation and graph drawing have focused on develo** techniques for the layout and display of very large and complex networks. Experiments involving human participants have also explored the readability of different styles of layout and representations for such networks. In both bodies of literature, networks are frequently referred to as being 'large'…
▽ More
For decades, researchers in information visualisation and graph drawing have focused on develo** techniques for the layout and display of very large and complex networks. Experiments involving human participants have also explored the readability of different styles of layout and representations for such networks. In both bodies of literature, networks are frequently referred to as being 'large' or 'complex', yet these terms are relative. From a human-centred, experiment point-of-view, what constitutes 'large' (for example) depends on several factors, such as data complexity, visual complexity, and the technology used. In this paper, we survey the literature on human-centred experiments to understand how, in practice, different features and characteristics of node-link diagrams affect visual complexity.
△ Less
Submitted 1 September, 2018;
originally announced September 2018.
