-
Empirical research methods for human-computer interaction
Authors:
I. Scott MacKenzie,
Janet C. Read,
Matthew Horton
Abstract:
Most attendees at CHI conferences will agree that an experiment (user study) is the hallmark of good research in human-computer interaction. But what constitutes an experiment? And how does one go from an experiment to a CHI paper? This course will teach how to pose testable research questions, how to make and measure observations, and how to design and conduct an experiment. Specifically, attende…
▽ More
Most attendees at CHI conferences will agree that an experiment (user study) is the hallmark of good research in human-computer interaction. But what constitutes an experiment? And how does one go from an experiment to a CHI paper? This course will teach how to pose testable research questions, how to make and measure observations, and how to design and conduct an experiment. Specifically, attendees will participate in a real experiment to gain experience as both an investigator and as a participant. The second session covers the statistical tools typically used to analyze data. Most notably, attendees will learn how to organize experiment results and write a CHI paper.
△ Less
Submitted 20 April, 2024;
originally announced April 2024.
-
DenResCov-19: A deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays
Authors:
Michail Mamalakis,
Andrew J. Swift,
Bart Vorselaars,
Surajit Ray,
Simonne Weeks,
Wei** Ding,
Richard H. Clayton,
Louise S. Mackenzie,
Abhirup Banerjee
Abstract:
The global pandemic of COVID-19 is continuing to have a significant effect on the well-being of global population, increasing the demand for rapid testing, diagnosis, and treatment. Along with COVID-19, other etiologies of pneumonia and tuberculosis constitute additional challenges to the medical system. In this regard, the objective of this work is to develop a new deep transfer learning pipeline…
▽ More
The global pandemic of COVID-19 is continuing to have a significant effect on the well-being of global population, increasing the demand for rapid testing, diagnosis, and treatment. Along with COVID-19, other etiologies of pneumonia and tuberculosis constitute additional challenges to the medical system. In this regard, the objective of this work is to develop a new deep transfer learning pipeline to diagnose patients with COVID-19, pneumonia, and tuberculosis, based on chest x-ray images. We observed in some instances DenseNet and Resnet have orthogonal performances. In our proposed model, we have created an extra layer with convolutional neural network blocks to combine these two models to establish superior performance over either model. The same strategy can be useful in other applications where two competing networks with complementary performance are observed. We have tested the performance of our proposed network on two-class (pneumonia vs healthy), three-class (including COVID-19), and four-class (including tuberculosis) classification problems. The proposed network has been able to successfully classify these lung diseases in all four datasets and has provided significant improvement over the benchmark networks of DenseNet, ResNet, and Inception-V3. These novel findings can deliver a state-of-the-art pre-screening fast-track decision network to detect COVID-19 and other lung pathologies.
△ Less
Submitted 8 April, 2021;
originally announced April 2021.
-
The Fluid Mechanics of Liquid Democracy
Authors:
Paul Gölz,
Anson Kahng,
Simon Mackenzie,
Ariel D. Procaccia
Abstract:
Liquid democracy is the principle of making collective decisions by letting agents transitively delegate their votes. Despite its significant appeal, it has become apparent that a weakness of liquid democracy is that a small subset of agents may gain massive influence. To address this, we propose to change the current practice by allowing agents to specify multiple delegation options instead of ju…
▽ More
Liquid democracy is the principle of making collective decisions by letting agents transitively delegate their votes. Despite its significant appeal, it has become apparent that a weakness of liquid democracy is that a small subset of agents may gain massive influence. To address this, we propose to change the current practice by allowing agents to specify multiple delegation options instead of just one. Much like in nature, where --- fluid mechanics teaches us --- liquid maintains an equal level in connected vessels, so do we seek to control the flow of votes in a way that balances influence as much as possible. Specifically, we analyze the problem of choosing delegations to approximately minimize the maximum number of votes entrusted to any agent, by drawing connections to the literature on confluent flow. We also introduce a random graph model for liquid democracy, and use it to demonstrate the benefits of our approach both theoretically and empirically.
△ Less
Submitted 6 August, 2018;
originally announced August 2018.
-
The Provable Virtue of Laziness in Motion Planning
Authors:
Nika Haghtalab,
Simon Mackenzie,
Ariel D. Procaccia,
Oren Salzman,
Siddhartha S. Srinivasa
Abstract:
The Lazy Shortest Path (LazySP) class consists of motion-planning algorithms that only evaluate edges along shortest paths between the source and target. These algorithms were designed to minimize the number of edge evaluations in settings where edge evaluation dominates the running time of the algorithm; but how close to optimal are LazySP algorithms in terms of this objective? Our main result is…
▽ More
The Lazy Shortest Path (LazySP) class consists of motion-planning algorithms that only evaluate edges along shortest paths between the source and target. These algorithms were designed to minimize the number of edge evaluations in settings where edge evaluation dominates the running time of the algorithm; but how close to optimal are LazySP algorithms in terms of this objective? Our main result is an analytical upper bound, in a probabilistic model, on the number of edge evaluations required by LazySP algorithms; a matching lower bound shows that these algorithms are asymptotically optimal in the worst case.
△ Less
Submitted 11 October, 2017;
originally announced October 2017.
-
A Discrete and Bounded Envy-Free Cake Cutting Protocol for Any Number of Agents
Authors:
Haris Aziz,
Simon Mackenzie
Abstract:
We consider the well-studied cake cutting problem in which the goal is to find an envy-free allocation based on queries from $n$ agents. The problem has received attention in computer science, mathematics, and economics. It has been a major open problem whether there exists a discrete and bounded envy-free protocol. We resolve the problem by proposing a discrete and bounded envy-free protocol for…
▽ More
We consider the well-studied cake cutting problem in which the goal is to find an envy-free allocation based on queries from $n$ agents. The problem has received attention in computer science, mathematics, and economics. It has been a major open problem whether there exists a discrete and bounded envy-free protocol. We resolve the problem by proposing a discrete and bounded envy-free protocol for any number of agents. The maximum number of queries required by the protocol is $n^{n^{n^{n^{n^n}}}}$. We additionally show that even if we do not run our protocol to completion, it can find in at most $n^3{(n^2)}^n$ queries a partial allocation of the cake that achieves proportionality (each agent gets at least $1/n$ of the value of the whole cake) and envy-freeness. Finally we show that an envy-free partial allocation can be computed in at most $n^3{(n^2)}^n$ queries such that each agent gets a connected piece that gives the agent at least $1/(3n)$ of the value of the whole cake.
△ Less
Submitted 27 August, 2017; v1 submitted 13 April, 2016;
originally announced April 2016.
-
Complexity of Manipulating Sequential Allocation
Authors:
Haris Aziz,
Sylvain Bouveret,
Jerome Lang,
Simon Mackenzie
Abstract:
Sequential allocation is a simple allocation mechanism in which agents are given pre-specified turns and each agents gets the most preferred item that is still available. It has long been known that sequential allocation is not strategyproof.
Bouveret and Lang (2014) presented a polynomial-time algorithm to compute a best response of an agent with respect to additively separable utilities and cl…
▽ More
Sequential allocation is a simple allocation mechanism in which agents are given pre-specified turns and each agents gets the most preferred item that is still available. It has long been known that sequential allocation is not strategyproof.
Bouveret and Lang (2014) presented a polynomial-time algorithm to compute a best response of an agent with respect to additively separable utilities and claimed that (1) their algorithm correctly finds a best response, and (2) each best response results in the same allocation for the manipulator. We show that both claims are false via an example. We then show that in fact the problem of computing a best response is NP-complete. On the other hand, the insights and results of Bouveret and Lang (2014) for the case of two agents still hold.
△ Less
Submitted 22 February, 2016;
originally announced February 2016.
-
A Discrete and Bounded Envy-free Cake Cutting Protocol for Four Agents
Authors:
Haris Aziz,
Simon Mackenzie
Abstract:
We consider the well-studied cake cutting problem in which the goal is to identify a fair allocation based on a minimal number of queries from the agents. The problem has attracted considerable attention within various branches of computer science, mathematics, and economics. Although, the elegant Selfridge-Conway envy-free protocol for three agents has been known since 1960, it has been a major o…
▽ More
We consider the well-studied cake cutting problem in which the goal is to identify a fair allocation based on a minimal number of queries from the agents. The problem has attracted considerable attention within various branches of computer science, mathematics, and economics. Although, the elegant Selfridge-Conway envy-free protocol for three agents has been known since 1960, it has been a major open problem for the last fifty years to obtain a bounded envy-free protocol for more than three agents. We propose a discrete and bounded envy-free protocol for four agents.
△ Less
Submitted 5 April, 2016; v1 submitted 20 August, 2015;
originally announced August 2015.
-
Egalitarianism of Random Assignment Mechanisms
Authors:
Haris Aziz,
Jiashu Chen,
Aris Filos-Ratsikas,
Simon Mackenzie,
Nicholas Mattei
Abstract:
We consider the egalitarian welfare aspects of random assignment mechanisms when agents have unrestricted cardinal utilities over the objects. We give bounds on how well different random assignment mechanisms approximate the optimal egalitarian value and investigate the effect that different well-known properties like ordinality, envy-freeness, and truthfulness have on the achievable egalitarian v…
▽ More
We consider the egalitarian welfare aspects of random assignment mechanisms when agents have unrestricted cardinal utilities over the objects. We give bounds on how well different random assignment mechanisms approximate the optimal egalitarian value and investigate the effect that different well-known properties like ordinality, envy-freeness, and truthfulness have on the achievable egalitarian value. Finally, we conduct detailed experiments analyzing the tradeoffs between efficiency with envy-freeness or truthfulness using two prominent random assignment mechanisms --- random serial dictatorship and the probabilistic serial mechanism --- for different classes of utility functions and distributions.
△ Less
Submitted 24 July, 2015;
originally announced July 2015.
-
On the Number of Minimal Separators in Graphs
Authors:
Serge Gaspers,
Simon Mackenzie
Abstract:
We consider the largest number of minimal separators a graph on n vertices can have at most.
We give a new proof that this number is in $O( ((1+\sqrt{5})/2)^n n )$.
We prove that this number is in $ω( 1.4521^n )$, improving on the previous best lower bound of $Ω(3^{n/3}) \subseteq ω( 1.4422^n )$.
This gives also an improved lower bound on the number of potential maximal cliques in a graph. W…
▽ More
We consider the largest number of minimal separators a graph on n vertices can have at most.
We give a new proof that this number is in $O( ((1+\sqrt{5})/2)^n n )$.
We prove that this number is in $ω( 1.4521^n )$, improving on the previous best lower bound of $Ω(3^{n/3}) \subseteq ω( 1.4422^n )$.
This gives also an improved lower bound on the number of potential maximal cliques in a graph. We would like to emphasize that our proofs are short, simple, and elementary.
△ Less
Submitted 2 April, 2015; v1 submitted 3 March, 2015;
originally announced March 2015.
-
Equilibria Under the Probabilistic Serial Rule
Authors:
Haris Aziz,
Serge Gaspers,
Simon Mackenzie,
Nicholas Mattei,
Nina Narodytska,
Toby Walsh
Abstract:
The probabilistic serial (PS) rule is a prominent randomized rule for assigning indivisible goods to agents. Although it is well known for its good fairness and welfare properties, it is not strategyproof. In view of this, we address several fundamental questions regarding equilibria under PS. Firstly, we show that Nash deviations under the PS rule can cycle. Despite the possibilities of cycles, w…
▽ More
The probabilistic serial (PS) rule is a prominent randomized rule for assigning indivisible goods to agents. Although it is well known for its good fairness and welfare properties, it is not strategyproof. In view of this, we address several fundamental questions regarding equilibria under PS. Firstly, we show that Nash deviations under the PS rule can cycle. Despite the possibilities of cycles, we prove that a pure Nash equilibrium is guaranteed to exist under the PS rule. We then show that verifying whether a given profile is a pure Nash equilibrium is coNP-complete, and computing a pure Nash equilibrium is NP-hard. For two agents, we present a linear-time algorithm to compute a pure Nash equilibrium which yields the same assignment as the truthful profile. Finally, we conduct experiments to evaluate the quality of the equilibria that exist under the PS rule, finding that the vast majority of pure Nash equilibria yield social welfare that is at least that of the truthful profile.
△ Less
Submitted 30 March, 2015; v1 submitted 17 February, 2015;
originally announced February 2015.
-
Manipulating the Probabilistic Serial Rule
Authors:
Haris Aziz,
Serge Gaspers,
Simon Mackenzie,
Nicholas Mattei,
Nina Narodytska,
Toby Walsh
Abstract:
The probabilistic serial (PS) rule is one of the most prominent randomized rules for the assignment problem. It is well-known for its superior fairness and welfare properties. However, PS is not immune to manipulative behaviour by the agents. We initiate the study of the computational complexity of an agent manipulating the PS rule. We show that computing an expected utility better response is NP-…
▽ More
The probabilistic serial (PS) rule is one of the most prominent randomized rules for the assignment problem. It is well-known for its superior fairness and welfare properties. However, PS is not immune to manipulative behaviour by the agents. We initiate the study of the computational complexity of an agent manipulating the PS rule. We show that computing an expected utility better response is NP- hard. On the other hand, we present a polynomial-time algorithm to compute a lexicographic best response. For the case of two agents, we show that even an expected utility best response can be computed in polynomial time. Our result for the case of two agents relies on an interesting connection with sequential allocation of discrete objects.
△ Less
Submitted 26 January, 2015;
originally announced January 2015.
-
Structure and complexity of ex post efficient random assignments
Authors:
Haris Aziz,
Simon Mackenzie,
Lirong Xia,
Chun Ye
Abstract:
In the random assignment problem, objects are randomly assigned to agents kee** in view the agents' preferences over objects. A random assignment specifies the probability of an agent getting an object. We examine the structural and computational aspects of ex post efficiency of random assignments. We first show that whereas an ex post efficient assignment can be computed easily, checking whethe…
▽ More
In the random assignment problem, objects are randomly assigned to agents kee** in view the agents' preferences over objects. A random assignment specifies the probability of an agent getting an object. We examine the structural and computational aspects of ex post efficiency of random assignments. We first show that whereas an ex post efficient assignment can be computed easily, checking whether a given random assignment is ex post efficient is NP-complete. Hence implementing a given random assignment via deterministic Pareto optimal assignments is NP-hard. We then formalize another concept of efficiency called robust ex post efficiency that is weaker than stochastic dominance efficiency but stronger than ex post efficiency. We present a characterization of robust ex post efficiency and show that it can be tested in polynomial time if there are a constant number of agent types. It is shown that the well-known random serial dictatorship rule is not robust ex post efficient. Finally, we show that whereas robust ex post efficiency depends solely on which entries of the assignment matrix are zero/non-zero, ex post efficiency of an assignment depends on the actual values.
△ Less
Submitted 21 September, 2014;
originally announced September 2014.
-
Computational Aspects of Multi-Winner Approval Voting
Authors:
Haris Aziz,
Serge Gaspers,
Joachim Gudmundsson,
Simon Mackenzie,
Nicholas Mattei,
Toby Walsh
Abstract:
We study computational aspects of three prominent voting rules that use approval ballots to elect multiple winners. These rules are satisfaction approval voting, proportional approval voting, and reweighted approval voting. We first show that computing the winner for proportional approval voting is NP-hard, closing a long standing open problem. As none of the rules are strategyproof, even for dich…
▽ More
We study computational aspects of three prominent voting rules that use approval ballots to elect multiple winners. These rules are satisfaction approval voting, proportional approval voting, and reweighted approval voting. We first show that computing the winner for proportional approval voting is NP-hard, closing a long standing open problem. As none of the rules are strategyproof, even for dichotomous preferences, we study various strategic aspects of the rules. In particular, we examine the computational complexity of computing a best response for both a single agent and a group of agents. In many settings, we show that it is NP-hard for an agent or agents to compute how best to vote given a fixed set of approval ballots from the other agents.
△ Less
Submitted 11 July, 2014;
originally announced July 2014.
-
Fair assignment of indivisible objects under ordinal preferences
Authors:
Haris Aziz,
Serge Gaspers,
Simon Mackenzie,
Toby Walsh
Abstract:
We consider the discrete assignment problem in which agents express ordinal preferences over objects and these objects are allocated to the agents in a fair manner. We use the stochastic dominance relation between fractional or randomized allocations to systematically define varying notions of proportionality and envy-freeness for discrete assignments. The computational complexity of checking whet…
▽ More
We consider the discrete assignment problem in which agents express ordinal preferences over objects and these objects are allocated to the agents in a fair manner. We use the stochastic dominance relation between fractional or randomized allocations to systematically define varying notions of proportionality and envy-freeness for discrete assignments. The computational complexity of checking whether a fair assignment exists is studied for these fairness notions. We also characterize the conditions under which a fair assignment is guaranteed to exist. For a number of fairness concepts, polynomial-time algorithms are presented to check whether a fair assignment exists. Our algorithmic results also extend to the case of unequal entitlements of agents. Our NP-hardness result, which holds for several variants of envy-freeness, answers an open question posed by Bouveret, Endriss, and Lang (ECAI 2010). We also propose fairness concepts that always suggest a non-empty set of assignments with meaningful fairness properties. Among these concepts, optimal proportionality and optimal weak proportionality appear to be desirable fairness concepts.
△ Less
Submitted 17 June, 2015; v1 submitted 23 December, 2013;
originally announced December 2013.