On Optimizing Human-Machine Task Assignments
Authors:
Andreas Veit,
Michael Wilber,
Rajan Vaish,
Serge Belongie,
James Davis,
Vishal Anand,
Anshu Aviral,
Prithvijit Chakrabarty,
Yash Chandak,
Sidharth Chaturvedi,
Chinmaya Devaraj,
Ankit Dhall,
Utkarsh Dwivedi,
Sanket Gupte,
Sharath N. Sridhar,
Karthik Paga,
Anuj Pahuja,
Aditya Raisinghani,
Ayush Sharma,
Shweta Sharma,
Darpana Sinha,
Nisarg Thakkar,
K. Bala Vignesh,
Utkarsh Verma,
Kanniganti Abhishek
, et al. (26 additional authors not shown)
Abstract:
When crowdsourcing systems are used in combination with machine inference systems in the real world, they benefit the most when the machine system is deeply integrated with the crowd workers. However, if researchers wish to integrate the crowd with "off-the-shelf" machine classifiers, this deep integration is not always possible. This work explores two strategies to increase accuracy and decrease…
▽ More
When crowdsourcing systems are used in combination with machine inference systems in the real world, they benefit the most when the machine system is deeply integrated with the crowd workers. However, if researchers wish to integrate the crowd with "off-the-shelf" machine classifiers, this deep integration is not always possible. This work explores two strategies to increase accuracy and decrease cost under this setting. First, we show that reordering tasks presented to the human can create a significant accuracy improvement. Further, we show that greedily choosing parameters to maximize machine accuracy is sub-optimal, and joint optimization of the combined system improves performance.
△ Less
Submitted 24 September, 2015;
originally announced September 2015.
A Lookahead algorithm to compute Betweenness Centrality
Authors:
B Vignesh,
Siddharth S,
Shridhar Ramachandran,
Dr. Sudarshan Iyengar,
Dr. C Pandu Rangan
Abstract:
The Betweenness Centrality index is a very important centrality measure in the analysis of a large number of networks. Despite its significance in a lot of interdisciplinary applications, its computation is very expensive. The fastest known algorithm presently is by Brandes which takes O(|V || E|) time for computation. In real life scenarios, it happens very frequently that a single vertex or a se…
▽ More
The Betweenness Centrality index is a very important centrality measure in the analysis of a large number of networks. Despite its significance in a lot of interdisciplinary applications, its computation is very expensive. The fastest known algorithm presently is by Brandes which takes O(|V || E|) time for computation. In real life scenarios, it happens very frequently that a single vertex or a set of vertices is sequentially removed from a network. The recomputation of Betweenness Centrality on removing a single vertex becomes expensive when the Brandes algorithm is repeated. It is to be understood that as the size of the network increases, Betweenness Centrality calculation becomes more and more expensive and even a decrease in running time by a small fraction results in a phenomenal decrease in the actual running time. The algorithm introduced in this paper achieves the same in a significantly lesser time than repetition of the Brandes algorithm. The algorithm can also be extended to a general case.
△ Less
Submitted 11 July, 2012; v1 submitted 16 August, 2011;
originally announced August 2011.
