-
Improving the Reporting of Threats to Construct Validity
Authors:
Dag I. K. Sjøberg,
Gunnar R. Bergersen
Abstract:
Background: Construct validity concerns the use of indicators to measure a concept that is not directly measurable. Aim: This study intends to identify, categorize, assess and quantify discussions of threats to construct validity in empirical software engineering literature and use the findings to suggest ways to improve the reporting of construct validity issues. Method: We analyzed 83 articles t…
▽ More
Background: Construct validity concerns the use of indicators to measure a concept that is not directly measurable. Aim: This study intends to identify, categorize, assess and quantify discussions of threats to construct validity in empirical software engineering literature and use the findings to suggest ways to improve the reporting of construct validity issues. Method: We analyzed 83 articles that report human-centric experiments published in five top-tier software engineering journals from 2015 to 2019. The articles' text concerning threats to construct validity was divided into segments (the unit of analysis) based on predefined categories. The segments were then evaluated regarding whether they clearly discussed a threat and a construct. Results: Three-fifths of the segments were associated with topics not related to construct validity. Two-thirds of the articles discussed construct validity without using the definition of construct validity given in the article. The threats were clearly described in more than four-fifths of the segments, but the construct in question was clearly described in only two-thirds of the segments. The construct was unclear when the discussion was not related to construct validity but to other types of validity. Conclusions: The results show potential for improving the understanding of construct validity in software engineering. Recommendations addressing the identified weaknesses are given to improve the awareness and reporting of CV.
△ Less
Submitted 8 June, 2023;
originally announced June 2023.
-
The Price of Using Students
Authors:
Dag I. K. Sjøberg,
Gunnar R. Bergersen
Abstract:
In a recent article, Falessi et al. (2017) call for a deeper understanding of the pros and cons of using students and professionals in experiments. The authors state: we have observed too many times that our papers were rejected because we used students as subjects. Good experiments with students are certainly a valuable asset in the body of research in software engineering. Papers should thus not…
▽ More
In a recent article, Falessi et al. (2017) call for a deeper understanding of the pros and cons of using students and professionals in experiments. The authors state: we have observed too many times that our papers were rejected because we used students as subjects. Good experiments with students are certainly a valuable asset in the body of research in software engineering. Papers should thus not be rejected solely on the ground that the subjects are students. However, the distribution in skill is different for students and professionals. Since previous studies have shown that skill may have a moderating effect on the treatment of participants, we are concerned that studies involving developers with only low to medium skill (i.e., students) may result in wrong inferences about which technology, method or tool is better in the software industry. We therefore provide suggestions for how experiments with students can be improved and also comment on some of the alleged drawbacks of using professionals that Falessi et al. point out.
△ Less
Submitted 28 November, 2018; v1 submitted 25 October, 2018;
originally announced October 2018.
-
Daily Stand-Up Meetings: Start Breaking the Rules
Authors:
Viktoria Stray,
Nils Brede Moe,
Dag I. K. Sjøberg
Abstract:
Members of high performing software teams collaborate, exchange information and coordinate their work on a frequent, regular basis. Most teams have the daily stand-up meeting as a central venue for these activities. Although this kind of meeting is one of the most popular agile practices, it has received little attention from researchers. We observed 102 daily stand-ups and interviewed 60 members…
▽ More
Members of high performing software teams collaborate, exchange information and coordinate their work on a frequent, regular basis. Most teams have the daily stand-up meeting as a central venue for these activities. Although this kind of meeting is one of the most popular agile practices, it has received little attention from researchers. We observed 102 daily stand-ups and interviewed 60 members of 15 teams in five countries. We found that the practice is usually challenging to conduct in a way that benefits the whole team. Many team members have a negative experience from conducting the meeting, which reduces job satisfaction, co-worker trust and well-being. However, the practice can be adjusted and improved to empower teams. In this article, we describe key factors that affect the meeting and propose four recommendations for improving the practice.
△ Less
Submitted 23 August, 2018;
originally announced August 2018.
-
C-ITS Deployment in Europe - Current Status and Outlook
Authors:
Katrin Sjöberg,
Peter Andres,
Teodor Buburuzan,
Achim Brakemeier
Abstract:
Cooperative Intelligent Transport Systems (C-ITS) refers to applications using vehicle-to-vehicle and vehicle-to-infrastructure communications at a carrier frequency of 5.9 GHz to increase road traffic safety and road traffic efficiency in Europe (a.k.a. connected vehicle technology in the US). This article will shed some light on the current status of C-ITS in Europe and what is left before deplo…
▽ More
Cooperative Intelligent Transport Systems (C-ITS) refers to applications using vehicle-to-vehicle and vehicle-to-infrastructure communications at a carrier frequency of 5.9 GHz to increase road traffic safety and road traffic efficiency in Europe (a.k.a. connected vehicle technology in the US). This article will shed some light on the current status of C-ITS in Europe and what is left before deployment can commence in 2019 as announced by C2C-CC. Even though there is an immense activity for the launch of C-ITS in Europe, the automotive industry is also planning for the future.
△ Less
Submitted 16 January, 2017; v1 submitted 13 September, 2016;
originally announced September 2016.
-
A Measurement Based Shadow Fading Model for Vehicle-to-Vehicle Network Simulations
Authors:
Taimoor Abbas,
Katrin Sjöberg,
Johan Karedal,
Fredrik Tufvesson
Abstract:
The vehicle-to-vehicle (V2V) propagation channel has significant implications on the design and performance of novel communication protocols for vehicular ad hoc networks (VANETs). Extensive research efforts have been made to develop V2V channel models to be implemented in advanced VANET system simulators for performance evaluation. The impact of shadowing caused by other vehicles has, however, la…
▽ More
The vehicle-to-vehicle (V2V) propagation channel has significant implications on the design and performance of novel communication protocols for vehicular ad hoc networks (VANETs). Extensive research efforts have been made to develop V2V channel models to be implemented in advanced VANET system simulators for performance evaluation. The impact of shadowing caused by other vehicles has, however, largely been neglected in most of the models, as well as in the system simulations. In this paper we present a shadow fading model targeting system simulations based on real measurements performed in urban and highway scenarios. The measurement data is separated into three categories, line-of-sight (LOS), obstructed line-of-sight (OLOS) by vehicles, and non line-of-sight due to buildings, with the help of video information recorded during the measurements. It is observed that vehicles obstructing the LOS induce an additional average attenuation of about 10 dB in the received signal power. An approach to incorporate the LOS/OLOS model into existing VANET simulators is also provided. Finally, system level VANET simulation results are presented, showing the difference between the LOS/OLOS model and a channel model based on Nakagami-m fading.
△ Less
Submitted 17 February, 2015; v1 submitted 13 March, 2012;
originally announced March 2012.
