Skip to main content

Showing 1–17 of 17 results for author: Bogart, C

.
  1. arXiv:2404.18262  [pdf, other

    cs.AI

    Generating Situated Reflection Triggers about Alternative Solution Paths: A Case Study of Generative AI for Computer-Supported Collaborative Learning

    Authors: Atharva Naik, Jessica Ruhan Yin, Anusha Kamath, Qianou Ma, Sherry Tongshuang Wu, Charles Murray, Christopher Bogart, Majd Sakr, Carolyn P. Rose

    Abstract: An advantage of Large Language Models (LLMs) is their contextualization capability - providing different responses based on student inputs like solution strategy or prior discussion, to potentially better engage students than standard feedback. We present a design and evaluation of a proof-of-concept LLM application to offer students dynamic and contextualized feedback. Specifically, we augment an… ▽ More

    Submitted 28 April, 2024; originally announced April 2024.

  2. arXiv:2312.03173  [pdf, other

    cs.CY cs.AI cs.CL

    A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education

    Authors: Jacob Doughty, Zipiao Wan, Anishka Bompelli, Jubahed Qayum, Taozhi Wang, Juran Zhang, Yujia Zheng, Aidan Doyle, Pragnya Sridhar, Arav Agarwal, Christopher Bogart, Eric Keylor, Can Kultur, Jaromir Savelka, Majd Sakr

    Abstract: There is a constant need for educators to develop and maintain effective up-to-date assessments. While there is a growing body of research in computing education on utilizing large language models (LLMs) in generation and engagement with coding exercises, the use of LLMs for generating programming MCQs has not been extensively explored. We analyzed the capability of GPT-4 to produce multiple-choic… ▽ More

    Submitted 5 December, 2023; originally announced December 2023.

  3. arXiv:2311.09518  [pdf, other

    cs.CY

    From GPT-3 to GPT-4: On the Evolving Efficacy of LLMs to Answer Multiple-choice Questions for Programming Classes in Higher Education

    Authors: Jaromir Savelka, Arav Agarwal, Christopher Bogart, Majd Sakr

    Abstract: We explore the evolving efficacy of three generative pre-trained transformer (GPT) models in generating answers for multiple-choice questions (MCQ) from introductory and intermediate Python programming courses in higher education. We focus on the differences in capabilities of the models prior to the release of ChatGPT (Nov '22), at the time of the release, and today (i.e., Aug '23). Recent studie… ▽ More

    Submitted 15 November, 2023; originally announced November 2023.

    Comments: arXiv admin note: text overlap with arXiv:2303.08033, arXiv:2306.10073

  4. arXiv:2306.17459  [pdf, other

    cs.AI cs.CL

    Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectives

    Authors: Pragnya Sridhar, Aidan Doyle, Arav Agarwal, Christopher Bogart, Jaromir Savelka, Majd Sakr

    Abstract: We evaluated the capability of a generative pre-trained transformer (GPT-4) to automatically generate high-quality learning objectives (LOs) in the context of a practically oriented university course on Artificial Intelligence. Discussions of opportunities (e.g., content generation, explanation) and risks (e.g., cheating) of this emerging technology in education have intensified, but to date there… ▽ More

    Submitted 30 June, 2023; originally announced June 2023.

  5. arXiv:2306.10073  [pdf, other

    cs.CY cs.AI cs.CL cs.SE

    Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses

    Authors: Jaromir Savelka, Arav Agarwal, Marshall An, Chris Bogart, Majd Sakr

    Abstract: This paper studies recent developments in large language models' (LLM) abilities to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. The emergence of ChatGPT resulted in heated debates of its potential uses (e.g., exercise generation, code explanation) as well as misuses in programming classes (e.g., cheating). Recent studies show that while… ▽ More

    Submitted 15 June, 2023; originally announced June 2023.

    Journal ref: ICER '23: Proceedings of the 2023 ACM Conference on International Computing Education Research - Volume 1. August 2023. Pages 78 - 92

  6. arXiv:2304.04873  [pdf

    cs.HC

    SocioEconomicMag Meets a Platform for SES-Diverse College Students: A Case Study

    Authors: Puja Agarwal, Divya Prem, Christopher Bogart, Abrar Fallatah, Aileen Abril Castro-Guzman, Pannapat Chanpaisaeng, Stella Doehring, Margaret Burnett, Anita Sarma

    Abstract: Emerging research shows that individual differences in how people use technology sometimes cluster by socioeconomic status (SES) and that when technology is not socioeconomically inclusive, low-SES individuals may abandon it. To understand how to improve technology's SES-inclusivity, we present a multi-phase case study on SocioEconomicMag (SESMag), an emerging inspection method for socio+economic… ▽ More

    Submitted 10 April, 2023; originally announced April 2023.

    Comments: 26 pages, 7 figures

  7. Can Generative Pre-trained Transformers (GPT) Pass Assessments in Higher Education Programming Courses?

    Authors: Jaromir Savelka, Arav Agarwal, Christopher Bogart, Yifan Song, Majd Sakr

    Abstract: We evaluated the capability of generative pre-trained transformers (GPT), to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. Discussions of potential uses (e.g., exercise generation, code explanation) and misuses (e.g., cheating) of this emerging technology in programming education have intensified, but to date there has not been a rigorous… ▽ More

    Submitted 16 March, 2023; originally announced March 2023.

    Comments: 7 pages. arXiv admin note: text overlap with arXiv:2303.08033

    Journal ref: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V.1 (ITiCSE 2023) 117-123

  8. arXiv:2303.08033  [pdf, other

    cs.CL cs.AI

    Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code

    Authors: Jaromir Savelka, Arav Agarwal, Christopher Bogart, Majd Sakr

    Abstract: We analyzed effectiveness of three generative pre-trained transformer (GPT) models in answering multiple-choice question (MCQ) assessments, often involving short snippets of code, from introductory and intermediate programming courses at the postsecondary level. This emerging technology stirs countless discussions of its potential uses (e.g., exercise generation, code explanation) as well as misus… ▽ More

    Submitted 9 March, 2023; originally announced March 2023.

    Comments: 12 pages

  9. arXiv:2201.10643  [pdf, other

    cs.HC cs.AI

    Intersectionality Goes Analytical: Taming Combinatorial Explosion Through Type Abstraction

    Authors: Margaret Burnett, Martin Erwig, Abrar Fallatah, Christopher Bogart, Anita Sarma

    Abstract: HCI researchers' and practitioners' awareness of intersectionality has been expanding, producing knowledge, recommendations, and prototypes for supporting intersectional populations. However, doing intersectional HCI work is uniquely expensive: it leads to a combinatorial explosion of empirical work (expense 1), and little of the work on one intersectional population can be leveraged to serve anot… ▽ More

    Submitted 25 January, 2022; originally announced January 2022.

  10. arXiv:2107.00218  [pdf

    cs.SE

    Comparing Example-Based Collaborative Reflection to Problem Solving Practice for Learning during Team-Based Software Engineering Projects

    Authors: Sreecharan Sankaranarayanan, Siddharth Reddy Kandimalla, Christopher Bogart, R. Charles Murray, Haokang An, Michael Hilton, Majd Sakr, Carolyn Rosé

    Abstract: Contributing to the literature on aptitude-treatment interactions between worked examples and problem-solving, this paper addresses differential learning from the two approaches when students are positioned as domain experts learning new concepts. Our evaluation is situated in a team project that is part of an advanced software engineering course. In this course, students who possess foundational… ▽ More

    Submitted 1 July, 2021; originally announced July 2021.

    Comments: 4 pages, 1 image, 1 table, 14th Computer Supported Collaborative Learning (CSCL) Proceedings at the Annual Meeting of the International Society of the Learning Sciences (ISLS)

    Journal ref: 14th Computer-Supported Collaborative Learning Proceedings at the Annual Meeting of the International Society of the Learning Sciences 2021, pp. 213-216

  11. arXiv:2103.12304  [pdf, ps, other

    cs.SE cs.CR

    Tracing Vulnerable Code Lineage

    Authors: David Reid, Kalvin Eng, Chris Bogart, Adam Tutko

    Abstract: This paper presents results from the MSR 2021 Hackathon. Our team investigates files/projects that contain known security vulnerabilities and how widespread they are throughout repositories in open source software. These security vulnerabilities can potentially be propagated through code reuse even when the vulnerability is fixed in different versions of the code. We utilize the World of Code infr… ▽ More

    Submitted 23 March, 2021; originally announced March 2021.

  12. arXiv:2012.05987  [pdf

    cs.SE cs.SI

    Guiding Development Work Across a Software Ecosystem by Visualizing Usage Data

    Authors: Christopher Bogart, James Howison, James Herbsleb

    Abstract: Software is increasingly produced in the form of ecosystems, collections of interdependent components maintained by a distributed community. These ecosystems act as network organizations, not markets, and thus often lack actionable price-like signals about how the software is used and what impact it has. We introduce a tool, the Scientific Software Network Map, that collects and displays summarize… ▽ More

    Submitted 10 December, 2020; originally announced December 2020.

    Comments: 12 pages, 2 figures; written in 2015

    ACM Class: D.2; H.5.3

  13. arXiv:2010.16196  [pdf, other

    cs.SE

    World of Code: Enabling a Research Workflow for Mining and Analyzing the Universe of Open Source VCS data

    Authors: Yuxing Ma, Tapajit Dey, Chris Bogart, Sadika Amreen, Marat Valiev, Adam Tutko, David Kennard, Russell Zaretzki, Audris Mockus

    Abstract: Open source software (OSS) is essential for modern society and, while substantial research has been done on individual (typically central) projects, only a limited understanding of the periphery of the entire OSS ecosystem exists. For example, how are the tens of millions of projects in the periphery interconnected through. technical dependencies, code sharing, or knowledge flow? To answer such qu… ▽ More

    Submitted 30 October, 2020; originally announced October 2020.

  14. arXiv:1901.03363  [pdf, other

    cs.SE

    ALFAA: Active Learning Fingerprint Based Anti-Aliasing for Correcting Developer Identity Errors in Version Control Data

    Authors: Sadika Amreen, Audris Mockus, Chris Bogart, Yuxia Zhang, Russell Zaretzki

    Abstract: Graphs of developer networks are important for software engineering research and practice. For these graphs to realistically represent the networks, accurate developer identities are imperative. We aim to identify developer identity errors from open source software repositories in VCS, investigate the nature of these errors, design corrective algorithms, and estimate the impact of the errors on ne… ▽ More

    Submitted 10 January, 2019; originally announced January 2019.

    Comments: 12 pages

  15. arXiv:1801.05366  [pdf, ps, other

    cs.SE

    Debugging Framework Applications: Benefits and Challenges

    Authors: Zack Coker, David Gray Widder, Claire Le Goues, Christopher Bogart, Joshua Sunshine

    Abstract: Aspects of frameworks, such as inversion of control and the structure of framework applications, require developers to adjust their debugging strategies as compared to debugging sequential programs. However, the benefits and challenges of framework debugging are not fully understood, and gaining this knowledge could provide guidance in debugging strategies and framework tool design. To gain insigh… ▽ More

    Submitted 16 January, 2018; originally announced January 2018.

    Comments: 10 pages

  16. arXiv:1707.04546  [pdf, other

    cs.CL cs.SI

    Linguistic Markers of Influence in Informal Interactions

    Authors: Shrimai Prabhumoye, Samridhi Choudhary, Evangelia Spiliopoulou, Christopher Bogart, Carolyn Penstein Rose, Alan W Black

    Abstract: There has been a long standing interest in understanding `Social Influence' both in Social Sciences and in Computational Linguistics. In this paper, we present a novel approach to study and measure interpersonal influence in daily interactions. Motivated by the basic principles of influence, we attempt to identify indicative linguistic features of the posts in an online knitting community. We pres… ▽ More

    Submitted 14 July, 2017; originally announced July 2017.

    Comments: 10 pages, Accepted in NLP+CSS workshop for ACL (Association for Computational Linguistics) 2017

  17. arXiv:1409.7133  [pdf, ps, other

    math.CO

    Superlinear subset partition graphs with dimension reduction, strong adjacency, and endpoint count

    Authors: Tristram C. Bogart, Edward D. Kim

    Abstract: We construct a sequence of subset partition graphs satisfying the dimension reduction, adjacency, strong adjacency, and endpoint count properties whose diameter has a superlinear asymptotic lower bound. These abstractions of polytope graphs give further evidence against the Linear Hirsch Conjecture.

    Submitted 23 September, 2015; v1 submitted 24 September, 2014; originally announced September 2014.

    Comments: 24 pages, 6 figures, to appear in Combinatorica

    MSC Class: 05B40; 05C12; 52B05; 90C05