Let's Ask AI About Their Programs

Description

The dataset includes: 60 small Python programs generated by OpenAI GPT-3.5 (10 functionally correct program variations for each of the selected 6 publicly available introductory programming assignments) 399 program comprehension questions that target the generated programs 798 answers to those questions by OpenAI GPT-3.5 and GPT-4 Researcher annotation on the correctness of each answer and developed codes for the error types In addition, scripts for processing and analyzing the data are included.
Show more

Year of publication

2024

Type of data

Authors

Department of Computer Science

Arto Hellas - Creator

Charles Koutcheme Orcid -palvelun logo - Creator

Teemu Lehtinen Orcid -palvelun logo - Creator

Zenodo - Publisher

Project

Other information

Fields of science

Computer and information sciences

Language

Open access

Open

License

Creative Commons Attribution 4.0 International (CC BY 4.0)

Keywords

Subject headings

Temporal coverage

undefined

Related to this research data