← Dataset Catalog

FalconCode

Publisher FalconCode
Description FalconCode -a collection of over 1.5 million Python programs from over two thousand undergraduate students capturesoverfivesemestersworthofcodesamplesfromourintroductiontocomputingcourse,whichistakenbyeverystudent regardlessof theiracademicmajor.
Resource Type URL
Data Type students code
Creator Adrian de Freitas; Joel Coffman;Michelle de Freitas;Justin Wilson; Troy Weingart
Availability By request
Programming Language Python
Collection Start Date 0
Collection End Date 0
Publication Year 2022
Number of Semesters 5
Data Protection anonymizes
Measurement Type programming assignments including homework and exam questions
Population CS1 students
Sample Size 2000
Country USA
Educational Institution United States Air Force Academy
Data Standard 0
Learning Environment A python dev environment with custom PythonPackage Index(PyPI)
Aggregation yes
Aggregation Level code snapshots
Related Publication @inproceedings{10.1145/3545945.3569822, author = {de Freitas, Adrian and Coffman, Joel and de Freitas, Michelle and Wilson, Justin and Weingart, Troy}, title = {FalconCode: A Multiyear Dataset of Python Code Samples from an Introductory Computer Science Course}, year = {2023}, isbn = {9781450394314}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3545945.3569822}, doi = {10.1145/3545945.3569822}, abstract = {The lack of large and diverse datasets of student code samples limits some forms of computer science education research. To address this problem, we created FalconCode, a novel collection of over 1.5 million Python programs from over two thousand undergraduate students at the United States Air Force Academy. FalconCode captures over five semesters worth of code samples from our introduction to computing course, which is taken by every student regardless of their academic major. The dataset contains student code submissions for over 800 programming assignments, as well as additional metadata such as the prompt for each assignment, the testcase(s) used to evaluate student submissions, and the specific skills needed to solve each problem. In this paper, we describe the methodology used to create FalconCode and the steps taken to anonymize the data. We then describe FalconCode's data schema, and show how it can support a wide range of research---including those utilizing machine learning (ML) and artificial intelligence (AI). FalconCode is provided free-of-charge, and is available upon request for computer science education research.}, booktitle = {Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1}, pages = {938–944}, numpages = {7}, keywords = {computer science education, dataset, student code repository}, location = {Toronto ON, Canada}, series = {SIGCSE 2023} }
Research Question gather frequent snapshots of student CS1 codes, anonymize it and add it to dataset to be reused by other researchers
Future Work further enhance data processing pipeline to generate even more metadata for each student submission. Collect programs written in languages such as C and C#,which are used in subsequent programming courses
Fairness Score Total score: 4% (initial) Findability: 1 of 7 Accessibility: 0 of 3 Interoperability: 0 of 4 Reusability: 0 of 10
ResourceOpen Dataset