| Publisher |
GitHub |
| Description |
The data is from an online introductory programming course using Dart language.
The students have varied backgrounds and study from distance. The course is
available at https://fitech101.aalto.fi/fitech101/introduction-to-programming/
in Finnish. For the same reason the programs in this data are likely to include
e.g. variable and function names in Finnish.
The published data includes
* 2 assignments, see TaskDescription-A*.txt
* 5 students in A79 assignment
* 20 students in A81 assignment |
| Resource Type |
URL |
| Data Type |
Programming |
| Creator |
Jeuring, Johan; Keuning, Hieke; Marwan, Samiha; Bouvier, Dennis; Izu, Cruz; Kiesler, Natalie; Lehtinen, Teemu; Lohr, Dominic; Peterson, Andrew; Sarsa, Sami |
| Availability |
open |
| Rights |
CC 4.0 |
| Programming Language |
Dart |
| Collection Start Date |
0 |
| Collection End Date |
0 |
| Publication Year |
2022 |
| Number of Semesters |
1 |
| Data Protection |
Anonymized |
| Measurement Type |
keystroke and other log data from IDE |
| Population |
CS1 |
| Sample Size |
25 |
| Country |
Finland |
| Educational Institution |
Aalto University |
| Data Standard |
0 |
| Learning Environment |
online IDE |
| Aggregation |
yes |
| Aggregation Level |
Keystroke |
| Related Publication |
@inproceedings{10.1145/3571785.3574124,
author = {Jeuring, Johan and Keuning, Hieke and Marwan, Samiha and Bouvier, Dennis and Izu, Cruz and Kiesler, Natalie and Lehtinen, Teemu and Lohr, Dominic and Peterson, Andrew and Sarsa, Sami},
title = {Towards Giving Timely Formative Feedback and Hints to Novice Programmers},
year = {2022},
isbn = {9798400700101},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3571785.3574124},
doi = {10.1145/3571785.3574124},
booktitle = {Proceedings of the 2022 Working Group Reports on Innovation and Technology in Computer Science Education},
pages = {95–115},
numpages = {21},
keywords = {sequences of programming steps, learning programming, learning environments, feedback and hints, automated feedback},
location = {<conf-loc>, <city>Dublin</city>, <country>Ireland</country>, </conf-loc>},
series = {ITiCSE-WGR '22}
} |
| Research Question |
1. How to annotate datasets consisting of steps students take towards solving a programming task within formation about when and how to give feedback and hints? 2. How does expert feedback relate to the feedback found in learning environments for programming? |
| Future Work |
An important contribution of this working group is that we found that there is still much work to be done to determine what kind of feedback to give, how to assess the feedback given by learning environments, and ultimately how to improve these environments. There are several directions for future work. First, since we think the expert-annotated datasets are a very useful resource, we encourage researchers to annotate more data. Second, we want to use the expert-annotated datasets to generalize how experts give feedback and hints on steps students take when working on programming tasks. These insights will be used to describe the design of a system giving automated feedback on student steps. Third, we also want to annotate steps students take when working on slightly larger tasks. Since possibilities to go off track are larger here, we need to think of a method to deal with this, probably involving connecting student steps to subgoals of a task. Fourth, we want to study what kind of feedback students expect at the various steps they take, and how this compares against the feedback specified by experts |
| Fairness Score |
Total score: 27% (initial)
Findability: 2.5 of 7
Accessibility: 1 of 3
Interoperability: 0 of 4
Reusability: 3 of 10 |
| Resource | Open Dataset |
|---|