Annex 2: Example of an evaluation instrument: Post-survey

Q196 The course has ended. We would like to thank you for your participation and contribution to its success! We are very interested to know about your experience during this course. With your feedback we can improve our courses, and enable more people to access, enjoy, and complete them.

This survey should only take 5-10 minutes to complete. Participation is completely voluntary and all information will be treated confidentially.

The data will be reported only in aggregate form and no individual will be identified. Your answers here, combined with your edX course data, will be used for evaluation purposes, and potentially in scientific research related to online education, which is why we need your permission.

Please feel free to contact us if you have specific questions about this survey, by sending an email to eduanalytics@tudelft.nl.

Thank you very much for helping us improve our courses!

Q198 This survey is in accordance with the edX Privacy Policy.

Q1edX ELECTRONIC CONSENT: Please select your choice below. Selecting the “agree” button below indicates that:

You have read and understand the above information. You voluntarily agree to participate. You give us permission to use your input for scientific purposes. You are at least 16 years of age.

Agree (1)

Disagree (0)

Q1 Based on your entire experience with TU Delft Online Learning, on a scale from 0-10, how likely are you to recommend us to a friend or colleague?

Q2 Please help us by explaining your rating.

Q2.1 Since the start of the course, how would you describe your participation level? Choose the answer that best applies to your situation.

In order for the survey to unfold correctly you need to answer this question.

• I did not participate in this course at all (1)

• I did not participate in this course, but I did browse around a little bit (2)

• I only looked at specific parts of the course that I was interested in (3)

• I participated in the course, but I stopped participating along the way (4)

• I participated in the course until the end (5)

Q2.2.1 Could you please describe the reason(s) why you did not start the course? ___________________________________________________________________________ very poor, 10: excellent)

Q2.2.2 Could you please describe which specific parts of the course you were interested in and why?

Q3 The next questions are about your overall experience and impression of the course. Q3.1 On a scale from 1 to 10, what overall grade would you give the course?

Q3.2 What did you find most valuable in the course? Please explain.

Q3.3 Which aspects of this course would you like us to improve? Please explain.

Q4 What is your current type of enrollment in the course?

• Audit - I am enrolled for free (1)

• Verified - I paid (2)

Q4.1 What additional value did you get from the verified track? ___________________________________________________________________________

Q4.2 How would you rate the following aspects of the course? The course was ...

Strongly disagree (1)

Somewhat disagree (2)

Neither agree nor disagree (3)

Strongly agree (5) Unique (Q4.5_1) Useful (Q4.5_2) Interesting (Q4.5_3)

Somewhat agree (4)

Q4.3 How would you rate the difficulty level of the course?

• Far too difficult (1)

• Too difficult (2)

• About right (3)

• Too easy (4)

• Far too easy (5)

Q4.4 How would you describe the amount of work required for the course?

• Far too little (1)

• Too little (2)

• About right (3)

• Too much (4)

• Far too much (5)

Q4.5 How would you describe the breadth of topics covered in the course?

• Far too narrowly (1)

• Too narrowly (2)

• About right (3)

• Too broad (4)

• Far too broad (5)

Q4.6 How would you describe the length of the course (i.e. number of weeks)?

• Far too short (1)

• Too short (2)

• About right (3)

• Too long (4)

• Far too long (5)

Q5 The next couple of questions are about how you participated in the course and how you perceived different elements of the course.

Q5.1 On average, how many hours per week did you work on this course? This includes assignments, reading material, and video lectures. Hours 0, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20

Q5.2 Which elements of the course did you use or participate in? Choose all that apply.

• Videos (1)

• Reading materials (2)

• Forums (3)

• Exercises, quizzes, assignments (4)

• Group work (5)

Q5.2.1 How satisfied were you with the following elements of this course?

Videos (Q5.2.1_x1)

Reading materials (Q5.2.1_x2)

Forums (Q5.2.1_x3)

Exercises, quizzes, assignments (Q5.2.1_ x4)

Group work (Q4.2.1_ x5)

Feedback by instructors (Q4.2.1_x6)

Possibility to work on your own project (Q4.2.1_x7)

Q5.2.2 How valuable were the following elements of this course? Not at all valuable (1) Somewhat valuable (2) Moderately valuable (3) Valuable (4) Very valuable (5)

Videos (Q5.2.1_x1)

Reading materials (Q5.2.1_x2)

Forums (Q5.2.1_x3)

Exercises, quizzes, assignments (Q5.2.1_ x4)

Group work (Q4.2.1_ x5)

Feedback by instructors (Q4.2.1_x6)

Possibility to work on your own project (Q4.2.1_x7)

Q5.2.3 Why did you not use or participate in ${Q4.2/ChoiceGroup/UnselectedChoices}?

Q5.3 What was the biggest challenge in completing this course?

• Using the learning platform (1)

• Meeting the deadlines for assignments and exams (2)

• Grasping the course content (3)

• Allocating sufficient time and combining it with other life obligations (4)

• Other: (5)

• I didn’t experience any challenges (6)

Q5.3.1 At the beginning of the survey you said that you participated in the course, but stopped participating along the way. Why did you not participate in the course until the end? Choose the answer that applies the most to your situation.

• Due to personal obligations. (1)

• Due to an unexpected change in available time. (2)

• Due to a general lack of time. (3)

• The course was not what I expected. (4)

• The course was too difficult for me. (5)

• I found a better course somewhere else. (7)

• Other: (6)