In the previous step, you learnt how to view the overview insights of your digital test. In this step, you will learn how to view the Exercises insights.
To gain insights into the Exercises of your digital test, click on analytics Insights from within your digital test. You will then be brought to the Insight overview page. Click Exercises in the box on the left, in which you'll find the following:
Below every question, you will see the dropdown menu Contributes. This allows you to change the contributes of the question to Bonus, Full points or Disabled. Before selecting a contribute, you can preview how it will effect the overall insights of that question/exercise.
This is the default option; the question contributes to the grades of the students.
The question will not be taken into account in the maximum score that can be gained, but it will count as a bonus for the students that answered correctly.
Every student is awarded the maximum amount of points possible for this question.
The question and the points awarded for the question will be taken out of the exam and will not be taken into account for the grading.
Analysis of the Exercises
Quality of the exercise
The first section of the box will display the quality of the exercise. The quality shown is either Good, Easy, Difficult or Needs attention. If you click the dropdown menu at the top of the page, you have the option to filter the exercises by quality.
- Good: All values are within the appropriate ranges.
- Easy: The p- and p'-values are probably too high.
- Difficult: The p- and p'-values are probably too low.
- Needs work: The Rit- and/or Rir-values can be too low (< 0.30). The question is not representative for the assignment.
Next to the quality of the exercise, there are five elements relating information on the questions:
p, p', Rit, Rir, and Rk
The p-value indicates the difficulty of the question. It is calculated by dividing the number of students that got maximum points by the total number of students. A p-value closer to zero means that a question is difficult, while a p-value closer to 1 means a question is easy.
The Rit‑value indicates correlation of question score to the total examination score. It tells us to what extent an item contributes to isolating the good candidates from the entire pool of test takers. In other words: it demonstrates the discriminating properties of the item and tells something about the performance of the item versus the test as a whole. So if students with a high grade score low on a specific question, but students with a low grade score relatively high on that item. you get a low (or even negative) rit-value.
The Rir‑value is similar to Rit but more precise because the score of the item itself is not taken into account.
Rate of difficulty corrected for the guess correction
The p'-value is the percentage of students that know the question. This value should range between 0,25 and 0,9. If the value equals 0,5, then it can be said that a maximum discrimination between strong and weak students is found.
Corrected guess effect
In a question with, for example, 4 choices and 1 correct answer, there's a 1 in 4–or 25%–chance the answer can be guessed correctly. If the question is worth, for example, 1 full point, then the student is awarded a score of 0,25 points for guessing correctly. This does not inherently accurately reflect the student's grasp on the knowledge required.
Rk is the corrected guess effect, where, within the score calculation, the choices from others are taken into consideration in order to judge such information more accurately.
Duration: The duration indicates the average time students spent on the question.
You can read in further detail about the exercise values in this article.