Step 2 - Questions insights

In the previous step, you learnt how to view the overview insights of your digital test. In this step, you will learn how to view the Questions insights. 

To gain insights into the questions of your digital test, click on analytics Insights from within your digital test. You will then be brought to the Insight overview page. Click Questions in the box on the left, in which you'll find the following:

Contributes

Below every question, you will see the dropdown menu Contributes. This allows you to change the contributes of the question to Bonus, Full points or Disabled. Before selecting a contribute, you can preview how it will effect the overall insights of that question/exercise.

Contributes
This is the default option; the question contributes to the grades of the students.

Bonus
The question will not be taken into account in the maximum score that can be gained, but it will count as a bonus for the students that answered correctly.

Full points
Every student is awarded the maximum amount of points possible for this question.

Disabled
The question and the points awarded for the question will be taken out of the exam and will not be taken into account for the grading.

Analysis of the Questions

Quality of the question
The first section of the box will display the quality of the question. The quality shown is either Good, Easy, Difficult or Needs attention. If you click the dropdown menu at the top of the page, you have the option to filter the questions by quality.

• Good: All values are within the appropriate ranges.
• Easy: The p- and p'-values are probably too high.
• Difficult: The p- and p'-values are probably too low.
• Needs attention: The Rit- and/or Rir-values can be too low (< 0.30). The question is not representative for the assignment.

Next to the quality of the question, there are five elements relating information on the questions:

p, p', Rit, Rir, and Rk

P-value
The p-value indicates the difficulty of the question. It is calculated by dividing the number of students that got maximum points by the total number of students. A p-value closer to zero means that a question is difficult, while a p-value closer to 1 means a question is easy.

Rit-value
The Rit‑value indicates correlation of question score to the total examination score. It tells us to what extent an item contributes to isolating the good candidates from the entire pool of test takers. In other words: it demonstrates the discriminating properties of the item and tells something about the performance of the item versus the test as a whole. So if students with a high grade score low on a specific question, but students with a low grade score relatively high on that item. you get a low (or even negative) rit-value. Please note, the Rit and Rir value cannot be calculated when using flow. 

Rir-value
The Rir‑value is similar to Rit but more precise because the score of the item itself is not taken into account. Please note, the Rit and Rir value cannot be calculated when using flow. 

P'-value
Rate of difficulty corrected for the guess correction
The p'-value is the percentage of students that know the question. This value should range between  0,25 and 0,9. If the value equals 0,5, then it can be said that a maximum discrimination between strong and weak students is found.

Rk-value
Corrected guess effect
In a question with, for example, 4 choices and 1 correct answer, there's a 1 in 4–or 25%–chance the answer can be guessed correctly. If the question is worth, for example, 1 full point, then the student is awarded a score of 0,25 points for guessing correctly. This does not inherently accurately reflect the student's grasp on the knowledge required.
Rk is the corrected guess effect, where, within the score calculation, the choices from others are taken into consideration in order to judge such information more accurately.

Duration: The duration indicates the average time students spent on the question.

You can read in further detail about the question values in this article.

Next step: Step 3- Objectives Insights