View insights in questions from a questionbank

When making a test, it is useful to know how a question performed in a different exam or test. This helps making the choice to either use a question or not. You can perform this analysis by using the filter options of a questionbank.

Filtering

In a questionbank, the filter options can be used to select a question that fits your exam. The following filter options can be used:

1. Label: The label (or status) of a question tells you if the question is reviewed and what the outcome was. Questions can have the following labels:
   • Draft
   • Review needed
   • Revision needed
   • Accepted
   • Accepted locally
2. Author: The author tells you who created this question.
3. Objectives: When a question bank yields objectives, these can be selected here.
4. P-value: The p-value indicates the difficulty of the question. A p-value closer to zero means that a question is difficult, while a p-value closer to 1 means a question is easy.
5. Rit-value: The relation of the question to all other questions in the test. The higher the Rit-value, the better the question fits the test. 
6. Categories: This filter lets you choose between different types of questions, e.g. open or multiple choice questions.
7. Tags: A tag can be added to a question to label it and increase findability. 

Further analytics

When a more in-depth analysis of an exercise is wanted, one should go to exercise analytics.

In the list, four values (of multiple examinations) are shown and combined into a conclusion. The number of participants is how many students made this question. The p-value indicates how difficult the question was, a high p-value indicates an easy question and a low p-value a difficult question. The Rit-value indicates the relation between the score of students on this question and on the test in total. A low Rit-value indicates that a question does not distinguish between students with a high overall score and a low overall score. The Rir-value indicates a relation between the score of students on this question and on the rest of the test (so the total score minus the score on this question). The conclusion shows if the p-, Rit and Rir-values indicate a difficult question, good question, a question that needs attention or if it does not have any results.

Add analytic data manually

It can be the case that for an exercise data is already available, which is not created in Ans. This data can be added to an exercise manually.