When making a test, it will be useful to know how a question performed in a different exam or test. This way a better choice can be made for using a question or not. This analysis is possible using the filter options in an item bank.
In an item bank, the filter options can be used to select a question that fits your exam. Below an image is shown in which the filter options are found above the list of questions. The following filter options can be used:
- Label: The label (or status) of a question tells you if this question is reviewed and what the outcome was. The following standard options are there for the status of a question:
- Review needed
- Revision needed
- Accepted locally
- Author: The author tells you who created this question.
- Objectives: When a question bank yields objectives, these can be selected here.
- P-value: The p-value indicates the difficulty of the question. A p-value closer to zero means that a question is difficult, while a p-value closer to 1 means a question is easy.
- Categories: This filter lets you choose between different types of questions, as open or multiple choice questions.
- Tags: A tag can be added to a question to easily find it or to label it.
When a more in-depth analysis of a question is wanted, one should go to question analytics, which can be found in the menu after selecting a question from the question bank. An example is shown below.
In the list, four values (of multiple examinations) are shown and combined into a conclusion. The number of participants is how many students made this question. The p-value indicates how difficult the question was, a high p-value indicates an easy question and a low p-value a difficult question. The Rit-value indicates a relation between the score of students on this question and on the test in total. A low Rit-value indicates that a question does not distinguish between students with a high overall score and a low overall score. The Rir-value indicates a relation between the score of students on this question and on the rest of the test (so the total score minus the score on this question). The conclusion shows if the p-, Rit and Rir-values indicate a difficult question, good question, a question that needs attention or if it does not have any results.
In the (fake) example above, the question is used in two tests. In this example, one test value by an assignment an one test value is added manually by the button Add manual data entry. The total values on top of the answers, the summary, takes only the values into account which are not added manually, while there is more information needed than only the p-, Rit-, and Rir-values and the number of participants to calculate a total p-, or Rir-value for example. In the example above, all results are good, so the question can be labeled as a good question.
Add analytic data manually
It can be the case that for a question already data is available, which is not created in Ans. This data can be added to a question manually. By clicking the button Add manual data entry, data can be added manually. A pop-up will appear as in the image shown below. In this pop-up, the name of the test and the p-value and Rit-value have to be filled in. The other data is optional.