To test whether the criteria you set up per question are appropriate for the way the students answered questions in an assignment, the criteria need to be validated. There are two ways to change validated criteria.

The flag questions-method works when points or rubrics are added after validating the criteria. When you want to delete points or rubrics or alter the number of points a criterion is worth, use the method show sequentially.

## Flag questions

- Sign in to Ans.
- Create an assignment.
*Read here how to create an assignment.* - Create an exercise.
*Read here how to create an exercise.* - Create a question, then create criteria.
- After all the students have submitted their assignment or the exams are scanned, review a few students per question to see if the criteria match the answers the students gave.
- Now it is known how the students answer and interpret the questions, add points or rubrics for the criteria which are found to not be precise.
- When criteria are changed, added or deleted, while (a part of the) students are already reviewed, a choice needs to be made. This choice is shown in the pop-up that appears after changing, adding or deleting one of the criteria. When multiple criteria are altered, the question is only raised for the first change.
- In the pop-up, choose
**Add new criterion and flag all**graded questions. - Click
**Review**in the menu on the left and click the**Red flag button**to review only the flagged questions. These questions are only the questions in which a criterion is added. - If the criteria now match the students' answers, we are done. Otherwise, repeat this method for the remaining questions.

## Show sequentially

- Sign in to Ans.
- Create an assignment.
*Read here how to create an assignment.* - Create an exercise.
*Read here how to create an exercise.* - Create a question, then create criteria.
- After all the students have submitted their assignment or the exams are scanned, review the first 10 students per question to see if the criteria match the answers the students gave.
- Now it is known how the students answer and interpret the questions; change, clarify or expand the criteria per question if needed.
- When criteria change for a question you have to regrade
**Show sequentially**will guide you along with all the students, in this way you can regrade the 10 graded students.- The reviewing of the rest of the questions and students can start.

**What’s next?**

- When you have validated your criteria, you can publish the results.

## Comments

0 comments

Please sign in to leave a comment.