Multiple response question

Create a multiple response question

Before a multiple response question can be created, it is necessary to create an exercise. To create an exercise with a multiple response question, follow the steps below.

1. Navigate to your question bank or your assignment. 
2. Click New exercise, fill in a name and click Create.
3. Click New question and select Multiple response.
4. Add input in the following fields:
   1. Question*: this the question content field where the text of the question can be formulated. You can make use of the text editor to construct the question.
   2. Points*: the number of points that the question is worth.
   3. Scoring method: the scoring method used to grade the question. There are three methods:
      • All or nothing: Students earn full points if they select all correct alternatives. Otherwise, they receive no points.
      • Partial: Points are awarded for each correct answer. 
      • Custom: Manually award points for each answer. With this scoring method it is possible to enable the option 'Limit minimum to zero points'. With this option enabled, it is not possible for the score to go below zero points when selecting an alternative with negative points. It is still possible to manually adjust the number of points to go below zero with the adjustment option during the reviewing.
   4. Alternatives: fill in the alternatives. To add a new alternative, click +Add alternative. You can also change the order of alternatives by clicking the drag_indicator-icon and dragging and dropping the alternative. To delete the alternative, click the delete-icon. Depending on the used scoring method, select the correct alternative:
      • By selecting the checkbox next to the alternative. 
      • By manually filling in the number of points per alternative.
   5. QUESTION FEEDBACK: click the dropdown to:
      1. Add a model answer. 
      2. Provide feedback to participants that is shown during the taking of a digital test if the option 'Feedback' is enabled in the accessibility settings of the assignment. The feedback can be filled and shown when:
         • The question is answered correctly.
         • The question is answered partially correctly (only possible when the 'Partial' and 'Custom' scoring methods are used). 
         • The question is answered incorrectly.
   6. Objectives: if there are learning objectives in the question bank or course that the question is created in, the objective can be selected or typed in to add to the question.
5. Click Create.

Add a grading scheme to a multiple response question

All options mentioned below for the grading scheme can also be added or adjusted from the exercise tab when creating a multiple response question.

1. Click Grading scheme tab at the top of the assignment or question bank exercise.
2. Go to the question for which you want to set the grading scheme.
3. Click the edit-icon. 
4. Adjust input in the following fields:
   1. Question*: this the question content field where the text of the question can be formulated. You can make use of the text editor to construct the question.
   2. Points*: the number of points that the question is worth.
   3. Scoring method: the scoring method used to grade the question. There are three methods:
      • All or nothing: Students earn full points if they select all correct alternatives. Otherwise, they receive no points.
      • Partial: Points are awarded for each correct answer. 
      • Custom: Manually award points for each answer.
   4. Alternatives: fill in the alternatives. To add a new alternative, click +Add alternative. You can also change the order of alternatives by clicking the drag_indicator-icon and dragging and dropping the alternative. To delete the alternative, click the delete-icon. Depending on the used scoring method, select the correct alternative:
      • By selecting the checkbox next to the alternative. 
      • By manually filling in the number of points per alternative.
   5. QUESTION FEEDBACK: click the dropdown to:
      1. Add a model answer. 
      2. Provide feedback to participants that is shown during the taking of a digital test if the option 'Feedback' is enabled in the accessibility settings of the assignment. The feedback can be filled and shown when:
         • The question is answered correctly.
         • The question is answered partially correctly (only possible when the 'Partial' and 'Custom' scoring methods are used). 
         • The question is answered incorrectly.
   6. Objectives: if there are learning objectives in the question bank or course that the question is created in, the objective can be selected or typed in to add to the question.
5. Click Update.

Options for a multiple response question

For additional options, click the settings-icon. You will see the following:

• Bonus
  This marks the question as a bonus question, which means that its points are not included in the maximum amount of points achievable for that assignment. If a student answers the question incorrectly, this will not be detracted from the number of points and the mark. However, when awarding points, it is possible to achieve more points that the maximum points achievable for the assignment.

For written assignments, Ans offers the following extra options:

• Start on new page
  By using this option, Ans forces the question to be printed on a new page.
   
• Stack alternatives vertically
  The default for written assignments is to stack the multiple response options horizontally. This is so the space on the paper is used as effective as possible. However, if the length of the alternatives overwrites the total width of the paper, Ans will stack the alternatives vertically, regardless of the default option.

Grading of multiple response questions in a written assignment

When recognising each individual multiple response answer, we categorise them in 4 different states.

• 0: The box has been left empty
• 1: The box has a cross
• 2: The box is fully coloured
• 3. The box has been corrected because there is large cross outside of the fully coloured box.

This recognition is done with "neural network" that has been trained on thousands of differently checked boxes, but has a small margin of error. This means there is a small chance that Ans may interpret the question differently than intended. The recognition can also be influenced by the type of pen/pencil used and the quality of the scan.

Ans does not automatically grade multiple response questions if it identifies state 3 answers. Instead the question will remain ungraded and will require manual review. This is a safety precaution to prevent multiple response choices from being graded incorrectly.