Multiple choice question

1. 1. Navigate to your question bank or your assignment. 
   2. Click New exercise, fill in a name and click Save.
   3. Click New question and select Multiple choice.
   4. Formulate the question in the question content field. You can make use of the text editor, for example to insert equations or images.
   5. Fill in the number of points the question is worth.
   6. Click the dropdown menu Correct alternatives* and choose One or Multiple.
   7. Three buttons are shown below the dropdown menu:
      • Shuffle alternatives
        Shuffles the alternatives once. They will be displayed in that order for every student. Shuffling alternatives for each student is an option under the assignment settings.
      • Sort alternatives
        Sorts the alternatives in alphabetical order or in numerical order. If the alternatives were for example red, blue, white. Then the alternatives would be sorted as, blue, red, and white.
      • Negative points
        If this button is selected, Ans will automatically add negative points to all incorrect alternatives. If for example, there are three possible alternatives and the correct alternative is worth 5 points, the two incorrect alternatives will result in -2.5 points if selected by the participant. To 'reset' the negative points, you will have to delete the negative points and change them back to 0. They will not reset by clicking 'Negative points' again.
        Additionally, the button will add an extra alternative with a question mark which gives a participant 0 points.

      error_outline The 'Negative points' option cannot be used together with the 'Use automatic scoring' feature. 

   8. Click Add alternative and fill in the alternative. You can also make use of the text editor by pressing the text_format icon.
   9. Fill in the number of points that can be earned for that specific alternative. If you have multiple correct options, you can determine the distribution of points yourself.
   10. You can fill in standardised feedback for the alternatives. This feedback will only be visible during the publication of a test. If you want to show feedback during the test, use the feedback possibilities which can be defined in the grading scheme. You can also make use of the text editor by pressing the text_format icon.
   11. If preferred, you can also set the Fixed starting position. This allows you to fill in the position of the alternative when shuffling the answer options is enabled. This option is used for example if one of the alternatives is 'All of the above'. In this situation, you'd like to show this particular alternative always as last option. Fill in the numerical position of this alternative to fixate it to that position. For example, if you have four alternatives, you can use the number 4 to show this alternative as fourth and last option.
   12. Repeat steps 11 until 14 for all alternative. 
   13. Click the more_vert-icon for options to change the order of an alternative, or to delete it. You can also change the order of alternatives by dragging and dropping the alternative.
   14. Click Save.

For additional options, click the more_horiz-icon and click Edit. Then click on the more_vert-icon. You will see the following:

• Bonus
  This marks the question as a bonus question, which means that its points are not included in the maximum amount of points achievable for that assignment. If a student answers the question incorrectly, this will not be detracted from the number of points and the mark. However, when awarding points, it is possible to achieve more points that the maximum points achievable for the assignment.
  
  
• Partial scoring
  Students will receive points when their answer is partly correct. For example, if the total number of points they can receive for a question is 2 and their answer is 50% correct, they will still receive 1 point. Without this option, they can only receive 0 or the maximum number of points.
  For multiple response questions, enabling partial scoring can increase the applied guess correction. Since students can earn points for partially correct answers instead of an all-or-nothing approach, they may be more likely to guess additional answers. This article provides a more detailed explanation of how the guess correction is calculated.

For written assignments, Ans offers the following extra options:

• Start on new page
  By using this option, Ans forces the question to be printed on a new page.
  
  
• Stack alternatives vertically
  The default for written assignments is to stack the multiple choice options horizontally. This is so the space on the paper is used as effective as possible. However, if the length of the alternatives overwrites the total width of the paper, Ans will stack the alternatives vertically, regardless of the default option.

1. Click Grading scheme tab at the top of the assignment or question bank exercise.
2. Go to the question for which you want to set the grading scheme.
3. Click the more_horiz-icon and click Edit. 
4. It is optional to fill in feedback that is shown to students when:
   
   • the question is answered correctly
   • the question is answered partially correctly
   • the question is answered incorrectly
     This feedback is shown if the option 'Feedback' is enabled under the assignment accessibility settings.
5. Fill in the number of points each alternative is worth. 
6. Filling in feedback for each alternative is optional. 
7. You can use the Calculate points button to calculate the maximum points. The points of all the criteria will be summed up automatically. Alternatively, you can manually set the maximum number of points. 
8. Click the more_vert-icon for more grading options.
9. Click Save.

lightbulb_outline For multiple choice questions with one correct answer, it is now possible to mark multiple alternatives as correct. While students can still select only one alternative, they will receive full points if they choose any of the marked correct alternatives.

• Model answer
  A solution for the reviewers (and for participants when published). The model answer can be an extensive elaboration, an image, or a file.
  
  
• Use automatic scoring
  When you use automatic scoring for grading, you will need to select the correct alternatives. The platform will automatically award the number of points set in the grading scheme for the question, either the full or partial points, depending on the setting. Disabling this option makes it possible to adjust the number of points awarded with each alternative. Both with the option enabled and disabled, the platform will automatically review the question, the difference is being able to differentiate between the number of points awarded for each alternative.
  
  
• Start with zero points
  If this option is enabled the marking of this question will always start at zero points and the points will be added up when selecting the criteria. When this option is disabled, the marking will start with the maximum amount of points that can be awarded for this question and selecting the criteria will be subtracted from this maximum. This means that the criteria should be added as minus points of the total amount. The reviewer can then select the criteria if the student did not meet this with their answer, so it can be detracted from the total amount of points.
  
  
• Limit minimum to zero points
  With this option enabled, it’s not possible to go below zero points when selecting the different criteria. It is still possible to manually adjust the number of points to go below zero with the adjustment option during the reviewing.
  
  
• Limit maximum to total points
  In the grading settings it’s possible to set the maximum amount of points achievable with the question, separate from the points per criteria When this number deviates from the maximum amount achievable by adding up the criteria points, this option will cap the maximum amount of points to this manually set number.

For multiple choice questions (automatically graded) you can provide feedback on answer level and on alternative level. In this article you can read more about it.

When recognising each individual multiple choice answer, we categorise them in 3 different states.

0: The circle has been left empty
1: The circle has a cross
2: The circle is fully coloured
3: The circle has been corrected because there is large cross outside of the fully coloured circle.

This recognition is done with "neural network" that has been trained on thousands of differently circles, but has a small margin of error. This means there is a small chance that Ans may interpret the question differently than intended. The recognition can also be influenced by the type of pen/pencil used and the quality of the scan.

Be aware that Ans makes a "crop" of the circle, meaning any indication outside the circle is ignored. For example, adding an arrow is not taken into account when recognising choices.

Ans does not automatically grade multiple choice questions if it identifies state 3 answers. Instead the question will remain ungraded and will require manual review. This is a safety precaution to prevent multiple choice questions from being graded incorrectly.

When recognising each individual multiple response answer, we categorise them in 4 different states.
0: The box has been left empty
1: The box has a cross
2: The box is fully coloured
3. The box has been corrected because there is large cross outside of the fully coloured box.

This recognition is done with "neural network" that has been trained on thousands of differently checked boxes, but has a small margin of error. This means there is a small chance that Ans may interpret the question differently than intended. The recognition can also be influenced by the type of pen/pencil used and the quality of the scan.

Ans does not automatically grade multiple response questions if it identifies state 3 answers. Instead the question will remain ungraded and will require manual review. This is a safety precaution to prevent multiple response choices from being graded incorrectly.