Order question

To create a an order question, follow the steps below.

1. Click the domain School name in the menu on the left.
2. Click on label_important Courses in the menu at the top.
3. Select your course or use the search bar.
4. Select your assignment or create a new assignment. 
5. Click New exercise, fill in a name and click Save.
6. Click New question and select Order question.
7. Formulate the question in the question content field.
8. Fill in the number of points the question is worth.
9. Click the dropdown menu Order type* and select Horizontal or Vertical. 
10. Click Add alternative and fill in the alternatives. Repeat this for all alternatives. The order in which you add your alternatives is the same order the participants will be required to rank the alternatives.
11. If preferred, you can also click on the box Fixed starting position. This allows you to fill in the position of the alternatives when shuffling the answer options is enabled.
12. Click the more_vert-icon for more options.
13. Click Save.

• Bonus
  This marks the question as a bonus question, which means the number of points awarded with this question will be counted until the maximum amount of points achievable for this assignment is reached. The points of the bonus question are not included in the maximum amount of points that can be achieved for the assignment If the participants answers the question incorrectly, this will not be detracted from the number of points and the mark.
  
  
• Skippable 
  You will first need to assign which students are exempted from answering this question within the settings of your course. You can then enable which questions can be skipped by these students. In the taking session of a digital test, the participant will be informed they can skip the question. The number of points for this question will not be counted in their result. It is not possible to change this setting after the test has been taken. 
  
  
• Partial scoring
  Participants will receive points when their answer is partly correct. For example, if the total number of points they can receive for this question is 2 and if their answer is half correct, they will get 1 point. Without this option, they can only receive 0 or the maximum number of points.

To add a grading scheme to an order question, follow the steps below.

1. Click the Grading scheme tab at the top of the assignment.
2. Go to the question for which you want to set the grading scheme.
3. It is optional to fill in feedback that is shown to students when:
   
   • the question is answered correctly
   • the question is answered partially correctly
   • the question is answered incorrectly
4. Click the more_vert-icon for more grading options.
5. Click Save.

• Model answer
  A solution for the reviewers (and for participants when published). The model answer can be an extensive elaboration, an image, or a file.
  
  
• Use automatic scoring
  When you use automatic scoring for grading, you will need to select the correct alternatives. The platform will automatically award the number of points set in the grading scheme for the question, either the full or partial points, depending on the setting. Disabling this option makes it possible to adjust the number of points awarded with each alternative. Both with the option enabled and disabled, the platform will automatically review the question, the difference is being able to differentiate between the number of points awarded for each alternative.
  
  
• Limit minimum to zero points (For the points-per-criteria grading method only)
  With this option enabled, it’s impossible to go below zero points when selecting the different criteria. It is still possible to manually adjust the number of points to go below zero with the adjustment option during the reviewing.
  
  
• Limit maximum to total points (For the points-per-criteria grading method only)
  In the grading settings it’s possible to set the maximum amount of points achievable with the question, separate from the points per criteria When this number deviates from the maximum amount achievable by adding up the criteria points, this option will cap the maximum amount of points to this manually set number.

If you have not used the product rule option, an order question will be graded as follows:  

We determine the number of correct ‘pairs’. For example, 4 options for the following pairs are used:

1-2 ; 1-3 ; 1-4 ; 2-3 ; 2-4 ; 3-4

We compare this with the student's answer and if for example, the student identified 4 correct pairs, the student receives a score of 4/6 * the number of points.

So in general: grade = (number of correct pairs set by the student / total number of correct pairs) * number of points set for this question.