In articles such as Mark calculation, Guess correction and Automatic scoring it is explained how these features in Ans can be enabled and how the features work. This articles demonstrates how different settings for the mark-calculation influence the marks students receive in practice.
The influence of different guess correction settings
The influence of different guess correction settings
There are different options available in the guess correction settings. The table below shows how results change if guess correction is applied in different ways:
| Student response | No guess score | Guess score | Guess score only if answered | |
| 1: Single choice | Correct 1/1 |
0 | 0.25 | 0.25 |
| 2: Single choice | Wrong 0/1 |
0 | 0.25 | 0.25 |
| 3: Single choice | Not answered 0/1 |
0 | 0.25 | 0 |
| 4: Open question | Correct full points 4/4 | 0 | 0 | 0 |
| Closed part points | 1 | 1 | 3*((1-0.75) / (3-0.75) = 0.33 | 3*((1-0.5) / (3-0.5) = 0.6 |
| Open part points | 4 | 4 | 4 | 4 |
| Mark-calculation | (5 / 7)*9+1 | (4.333 / 7)*9+1 | (4.6 / 7)*9+1 | |
| Mark | 7.43 | 6.57 | 6.91 |
The setting 'Limit the guess correction to zero' is not shown in this example. This prevents the closed points part from becoming negative if the Guess score > Total scored points. In this case, this would not influence the scores shown.
The influence of using rounding for (part of) the formula
The influence of using rounding for (part of) the formula
It is possible to round the formula or force a roundup or round down for (a part of) the formula. We will use the same situation as in the first example. In this example, we would like the formula to round to the nearest decimal (1 decimal), except for when rounding just below the pass mark. The pass mark is a threshold and marks below the threshold should never be rounded up to the pass mark. If rounding to the nearest decimal is used, all participants with grades between 5.45 and 5.49 will receive a 5.5 as well. By making use of an IF statement, combined with the rounding options for formulas, you can make an exception for these marks.
- 40 multiple choice questions
- 1 correct answer per question, which is worth 1 point
- Maximum score of the assignment: 40 points
- Guess score: 10
- Minimum mark: 1
- Maximum mark: 10
- Pass mark: 5.5
- All grades between 5.45 and 5.49 need to be rounded down.
- Used formula:
IF(AND(1+9*points/total>5.44, 1+9*points/total<5.5), ROUNDDOWN(1+9*points/total,1), 1+9*points/total)
The formula consists of three parts:
- IF-statement combined with an AND-statement: Ans checks if the calculated mark lies between 5.44 and 5.5.
- Calculation if true: If the mark lies between these boundaries, Ans will force a round down with the same formula, rounded to 1 decimal.
- Calculation if not true: If the mark lies outside these boundaries (either below or above), the regular formula with normal rounding is used.
To show the consequences for different cases, 5 participants with different scores are included in the table below. We have excluded guess correction in this example. With guess correction, the same rounding rules apply.
| Participants | A | B | C | D | E |
| Score | 19 | 19,3 | 19,4 | 19,8 | 20 |
| Mark | 5.275 = 5.3 | 5.3425 = 5.3 | 5.365 = 5.4 | 5.455 = 5.4 | 5.5 = 5.5 |
Please note, we strongly recommend aligning any rounding decimals in your formula with the overall rounding that can be selected above the formula in the dropdown menu. In the example above, it might be possible that for very specific cases the result is different than desired. For example, if a participant has received a score of 19,9 points, this must not result in a 5.5 mark according to the formula used above. If the two rounding options are not aligned, this could be the case:
- The overall rounding of the mark calculation (the dropdown menu) is set to 1 decimal
- The ROUNDDOWN in the formula rounds to 2 decimals (the digit after the comma is 2)
In the specific case that a participant has received 19,9 points, the ROUNDDOWN part of the formula will make sure the participant's score is 5.47. However, the overall rounding of the formula is set to 1 decimal. As 5.47 will be rounded to 5.5, the participant will still receive a 5.5. This can be prevented if both rounding options are equal. If the rounding is set to 1 decimal, the participant will receive a 5.4, if the rounding is set to 2 decimals, the participant will receive a 5.47.
Split-linear mark calculation with a Cut-off score
Split-linear mark calculation with a Cut-off score
The Cut-off score mark-calculation offers an alternative to the default Formula, with which it's simpler to increase or decrease the score that students need to achieve to pass an assignment. Depending on the Maximum and Minimum mark this could lead to a non-linear score calculation. Where above and below the threshold the Mark-calculation is different:
- Above the Cut-off score: (Points - Cut-off %* Max points) /((1- Cut-off %) * Max points- Min points)*(Max mark - Pass mark)*+Pass-mark
- Under the Cut-off score: Scored Points/(Cut-off % * (Max points - Min points)*(Pass mark - Min mark)+Minimum mark
Commonly the Minimum score of a test is 0, which means these deductions can be left out of the calculation. This may result in a scenario that looks something like this:
| Student 1 | Student 2 | Student 3 | |
| Closed part points | 6 | 9 | 10 |
| Open part points | 7 | 10 | 10 |
| Total corrected points /25 | 13 | 19 | 21 |
|
Above Cut-off In this case 70% of 25 pts. |
No | Yes | Yes |
|
Mark-calculation Pass mark = 5.5. Min = 1. Max = 10 |
13 /(0.7*25)*(5.5-1)*+1 = | 20/((1-0.7)*25)*(10-5.5)+5.5 = | (21/((1-0.7)*25)*(10-5.5)+5.5 = |
| Mark | 4.343 | 6.143 | 6.400 |
Using Mark calculation variables to combine Non-linear scoring with a Guess score
Using Mark calculation variables to combine Non-linear scoring with a Guess score
The Cut-off score mark-calculation enables users to create a non-linear distribution of the marks. However, this feature does not yet support the use of a guess-score. In this case, users could instead use the Mark calculation variables to make this happen, using the following formula:
IF(points>(total*Cut-of score),(Points - Cut-off %* Max points)/(1- Cut-off %*Max points)*(Max mark - Pass-mark)+Pass-mark, (Points*(Pass mark - Min mark))/(Cut-off %*Max points)+1
The formula consists of three parts. An IF statement, the calculation if it's true and the calculation if it's not true. The three parts are separated by commas.
-
IF-statement: Checks if the amount of points of the participant is higher than the Cut-off score
- True: If the participant has scored a higher amount of points than the Cut-off, Ans will check the second part of the formula. For this calculation we first determine the percentage of the marks above the pass-mark the participant should receive per scored point above the pass mark. This percentage is then multiplied by the amount of marks above the pass-mark. Above which the pass-mark is added to come to a final mark.
- False: If the participant has scored a higher amount of points than the Cut-off, Ans will check the second part of the formula. For this calculation, we again first determine the percentage of the marks the participant should be receive per scored point. This is multiplied by the number of points of the participant. Lastly, 1 mark is added to this total (as a participant will receive a 1 in case 0 points are scored).
An example calculation
For the following standard parameters
- Guess score: 10
- Minimum mark: 1
- Maximum mark: 10
- Pass mark: 5.5
- Cut-off: 70% of the score:
Within Ans the formula set in the Mark-calculation then becomes: IF(points>(total*0.7), (points-0.7*total)/(0.3*total)*4.5+5.5, points/(0.6*total)*4.5+1. In this situation, points scored above the cut-off score are worth more than points scored below the cut-off score. When the distribution is visualised, this means differences in Marks between two students who differed one point in scoring is larger when both have scored above the Cut-off score. The example below demonstrates this:
| Student 1 | Student 2 | Student 3 | |
| Guess score | 2 | 2 | 3 |
| Closed part points | 6 | 9 | 10 |
| Open part points | 7 | 10 | 10 |
| Total corrected points | 15*((6-2) / (15-2)) + 7 = 11.62 |
15*((9-2) / (15-2)) + 11 = 18.08 |
15*((10-3) / (15-3)) + 10 = 18.75 |
|
Above Cut-off In this case 70% of 25 pts. |
No | Yes | Yes |
|
Mark-calculation Pass mark = 5.5. Min = 1. Max = 10 |
11.62 /(0.7*25)*4.5+1 = |
(18.08-0.7*25) /(0.3*25)*4.5+5.5 = | (18.75-0.7*25) /(0.3*25)*4.5+5.5 = |
| Mark | 2.988 | 5.842 | 6.250 |
Examples table
The table functionality is explained with one example. The example is to manually create a table with multiple layers. This can be used when you are using a 'scale' such as insufficient - sufficient - good.
Example 1: manual table
Example 1: manual table
Manually creating a table can be used in case scores need to be translated into letter grades. An example of a letter grade scale can be insufficient - sufficient - good. As explained in the mark calculation article, the table always rounds down in case the amount of points of a certain row is not met. For a three-point scale such as insufficient - sufficient - good, this means three rows are enough to establish the whole mark calculation table.
The following assessment characteristics apply in this example:
- 10 multiple choice questions
- 1 correct answer per question, which is worth 1 point
- Maximum score of the assignment: 10 points
- Minimum score of the assignment: 0 points
- Guess score: 2.5
- Minimum mark: 1
- Maximum mark: 10
- Pass mark: 5
- Rounding: halve marks
The following situation can be applied:
| Mark | Points | Letter grade |
| 1 | 0 | Insufficient |
| 5 | 6.8 | Sufficient |
| 8 | 8.4 | Good |
With this table, all participants that score lower than 6.8 points will receive a 1 and an 'insufficient' as a letter grade. All participants that score 6.8 points or higher, but lower than 8.4 points receive a 5 and 'sufficient'. Finally, all participants that score higher than 8.4 points will receive an 8 and a 'good'.
Of course, the mapping can be done accordingly to your own assignment. Also, it is possible to add additional rows if you want to differentiate for different marks. A letter grade can be applicable for multiple rows. Another outcome could be:
| Mark | Points | Letter grade |
| 1 | 0 | Insufficient |
| 2 | 1.5 | Insufficient |
| 3 | 3 | Insufficient |
| 4 | 4.5 | Insufficient |
| 5 | 6 | Sufficient |
| 6 | 6.8 | Sufficient |
| 7 | 7.6 | Sufficient |
| 8 | 8.4 | Good |
| 9 | 9.2 | Good |
| 10 | 10 | Good |
Please be aware that rows with duplicate score values will be skipped during import.
Comments
0 comments
Article is closed for comments.