play_circle_outline Check out how to use assignment insights on our YouTube channel.
Insights are an easy way to gain insight into the composition and results of an assignment. Insights allow the instructor to see details regarding marks, points and general characteristics of the assignment. These insights can also be filtered on a group or a class by making use of the dropdown menu at the top of the page.
Follow the steps below to see where you can view your Insights.
- Click the School name in the menu on the left.
- Click menu_book Courses in the menu at the top.
- Select your course or use the search bar.
- Select your assignment or use the search bar.
- Click analytics Insights in the menu at the top.
- Click Overview in the menu on the left.
This brings you to the insights overview of your assignment, in which you'll find the following:
Characteristics
Characteristics
-
Exercises
The number of exercises in the assignment. -
Maximum points
The maximum amount of points a participant can receive. -
Guess score
The guess score is the number of points that can theoretically be obtained by the participant by guessing. The calculation of the guess score is explained in the article on guess correction.
The guess score differs per participant for randomly generated exams. If the guess score cannot be calculated for the whole student population, Ans will show NaN (Not a Number). -
Randomly generated
If Flow was used in an assignment, then the assignment will be randomly generated. Only digital tests can be randomly generated.
Note: if the assignment is randomly generated, the 'Exercises' and 'Guess score' fields will display the total amount of exercises and guess score of the assignment, rather than the amount of exercises given to students by the flow.
Metrics
Metrics
-
Results
The number of participants that took part in the assignment. -
Pass rate
The percentage of participants that received a passing mark. -
KR20 / alpha
This is an indicator for the assignment's reliability. It has a value between 0 and 1, where a higher value means higher reliability. The KR20 is depending on the standard deviation and the amount of (in)correct answers from participants. The KR20/alpha is not displayed when students are randomly assigned questions from a group, because this makes the calculation of this indicator unreliable. -
Standard deviation points
The standard deviation shows the average difference in the number of points, compared with the average amount of points. This number represents the spread of the scores of the participants. A higher standard deviation suggests that there are (too) many outliers. If the standard deviation is low compared to the average score, the scores are likely to be normally distributed. -
Standard measurement error
The standard measurement error shows the accuracy of the outcome of the exam. The value indicates how likely the answers of the participants represent the actual knowledge of participants. The standard measurement error is dependent on the standard deviation and the KR20 value.
Marks
Marks
This chart shows the marks students earned and if they pass or failed the assignment. The pass threshold is determined in the Mark calculation menu. When participants have multiple attempts, the attempt with the highest mark is used. A dashed line in the chart indicates the mark required to pass, with a label showing the required passing mark.
The bar chart divides the mark scale into rounded intervals, with a maximum of twenty intervals. If you select the “none” grading option, or if your formula sets the grade equal to the number of points, the maximum score shown in the graph is the maximum number of points that can be earned. If the maximum number of points a student can earn varies due to the use of sections, the highest possible maximum number of points is shown here.
Question quality
Question quality
The question quality in the graph is based on question statistics (P-value and Rit-value). Contributing questions are placed into four regions: Easy, Difficult, Needs Attention, and Good, providing an indication of how students performed on these questions. To see a list of all questions from a specific category, users can simply click the dedicated field.
Duration
Duration
This chart shows how many students finished a digital test in each 5 minute interval. Helping educators to estimate if the content of the assignment was in line with the duration. This chart is only available for digital tests.
error_outline Most data shown in the Insights environment are not reliable for small amounts of data (participants). Keep this in mind when making conclusions based on the analytics in this overview.
Comments
0 comments
Article is closed for comments.