Known issues

Publication date

24th of July 2024

Summary

In a written assignment, the option 'm' in multiple-choice questions with 13 or more answer alternatives is not always recognised correctly. Typically. the answers of multiple-choice questions with one correct alternative are circles with letters inside. When there are 13 or more answer alternatives, the 13th circle contains the letter 'm', which, when scanned, can be incorrectly recognised as being filled in by the student.

The steps to reproduce

• Create a written assignment.
• Create a multiple-choice question with one correct alternative.
• Add at least 13 answer alternatives.
• Generate forms and print/download the assignment.
• Scan/upload the assignment.

The expected result

Ans should correctly register the selected answer or indicate no answer if none is chosen.

The actual result and workaround

Often, the letter 'm' is incorrectly recognised as being selected, resulting in either:

• Two choices being marked (one of them being 'm'), leading to the question being marked as 'ungraded', or
• The 'm' choice being marked as selected even when no other answer is chosen.

To avoid this issue, we recommend not using more than 12 answer alternatives for multiple-choice questions with one correct answer in written assignments.

Publication date
20th of September 2023

Summary
While taking a digital test that has the beta feature 'Monitor participants during a digital test' and DocReader enabled, incidents will not be created, allowing students to "potentially" perform tab switches without being detected. Please note that this is an extreme edge case, as students have to click on the test area (left panel) again in order to continue answering their questions, thus resetting the behaviour.

The steps to reproduce

• Create a digital test with DocReader and Monitoring enabled
• In the settings of your test, click on the tab Proctoring and enable Report tab exiting 
• Open one browser window where you can see the Taking overview, for accessing the participants’ incidents overview
• Open a second browser window (as student) in digital test, with PDF attachment in split screen mode
• Click on PDF
• Switch tab
• Switch back to digital test tab
• Click on the PDF attachment first, then on the digital test half of the screen

The expected result
This action should be detected as an incident.

The actual result and workaround
Currently, there is no workaround.

Publication date

24th of April 2023

Summary

With the Readspeaker integration enabled, students are still able to download a document after this action has been disabled in the DocReader settings.

The steps to reproduce

• Create a digital test and enable ReadSpeaker in the general test settings
• Add an attachment to the digital test and disable the attachment in the Attachments settings
• Disable downloading a document in the Readspeaker settings on school level
• Disable downloading a document in the Readspeaker settings in the digital test
• Preview the digital test and go to the menu of DocReader
• Click on Download document to download a document

The expected result

The option to download a document should not be available in the DocReader menu since we disabled the possibility to download a document.

The actual result and workaround

It is possible to download an attachment despite this has been disabled in the settings. Unfortunately there is no workaround at this moment.

Publication date

10th of March 2023

Summary

In the objectives insights of a digital test using flow, flow is not taken into account when calculating the scored values on the objective. This will result in a biased overview of the objectives insights.

The steps to reproduce

• Create a digital test with flow enabled.
• Add at least two exercises to one flow group. The exercises should be attached to the same objective.
• Set the amount of selected exercises in the flow group in such a way that the student will not receive all of the exercises of the flow group in the test during taking.
• Student takes the test.
• Check the objectives insights under the test insights.

The expected result

The objectives insights on test level take flow into account and correctly calculate and display the scored value on the objective.

The actual result and workaround

The objectives insights on test level do not take into account that the participants did not actually take all exercises in the test. We do not know if an objective was present in some of the questions or in all of them. Even if the participants answered all questions, that are attached to the same objective, correctly, the objective insights will still not reach 100%. This does not apply to the objectives insights in the result of one individual participant. On this student level, the insights do calculate and display correctly. 
At the moment, no workaround is available for this issue. For this reason, a warning will be added to the objectives insights when the test makes use of flow.

Publication date
9th of January 2023

Summary

If you try to copy-paste underlined text from Word to Ans, for example when copying questions from a Word document, underlined text will paste without the underline.

The steps to reproduce

• Write text in a Word document (or another text editor).
• Underline (part of) the text.
• Copy the text.
• Create a field where you can enter text in Ans, for example a question or a description.
• Paste the text.

The expected result

The expected result is that underlined parts of the text are included when pasting the text into Ans.

The actual result and workaround

When the sentences from Word are pasted in Ans, all text formatting is pasted, except for underlining. You will have to manually go over the pasted text and fix the parts of the text which are not underlined manually. If the whole text is underlined, a workaround would be to first enable the rich content editor with underlined formatting= by making use of the U symbol in the rich content editor or by using control + u (Windows) or command + u (Mac). After that, paste the text and it will appear underlined.

Publication date

9th of January 2023

Summary

If the rich content editor is used, it is no longer possible to add other content after a coding block.

The steps to reproduce

• Create a written assignment.
• Create a question or content in an exercise.
• Type some text in the rich content editor.
• Use the HTML functionality of Ans to insert the code (make use of the <code> and </code> tags).
• Close the HTML editor and return to the rich content editor.
• Type your text in the code part.
• Try to move to the end of the code part and try to type text after this part.

The expected result 

After skipping to the end of the code block, it is expected that you can continue typing with normal text.

The actual result and workaround

Ans will continue to type in the code block. Ans provides three workarounds.

1. You can manually add a regular text below the code part by making use of the HTML editor within the rich content editor.
2. A second workaround which achieves the same result is to first start typing two lines of text, separate them with an enter. Now open the HTML editor and start a coding block in between the two regular text blocks.
3. Another workaround would be to use the Code content type for the part where you use coding in your question. This workaround is applicable when you are creating questions only. It is not available for the rich content editor for students in the open question for example. They would have to use the first possibilities as workarounds. 

Publication date

9th of January 2023

Summary

For written assignments, long words at the end of a sentence sometimes run off the page. 

The steps to reproduce

• Create a written assignment.
• Create either a description or a question.
• In the richt content editor, write some text. The line width of a text box is, depending on the used characters, approximately 100 characters. Make sure that the last word on the line starts approximately 10 to 15 characters before the end of the line width. The word should be without any spaces.
• After saving the text, the text will run off the page.

The expected result

Ans should recognise the end of a page and wrap the text on a new line in case the length of the text exceeds the line width.

The actual result and workaround

Ans does not wrap the text and continues the text on the same line, which makes it run off the page. The workaround is to manually add an enter before the long word reaches the end of the line. 

Publication date

9th of January 2023

Solve date

10th of November 2024

Summary

Gaps of a fill-in question are not working properly when used in combination with a table. When adding a gap in the second or further column of a table, the gap will not show in the second column unless another character has been added before.

The steps to reproduce

• Create a digital test.
• Create a fill-in question.
• In the answer field, create a table with at least two columns.
• Navigate to a random row in the second column (or further) and insert a gap.

The expected result

The gap will appear as it should in the second column (or further) of the table.

The actual result and workaround

The gap will shift one cell to the left if it is created in an empty cell. The workaround for this is to create the gap one column further to the right or to add a random character before inserting a gap. This can also be a space to minimise the use of random characters in your table.

Publication date

5th of May 2023

Summary

While taking over an account (assuming the identity of another user), a red bar is displayed at the top of the screen. On some pages this red bar is not accounted for when calculating the height of the page. This results in having to scroll down to view certain of the content. The currently known locations are the digital test view and the grading view.

The steps to reproduce

• You must have an administrator role in Ans (This does not include a department administrator)
• Navigate to the user overview and click on the tab Students tab
• Click on the student that you want to assume the identity of and then navigate to the settings tab of that student and click on Assume in the Danger zone section
• Go to a result of this student and click on ‘View answers’
• You will see some content is now scrolled out of view

The expected result 

The correctly scaled content is shown when assuming the identity.

The actual result and workaround

Due to the red bar not being accounted for when calculating the height, It sometimes happens that not all content is visible. The workaround is to scroll up or down to see all content. It is not possible to disable downloading an attachment with Readspeaker enabled.

Publication date

9th of January 2023

Summary

For written assignments, tables can sometimes run off the page. 

The steps to reproduce

• Create a written assignment.
• Create a question or content in an exercise.
• Create a table in the rich content editor.
• Fill the cells in the columns, where the total amount of characters exceeds the line width.
• Save the progress.

The expected result 

The table sizes the cells so all cells fit on the page and do not run off the page.

The actual result and workaround

The table runs off the page, making cells unreadable. The workaround is create an image of the table and insert the image in the rich content editor. It is not possible to add HTML inside a table or to create a table with LaTeX. Both features are not supported in Ans.

Publication date

9th of January 2023

Solve date

26th of August

Summary

For peer-review assignments, the scores of all closed questions count towards the reliability

The steps to reproduce

• Create a peer-review digital test as instructor.
• Add at least one exercise with at least one open-ended question and at least one closed-ended question.
• Allow participants take the test.
• Allow peers to review the test.
• Check the reliability score under insights.

The expected result

As closed-ended questions are graded automatically, the scores should not add to the reliability of a peer-review digital test. The reliability percentage indicates to what extent the different peer-reviews are similar to a result. Only open-ended questions should count towards the reliability percentage.

The actual result and workaround

Both closed-ended questions and open-ended questions are counted towards the reliability score of a peer-reviewed digital test. To prevent this, we advise to separate the closed-ended questions and open-ended questions into two different tests. This will provide a representative reliability score.