Create a question bank assignment

Manually create a new question bank assignment

You have the possibility to create a new question bank assignment from within your question bank and manually add the exercises to this assignment. To create a new question bank assignment, follow the steps below.

1. Navigate to your question bank.
2. Click assignment Question bank assignments in the menu at the top. 
3. Click New assignment.
4. Fill in the name and click the dropdown menu to select the assignment type. 
5. Click Save. 

Once you have created the assignment, you can manually add exercises to your assignment. Selecting your exercises can be done more easily by making use of the filters in your question bank. This way you can select the specific exercises you want to be added to your assignment based on your preferences. You also have the option to randomise the exercises you have added to your question bank assignment by making use of sections. 

To add exercises from a question bank to an assignment using filters, follow the steps below.

1. Navigate back to the extension Exercises tab of your question bank.
2. Adjust the filters to your specific requirements. 
3. Check the box of the exercises you want to add to your assignment.
4. Click on the + Add to.
5. Select your question bank assignment.
6. Click Copy. 

When you select exercises in the overview, you can use the checkbox at the top of the table to select all visible exercises at once. This way, you can easily add multiple exercises to your question bank assignment at the same time. By default, the exercises are added in the order of creation date. You can adjust this order later, both in the Layout panel of your course assignment and question bank assignment.

With the bulk selection, a maximum of the first 100 exercises are selected. If there are more than 100 exercises available, you can navigate to the next page and use the checkbox at the top again to add the next 100 exercises - and so on.

If you want to select more than 100 exercises at once, you can adjust the limit of the displayed exercises via the URL. To do this, add ?limit=xxx to the end of the URL (for example, ?limit=500). This way, more exercises are shown immediately, and you only have to click the top checkbox once to select them all.

You can also generate an assignment by using a blueprint. You will first need to create your blueprint within the question bank to be able to generate your assignment. The steps for generating a question bank assignment differ depending on whether you’re using the new blueprints or the classic blueprint.

Generate an assignment using a blueprint (new)

1. Navigate to your question bank.
2. Click Question bank assignments in the menu at the top.
3. Click the Blueprints tab.
4. Click on your blueprint.
5. Click Generate assignment.
6. Fill in the name of your assignment and select the assignment location.
7. Click Generate.

Alternatively, you can click on the assignment of a blueprint from the blueprints overview.

Generate an assignment using a classic blueprint 

1. Navigate to your question bank.
2. Click on fact_check Objectives in the menu at the top.
3. Select a blueprint.
4. Click on Generate assignment.
5. Fill in a name for the new assignment.
6. Check the various options that apply:
   • Labels: include or exclude exercises with a specific label in the exercise selection.
   • Exercise selection: fixed or randomised exercises per participant.
     • Fixed 
       This assignment will have a fixed set of exercises which will be identical for all participants.
     • Randomised per participant
       This assignment will have a mixed set of exercises which will be different for each participant. The exercises are placed into sections when the assignment is copied to a course. Every participant receives a unique assignment based on the blueprint parameters. Ans keeps track of which exercises from the question bank have been included in previous assignments for specific participants. If alternative exercises are available, those previously selected will be excluded from their current assignment.
   • Exclude exercises from assignments: excludes the exercises which were chosen in the selected assignments.
   • Filter on feedback: use questions with feedback.
   • Filter on p-value: exclude questions that lie outside the boundaries indicated.
   • Filter on question type and tags: determine the number of questions per question type and the number of questions with a certain tag.
7. Click Generate.

If you wish to remove included exercises in the generated assignment, you have the option to manually remove them. You can remove exercises from a question bank assignment by following the steps below. 

1. Navigate to your question bank assignment. 
2. Click the trash icon next to the exercise you want to remove. 
3. Click Confirm.

Selection of questions with a blueprint (classic blueprint)

If you use a blueprint, Ans will select the questions from the question bank. This can be done either at random or fixed, depending on the way of generation which you have selected. More information on this can be found above. As explained in the manage blueprints article, you need to define the number of questions that will be selected with a certain objective. However, it might be possible that an exercise contains questions with different objectives. Below, you can read more information on how Ans deals with these kind of situations. We will use a simple example to explain how Ans selects questions. In our example, we have the following exercises, questions and objectives:

In the table above you can see that there are four questions with objective A connected, and one question with objective B connected. However, the four questions with objective A connected, are spread over three different exercises. We will use a simple example where the blueprint will select:

• Two questions with objective A
• One question with objective B

You have the option to filter on elements such as question type and p-value. These options are explained in the section 'Selection of questions with blueprint and filtering options'. In this part of the article, the filtering options are left out.

While generating, Ans will go through the list of possible questions that can be selected. In this case, three questions need to be selected. An important point of attention to take into account is that Ans checks the questions for generating the assignment, however the whole exercise will be selected. The following process is executed in the background:

1. First, Ans will seek for a possible question with objective A. This selection is done at random. In the example, it can be possible that question 1a, 1b, 2a or 3a is selected in this first step. The exercise of the selected question is added to the assignment. For example, if Ans selects question 2a, exercise 2 including questions 2a and 2b are added to the assignment.
2. The second step depends on the outcome of the first step. It is possible that the blueprint has already fulfilled the requirement of having two questions with objective A selected (if exercise 1 is added). Therefore, the second step can be one of the following options:
   • Completion of the requirement of two questions with objective A if less than two questions were added in the first step.
   • Check for questions with objective B connected if two questions with objective A were added in the first step.
3. If the requirement of the blueprint has been fulfilled after step 2, the assignment is complete and will be generated (in case of the second bullet of step 2). If the requirement of objective B was not fulfilled, Ans will try to find a question with objective B.
4. As you can see, there are five possible situations for the example described above. We have described these below. The complexity of the process increases with additional questions.
   • Situation 1
     • Question 1a or 1b found, exercise 1 added, objective A completed.
     • Question 2b found, exercise 2 added, objective B completed.
     • End result: Two exercises with four questions added.
   • Situation 2
     • Question 2a found, exercise 2 added, objective A not completed (but B is completed).
     • Question 1a or 1b found, exercise 1 added, objective A completed.
     • End result: Two exercises with four questions added.
   • Situation 3
     • Question 2a found, exercise 2 added, objective A not completed (but B is completed).
     • Question 3 found, exercise 3 added, objective A completed.
     • End result: Two exercises with three questions added.
   • Situation 4
     • Question 3 found, exercise 3 added, objective A not completed.
     • Question 1a or 1b found, exercise 1 added, objective A completed.
     • Question 2b found, exercise 2 added, objective B completed.
     • End result: Three exercises with five questions added.
   • Situation 5
     • Question 3 found, exercise 3 added, objective A not completed.
     • Question 2b found, exercise 2 added, objective A and B completed.
     • End result: Two exercises with three questions added.

Selection of questions with a blueprint and filtering options (classic blueprint)

We advise to read the section 'Selection of questions with a blueprint' of this article first. In this part, the method of how the blueprint selects questions is explained. The use of filters is an addition to the selection with a blueprint and therefore knowledge on how the blueprint is used is needed before reading this part of the article.

The blueprint forms the basis of your assignment. The blueprint selects questions based on the objective. In the blueprint you can determine the number of questions that is selected per objective, regardless of other characteristics such as tags, labels, question type and p-value. Before Ans is generating an assignment, you can apply filters on the generation process. This reduces the set of questions out of which Ans selects the questions for the assignment. We will explain this method based on an easy example. The question bank contains the following questions:

We would like the blueprint to select the following questions:

• Two questions with objective A
• One question with objective B

Besides the blueprint, we use a filter to filter on question type. We do not want Ans to select match questions. Therefore we set the max to 0 on the question type match filter. Make sure to enable the filter by using the box on the left side on the question type.

Ans will take the filter limits into account while selecting questions. In this case no match questions are allowed to be selected. Ans will start as indicated earlier with objective A. Ans will check which questions contain objective A (questions 1a, 1b, 2a and 3a). These questions are in exercises 1, 2 and 3. After this step, Ans will exclude the exercises which contain a match question. In this case, this is exercise 2. Ans will try to fulfil the requirement of having two questions with objective A from the remaining exercises. As Ans starts at random with the exercise selection, there are two options: either exercise 1 is selected, or exercise 1 and 3 are selected. After the fulfilling the requirement of objective A, Ans will fulfil the requirement of objective B in the same way. In this case, exercise 2 is excluded from the possible exercises because of the match question. Therefore, question 4 is automatically added to the assignment.

It's possible to combine multiple filters. Ans will determine the set of exercises based on the blueprint in combination with the filters. The following filters are available:

• Labels
  Select the labels that exercises must have in order to be added to your assignment. By selecting labels, they will be included in the pool of exercises out of which Ans will select the exercises. If you want to exclude labels, you can select all other labels. By doing so, the exercises with the unselected label will not be selected.
• Exclude exercises from assignments
  Select assignments with exercises you do not want to use in your new assignment. This prevents exercises from your previous assignment from appearing again in a resit.
• Filter on feedback
  Only use closed questions in which feedback has been included. This is the feedback provided in the fields: answered correctly, answered partially correctly, answered incorrectly. This allows you to create an assignment in which participants can receive feedback on all questions, for instance for formative testing.
• Filter on p-value
  If your exercise was used in previous assignments, a p-value is calculated. The p-value is a score from 0 to 1 and represents the difficulty of the question. The higher the value, the easier the question. You have the option to set a p-value range from which exercises are chosen. This allows you to influence the difficulty of exercises for your assignment. 
• Filter on question type
  For all question types, you have the option to set how often this question type should occur.
• Filter on tag
  You can filter on tags connected to questions to select or exclude exercises from being added to your new assignment. When generating a question bank assignment, with a fixed amount of questions, first the exercises with the filtered tags are added, before adding exercises that do not match the tag filters.