The following narrated video provides a visual and auditory representation of some of the information included on this page. For a detailed description of what is portrayed in the video, open the video on YouTube, navigate to More actions, and select Open transcript.
Video: Use question pools explains how to add a question pool to an assessment in the Ultra course view.
You can specify that a random selection of questions is presented each time a student takes an assessment.
When you create an assessment in the Ultra Course View, you can use question pools to be sure each student receives a different version of the assessment.
We’ve made some changes to assessment feature names based on user research and current industry standards. The Ultra Course View includes the new terminology that aligns with current standards.
This table lists the names of assessment question features in the two course views.
|Ultra Course View||Original Course View|
|Question pool||Random block and question set|
|Question bank||Question pool|
|Question analysis||Item analysis|
On the Add Question Pool page, you can browse, preview, filter, and select questions from other assessments and question banks in the course you're currently in. You can view the questions, but you can't make edits until you add the question pool to your assessment.
- You can use a keyword search to find questions to add.
- You choose the number of questions from a pool to display to students. For example, you can show 3 questions out of 50. The questions are then randomly distributed so each student sees a different set of 3 questions.
- After you make your selections, you set the same points possible for all questions in the pool.
- You can display all the questions in a pool. Questions appear in a random order for each student.
- You can delete questions in a pool. The question is removed from the pool, but not deleted from your course.
- In the student view, questions randomly selected from a pool appear just as other questions do. Students won't know the questions are from a pool.
You can't add question pools to assessments when these settings or conditions exist:
- You've added a rubric to your assessment.
- You've chosen to collect submissions offline.
- Students have opened the assessment.
In an assessment, select the plus sign wherever you want to add a question pool. Select Add question pool from the menu. The question pool is inserted at this point in the assessment.
On the Add Question Pool page, select the assessments, question banks, and question types you want to browse.
The Filter Criteria panel is open by default and all questions appear in the active filter area on the right. The active filter area changes automatically as you select or clear criteria. You can expand and collapse sections.
On small devices, the Filter Criteria panel is closed by default.
The information at the top of the panel shows how many sources you chose and how many total items appear to choose from. Select the X to collapse the panel and increase the area to view questions. Select Filter to open the panel.
In the Filter Criteria panel, you can perform a basic search by keyword. After you type one keyword, another field appears. Each applicable keyword may increase the number of results. Results include singular and plural forms of a word and tenses such as -ing and -ed. Partial word and contains logic won't work with this basic search.
View and select questions
On the Add Question Pool page, you can expand questions to view them.
You can't edit the questions or the point values on this page. Questions with goal alignments appear with trophy icons next to the point values. Goal alignments are added with the questions.
Select the check boxes for the questions you want to add. You can view how many items you've selected at the bottom of the screen.
Select Clear all to clear the check boxes in the Sources section. If you already chose some questions to add, those items are still ready to add. In the active filter area, clear the check boxes for the questions you no longer want to add.
Select Add Questions. The question pool appears in your assessment. Type a point value and the number of questions to display to students. The point value is assigned to each question in the pool. You can't assign separate point values for individual questions in the same pool. Select Save to add the question pool to your assessment.
You can add, remove, edit, and regrade individual questions in a question pool.
- After you save the question pool, press the Drag to reorder icon in a pool's row to move it to a new location. The question numbering updates automatically. Open the menu and select Edit to make changes to the pool such as the questions' point value.
You can use your keyboard to move an item.
- Tab to an item's Drag to reorder icon.
- Press Enter to activate move mode.
- Use the arrow keys to choose a location.
- Press Enter to drop the item in the new location.
- You can view the questions in a pool and add, remove, or regrade questions.
- Select the plus icon wherever you want to add another question pool.
To view questions in the pool, select View questions. On the Question Pool page, the number of questions in the pool is listed in the top-left area. The source assessment for each question in the pool is listed.
Before students open an assessment, you can perform these actions:
- Select Add Question in the top-right corner to return to the Add Question Pool page to browse for questions to add to the pool.
- Open an individual question's menu to remove, edit, or regrade it. When you remove a question in a pool, the question isn't deleted from your course.
When you select Edit/Regrade, a notification appears that states how many other assessments are affected. If you edit a question in a question pool, the edits appear everywhere the question is used. For example, if you change the correct answer, the question is regraded in all assessments where the question is used. The same is true for edits you make in a source assessment's questions. Those edits affect all the question pools where the question appears.
After students open an assessment or make submissions, you can't add or remove questions from a pool or delete a pool from an assessment. You can edit and regrade questions when submissions exist.
At this time, the Give full credit for question option only appears for questions that aren’t in question pools. If you apply full credit for a question in a source assessment, full credit isn’t applied to that pool question when it’s used in other assessments with submissions.
If you select Give full credit for question and then a student submits, that question automatically receives full credit everywhere it exists, even if it’s in a pool. If you clear the full credit option for the question in the source assessment, the student still receives full credit for the pool’s question.
When you give full credit for either of the preceding scenarios, you can’t change student scores for an individual question. You can override each student’s assessment score to adjust the points.
You can’t delete the source assessments for question pools from these areas:
- Course Content page
- Gradebook list or grid view
You also can't delete these items:
- Folders that contain source assessments for question pools
- Question banks used in question pools
ULTRA: Original Course View conversion
Your Original course's question sets and random blocks appear as question pools after conversion. Unsupported question types are removed. If an Original question set or random block only has unsupported question types, the set or block is removed during conversion.
You can only access your Ultra question pools in the assessment they appear in.
When you convert an Original course to Ultra, two decimal places carry over.