Using grades and feedback from more than one grader helps to promote reliability and remove bias. For large classes, you can divide up the grading tasks among TAs and other graders. Roles with default grading privileges include instructor, teaching assistant, and grader.
The users who help you grade are called delegated graders and they provide provisional grades. Delegated graders follow the same grading steps that you do, however, the group of assignment attempts that they see are based on the options you choose. After all delegated graders provide grades and feedback, one or more instructors review the grading to determine a final grade or reconcile it.
You can combine delegated and anonymous grading. When viewing submissions you are assigned to grade, student names are hidden. To learn about enabling anonymity, see Anonymous Grading.
To view examples of setting up some delegated grading scenarios, see Best Practice: Delegated Grading Examples.
On the Create Assignment page, choose the graders to help with grading tasks.
In the Grading Options section, after you select the check box for Enable Delegated Grading, you can view a list of potential graders. Use the Show drop-down list to filter the list.
To help with accuracy and consistency of grading, have all delegated graders use a rubric when providing grades. A rubric is an assessment tool listing evaluation criteria for an assignment. To learn more, see Rubrics.
If you select two delegated graders and assign each grader a random set of submissions, each grader is notified and only sees attempt submissions that are part of their individual random sets.
You are notified of needs grading status for assignments you have been delegated in the following areas:
You can access assignment submissions that you are assigned to grade in the Grade Center and on the Needs Grading page. If anonymous grading is also enabled, see Access Anonymous Submissions to see how submissions appear in the two areas.
Both access options take you to the Grade Assignment page where you view submissions and grade inline as you normally do. On the action bar, each grader can view how many gradable items are in the queue. To learn more about inline grading, see Grade Assignments.
Each instructor has the ability to view what other graders provided for scores, feedback, and notes. Other graders do not see this information unless enabled.
After you provide a grade, the Needs Reconciliation icon appears in the Grade Center cell. No score appears until the instructor role reconciles the grade.
After delegated graders begin providing grades, instructors receive notifications that grades needs reconciling. These notifications appear in the following areas:
The instructor role reviews all grades and feedback made by graders, and determines the final grades. Regardless of how many student attempts an instructor role is assigned or even if none are assigned, all instructors can reconcile grades.
The Reconcile Grades page is accessible from several locations, including the Needs Grading page and the Full Grade Center.
The instructor role selects Reconcile Grades from the grade column's contextual menu. Other grader roles who have graded attempts see the Needs Reconciliation icon in the Grade Center, but do not have access to the Reconcile Grades page.
On the Reconcile Grades page, the instructor role can view all the grades that all graders assigned and see who has grading to perform. For large classes, filter the list by status and grader. Scores that appear with a comment icon have feedback. On this page, you accept the grades set by another -OR- review grades assigned by multiple graders and set the final grades.
After you reconcile grades, the Needs Reconciliation icons are replaced with the scores you assigned. You can view the scores and feedback each grader assigned on the student's Grade Details page in the Grade History tab. Students see their reconciled scores and feedback in My Grades. They can also click the name of the assignment to view the feedback from all graders on the Review Submission History page.
When reconciling grades, instructors have the option to not show delegated graders' feedback to students and provide their own.
Delegated graders and settings are carried over to the new course when you use the following content exchange functions:
When you copy a course without enrollments into a new course, the delegated setting is brought over as enabled for all existing delegated grading assignments. The instructor copying the course is set to grade all submissions and reconcile grades.
When you copy or import a course without enrollments into an existing course, the delegated setting is brought over as enabled for all existing delegated grading assignments. All current users who can reconcile are also set to grade all submissions.