Peer Review Options (using UNC Instructional Technologies)

Peer Review Tools

Using UNC Instructional Technologies

A quick comparison:

Tool Great for…
Sakai: Assignments Tool ·      Peer review of written and media assignments, as well as general peer review for group participation

·      Grading the person being reviewed by peers, NOT the peer reviewers

Sakai: Lessons Tool
(with Student Pages)
·      Anonymous peer reviews, complete with rubric ratings and comments

·      Grading both the person being reviewed AND the peer reviewer comments

·      Giving students one place to see all of their peer feedback

Voicethread ·      Ungraded peer review of individual or group presentations

·      Ungraded peer review of media objects

 

The rest of this document provides considerations and setup details for doing peer review with each tool.

 


Sakai Assignments Tool

 

Great for:

  • Peer review of written and media assignments, as well as general peer review for group participation
  • Grading the person being reviewed by peers, NOT the peer reviewers

Things to know:

  • For each peer review session, an assignment must be created for each group
  • Assignment title should include group names because all students can see an assignment even if they can’t do peer review in the assignment. For example: Peer Review #2: Group 3, Peer Review #2: Group 4
  • Can set a due date for assignment submission and the end of an evaluation period
  • Students must submit something in order to make peer review options available
  • If you want students to use a rubric for evaluation, you must upload it (along with examples of graded work) as attachments to the assignment instructions and direct students to use it in text instructions. Students cannot upload a rubric to complete their peer review; instead they must type in text comments to accompany a point score.
  • Can provide a model response for students to see
  • Students can “assign” a grade, but grades must be approved/edited and released by instructor before being recorded in gradebook
  • Group assignments cannot have peer review
  • Can specify the number of submissions a reviewer must review
  • Instructors have the option to release all grades at one time or to modify grades, insert comments, and release them individually
  • If choose to “Download all” from the gradebook, you’ll only receive a record of the grade you assigned to the student. Peer feedback information (including individual peer review grades and comments) is not included. It’s best to grade peer review assignments within Sakai.

Cautions:

  • Students don’t receive an automatic notification that the assignment is ready for peer review
  • Unless you associate the assignment with a gradebook entry, you can’t release grades or peer reviewer feedback to student
  • Peer reviewer comments and ratings are not automatically anonymous. You must choose to have peer assessment use anonymous evaluation when setting up the assignment.

Setup:

  1. Create a Peer Review Assignment for each group and name the assignment for the group
  2. Provide clear text instructions for the actions and expectations for each person concerning what to submit, how many people to review, when the review should happen, and what a good review looks like
  3. Select “Use Peer Assessment,” define the evaluation period, whether evaluations will be anonymous, the number of submissions each student must review, and upload specific text instructions
  4. Use the “Model Answer” section under “Additional Information” to provide students with a model peer review

 


Sakai: Lessons Tool (with Student Pages)

 

Great for:

  • Anonymous peer reviews, complete with rubric ratings and comments
  • Grading both the person being reviewed AND the peer reviewer comments
  • Giving students one place to see all of their peer feedback

 

Things to know:

  • Only instructors can assign grades
  • Grades can be assigned to the student being reviewed for content AND to student doing reviews for comments
  • Students can change their peer review ratings more than once
  • There is a lag when updating content and using a second private browser window to view as a student; if you don’t see your updates immediately, try again in 5-10 minutes
  • Can be hidden until ready to release (but cannot be retracted)
  • Cannot assign due dates on the calendar for comments and peer ratings, only for creating a student page
  • You can choose to make student pages anonymous or not, giving peer reviewers the option to know whose work they’re reviewing or not
  • The rubrics and comments don’t contribute to the grade of the student being reviewed; only the instructor can give a grade
  • Students can receive a grade for creating a student page
  • If you choose to associate a student page with a group rather than an individual, all students in the group will be able to edit it; this is not ideal for peer review

Cautions:

  • The rubric does not have a space to give examples of ratings in each category. We recommend you:
    • create a document with rubric examples AND that you
    • instruct students to download the examples and keep them open it in a separate browser window while doing reviews
  • If you don’t have groups set up in your course, you won’t see a link to make a page/subpage available to only a specific group; if you don’t see this, double check that you have your groups set up in Site Info > Manage Groups

Setup:

  1. Organize students into groups for peer review. This allows you to ensure each person has been reviewed by the same number of people
  2. Create a lesson page for peer reviews (and consider naming it Peer Reviews)
    1. Set up one subpage per group within the peer review lesson page
    2. Name the subpages after the groups and in the creation page, click on “Edit the groups to which this can be shown” to select the group that matches the title of the subpage
  3. On each subpage
    1. Set up student pages open date to be the same as the date the peer review lesson is released
    2. Create text instructions at the top of the page that describe to students the process they must go through to complete the peer review (create their own student page, review X number of students)
    3. Consider making student pages anonymous to dissociate identity from content (unless there is a good reason to show identities)
    4. If you choose to allow comments, make them anonymous to protect peer reviewers
    5. Provide instructions for how to submit content to be reviewed and how to review content
  4. Be sure to grade student comments yourself; the grades students assign will go into the gradebook unless an instructor/TA approves them. Grades can be edited before approval.

 


Voicethread

 

Great for:

  • Ungraded peer review of individual or group presentations
  • Ungraded peer review of media objects

Things to know:

  • Students can provide anonymous text comments or non-anonymous video/audio comments
  • Instructor review and grading can be time-intensive, especially in large courses

Cautions:

  • Instructions for how to do peer review need to be provided outside of Voicethread

Setup:

  • When uploading a document, students must remember to enable comment moderation so reviewers don’t see each others’ comments before providing their own review

Downloadable PDF: Peer Review Options