Peer Review Guide

Definition

For us, peer review is a broad term for a range of activities that involve students in the act of assessing and providing feedback on the work of their peers.

It can be formative, where students give feedback on each other's work before a final product is submitted, or summative, where students use the assessment criteria to mark other students' submissions.

Peer assessment is most often used with written work, but can also be used with presentations, performances, posters, videos and other types of work. It is also commonly used as a strategy for assessing group work and homework.

There are several benefits for students:

  • receive more frequent and understandable feedback than when the instructor alone provides it
  • get feedback on their drafts and be able to make improvements
  • engage in the critical analysis and reflection associated with assessing the work of their peers.

How does peer review work?

Peer assessment can take many forms, which may vary according to the learning objectives, the disciplinary context and the available technologies. Peer assessment is often characterised by a formative or summative approach.

Example of a summative peer review

  1. Students are introduced to the assignment and the assessment criteria
  2. Students are trained and practiced on how to use the scoring grid and provide feedback
  3. Students complete and submit a final assignment
  4. Students assess the assignments of 3-6 other students using the marking criteria and provide feedback
  5. The grades are determined for each student by taking the average grade given by their peers
  6. Instructor and students reflect on the activity with an emphasis on reinforcing the learning that has occurred by giving peer feedback

Example of a formative peer review

  1. Students are introduced to the assignment and the assessment criteria
  2. Students are trained and practiced on how to evaluate and provide feedback
  3. Students complete and submit a draft
  4. Pupils evaluate each other's drafts and give feedback
  5. Students reflect on the feedback received and revise their work for final submission
  6. Homework is graded by the teacher
  7. Instructor reflects on the activity with the class

How can peer assessment improve student learning?

Clarify the objectives and criteria for evaluation

The act of peer assessment forces students to look more closely at the assessment criteria and allows them to practise applying the criteria to a number of examples, enabling them to better reflect on how their own work matches the criteria. Students may have different conceptions of learning objectives and criteria than instructors (Hounsell, 1997; Norton, 1990). Through the practice of peer assessment, students will become familiar with the assessment criteria and will be aware of the features that distinguish successful performances from those that do not meet expectations.

More feedback, faster

Instructors are often unable to provide frequent detailed feedback on multiple assignments. Instructor time is cited as one of the main factors limiting increased opportunities for students to practice and get feedback on their work (Cho and Schunn 2007). In addition, students are often asked to wait a few weeks until they receive feedback from an instructor. Receiving feedback from several peers also provides potentially more diverse feedback and the opportunity to learn from different perspectives.

Learning by giving feedback

Students learn by providing constructive feedback, as it involves them in complex processes of problem solving, problem diagnosis and solution suggestions. Studies have shown that providing elaborate feedback including problem descriptions and constructed solutions is the element of peer assessment that most benefits student learning (Lie et al. 2010, 2012; Topping et al. 2013).

Increased engagement with homework

Peer assessment increases the amount of time students spend critically reflecting on an assignment by "reviewing, summarising clarification, giving feedback, diagnosing knowledge gaps, identifying missing knowledge and considering deviations from the ideal". (Topping 1998) These activities help to reinforce and deepen learning.

Active engagement

Peer assessment encourages active learning by involving students in the feedback process rather than simply being passive recipients of feedback from a teacher (Liu and Carless 2006; Cartney 2010; Nicol 2011). In doing so, they are alerted to the value of feedback rather than seeing it as a justification for a grade. Peer assessment can help provide opportunities for feedback earlier so that students can use it to improve their work by revising drafts or incorporating what they have learned into later assignments. Studies show that students are more motivated to engage with and use feedback when the immediate usefulness of that feedback is clear (Moore and Teather 2013).Opportunities to apply knowledge through practice and to receive quality feedback on that practice are known to have positive impacts on student learning (Nicol and Macfarlane-Dick 2006).

Better understanding of their own work

Students develop the metacognitive ability to reflect more critically on their own work through the assessment of their peers' work. Training and experience of peer assessment can also help to correct the detrimental effects of students over- or underestimating their own performance and can result in students becoming more independent learners, reducing dependence on feedback from instructors (Nicol, Thomson and Breslin 2014).

Lifelong skills development

Peer assessment helps students to develop lifelong transferable skills, such as engaging in critical review of their peers' and colleagues' work, communicating feedback in a constructive and positive way, learning to accept feedback from others and incorporating feedback from others into their work. This helps to prepare them to engage in such activities independently once they leave school.

peer review group

Questions to ask before a peer review?

The concept of peer review is broad and can therefore be implemented in different ways. It is therefore important to reflect on some of the basic elements that go into the design of a peer review activity in the light of the desired learning outcomes. (modified from Gielen 2010 and Topping 1998).

  • Purpose of the evaluation

    What will the students produce? (article, web page, poster, presentation, video, participation/contribution to a group project) What skills do the students need to develop and demonstrate when producing?

  • Peer review product

    What is the outcome that students create when evaluating their peers? (grades, rubric, ranking, guided questions, qualitative feedback)

  • Formative or summative

    Will the final product be peer-reviewed for a grade or will students submit a draft product for peer review which they can revise before submitting it to the teacher?

  • Rating

    How will students be graded on the assignment? Will peer assessment replace instructor assessment (substitution)? Will students receive grades or feedback from both peers and instructors (partial substitution)? Or, will the peer assessment provide additional feedback but be primarily assessed by the instructor for the final (supplementary) grade? Will you give feedback to the students or will you give a grade, with or without evaluation, for their peer evaluations?

  • Organization

    How will peer assessors be assigned (e.g. randomised, self-selected, selected by you, small group, paired). How many assessments will you ask each student to complete? Will the assessments be anonymous or will there be a dialogue between peers who assess each other?

  • Training

    How experienced and confident are students in peer assessment? How will students be trained to assess their peers' work and provide feedback? At what point in the process does the training take place?

  • Frequency and positioning

    Will there be several activities developed in a quarter or only one peer-reviewed activity? Will peer review be used to provide feedback at several stages of a larger assignment or at the end of an assignment? Will there be a "peer feedback exercise activity" to familiarise students with this? Have students' skills and familiarity been developed over a series of courses at programme level or is this type of activity unique to your course?

Good practice

  • Set expectations and clarify objectives

    Students are often anxious about peer assessment, especially when peer marking is involved, but also when it comes to giving and receiving feedback. It is important to clarify the expectations and objectives of the activity for all involved to build confidence at the beginning and to get buy-in from the students. Students could be invited to read one of the educational research studies on peer review cited in this guide.

  • Provide training for students

    Particularly for novice students, it is important to provide training activities to teach students to assess their peers' work and provide constructive feedback. This can help not only to increase students' ability to carry out peer assessments, but also to improve students' confidence in the process.

  • Evaluation and feedback model

    Model the act of assessing and giving feedback to your students by guiding them through the assessment process with some sample assignments. It is useful to provide examples of assessed work that show different levels of performance or indicate common challenges that you want students to focus on. This can be done through online modules or as in-class activities.

  • Focus on written feedback

    Although assessing peer texts using rubrics and scoring criteria can improve students' writing skills in some contexts, research shows that students consistently benefit more from providing written feedback to their peers than from any other activity that is part of the peer assessment process (Lu et al. 2012, Wooley et al. 2008).

  • Encourage elaborate feedback

    Novice reviewers tend to focus on surface feedback, concentrating on grammar or error corrections rather than substantive criteria. Giving specific instructions, training and feedback guides can help improve the quality of feedback and the resulting learning benefits. Studies show that students benefit most from constructing feedback where they not only identify strengths and weaknesses, but offer suggestions and strategies for improvement. (Patchan and Schun 2015)

  • Allow opportunities to apply feedback

    Feedback is most useful when learners act on it. Build into the set of activities opportunities for students to make revisions to their work and to reflect on how the feedback they received influenced the revisions. It may also be useful to get students to think about the feedback and revision process. Why did they accept or reject the suggestions? How did they change their work after receiving feedback? How did the evaluation of their peers' work change the way they viewed their own work?

  • Allow sufficient time and space for the process

    To encourage a deeper level of engagement, begin the peer review process early in the term so that students have sufficient time to reflect on the feedback they receive and apply it to their learning. Studies have shown that early revisions focus on substantive content-based changes, while near-term revisions involve finishing changes focusing on grammar, word substitution and spelling (Baker 2016; Cho and MacArthur, 2010). In a short 12-week course programme, the ideal design would begin peer review activities in week 3.

  • Aligning peer review with key learning objectives

    Ensure that peer assessment activities are aligned with the core learning objectives so that students are clear about how the activities benefit their learning and are not seen as an additional task of little value. Peer assessment activities require considerable time and effort on the part of students, but their strategic positioning can help to focus students' efforts and deepen their critical engagement around key learning objectives. If marks are awarded for feedback, they should be weighted sufficiently to indicate the importance of this activity.