User-guide for Peer Evaluation 1. Introduction ................................................................................................................. 3 2. Creating New Peer Evaluation ................................................................................ 4 3. Managing Evaluation ................................................................................................. 7 3.1 3.2 3.3 3.4

Edit the settings of the Evaluation .............................................................................. 8 Delete the Evaluation ...................................................................................................... 8 Checking Status of Submission .................................................................................... 9 View Students submission ...........................................................................................10

4. Moderate Evaluation and Release Result ........................................................ 12 4.1 4.2

Moderate/Edit Evaluation ...........................................................................................12 Release Evaluation Result ...........................................................................................13

5. Create/Reuse Rubric .............................................................................................. 17 5.1 5.2

Customizing Rubric from template ..........................................................................18 Creating a new Rubric from scratch ........................................................................19

6. Creating Student Groups ....................................................................................... 20

2

1. Introduction The steps for creating Peer Evaluation for students are similar to the steps for creating assessment for students. The flow chart in Fig 1 below shows the different steps for Peer Evaluation.

Instructor Create/Reuse Rubrics

Create Groups Create Peer Evaluation Assessment

Student

Check status/expedite Evaluate View/Moderate Evaluation Release Result

View Result

View Overall Result Fig 1: Flow Chart for creating eer Evaluation Page

Similar to defining eRubrics for Assessment, you will need to create eRubrics for Peer Evaluation. Please proceed to section 5 of this guide on how to create or reuse Rubrics. You will also need to group your students just like how you group your students for group assessment. Please proceed to section 6 on how to create Group Sets. Once eRubric and Group Set are being created, you will be able to create Peer Evaluation Assessment by following through section 2 to section 4 of this guide.

3

2. Creating New Peer Evaluation By default, Peer Evaluation is not added to your project site. Once you have accessed your project site, click on Manage Module button as shown in Fig 2.1

Fig 2.1: Manage Module Button Once you are in Manage Module Page as shown in Fig 2.2, select the Peer Evaluation Module and then click on Assign button.

Fig 2.2: Manage Module Page Peer Evaluation module will be added to your project site and you should be able to see the Peer Evaluation icon appearing on the top menu bar as shown in Fig 2.3. Click on Peer Evaluation icon to access Peer Evaluation Page

4

Fig 2.3: Peer Evaluation Icon Appearing on top menu bar Once you are in the Peer Evaluation Page as shown in Fig 2.4, click on New Evaluation button.

Fig 2.4: Peer Evaluation Page You will be directed to New Evaluation Page as shown in Fig 2.5.

Fig 2.5: New Evaluation Page 5

In New Evaluation Page as shown in Fig 2.6, a) Key in evaluation Name, b) Key in Description (optional field) c) Select Evaluation End Date d) Assign Weight to the assessment (eg: if you only have 1 evaluation the weight will be 100%; if you have 2 evaluations the weight of each evaluation might be 50% and etc) e) Select Group Set from the group set that you have already created (refer to section 6 on how to create group set) f) Select Rubric from the list of templates available (refer to section 5 on how to create/reuse Rubrics) g) Select if you want to allow students to do Self-Evaluation h) Configure Email Reminders to the students to submit evaluation before evaluation end date i) Configure Email Reminders to instructors on the evaluation end date and to remind them to monitor and expedite the submission before the due date j) Click Submit button when done Note: Once the evaluation end date is over, students will no longer be able to submit any evaluation.

Fig 2.3: Creating New Evalation

6

3. Managing Evaluation Click on Peer Evaluation icon as shown in Fig 3.1 and click on Manage Evaluation button to manage the Peer Evaluation(s) that you have created.

Fig 3.1: Accessing Manage Evalation Page

You will be directed to Manage Evaluation Page as shown in Fig 3.2. This page will list out all the evaluations that you have created. You could change the weightage of each evaluation by clicking on Pencil icon as shown in Fig 3.2. You could also Edit, Delete, View or Check Status of any evaluation by clicking on the respective buttons.

Fig 3.2: Manage Evalation Page

7

3.1 Edit the settings of the Evaluation You could change any of the Evaluation settings at any time by clicking on the Edit button shown in Fig 3.2. You will be redirected to Edit Evaluation Page as shown in Fig 3.1.1. Note: Very often, instructor needs to extend the evaluation end date so that students can continue to submit the evaluation again. To edit the evaluation end date, please access Fig 3.1.1.

Fig 3.1.1: Edit Evalation Page

3.2 Delete the Evaluation You could also delete any evaluation at any point of time. To delete the evaluation, just click on the Delete button in Fig 3.2 and you will be prompted with a warning as shown in Fig 3.2.1 below. Click Ok button if you decide to proceed with deletion.

Fig 3.2.1: Delete Evaluation Warning

8

3.3 Checking Status of Submission You will need to check the status of student submission before you release the result to the student. To check submission status please click Check Status button on Fig 3.2 and you will be directed to Fig 3.3.1 below. You will be able to view the students’ group, the submission status (Not attempted, Submitted) and the end of evaluation date. If you notice that students are not submitting and end of evaluation is coming, you could email the students to expedite by clicking on the Email Button.

Fig 3.3.1: Check Status Page By clicking on Email button as shown on Fig 3.3.1, you will be directed to Email Reminder Page as shown in Fig 3.3.2. Note: Email reminders with standard email message template could be configured during creating or editing of evaluation. However, if you prefer to send additional customized emails to expedite the submission, you could also compose any message as shown in Fig 3.3.2 and click on Send.

Fig 3.3.2: Email Reminder Page

9

3.4 View Students submission To View student’s submission, please click on View button in Fig 3.2 and you will be directed to Fig 3.4.1 as shown below. By default, the rating for each student shown will be based on the average rating given by all the group members who have submitted. The feedback from all students will also be consolidated and shown under the column for Qualitative Feedback as shown Fig 3.4.1.

Fig 3.4.1: View Evaluation Average Score Page You could also access Fig 3.4.1 to view students’ submission by clicking on Peer Evaluation Icon and the Evaluation Name as shown in Fig 3.4.2.

Fig 3.4.2: Accessing View Evaluation Avergae Score Page Fig 3.4.3 below shows the average rating of each student. If you want to view how a particular student is being evaluated by his peers in his group, please click on the rating of the student as shown in Fig 3.4.3. Once you click on the rating,

10

you will be re-directed to the View Detail by Evaluatee Page as shown in Fig 3.4.4.

Fig 3.4.3: Accessing View Detail by Evaluatee Page

Fig 3.4.4: View Detail by Evaluatee Page

11

4. Moderate Evaluation and Release Result 4.1 Moderate/Edit Evaluation It is compulsory for you to view all the comments by the students and to moderate it before releasing result to the students. By default, you can release the result only when 1) when the evaluation end date is over and 2) all students have evaluated. As long as evaluation end date is not over, students can re-submit multiple times and only the last submission will be recorded. As such you can edit student’s evaluation submission, by clicking on the Edit link as shown in Fig 4.1.1, only when the evaluation end date is over. To access Fig 4.1.1, please refer to section 3.4.

Fig 4.1.1: Edit link in View Evaluation Avergae Score Page When the end evaluation date is not over and you try to click on Edit link, you will get an error prompt as shown in Fig 4.1.2 below.

Fig 4.1.2: Cannot edit evaluation before evaluation end date

12

When the end evaluation date is over and you try to click on Edit link, you will be directed to a warning message, as shown in Fig 4.1.3 to inform you that once you have edited any of the student’s submission, all your students will no longer be able to re-submit. Click OK button to proceed. Note: Always remember to edit/moderate only when you have decided not to extend the evaluation end date anymore. If you still want the students to submit, please do not edit/moderate first because if you moderate a single student’s submission and decide to extend the evaluation date later, all your students will still not be able to submit even if you have extended the deadline.

Fig 4.1.3: Cannot edit evaluation before evaluation end date

4.2 Release Evaluation Result You can release the result to the student by clicking the Release Result button as shown in Fig 4.2.1. To access Fig 4.2.1, please refer to section 3.4.

Fig 4.2.1: Release Result button on View Evaluation Average Score Page

13

There are 2 conditions to release the result to the students. The conditions are 1) when the evaluation end date is over and 2) all students have evaluated. When evaluation end date is not over and you click on Release Result button, you will get the message as shown in Fig 4.2.2 below.

Fig 4.2.2: Message - Release result before evaluation end date If not all students have submitted the evaluation and you click on Release Result button, you will get the message as shown in Fig 4.2.3 below.

Fig 4.2.3: Message - Release result before all students have submitted

When the 2 conditions are met, you will be able to see the release result page as shown in Fig 4.2.4 below.

Fig 4.2.4: Release result Page It is important that you have moderated the comments from the students. If not, you could always click on “Go back to Moderate” button as shown in Fig 4.2.4 to moderate the comments. If you are ready to release the result to the students, you have to click on the Released checkbox as shown in Fig 4.2.4 before clicking on the Confirm button. As shown in Fig 4.2.4, there are also 2 permission levels that you have to set before the students can see the released result. 14

If you select View Scored Rubrics permission level, the students will be able to see the scored rubric and the consolidated comments by clicking on the View link as shown in Fig 4.2.5.

Fig 4.2.5: View Scored Rubric If you select View Grade permission level on Fig 4.2.4, the students will be able to see the grade only as shown in Fig 4.2.6.

Fig 4.2.6: View Grade

15

If you select both View Scored Rubric and View Grade permission levels on Fig 4.2.4, the students will be able to see the Scored Rubrics and the comments by clicking on the grade as shown in Fig 4.2.7.

Fig 4.2.7: View Grade and Scored Rubric

16

5. Create/Reuse Rubric You could create Peer Evaluation Rubric exactly the same way as you create any Assessment Rubric. You either create the Rubric from scratch or customize it from the list of Rubric templates available to you. To create new Rubric, click on Control Panel icon on the top menu, then click on New Rubric as shown below.

Fig 5.1: Create New Rubric from Control Panel You will be directed to New Rubric Page as shown in Fig 3.2. You can either create a Rubric from scratch or load from a list of Rubric templates available to you.

Fig 5.2: New Rubric Page

17

5.1 Customizing Rubric from template In the New Rubric Page as shown in Fig 5.1.1, a) key in Rubric Name, b) select option Load from template then select the Rubric from the list of templates available c) click update button

Fig 5.1.1: Cutomizing Rubric from Rubric Template d)

You may change the number of rows and columns of the selected Rubric and then click the Update button as shown in Fig 5.1.2.

Fig 5.1.2: Changing number of rows and columns of Rubrics e)

You may also add/delete rows and columns by selecting the row or column, then clicking on the Insert Col/Delete Col button as shown in Fig 5.1.3. For example, when you select column 3 as shown in Fig 5.1.3 and click on Insert Col button, a column will be added in front of column 3.

18

Fig 5.1.3: Inserting and deleting of rows or columns of Rubrics f) g) h)

You may also change the description of the Criteria and Performance. You may change the Weight for each Criteria to add up to total of 100% Once you are ready with your changes, click on Submit button.

Note: Please do not click on “Shared” checkbox if you do not intend to share the templates to all NTU staff. If this is checked, all staff can search for the Rubrics that you have created.

5.2 Creating a new Rubric from scratch In the New Rubric Page as shown in Fig 5.2.1, a) key in Rubric Name, b) select option Create from Scratch c) select number of Rows and Columns d) click update button e) key in description for Criteria and Performance f) assign the weight for the Criteria g) click on Submit button when you are ready

Fig 5.2.1: Creating New Rubric from Scratch 19

6. Creating Student Groups You need to group the students in your project site before they can do peer evaluation. For Peer Evaluation to work, each group must contain at least 2 students. Follow 4 simple steps as illustrated below. Step 1: In Project Info Page, click on Manage Group button as shown in Fig 6.1 below.

Fig 6.1: Project Info Page Step 2: Click on Create button as shown in Fig 6.2 to create the group set.

Fig 6.2: Manage Group Page Step 3: Give a name to the Group Set and specify how many groups you are trying to form in this group set as shown in Fig 6.3. Click the Next button when done

Fig 6.3: Edit Group Setting Page 20

Step 4: Assign the members to each group by using the Enroll and Remove Button as shown in Fig 6.4.

Fig 6.4: Enroll Group Members Page

21