MARKER GUIDE NOTES 2016

INTENDED FOR INTERNAL DISTRIBUTION

Contents INTRODUCTION ............................................................................................................................ 4 1.

Overview of marking process ............................................................................................................... 4

2.

Contact information ............................................................................................................................... 4

3.

Marker calendar ...................................................................................................................................... 5

4.

Responsibilities ...................................................................................................................................... 6

BEFORE MARKING ....................................................................................................................... 7 5.

Watch the Marker Administration Movie .............................................................................................. 7

6.

Updating contact details online ............................................................................................................ 7 Logging into your Marking Home page .................................................................................................... 7

7.

Pre-approval process for travel over 100 km ...................................................................................... 8

8.

Marker Pack ............................................................................................................................................ 8

DURING MARKING ........................................................................................................................ 9 9.

Receipt of answer booklets ................................................................................................................... 9 Types and uses of courier boxes and bags ............................................................................................. 9

10.

Identifying answer booklets ................................................................................................................ 10

11.

Unusual answer booklets .................................................................................................................... 10 Irregular answer booklets ....................................................................................................................... 10 Answer booklets processed as irregular ................................................................................................ 11 Answer booklets with typed separate paper, complete the following steps: .......................................... 12 Void answer booklets, complete the following steps: ............................................................................. 12 Misdirected or mislabelled answer booklets ........................................................................................... 12 Missing answer booklets ........................................................................................................................ 12

12.

Panel meeting ....................................................................................................................................... 13

13.

Grade Score Marking (GSM)................................................................................................................ 13

14.

Marking conventions ........................................................................................................................... 14

15.

Test marking ......................................................................................................................................... 15

16.

Check marking ...................................................................................................................................... 15 Sending answer booklets for check marking.......................................................................................... 16

17.

Re-marking ............................................................................................................................................ 16

18.

Marking Home page ............................................................................................................................. 16

19.

View your details .................................................................................................................................. 16

Marker Guide Notes 2016

Page 2 of 25

20.

Marking Pages ...................................................................................................................................... 17 A Allocation Summary ........................................................................................................................... 17 B Search for Candidate/Sort Pages ...................................................................................................... 17 C Control Sheet Pages .......................................................................................................................... 17 D Guinea Pig Pages .............................................................................................................................. 18 E Supplementary Pages ........................................................................................................................ 18 F Additional Pages ................................................................................................................................ 18

21.

Entering results .................................................................................................................................... 18 Initial results entry................................................................................................................................... 18 Double entry of results ........................................................................................................................... 18 Mark Sheet Entries page ........................................................................................................................ 19 Completion of marking and final submission of results .......................................................................... 19

22.

Booklets requested by NZQA.............................................................................................................. 19

23.

Search for Candidate ........................................................................................................................... 20 Locate an answer booklet complete the following steps: ....................................................................... 20 To transfer a result entry line to yourself complete the following steps: ................................................ 20

24.

Forms and guide notes ........................................................................................................................ 22

25.

Cut score setting .................................................................................................................................. 22

AFTER MARKING ........................................................................................................................ 23 26.

Marker report ........................................................................................................................................ 23

27.

Marking evaluation ............................................................................................................................... 23

28.

Final Pick-up of answer booklets ....................................................................................................... 23 Courier tracking ...................................................................................................................................... 23

29.

Remaining materials ............................................................................................................................ 24

30.

Marker claims........................................................................................................................................ 24 Completing your claim online ................................................................................................................. 24

Marker Guide Notes 2016

Page 3 of 25

INTRODUCTION 1. Overview of marking process •

Receive a contract for marking and Marker Guide Notes Outline 2016 from June.



Check and update contact details online by 21October.



Receive Marker Pack containing stationery and courier items in early November.



Receive and check off answer booklets in several consignments post-examination.



Attend panel meeting for detailed instructions before marking begins.



Test mark 40 answer booklets following panel meeting and enter results online.



Wait for panel leader approval to continue marking and entering further results.



Following check marking feedback, if required change results on answer booklets and online.



Double enter results online only when approval given by panel leader.



On request, send a selection of answer booklets to panel leader for cut score setting.



Wait for panel leader approval before couriering all remaining marked answer booklets to NZQA c/o Printlink.



Submit Marker Report and Marking Evaluation Form.



Submit marker claim online.

2. Contact information New Zealand Qualifications Authority (NZQA) Marker helpline

0800 697 296

[email protected]

8 am–5 pm weekdays

And ask for marker helpline

NZQA physical address

Level 14, 125 The Terrace, Wellington 6011

NZQA postal address

PO Box 160, Wellington 6140

NZQA Freepost

Freepost 3221, PO Box 160, Wellington 6140

Return delivery address for answer booklets

NZQA c/o Printlink, 33 Jackson Street, Petone, Wellington 5012

CourierPost

0800 501 504

Marker Guide Notes 2016

https://www.courierpost.co.nz

Page 4 of 25

3. Marker calendar August

Check and update contact details on NZQA website. Read Marker Guide Notes 2016.

Fri 21 October

Last day to change addresses online. To change an address after 21 October, you must notify the Marker Helpline.

Wednesday 26 October

Last day to email Pre-approval Travel Request Form to NZQA at [email protected]. Please note if this is not received your claim may be delayed.

Friday 4 November

If Marker’s Pack has not arrived, contact Marker Helpline.

Early November

Watch the marker movie online at Online Marking Processes and Administration Movie.

DURING MARKING Receive answer booklets in several consignments 3–7 days post-examination. Check off all answer booklets received on Answer Booklet Control Sheets. Return misdirected answer booklets to NZQA c/o Printlink immediately using pre-addressed yellow courier bags. November/December

Attend panel meeting. Begin marking, following the panel leader’s Marking Timeline. Enter results daily online using the Marking Pages. Send check marking to panel leader or check marker. Act on feedback changing results, if required, on answer booklets and online.

Tuesday 13 December

Last day answer booklets delivered to a school or workplace address. After this date, all deliveries will be to a home address.

Friday 16 December

Additional Pages, if required, will appear online. Final Submission button will appear online once all marking pages are completed.

Wednesday 21 December

Final Submission button must have been clicked. Final results submission for all examinations.

AFTER MARKING 16, 19, 20, 21, 22, and 28 CourierPost collect answer booklets. No pick-ups on 17, 18, or 23 December. December Book pick-ups by noon for pick-up by 5.30pm. Preferred final pick-up date of marked answer booklets. Wednesday 21 December

Marker Report emailed to the panel leader. Marking Evaluation Form emailed to [email protected].

Wednesday 28 December January 2017

Final pick up of answer booklets. Pickup must occur before midday. Return all unused stationery and courier items to NZQA. Destroy all other examination-related materials after checking for answer booklets.

Friday 20 January 2017

Marker Guide Notes 2016

Last day for submitting marker claims online for payment by 1 March.

Page 5 of 25

4. Responsibilities National Assessment Facilitator (NAF) has overall responsibility for: • all marking processes associated with their subjects • appointment and contracting of all markers. Operations Officer (OPO) has responsibility for: • supporting the NAF in the organisation of marking processes • the administration of marking processes. Panel leader has responsibility for: • all aspects of marking as outlined in their contract for marking • conducting the benchmarking process • organising the benchmarking meetings, panel meetings, and cut score meeting • liaising with the examiner and the NAF • the organisation, briefing, and operation of a panel of markers as outlined in their contract for marking • the quality control of marking through the consistent application of the assessment schedule by markers on the panel • monitoring the quality and progress of result entry online • writing the final assessment schedule and Panel Leader’s Report for the examiner • fulfilling their check marker and marker responsibilities as listed below. Co-ordinating panel leader has additional responsibility for: • the organisation and operation of multiple panels • ensuring that interpretations made for the same achievement standard are applied to all panels. Marker has responsibility for: • all aspects of marking as outlined in their contract for marking • following all processes and procedures in these guide notes • attending all panel meetings • ensuring that all answer booklets are marked according to the assessment schedule, marking conventions, and any other instructions provided by the panel leader • ensuring that all answer booklets are marked consistently and fairly • entering results online daily • ensuring that answer booklets and online result entries are free from marker errors and omissions • responding immediately to instructions and advice given by the panel leader or check marker regarding check marking, and re-marking if required • undertaking and completing any re-marking as necessary • meeting all deadlines • writing and emailing a Marker Report to the panel leader • maintaining the security and confidentiality of all answer booklets, associated marking material, and all work in connection with the examination. Check marker has additional responsibility for: • supporting the panel leader in the organisation, briefing, and operation of a panel of markers • completing check marking as specified by the panel leader. Marker Guide Notes 2016

Page 6 of 25

BEFORE MARKING 5. Watch the Marker Administration Movie You must login and watch the Online Marking Processes and Administration Movie. A link to this movie is available from your Forms for Markers page. This movie provides a comprehensive step by step guide to all of the administrative processes required for marking. Please note due to changes in courier scheduling the 12.30 pm pick up time notified in the movie is not correct. The correct cut off time for booking a same day pick up is 12.00 pm.

6. Updating contact details online You must check your school delivery address, using the NZ Post address spreadsheet at https://secure.nzqa.govt.nz/for-partners/marker/view-forms.do. The school delivery address recorded on your NZQA Details page must be the same as the address from the NZ Post address spreadsheet. CourierPost will not leave answer booklets at an address if nobody is available to sign for the delivery We strongly recommend that you use a school address for answer booklet deliveries before 13 December. After 13 December any further answer booklet deliveries will be made to your home address. Your home delivery address must be checked against the address checker at https://www.courierpost.co.nz/tools/address-checker/. The home delivery address recorded on your NZQA details page must be the same as the address from the address finder. It is highly desirable that the confirmed address used for check-marking pick-up and delivery is an urban school address rather than a rural or RD address. Rural area deliveries will take up to 3 days. 21 October is the last date to check and update your answer booklet delivery address. The data file for delivery addresses is prepared on 21 October. After 21 October, the file does not automatically update after any changes that you make online. To ensure you receive your answer booklets, you must notify the Marker Helpline of delivery address changes made after 21 October.

Logging into your Marking Home page To change your details with NZQA go to http://www.nzqa.govt.nz/login/. On the Login page, click on All other users Login and enter your user name/ID and password. Select Marking Home, then click on View your Details.

Marker Guide Notes 2016

Page 7 of 25

7. Pre-approval process for travel over 100 km The marking incidental fee covers the first 100 km of travel to panel and any other marking meetings. If your travel is likely to exceed 100 km and you require payment for the extra kilometres, you must request pre-approval from your NAF. Download and complete a Pre-approval Travel Request Form and email to your NAF at [email protected] by 28 October, with ’PTRF Subject’ in the subject line. E.g. PTRF English. Payment is conditional on pre-approval being recorded by NZQA. Where you claim for travel over 100 kilometres, and a Pre-approval Travel Request Form has not been completed your claim may be delayed.

8. Marker Pack A marker pack containing stationery and courier materials will be sent to your home address in early November. It contains: •

a cover letter



adhesive tape for resealing answer booklet boxes



envelopes and labels −

two small and two large Freepost envelopes for returning materials to NZQA



ten pink courier bags for sending answer booklets to and from the check marker or NZQA



two yellow courier bags pre-addressed to NZQA c/o Printlink for misdirected answer booklets



two Saturday Delivery prepaid tickets and two fluoro Saturday Delivery stickers for courier bags.

If anything is missing, or if a pack is not received by 4 November, contact the marker helpline.

Marker Guide Notes 2016

Page 8 of 25

DURING MARKING 9. Receipt of answer booklets CourierPost will deliver the answer booklets 3–7 days post-examination. They are likely to arrive in several consignments. If a person is not available to sign for a consignment, CourierPost will not leave the booklets but will leave instructions to arrange delivery. If unmarked booklets are dropped off without a signature, advice the NZQA co-ordinator at CourierPost. Markers may receive answer booklets in four ways: •

most in pink boxes within a week of the examination



some in blue boxes (selected markers only)



some late ones in pink courier bags



some by hand from the panel leader.

As soon as you receive your answer booklets do the following: •

Locate the Answer Booklet Control Sheets in the first box of each consignment and check the answer booklets off in the received column, keeping them in the same order for marking and entering results.



Keep the Answer Booklet Control Sheets as your record of receipt and for recording results before sending answer booklets for check marking.



Keep the contents of any plastic bag together, and after processing return answer booklets in plastic bags at the top of a box.



Call the Marker Helpline immediately if any answer booklets are damaged in transit.



Stick the NZQA c/o Printlink return courier label over your address label.



Keep the boxes to send answer booklets back when marking is complete.



Keep all answer booklets safe and secure.

Types and uses of courier boxes and bags Pink boxes (signature required): •

sending you the bulk of your answer booklets



returning all your answer booklets at the end of marking.

Pink courier bags (signature required): •

sending you late answer booklets for marking.

Blue boxes (signature required) for selected markers only: •

sending you some of your answer booklets



returning your answer booklets (using the instructions within them).

Pink courier bags (non-signature required): •

sending and returning check marking



returning marked answer booklets requested by NZQA



sending irregular answer booklets to your panel leader.

Yellow courier bags (non-signature required): •

returning misdirected answer booklets to NZQA via Printlink.

Marker Guide Notes 2016

Page 9 of 25

10.

Identifying answer booklets

All answer booklets used by candidates will be personalised with a barcode. The example below shows the data contained on the barcode for a question and answer booklet. Exam Centre CodeExam Code

Marker Code

Booklet Code

Candidate Sort Code

NSN Code (National Student Number)



The Exam Centre Code consists of the number of the examination centre where the candidate sat the examination, followed by an Exam Code for a specific candidate at that centre.



Your Marker Code consists of four numbers and the letter A.



The Candidate Sort Code assists with the sorting of answer booklets back to candidates.



The NSN (National Student Number) is the candidate’s unique identification number.



The Booklet Code indicates the achievement standard number. If it is not a combined question and answer booklet: −

A denotes an answer booklet only



Q denotes a question booklet only



R denotes a resource booklet.

11.

Unusual answer booklets

Irregular answer booklets An irregular answer booklet is one with disturbing content, or one in which you suspect collusion, copying, or other misconduct (e.g. offensive language, use of additional pieces of paper). An answer booklet you believe is irregular should be sent to your panel leader immediately. If you find an irregular answer booklet complete the following steps. •

Mark it as usual and enter the result online including double entry.



Download and complete an Irregular Answer Booklet Form (ensuring your comments are professional and based on evidence as they could later be read by the candidate).



Print and sign the form and send it with the answer booklet to your panel leader immediately using a pink courier bag.

Your panel leader will investigate and tell you what action they are taking; the answer booklet will not be returned to you.

Marker Guide Notes 2016

Page 10 of 25

Answer booklets processed as irregular Damaged answer booklets If an answer booklet is damaged in transit or during marking, complete the following steps. •

Mark it as normal and enter the result online.



Download and complete an Irregular Answer Booklet Form, and send it with the answer booklet to your NAF at the address on the form, using a pink courier bag.

Non-personalised answer booklets A non-personalised answer booklet is one with no barcode and will usually have the candidate’s NSN, Exam Centre Code, and Exam Code written on the cover instead. If it contains candidate answers, complete the following steps: •

Mark it as usual.



Use the Search for Candidate function to enter the result online.



Download and complete an Irregular Answer Booklet Form, and send it with the answer booklet to Logistics, Level 14, NZQA, 125 The Terrace, Wellington 6011 using a pink courier bag.



If you cannot find a result entry line call the marker helpline.

Supplementary paper enclosed with answer booklet, complete the following steps: Any supplementary paper must have the exam supervisor’s name or signature on it and look like the example below.



Mark both as usual, enter the result online, and return to the plastic bag.



If the supplementary paper does not have the exam supervisor’s name or signature on it, download and complete an Irregular Answer Booklet Form, and send it with the answer booklet and supplementary paper to your NAF using a pink courier bag.

Two answer booklets, one with and one without a bar code, complete the following steps: •

If both have been written in, clip them together, mark both as usual, record the result on the front cover of the first answer booklet, enter the result online, and return to the plastic bag.



If only the barcoded answer booklet has been written in: mark it as usual, enter the result online, and return to the plastic bag, and then destroy the non-barcoded answer booklet.



If only the non-barcoded answer booklet has been written in: write the candidate’s NSN on the cover, mark it as usual and enter the result online. Download and complete an Irregular Answer Booklet Form, and send it with both answer booklets to Logistics, Level 14, NZQA,125 The Terrace, Wellington 6011 using a pink courier bag.

Marker Guide Notes 2016

Page 11 of 25

Answer booklets with typed separate paper, complete the following steps: •

Write the NSN on the top of the separate paper.



Mark the answer booklet and separate paper as usual and enter the result online.



Staple the separate paper inside the answer booklet and return to the plastic bag.

Void answer booklets, complete the following steps: Void answer booklets are either blank inside, or the whole response has been completely crossed out by a candidate. They should be marked using the following conventions. •

Contain each page by putting a diagonal line across it with red pen.



On the front cover write Void, and write V in the total box with red pen, as shown below.



Enter the result as V on your Marking Pages.



Misdirected or mislabelled answer booklets •

For a standard you are not marking, send it to NZQA c/o Printlink immediately using a preaddressed yellow courier bag.



For your standard but has another marker code, mark it as normal and enter the result online using the Search for Candidate function.



Booklet answered in Te Reo Māori but has your marker code, send it to your panel leader using a pink courier bag.



Answer booklet is not on your marking pages, has your marker code, and is for your standard, complete the following steps: •

Mark it as usual.



Use the Search for Candidate function to enter the result.



Record the result manually on your Answer Booklet Control Sheet.

Missing answer booklets If answer booklets are missing from your boxes complete the following steps: •

Record as Z on your Answer Booklet Control Sheet.



Enter the result online as Z.



If you receive the answer booklet, mark it as normal and enter the correct result online by overwriting the Z result.

Marker Guide Notes 2016

Page 12 of 25



12.

If a Y appears on your Marking Pages, it indicates the candidate did not sit this exam; do not overwrite this.

Panel meeting

You must attend the panel meeting. The panel leader will confirm details for the meeting. Take along a red pen, the Marker Guide Notes Outline 2016, and your Marker Pack. You must not begin marking until approval has been given by the panel leader. The purpose of the panel meeting is to: •

ensure that you have a clear understanding of the achievement standard and assessment schedule



establish consistency in marking using benchmarking scripts provided by the panel leader.

The panel leader will provide a marking timeline, examination paper, achievement standard, current assessment schedule, and benchmarking scripts at the meeting.

13.

Grade Score Marking (GSM)

Each question is awarded a single grade score. N NØ

N1

A N2

A3

M A4

M5

E M6

E7

E8

The grade score is awarded using the criteria from the standard. It is based on the whole response to each question and should take account of all evidence. A question with no response or relevant evidence will receive NØ, but an answer with some evidence (insufficient for Achieved) must receive N1 or N2. Acknowledge what the candidate knows and can do. Do not mark what the candidate does not know or cannot do. A high quality response should not be marked down for a minor error. The total score from adding together the scores for all questions is written on the front cover of the answer booklet. You must check that the sum is accurate.

‘Top down’ marking The ‘top down’ marking system is consistent with standards-based assessment. For each question, first look for evidence of Excellence. Where sufficient evidence for Excellence is found, award the grade. Sufficiency of evidence against the criteria in the standard is paramount.

Marker Guide Notes 2016

Page 13 of 25

14.

Marking conventions

Record the grade score in the box at the end of each question, e.g. M5, then write the two-digit total score (with no letters) in the total box on the front cover of the answer booklet, e.g. 05. •

Check that the total is the correct sum of all of the grade scores.



Use only a red pen for marking (but if a candidate has written in red then use a blue pen).



Do not use correcting fluid or pencil.



Do not write any words or codes, unless specifically directed to by the panel leader.

The following containment conventions prevent candidates from altering answer booklets submitted for reconsideration. You must use these conventions.

• • •

Put a diagonal line through all blank spaces and blank pages in answer booklets, and both sides of any supplementary paper. Double slash // as close as possible to the end of the candidate’s responses. Circle where a candidate has used pencil or correcting fluid and write this adjacent to the response and on the front cover of the answer booklet.

Marker Guide Notes 2016

Page 14 of 25



If you change any grade score, cross it out, write the corrected result and initial it. If necessary, also cross out, rewrite and initial the corrected total in the box on the front cover of the answer booklet (as above) and ensure the result entered online is also corrected.



Do not write comments for the check marker in the answer booklet, use sticky notes instead and ensure they stick out so you can easily remove them later.

15.

Test marking

Following the panel meeting, markers test mark 40 answer booklets and enter the results online. You must stop after marking 40 answer booklets and not mark any more until the panel leader has finalised the assessment schedule and given approval to continue marking. For multi-question answer booklets, return the result of this marking to your panel leader on the Test Marking Summary Form (downloaded from the Forms and Guide Notes section of Marking Home) so they can see the spread of grade scores for each question.

16.

Check marking

Check marking is the process that ensures consistency of marking. Your panel leader will explain the check marking procedures and timeline at the panel meeting. All markers, including panel leaders, are required to submit a percentage of answer booklets for check marking. Feedback from your panel leader or check marker may require you to go back over earlier marking and make some changes to ensure consistency with the standard. This is a normal part of marking. If check marking changes a total score, you must change the online result. You must confirm with the panel leader or check marker that this has been done. While waiting for check marking feedback you should continue marking, but do not enter more results online as you may need to change them.

Marker Guide Notes 2016

Page 15 of 25

Sending answer booklets for check marking Select a group of consecutive answer booklets which includes 30 that are ‘live’ (i.e. contain responses) from an Answer Booklet Control Sheet to send for check marking. Tick the CM Sent column and record the result of each answer booklet you are sending on your Answer Booklet Control Sheet. Attach the Sender Tracking / For Customer Use portion of the courier tickets to your Courier Tracking Sheet. Book a courier pick up by 12 noon for pick up by 5.30 pm on the same day, or after 12 noon for pick up the next day. Booking a pick up can only be done Monday to Friday. If Saturday delivery of check marking is required you must make the booking before 10.00am on Friday and attach a Saturday delivery sticker to the courier package. If a Saturday delivery sticker is not attached the package will not be delivered on Saturday. Saturday delivery is arranged if the panel leader requires it. Saturday delivery is only available in metropolitan areas. A Saturday pick-up is not possible. Call CourierPost immediately if there are any courier problems. If there are recurring problems call the marker helpline.

17.

Re-marking

In the unlikely event that the final results across all markers for a standard are unjustifiable, all answer booklets may need to be re-marked either fully or in part. The decision to re-mark is made by the Manager, Secondary Examinations, after consultation with the NAF and the panel leader. Markers will be paid on a pro rata basis depending on how many questions and answer booklets need to be re-marked, and how long this takes.

18.

Marking Home page

When you log in and click on Marking Home, the top area of the screen displays messages to markers which you should always check. The following links appear on your Marking Home page, and are explained in detail below: •

View your Details



Marking Pages −

Result Pages for Marker Code xxxx



Booklets returned to NZQA



Search for Candidate



Forms for Markers.

19.

View your details

Change personal details such as email, phone numbers, and addresses using this screen. After 21 October notify the marker helpline of any change of address. Online changes made after 21 October will not change the address to which your answer booklets will be delivered.

Marker Guide Notes 2016

Page 16 of 25

20.

Marking Pages

Below is an example of the online Marking Pages, with explanations

A B C D E F A Allocation Summary This table provides a summary of the entries which should appear on your Marking Pages.

B Search for Candidate/Sort Pages The Search for Candidate link finds the location of a result entry line on your Marking Pages. Do not use the Sort Pages function unless your NAF asks you to, because the sort cannot be undone. It re-sorts the entries on the Marking Pages into Exam Centre Code/Exam Code order.

C Control Sheet Pages Each Control Sheet Page has one line. The number of answer booklets per page is up to 40, shown in the Entries column. The Page Order column shows either C if the answer booklets are in Answer Booklet Control Sheet order, or E if they are in Exam Centre Code/Exam Code order. As marking progresses, new pages may appear. NZQA may reallocate pages to you from another marker, they will appear at the end of your Control Sheet Pages, highlighted with a red asterisk.

Marker Guide Notes 2016

Page 17 of 25

D Guinea Pig Pages These pages list answer booklets that have not been through the main sorting process. They went directly to the panel leader and will be given to you at the panel meeting. Sort these manually into Exam Centre Code/Exam Code order because they will be listed like this on the Guinea Pig Pages.

E Supplementary Pages Supplementary Pages will only appear when you reallocate an answer booklet from another marker to yourself.

F Additional Pages Additional Pages may appear from 16 December. As soon as these pages appear, if you do not have an answer book listed on the page enter Z. Other result entry lines may be for answer booklets you have marked but could not enter elsewhere, so enter their results here. All pages, including Additional Pages, must show as Complete before the Final Submission button will appear.

21.

Entering results

To enter results click on Result Pages for Marker Code xxxx on your Marking Home page to display your allocated Marking Pages.

Initial results entry All results must be entered from the front cover of the answer booklet. To enter results, click on Not started or In Progress on the relevant page listed in the Initial Entry column. This will display the Mark Sheet Entries page (see below). Enter candidate results. Results less than 10 require a zero for double figure entry i.e. 03, 06, 09. Some pages may have an initial status of In Progress where NZQA has entered a Y for a candidate who was absent for the examination. If there are two separate lines on your Marking Pages for the same answer booklet, enter the result on one line and enter a Z (missing) on the other line. Any results entered on a page must be saved by clicking on Save. When you have entered a full page of results and clicked on Save, the status on the Marking Pages screen will show as Complete. Initial Entry pages showing as Complete are still updatable until you save a result on the corresponding Double Entry page. Once a result has been saved on the Double Entry page the Initial Entry page will be locked and no longer editable and will appear as Complete.

Double entry of results Results for each page must be entered twice. Your panel leader will give approval to double enter your results. All double entry results must be entered from the front cover of the answer booklet to ensure the correct result is entered. Results should not be copied from a Control Sheet Page or other record, as any error will be repeated. Click on Not Started or In Progress for the page shown in the Double Entry column to double enter the results. The process for double-entry of results is the same as for the process for entering initial results. Once you have completed making entries on a page, click on Save to continue. If the Marker Guide Notes 2016

Page 18 of 25

Mismatch screen is displayed, the double entry result displayed does not match the initial result and you need to recheck the answer booklet and enter the correct result.

Mark Sheet Entries page

Completion of marking and final submission of results The Final Submission button will appear on screen from 16 December when all your Marking Pages, including any Additional Pages, are completed. Your panel leader will give approval to click the Final Submission button. When you are certain no more edits are required, click the Final Submission button. You are asked to confirm, and if you answer Yes, your entries are complete. The message ‘The final submission is now complete. Pages can be viewed but not edited.’ will appear. If you need to unlock the pages call the Marker Helpline. All results must either be entered online or recorded using a Supplementary Result Sheet/Change of Result Sheet (downloaded from the Forms and Guide Notes section of Marking Home). The Supplementary Result Sheet/Change of Result Sheet should be sent with the answer booklet to NZQA c/o Printlink at the completion of marking. Keep a copy for your records. Wednesday 21 December is the final results submission date for all examinations.

22.

Booklets requested by NZQA

Answer booklets may be requested by NZQA in connection with possible breaches of examination rules. The message ‘NZQA requires the return of booklets’ will appear beside the Booklets returned to NZQA link on your Marking Home page. This message will disappear once the requested answer booklets have been checked off in the Booklets returned to NZQA screen. You will also be sent a letter and prepaid envelope to follow up this online request. Marker Guide Notes 2016

Page 19 of 25

If you receive this request you must immediately complete the following steps. •

Find the answer booklet in your allocation by using the Search for Candidate link.



Mark it as usual.



Enter the result online on your Marking Pages, and record it on the Answer Booklet Control Sheet.



Send the answer booklet to NZQA using the prepaid envelope.



If you have not yet received the booklet, wait until the final week of marking and if it still has not arrived, complete the form at the bottom of the letter and return it in the prepaid envelope.

23.

Search for Candidate

Use the Search for Candidate link to locate an answer booklet requested by NZQA or one from your own allocation, and to transfer a result entry line from another marker’s allocation to yours to enter a result.

Locate an answer booklet complete the following steps: •

Click on Search for Candidate.



Enter either the candidate’s NSN or both their Exam Centre Code and Exam Code.



Select the relevant standard number from the drop-down list.



Click on Search.



If the candidate is located, you will see their entry on the Control Sheet Page.



If the candidate is not located, there will be a notification message.

To transfer a result entry line to yourself complete the following steps: •

Click on Search for Candidate.



Enter either the candidate’s NSN or both their Exam Centre Code and Exam Code.



Select the relevant standard number from the drop-down list.



Click on Search.



If the candidate is located, the details of the requested answer booklet will appear.



Click on Accept.

Marker Guide Notes 2016

Page 20 of 25

The result entry line will be transferred (your name and marker code will appear) and you can add a result by clicking on Edit and then on Save.

When you transfer a result entry line from another marker to yourself a Supplementary Page will be created on your Marking Pages. Additional answer booklets transferred from other markers to you will appear on this Supplementary Page until there are 40 result entry lines, when a new Supplementary Page will be created.

When you transfer a result entry line from another marker to yourself warning messages might appear. •



‘Warning: forbidden learner’ or ‘Warning: forbidden provider’ mean the result entry line belongs to a specific candidate indicated as forbidden, or a candidate from a school indicated as a forbidden provider. −

Do not mark the answer booklet.



Send it to your panel leader who will reallocate the result entry line.

‘Reallocation failed: result code already present’ means a marker has already entered a result for this candidate for the same standard. −

Check that you have entered the NSN correctly.



If you are still unable to transfer the result entry line, mark the answer booklet as normal and email the result and the NSN to your NAF.



Download and complete an Irregular Answer Booklet Form and include the other marker’s code, the candidate’s NSN, and the standard number.



Send the form and answer booklet to your NAF using a pink courier bag.

If you cannot find a result entry line on the Marking Pages after using Search for Candidate, wait until 16 December when Additional Pages become visible. If there is still no result entry line, download and complete a Supplementary Result/Change of Result Sheet, copy it for your records, then email it to your NAF.

Marker Guide Notes 2016

Page 21 of 25

24.

Forms and guide notes

Forms specified in the Marker Guide Notes 2016 for use during the marking and results entry process can be downloaded from the Forms and Guide Notes section of Marking Home, then completed and emailed to your panel leader or NAF. Forms and guide notes available include: •

Marker Guide Notes 2016



Marker Guide Notes Outline 2016



Pre-approval Travel Request Form



Irregular Answer Booklet Form



Test Marking Summary Form



Supplementary Result Sheet/Change of Result Sheet



Marker Report Form



Marking Evaluation Form.

25.

Cut score setting

For multi-question answer booklets, when acceptable consistency has been reached late in the marking process, markers will be asked to send a selection of marked and double entered answer booklets to the panel leader for the cut score meeting. The answer booklets will not be returned to markers. You must send these booklets to the panel leader. It is essential to the completion of marking that you send these booklets as requested. The cut scores for each grade boundary are recommended by the panel leader and a senior marker to align with the standard using the assessment schedule, benchmarking scripts, and their professional judgement. The NAF approves the final cut scores.

Marker Guide Notes 2016

Page 22 of 25

AFTER MARKING 26.

Marker report

Download and complete a Marker Report Form and email it to your panel leader by 21 December (or earlier if requested). Keep notes during marking to assist with the completion of this report.

27.

Marking evaluation

Download and complete a Marking Evaluation Form, and email it to [email protected] by 21 December. Use Evaluation, the subject and standard number in the subject line. E.g. Evaluation English 91472. If you have experienced any specific issues with the courier service, include your marker code and address in your feedback.

28.

Final Pick-up of answer booklets

The panel leader will give approval for the courier collection of marked answer booklets. Before couriering; remove sticky notes, align spines, and do not crease or fold answer booklets before repacking them in boxes. At this stage the answer booklets do not have to be in order. Place answer booklets in plastic bags at the top of the boxes. If you have blue boxes fill these first. Do not put plastic bags in blue boxes. Attach the Sender Tracking / For Customer Use portion of the courier tickets to your Courier Tracking Sheet. If you use extra boxes address them to NZQA c/o Printlink. The courier will apply the return ticket for you. Book the pick-up of all answer booklets with CourierPost by 12 noon for pick-up by 5.30 pm, or after 12 noon for pick up the next day. Ensure all boxes have NZQA c/o Printlink return courier label covering your address label. CourierPost will collect from nominated pick-up addresses on 16, 19, 20, 21, 22, and 28 December. Before noon on 21 December you must make arrangements with CourierPost to pick-up boxes. Before 21 December you must make arrangements with CourierPost to drop off boxes at a CourierPost depot. If your boxes are not picked up by 22 December, you must arrange a pick-up between 8 am and 12 noon on 28 December. If boxes have not been collected by 12 noon on 28 December, call CourierPost. Do not return split consignments. All of your boxes of answer booklets must be picked up by CourierPost or dropped off at CourierPost in one consignment.

Courier tracking To track the courier consignments complete the following steps. •

Log on to www.courierpost.co.nz.



Enter the consignment number (from the Sender Tracking Label portion of the courier ticket) in the Track & Trace field.



Click on Trace Now.



View the date and time of pick-up, the courier identification, and delivery status.

Marker Guide Notes 2016

Page 23 of 25

29.

Remaining materials

Return all unused stationery and courier items to NZQA during January 2017. Check for live answer booklets and then destroy all other examination-related materials.

30.

Marker claims

Payment for marking will be made under the terms of the marker’s contract. Marker claims can be made online, and if accurately submitted by 20 January 2017, they will be paid by 1 March 2017. You can print a copy of your claim from the NZQA website at any time. If a marker claim is not complete payment may be delayed. Any claims for postage, couriers, telephones, and meals must have a GST receipt. NZQA is unable to pay for items that are classified as capital expenditure (e.g. filing cabinets and computers) or tax deductible (e.g. printer paper and cartridges).

Completing your claim online Log in, go to Marking Home, and click on Claim Details (this button will appear towards the end of marking) and then on Start Claim. If the contract drop-down list is not panel leader, marker, or check marker call the Marker Helpline. If you have different marking roles on separate panels (e.g. panel leader on one panel, marker on another) call the Marker Helpline before you make the second claim. Enter your claim entitlements on the Payment Information page, as below. Claim type If you are submitting a GST invoice for your services, select the GST Invoice option. Otherwise, leave the Normal Claim option selected and choose the payment method.

Booklet marking If you marked more than one standard, there will be a line for each. The Returned box will contain the number of answer booklets for which you entered results (including V booklets). Z booklets are not included. If you were a check marker, enter the number of answer booklets you check marked in the Marked box, and note this in the Notes box. Marking Fees Tick the Marker Administration fee and Marking Incidentals boxes.

Marker Guide Notes 2016

Page 24 of 25

Click on Save. A summary of the claim will appear for you to check. If you need to change any details, click on Edit Claim Information, make the changes, and click on Save again. Check the accuracy of all information to avoid delays in your claim being processed. When the claim is correct, tick the confirmation box, and then click on Submit Claim.

A confirmation message will appear. You cannot edit the claim any further. If you need to change something, call the Marker Helpline. If you have receipts to submit, print out a copy of your completed claim form, attach the receipts and post to NZQA in an envelope from your Marker Pack. Receipts must be itemised, and include the GST number. EFTPOS receipts without a GST number will not be accepted. This might delay payment of your claim. Tracking claims. To track your claim, log in and click on Claim Details. A message will appear which indicates the current status of your claim. The initial status will be Submitted, which changes to Approved, and then to Sent for Payment. If NZQA requires additional information you will be contacted and the status will be On Hold. This might delay payment of your claim.

Marker Guide Notes 2016

Page 25 of 25