Office of Assessment and Accountability Kentucky Department of Education

August 2011

1

Allegation Inappropriate Assistance/Intervention by Staff Test Security (Staff) Test Security (Student) Out of Order (Staff) Out of Order (Student) Special Education Student Action Missing Test Booklets Other

# of Incidents

August 2011

2

Allegation Inappropriate Assistance/Intervention by Staff Test Security (Staff) Test Security (Student)

# of Incidents

35 40 5

Out of Order (Staff)

27

Out of Order (Student)

54

Special Education

46

Student Action

18

Missing Test Booklets Other

6 37 August 2011

3

 To

review the appropriate practices for the state assessment system as defined in the Administration Code for Kentucky’s Educational Assessment Program (703 KAR 5:080) Revised September 2009

 To

review the Inclusion of Special Populations in the State-Required Assessment and Accountability Programs (703 KAR 5:070) Revised February 2009 August 2011

4

I. II. III. IV. V. VI.

Rationale Appropriate Assessment Practices Violations of the 703 KAR 5:080 Administration Code Review of Secure Assessment Components Proper Reporting of Nonacademic Indicators Signature Page

August 2011

5

ACCEPTABLE

NOT ACCEPTABLE From the Regulation

Positive Statement  Aligns  Topic Change appears below line in regulation 



New or Clarified information in Bold Blue

Negative Statement  Aligns  Topic Change appears below line in regulation 



New or Clarified information in Bold Blue

From the PowerPoint August 2011

6

Multiple state-required assessments 1.

Professional Ethics

 704 KAR 20:680 2.

Educational Defensibility

 Teach the content 3.

Student Ownership  All work done entirely by the student

August 2011

7

EOC

K-PREP (CRT/NRT)

ACT

Alternate Assessment

PLAN

Access

EXPLORE

KY

NonAcademic Data August 2011

8

Test Security, Procedures for Reporting Errors, Classroom Materials, Administration Practices, Test Preparation, Inclusion of Special Populations, & Alternate Assessment

August 2011

9

 Requires

annual training for all individuals involved in any component of the state assessment

 Annually

read and comply with documents and manuals specific to the state-wide assessment

 Training

includes “documents and administration manuals specific to staterequired assessment components”

August 2011

10

 Training

must be completed prior to any state required assessment administration

 703

KAR 5:080 & 703 KAR 5:070 shall be reviewed prior to spring test administration by all involved in assessment

August 2011

11

“DACs, administrators, and teachers shall ensure the security of the assessment materials before, during, and after test administration.”

“When not being used for a scheduled testing session, all assessment materials shall be stored in a secure location with access granted to authorized personnel only.”

August 2011

12

ACCEPTABLE  Using

Kentucky’s Core Content for Assessment  Using released items  Signing of nondisclosure forms by noncertified personnel assisting with testing

NOT ACCEPTABLE  Revealing

any secure

test item  Using secure test items to prepare students for assessment  Taking notes about or discussing the content, concepts or structure of any secure test item August 2011

13

ACCEPTABLE  Using

technology to save responses to CDs or portable drives (i.e., flash drives, floppy discs, etc.)  Copying of Alert Papers by DAC, BAC or school administrator

NOT ACCEPTABLE  Saving

student responses electronically to local drives or network drive  Reproducing secure test materials in any way  Access to electronic devices with wireless communication or imaging capabilities August 2011

14

ACCEPTABLE  Destroying

student notes, rough drafts or scratch paper after testing  Visually scanning student response booklets for stray marks and “good faith effort”

NOT ACCEPTABLE  Scoring

of test items or rough drafts is not permitted  Reading student responses in entirety for “good faith effort” is not permitted

August 2011

15

ACCEPTABLE Distributing Test Administration Manuals (TAMs) to administrators or proctors prior to the testing window  Distributing tests in the order of the shrink-wrapped packages  Ensuring that reusable test materials are free of any marks made by past students 

NOT ACCEPTABLE Making test booklets available to administrators or proctors prior to the testing window  Showing test items to anyone not administering the test  Leaving test booklets unattended outside of locked storage  Storing test booklets in a classroom without doublelocked storage 

August 2011

16

Example – For DAC

Sent to KDE from DAC

Grade Level

Grade 4

Content Area & Part

Reading – Part B

Form

Form 3A

Page Number

Page 30

Identify item as multiple Multiple Choice Item # 2 choice or open response or on-demand writing prompt Do not reproduce test item! Error or Problem

No correct answer choice provided August 2011

17

Content information or strategies/processes cannot be displayed on any classroom surface, including clothing.

Materials containing content information or strategies/processes added to classroom surfaces during instruction must be removed or covered during the assessment. Periodic tables and motivational-type posters may remain. August 2011

18

What are acceptable materials on the walls, ceilings, floors, blinds, windows and clothing during testing? ACTIVITY August 2011

19

 Dictionaries

& Thesauri for on-demand writing  Calculators as designated in the administration manual for that assessment  Refer to EXPLORE, PLAN & ACT manuals for acceptable calculators  Blank

writing or graph paper, blank overlay sheets, and bookmarks which are free of content

August 2011

20

 Sharing

calculators during testing session

 Leaving

the testing area for calculators, dictionaries, thesauri, blank writing or graph paper, etc.

 Having

materials or information at the student workstation that was not sent as a part of the assessment

August 2011

21

General Instructions “Do your best” “Stay on task”



Assistance or Evaluative Comments “You can do better.” “You can write more.”

August 2011

22

 Accommodations

for assessment shall be consistent with a student’s current IEP, 504 Plan or PSP.  Accommodations for one student shall not interfere or influence the assessment of another student.  Students who exhibit disruptive behavior prior to or during testing may be tested in a different location from their peers.

August 2011

23

 Restroom

breaks are allowed, if the student is monitored at all times.  Lunch Break  Tests should be scheduled to avoid lunch.  If lunch is unavoidable, it should be brought to the students in the testing area.  If there are too many students to bring lunch to the testing area, then students may be escorted to the lunchroom and monitored to prevent discussion.

August 2011

24

August 2011

25

All students in the same grade level in the same school must be simultaneously assessed in the same content area. • Students that are absent should resume testing with their class in the section that the class is testing. • Example: A student that was absent for Part A and returns to school when Part B is being administered will take Part B with the class. Then he will take Part A in a makeup session later. August 2011

26





Time Limits and extended time for each assessment must be followed per the administration manual. Students with extended time as an accommodation on an IEP, 504 Plan or PSP may have additional time during that school day.

August 2011

27

 If

a student is ill and cannot finish the test section, the student may complete that section later. The student may not return to previously answered parts of the section.

 If

a student leaves during the test session for a reason other than sudden illness, the student cannot complete the test section at a later time.

August 2011

28

ACCEPTABLE – Instructional Practice

NOT ACCEPTABLE – Instructional Practice

• Continuing normal instruction during testing window

• Cessation of normal instruction during testing window

• Ongoing regular review of year long content

• Review of content based upon information from secure test materials

• Embedded test taking strategies in regular content instruction • Test item retaken for disciplinary purposes

• Test prep courses with no link to Program of Studies August 2011

29

 Test

preparation or practice activities are not to be conducted instead of regular classroom instruction.

 Teachers

and other staff shall not be required to conduct test preparation or practice activities outside the normal work day.

August 2011

30

 Can

include pre-writing requirement (type to be determined by the student)

 Cannot

require complete first drafts

 Cannot

include evaluative statements or grade assignments of test answers

 Cannot

give feedback until after test booklets are returned to the BAC or DAC

August 2011

31

Shall be consistent with those applied within the regular curriculum or with the larger school program in general and attainable year round for student achievement.

August 2011

32

 Follow

School Food Services Guidelines and local and state boards finance policies.

 Local

school board funds or cash awards from school activity funds generated by students shall not be used for student incentives.

 ESS

funds shall not be used for test preparation.

 Donations

from individuals, businesses, parents or school staff can be used for student incentives.

August 2011

33

 Those

providing accommodations must be trained in Administration Code and how the student uses accommodations.

 Accommodations

during an assessment shall be consistent with 703 KAR 5:070, Procedures for the Inclusion of Special Populations

August 2011

34

 Students

in program have primary ownership of assessment pieces

 Yearly

training for administration is required

 Alternate

Assessment components are secure materials

 Altering

results of Alternate Assessment components is prohibited

August 2011

35

August 2011

36

 All

allegations, or perceived inappropriate testing procedure or behavior, should be reported to the Building Assessment Coordinator (BAC) and then to the District Assessment Coordinator (DAC).

 If

the DAC is the one not following proper procedure and does not correct or report the situation, a call or e-mail can be placed to the Allegations Coordinator in the Office of Legal Services by any concerned person. August 2011

37

Step 1 Allegation referred to KDE Allegation Coordinator

Step 2 KDE manages investigation process Step 3 Findings reported to Board of Review Step 4 Board of Review makes recommendations to Commissioner of Education

Step 5 Commissioner of Education makes final determination Step 6 Augustto 2011be taken 38 District receives letter from KDE with action

August 2011

39





Parents and Others not employed by a Kentucky Public School District may: review secure materials at the KDE office in Frankfort and not at the local district. A nondisclosure statement must be signed before reviewing secure assessment components. August 2011

40

August 2011

41

 Local

districts shall:

◦ report data to KDE. ◦ inform KDE of any errors in reporting.  Data

that is reported is lagged by one year.

◦ Example: Information reported in fall will be information regarding students in the prior school year.

August 2011

42

August 2011

43

August 2011

44

Office of Assessment and Accountability Division of Support and Research (502)564-4394

[email protected] August 2011

45