Student Achievement Success Criteria, Benchmarks, and Strategies for Improvement

Student Achievement Success Criteria, Benchmarks, and Strategies for Improvement Criterion Definition Calculation Method Data Source Benchmark Pe...
Author: Eugenia Price
3 downloads 2 Views 214KB Size
Student Achievement Success Criteria, Benchmarks, and Strategies for Improvement Criterion

Definition

Calculation Method

Data Source

Benchmark

Performance on State Licensure Exams

The percentage of first time test takers passing an examination required for North Carolina licensure or certification prior to practicing the profession, including the following curriculum programs:  Veterinary Medical Technology  Associate Degree Nursing  Practical Nursing  Medical Assisting  Cosmetology  Barbering  Esthetics  Emergency Medical Technician  Basic Law Enforcement Training  Dental Hygiene

The total number of first time test takers passing for all reported examinations divided by the total number of persons who sat for the exam for the first time. For privacy and statistical validity, no examination data are reported when the number of first time test takers was fewer than 10.

Annual NCCCS Critical Success Factor Report. Full results available at: http://www.nccommu nitycolleges.edu/Public ations/archivedCsfRep orts.htm

System Standard: 80% of first time test takers will pass examinations required for North Carolina licensure or certification.

Of students transferring to a university with an associate degree or 24 articulated college transfer credit hours, the percentage who have a GPA equal or greater than 2.00 after two semesters at the university.

Two cohorts: students receiving an associate degree during the previous academic year and those who had accumulated at least 24 articulated college transfer credit hours. Matched against UNC system student records to determine transfer enrollment at a North Carolina public university and first year academic performance. CCCC supplements this with performance data from private and out of state institutions using consistent

Transfer Performance

NCCCS accesses data from agencies issuing the license or certification and validated by the colleges

Annual NCCCS Critical Success Factor Report. Full results available at: http://www.nccommu nitycolleges.edu/Public ations/archivedCsfRep orts.htm NCCCS accesses data from the National Student Clearinghouse, University of North Carolina (multicampus system) Institutional Research & Analysis office, and data from individual private and out-ofstate institutions.

Exceptional Institutional Performance Standard: The college will have no exam with a passing rate less than 70%

System Standard: 83% of students transferring to a university with an associate degree or 24 articulated college transfer credit hours will have a GPA equal to or greater than 2.00 after two semesters at the university. Exceptional Institutional Performance Standard: Meet or exceed the aggregate performance of native UNC sophomores and juniors, which is 88% for the 2012 reporting year.

Justification for Benchmark The North Carolina Community College System is comprised of 58 two-year public colleges with open-door access, including Central Carolina, all with similar missions, programs, and student bodies; therefore it is reasonable to use the stateestablished benchmark standards.

The North Carolina Community College System is comprised of 58 two-year public colleges with open-door access, including Central Carolina, all with similar missions, programs, and student bodies; therefore it is reasonable to use the stateestablished benchmark standards.

1

Results

Sample Strategies for Improvement

Aggregate results for all exams: CCCC State Avg 2012: 84% 87% 2011: 83% 86% 2010: 86% 86% 2009: 83% 86% 2008: 87% 83%

Examples from Basic Law Enforcement:  Rewrote and standardized unit tests to align with state exam  Require students to participate in personal tutoring with program head for students falling below 85 on a test  Increase attention to detail to enhance student professionalism and precision, to cultivate appropriate mindset  Increase discipline in adherence to physical requirements  Encourage students to look out for each other (critical in this field)  Encourage peer study groups  Established library at the Emergency Services Training Center  Purchased supplementary study materials  Provided tutors  Improved assessment of student learning Implementation of these strategies resulted in state licensure exam pass-rate improving steadily from 84% in 2007-08 to 97% in 2011-12.

Central Carolina has consistently exceeded the state standard for this measure. These are aggregate results, including credentials from both Curriculum and Continuing Ed programs. Results for individual certification exams are also closely monitored and are shown below. These individual results are also major elements in each program’s Program Planning and Review (Outcomes & Assessments) plan. Pass rates are tracked and presented as trend data in the Criteria for Quality and Viability component. Areas of concern are analyzed and addressed. [See Narrative for 3.3.1]

2012: 2011: 2010: 2009: 2008:

CCCC 94% 87% 87% 87% 85%

UNC Native State Avg Students 88% 88% 87% 87% 85% 86% 88% 87% 84% 87%

Central Carolina has consistently exceeded the state standard for this measure, and has equaled or exceeded aggregate performance of native UNC system university students in four of the past five years.

Examples from Practical Nursing: obtained third-party NCLEX-PN test prep program

 Enhance ties with university-based advisory committees to focus on investing students with the skills needed for transfer  Enhanced transfer advising with “Success Coaches” and AVISO  Document advisory-committee recommendations and associated changes in the formal Program Review (Outcomes & Assessments) process  Created new Transfer student webpage to consolidate resources and information for aspiring transfer students  Beginning in Fall, 2013, all transfer-intent students will be required to take ACA 122, the College’s new one-credit College Transfer Success course.  Obtained updated science lab equipment to provide students with lab skills needed at universities.  Early Childhood instructors created departmental rubrics and began requiring APA format to bridge students’ transition to university, and also post transfer opportunity information on their Facebook page.

Student Achievement Success Criteria, Benchmarks, and Strategies for Improvement Criterion

Definition

Calculation Method

Data Source

Benchmark

Justification for Benchmark

Annual NCCCS Critical Success Factor Report. Full results available at: http://www.nccommu nitycolleges.edu/Public ations/archivedCsfRep orts.htm

System Standard: 75% of developmental course completers in reading, English or mathematics will complete with a grade of “C” or better.

The North Carolina Community College System is comprised of 58 two-year public colleges with open-door access, including Central Carolina, all with similar missions, programs, and student bodies; therefore it is reasonable to use the stateestablished benchmark standards.

Results

Sample Strategies for Improvement

methodology Passing Rates of Developmental Students

The percentage of developmental course completers in reading, English, or mathematics completing with a grade of “C” or better.

Number of students completing with a “C” or better divided by the total number of students enrolled to the end of the course.

NCCCS accesses data from its Data Warehouse, drawing from individual college data in Datatel Colleague from individual colleges

Success rates of Developmental students in subsequent college-level courses

Among developmental completers subsequently completing a college level English or math course, the percentage passing the college level English or mathematics course with a grade of "D" or better.

English: For first-time credit English students who had also taken a Developmental English or reading course: number of students earning a “D” or better divided by number of course completers in this group. Math: For first-time credit Math students who had also taken a Developmental Math course: number of students earning a “D” or better divided by number of course completers in this group.

Annual NCCCS Critical Success Factor Report. Full results available at: http://www.nccommu nitycolleges.edu/Public ations/archivedCsfRep orts.htm NCCCS accesses data from its Data Warehouse, drawing from individual college data in Datatel Colleague from individual colleges

80% of college level English or mathematics course completers with previous developmental coursework will complete the college level English or mathematics course with a grade of "D" or better.

The North Carolina Community College System is comprised of 58 two-year public colleges with open-door access, including Central Carolina, all with similar missions, programs, and student bodies; therefore it is reasonable to use the stateestablished benchmark standards.

2

Reading 2012: 2011: 2010: 2009:

CCCC 87% 89% 93% 89%

State Avg 86% 83% 83% 84%

English 2012: 2011: 2010: 2009:

CCCC 83% 83% 86% 86%

State Avg 83% 81% 83% 79%

Math 2012: 2011: 2010: 2009:

CCCC State Avg 77% 76% 79% 74% 74% 77% 71% 74%

Central Carolina has consistently exceeded state standards for this measure for Reading and English. Having implemented improvement strategies in recent years, Central Carolina has now exceeded the state standard for Math in the past two years. English CCCC State Avg 2012: 90% 85% 2011: 92% 87% 2010: 90% 86% 2009: 94% 89% Math 2012: 2011: 2010: 2009:

CCCC State Avg 96% 88% 97% 88% 92% 88% 96% 90%

Central Carolina has consistently exceeded the state standards for this measure.

 Identify at-risk students earlier for academic intervention (tutoring)  Utilize subject-specific coaches and tutors to help students master material  Maintain close ties with curriculum-level Math and English faculty and department leadership to ensure Developmental course content prepares students adequately and targets problem areas  Implemented new Developmental modular courses to focus on students’ specific deficiencies and get them ready to move to curriculum-level courses in a shorter time frame  Encourage students to interact with “Success Coaches” and use the AVISO Advising interface  Survey students at the end of each individual Developmental course, and incorporate useful ideas moving forward

 Identify at-risk students earlier for academic intervention (tutoring)  Utilize subject-specific coaches and tutors to help students master material  Maintain close ties with curriculum-level Math and English faculty and department leadership to ensure Developmental course content prepares students adequately and targets problem areas  Implemented new Developmental modular courses to focus on students’ specific deficiencies and get them ready to move to curriculum-level courses in a shorter time frame  Encourage students to interact with “Success Coaches” and use the AVISO Advising interface  Survey students at the end of each individual Developmental course, and incorporate useful ideas moving forward  Coordinated schedules for Developmental and Curriculum courses allowing a student to take a DEV module and a curriculum math course in the same semester

Student Achievement Success Criteria, Benchmarks, and Strategies for Improvement Criterion

Definition

Calculation Method

Data Source

Benchmark

Curriculum student retention, graduation and transfer rates

The percentage of fall credential seeking students who have graduated or are still enrolled at the same college, a university, or another community college one year later.

The data set was analyzed to determine which students from the previous fall list had “graduated”, “returned but did not graduate”, “transferred but did not graduate or return”, or “did not graduate, return, or transfer”. The number of students who had returned, graduated, and/or transferred was then divided by the total number of students from the previous fall.

Annual NCCCS Critical Success Factor Report. Full results available at: http://www.nccommu nitycolleges.edu/Public ations/archivedCsfRep orts.htm

65% of fall credential seeking students will graduate, remain enrolled at the same college, or transfer to a university or another community college one year later

Data are collected on the number of students entering the institution as full-time, first-time, degree/certificateseeking undergraduate students in a particular year (cohort); the number completing their program within 100 or 200 percent of normal time to completion; the number that transfer to other institutions

IPEDS (Integrated Postsecondary Education Data System)

Graduation rates of first-time, full-time credentialseeking students in 100%, and 200% of normal time to completion

Graduation rates of first-time, full-time credential-seeking students in 100%, and 200% of normal time to completion

NCCCS accesses data from National Student Clearinghouse; and the NC Community College System Data Warehouse, drawing from college data in Datatel Colleague from individual colleges

45% of first-time, fulltime credential-seeking students will graduate in 100%, and 49% of first-time, full-time credential-seeking students will graduate in 200% of normal time to completion. Benchmarks will be reevaluated every three years.

Justification for Benchmark The North Carolina Community College System is comprised of 58 two-year public colleges with open-door access, including Central Carolina, all with similar missions, programs, and student bodies; therefore it is reasonable to use the stateestablished benchmark standards.

In developing the College’s MAP to higher achievement, (Maximizing Academic Persistence with a College Success Center), Central Carolina identified annual, realistic benchmarks that would match average college graduation rates at sister institutions in the North Carolina Community College System. Implementation of Title III strategies is expected to result in graduation rates that increase by 1% after yr 3, 3% after

3

Results

2012: 2011: 2010: 2009:

CCCC State Avg 67% 67% 66% 68% 70% 72% 69% 69%

Central Carolina has consistently exceeded the state standard for this measure. Persistence is also reviewed in each individual curriculum’s Program Planning and Review Quality/Viability Criteria. The criteria are reviewed, needed areas of concern addressed, and the impact analyzed. [See Narrative for 3.3.1]

100% Time 200% Time 2012: not available not available 2011: 41% 44% 2010: 23% 36% 2009: 20% 25%

Sample Strategies for Improvement 

Obtained Title III Grant focused on enhancing student success  Initiated “Intrusive” advising  Added “Success Coaches”  Added requirement for Study-skills course  Expanded Writing Center  Implemented “AVISO” user-friendly Advising interface  Implemented targeted professional development for faculty teaching courses with lowest “success” rate  Reached out to previous years’ Non-Completers to invite them to return  Enhanced focus on data-informed, evidence-based intervention programs Program specific example:  Dental Hygiene implemented an Outcome evaluating individual strengths and weaknesses in skill development, which led to enhanced communication and correction of critical skills  Broadcasting Production Tech instructors expanded lab availability to accommodate students with transportation and work challenges  Vet Med Tech offered incentives to increase advisoradvisee contact, and implemented an Early Warning system  Obtained Title III Grant focused on enhancing student success  Initiated “Intrusive” advising  Added “Success Coaches”  Expanded Student Orientation (College wide, Program-specific, and First Year Experience including Added requirement for Study-skills course)  Made Scholars (Minority Male Mentoring Program)  Expanded Writing Center  Implemented “AVISO” user-friendly Advising interface  Implemented targeted professional development for faculty teaching courses with lowest “success” rate  Implemented Supplemental Instruction Group Tutoring for select courses with low “success” rate  Reached out to previous years’ Non-Completers to invite them to return  Enhanced focus on data-informed, evidence-based intervention programs  Analyze results from the annual Enrolled Student, Completer, and Non-Completer surveys, for recurring themes, identify impediments to success, and incorporate suggestions for improvement  Implemented enhanced advising system for Assoc.

Student Achievement Success Criteria, Benchmarks, and Strategies for Improvement Criterion

Graduates indicating they accomplishe d their goal(s) for attending

Graduates indicating the college prepared them for a career

Graduates indicating the college prepared them for transfer to a four-year institution

Course Success Rate

Definition

Calculation Method

Data Source

Percent of graduates responding to the completer survey who answered “Yes, completely” or “Yes, partially” to the question “Did you accomplish your goal(s) while attending CCCC?” Percent of graduates responding to the completer survey who answered “Satisfied” or “Very Satisfied” to the prompt “The extent to which CCCC prepared you for a career.” Percent of graduates responding to the completer survey who answered “Satisfied” or “Very Satisfied” to the prompt “The extent to which CCCC prepared you to transfer to a fouryear institution.”

Number of graduates responding “Yes, completely” or “Yes, partially”, divided by the total number responding

Annual Central Carolina Completer Survey

Number of graduates responding “Satisfied” or “Very Satisfied”, divided by the total number responding

Annual Central Carolina Completer Survey

Percentage of enrolled students who complete with an “A”, “B”, or “C”, for each course

For each course, the number of students who complete with a grade of “A”, “B”, or “C”, divided by the

Number of graduates responding “Satisfied” or “Very Satisfied”, divided by the total number responding

Annual Central Carolina Completer Survey

CCCC Grade Distribution Report

Benchmark

Justification for Benchmark yr 4 and 4% after yr 5.

Results

in Science students, including enhanced guidelines, tracking system, and criteria integrated with each Instructor’s annual Performance Evaluation.

100% of graduates will indicate they accomplished their goals for attending.

All students will engage in a structured academic program specifically designed to successfully meet academic goals.

2012: 2011: 2010: 2009:

97% 97% 100% 99%

100% of graduates will indicate that the college prepared them for a career.

The college will ensure education and training in all academic programs consistently meets current required employment skills and standards.

2012: 2011: 2010: 2009:

94% 94% 95% 96%

100% of graduates earning the Associate in Arts or Associate in Science degree indicate that the college prepared them for transfer to a four-year institution.

Review and Update of the Comprehensive Articulation Agreement between the NC public universities and the NC Community College System (and its 58 community colleges) is focused on strengthened partnership and enhanced communication, which encouraged CCCC to set the bar high.

2012: 2011: 2010: 2009:

75% of enrolled students will complete with an “A”, “B”, or “C” for each course. Benchmarks will be re-

Review of the literature shows a wide variation for this metric in community colleges;

Aggregated Weighted Average Success Rate for all Courses:

4

Sample Strategies for Improvement

  

  

94% 94% 89% 93%

   

Fall 2012: Spring 2012:

71% 71%

  

Enhanced focus on students’ goal progress in AVISO Advising System and with “Success Coaches” Reached out to previous years’ Non-Completers to invite them to return Analyze results from the annual Enrolled Student, Completer, and Non-Completer surveys, for recurring themes, identify impediments to success, and incorporate suggestions for improvement

Enhance ties with industry-based advisory committees to focus on investing students with the skills needed in the workplace Document advisory-committee recommendations and associated changes in the formal Program Review (Outcomes & Assessments) process Follow-up with employers to assess satisfaction with graduates, and address any issues identified with program faculty Enhance ties with university-based advisory committees to focus on investing students with the skills needed for transfer Enhanced transfer advising with “Success Coaches” and AVISO Document advisory-committee recommendations and associated changes in the formal Program Review (Outcomes & Assessments) process Implement three essential strategies of the current review of the North Carolina Comprehensive Articulation Agreement: 1. Update to support current general education requirements at senior institutions. 2. Establish a process for maintaining currency. 3. Ensure current information is universally accessible to students and advisors.

Implement targeted professional development for faculty teaching courses with lowest “success” rates Offered two-day summer Chair Workshop focused on enhancing student success and improving programs Request that instructors/chairs for low-performing

6tudent Achievement Success Criteria, Benchmarks, and Strategies for Improvement Criterion

Definition

Calculation Method total number of students enrolled

Data Source

Benchmark evaluated every three years.

Justification for Benchmark CCCC developed this benchmark within the range identified in the large studies evaluated and will re-evaluate every three years.

5

Results Fall 2011: Spring 2011: Fall 2010:

70% 73% 72%

Trend data for course completion rates by individual discipline are shown in the table below.

Sample Strategies for Improvement



courses address course improvement initiatives in their department’s Outcomes & Assessments plan, and follow up. Implementing Supplemental Instruction Group Tutoring for select courses with low “success” rate

Student Achievement Success Criteria, Benchmarks, and Strategies forImprovement

Passing Rates on State Licensure Exams: Individual Test Results Basic Law Enforcement Training System Totals Central Carolina Community College Cosmetic Arts: Apprentice System Totals Central Carolina Community College Cosmetic Arts: Cosmetology System Totals Central Carolina Community College Cosmetic Arts: Esthetician System Totals Central Carolina Community College Cosmetic Arts: Instructor System Totals Central Carolina Community College Dental Hygiene System Totals Central Carolina Community College Practical Nursing System Totals Central Carolina Community College Registered Nursing System Totals Central Carolina Community College Veterinary Medical Technician System Totals Central Carolina Community College

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

1407 30

84% 97%

85% 95%

87% 93%

87% 91%

86% 84%

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

194 10

95% 90%

96% 100%

96% 100%

96% 93%

90% 86%

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

724 55

93% 87%

94% 91%

95% 91%

92% -

89% 100%

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

166 8

95% 88%

96% 100%

84% 79%

85% 83%

83% 81%

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

39 5

90% 100%

67% -

81% -

85% 83%

83% 81%

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

227 8

92% 88%

84% 82%

91% 100%

92% 100%

94% -

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

771 50

95% 82%

84% 80%

97% 87%

96% 97%

94% 93%

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

2001 15

95% 100%

90% 96%

87% 100%

89% 93%

90% 100%

Test Takers 2011-12

2011-2012

2010-2011

% Passing 2009-2010

2008-2009

2007-2008

82 31

100% 100%

95% 100%

96% 100%

100% 100%

98% 100%

6

Student Achievement Success Criteria, Benchmarks, and Strategies for Improvement

Unweighted Average of Success Rates by Course Prefix (Success Rate = Percent Retained AND Passed with “C” or better) Course Prefix

Average of Success Rate Spring Fall Spring Fall 2011 2011 2012 2012

Course Prefix

Average of Success Rate Spring Fall Spring Fall 2011 2011 2012 2012

Course Prefix

Average of Success Rate Spring Fall Spring Fall 2011 2011 2012 2012

Course Prefix

Average of Success Rate Spring Fall Spring Fall 2011 2011 2012 2012

ACA

60%

64%

66%

73%

COS

79%

75%

76%

83%

MAC

95%

81%

73%

80%

RED

63%

62%

63%

55%

ACC

68%

79%

71%

77%

CSC

75%

91%

81%

67%

MAS

89%

72%

88%

*

REL

76%

86%

69%

85%

AGR

92%

74%

94%

86%

CST

50%

55%

83%

71%

MAT

59%

58%

55%

65%

SAB

*

76%

*

56%

ALT

87%

95%

84%

92%

CTS

84%

83%

90%

76%

MCM

97%

82%

86%

88%

SEC

88%

63%

85%

78%

ANS

85%

82%

95%

90%

CUL

*

*

*

78%

MEC

82%

74%

89%

85%

SOC

68%

65%

72%

69%

ANT

84%

64%

48%

57%

DBA

75%

55%

68%

62%

MED

77%

84%

78%

83%

SPA

59%

61%

65%

64%

ARC

56%

*

100%

*

DEN

95%

95%

97%

100%

MKT

85%

91%

74%

79%

SST

54%

67%

68%

84%

ARS

86%

85%

80%

82%

DFT

93%

74%

100%

93%

MNT

94%

71%

87%

89%

TCT

91%

89%

87%

93%

ART

76%

78%

81%

81%

DRA

64%

90%

73%

66%

MUS

83%

70%

72%

67%

TEL

98%

95%

95%

89%

AUB

88%

84%

80%

84%

ECO

66%

46%

68%

69%

NAS

*

*

*

27%

VET

93%

91%

93%

92%

AUT

76%

82%

74%

81%

EDU

85%

86%

85%

80%

NET

89%

88%

91%

66%

WEB

50%

70%

47%

46%

BAR

74%

80%

85%

79%

EGR

*

49%

*

79%

NOS

86%

90%

80%

80%

WLD

88%

89%

78%

67%

BIO

65%

61%

60%

66%

ELC

91%

68%

84%

67%

NUR

93%

79%

86%

87%

BPM

85%

86%

84%

100%

ELN

74%

100%

82%

81%

NUT

*

*

*

73%

BPR

92%

81%

77%

83%

ENG

64%

62%

61%

62%

OMT

83%

100%

60%

100%

BPT

74%

82%

80%

77%

FST

94%

94%

94%

91%

OST

83%

74%

76%

74%

BUS

71%

74%

77%

72%

GEL

65%

72%

67%

73%

PCC

50%

95%

*

*

CAB

100%

*

*

*

HIS

76%

77%

72%

74%

PCD

75%

67%

*

100%

CAR

100%

*

*

*

HOR

100%

89%

93%

95%

PCI

100%

*

83%

*

CET

86%

100%

67%

63%

HSE

75%

62%

91%

77%

PCS

88%

50%

92%

*

CHI

76%

79%

66%

70%

HUM

66%

62%

62%

59%

PED

89%

78%

79%

83%

CHM

63%

56%

62%

69%

HYD

*

93%

*

94%

PHI

92%

64%

72%

69%

CIS

70%

62%

67%

64%

INT

*

86%

*

80%

PHY

83%

73%

77%

86%

CJC

78%

73%

81%

79%

ISC

81%

83%

84%

83%

PME

92%

*

*

*

CMT

*

*

*

83%

LEO

98%

100%

98%

100%

POL

59%

52%

54%

60%

COE

88%

90%

93%

92%

LEX

85%

86%

96%

88%

PSY

76%

76%

74%

72%

COM

79%

90%

85%

83%

LIB

76%

91%

80%

70%

PTC

86%

57%

67%

67%

*Courses not offered this semester

7

Suggest Documents