Enhancing Orientation Programs & Partnerships through Assessment Dan Murphy Director for Student Orientation & Transition Programs | Penn State
(t) @danielwmurphy (e)
[email protected] (& iMessage)
The Strategic Plan Strategy 1.3: improve key student transition experiences -“…analysis of Penn State data indicate students encounter some of the greatest difficulties of their educational experiences during key transitions: beginning their college studies… change from one campus to another…”
Student Transitions Steering Committee -Charged to “student how the transition can be made seamless”
“Orientation” vs. “orientation”
The Strategic Plan Strategy 1.3: improve key student transition experiences -“…analysis of Penn State data indicate students encounter some of the greatest difficulties of their educational experiences during key transitions: beginning their college studies… change from one campus to another…”
Student Transitions Steering Committee -charged to “study how the transition can be made seamless”
“Orientation” vs. “orientation”
The Strategic Plan Strategy 1.3: improve key student transition experiences -“…analysis of Penn State data indicate students encounter some of the greatest difficulties of their educational experiences during key transitions: beginning their college studies… change from one campus to another…”
Student Transitions Steering Committee -Charged to “student how the transition can be made seamless”
“Orientation” vs. “orientation”
A Look at the Landscape CAS (2009) highlight Orientation responsibility for: -aiding students understanding of the nature/purpose of the institution, membership in the academic community, and relationship to intellectual, cultural, and social climate of the institution -provide intentional opportunities for new students to interact with fellow new, and continuing, students as well as faculty/staff members -central to this mission is inclusion of parents/families in support of new students -contribute to institutional enrollment management, including retention
21 similar institutions selected for initial benchmarking -17 had an overnight summer orientation program -including 7 Big Ten institutions (9 with addition of Maryland/Rutgers) -landscape is similar when you look at peers in NODA’s Large Institution Network
A Look at the Landscape CAS (2009) highlight Orientation responsibility for: -aiding students understanding of the nature/purpose of the institution, membership in the academic community, and relationship to intellectual, cultural, and social climate of the institution -provide intentional opportunities for new students to interact with fellow new, and continuing, students as well as faculty/staff members -central to this mission is inclusion of parents/families in support of new students -contribute to institutional enrollment management, including retention
21 similar institutions selected for initial benchmarking -17 had an overnight summer orientation program -including 7 Big Ten institutions (9 with addition of Maryland & Rutgers) -similar when you look at peers in NODA’s Large Institution Network
The Goals of NSO -introduce Penn State’s University community -clarify roles of student and families in higher education’s context -expand understanding of higher education’s purposes -encourage students to take an active role in planning an education -increase familiarity with the campus community by increasing exposure -enhance understanding of community expectations -provide greater opportunity for educational planning and academic advising -improve understanding of residence hall living and campus dining -introduce intellectual community through a common book project -enhance understanding of student services for both students and families -increase opportunities for students and families to connect with others
Overview of NSO 2013
43 # of Sessions
39: May 19 through July 19 3: International Student Advising Days 1: August NSO Session
98.6 % of PDACCs attending NSO
Represents 8,250+ Students Only 21 Arrived on Day 2 2012 FTCAP #s: 96.8%
Departure for NSO
Overview of NSO 2013
43 # of Sessions
39: May 19 through July 19 3: International Student Advising Days 1: August NSO Session
98.6 544 1.52 # Guests Staying in Residence Hall
% of PDACCs attending NSO
Represents 8,250+ Students Only 21 Arrived on Day 2 2012 FTCAP #s: 96.8%
8.7 % College Change at NSO
# of Guests per Student*
9,869 Guests Attended NSO *10% Attended NSO Alone Sun/Mon Most Popular
College Advising Meeting We participate in annual debrief meetings with each college College Advising Meeting Learning Outcomes Group -one representative from each college’s advising team -staff from NSO and Student Affairs Research and Assessment -established learning outcomes for students & parents/family members
Authored evaluation questions for advising portions of NSO Afford opportunity to gather additional data for the college -HHD: “Please elaborate on your advising and scheduling experience…” -ENGR: “As a result… I know that with a schedule of 15-17 credits I need to study:” -SC: “I feel connected to the College of Science”
College Advising Meeting We participate in annual debrief meetings with each college College Advising Meeting Learning Outcomes Group -one representative from each college’s advising team -staff from NSO and Student Affairs Research and Assessment -established learning outcomes for students & parents/family members
Authored evaluation questions for advising portions of NSO Afford opportunity to gather additional data for the college -HHD: “Please elaborate on your advising and scheduling experience…” -ENGR: “As a result… I know that with a schedule of 15-17 credits I need to study:” -SC: “I feel connected to the College of Science”
College Advising Meeting We participate in annual debrief meetings with each college College Advising Meeting Learning Outcomes Group -one representative from each college’s advising team -staff from NSO and Student Affairs Research and Assessment -established learning outcomes for students & parents/family members
Authored evaluation questions for advising portions of NSO Afford opportunity to gather additional data for the college -HHD: “Please elaborate on your advising and scheduling experience…” -ENGR: “As a result… I know that with a schedule of 15-17 credits I need to study:” -SC: “I feel connected to the College of Science”
College Advising Meeting We participate in annual debrief meetings with each college College Advising Meeting Learning Outcomes Group -one representative from each college’s advising team -staff from NSO and Student Affairs Research and Assessment -established learning outcomes for students & parents/family members
Authored evaluation questions for advising portions of NSO Afford opportunity to gather additional data for the college -HHD: “Please elaborate on your advising and scheduling experience…” -ENGR: “As a result… I know that with a schedule of 15-17 credits I need to study:” -SC: “I feel connected to the College of Science”
Familiarity with Expectations
NSO assisted in…
Academic Goal Setting
Support/Services Familiarity
Making “The List”
The 2014 List Increase advising quota usage percentage/efficiency -in 2013, 88.5% quota efficiency; ~220 domestic students in August -in 2014, 91.6% quota efficiency; 178 domestic students in August
Increase agreement re: understanding of Penn State Reads -“I understand how Penn State Reads will enhance the intellectual community…”
Increase parent/family member understanding of meal plan -“I have a general understanding of the campus meal plan.”
Find data to better inform us about previous exposure to campus -Spend A Summer Day, Admitted Student Programs, & general campus visits -Alumni Connections
The 2014 List Increase advising quota usage percentage/efficiency -in 2013, 88.5% quota efficiency; ~220 domestic students in August -in 2014, 91.6% quota efficiency; 178 domestic students in August
Increase agreement re: understanding of Penn State Reads -“I understand how Penn State Reads will enhance the intellectual community…” -in 2013, 61.35% agreed/strongly agreed; 13.9% disagreed/strongly disagreed (M=3.68) -in 2014, 61.75% agreed/strongly agreed; 11.93% disagreed/strongly disagreed (M=3.74)
Increase parent/family member understanding of meal plan -“I have a general understanding of the campus meal plan.”
Find data to better inform us about previous exposure to campus -Spend A Summer Day, Admitted Student Programs, & general campus visits -Alumni Connections
The 2014 List Increase advising quota usage percentage/efficiency -in 2013, 88.5% quota efficiency; ~220 domestic students in August -in 2014, 91.6% quota efficiency; 178 domestic students in August
Increase agreement re: understanding of Penn State Reads -“I understand how Penn State Reads will enhance the intellectual community…” -in 2013, 61.35% agreed/strongly agreed; 13.9% disagreed/strongly disagreed (M=3.68) -in 2014, 61.75% agreed/strongly agreed; 11.93% disagreed/strongly disagreed (M=3.74)
Increase parent/family member understanding of meal plan -“I have a general understanding of the campus meal plan.” -in 2013, 82.68% agreed/strongly agreed; 3.79% disagreed/strongly disagreed (M=4.06) -in 2014, 85.53% agreed/strongly agreed; 3.6% disagreed/strongly disagreed (M=4.07)
Find data to better inform us about previous exposure to campus -Spend A Summer Day, Admitted Student Programs, & general campus visits -Alumni Connections
The 2014 List Increase advising quota usage percentage/efficiency -in 2013, 88.5% quota efficiency; ~220 domestic students in August -in 2014, 91.6% quota efficiency; 178 domestic students in August
Increase agreement re: understanding of Penn State Reads -“I understand how Penn State Reads will enhance the intellectual community…” -in 2013, 61.35% agreed/strongly agreed; 13.9% disagreed/strongly disagreed (M=3.68) -in 2014, 61.75% agreed/strongly agreed; 11.93% disagreed/strongly disagreed (M=3.74)
Increase parent/family member understanding of meal plan -“I have a general understanding of the campus meal plan.” -in 2013, 82.68% agreed/strongly agreed; 3.79% disagreed/strongly disagreed (M=4.06) -in 2014, 85.53% agreed/strongly agreed; 3.6% disagreed/strongly disagreed (M=4.07)
Find data to better inform us about previous exposure to campus -Spend A Summer Day, Accepted Student Programs, & general campus visits -Alumni Connections
Overview of NSO 2014
45 # of Sessions
39: Summer NSO Sessions 1: Transfer Student Orientation 4: International Student Orientations 1: August NSO Session
98.8 % of PDACCs attending NSO
Represents 8,500+ Students Only 7 Arrived on Day 2 2013 NSO #s: 98.6%
# Attending Transfer Program
94
8.7 % College Change at NSO
1.52 # of Guests per Student*
10,300+ Guests Attended *13% Attended NSO Alone Ratio Same as 2013
Beyond Proving “No Harm” Students Attending NSO Alone -in 2013, 90% of students brought one or more guest with them to NSO -in 2014, 87% of students brought one or more guest with them to NSO -using data to create profiles to support/provide access for families at a distance
Student Staff Training -leveraging course evaluations to better prepare student leaders
Developing an Assessment Plan -moving beyond program evaluation to gauge learning
Attending NSO Alone
Beyond Proving “No Harm” Students Attending NSO Alone -in 2013, 90% of students brought one or more guest with them to NSO -in 2014, 87% of students brought one or more guest with them to NSO -using data to create profiles to support/provide access for family at distance
Student Staff Training -leveraging course evaluations to better prepare student leaders
Developing an Assessment Plan -moving beyond program evaluation to gauge learning
Student Staff Training Student Staff Training -leveraging course/training evaluations to better prepare student leaders -SOTP Diversity & Inclusion Advisory Group Engaging
Challenging
Relevant
Diversity & Inclusion
3.8
3.2
3.8
Penn State Reads Book Discussions
3.2
2.7
3.3
Public Speaking & Group Facilitation
3.9
2.1
4.0
World in Conversation Training
3.9
2.6
3.6 Preparedness
Diversity & Multicultural Competence
3.11
Multicultural Resources at Penn State
3.00
Connecting with Students of Diverse Backgrounds
3.16
Working with International Students
2.47
Student Staff Training Student Staff Training -leveraging course/training evaluations to better prepare student leaders -SOTP Diversity & Inclusion Advisory Group Engaging
Challenging
Relevant
Diversity & Inclusion
3.8
3.2
3.8
Penn State Reads Book Discussions
3.2
2.7
3.3
Public Speaking & Group Facilitation
3.9
2.1
4.0
World in Conversation Training
3.9
2.6
3.6 Preparedness
Diversity & Multicultural Competence
3.11/3.52
Multicultural Resources at Penn State
3.00/3.38
Connecting with Students of Diverse Backgrounds
3.16/3.29
Working with International Students
2.47/NA
Beyond Proving “No Harm” Students Attending NSO Alone -in 2013, 90% of students brought one or more guest with them to NSO -in 2014, 87% of students brought one or more guest with them to NSO -using data to create profiles to support/provide access for family at distance
Student Staff Training -leveraging course evaluations to better prepare student leaders
Developing an Assessment Plan -moving beyond program evaluation to capture learning
Overview of NSO 2015
43 # of Sessions
36: Summer NSO Sessions 2: Transfer Student Orientation 4: International Student Orientations 1: August NSO Session
97
% of PDACCs attending NSO
Represents 7,700+ Students 2013 NSO #s: 98.6% 2014 NSO #s: 98.8%
% Attending Transfer Program
50
9.3 % College Change at NSO
1.52 # of Guests per Student*
9,600+ Guests Attended *10% Attended NSO Alone No Change Since 2013
Moving Beyond Evaluation Looking at the Instruments -approached program evaluation with greater intention -for each question we asked ourselves “What are we going to do with this?” -aligned questions from NSO evaluation to PULSE report
Cohorting Pilot Study -collaboration with Eberly College of Science -first phase completed at 2014 NSO
Beyond Level of Confidence… What is Being Learned? -for our students we asked them to: -define “consent” as presented in the NSO program (four-part definition) -identify two resources to assist with personal budgeting & debt management -asked parents & gamily members to define “FERPA” as presented at NSO -the origin of “We Are”
Moving Beyond Evaluation Looking at the Instruments -approached program evaluation with greater intention -for each question we asked ourselves “What are we going to do with this?” -aligned questions from NSO evaluation to PULSE report
Cohorting Pilot Study -collaboration with Eberly College of Science -first phase completed at 2014 NSO
Beyond Level of Confidence… What is Being Learned? -for our students we asked them to: -define “consent” as presented in the NSO program (four-part definition) -identify two resources to assist with personal budgeting & debt management -asked parents & gamily members to define “FERPA” as presented at NSO -the origin of “We Are”
Moving Beyond Evaluation Looking at the Instruments -approached program evaluation with greater intention -for each question we asked ourselves “What are we going to do with this?” -aligned questions from NSO evaluation to PULSE report
Cohorting Pilot Study -collaboration with Eberly College of Science -first phase completed at 2014 NSO
Beyond Level of Confidence… What is Being Learned? -for our students we asked them to: -define “consent” as presented in the NSO program -identify two resources to assist with personal budgeting & debt management -asked parents & family members to define “FERPA” as presented at NSO -the origin of “We Are”
Questions in the Data
NSO assisted in…
Established FYR Friendships
Taking This Home What are three new metrics you want to collect/identify? -persistence through the program, define bystander, major change at NSO…
Who are your partners? -institutional research, fans of assessment, graduate programs…
What is one (1) question you want to START asking? What is one (1) question you want to STOP asking? How will you identify what makes “the list”? -I most definitely recommend post-it notes…
Questions?
43
