Nov 2, 2017

Introducing: PFCE Assessment Tool R9HSA Family Engagement Conference

● Are you assessing parent engagement now? ● If so, what tool are you using? ● Are you assessing program effectiveness? ● If so, how?

Outline • Research & Development • Pilot Experience (2016-17) • Demo: How to Use • Timeline • How to Subscribe • User Support • Q&A

TM

Origins of Parent Gauge

• OHS release of the PFCE Framework • No tool addressed Head Start program needs

• No tool was aligned to the PFCE Framework • Programs were looking for a solution • Region 5 Head Start directors approached the University of Chicago • Piloted 2016-2017 • Valid and reliable instrument to measure PFCE

Vision for Parent Gauge: 1. Identify themes through parents’ own words

2. Create an assessment under the guidance of the field and owned by the field 3. Continue strengthening the tool by feeding in data, learning and refining

Project Staff & Advisory Panel Project Team

Expert Advisory Panel Members

• Marc Hernandez, NORC

• Cathy Ayoub*, National Center for PFCE • Josh Sparrow, National Center for PFCE • Jeremiah Garza, Sarah Samuels Center for Public Health Research & Evaluation • Terri Sabol, Northwestern University • Scott Siegfried, Miami Valley Child Development Center • Patrick Van Kessel, Pew Research Centers

• Patrick Sier, NORC • Gabriel Velez, NORC • Lekha Venkataraman, NORC

• Michele Zimowski, NORC • Gayle Kelly, Minnesota HSA • Rick Mockler, NHSA • Tim Nolan, National Centers for Learning Excellence, Inc. • Victoria Jones, NHSA • Kate Klingensmith, Consultant

The Instrument Goals for the Tool: • Easily assesses PFCE through parent report • Is aligned with the OHS PFCE Framework • Provides useful information to improve engagement and support ongoing program evaluation and CQI

Requirements: • Supports multiple languages (e.g., English, Spanish, Arabic, French) • Web-based with to accessibility multiple devices We wanted create afor practitioner tool that would • Administered trusted program staffparents’ in 15 minutes or less allow us tobyformatively assess engagement • Immediately informative interviewer with their Head Starttoprogram and perceptions of how • Generates useful reports that aggregate at multiple levels

the program has impacted them and their children

Measuring: • 35 closed-ended and 10 open-ended questions

Rigorous Parent Research with the Pilot

Final Sample • 147 grantees participated • All 12 Regions represented • Approximately 1,000 interviews We wanted toperceived create a practitioner tool that would allow Insight: Parents us to formatively parents’ strongest immediateassess program value engagement with their Head about Start program and perceptions of how the was learning their child’s program has impacted them and their children development

Review of Existing PFCE Assessment Strategies

Pilot Test - Psychometric Results • Tool measures two related factors: Parent & Program • Responses were generally positive, more so for the Program Scale than for the Parent Scale • Good scale reliability (graded responses)  

Parent Scale (15 items): alpha = 0.85 Program Scale (22 items): alpha = 0.93

Privacy • Parent Gauge is in full compliance with all OHS and Federal privacy standards TM

• The software is encrypted • Each program controls their centers’ and staff permission levels • Data sharing: on the state and national level, data will be anonymized to protect personal information

Getting Started • Roles System/Program Admin, Center Admin, Staff (Family Services or Teacher/Home Visitor)

• Import data from Child Plus Name, teacher, birth date, race, sex, native language, connections between children and guardians, and email for staff

• Record Interviews

Demo

I. Create an Interview

I. Review an Interview • Roster & filtering II. Reports • Baseline • Growth

Parent Gauge Tool Content

● Strength-based parent measures and questions assessing program influence on parents (i.e., couplets)

● Open-ended questions for additional context “Now, please tell me more about how the program has affected how you and your child communicate.”

Parent Gauge Baseline Report

Parent Gauge Question Detail

Parent Gauge Growth Report

Implementation Cycle

Subscriptions Annual license :

• Base usage fee of $1500 plus $3 per family* • NHSA members receive a 15% discount *Very small programs (under 100 children) qualify for a discounted,

$800 base usage fee.

Support for Users NORC continued involvement: • •

Training for administrators and line staff Technical assistance

•

Support for data analysis

NHSA, Product Manager: • User Groups •

User Feedback  Surveys, analytics, bug reports

•

Ongoing revisions and improvements

How to Order Information you need in order to complete the form: • Contact Information for the Program • Estimated number of families that you plan to include, at the Program Level

• Eventually, we’ll need contact information for the Program’s System Admin Order on NHSA website: go.nhsa.org/ParentGauge

Join your Colleagues Animated, 3 minute demo video: go.nhsa.org/ParentGauge

More Information • Video, FAQs, details: go.nhsa.org/ParentGauge • Contact: [email protected]

Questions? We wanted to create a practitioner tool that would allow us to formatively assess parents’ engagement with their Head Start program and perceptions of how the program has impacted them and their children