APPIC 2016 Membership Conference New Orleans, LA New Developments in Licensure and Their Implications for Training Sharon Lightfoot, PhD Emil Rodolfa, PhD Carol Webb, PhD ABPP

APPIC 2016 Conflict of Interest Statement • Dr. Lightfoot is on the Board of Directors of ASPPB. • Dr. Rodolfa is the chair of the EPPP Step 2 Implementation Task Force and the Job Task Analysis Task Force for ASPPB. • Dr. Webb is ASPPB’s Chief Operating Officer. • ASPPB owns the EPPP and the PLUS and is developing the EPPP Step 2.

Learning Objectives • Summarize the scientific underpinnings of the EPPP • Describe the ASPPB Competency Model • Identify elements of the universal application (PLUS) • Explain how work force analysis data can impact training • Identify rationale for the EPPP Step 2 (new)

Outline of Presentation • ASPPB Overview • ASPPB Programs • PLUS, CPQ, PSYPACT, Work Force Analysis • EPPP: New pass rate data • EPPP Step 2 • • •

Development, Competencies, Job Task Analysis, Volunteers Questions and Concerns

Association of State and Provincial Psychology Boards (ASPPB) • Non profit association of all the psychology licensing boards in the US and Canada (64 members) • Provides services to licensing boards, applicants for licensure, licensed psychologists: – Owns, creates, and maintains the EPPP – Oversees an on line universal licensure application (PLUS), – Manages various mobility programs (CPQ, IPC), and a strategy for the interjurisdictional practice of telepsychology (PSYPACT)

Psychology Licensure Universal System (PLUS) • An on line system for psychology licensure application. The applicant contacts the licensing board directly. Licensing board provides ASPPB with contact information for eligible applicants. The applicant is contacted by ASPPB to begin the PLUS application.

What Makes Up a PLUS Record? A completed PLUS application packet contains: • Demographics • Transcript(s) • Supervision History • Practicum • Internship • Post-doctoral • Exam Information • Work History • All Supporting Documents

PLUS: Current Status • 12 jurisdictions using the PLUS for licensure: GA, MS, NV, NH, ND, OK, TX, OH, MB, NM, LA, WA • Several more in the process: AZ, UT, NC, ON, ID, VI, OR • Many more have expressed an interest

Workforce Data • • • • •

Why this matters Phase 1 HRSA: Survey developed and sent Phase 2: Improve response rate Collaboration Phase 3: Strategic Plan and Resource Mgmt

The Examination For Professional Practice in Psychology (EPPP) • EPPP used in all US and Canadian Jurisdictions • Owned by ASPPB • Purpose to examine a candidate’s breadth and depth of knowledge of the profession of psychology: – – – – – – – –

1) biological bases (12%); 2) cognitive-affective (13%); 3) social and cultural (12%); 4) growth and lifespan development (12%); 5) assessment and diagnosis (14%); 6) treatment, intervention and prevention (14%); 7) research and statistics (8%); 8) ethical/legal/professional issues (15%)

EPPP • Four Forms of the EPPP are in use at any given time • Two new forms added and two retired each year • 225 item multiple choice test computer administered throughout the year • Validated and updated by periodic Practice Analysis (PA)/Job Task Analysis (JTA): Currently underway. – 2009 PA surveyed newly licensed and experienced psychologists seeking their views on the frequency of knowledge used, the importance of the knowledge to their practice, and critical nature of the knowledge protecting the public from harm. – 2016 JTA conducting a similar survey of all licensed psychologists – You will be receiving one soon!

EPPP Licensure Applicant Data • New EPPP Data: Feb 2015-March 2016 • 4957 First Time Takers of the EPPP • Overall Pass Rate (PR) • Overall PR Doctoral • Overall PR Masters

75% 79% 53%

EPPP Licensure Applicant Data • From Accredited Graduate Programs • From Non Accredited Graduate Programs • PhD • PsyD

85% 72%

• • • • •

90% 74% 83% 84% 91%

Clinical PhD Clinical PsyD Counseling School Combined

82% 55%

EPPP Licensure Applicant Data • APPIC Internship • Non APPIC Internship

84% 63%

• APA/CPA Accredited Internship 87% • NonAPA/CPA Accredited Internship 67% • With Post Doc (not APPIC) 79% • No Post Doc 78% • *With APPIC Post Doc 89% * Does not include all APPIC post docs, just those from 2012/2013 and before.

EPPP Licensure Applicant Data % correct in each domain • Domain Pass Fail • Biological 75 53 • Cog/Affective 80 55 • Social/Cultural 76 55 • Developmental 75 57 • Assessment 72 50 • Intervention 77 55 • Research/Stats 68 41 • Ethics 80 65

EPPP Licensure Applicant Data (All Candidates)

Study time • None • 1-50 hours • 51-75 hours • 76-100 hours • 101-200 hours • 201-300 hours • 301-400 hours • 401+ hours

# Fail # Pass 6 5 90 77 87 176 107 323 494 1444 499 1498 353 674 345 348

Pass rate (%) 45 46 67 75 74 77 66 50

EPPP Licensure Applicant Data • Doctoral Pass Rates by Year of Graduation Year of Graduation Pass Rate • 2015 88% • 2014 84% • 2013 73% • 2012 64% • 2011 and before 59%

EPPP Step 2 • For entry level licensure • Computer based exam assessing skills • www.asppb.net/page/EPPPStep2

• Based on competency model derived from ASPPB Practice Analysis

ASPPB Competencies Expected at the Point of Licensure • • • • • •

Scientific Orientation Professional Practice Relational Competence Professionalism Ethical Practice Systems Thinking

Available at http://c.ymcdn.com/sites/www.asppb.net/resource/res mgr/Guidelines/ASPPB_Competencies_Expected_.pdf

! !

!

Comparison of Competencies ASPPB!

Canadian!MRA!

Scientific!Orientation! · Core!Knowledge!Domains!

Research! · Core!Content!Areas!

! Professional!Practice! · Assessment! · Intervention! · Consultation!

! ! Assessment!and!Evaluation! Intervention!! Consultation! ! Supervision! ! ! Interpersonal!Relationships! · Knowledge!of!Others! ! ! Interpersonal!Relationships! · Knowledge!of!Self! ! ! Ethics!and!Standards! !

! Relational!Competence! · Diversity! · Relationships! ! Professionalism! · Personal!competence! · Reflective!practice! ! Ethical!Practice! · Application!of!ethics!codes! · Application!of!laws!and!rules! · Ethical!decision5making! ! ! Systems!Thinking! · Organizations! · Interdisciplinary!collaborations! !

! Interpersonal!Relationships! · Macro5environment! ! !

CoA! Research! · Discipline5!Specific!Knowledge!(DSK)! !! ! ! Assessment! Intervention! Consultation!&!Interprofessional/! Interdisciplinary!Skills! Supervision! ! ! ! Individual!&!Cultural!Diversity! Communications!&!Interpersonal!Skills!! ! Professional!Values,!Attitudes!&!Behaviors!!

! Ethical!and!Legal!Standards!

! Consultation!&! Interprofessional/Interdisciplinary!!Skills! !

EPPP Step 2 • EPPP: standardized means to assess core knowledge necessary for independent practice • EPPP Step 2: standardized means to assess skills necessary for independent practice

EPPP Step 2 Time Line 2010 - 2014

2015

2016

Competency Development

Feasibility Review

Job Task Analysis

Item and Skills Exam Development

Skills Exam Development

January Skills Exam Launch

EPPP Prac ce Analysis

Determined conceptual and financial feasibility for skills exam

Validate competencies

Train item writers

Develop skills exam forms

Develop skills exam blueprint

Develop item bank

Conduct Beta tes ng

Ongoing development of skills exam forms

Create skills exam policies and procedures

Con nue item wri ng

Refined competency model

2017

2018

2019

Ongoing item wri ng

Provide educa onal and informa onal material to jurisdic ons and other stakeholders regarding the exam. Assist jurisdic ons with necessary rule/statute changes.

An Outline of Exam Development 1. 2. 3. 4. 5. 6. 7.

Job Task Analysis / Practice Analysis Test Specifications / Content Outline Item Development Form Construction Beta Examination Standard Setting Exam Launch

Job Task Analysis (YOU ARE HERE)

Exam Launch

Standard Setting

Content Outline

Beta Testing

Exam Items

Job Task Analysis: Expert Panel Meeting 24

EPPP Step 2 • Thank you to all who have volunteered so far to help us develop this exam. We have had over 90 volunteers, primarily from the education and training community • Item Writing • Beta Testing • Jurisdiction rules and laws

Some Questions and Responses

What kind of exam will the EPPP Step 2 be? • • • • •

Computer based Innovative items Multiple choice items Focused on skills Taken after the EPPP has been passed

Professional Licensure • Professional licensure goal: to protect the public • Two main tasks: 1) ensuring the competence of those licensed, and 2) monitoring the professional conduct of licensees.

Why is ASPPB Developing the EPPP Step 2? • The EPPP Step 2 is a tool that can be developed today (well, in the next 3 years) for licensing boards to use to accomplish the first task • A step in the evolution towards a culture of competence • A step that all other doctoral level Health Professions have already taken as part of their licensure process.

Some Concerns We Have Heard • Another expense for students who are already struggling financially • Just modify the EPPP to include questions on skills • Skills exam is not necessary as skills are assessed in graduate school and internship • Another barrier to mobility

How much will this exam cost? • Exam fee has not been set yet, however, • It will be another expense for students • ASPPB will work with APAGS, CECP, and other student groups (as we have been doing for years) on ways to mitigate the burden. • We are open to discussing a change in the timing of the exam (more later on this)

Why can’t you just change the EPPP? • Explored this option • Foundational knowledge and functional skills are sequential • Given breadth and depth of material, exam assessing both would be too lengthy and costly

Why can’t a skills exam for licensure be administered by accredited programs during training? • Licensing boards are the ones tasked with ensuring that each applicant is competent. • Licensing boards will not allow other groups to fulfill their responsibility.

Why can’t graduates of accredited programs be assumed to have the skills necessary to be licensed? • Few licensing boards require that applicants come from accredited programs. • Accrediting bodies accredit programs and do not necessarily ensure that each student from those programs have acquired the competencies necessary for independent practice. • Supervisor evaluations not necessarily reliable (who are the other 90%), hence efforts by APPIC towards standardized letters of reference

When will the EPPP Exams be given? • In Sequence: After a candidate passes the EPPP, the candidate can take the EPPP Step 2 • There has been discussion about the timing of the sequence (i.e. take the EPPP prior to internship and the EPPP Step 2 upon completion) To make this change there would have to be significant discussion with the jurisdictions and the training associations.

Who will take the EPPP Step 2? • This examination is being developed for entry level licensure and not for renewal of a license. • Some jurisdictions have also discussed using the skills examination in disciplinary cases.

Won’t this be yet another barrier to mobility? • Policies and procedures not fully developed for the EPPP Step 2 • However, likely that it will only be required for those licensed after Jan 2019 • After 2019, if you want to move to a jurisdiction that requires it (and you were licensed after 1/19), there will be a simple and reasonable way to register for and take the exam • We do not anticipate that there will be a need for formal studying for this exam.

Questions, Comments, Concerns

Thanks for listening Remember, additional material about ASPPB is online at ASPPB.Net

Volunteer Forms and additional information about the EPPP Step 2 are online at http://www.asppb.net/page/EPPPStep2 Email us: Sharon: [email protected] Carol: [email protected] Emil: [email protected]