2014 Master’s Program

EXECUTIVE SUMMARY OF PROGRAM EVALUATION Prepared by Margaret W. Baker PhD, RN & Jungeun Lee MSN, RN Approved by MCC February 2015

The 2014 Master’s program evaluation report was generated from the following five surveys: (1) End-of-Program Evaluation (EPE), (2) Scholarly Inquiry Scale (SIS), (3) Clinical Scale (CS), (4) Alumni Survey (AS) for graduates of 2009, 2011, and 2013, and (5) Supervisory Colleague’s Evaluation of MN/MS Alumni (CE).

RESPONSE RATE 2010-2014

S 21 46 52 60 56

2014 2013 2012 2011 2010

CS R % 21 100 41 89.1 39 75 52 87 47 84

S 70 105 113 90 114

SIS R 58 87 90 82 107

% 82.9 82.9 79.6 91 94

S 70 105 113 92 108

EPE R % 53 75.7 83 79 90 79.6 74 80 78 73

S 270 270 296 242 249

AS R % 48 17.8 54 20 53 17.9 50 22 63 25

S 270 270 296 242 249

CE R % 5 1.9 11 4.1 8 2.7 9 4 13 5

S: number of surveys sent; R: number of surveys returned; %: return rate

Master of Nursing Program (MN) 1. End-of-Program Evaluation (EPE)  New MN graduates evaluated that the Master’s program of study met their educational goals well (mean = 4.3) and was flexible to meet individual educational goals (mean = 3.9).  Program Outcome: To what extent do you feel your program facilitated 1) The ability to assess and manage health-related issues in the following areas: -

Individuals : mean = 4.5, SD = 0.7

-

Families: mean = 4.0, SD = 0.9

-

Communities: mean = 3.9, SD = 0.9

-

Systems: mean = 3.8, SD = 1.0

2) The development in the following areas:

-

Conceptual skills: mean = 4.2, SD = 0.6

-

Cultural Competency in knowledge inquiry and clinical practice: mean = 4.1, SD = 0.8

-

Leadership or management skills: mean = 4.3, SD = 0.7

-

Scholarly skills: mean = 4.4, SD = 0.6

3) The ability in the following areas: -

Evaluating the current state of knowledge: mean = 4.5, SD = 0.6

-

Developing and implementing a research study: mean = 4.2, SD = 0.7

-

Evaluating the application of inquiry-based knowledge: mean = 4.5, SD = 0.7

-

Articulating ethical issues and responsibilities involved in research: mean = 4.1, SD = 0.8

-

Developing and utilizing leadership strategies: mean = 4.3, SD = 0.7

 Mean scores of new graduates’ experiences at the School related to various socialization/discussion outside of class/study opportunities with other racial/ethnic groups were all 4.0. The degree of agreement with the statements regarding discrimination and being stereotyped by faculty was low (means for both items were 1.3 and 1.2, respectively).  About 98% of new graduates had plans for further education (e.g., DNP > continuing education > conference or seminar). In total, 79.5% of new graduates stated that they would choose the University of Washington School of Nursing again, while only 2.3% answered they would not do so.

2. Scholarly Inquiry Scale (SIS)  Faculty members evaluated new graduates’ competency in scholarly inquiry that reflected five program outcomes. Mean scores of the new MN graduates’ competency of scholarly inquiry ranged from 4.5 - 4.8. 

Highest - How well did this student link the results or product of the thesis or scholarly project to advanced practice and/or future research?



Lowest – o

How well did this student demonstrate critical examination of the content and design of the reviewed studies in the written report and/or oral presentation?

o

How well did this student address ethical issues that were related to practice and research in the focused area?

o

How well did this student address the dissemination of the results or product of the thesis to researchers, clinicians, communities, and the public?

o

How well did this student address the relevance and/or limitations of the thesis to culturally competent practice, education, or administration in the oral presentation, written report, or both?

 Editing by faculty for written work was required for most students (46 out of 49). Seven students’ work required extensive editing by faculty. About 2% of students employed professional editor for their work. 3. Clinical Scale (CS)  Twenty-one clinical faculty members evaluated clinical competence of MN students in comparison with five MN program outcomes.  Clinical Competency and MN Program Outcomes 

Perform comprehensive or focused assessments (mean = 4.5, SD = 0.6)



Use findings of the assessment to formulate appropriate diagnoses (mean = 4.5, SD = 0.6)



Use assessment findings to prioritize health problems and shape the plan of care (mean = 4.4, SD = 0.6)



Develop a plan of care (mean = 4.5, SD = 0.6)



Implement or delegate implementation of interventions (mean = 4.5, SD = 0.6)



Facilitate cost-effective episodic and continuing care (mean = 4.1, SD = 0.7)



Evaluate effectiveness and efficiency of interventions (mean = 4.5, SD = 0.6)



Evaluate ways to provide high quality, cost-effective care (mean = 4.2, SD = 0.6)



Incorporate the client’s values, beliefs, and experiences (mean = 4.7, SD = 0.5)



Use knowledge of cultural, social, and political influences on the client’s health and health care outcomes (mean = 4.6, SD = 0.5)



Use principles and skills of negotiation, communication and group dynamics (mean = 4.5, SD = 0.5)



Establish and maintain a collaborative relationship (mean = 4.8, SD = 0.4)



Use credible research findings and a broad range of knowledge to refine the practice or to develop new strategies (mean = 4.5, SD = 0.6)



Use credible research findings and a broad range of knowledge to influence quality of care (mean = 4.4, SD = 0.8)

4. Alumni Survey (AS)  Alumni Employment Status and Contribution after Graduation



It took 10.4 months on average to begin their first advanced practice job after graduation.



27% of them started their first job as a specialty NP and 13.5% as primary care NP. Currently 27% are working as a specialty NP and 16.2% as primary care NP.



Alumni are working in various healthcare settings; 43% of them are currently working in acute care hospitals.



Alumni have taught continuing education (46%), participated in grant writing (24%), written journal articles/books (22%), received honors/awards/certificates (36%), delivered conference presentations (41%), and served on specific committees for improving health care outcomes or health care systems (41%). Many alumni hold membership in professional organizations (76%).

 Alumni Satisfaction 

Alumni responded that their Master’s program met their educational goals well (mean = 4.2) and it was flexible (mean = 4.2).



Alumni responded that the Master’s program facilitated: 1) The ability to assess and manage health-related issues in the following areas: -

Individuals : mean = 3.6, SD = 1.2

-

Families: mean = 3.4, SD = 1.1

-

Communities: mean = 3.5, SD = 1.1

-

Systems: mean = 3.6, SD = 1.0

2) The development in the following areas: -

Conceptual skills: mean = 4.1, SD = 0.8

-

Cultural Competency in knowledge inquiry and clinical practice: mean = 4.1, SD = 0.8

-

Leadership or management skills: mean = 3.8, SD = 0.9

-

Scholarly skills: mean = 4.2, SD = 0.8

3) The ability in the following areas: -

Evaluating the adequacy of underlying knowledge: mean = 4.1, SD = 0.7

-

Assessing, managing health-related issues with a designed population or care system, and evaluating the effectiveness of these advanced nursing practices: mean = 4.1, SD = 0.8

-

Utilizing knowledge and skills in professional practice among diverse and multi-cultural populations: mean = 4.1, SD = 0.9

-

Demonstrating competence in development of inquiry: mean = 4.1, SD = 0.8

-

Developing and utilizing leadership strategies: mean = 3.9, SD = 1.0



About 59% of MN alumni had a plan to pursue further education, such as continuing education (17%) or Specialty Certification (17%). Six alumni had already enrolled in a doctoral degree or certificate program.



78% stated that they would choose the University of Washington School of Nursing again, while 5% answered they would not do so.

5. Colleague Evaluation (CE)  Three supervisory colleagues completed and returned the Colleague Evaluation Survey. Mean scores for evaluation items ranged from 4.3 to 5.0. One supervisory colleagues ranked our MN graduates as top 5% compared to all other individuals in similar positions.

Master of Science Program (MS) 1. End-of-Program Evaluation (EPE)  New MS graduates evaluated that the Master’s program of study met their educational goals well (mean = 4.1) and was very flexible to meet individual educational goals (mean = 4.4).  Program Outcome: To what extent do you feel your program facilitated 1) The ability to assess and manage health-related issues in the following areas: -

Individuals : mean = 2.9, SD = 1.2

-

Families: mean = 2.9, SD = 1.6

-

Communities: mean = 4.1, SD = 0.6

-

Systems: mean = 4.4, SD = 0.7

2) The development in the following areas: -

Conceptual skills: mean = 4.3, SD = 0.5

-

Cultural Competency in knowledge inquiry and clinical practice: mean = 3.8, SD = 1.0

-

Leadership or management skills: mean = 4.1, SD = 1.0

-

Scholarly skills: mean = 4.6, SD = 0.5

3) The ability in the following areas: -

Evaluating the current state of knowledge: mean = 4.4, SD = 0.9

-

Developing and implementing a research study: mean = 4.1, SD = 0.8

-

Evaluating the application of inquiry-based knowledge: mean = 4.3, SD = 0.7

-

Articulating ethical issues and responsibilities involved in research: mean = 4.1, SD = 0.8

-

Developing and utilizing leadership strategies: mean = 4.5, SD = 0.5

 Mean scores of new graduates’ experiences at the School related to various socialization/discussion outside of class/study opportunities with other racial/ethnic groups were 4.1, 3.8 and 4.0, respectively. The degree of agreement with the statements regarding discrimination and being stereotyped by faculty was low (means for both items were 1.5 and 1.4, respectively). 

All new graduates had plans for further education (e.g., continuing education > PhD in nursing science & Advance education other than nursing). In total, 87.5% of new graduates stated that they would choose the University of Washington School of Nursing again, while 12.5% answered they do not know.

2. Scholarly Inquiry Scale (SIS)  Faculty members evaluated new graduates’ competency in scholarly inquiry that reflected six program outcomes. Mean scores of the new MS graduates’ competency of scholarly inquiry ranged from 4.3 - 4.9. 

Highest - How well did this student link the results or product of the thesis to theories, practice, and research?



Lowest – How well did this student address the relevance and/or limitations of the thesis to culturally competent practice, education, or administration in the oral presentation, written report, or both?

 Editing by faculty for written work was required for most MS students. None of MS students required extensive editing by faculty. No student employed professional editor for their work. 3. Alumni Survey (AS)  All MS alumni were enrolled in the Clinical Informatics and Patient-Centered Technologies program.  Alumni Employment Status and Contribution after Graduation 

It took 2.3 months on average to begin their first advanced practice job after graduation.



55% of them started their first job as a clinical analyst or informatics-related field. Currently 55% of alumni are working in areas related to clinical informatics.



Alumni are working in various healthcare settings; 73% of them are currently working in acute care hospitals.



Alumni have taught continuing education (73%), written journal articles/books (27%), received honors/awards/certificates (27%), delivered conference presentations (36%), and served on specific committees for improving health care outcomes or health care systems (55%). All alumni hold membership in professional organizations.

 Alumni Satisfaction 

Alumni responded that their Master’s program met their educational goals well (mean = 4.5) and it was flexible (mean = 4.5).



Alumni responded that the Master’s program facilitated: 1) The ability to assess and manage health-related issues in the following areas: -

Individuals : mean = 3.9, SD = 0.5

-

Families: mean = 3.7, SD = 0.8

-

Communities: mean = 3.9, SD = 1.1

-

Systems: mean = 4.1, SD = 1.1

2) The development in the following areas: -

Conceptual skills: mean = 4.4, SD = 0.7

-

Cultural Competency in knowledge inquiry and clinical practice: mean = 4.2, SD = 0.6

-

Leadership or management skills: mean = 4.2, SD = 1.1

-

Scholarly skills: mean = 4.3, SD = 1.0

3) The ability in the following areas: -

Evaluating the adequacy of underlying knowledge: mean = 4.3, SD = 0.6

-

Assessing, managing health-related issues with a designed population or care system, and evaluating the effectiveness of these advanced nursing practices: mean = 4.4, SD = 0.8

-

Utilizing knowledge and skills in professional practice among diverse and multi-cultural populations: mean = 4.2, SD = 0.8



-

Demonstrating competence in development of inquiry: mean = 4.5, SD = 0.7

-

Developing and utilizing leadership strategies: mean = 4.3, SD = 0.9

About 55% of MS alumni had a plan to pursue further education, such as DNP (17%), conference/seminar (17%) or specialty certification (17%).



91% stated that they would choose the University of Washington School of Nursing again.

4. Colleague Evaluation (CE)  Two supervisory colleagues completed and returned the Colleague Evaluation Survey. Mean scores for 11 evaluation items were ranged from 3.5 to 5.0. One supervisory colleagues ranked our MS graduates as top 5% compared to all other individuals in similar positions.