TERMS OF REFERENCE FINAL PROJECT EVALUATION ‘ Consultancy Summary: Mission Station: Consultancy Duration: Start Date:

Evaluating of the “Mobile Outreach One Stop Shop” (MOOSS) project in Fiji. Suva, Fiji with travel to project locations across Fiji Technical support required over a 1 month period Immediately

ORGANIZATIONAL BACKGROUND Medical Services (MSP) was established as an NGO in 2010 to provide communities in the Pacific with improved access to health care, information and clinical services, specifically in the sectors of reproductive health care, family planning, maternal and child health care and adolescent health. MSP exists to: · ·

Enable Pacific women and adolescents to have greater access to quality health care services and useful knowledge for successful family planning. Assist governments to manage interactions between vulnerable populations and island resources.

MSP Strategy: MSP offers technical assistance to individuals, communities and groups to improve their access to development services and resources. MSP has a ‘People First’ approach that values and embraces the collaborative nature of traditional communities and values people as part of the solution. Women and youth are supported in programs as potential agents for change and development, at the family, community and governance levels. Working in the health sector, MSP is a pro-choice, rights-based organization supporting women and youth to have the right to choose the number and spacing of their children. MS believes that empowered women who have choices and access to information and health care choices are more resilient and better able to respond to economic threats or natural disaster such as climate change. MSP teams work in partnership with key stakeholders and local government under formal protocols which maximize resources and enhance multi-stakeholder coordination mechanisms to strengthen service delivery. MSP recognises that successful long term health and development outcomes require peaceful contexts with sustainable development initiatives. Therefore, MSP programs have an underlying human rights, health and environment agenda. MSP aims to prepare and empower communities to both manage and address issues of conflict and climate change as they relate to health and population growth. The MSP Pacific strategic plan has 4 Pillars: 1. 2. 3. 4.

Strengthening health and social services for women & Youth (& children) Promoting human rights, ending VAWG & strengthening Child Protection Environmental Health and Climate Adaptation Building resilient Pacific communities

TERMS OF REFERENCE FINAL PROJECT EVALUATION

Health Sector Focus A key aspect of all MSP programs is the health program. MSP seeks to respond to the needs of both urban and rural women and adolescents for information and reproductive health services; promoting awareness of reproductive tract infections, STI’s, HIV and AIDs, cancers of the reproductive system; and family planning so everyone can make healthy life choices. MSP also supports safe motherhood and provides maternal and child health care services on demand. The MSP program in Fiji seeks to provide a comprehensive range of health and social services to strengthen reproductive health choices and ensure all have access to information. MSP uses a dual program approach which combines a static clinic in Suva (a One Shop Stop model) with Mobile Clinical Outreach Service. MSP has an expanding service sector. Health services include general medical examinations, pre and post natal exams, maternal/child health, reproductive health, STI/HIV testing, cancer screening, family planning, post rape care, safe abortion counselling, nutrition awareness, counselling, information on health and human rights/gender and referrals to MOU partners and medical services. MSP teams also work with high risk and vulnerable groups (e.g. youth, MSM, sex workers, vulnerable women) to increase awareness and access to key clinical and social services. MSP Outreach teams provide professional and confidential clinical services to remote and isolated groups, working in close partnership with local government Zone nurses (under a MOU) and will work with the Department of Community Police teams to tailor information and service packages. MSP has an Memorandum of Agreement (MOA) with the Fiji Police Force to provide clinical support and service choices for those impacted by sexual assault and gender violence. Youth Focus The MSP health program is designed to support the goal of the Fiji MOH Reproductive Health Policy and the Pacific Policy Framework for Achieving universal Access to RHS and Commodities 2008-2015 and the ICPD+15 program of action. The population of the Pacific is young and thus, MSP ensures its program considers the needs of youth as a priority. By ensuring access to reproductive health services, MSP health projects specifically address risks to which young people in the Pacific are most vulnerable: 1. 2. 3. 4.

Teenage pregnancy Unmet need for contraception STI, HIV/AIDS and RTIs Sexual violence and exploitation

EVALUATION OF THE MOOSS PROJECT MOOSS Project Goal: To reduce morbidity and mortality related to sexual and reproductive practices; in particularly the reduction of sexual abuse, unplanned pregnancy, and STI’s including HIV among women and young people, thus contributing to the achievement of MDG 5.

TERMS OF REFERENCE FINAL PROJECT EVALUATION Overall MOOSS Project Objective To address the immediate and urgent needs of women and adolescents for access to reproductive health/family planning/maternal/child health care services, information and support services, through the provision of mobile clinical outreach and a ‘one stop shop’ youth friendly clinic. By ensuring access to reproductive health services, the project will specifically address risks to which young people in the Pacific are most vulnerable: 1. 2. 3. 4.

Teenage pregnancy Unmet need for contraception STI, HIV/AIDS and UTI’s Sexual violence and exploitation

The project will support and strengthen the goals (1&2) of the Fiji MOH Reproductive Health Policy, including Section 1 Strategic Area 2 – “The provision of comprehensive and integrated RH services with emphasis on linkages with HIV/STI services, including cancer prevention and treatment, fertility services and other emerging areas.” Section 2 – Maternal and Neonatal Health, Section 4 – Adolescent Health and Section 5 – Family Planning and Post Abortion Services.

Task: Summative Evaluation of the MOOSS Project

Evaluation Instructions: The evaluation should follow the recommendations of the Australian Government DFAT Guidelines for Evaluation of overseas development projects which refer to the OECD Development Assistance Committee (DAC) guidance for evaluating projects. Importantly, MSP Evaluations should follow the ethnics noted by DAC. Specifically, the “DAC Guidelines and Reference Services “ Quality Standards for Development Evaluation” 1 and the MSP Project Management Manual (guidelines for Evaluations (See Annex 1 & 2). In addition, Evaluators should refer to the Active Learning Network for Accountability and Partnership in Humanitarian Action (ALNAP) Quality Proforma2 criteria for an evaluation [http://www.alnap.org/resource/10400.aspx]. Evaluators can find technical assistance on evaluations at http://www.alnap.org/resource/10400.aspx Evaluation Purpose Statements  To assess the degree to which project objectives were achieved.  To assess the impact of the project in mobile outreach  To assess the impact of the One Stop Shop against stated objectives  To assess the degree that gender was considered during the project  To examine the changes that resulted and impact on women and youth who benefited from doing the project. http://www.dfat.gov.au/aid/how-we-measure-performance/ode/Documents/dac-quality-standards-qualityevaluation.pdf 2 http://www.alnap.org/resources/quality_proforma.htm and http://www.alnap.org/resource/10400.aspx 1

TERMS OF REFERENCE FINAL PROJECT EVALUATION        

To document the lessons learned and record opportunities and gaps To provide recommendations for project development and improvement. To examine key cross cutting issues To assess gaps such as sanitation and hygiene awareness (areas which are not yet targeted in mobile outreach) To asses impact on reducing Violence Against Women and Girls To assess impact on reducing maternal and infant mortality Building the capacity of project teams to better understand Evaluation processes To provide input to guide decision making for the upcoming renewal and extension of projects aimed to expand services nationally to reduce and respond to issues of VAWG and improve services for women and youth.

METHODOLGY The evaluation exercise will entail a combination of: a comprehensive desk review and document analysis; followed by consultations with key stakeholders; and in situ discussions with a sample of 10 villages (3 in each of the key provinces if possible). The evaluation will be participatory in nature and will make use of focus groups and semi structured interviews. MSP will at all times prioritize the involvement of women team members and community representatives. Both qualitative and quantitative approaches shall be applied. Semi structured Interviews based on check list: A set of questions (will be predetermined or not) about certain Topics that are posed to a target audience and followed by additional questions and conversations. Knowledge skill Test: A set of questions that determine the level of knowledge or skills in Project participants Focus Group discussions: with a relatively small number of selected people About certain questions. Evaluation form: A set of questions that determine the participants’ opinions, attitudes, and understanding once a project activity is complete. Risk analysis matrix: Review the risk matrix against outcomes findings and context. As part of the TOR briefing

Specific Activities 1. 2. 3. 4.

Consult with the Senior Management Team of MSP Consult with the Health and Medical Advisor of MSP in formulating assessment of clinic program Consult with MOH stakeholders Consult with FPF SOU stakeholders

TERMS OF REFERENCE FINAL PROJECT EVALUATION 5. 6. 7. 8. 9.

Consult with community representatives Present the findings in a draft report to MSP Present the final findings to the FCPD team Be prepared to present final findings to other stakeholders such as the MOH Partner with the MSP Health and Clinical Advisor on the standards and guidelines for assessing the clinic and medical services. 10. Where opportunity aligns, be prepared to build the capacity of local staff Expected Deliverables 1. Desk Review of Project Documentation (checklist/matrix) 2. Draft Evaluation Report on the MOOSS project, which includes the current findings and recommendations and presentation to MSP SMT 3. Final Evaluation Report & presentation 4. Financial acquittal of field expenses

General Activities ·

· · · · ·

Review of secondary documents: Such as the ‘Interagency Guidelines on Child Protection’, and the MOH Guidelines for Medical Practitioners dealing with Intimate partner violence (to be provided by MSP) and the MOH Reproductive Health Guidelines and strategic plan. Meetings with MSP and formulation of Evaluation Team Preparation of Work Plan and field travel schedule and booking meetings Interaction with the MOH staff members at Province and district level Field visits to communities and discussions with women and youth on awareness and clinical services. Assessment of the One Stop Shop service

Activity Schedule: Activity Detail 1. Consultation with MSP on the project and review of project Documentation, policies and related literature. 2. Planning and scheduling field visits. 3. Meetings 4. Travel to the field to conduct evaluation activities. Ensure Gender Analysis in review. Conduct consultation with district level stakeholders, e.g. women and youth in the targeted villages and other members, local government and partners. 5.Assessment of the One Stop Shop services 6.Work with MSP SMT, the Program Manager, the Health and Medical Advisor, and the M&E staff. 7.First draft evaluation report submitted to MSP SMT 8.Final draft and presentations 9. Final draft Submitted

Wk1

Wk2

Wk3

Wk4

TERMS OF REFERENCE FINAL PROJECT EVALUATION

Qualifications and Experience Education University degree in Health, Development Studies, Gender Studies or Social Sciences. Postgraduate qualifications in supporting development sector. Experience - At least three years of postgraduate professional experience in overseas aid programs and experience in Fiji or the Pacific contexts - Gender expertise, ideally in Pacific Island settings, designing and undertaking Gender assessments and analysis; and mainstreaming Gender in project design/implementation/monitoring - Experience in project design, monitoring and evaluation or research - Experience working in the Health Sector or in Social Services - Experience in capacity development, including conducting professional trainings (e.g. M&E standards or gender or risk assessments) - Experience utilizing computers, including word processing, spreadsheets and other standard software; and - Strong verbal and written communication skills. Language - Fluency in both oral and written English at professional level is required - Spoken knowledge of Fijian is preferred* - Fiji Hindi useful but not essential.* *Translators will be available Invoices and Payments Payment will be based on deliverables and will be made in three instalments. MSP will pay 40% of the budget up front to enable rapid deployment and desk review and planning The following payment of 40% will be made after receipt of preliminary findings of the evaluation (field work) and in connection with the quality and performance of the work. The remaining 20% will be paid after the final report is submitted and presented. MSP shall pay for the expenses reasonable incurred as per the agreed upon budget; and based on actual. Budget FJD Evaluation Launch and desk review Draft Report Findings Final Report and Presentations Transport and Accommodation Total FJD

$2000 $2000 $1000 $2800 $7700