Consultant for Expanding IMPACT Final Evaluation At Save the Children

Consultant for Expanding IMPACT Final Evaluation

SCOPE OF EVALUATION

Purpose and key questions

SC intends to conduct a final (external) evaluation of Expanding IMPACT project to generate substantive evidence-based knowledge by identifying and documenting good practices and lessons learned from intended impact and unintended consequences of the project interventions. This evaluation is intended to assess the extent of change that has taken place in the lives of targeted children, quality of services provided, and related policy changes and implementation/response to the COVID-19 pandemic. The results from this evaluation will be highly useful in providing recommendations for the Thai Government, as well as future strategies for Save the Children Thailand.

The results will define key learning and lead the design of the next phase of future child protection and education for migrant children program. To ensure objectivity and credibility, the evaluation is to be led by an external consultant who has made no prior commitment or contribution to the project. The evaluation is expected to take place from April 2021 to June 2021.

The overall objectives of this consultancy include:

· Evaluate project performance, including progress and achievements towards the project goal and objectives, the overall impact of the project, including unintended consequences and the factors that influenced change at all levels of the outcomes framework.

· Measure and report against the project outcome indicators, baseline and mid-term assessment report to create end line information

· Consolidate key success stories and lessons learned from the project

· Assess to what extent the project has made impacts to change at policy level and/or advocacy with local and national government

· Provide recommendation to SCI management and program team for project adaptation and scale up.

Scope

Due to the changing context and often restricted access within the migrant communities located on the Thai-Myanmar border and the resurgence of COVID-19, the evaluation team will be requested to prepare alternative evaluation method, i.e. remote data collection and evaluation, with support from Save the Children, in case the face-to-face data collection cannot be done.

Stakeholders/audiences

The main stakeholders/targeted audiences for this evaluation are:

· Project donor; Australian DFAT-ANCP

· Primary implementing organization; Save the Children Thailand, Expanding IMPACT Team

· Implementing partners; Help Without Frontiers (HWF), Safe Haven Orphanage (SHO)

· Government counterparts; Department of Children and Youth (DCY), Ministry of Social Development and Human Security (MSDHS), Tak Education Service Area Office, Ministry of Education

· Community groups; Parent Teacher Associations, Child Protection Agencies in Mae Sot, Tak province

· Beneficiaries; Children and adults involved in the program/project/s and the evaluation

· International development/humanitarian research community; International Rescue Committee (IRC) – Child Protection program

EVALUATION METHODOLOGY

Research design and sampling

The suggested research design for this evaluation is a mixed methods design including participatory methods if and where possible. Both qualitative and quantitative data collection and analysis for addressing each of the evaluation criteria. SCI anticipates the methodology to include a review of project documents, semi-structured interviews and focus group discussions with relevant stakeholders including beneficiaries, observations, and review of project monitoring data. The consultant is encouraged to propose additional methodology that they consider appropriate to the project, which is subject to Save the Children’s approval and must meet ethical guidelines (Annex I).

The evaluation will focus in the targeted areas in Tak province. It will involve children, teachers, relevant local education authorities, child protection agencies, project partner organizations, and SCI project team. Participants in the study will be selected through purposive sampling.

Data

All primary data collected during the course of the evaluation must be disaggregated by sex, age, people with disabilities, status and location and inclusive of children’s representation.

Save the Children has existing data collection instruments and tools that can be drawn on in the evaluation. These will be shared with the evaluation team.

Save the Children will not provide enumerators to assist with primary data collection. Data triangulation is expected for this evaluation. It will be a requirement of the Evaluation team, including qualified translators, to source additional external data sources to add value to the evaluation, such as consultations with partners and review of project documents.

A range of project documentation will be made available to the Evaluation team that provides information about the design, implementation and operation of the Program. Example of documents include previous evaluations, mid-term assessment reports, ADPlans, and logframe.

Ethical considerations

It is expected that this evaluation will be:

· Child-friendly and participatory. Children should be meaningfully involved in the evaluation as a holistic process and not only as informants. Refer to the Practice Standards in Children’s Participation (International Save the Children Alliance 2005); and Global Indicator technical guidance (SCI M&E handouts Package, Volume 2).

· Inclusive. Ensure that children from different ethnic, social and religious backgrounds have the chance to participate, as well as children with disabilities and children who may be excluded or discriminated against in their community.

· Ethical: The evaluation must be guided by the following ethical considerations:

o Child safeguarding – demonstrating the highest standards of behaviour towards children

o Sensitive – to child rights, gender, inclusion and cultural contexts

o Openness – of information given, to the highest possible degree to all involved parties

o Confidentiality and data protection – measures will be put in place to protect the identity of all participants and any other information that may put them or others at risk.

o Public access – to the results when there are not special considerations against this

o Broad participation – the relevant parties should be involved where possible

o Reliability and independence – the evaluation should be conducted so that findings and conclusions are correct and trustworthy

It is expected that:

· Data collection methods will be age and gender appropriate.

· Evaluation activities will provide a safe, creative space where children feel that their thoughts and ideas are important.

· The Evaluation team will adhere to the Save the Children Child Safeguarding, Data protection and Privacy policies that are required throughout all project activities.

EXPECTED DELIVERABLES

The evaluation deliverables and due dates (subject to the commencement date of the evaluation) are outlined below. The lead evaluation consultant will advise the Expanding IMPACT Project Coordinator immediately of any risks or issues that may impact on their ability to provide the deliverables by these due dates.

Deliverable: The Evaluation Team is contracted and commences work

Due Date: April, 2021**

Phase 1: INCEPTION PHASE

Deliverable: The Evaluation Team will conduct initial desk research and tool review and develop and submit the Inception report that will include:

· evaluation objectives and key evaluation questions

· description of the methodology, data sources, draft data collection tools (preferably against the key evaluation questions and selected indicators for baseline assessment) and sampling considerations

· caveats and limitations of evaluation

· key deliverables, milestones and timelines

· risk and issue management plan

· a stakeholder communication and engagement plan

· consultation protocols for consulting with children and other vulnerable groups (if applicable)

· Logistical or other support required from Save the Children

Once the report is finalized and accepted, the evaluator/ evaluation team must submit a request for any change in strategy or approach to the Education Technical Advisor and Expanding IMPACT Coordinator Due Date: To be submitted within 15 days after signed contract (4th week in April 2021)

Deliverable: Ongoing Desk Research of project documents and secondary sources

Due Date: On-going April to May 2021

Deliverable: Feedback by SCI

Due Date: Within 5 working days after receiving the inception report

Deliverable: SCI Approval of Inception Report and data collection tools

Due Date: Within 1 week after review completed –End of April 2021

Phase 2: DATA COLLECTION and ANALYSIS

Deliverable:

· Field work plan and logistical arrangements

· Translation of tools

· Data collection

· Data analysis

Due Date: End of May (15 days)

Phase 3: REPORTING

Deliverable: Preliminary findings presentation and verification workshop with partners **

Summary of interim findings

· Any emerging program issues or risks (if applicable)

· Key tasks for the next stage of the evaluation and any proposed refinements or changes to methodology (if applicable)

Due Date: Mid- June 2021 (1 day)

Deliverable: Draft Evaluation Report* including the following elements:

· Executive summary

· Background description of the Program and context relevant to the evaluation

· Scope and focus of the evaluation

· Overview of the evaluation methodology and data collection methods, including an evaluation matrix

· Findings aligned to each of the key evaluation questions

· Consolidate and document good practices and lessons learned from intended impact and unintended consequences of the project interventions

· Specific caveats or methodological limitations of the evaluation

· Conclusions outlining implications of the findings or learnings

· Recommendations

· Annexes (Project logframe, Evaluation TOR, Inception Report, Study schedule, List of people involved)

The report should be approximately 30 pages with executive summary.

Due Date: 4^th week of June 2021

Deliverable: Feedback and approval by SCI

Due Date: Within 5 working days after receiving the inception report

Deliverable: Final Evaluation Report*** with submission of **data and analysis incorporating feedback from consultation on the Draft Evaluation Report

Due Date: End of June (3 days)

Deliverable: Knowledge translation materials:

· PowerPoint presentation of evaluation findings

· Evidence to Action Brief**

Due Date: 1^st Week of July (1 day)

*All reports are to use the Save the Children Evaluation report template. Please also refer to Save the Children technical writing guide.

** The Evidence to Action Brief is a 2-4-page summary of the full report and will be created using the Save the Children Evidence to Action Brief template.

All documents are to be produced in MS Word format and provided electronically by email to the SC Expanding IMPACT Project Coordinator, MEAL Coordinator, Education Technical Advisor and Child Protection Technical Advisor. Copies of all PowerPoint presentations used to facilitate briefings for the project should also be provided to Save the Children in editable digital format.

CONSULTATION

Key Save the Children stakeholders to be involved in the evaluation are the Expanding IMPACT Project Team; REACT Project Team (Education component); MEAL Coordinator; Education Technical Advisor; and Child Protection Technical Advisor.

External stakeholders to be consulted for key informant interviews and data validation meeting include representatives from the following partners and local education authorities: HWF, SHO, Life Impact, IRC. The Expanding IMPACT team will work closely with the evaluator to identify key representatives and coordinating the key informant interviews and data validation meeting as appropriate.

EVALUATION TEAM

To be considered, the Evaluation team members together must have demonstrated skills, expertise and experience in:

· Masters’ degree in Social sciences, education, international relation or relevant area to the project.

· Proven experience designing and conducting high quality project evaluations based on OEDC-DAC evaluation criteria

· Proven ability and track record conducting ethical and inclusive research with vulnerable populations while ensuring rigorous ethics, integrity, and safeguarding especially in migrant setting;

· Thai or international consultant who has experience to work in Thailand

· Ability to work independently and meet tight deadlines

· Language proficiencies required include: English, Thai, Karen and Burmese; kindly include a clear plan for language proficiencies in the team and/or translators included in the team

· Flexibility to travel to remote areas

There is a high expectation that:

· Members (or a proportion) of the evaluation team have a track record of working together.

· A team leader will be appointed who has the seniority and experience in leading complex evaluation projects, and who has the ability and standing to lead a team toward a common goal.

· The team has the ability to commit to the terms of the project, and have adequate and available skilled resources to dedicate to this evaluation over the period.

· The team has a strong track record of working flexibly to accommodate changes as the project is implemented.

Time Frame: April – July 2021

Applications for the consultancy should include:

· Expression of interest: stating candidate skill and experience suitable for the consultancy (max 1 page)

· Technical and financial proposal: Outline of evaluation framework and methods, proposed timeframe, work plan and budget (max 4 pages; applications over limit will be automatically excluded).

· CV of proposed individual/s and one piece of evidence of similar evaluation carried out previously

** Please contact SCI Procurement for full TOR along with selection criteria.**

Close Date for Submissions:

If you are interested in this evaluation, please submit a proposed plan for evaluation design and implementation with detailed schedule and proposed budget (consultant fee and all proposed expenses including translators (if lead candidate is International consultant) by 15 April 2021

Submissions should be addressed to: [email protected]

Please indicate in the subject as ‘Consultant for Expanding IMPACT Final Evaluation _(Name of applicant)’

Only shortlisted candidates will be notified.

“We need to keep children safe so our selection process, which includes rigorous background checks, reflects our commitment to the protection of children from abuse”

[KK1]Remove as already stated below.