External Evalutation Consultant

1. Background

Period being evaluated: January 2019 – August 2020

Dates of the evaluation: August - October 2020

Project intervention zones: Bekaa Governorate

Project duration: 20 months

Project Background: International Alert is implementing the third phase of its dialogue project in the Bekaa to support local dialogue networks with capacity development and accompaniment on conflict analysis and sensitivity. The project is funded by the Human Security Department at the Swiss Embassy in Beirut.

This third phase of work (between January 2019 and August 2020) builds on the achieves and learning of the previous two phases. In Phases I and II the Bekaa Dialogue Group (BDG) was established and its capacities built on conflict-mapping, conflict-analysis, and facilitation skills. In Phase II the BDG identified as three topics which cause high conflict and tensions, these were: (a) Education, (b) Protection, and (c) Natural Resource Management.

Phases I and II of this project constituted piloting and proof of concept of the dialogue model and the approach of integrating conflict sensitivity into water management in the Bekaa: developing a dialogue mechanism (facilitating dialogue, supporting initiatives and establishing a platform for increased outreach through the conference). Phase III aimed at consolidating the learning and building on these results to a) further strengthen and grow the dialogue mechanism, with a focus on local ownership and sustainability, b) develop and connect up additional dialogue groups, and c) connect up the dialogue process with key institutions, that provide basic services such as water, to address tensions.

As such, this third phase focused on capitalisation of learning, scale up and replication of the dialogue mechanisms, transfer of capacities and evidencing the approach for similar dialogue and conflict mitigation projects in Lebanon.

The external final evaluation of the project will inform the design of a fourth phase of this project, consolidate learning acquired throughout the project on dialogue and networking as a peacebuilding tool, and will support Alert’s developing of projects that focus on the integration of peacebuilding and conflict-sensitivity in the light of the new contextual developments such as the COVID-19 pandemic, the October 2019 movement, and the economic and financial crisis that Lebanon is currently going through.

2. Objectives of the evaluation

The external evaluation aims to work on a theory-based evaluation as well as to derive lessons learned.  It aims at measuring the overall aim of the project which is to strengthen local capacities in dialogue and reduce and mitigate conflicts in the Bekaa. The evaluation will also measure the project’s specific objectives of: 1) to strengthen and sustain local capacity for conflict mitigation developed through the ‘Creating Space for Peace’ dialogue mechanism and process; 2) to promote and foster positive relations between Lebanese and Syrian communities; with a focus on youth and women; and 3) to promote conflict sensitive provision of basic services (including water) through local peacebuilding networks and locally led community engagement.

The objective of the evaluation is to assess and evaluate the success of the project in terms of:

• Lessons learned regarding the integration and adoption of peacebuilding and conflict-sensitive approaches in local peacebuilding and networking and provision of basic services.
• Alert partners’ view, understanding, and assessment of programming through a conflict-sensitive and peacebuilding lens. 
• The relevance and potential for success of a further project phase.

Suggested lines of inquiry include:

Relevance

• Does the intervention appear to address relevant key causes and drivers of conflict and fragility in the areas of implementation: Bekaa?
• What is the relevance of the intervention as perceived by the local population, beneficiaries and Alert partners?
• Has the intervention responded flexibly to changing circumstances over time?

Impact

• To what extent does the problem that the project is addressing exists, and who is it affecting? How?
• What are our outputs and immediate results of activities?
• What are the short-mid term social changes (outcomes) and long term results (impacts) of our activities?
• To what extent are the outcomes a result of our activities? Can the outcomes be attributed to our activities?
   

Sustainability

• To what extent would the benefits of the project continue after donor funding ceases?
• What were the major factors which influenced/influence the achievement or non-achievement of sustainability of the access to livelihoods and protection?
• To what extent do Alert’s partners see and evaluate the added-value of the peacebuilding and conflict-sensitive perspective in the way they implement/facilitate programs?

Learning

• What were the major lessons learned from the project?
• What are the main learnings/contribution of dialogue to local peacebuilding outcomes?
• What are the main learnings/lessons learned regarding Alert’s selection of partners for the implementation of project?
• What were the main lessons learned regarding mainstreaming conflict-sensitive approaches to local peacebuilding and social stability?
• What recommendations did the project result in that can help Alert in future proposal writing and program planning?

3. Evaluation Timing and Duration

The evaluation will be conducted in September and October 2020. It is expected to take 30 days. The precise timing will be discussed and agreed on with the consultant, however, Alert envisages a preliminary schedule that includes the following:

• Preparation (reading, etc.): 3 days
• Initial planning and development of tools: 2 days
• Methodology and logistics planning with Alert staff and partners: 1 day
• Reflection session (with project team and partners): 1 day
• Piloting of tools: 1 day
• Data collection and analysis: 14 days
• Restitution workshop on results with staff, partners and stakeholder representatives: 2 days
• Report Writing: 5 days
• Finalisation of report after feedback: 1 day
• Dissemination of evaluation findings: Alert

Alert will review and respond to the first draft of the report within 10 working days. Based on the comments the Evaluator will amend the draft report and the final report should address and respond to Alert’s feedback.

4. Evaluation Methodology

This evaluation will adopt a qualitative and reflective approach, and utilise several data collection tools: context review, project document review, direct observation, interviews with key informants [partners, consultants, and beneficiaries], and focus group discussions.  Given the learning outcomes to be derived from this project, it is essential that the evaluation process engages Alert’s partners, the consultants, and the partners’ beneficiaries in the evaluation.

This evaluation will include the following steps:

• Preparation: Key project documentation will be provided to the consultant and will include the project proposal, logframe, donor reports, partner reports, activity reports, and monitoring data. Following this the consultant will draft a revised methodology plan, work plan and evaluation tools, which will be reviewed and finalised with the project team including methodology and planning meetings with Alert. 
• Fieldwork: to collect data, carry out interviews and focus group discussions. The fieldwork will be carried out in areas of implementation (Central, North, and West Bekaa, and Beirut).
  Alert will provide lists of the different stakeholders and beneficiaries of the project for the consultant to select from and will ensure that project staff assist and accompany the consultant throughout the evaluation.
  Interviews and/ or focus group discussions will be carried out with: project staff, other Alert staff in country, Alert Headquarters staff involved in the project, and project partners, beneficiaries and stakeholders. 
• Analysis of results: All collected data, obtained through the methodology, should form part of a comprehensive analysis that leads to lessons learned and list of recommendations.
• Restitution: At the end of the fieldwork and before submitting the draft report, the consultant will lead a restitution workshop with key project stakeholders to present their initial observations, conclusion and recommendations, with a dedicated session on ideas for developing the next phase of the project.
• A draft report responding fully to these terms of reference.
• A final report taking into account the observations and comments of Alert.
   

5. Deliverables

• Evaluation plan by July 31, 2020
• Tools for data collection by August 14, 2020
• Draft report by September 11, 2020
• Final report September 25, 2020
• Conducting learning and development sessions based on the evaluation findings to Alert and its partners by October 9, 2020.
   
  All deliverables are to be presented in draft format and at a meeting for Alert and partner staff, before being finalised. All deliverables and data of the evaluation will be owned by Alert and may be used for both internal and external reporting and communications.

The main body of the report, in Word format, should be between 20 and 30 pages (excluding the appendices/annexes) and is to include the following elements:

• Contents table
• Executive Summary
• Introduction
• List of Acronyms
• Background (description of the project)
• Evaluation objectives and criteria
• Methodology and challenges
• Main results and analysis, clearly responding to the evaluation criteria and key questions in the TOR and referring to the project’s results and indicators
• Conclusions and recommendations, focusing on programme development for the next phase
  Annexes: Three case studies of what has worked well (written), evaluation Terms of Reference, meeting calendar, tools used in evaluation (question guides, questionnaires, observation grids), list of documents consulted.
   

6. Support and resources to be provided by Alert

Alert staff, the Programmes Manager, and the DMEL Manager, will be available to provide the necessary support to the external evaluator.  In addition, Alert’s Senior Field Coordinator in the Bekaa will assist in coordinating meetings between consultant and beneficiaries and/or Alert partners in the field. 

The consultant is responsible for his/her own transportation and will need to have his/her own computer. 

Alert will also provide all key documents such necessary to perform the assignment, as detailed below, at least one-week prior to the start of the fieldwork, to be provided by the project officer.

7. Required skills and experience
 

• University degree in social sciences or relevant fields
• Experience of conducting external evaluations in Lebanon
• At least five years of experience with familiarity for standards of ethical conduct in research/evaluation settings 
• Has experience in evaluations/research relating to peacebuilding, protection, livelihoods, and/or economic stability
• Sound and proved experience in conducting evaluations and impact assessments, particularly utilization and learning focused evaluations.
• Expertise in qualitative and quantitative data collection techniques
• Expertise in conducting learning sessions and/or trainings
• Fluent in English and Arabic
• Strong inter-personal communication skills
• Excellent skills in research and data collection
• Ability to work both independently and as part of a team
• Demonstrated ability to handle sensitive information with discretion and professionalism
• Ability to work under pressure and meet deadlines
• Prior experience working on public consultation projects is a plus

Evaluation Criteria:

Technical Criteria (60%)

• Quality of proposal (level of effort/details put into proposal and level of understanding of assignment scope). (10%)
• Methodology (approach (mixed: qualitative and quantitative) and the extent to which the proposed sample covers all concerned stakeholders). (10%)
• Candidate profile (the strength and relevancy of the candidates’ academic background, technical and evaluation expertise). (15%)
• Delivery of Report within 30 days. (25%)

Financial Criteria (40%)

Total Price: Bidder’s price is within budget allocated for evaluation. (40%)