Title: Consultancy on a Mid-Term Evaluation of the Regional Project Southeast Asia: Combatting Human Trafficking and Promoting Safe Migration (2021-2023)

Location: Philippines (Manila, Mindanao), Indonesia (Lombok, Java)

Duration of Appointment: Up to 45 days during July – September 2022

 

1. Background

AWO International was founded in 1998 as a professional association for development cooperation and humanitarian action within the framework of the German welfare organization “Arbeiterwohlfahrt” (AWO). It draws on the expertise and experience of AWO in Germany, which has been an integral part of the German welfare state since the last century.

In close cooperation with local non-governmental organizations in Central America, East Africa, South Asia, and Southeast Asia, AWO International is working to ensure that disadvantaged people achieve sustainability in improving their living conditions. The organization has a special approach in its development projects, which aims at the “Enhancement of Social Structures.” Its goal is to set up and strengthen the social structures wherein the people are interacting. To achieve this, AWO International and its partner organizations concentrate their efforts on providing organizational development and supporting civil society networks at the local and regional level.

The Regional Office in Southeast Asia (RO SEA) is implementing the Regional Project  on “Combatting Human Trafficking and Promoting Safe Migration in the Philippine, Indonesia and Malaysia” with funding from the German Federal Ministry of Economic Cooperation and Development (BMZ). The Regional Project started in 2018 and was extended until 2023. The overall objective is to capacitate marginalized communities in rural and urban areas and protect them against unsafe migration and human trafficking. The Regional Project also works to improve their access to development opportunities and help them secure their livelihoods through self-determined processes and structures. For the planned Mid-Term-Evaluation 5 out of 10 current partnership projects in the framework of the Regional Project shall be evaluated as listed below:

  1. Advocacy for Indonesian Migrant Workers / ADBMI (Indonesia): Scaling Up Community Based Initiative for Migrant Workers’ Early Protection in their Villages in East Lombok
  2. Center for Migrant Advocacy, Inc. (Philippines): Building Rights-Based and Resilient Social Structures for Migrant Workers and Their Families
  3. Mindanao Migrants Center for Empowering Actions, Inc. (Philippines): Engaging Migrant Workers and Families in Social Structures towards Promoting Safe and Regular Migration
  4. OND Hesed Foundation, Inc. (Philippines): Reducing the risk of trafficking in persons (and forced labour) in Fishing Communities through the Strengthening of Social Structures
  5. Institute for Education Development, Social, Religious, and Cultural Studies / INFEST (Indonesia): Activating Migrant Worker Community-Based Organization for Public Service Enhancement and Socio-economic Improvement in East Java and Johor Bahru, Malaysia

These 5 partners have participated in the Regional Project since 2018 or for almost 5 years and are scheduled to continue for the upcoming funding period from 2024.  

Four (4) more partners joined the Regional Project more recently and will not be subject to the current mid-term evaluation.

 

2. Purpose

The purpose of the mid-term evaluation is to draw lessons from the implementation of the individual projects and assess whether the project goals and objectives remain relevant. The evaluation will further assess the extent to which the projects are on track in terms of reaching their targets and objectives and provide recommendations for improvement.

Firstly, the evaluation will review the progress of the selected projects in terms of the DAC criteria relevance and effectiveness, and the sustainability of the intended outcomes.

It will test underlying assumptions about the projects contribution to the broader developmental impact.

More specifically, the evaluation results would contribute to:

  • improving project performance and organizational learning of AWO International and its partners,
  • enhancing the effectiveness of planning and management by AWO International and its partners for the current phase and a future extension of the Regional Project,
  • strengthening the accountability towards beneficiaries and stakeholders by incorporating recommendations and lessons learned,
  • the conceptualization and development of the next phase of the Regional Project and the overall project strategy.

The mid-term evaluation shall look at the projects’ relevance in relation to AWO International’s work in the “Enhancement of Social Structures” which is a cooperation strategy espoused by AWO International aiming to strengthen self-help capacity and initiative of communities and marginalized groups, and encourage participation in social and economic development. It should further analyze the progress in sustainably strengthening the organizational and technical capacity of the partner organizations and the supported social structures.

The evaluation shall integrate gender equality and other non-discrimination approaches as cross-cutting issues into its methodology and deliverables. It shall assess the application of a rights-based approach as well as potential and status of mainstreaming Disaster Risk Reduction into the Regional Project concept.

Lastly, the evaluation shall make reference to the overall impact of CoViD-19 on the members of the social structures, the partner organizations, and on project implementation progress. In this, it shall assess the relevance and effectiveness of the mitigation measures taken by the AWO International Regional Office and its partner organizations as response.

 

3. Role

The Consultant or Lead Evaluator will develop and recommend the most adequate evaluation design and methodology for data collection and data analysis. The consultant will provide technical inputs on the development of tools and facilitate surveys, interviews and focus group discussions etc., virtually, and face-to-face.

S/he shall be recruited internationally and will be working in tandem with local counterparts . The division of tasks and responsibilities shall be decided among the tandems in the inception phase. The consultant will take the leading role and act as the responsible focal person on behalf of her/his team to AWO RO SEA, during the whole evaluation.

The recruitment of the Philippines and the Indonesia counterpart will be the responsibility of AWO International. Recommendations from the Lead Evaluator on the composition of the tandems can be considered.

 

4. Scope

The scope of the evaluation will encompass all planning, monitoring and implementation activities of the projects for the period from January 2021 to the end of June 2022. The evaluation covers all 5 individual projects in selected geographic areas where activities were and currently are being implemented.

The evaluation shall have a total assignment period of no more than 43 days:

  • 7 days preparation phase (review of project and framework documents, inception report)
  • 22 days field phase inclusive of travel between partners’ implementation areas and AWO Intl. Manila
  • 11 days reporting phase (initial findings, evaluation report and recommendations, de-briefing notes for all partners)
  • 3 days international travel (for international consultant if required)

The consultant is expected to carry out the following tasks in accordance with the following TENTATIVE schedule:

#

Task

Responsible person

Indicative deadline

1

Introduction of national counterpart evaluators

RO SEA/ Lead Evaluator and Local Counterparts

30 June 2022

2

Evaluation briefing and RO SEA’s evaluation process.

RO SEA

8 July 2022

3

Provision of project documents such as Project Proposals, updated Logical Frameworks, Monitoring reports, Direct and Indirect Beneficiaries reports, etc.

Receive a full itinerary; schedule per partner organizations, list of recommended/potential persons/social structures/institutions to interview

RO SEA/ Lead Evaluator

8 July 2022

4

Presentation of the inception report to AWO International

This document will be 18 to 20 pages in length, written in English, and will propose the methods, sources, and procedures to be used for data collection and analysis.  It will also include a proposed timeline of activities and the submission of deliverables.

Lead Evaluator

15 July 2022

5

Travel mission to Philippines (with a Philippine evaluator)

Lead Evaluator

27 July – 7 August 2022

6

Travel mission to Indonesia (with Indonesian evaluator)

Lead Evaluator

10 August –

23 August 2022

7

Debrief with RO SEA Project team, presentation of initial findings

Lead Evaluator

2 September 2022

8

Submission of draft evaluation report to AWO Intl.

This draft will be approximately 50-60 pages plus executive summary of max. 5-6 pages and annexes, written in English. It will also contain a brief description of the projects and their contexts and current status, the purpose of the evaluation and its methodology. It will provide major findings, conclusions, and recommendations to AWO International and partner organizations.

Lead Evaluator

9 September 2022

9

Share draft report on individual projects with the respective partner organizations, full draft with AWO Intl. Head Office

RO SEA

16 September 2022

10

Send consolidated comments and feedback on the draft report to the Lead Evaluator

RO SEA

23 September 2022

11

Finalize and submit evaluation report to RO SEA

Lead Evaluator

30 September 2022

12

Review and submit the final report to Berlin

RO SEA

5 October 2022

13

Approval of the Mid Term Report

HO/ RO SEA

28 October 2022

 

 

5. Criteria and Guiding Questions

The evaluation shall analyze the selected projects of the Regional Project within the framework of the DAC evaluation criteria relevance, effectiveness, impact and sustainability, and in compliance with the DAC evaluation quality standards.

For certain projects, specific questions will be added during the evaluation briefing at the beginning of the preparation phase. With this, the varying thematic foci shall be addressed and the diversity of the individual projects regarding beneficiaries and operational environment be acknowledged.

 

Relevance

  • Is there a fit between the project concept and the direct beneficiaries’ needs?
  • To what extent have the individual projects been realigned/recalibrated to provide a timely and relevant response to constituents’ needs and priorities
  • Is the intervention logic coherent and realistic to achieve the planned outcomes? Are the activities supporting the project objectives (strategies)?
  • Did the project consider the gender dimension of the planned interventions through objectives, outcomes, use of outputs, outputs and activities that aim to promote gender equality?
  • Is the project aligned with national/regional/local development plans and priorities, and the Sustainable Development Goals?

 

Effectiveness

  • Have there been any unintended results (positive or negative)? Please give particular attention to the impact of CoViD-19.
  • What were the major factors influencing the achievement or non-achievement of the objectives to date?
  • To what extent has the project adapted its approaches to respond to the CoViD-19 crisis? What have the implications of the crisis and the project’s response (if any) on implementation and achievement been?
  • How effectively was the monitoring mechanisms set up, including the role of the local partner organizations and the regular/periodic meetings and field visits among project staff and with the beneficiary, AWO International and key stakeholders?
  • Are the project design logic and consistent? Are indicators SMART and supported by adequate baseline data? After reviewing the individual Logical Frameworks: what should be done differently when planning the next project phase?

 

Sustainability and impact potential

  • To what extent were sustainability considerations taken into account while conceptualizing the individual projects?
  • Is the to-date achieved progress likely to be long lasting in terms of longer-term effects? What action might be needed to bolster the longer-term effects?
  • What would be effective and realistic exit strategies for the individual projects? What measures should be included?
  • To what extent are concepts of the projects exemplary in the fulfilling the purpose of strengthening social structures? What are the lessons learnt / good practices?
  • To what extent have the projects been able to create livelihood opportunities for women and men where it was intended in the individual project concept?
  • Does AWO International provide sufficient support to capacitate the partners?

 

Gender equality and non-discrimination issues

  • Do the projects align with national mainstreaming strategy on gender equality?
  • To what extent have the projects enhanced women’s and community members awareness about trafficking?
  • How effective have the projects been in responding to gender-specific aspects of migration governance, and the protection of migrant workers?
  • To what extent have gender-specific aspects of the project improved outcomes for male and female migrant workers?
  • How has the monitoring and reporting of the projects considered gender?

 

Social Structures

  • Have planned benefits been perceived to have been received by the social structures?
  • To what extent has collective empowerment been achieved to identify problems, to pursue adequate solutions, and to give the social structures visibility and leverage?
  • How stable is the organizational structure and its generation of resources to create strategic alliances within the community?
  • How efficient is the structures’ governance? Are bylaws and SOPs being followed? Are elected officials of the structures “true leaders” in terms of ownership, and change processes within the organization, and in their communities?
  • To what extent have the Vision, Mission and Goals (VMGs) of the Social Structures been achieved?
  • How were reflections and new ideas integrated to refine groups’ strategy, realign power relationships, and adapt in a rapidly shifting environment?

The list of questions may not be exhaustive and is intended as a guideline that can be adjusted by the evaluator in consultation with AWO International Southeast Asia. Any fundamental change to the evaluation criteria and questions needs to be agreed between Project Officers of AWO International and the evaluator and be reflected in the inception report.

 

6. Deliverables and Coordination

The evaluation will be carried during a pandemic situation that is likely to have implications on field-based research and data collection. If international and domestic travels would be affected by restrictions the evaluator and AWO International will discuss and consider alternative methodologies. This could include the use of virtual meetings, interviews and conferences, and other means feasible.

The evaluator is independent from the donor or any partner and stakeholder involved in the projects to be evaluated.

The final methodology, tools for data gathering and analysis, and evaluation questions will be determined by the evaluator in consultation with AWO RO SEA Project team after the presentation of the inception report. They preferably include:

  • Desk study: review of documents related to the project, including the local partner organization’s initial project documents (proposal Logical Framework, and Contract of Cooperation), reports such as annual narrative and monitoring, and direct and indirect beneficiary reports.
  • Field visits, interviews, surveys and group discussions with key stakeholders, local partner organizations and social structure as well as individual community members in the Philippines and Indonesia, and virtual interviews or discussion for beneficiaries in Johor Bahru/Malaysia.
  • Field visits to the offices of government partners’ will be organized to coincide with a scheduled activity, rather than organizing a separate stakeholder workshop.

 

Products to be delivered in accordance with the schedule agreed upon in the evaluation briefing:

1) Inception report with evaluation design and methodology, including draft questionnaires, interview questions, timeline, list of respondents/groups, required field support (e.g. enumerators)

2) Preliminary findings as presentation to AWO International

3) Draft evaluation report and revised final evaluation report in English language

4) Briefing notes for the partner organizations on the individual projects

Throughout the Mid-Term Evaluation, all parties involved abide by the principles of dialogue and transparency. Continuous communication and consultation will ensure a smooth implementation and valuable results.

 

7. Profile of the Lead Evaluator

  • Advanced University degree in Development Studies, International (Asian) Studies, Migration Studies, Community Development, Statistics, Social Sciences, or related field.
  • At least ten (10) years proven experience in evaluation of development projects.
  • At least five (5) years experience in engaging with Community-Based and Civil Society Organizations (CBOs).
  • Substantial knowledge in migration and trafficking issues.
  • Knowledge of the country context (Philippines, Indonesia, to some extent Malaysia).
  • Excellent qualitative and quantitative research skills, and analytical and report-writing skills.
  • Proficient in English, preferably with working knowledge in German, Bisaya or Bahasa Indonesia.

 

The Lead Evaluator will respect the confidentiality of AWO International’s and its local partners’ data and information made available to her/him during this evaluation. Documents and data sets produced in the course of his/her assignment can be used for the tasks under this ToR. S/he is to sign a confidentiality agreement along with the contract of service.

 

8. Payment details

The payment schedule follows the requirements of the back donor.

50% upon submission of the inception report

50% upon approval of the final Mid Term Evaluation report

 

9. Application

Independent consultants meeting the requirements are encouraged to apply.

Required documents for submission:

  1. Detailed curriculum vitae (including information about past experiences in similar projects or assignments)
  2. Technical and financial proposal for the evaluation including all logistical and organizational requirements

Only applications submitted on or before 1 June 2022 to mail@awo-southeastasia.org with subject title: “AWO RO SEA Application: Mid Term Evaluator for RO SEA DevCo Project” will be processed.