CALL FOR EXPRESSIONS OF INTEREST TO UNDERTAKE AN EVALUATION IN AFGHANISTAN
medica mondiale is a non-governmental organisation based in Cologne, Germany. As a feminist women’s rights and aid organisation medica mondiale supports women and girls in war and crisis zones throughout the world. Through own programmes and in cooperation with local women’s organisations we offer holistic support to women and girl survivors of sexualised and gender based violence. On the political level, we pro-actively promote women’s rights, call for a rigorous punishment of crimes as well as effective protection, justice and political participation for survivors of violence. Currently medica mondiale is working in Northern Iraq/Kurdistan, in Afghanistan, in Liberia, in Kosovo, in Bosnia and Herzegovina as well as the African Great Lakes Region.
We are looking for a female
SHORT-TERM CONSULTANCY TEAM
to develop and conduct the final evaluation of the project: “Awareness. Access. Advice. Advocacy. Assertion. Legal and social protection and empowerment of Afghan women and girls in Kabul and Mazar-e Sharif” in Afghanistan. Institutions and/or consultant teams are invited to submit an application for this consultancy.
The project shall be evaluated along the lines of OECD-DAC criteria and with special attention to the stress and trauma sensitive approach used, to any progress barriers for the project and to management policy impact, amongst other points.
We also welcome proposals with elements of adequate remote evaluation models.
Tentative time plan:
Tender of evaluation: August 2017
Selection of evaluators/ preparation /inception phase: September 2017
Data collection period in Afghanistan: October 2017
Reporting: November 2017
To ensure that the evaluation draws a balanced picture we would like to contract an evaluation team consisting of an international female expert and a regional female expert with the following expertise:
- A strong understanding and experience in evaluation methodology and practice with experience in team work
- Experience in qualitative (storytelling, MSC, etc.) but also in quantitative sociological research methods and practice,
- Experience in and sound knowledge of advocacy, legal- and social protection in the field of violence against women mainly in conflict regions and especially in Afghanistan
- Strong background and working experience in the above mentioned topics as evaluator
- Excellent and proven report writing and verbal communication skills in English, German would be an asset.
- National/Regional evaluator with excellent communication skills in dari/farsi languages.
- Experience with evaluating projects funded by the Federal Ministry for Economic Cooperation and Development (BMZ) would be an asset
One consultant will be the main responsible person to medica mondiale and will take the lead responsibility for methodology, process and reporting. This consultant will also ensure that the evaluation team and interpreters will act in a trauma sensitive way. Team applications are most welcome. We appreciate applications from regional consultant teams and / or institutions.
Additionally, each consultant must prove she has participated in a security training for travels in war risk countries / crises areas. Otherwise, such training has to be absolved prior to departure to Afghanistan.
- Flexible, creative and innovative
- Excellent analytical skills
- A clear commitment to work with a women centred and empowering approach
- High cultural sensitivity; high degree of cross-cultural competence and diversity perspective
We highly appreciate team applications. The budget for the evaluation including travel costs, accommodation etc. should not exceed 20.000 € in total.
We will not send any acknowledgement of receipt of the documents you have submitted. Only short listed / successful candidates will be contacted. Please note also that the Federal Ministry for Economic Cooperation and Development (BMZ) has to agree on the selection of evaluators and the final TOR.
Further information on medica mondiale can be found on website: www.medicamondiale.org
Further information on Medica Afghanistan can be found on website: www.medicaafghanistan.org
TERMS OF REFERENCE
5 Pillars to build Women’s Rights: Awareness. Access. Advice. Advocacy. Assertion. Legal and social protection and empowerment of Afghan women and girls in Kabul and Mazar-e Sharif.
Implementing Partner in Developing Country
Medica Afghanistan – Women Support Organisation
Private Project Partner
medica mondiale e.V.
Public Project Partner
Federal Ministry for Economic Cooperation and Development (BMZ)
01.12.2014 - 30.11.2017
Purpose and Objectives of Evaluation
At a higher level, this final evaluation serves as important participatory learning process for all stakeholders involved in the project.
The purpose of the final evaluation is to provide decision makers at the BMZ, medica mondiale and Medica Afghanistan with sufficient information to make an informed judgment about the performance of the project, document lessons learnt and provide practical recommendations for follow-up actions and similar future projects. As general standard, this final project evaluation shall include an assessment of the project’s impact, effectiveness, relevance, efficiency and sustainability so far.
The success of the project shall be assessed regarding its stated objectives. The final evaluation should generate practical hands-on recommendations that can be implemented by the project actors within their sphere of control as follow-up actions and beyond. The evaluation will be used to gain more knowledge on effects and impacts in order to inform future programming of Medica Afghanistan and medica mondiale. medica mondiale will share the evaluation results with the BMZ and Medica Afghanistan and will publish the summary on its homepage.
Initial Situation and Project Site
In spite of the legal framework that resulted from the ratification of the Convention for the Elimination of all Forms of Discrimination against Women (CEDAW) in 2003, and anchoring gender equality in the Afghan Constitution in 2004, sexual and gender based violence (S)GBV still is widely present in Afghan society. With the adoption of the EVAW law in 2009, violence against women was declared a criminal offence for the first time in Afghanistan. New institutions were created for the protection of women’s rights, such as the EVAW departments at selected departments of public prosecution and commissions for domestic violence at selected police departments. However, little has been done to educate the affected women. There is little knowledge about the EVAW law and the civil society remains the main actor for strengthening and enforcing human rights and, in particular, provisions for the prevention of violence against women. The respective institutional duties are largely not being realized. In most cases, women and girls survivors of (S)GBV do not receive education or support regarding the legal system and access to it. There are few legal services for survivors and rarely these are adapted to their needs, namely trauma-sensitive.
The project contributes to the improvement of legal and social protection of Afghan women and girls survivors of (S)GBV by implementing the holistic approach of medica mondiale and Medica Afghanistan, which is based on a double strategy to achieve goals on two levels: provision of direct services for women and girls survivors of (S)GBV in Kabul and Mazar-e Sharif, as the main target group, and strengthening the Afghan legal system. Direct services are directed towards the goal that the main target group can claim their rights by improving their access to gender and trauma-sensitive legal and social support.
At the same time, the project seeks to optimize legal provision for the prevention of (S)GBV and to contribute to strengthening women’s and girls’ rights in the Afghan legal system. Medica Afghanistan thus supports education about and application of EVAW and plays a leading role in advocating for a reform of the Family Law in collaboration with other NGOs as part of the Family Law Advocacy Committee. Medica Afghanistan’s psycho-social and legal counseling, education efforts, counseling and representation in criminal cases, family mediation and advocacy work complement each other’s impact. Legal work and advocacy is intended to enable the target group to make informed decisions about possible legal and non-legal action steps. Family mediation is intended to use and inform about possible solutions to violent conflicts within families. Psycho-social work with and in families supports the reintegration of women into their families.
Medica Afghanistan also supports the rigorous application of EVAW by regular practical legal work and representation in civil and other criminal cases. Knowledge about challenges and good practices is shared in networks where Medica Afghanistan advocates for the needs of women survivors on local and national political level.Additionally, the development and implementation of a quality assurance system improves quality standards of trauma-sensitive counseling and legal representation in civil cases.The target group consists of about 1800 women and girls affected by (S)GBV in Kabul and Mazar-e Sharif as well as their children and families, who are in conflict with the law and/or affected by violence within the family. Some of the women are imprisoned and are looking for external support.
Those who are accused of adultery (zina) are the ones who need protection most because in most cases they are denied any support from their family and from existing institutions. Experienced lawyers and women’s rights experts who apply national law, especially Family Law, but also the law for the elimination of violence against women, Sharia law and international human rights conventions, play a crucial role here, as well as social workers and trauma-sensitive experts for professional family mediation for female survivors of (S)GBV. The police and legal actors refer endangered women and girls to lawyers and social workers of Medica Afghanistan for legal and social support.
Medica Afghanistan was launched in Kabul in 2002 by medica mondiale and in late 2010 was officially registered as a self-sustaining Afghan national NGO, run by Afghan women for Afghan women. It is headquartered in Kabul with North and West coverage provided by branches in Mazar and Herat Provinces. Medica Afghanistan is a non-profit, non-governmental Afghan women’s organization working towards the elimination of the violence against women through the provision of legal aid, psychosocial support, capacity building and advocacy. It seeks to improve the quality of women’s lives through direct psychosocial and legal services.
Background of Project „ 5 Pillars to build Women’s Rights: Awareness. Access. Advice. Advocacy. Assertion. Legal and social protection and empowerment of Afghan women and girls in Kabul and Mazar-e Sharif”
Overall objective (impact): Contributing to the improvement of the legal and social protection of Afghan women/girls survivors of sexual and gender based violence (S)GBV.
Project goal 1 (outcome): Afghan women and girls affected by (S)GBV in Kabul and Mazar-e Sharif are strengthened through trauma and gender sensitive legal and social services.
Project goal 2 (outcome): The use of legal provisions for the prevention of (S)GBV in families and legal provisions for strengthening the rights of women/girls survivors of violence is increased.
- The target group consists of about 1800 women and girls affected by (S)GBV in Kabul and Mazar-e Sharif as well as their children and families, who are in conflict with the law and/or affected by violence within the family.
Project sub-goals (outputs) without indicators
1) Legal counseling: 1300 women and girls in jail, custody and juvenile detention; police offices of the commission for domestic violence, family courts, mediation facilities, the Ministry of Women Affairs and the justice department in Kabul and Mazar-e Sharif are enabled to make informed decisions.
2) Education about rights:
250 clients who participated in psycho-social counseling groups know their legal rights (e.g. related to Maher1, alimony, separation, raising/educating children, inheritance and other important regulations of Sharia law).
3) Family mediation: 600 women and girls in Kabul and Mazar-e Sharif have solved family disputes through professional mediation.
4) Legal representation of women in civil cases: access to trauma-sensitive legal representation is assured for 370 women/girls affected by domestic violence in family or civil disputes in Kabul and Mazar-e Sharif
5) Criminal defense: 230 detained, legally charged or convicted women and girls in Kabul and Mazar-e Sharif affected by (S)GBV receive trauma-sensitive legal defense for the complete time of the lawsuit.
6) Criminal procedures in which women sue perpetrators are monitored officially by an EVAW department
7) Social services and follow-up support: 150 women and girls in Mazar-e Sharif and Kabul were able to re-integrate into their families after release from detention; 370 women and girls were able to re-unite with their families after disputes or were able to return to their relatives after divorce.
8) Quality assurance: Medica Afghanistan develops and implements a replicable Quality Assurance System (QAS) for standard for legal aid services.
9) Advocacy for a reform of the Afghan Family Law: Until summer 2017 relevant representatives of the Ministry of Justice show a change in awareness regarding women’s rights and a respective reform of family law has been achieved.
10) Advocacy for the realization of EVAW for ending violence against women: The realization of EVAW is supported through its active application and dissemination of successful procedures.
The Indicators and further necessary project information will be provided in the preparation phase.
Activities to achieve the objectives include:
- Practical application of EVAW by lawyers during representation in civil and other criminal cases in Kabul and Mazar-e Sharif
- Legal counseling and support of affected women in Kabul and Mazar-e Sharif
- Awareness raising activities in Kabul and Mazar-e Sharif
- Conversations with the police at 25 police departments (different districts in Kabul and Mazar-e Sharif) to improve the referral system
- Data analysis, reporting and recommendations for the development and application of EVAW are made and published annually
- Development and implementation of a quality assurance system of Medica Afghanistan’s legal services
- Participation in DOWA (Department of Women Affairs) network meetings, CPAN (Child Protection Action Network) and Afghanistan Women’s Network Lobby coordination meetings with relevant stakeholders
- Conversations with public institutions in Kabul and Mazar-e Sharif such as the national GBV Sub Cluster that supports the prevention of violence. Medica Afghanistan is responsible for the coordination of the activities in the northern region.
3. Scope of Work
Final evaluation of the project. As part of the evaluation, the different project sites will be visited.
Assessment – DAC evaluation criteria
The evaluation shall include a performance assessment based on the DAC criteria and provide feasible lessons learned for future programming. Evaluation questions will be developed in order to assess the following areas:
1. Relevance: Were the project approach /strategy and the services provided by the organization suitable for the situation and the needs of the different target groups? What can be stated about the relevance of the intervention strategy/methodology/activities implemented to contribute to build women’s rights in the Afghan society? To what extent re the objectives of the projects still valid?
2. Effectiveness: What can be stated about the effectiveness of the project and the approach of Medica Afghanistan? Which measures were particularly effective, which weren’t? What internal and external factors inhibited or promoted the achievement of specific goals and program progress? To what extent were the project goals, its sub goals and its indicators achieved ? What were the major factors influencing the achievement or non-achievement of the project goals?
3. Efficiency: What can be stated about the efficiency of the project ? Were objectives achieved on time? Was the project implemented in the most efficient way compared to alternatives? What can be stated about the cost effectiveness of the project? Are the chosen
implementation mechanisms conducive for achieving the expected results?
4. Impact: What can be stated about the impact of the project? To what extent has the project contributed to the improvement of the legal and social protection of Afghan women/girls survivors of sexual and gender based violence (S)GBV ? To what extent has the project contributed to building women’s rights in Afghanistan? What can be stated on short and long term impacts of the services provided by Medica Afghanistan at the individual, societal and political levels? What real difference has the activity made to the beneficiaries? What can be stated about intended and unintended changes?
5. Sustainability: What can be stated about the sustainability of the project? How has sustainability been realized at individual, structural respectively societal level? To what extent will the benefits of the project continue after donor funding ceased? What are /were the major factors which influenced the achievement or non-achievement of sustainability of the project?
Each Dac criterion shall be analyzed and assessed by the evaluation team in a separate section of the evaluation report.
Specific Assessment of project’s goals / sub-goals and its indicators
- The implementation of the project’s goals / sub-goals and its indicators as planned in the impact matrix shall be described, analyzed and assessed by the evaluation team in a separate section of the evaluation report.
Specific Assessment of the approach and its implementation:
- What can be stated about the implementation of a stress- and trauma-sensitive approach for legal aid services? What has proven to be successful, what has not? What is the added value for the beneficiaries and also for MA?
- How is MA’s legal counseling different from legal counseling by other organizations?
- What can be stated about mediation? To what extent can partiality for women be realized? What are challenges and chances of mediation for women in the Afghan context?
- What can be stated about the internal referral system, which synergies are used? What can be stated about the implementation and effects of management policies and procedures that have been developed in this project?
Recommendations and lessons learned
- Lessons learned from the project implementation shall be derived to inform and improve the development of future programming and organizational structure and strategy. Regarding any major issues and problems affecting progress, recommendations shall be made and action points identified. Necessary feasible recommendations shall be provided and be addressed to different recipients and by the evaluation team in a separate section of the evaluation report.
- Are there any lessons learned identified which are relevant for similar projects in similar contexts and can serve for scaling up and or serve as models for medica mondiale, medica Afghanistan and others in the field?
All Assessments and their findings, the derived conclusions and recommendations should be answered in separate sections in the main report.
The final methodology will be defined and agreed upon in close cooperation with medica mondiale and Medica Afghanistan during the preparation and before the field phase of the evaluation. This ensures transparency. Furthermore, the dialogue is important to achieve “ownership” of the evaluation and with this acceptance of the evaluation results. At the same time, the basis for collaboration with the evaluation team is formed. In general, a trauma-sensitive way of working is important to us in this context and standards in working with survivors of sexualized violence should be applied.
The evaluation team should use a multi mixed design, using quantitative and qualitative data. The design should be based on a participatory approach and at the same time strongly incorporate “learning”:
1. Desk review and analysis of documentation – available reports and other documents shall be analyzed and the methodology further refined. For preparation purposes, initial Skype and phone interviews with all involved stakeholders shall take place before the field phase. The partnerorganisation shall already be involved during the preparation. Project documents of the project partners shall be secured and analyzed. A planning meeting shall take place in Cologne or in a virtual room with medica mondiale and medica Afghanistan.
2. Interviews and focus group discussions shall take place with women and girls of the target group and staff of Medica Afghanistan. Additionally, storytelling interviews with selected members of the target group and interviews with other relevant stakeholders such as local institutions shall be conducted.
3. Workshop with all relevant stakeholders shall be conducted to present and discuss the preliminary evaluation results and to present the initial recommendations. This workshop is an essential component in the evaluation process on site. Possible follow-up steps and actions can be discussed and a learning process takes place that is moderated by the evaluation team.
4. Data triangulation /analysis are conducted in order to interpret the results and write the report.
5. Outputs and Deliverables
- The evaluation team is expected to compile an Inception report in English with the final specified methodology, evaluation matrix, analysis methods, data collection instruments and work plan.
- The evaluation team is expected to give a presentation of preliminary findings and recommendations to Medica Afghanistan at the end of the field evaluation phase. The discussions and results of this “initial findings sharing workshop” with Medica Afghanistan have to be included in the evaluation process and its report.
- The evaluation team is expected to compile a draft report in English 14 days after return from the evaluation mission which has to be shared first with Medica Afghanistan.
- After their feedback the draft report has to be shared with medica mondiale and Medica Afghanistan
- A presentation of the findings and recommendations to medica mondiale in Cologne
- The evaluation team is expected to compile the final report (60 pages max. excluding appendix) after feedback for the draft report through medica mondiale and Medica Afghanistan. Quality criteria for report will be provided.
- An assessment of the project according to the quality principles/features of medica mondiale (assessment grid will be provided)
- A summary of the evaluation report for the website of medica mondiale
6. Evaluation team
An expert profile for selecting the evaluators was developed in collaboration with the local project partner. Regional competency, professional and methodological expertise, especially in the psychosocial and area, and practical experience are most important.
The expert profile will be published regionally and internationally through the internet.
7. Tentative Timetable – Quantity Structure
Analysis of relevant documents and project documentation
Preparation of Inception report
Preparation of evaluation tools and planning meeting with medica mondiale e.V.; Skype meetings with Medica Afghanistan and project stakeholders
Afghanistan, different locations
Site visits in Afghanistan
Interviews and/or focus group discussions with key personnel of Medica Afghanistan and partner organizations / stakeholders; Focus group discussions/workshops are with women of the target group (both new and previous clients), preferably including story telling methods or other participative methods; one-day “initial findings sharing workshop” with Medica Afghanistan staff and partner organisations to present, discuss and refine preliminary conclusions and recommendations.
Analysis and report writing
Analysis and triangulation of evaluation results and drafting of the report
Send draft of the report to medica mondiale e.V. and to Medica Afghanistan
Present and discuss the evaluation results and recommendations to medica mondiale e.V. in Cologne
Write and send the final evaluation report after feedback and presentation
Write short summary of evaluation report to be published on website of medica mondiale e.V.
The detailed timetable, quantity structure and process will be agreed upon in advance with medica mondiale e.V. and Medica Afghanistan.
8. Management of the Evaluation
The Department of Evaluation and Quality of medica mondiale will take care of the facilitation of the evaluation process in cooperation with Medica Afghanistan. We think that the separation of the evaluation management from the staff responsible for project implementation at medica mondiale and Medica Afghanistan is important for the credibility and the acceptance of the evaluation results.
9. Evaluation Report – Requirements
The main report and the comprehensive summary shall be complete and written in readily understandable language (English). The report shall clearly describe the background and goal of the project as well as the evaluation methodology, process and results in order to offer comprehensive and understandable content. A transparent line of arguments shall be kept throughout analysis, assessment and recommendations so that every recommendation can be comprehensibly attributed to the results that are based on data analysis. As per the principle of usefulness the recommendations shall be guided by the terms of reference and the information needs and be clearly directed at particular recipients. A document detailing assessment criteria for inception reports and evaluation reports will be provided by medica mondiale e.V..