BACKGROUND AND PROJECT DESCRIPTION
Since 2017, HIAS partnered with HIVOS Foundation timplement a two-year VOICE project entitled “Creating a Safe and Inclusive Environment for Kenyan and Refugee persons LGBTIQ in Nairobi”
The project has a goal of creating an inclusive and safe environment for LGBTIQ refugees and their host communities tlive and work. The project builds their resilience by strengthening social support resources, building informal peer networks, and facilitating access tlivelihoods. Within each thematic priority, the project aims tcapture lessons learned tidentify successful approaches for empowering LGBTIQ persons populations under three mutually reinforcing and supportive objectives that i) increase the power and voice of the LGBTIQ community advocate for their own protection, ii) increase the ability of LGBTIQ persons tan earn an income in a safe and sustainable way, and iii) build the capacity of service providers taddress the basic needs and protection concerns of Kenyan and refugee LGBTIQ persons, ensuring their needs are met in through confidential, appropriate and quality assistance.
EVALUATION PURPOSE AND OBJECTIVES
The end of project evaluation will help tdraw key lessons learnt and the best practices tthe project stakeholders; Knowledge, Attitudes and Practices (KAP) relating taccess temployment, protection of LGBTIQ persons and capacity of service providers taddress the basic needs and protection concerns of this population. In particular, the project evaluation will be shaped by the following specific evaluation objectives:
Effectiveness
Measures the extent twhich the objectives of the project are achieved. In particular,
Twhat extent did the project meet the objectives as defined by log frame?
What were the intended and not intended positive and negative effects at the individual level?
Twhat extent has the project enabled the targeted population tbe better able tmitigate future responses?
Management
Effectiveness/Efficiency
The degree twhich organizational structure provided sufficient, effective and timely support for the project implementation.
How adequate were the available resources qualitatively and quantitatively?
Were all the project resources utilized optimally?
How could the efficiency of the project be improved without compromising outputs?
Assess the timeliness of implementing the project activities.
How adequate were the reporting and monitoring systems of the project?
Have the project outputs been achieved with a reasonable cost?
Appropriateness/relevance
Community involvement and participation in the design process, goal setting, planning and implementation. In particular, the relevancy and appropriateness of project design tthe needs of the community will be assessed.
What did the communities articulate were the priority needs and how the project aligns with that?
What were secondary sources saying the issues were and
how did the project align tthat?
Connectedness/Sustainability
This will focus on the need tensure that activities of a short term emergency nature is carried out in a context that takes longer term and interconnectedness intaccount. In particular,
Are there sustainability plans, structures and skills in place tensure there is sustainability of project benefits?
How adequate are they?
How is the community and local partners prepared tcontinue with the project outcome?
Are the community members knowledgeable and supportive tthe project?
Is there evidence of community contribution and ownership of the different project interventions?
Coordination
Has there been any collaborations and networking with the different stake holders?
How strong are the relationships with government, other agencies and CBOs that can be improved (in terms of partnering, collaboration, networking and donor relations)?
Cross-cutting issues
Twhat extent were relevant international standards used in the planning and implementation of the intervention (e.g, international humanitarian and human rights law; NGCode of Conduct and developing standards – e.g., Sphere)?
Was Gender and Diversity mainstreaming taken intconsideration in all relevant areas?
Impact
What were the main impacts (positive/negative, expected/unexpected) as perceived by the different actors and beneficiaries of the project?
SCOPE OF EVALUATION
The evaluation will focus on the following:
Intervention, viz. the project on “Creating a Safe and Inclusive Environment for Kenyan and Refugee LGBTIQ persons in Nairobi County” in the selected target population.
Geographical scope: Nairobi County.
Project Implementation: Period of twyears from July 2017 tJuly 2019.
EVALUATION DELIVERABLES
Successful performance of this assignment will be based on the following activities and production and timely submission tHIAS of related deliverables:
Review of project documentation and relevant background documents. An inception report, providing information on detailed survey implementation plan – including details of both the technical approach (sampling methods, tools and techniques tcollect data against key indicators and targets, reference data, analysis, ethical considerations, limitations, etc.) and their implementation (schedule of activities and costs).
Collection of data; (including baseline reconstruction data). A complete set of data collected tbe submitted tHIAS alongside the final report.
Data analysis, preparation of draft report and submission of a draft report (soft copy) of the evaluation tHIAS for review, factual corrections and feedback.
A validation workshop involving staff, beneficiaries and key stakeholders tbe held 28th t1st February 2019 (one day tbe selected).
Incorporation of comments received on the draft evaluation report and preparation of a
final report in English (Word and PDF versions including all annexes) by 15th July 2019 and include strengths and weaknesses conclusions, recommendations, lessons learned and best practices.
Max 3 page summary for publication in newsletters, websites etc.
EVALUATION REPORT STRUCTURE
The final evaluation report should not exceed more than 60 pages (without the annexes) and will include at least the following:
Executive Summary
Brief description of the program, its context, financial arrangements, areas of intervention, timing, implementation modalities and actors
Objectives, methodology, timing of evaluation and challenges / limitations of the analysis
Results in terms of relevance, efficiency, effectiveness, coordination, impact, sustainability and cross-cutting issues.
Analysis, including reflection on gender mainstreaming, human rights.
Lessons learned, challenges, conclusions, recommendations, action plan
Annexes including list of the data with maximum disaggregation
CONFIDENTIALITY AND AUTHORSHIP
Ownership and copyright of all data, drafts and final products of the survey will be the sole and exclusive property of HIAS. The consultant will submit all original documents, materials and data tHIAS. Therefore, all the outputs of the survey will not be disseminated in part or whole without express authority from HIAS’s country director. The consultant shall not produce information in these materials in any form (electronic, hard copies, etc.) ta third party without a written permission from HIAS.
TIME FRAME
The overall evaluation process is expected ttake 24 working days including preparation, data collection, and analysis and reporting. The Consultant should be able tundertake some of the tasks concurrently tfit within the planned time-frame, without compromising the quality expected. The assignment is expected tcommence on July 15, 2019, with the final evaluation report expected by August 13, 2019.
INSTITUTIONAL ARRANGEMENT
HIAS will establish an evaluation team toversee all the related tasks. The M&E officer will be responsible for the overall coordination of all the evaluation tasks with the Consultant. In addition, the Project Manager, Head of Programmes and Country Director will provide all the necessary technical and operational support required throughout the evaluation process.
The Consultant will be responsible for the following:
Review all relevant documents for evaluation study
Develop evaluation study design which includes survey methodology and the data collection tools (questionnaires including KAP; focus group guides, interview protocol, data entry templates, etc.), as appropriate, including a field manual for training, in consultation with evaluation team, reflect HIAS’s feedback on the methodology.
Designing the ODK/Kobforms.
Develop the field work schedule in consultation with evaluation team
Conduct training for the data collectors during field visits phase, finalize the evaluation schedule
Supervise the data collection process, give advice and ensure the quality of the data
Conduct interviews (KII) with key project staff and stakeholders.
Data analysis and report writing, draft the first report and include HIAS’s feedback and finalize the report for submission
Provide required data that is completed and labelled in English (variables and values) for both the SPSS and Microsoft file formats.
Provide daily briefing to the M&E Officer and Project Manager on the progress and any challenges from the field.
REQUIREMENTS OF THE CONSULTANT
We are looking for a Consultant/team with the following skills and qualifications;
The team leader must possess a Degree in Social Sciences or related discipline, with experience working with sexual and gender minorities. A post-graduate degree will be an added advantage.
Experience in designing and conducting baseline, end line, and other comparable quantitative surveys being implemented by non-governmental and private sector actors.
Demonstrated experience leading teams.
Demonstrated experience in designing survey methodology, data collection tools, processing and analysis of data.
Ability tinteract with host government, partners and/or others;
Strong organizational, analytical and reporting skills, presentation skills, attention tdetail, ability tmeet deadlines, and proficiency in Microsoft Office and qualitative data analysis software/tools.
Capacity tuse mobile data collection and GIS tools for data collection, and analysis of survey results.
Excellent verbal and written communication in English required.
BACKGROUND AND PROJECT DESCRIPTION
HIAS is a global Jewish non-profit organization that stands for a world in which displaced persons attain full potential and contribute tsociety through sustained legal, social, and systematic change, attaining legal status, exercising social and economic rights and rebuilding their lives. HIAS’ operation in Kenya was established in 2002 with the mission tserve the most vulnerable refugees through community based protection, including mental health and psychosocial-support (MHPSS) services, resilience building, economic inclusion, Child protection and provision of durable solutions.
Since 2017, HIAS partnered with HIVOS Foundation timplement a two-year VOICE project entitled “Creating a Safe and Inclusive Environment for Kenyan and Refugee persons LGBTIQ in Nairobi”
The project has a goal of creating an inclusive and safe environment for LGBTIQ refugees and their host communities tlive and work. The project builds their resilience by strengthening social support resources, building informal peer networks, and facilitating access tlivelihoods. Within each thematic priority, the project aims tcapture lessons learned tidentify successful approaches for empowering LGBTIQ persons populations under three mutually reinforcing and supportive objectives that i) increase the power and voice of the LGBTIQ community advocate for their own protection, ii) increase the ability of LGBTIQ persons tan earn an income in a safe and sustainable way, and iii) build the capacity of service providers taddress the basic needs and protection concerns of Kenyan and refugee LGBTIQ persons, ensuring their needs are met in through confidential, appropriate and quality assistance.
EVALUATION PURPOSE AND OBJECTIVES
The end of project evaluation will help tdraw key lessons learnt and the best practices tthe project stakeholders; Knowledge, Attitudes and Practices (KAP) relating taccess temployment, protection of LGBTIQ persons and capacity of service providers taddress the basic needs and protection concerns of this population. In particular, the project evaluation will be shaped by the following specific evaluation objectives
Effectiveness
Measures the extent twhich the objectives of the project are achieved. In particular,
To what extent did the project meet the objectives as defined by log frame?
What were the intended and not intended positive and negative effects at the individual level?
Twhat extend has the project enabled the targeted population tbe better able tmitigate future responses?
Management
Effectiveness/Efficiency
The degree twhich organizational structure provided sufficient, effective and timely support for the project implementation.
How adequate were the available resources qualitatively and quantitatively?
Were all the project resources utilized optimally?
How could the efficiency of the project be improved without compromising outputs?
Assess the timeliness of implementing the project activities.
How adequate were the reporting and monitoring systems of the project?
Have the project outputs been achieved with a reasonable cost?
Appropriateness/relevance
Community involvement and participation in the design process, goal setting, planning and implementation. In particular, the relevancy and appropriateness of project design tthe needs of the community will be assessed.
What did the communities articulate were the priority needs and how the project aligns with that?
What were secondary sources saying the issues were and
how did the project align tthat?
Connectedness/Sustainability
This will focus on the need tensure that activities of a short term emergency nature is carried out in a context that takes longer term and interconnectedness intaccount. In particular,
Are there sustainability plans, structures and skills in place tensure there is sustainability of project benefits?
How adequate are they?
How is the community and local partners prepared tcontinue with the project outcome?
Are the community members knowledgeable and supportive tthe project?
Is there evidence of community contribution and ownership of the different project interventions?
Coordination
Has there been any collaborations and networking with the different stake holders?
How strong are the relationships with government, other agencies and CBOs that can be improved (in terms of partnering, collaboration, networking and donor relations)?
Cross-cutting issues
Twhat extent were relevant international standards used in the planning and implementation of the intervention (e.g, international humanitarian and human rights law; NGCode of Conduct and developing standards – e.g., Sphere)?
Was Gender and Diversity mainstreaming taken intconsideration in all relevant areas?
Impact
What were the main impacts (positive/negative, expected/unexpected) as perceived by the different actors and beneficiaries of the project?
SCOPE OF EVALUATION
The evaluation will focus on the following:
Intervention, viz. the project on “Creating a Safe and Inclusive Environment for Kenyan and Refugee LGBTIQ persons in Nairobi County” in the selected target population.
Geographical scope: Nairobi County.
Project Implementation: Period of twyears from July 2017 to July 2019.
EVALUATION DELIVERABLES
Successful performance of this assignment will be based on the following activities and production and timely submission tHIAS of related deliverables:
Review of project documentation and relevant background documents. An inception report, providing information on detailed survey implementation plan – including details of both the technical approach (sampling methods, tools and techniques tcollect data against key indicators and targets, reference data, analysis, ethical considerations, limitations, etc.) and their implementation (schedule of activities and costs).
Collection of data; (including baseline reconstruction data). A complete set of data collected tbe submitted tHIAS alongside the final report.
Data analysis, preparation of draft report and submission of a draft report (soft copy) of the evaluation tHIAS for review, factual corrections and feedback.
A validation workshop involving staff, beneficiaries and key stakeholders tbe held 28th t1st February 2019 (one day tbe selected).
Incorporation of comments received on the draft evaluation report and preparation of a
final report in English (Word and PDF versions including all annexes) by 15th July 2019 and include strengths and weaknesses conclusions, recommendations, lessons learned and best practices.
Max 3 page summary for publication in newsletters, websites etc.
EVALUATION REPORT STRUCTURE
The final evaluation report should not exceed more than 60 pages (without the annexes) and will include at least the following:
Executive Summary
Brief description of the program, its context, financial arrangements, areas of intervention, timing, implementation modalities and actors
Objectives, methodology, timing of evaluation and challenges / limitations of the analysis
Results in terms of relevance, efficiency, effectiveness, coordination, impact, sustainability and cross-cutting issues.
Analysis, including reflection on gender mainstreaming, human rights.
Lessons learned, challenges, conclusions, recommendations, action plan
Annexes including list of the data with maximum disaggregation
CONFIDENTIALITY AND AUTHORSHIP
Ownership and copyright of all data, drafts and final products of the survey will be the sole and exclusive property of HIAS. The consultant will submit all original documents, materials and data tHIAS. Therefore, all the outputs of the survey will not be disseminated in part or whole without express authority from HIAS’s country director. The consultant shall not produce information in these materials in any form (electronic, hard copies, etc.) ta third party without a written permission from HIAS.
TIME FRAME
The overall evaluation process is expected ttake 24 working days including preparation, data collection, and analysis and reporting. The Consultant should be able tundertake some of the tasks concurrently tfit within the planned time-frame, without compromising the quality expected. The assignment is expected tcommence on July 15, 2019, with the final evaluation report expected by August 13, 2019.
INSTITUTIONAL ARRANGEMENT
HIAS will establish an evaluation team toversee all the related tasks. The M&E officer will be responsible for the overall coordination of all the evaluation tasks with the Consultant. In addition, the Project Manager, Head of Programmes and Country Director will provide all the necessary technical and operational support required throughout the evaluation process.
The Consultant will be responsible for the following:
Review all relevant documents for evaluation study
Develop evaluation study design which includes survey methodology and the data collection tools (questionnaires including KAP; focus group guides, interview protocol, data entry templates, etc.), as appropriate, including a field manual for training, in consultation with evaluation team, reflect HIAS’s feedback on the methodology.
Designing the ODK/Kobforms.
Develop the field work schedule in consultation with evaluation team
Conduct training for the data collectors during field visits phase, finalize the evaluation schedule
Supervise the data collection process, give advice and ensure the quality of the data
Conduct interviews (KII) with key project staff and stakeholders.
Data analysis and report writing, draft the first report and include HIAS’s feedback and finalize the report for submission
Provide required data that is completed and labelled in English (variables and values) for both the SPSS and Microsoft file formats.
Provide daily briefing tthe M&E Officer and Project Manager on the progress and any challenges from the field.
REQUIREMENTS OF THE CONSULTANT
We are looking for a Consultant/team with the following skills and qualifications;
The team leader must possess a Degree in Social Sciences or related discipline, with experience working with sexual and gender minorities. A post-graduate degree will be an added advantage.
Experience in designing and conducting baseline, end line, and other comparable quantitative surveys being implemented by non-governmental and private sector actors.
Demonstrated experience leading teams.
Demonstrated experience in designing survey methodology, data collection tools, processing and analysis of data.
Ability tinteract with host government, partners and/or others;
Strong organizational, analytical and reporting skills, presentation skills, attention tdetail, ability tmeet deadlines, and proficiency in Microsoft Office and qualitative data analysis software/tools.
Capacity tuse mobile data collection and GIS tools for data collection, and analysis of survey results.
Excellent verbal and written communication in English required.