Professional Documents
Culture Documents
Terms of Reference - SCILD Final Evaluation - YPII - 100619 EUD - 11 June 2019
Terms of Reference - SCILD Final Evaluation - YPII - 100619 EUD - 11 June 2019
2. Project Background
The livestock sector in West Timor, Indonesia has been mostly concentrated around the production
of various livestock commodities without further processing and marketing to the end customer
(with the exception for chicken which has processing facilities on the island). For the production of
the cows, most of the livestock has been shipped to Java and other areas of Indonesia for processing
and only a small fraction stays on the island for immediate consumption. Since pork meat is hardly
consumed elsewhere in Indonesia and is mostly used in West Timor and throughout NTT province
for ceremonial purposes, it has not been developed as a household livelihood activity or
commercially. There has also been a lack of awareness of the economic value of chicken for the
modern retail markets and a lack of knowledge of available business opportunities to take part in
this value chain. Especially in terms of chicken and pork production, youth are eager and ready to be
trained on livestock farming business.
The SCILD (Strong CSOs for Inclusive Livestock Value Chain Development) project, with funding
through the European Union and Plan International Finland, has sought to improve business
opportunities for youth in the livestock sector. The project began in March 2016 with the overall
objective to contribute to the improved position and social and economic empowerment of young
women and men in NTT through sustainable support to the livestock sector in five districts: Kupang,
TTS, TTU, Belu and Malaka.
The project has so far resulted in increased capacity of CSOs in terms of technical, organizational and
advocacy aspects. Project initiatives managed by eight CSO have achieved almost 70% of the
planned results by the end of April 2019 showing local CSOs’ ability to complete activities as per
their plans. So far, 2002 youth (1296F/706M) have participated in the activities proposed by CSOs on
livestock value chains, especially on semi-intensive livestock management, and 1571 youth
(911F/660M) have also shown their increased interest to continue working in the livestock value
chain.
Partners of the project SCILD are Yayasan Sanggar Suara Perempuan (YSSP) and Bengkel Advokasi
Pemberdayaan Kampung (APPeK) and affiliated eight Civil Society Organization (CSOs) local
community organizations. Each CSO has involved 250 youth (65% female) with a total number of
2,002 youth reached through the project.
The CSOs working through Bengkel APPeK The CSOs working through YSSP include:
include:
• Yayasan OISCA in TTS
• Perkumpulan Potensi Advokasi Rakyat • KSU Wanita Kasih in TTS
NTT (PAR NTT) NTT in Kupang • Yayasan An Feot Ana (YAFA) TTUin Belu
• Geng Motor Imut in TTU : • PPSE Keuskupan Atambua in Belu
• Yayasan Amnaut Bife Kuan (YABIKU) in
TTU
• Futuru de Timor in Malaka District
2|P a g e
3.2 Evaluation Criteria
Based on OECD DAC Guidelines
The appropriateness of project objective to the problems that it was supposed to address,
and to the physical and policy environment within which it was operated. It should include
Relevance an assessment of the quality of project preparation and design, i.e. the logic and
completeness of the project planning process, and the internal logic and coherence of the
project design.
The fact that the project results have been achieved at reasonable costs, i.e. how well
inputs / means have been converted into activities, in terms of quality, quantity, quantity of
Efficiency time, and quality of results achieved. This generally requires comparing alternative
approaches to achieving the same results, to see whether the most efficient process has
been adopted.
An assessment of the contribution made by results to achievement of the project purpose,
and how assumptions have affected project achievements. This should include specific
Effectiveness
assessment of the benefits accruing to target groups, including women and men and
identified vulnerable groups such as children, the elderly and disabled.
The effect of the project on its wider policy or sector objectives (as summarized in the
Impact
project’s overall objectives).
An assessment of the likelihood of benefits produced by the project to continue to flow
after external funding has ended with particular reference to factors of ownership by the
Sustainabilit
beneficiaries, policy support, economic and financial factors, socio-cultural aspects, gender
y
equality, appropriate technology, environmental aspects and institutional and management
capacity.
3|P a g e
What factors contributed to the achievement of outputs/ outcomes (including contextual
factors, gender analysis and aspects of the project approach and activities)? (suggested
tools: Desk review, direct observation, FGDs, KIIs, analysis)
Identify key results achieved by the project, including key learnings around what has
worked/ not worked in achieving outputs and outcomes. (suggested tools: Desk review,
direct observation, FGDs, KIIs, analysis)
Impact & Sustainability
What kind of long-term improvements in youth employment, especially for women might
the project contribute to and how? (suggested tools: Desk review, direct observation, FGDs,
KIIs, analysis)
What aspects of the project design and approach should be replicated and scaled up and
what level of support is there and/or remaining gap from different project stakeholders to
facilitate replication/ scale-up? (suggested tools: Desk review, direct observation, FGDs, KIIs,
analysis)
What roles and responsibilities should different stakeholders assume to facilitate future
scale-up of the project, particularly for local government authorities? (suggested tools: Desk
review, direct observation, FGDs, KIIs, analysis)
Investigate how project results could contribute to longer term opportunities for gender-
balanced youth employment in the livestock sector in NTT. (suggested tools: Desk review,
direct observation, FGDs, KIIs, analysis)
4|P a g e
The consultant will oversee primary data collection, including the delivery of an inception
workshop for relevant stakeholders, testing and refining data collection tools, training
enumerators and data quality assurance/ control.
The methodology will include a brief literature review of comparable projects in NTT and
elsewhere in Indonesia to inform analysis around the effectiveness of the project approach
and potential longer-term outcomes.
5.1 Sample
At the activity/ output level, the evaluation will include all project areas that participated in the
project; however, primary data collection related to project objectives and results and the
appropriateness of the approach will focus on a sample of villages. These villages will be selected
with the intention of exploring different project implementation contexts and approaches, while
taking into account constraints around accessibility.
The suggested data collection approach will be through a combination of focus group discussions
(FGDs), key informant interviews (KIIs) and direct observation. Sampling in the target areas would
cover selected projects in each of the five Districts of Belu, TTU, Malaka, Soe and Kupang. Based on
the evaluation timeframe, it should be possible to include up to ten villages across the five Districts
in the data collection process.
KIIs will be conducted with representatives from the 1) Provincial Livestock Office, 2) Nusa Cendana
University, 3) Regional Livestock Alliance, and 4) Cooperative and Micro Enterprise Office of NTT
Province. At the District level, KIIs would be conducted with representatives from the District
Livestock Offices, village forums and livestock suppliers. Village forums, comprising those that have
and have not supported the SCILD project initiatives, should be included in the survey to highlight
respective lessons and challenges about future sustainability of the approach with localized support.
FDGs would be conducted with each of the eight implementing CSOs in their respective areas as well
as with ten youth and youth groups who directly participated in the SCILD project. FDGs with
parents of the youth involved in the project in two selected villages is suggested for documenting
their perspectives. Suggested targets for data collection are listed below
5|P a g e
5.2 Participant selection and recruitment
Representatives from key stakeholders (project team, project partners, CSOs, youth and youth
groups, parents, and provincial and district government offices and local university) will be included
in the evaluation consultations as mentioned above. The actual project sites will be determined
through consultation with YPII and its partners together with the consultant. Additional
stakeholders suggested by the consultant may be considered.
7. Key Deliverables
8. Timeline
Time (2019) Days of Work Responsible
Activity Support
estimated (estimated) (Lead)
Advertisement and Selection HR team, PM,
process 11-17 June 0 YPII HR M&E
Coordinator
HR team, PM,
Background Checks and
18-21 June 0 YPII HR M&E
Contracting;
Coordinator
Document review (project 25-26 June 2 Consultant YPII
documents/ output &
6|P a g e
Time (2019) Days of Work Responsible
Activity Support
estimated (estimated) (Lead)
activity data and broader
literature review)
Development of
YPII and Plan
methodology, evaluation 27-29 June 3 Consultant
Finland
plan and draft tools
Primary data collection 13
(including inception (including 2 days
Consultant and
workshop, testing and 3-19 July travel, 1 day for YPII
YPII and partners
refining tools and training inception
data collection team) workshop)
Data cleaning and analysis 22-26 July 5 Consultant YPII
Summary of preliminary
27 July 1 Consultant YPII
findings
29 July – 2 YPII and Plan
Draft evaluation report 5 Consultant
August Finland
Review draft report 3-8 August 0 FLNO and YPII N/A
12-16 YPII and Plan
Final evaluation report 5 Consultant
August Finland
Total estimated consultant
34
days
7|P a g e
10. Budget
12. Contract
13. Applications
Interested applicants should provide a proposal covering the following aspects:
- Detailed response to the TOR
- Proposed methodology
- Ethics and child safeguarding approaches, including any identified risks and associated
mitigation strategies
- Proposed timelines
- CVs
- Example of previous work
- Detailed budget, including daily fee rates, expenses, taxes etc.
8|P a g e
- Police Certificates of Good Conduct – especially where there is primary data collection
9|P a g e