Terms of Reference

SCILD (Strong CSOs for Inclusive Livestock Value Chain Development)

Final Evaluation

1. About Plan International

We strive to advance children’s rights and equality for girls all over the world. As an independent
development and humanitarian organisation, we work alongside children, young people, our
supporters and partners to tackle the root causes of the challenges facing girls and all vulnerable
children. We support children’s rights from birth until they reach adulthood and enable children to
prepare for and respond to crises and adversity. We drive changes in practice and policy at local,
national and global levels using our reach, experience and knowledge. For over 80 years we have
been building powerful partnerships for children, and we are active in over 75 countries.
Yayasan Plan International Indonesia is part of the global Plan International Federation, an
independent development and humanitarian organisation that advances children’s rights and
equality for girls. YPII is currently implementing its country strategy 4 (CS4) from 2018 to 2022, in
which the country objective has been defined as “to identify and facilitate the removal of obstacles
that prevent children from enjoying their rights and participating fully in Indonesian society.”

2. Project Background
The livestock sector in West Timor, Indonesia has been mostly concentrated around the production
of various livestock commodities without further processing and marketing to the end customer
(with the exception for chicken which has processing facilities on the island). For the production of
the cows, most of the livestock has been shipped to Java and other areas of Indonesia for processing
and only a small fraction stays on the island for immediate consumption. Since pork meat is hardly
consumed elsewhere in Indonesia and is mostly used in West Timor and throughout NTT province
for ceremonial purposes, it has not been developed as a household livelihood activity or
commercially. There has also been a lack of awareness of the economic value of chicken for the
modern retail markets and a lack of knowledge of available business opportunities to take part in
this value chain. Especially in terms of chicken and pork production, youth are eager and ready to be
trained on livestock farming business.
The SCILD (Strong CSOs for Inclusive Livestock Value Chain Development) project, with funding
through the European Union and Plan International Finland, has sought to improve business
opportunities for youth in the livestock sector. The project began in March 2016 with the overall
objective to contribute to the improved position and social and economic empowerment of young
women and men in NTT through sustainable support to the livestock sector in five districts: Kupang,
TTS, TTU, Belu and Malaka.
The project has so far resulted in increased capacity of CSOs in terms of technical, organizational and
advocacy aspects. Project initiatives managed by eight CSO have achieved almost 70% of the
planned results by the end of April 2019 showing local CSOs’ ability to complete activities as per
their plans. So far, 2002 youth (1296F/706M) have participated in the activities proposed by CSOs on
livestock value chains, especially on semi-intensive livestock management, and 1571 youth
(911F/660M) have also shown their increased interest to continue working in the livestock value
chain.
Partners of the project SCILD are Yayasan Sanggar Suara Perempuan (YSSP) and Bengkel Advokasi
Pemberdayaan Kampung (APPeK) and affiliated eight Civil Society Organization (CSOs) local
community organizations. Each CSO has involved 250 youth (65% female) with a total number of
2,002 youth reached through the project.
The CSOs working through Bengkel APPeK The CSOs working through YSSP include:
include:
• Yayasan OISCA in TTS
• Perkumpulan Potensi Advokasi Rakyat • KSU Wanita Kasih in TTS
NTT (PAR NTT) NTT in Kupang • Yayasan An Feot Ana (YAFA) TTUin Belu
• Geng Motor Imut in TTU : • PPSE Keuskupan Atambua in Belu
• Yayasan Amnaut Bife Kuan (YABIKU) in
TTU
• Futuru de Timor in Malaka District

3. Purpose of the Evaluation

The overall purpose of the evaluation is to:
1. Validate field results, achievements and progress made against the project indicators
and targets as reported by the SCILD project and partner teams through qualitative data
collection and analysis conducted under this consultancy;
2. Produce a final evaluation to assess in more detail and depth the programmatic
progress and performance from the point of view of relevance & appropriateness,
effectiveness, and impact & sustainability.
3. Provide lessons learned for key stakeholders involved in the project for future
application

3.1 Evaluation Focus

3.1.1 The evaluation will focus on how the project has been able to achieve its overall objectives and
key results which include and accomplishment towards the project performance and impact
indicators according to the project log frame:
 Overall objective: To contribute to the improved position and social and economic
empowerment of young women and men in NTT through sustainable support to the
livestock sector
 Specific Objective 1 - To strengthen local CSOs to become a driving force for young women’s
and men’s enhanced equal participation geared toward economic development in the
livestock value chain in NTT
 Expected Results -
o The capacity of livestock-focused CSOs in 5 districts to work in a sustainable, gender-
sensitive and inclusive way has been strengthened
o CSOs are strengthened to provide meaningful input into planning and monitoring of
local economic development policies in the field of livestock in NTT
o The business climate for more competitive and inclusive livestock sector has been
improved
3.1.2 The evaluation will identify the key achievements of the project and aspects of the project
approach that were most effective in engaging stakeholders and improving youth livelihoods in the
livestock sector. It will focus on learning around “what has worked” and the aspects of the project
design and implementation that could be leveraged/ replicated to expand the reach and impact of
the project moving forward.

2|P a g e
3.2 Evaluation Criteria
Based on OECD DAC Guidelines
The appropriateness of project objective to the problems that it was supposed to address,
and to the physical and policy environment within which it was operated. It should include
Relevance an assessment of the quality of project preparation and design, i.e. the logic and
completeness of the project planning process, and the internal logic and coherence of the
project design.
The fact that the project results have been achieved at reasonable costs, i.e. how well
inputs / means have been converted into activities, in terms of quality, quantity, quantity of
Efficiency time, and quality of results achieved. This generally requires comparing alternative
approaches to achieving the same results, to see whether the most efficient process has
been adopted.
An assessment of the contribution made by results to achievement of the project purpose,
and how assumptions have affected project achievements. This should include specific
Effectiveness
assessment of the benefits accruing to target groups, including women and men and
identified vulnerable groups such as children, the elderly and disabled.
The effect of the project on its wider policy or sector objectives (as summarized in the
Impact
project’s overall objectives).
An assessment of the likelihood of benefits produced by the project to continue to flow
after external funding has ended with particular reference to factors of ownership by the
Sustainabilit
beneficiaries, policy support, economic and financial factors, socio-cultural aspects, gender
y
equality, appropriate technology, environmental aspects and institutional and management
capacity.

3.3 Evaluation Questions (suggested)

Relevance & Appropriateness
 How relevant were the project objectives and activities to the needs of CSOs, youth groups,
and different levels of government (i.e. Village, District, and Provincial levels)? (suggested
tools: FGDs, KIIs)
 To what extent were project activities informed by input from project stakeholders? Who
were the stakeholders and what was their comparative level of input? (suggested tools:
FGDs, KIIs)
 Identify how the specific needs of youth, especially women, girls and other marginalised
groups were incorporated in the project design, implementation and local context, as well as
how the needs of marginalised groups could be better incorporated in future programming.
(suggested tools: FGDs, KIIs)
Effectiveness
 To what extent has the project achieved its intended objectives and results? (suggested
tools: Desk review, direct observation, FGDs, KIIs)
 Do CSOs show increased capacity that demonstrate improvements on organizational,
technical, and soft skills resulting from the project interventions? (suggested tools: Desk
review, direct observation, FGDs, KIIs)
 Is there evidence of increased capacity of the youth, particularly women, in establishing and
maintaining sustainable livelihood based on the livestock sector and related value chains?
(suggested tools: Desk review, direct observation, FGDs, KIIs)

3|P a g e
  What factors contributed to the achievement of outputs/ outcomes (including contextual
factors, gender analysis and aspects of the project approach and activities)? (suggested
tools: Desk review, direct observation, FGDs, KIIs, analysis)
 Identify key results achieved by the project, including key learnings around what has
worked/ not worked in achieving outputs and outcomes. (suggested tools: Desk review,
direct observation, FGDs, KIIs, analysis)
Impact & Sustainability
 What kind of long-term improvements in youth employment, especially for women might
the project contribute to and how? (suggested tools: Desk review, direct observation, FGDs,
KIIs, analysis)
 What aspects of the project design and approach should be replicated and scaled up and
what level of support is there and/or remaining gap from different project stakeholders to
facilitate replication/ scale-up? (suggested tools: Desk review, direct observation, FGDs, KIIs,
analysis)
 What roles and responsibilities should different stakeholders assume to facilitate future
scale-up of the project, particularly for local government authorities? (suggested tools: Desk
review, direct observation, FGDs, KIIs, analysis)
 Investigate how project results could contribute to longer term opportunities for gender-
balanced youth employment in the livestock sector in NTT. (suggested tools: Desk review,
direct observation, FGDs, KIIs, analysis)

3.4 Child rights, gender and inclusion

In line with Plan International’s values and organisational ambition, all evaluations should seek to
prioritise a focus on child rights, gender and inclusion and trying to understand the extent to which
the project or programme applied gender and inclusion sensitive approaches and explicitly aimed for
results that improve the rights of children and young people and gender equality.

4. Users of the Evaluation

The primary audience for the report comprises:
 European Union Delegation in Indonesia (project donor)
 Plan Finland, Yayasan Plan International Indonesia and its partners including associated CSOs
 Local provincial and district government authorities with a view of informing and influencing
local policies and planning

5. Methods for Data Collection and Analysis

The methods and approach originally used in the baseline to inform the project’s original indicators
will be considered. For this evaluation, the consultant will utilize data collected by the project team
and validate the data using mainly qualitative methods such as focus group discussions and key
informant interviews. The detailed evaluation methodology will be developed in collaboration
between YPII and the consultant; however, YPII has identified some requirements that will influence
the methodology and scope of the evaluation:
 The evaluation will include a mix of desk-based document review/ data analysis and primary
data collection using quantitative and qualitative methods, mainly through focus group
discussions and key informant interviews.
 The evaluation scoping, methodology development and draft tool development will be desk-
based.
 A sample of villages will be selected, in consultation with YPII and Plan Finland.

4|P a g e
  The consultant will oversee primary data collection, including the delivery of an inception
workshop for relevant stakeholders, testing and refining data collection tools, training
enumerators and data quality assurance/ control.
 The methodology will include a brief literature review of comparable projects in NTT and
elsewhere in Indonesia to inform analysis around the effectiveness of the project approach
and potential longer-term outcomes.
5.1 Sample
At the activity/ output level, the evaluation will include all project areas that participated in the
project; however, primary data collection related to project objectives and results and the
appropriateness of the approach will focus on a sample of villages. These villages will be selected
with the intention of exploring different project implementation contexts and approaches, while
taking into account constraints around accessibility.

The suggested data collection approach will be through a combination of focus group discussions
(FGDs), key informant interviews (KIIs) and direct observation. Sampling in the target areas would
cover selected projects in each of the five Districts of Belu, TTU, Malaka, Soe and Kupang. Based on
the evaluation timeframe, it should be possible to include up to ten villages across the five Districts
in the data collection process.

KIIs will be conducted with representatives from the 1) Provincial Livestock Office, 2) Nusa Cendana
University, 3) Regional Livestock Alliance, and 4) Cooperative and Micro Enterprise Office of NTT
Province. At the District level, KIIs would be conducted with representatives from the District
Livestock Offices, village forums and livestock suppliers. Village forums, comprising those that have
and have not supported the SCILD project initiatives, should be included in the survey to highlight
respective lessons and challenges about future sustainability of the approach with localized support.

FDGs would be conducted with each of the eight implementing CSOs in their respective areas as well
as with ten youth and youth groups who directly participated in the SCILD project. FDGs with
parents of the youth involved in the project in two selected villages is suggested for documenting
their perspectives. Suggested targets for data collection are listed below

At the provincial level:

• Total number of KIIs: 4
o Provincial Livestock Office 1
o Nusa Cendana University 1
o Regional Livestock Alliance 1
o Cooperative and Micro
Enterprise Office 1

At the district level:

• Total number of FGDs: 22
o Implementing CSOs 8
o Youth beneficiaries 10
o Parents 2
o Partner NGOs 2
• Total number of KIIs: 20
o District Livestock Office 5
o Village Forums 10
o Local livestock suppliers 5

5|P a g e
5.2 Participant selection and recruitment
Representatives from key stakeholders (project team, project partners, CSOs, youth and youth
groups, parents, and provincial and district government offices and local university) will be included
in the evaluation consultations as mentioned above. The actual project sites will be determined
through consultation with YPII and its partners together with the consultant. Additional
stakeholders suggested by the consultant may be considered.

6. Ethics and Child Protection

Plan International is committed to ensuring that the rights of those participating in data collection or
analysis are respected and protected, in accordance with Ethical MERL Framework and our Global
Policy on Safeguarding Children and Young People. All applicants should include details in their
proposal on how they will ensure ethics and child protection in the data collection process.
Specifically, the consultant(s) shall explain how appropriate, safe, non-discriminatory participation of
all stakeholders will be ensured and how special attention will be paid to the needs of children and
other vulnerable groups. The consultant(s) shall also explain how confidentiality and anonymity of
participants will be guaranteed.

7. Key Deliverables

Deliverable Format Length Due (2019) Detail

Research Plan
(include: Evaluation Word, Excel Up to 3 pages 21 June
methodology)
Inception /
enumerator Ppt, handouts,
workshop with practice using 29 June
project partners in tools
Kupang
Research tools and FDG, KII As per tools, data
19 July
raw data questions collection plan
Presentation of
Ppt. presentation Up to15 slides 27 July
preliminary findings
Max 40 pages
Draft evaluation
Word, Excel (with graphs and 2 August
report (English)
photos)
Note that more time may be
Max 40 pages granted for translation of
Final evaluation (with graphs and finalized report in Bahasa
Word, Excel 16 August
report (English) photos, excluding Indonesian (can assume
annexes) budget for translation
outsourcing by consultant)

8. Timeline
Time (2019) Days of Work Responsible
Activity Support
estimated (estimated) (Lead)
Advertisement and Selection HR team, PM,
process 11-17 June 0 YPII HR M&E
Coordinator
HR team, PM,
Background Checks and
18-21 June 0 YPII HR M&E
Contracting;
Coordinator
Document review (project 25-26 June 2 Consultant YPII
documents/ output &

6|P a g e
 Time (2019) Days of Work Responsible
Activity Support
estimated (estimated) (Lead)
activity data and broader
literature review)
Development of
YPII and Plan
methodology, evaluation 27-29 June 3 Consultant
Finland
plan and draft tools
Primary data collection 13
(including inception (including 2 days
Consultant and
workshop, testing and 3-19 July travel, 1 day for YPII
YPII and partners
refining tools and training inception
data collection team) workshop)
Data cleaning and analysis 22-26 July 5 Consultant YPII
Summary of preliminary
27 July 1 Consultant YPII
findings
29 July – 2 YPII and Plan
Draft evaluation report 5 Consultant
August Finland
Review draft report 3-8 August 0 FLNO and YPII N/A
12-16 YPII and Plan
Final evaluation report 5 Consultant
August Finland
Total estimated consultant
34
days

9. Final Report Structure

Final report should be produced in Bahasa and English and should contain and be developed according to the
following structure:
Acknowledgment
Executive Summary (Having contents; Objectives, Methods, results & conclusion)
1. Background (description of project and activities)
2. Literature review
3. Methodology (having below mentioned components)
a. Objectives of the study
b. Operational definitions
c. Study design
d. Sampling Method and Sample Size
e. Data Collection Procedure
f. Data Analysis
g. Significance / Importance of the study, Human subject protection
4. Limitations
5. Findings should be presented on study objectives covering following (CCCD principles, quality of design
of the project, cost, reach, overall quality assessment) – the sections of the findings should be
according to main objectives of the project
6. Conclusions
7. Recommendations
8. References
9. Annexure (TOR, data collection tools, case studies, etc.)

Following lists must be given at the beginning:

1. Table of contents (automatically generated)
2. List of Figures
3. List of Tables
4. Acronyms and abbreviations

7|P a g e
 10. Budget

Milestone Detail Amount to be Paid (%) Expected Timeframe

Upon Contract Signing 35% 1 week

Delivery of full report 65% 7 weeks (estimated)

11. Expected Qualifications

Formal qualifications (required):
 Masters level degree (or undergraduate level coupled with appropriate practical experience)
in a relevant field, such as livelihoods development, livestock sector, international
development, child and human rights, etc.
Practical skills and experience (Required):
 Demonstrable expertise in youth employment and empowerment, especially in the NTT and
the livestock sector
 Demonstrable experience (3-5 years) in designing and conducting quantitative and
qualitative research/evaluation and including the development and use of qualitative data
collection tools and analysis using participatory methodologies, particularly in rural
communities in Indonesia.
 Performed team leader functions in similar evaluation assignment.
 Ability to meet deadlines and respond to requests and feedback appropriately and in a
timely manner
 Understanding of country level policies, framework and strategy in the livestock sector and
with regard to youth livelihood development
 Strong analytical skills
 Excellent report writing skills in English
 Experience in undertaking participatory evaluative methodologies, particularly with children,
and community engagement and consultations
 Excellent and demonstrated understanding of Child Protection, Gender Sensitivity and
ethical issues in research

12. Contract

1. Dwi Rahayu, Project Director, Yayasan Plan International Indonesia (YPII)

2. Dina (Rara) Mairawati as OIC for LEARN Program Manager, YPII
3. Solomi (Emmy) Tabun, SCILD Project Manager,YPII

13. Applications
Interested applicants should provide a proposal covering the following aspects:
- Detailed response to the TOR
- Proposed methodology
- Ethics and child safeguarding approaches, including any identified risks and associated
mitigation strategies
- Proposed timelines
- CVs
- Example of previous work
- Detailed budget, including daily fee rates, expenses, taxes etc.

8|P a g e
 - Police Certificates of Good Conduct – especially where there is primary data collection

Please send your application to Yayasan Plan International, c/o Verina.Salsabila@plan-

international.org Admin Manager, Program Support by 17 June 2019 referencing “Evaluation for
SCILD project” in the subject line, and including support documents as outlined

Annex 1: Checklist for Completeness

Annex 2: Global Policy: Safeguarding Children and Young People
Annex 3: Full Report Structure
Annex 4: Project Details
Annex 5: Ethical MERL Framework

9|P a g e