Final report for Mid Term Evaluation of the Archipelago Program TVET Initiative - 06 2022

Description of the programme and its objectives

The overall impact objective of the ARCHIPELAGO program is to better match labour supply (skills available in the local market) with labour demand (generated by the local private sector and productive economic growth). The ARCHIPELAGO program and its 20 projects were evaluated in a mid-term evaluation between October 2021 and January 2022. In terms of direct beneficiaries, ARCHIPELAGO targets 10,500 young people and entrepreneurs through the combined action of implementing partners SEQUA gGmbH, CPCCAF and EUROCHAMBRES. They are mobilizing their networks to promote the implementation of 20 vocational training partnership projects based on an entrepreneurial vision and the choice of promising trades and sectors in Burkina Faso (2 projects), Cameroon (4), Chad (2), Côte d'Ivoire (2), Ghana (2), Mali (1), Mauritania (2), Niger (1) and Senegal (4).

The evaluation examined the overall implementation of the project, including the achievement of the following expected outcomes:

1. Specific Effect/Objective 1: Increase and improve local employment opportunities based on the analysis of skills gaps and the identification of potential growth factors that stimulate job creation in existing MSMEs and future start-ups; and
2. Specific Effect/Objective 2: Develop local vocational education and training (TVET) resources tailored to the needs of the private sector to enhance the employability of youth.

Purpose and scope of the evaluation

This mid-term evaluation assessed the results of the intervention during the period to be evaluated-from its start on 09/12/2018 to the mid-term evaluation period and is based on the realities on the ground. The evaluation used a systems and evaluative inquiry approach to manage and interpret the information collected. Rights-based methods of analysis, with a particular focus on gender, were applied in all aspects and stages of the inquiry and conclusion processes. This means that they were fundamental to the entire process, in a cross-cutting manner. The norms and standards, ethical guidelines, and code of conduct of the UN Evaluation Group were applied during the evaluation. Twelve of the 20 projects were selected for field visits based on the selection criteria defined during the evaluation's inception period. The evaluation was limited to 12 project visits, although others were included through document review and participation in round table discussions, either during the visits or subsequently via Internet.

Evaluation Questions

Relevance

• Evaluation Question 1 - To what extent do ARCHIPELAGO's objectives and design respond to and are structured to address priority needs?

Coherence

• Evaluation Question 2 - Compatibility and alignment of ARCHIPELAGO to achieve synergistic coherence?

Effectiveness

• Evaluation Question 3 - The extent to which projects have contributed to intended outcomes and objectives?
• Evaluation Question 4 - Extent of achievements with regard to gender, returning migrants, environment and climate change?

Efficiency

• Evaluation Question 5 - To what extent does ARCHIPELAGO deliver results in a timely and efficient manner?

Impact

• Evaluation Question 6 - To what extent does ARCHIPELAGO generate higher level impacts?

Sustainability - Viability

• Evaluation Question 7 - How likely is it that net benefits will continue beyond the implementation period of ARCHIPELAGO?
• Evaluation Question 8 - To what extent can ARCHIPELAGO envisage geographic and thematic expansion and diversification?

Added value of the European Union

• Evaluation Question 9 - How does ARCHIPELAGO contribute to the optimization of efforts and the creation of synergies between EU and Member State interventions?

Methodology

The evaluation is based on a multidimensional methodology that goes beyond simple triangulation. Data collection included analysis of relevant documents and websites, supplemented by interviews and focus groups with key stakeholders to gather their feedback, and observations at project sites. Finally, an online survey of key stakeholders was conducted.

The selection of people to be interviewed and/or included in the meetings and focus groups was done using "snowball" sampling methods, i.e., key people identified for interview referred others who were relevant.

A total of 500 people were interviewed or included in focus group discussions throughout the evaluation. Of these, 350 were men and 150 were women. For the survey, 62 out of 86 people responded, representing a response rate of 72%.
A vertical and horizontal analysis was conducted across the documents and layers of information collected and traversed the different levels of the ARCHIPELAGO program. Atlasti qualitative data analysis software was used to ensure in-depth analysis of the data.

Limitations

It was difficult to assess the results of some projects due to significant delays resulting primarily from the impact of the COVID19-related pandemic. One project (Niger) did not begin implementation until September 2021.