✔ The evaluation assesses the relevance and fulfilment of objectives, developmental efficiency and effectiveness, impact and sustainability of the intervention
The aim of an Evaluation is that of assessing the relevance and fulfilment of objectives, developmental efficiency, effectiveness, impact and sustainability of the intervention. The evaluation of a project must be impartial and independent, credible, useful, and carried out with the participation of the project's stakeholders.
The scope of the evaluation includes review of all resources mobilised and activities implemented in the framework of the project.
In case the partner intends to request EC's funding for the external evaluation of the project, Terms of Reference (including methodology, duration and foreseen calendar) will have to be provided with the project proposal (or later on in the Interim or Pre-Final stage) and require the official agreement of EuropeAid.
To be considered eligible, evaluation costs have to be incurred (committed) before the end of the implementing period of the project (i.e. during the period running from the date of eligibility of expenditure of the operation established in the Special Conditions of the Grant Contract to the end of the implementation period). The evaluation itself must be carried out within three months of the end of the operation. Evaluation reports have to be submitted to EuropeAid with the final report.
The external evaluation team should be engaged via the applicable tendering/contracting procedure. The candidate contractor shall prepare a proposal in response to the ToR issued by the commissioning service. The contents of the proposal shall be as follows:
During the inception phase, which starts when the evaluation team is engaged and lasts a few weeks, team members collect basic documentation:
The team shall also consult all relevant management and monitoring documents so as to acquire a comprehensive knowledge of the project covering:
The evaluation team then reviews the project logical framework as set up at the beginning of the project cycle and identifies the points which need clarification and/or updating. The analysis of the project logic covers:
Particular care shall be given to the identification of the different levels of objectives and their translation into various levels of intended effects:
The logical framework preferably includes “Objectively Verifiable Indicators (OVIs)” and “Sources of Information” which are useful for structuring the evaluators' work. In so far as OVIs have been properly monitored, including baseline data, they become a major part of the factual basis of the evaluation. Indicators may also be developed in the framework of the evaluation as part of a questionnaire survey, an analysis of a management database, or an analysis of statistical series. Indicators may be quantitative or qualitative.
Once the analysis has been performed on the basis of official documents, the evaluation team starts interacting with key informants in the project management entourage. The first to be interviewed are generally the persons who are or have been involved in the design, management and supervision of the project. Interviews cover project management, EC services, and possibly key partners in the country/ies concerned. Other evidence is collected through direct observation of facts (including track records, photographs and alike); statements by informants who have been personally involved; identification and reference to proxies; indirect reporting on facts by informants who have not been personally involved. The evaluation team makes use of different participatory tools for research and dialogue and shall insure an ethical behaviour in collecting data.
The core evaluation report shall be based on seven criteria identified by the OECD/DAC and the EC itself. These criteria are the following:
Once a self-assessment of the reliability of data and validity of analyses has been carried out and the quality control guaranteed, the evaluation team reviews the findings with the view of confirming them, and formulates a series of conclusions, recommendations and lessons learnt. The evaluation team then finalises the drafting of the evaluation report following the standard EC format.
The evaluation team leader attaches a quality certificate to the draft final report, indicating the extent to which:
Resources and useful links: