Monitoring and Evaluation of the Grants
Why an impact monitoring and evaluation system (OIMES)?
The impact monitoring and evaluation system (OIMES) has been developed to assess the Facility’s long-term contribution to the strengthening of nfps in partner countries. OIMES serves a dual purpose:
1) OIMES focuses on participatory monitoring at country level, involving and building the capacity of the Multi-stakeholder National Steering Committees. It generates information necessary for enhanced steering/coordination of nfps in partner countries (for use by Multi-Stakeholder National Steering Committees).
2) OIMES generates information and insights about the performance, effectiveness and long-term impact of support provided by the NFP Facility.
The purpose of the matrix is to assess the current status of the nfp process, to identify gaps and weaknesses, and to monitor progress of the nfp process of a given country by using it periodically and observing changes in the quality of the nfp process. In order to get a balanced assessment of the process, the matrix is filled in a joint exercise by the nfp stakeholders seeking consensus on the status and rating of the achievements of indicators.
While the assessment of the nfp process along the matrix can provide a general baseline for Facility support to a given country, the contribution of the Facility to the progress of the nfp principles can not be clearly identified thereby. To provide a clear picture on this contribution it has to be measured along clearly attributable cause-effect chains with clearly described indicators.
Results-Based Management (RBM) chain
OIMES is based on a coherent results chain tailored to match the specifics of (i) the NFP Facility’s support to a given country, and (ii) each project with clearly defined inputs, activities, outputs, outcomes and impacts and related indicators.
For the determination of indicators for Facility support at country level, OIMES draws on the overall assessment of the nfp process within the nfp update. By screening the indicators in the nfp update matrix, stakeholders identify the bottlenecks of the nfp process that should be overcome. The related indicators of the matrix are then selected and further specified by defining qualitative and quantitative values as a basis for monitoring achievements under the Facility support. Indicators on project level are mostly more practical and have to show clearly their linkage to the defined objective(s) of the country support.
In practice... implementation at country level
Different stakeholders contribute differently to the operation of the OIMES, each with their own specific needs for monitoring information.
Whereas monitoring will be separately executed on grant-project level, support of the Facility and the entire nfp-process, periodic evaluation should be trans-level, and check weather the respective impact chains are linked and finally contribute to the overall nfp process.
Defining priorities at national level
At the beginning of a Partnership Agreement the indicators of the nfp-matrix are assessed in a participatory way during the Launching Workshop. This exercise gives a picture of the nfp process of the country. It is an opportunity for stakeholders to analyse the strengths and the areas of their nfp needing support. Priorities and activities are defined for Facility support by all stakeholders. Specific Objectives, Indicators for Monitoring and Evaluation, Partnership Outputs are formulated and nfp-matrix Indicators selected and reported in the Appendix to the Facility Country Partnership Agreement.
Impact Assessment of Facility grants
All Facility grant contracts include a monitoring and evaluation section in the activities planned to be implemented. The assessment of the impact of the activities on the nfp-indicators at Facility grant level is done by the Recipient Organisation itself.
Impact Assessment at national level
A summary of the impact of all activities conducted at national level is done by the National Facility Focal Point. It is shared during a meeting of the National Multi-stakeholder Steering Committee (NMSC), during which its members evaluate the progress of the overall nfp process and assign new assessment of the nfp-indicators in the nfp-matrix. Results of the activities and lessons learned are shared in a stakeholders workshop every year. The nfp matrices of partner countries can be found on the Country support pages.
During this Monitoring and Evaluation process, the Monitoring phase of the nfp is strengthened at national level.