Key principles for programme M&E
The CARHAP M&E framework primarily focuses on the activities, services and outputs delivered by the programme. A key underlying principle, however, is that it is compatible with the standards and priorities of the national M&E frameworks in each country and international reporting requirements, and that it builds on existing M&E practices and tools developed and used by partner organisations in the region.
Thus, CARHAP aims to avoid duplication of efforts and promote coordination and collaboration with other stakeholders in the field of M&E. Output 3 of the CARHAP LogFrame specifically aims to operationalise this principle by promoting a unified M&E approach among harm-reduction service organisations (HRSOs). This, in turn, will contribute to and strengthen the overall national M&E systems that are currently under development in all three programme countries.
In addition, CARHAP will coordinate and harmonise its M&E approaches with other major programmes in the region, notably Global Fund programmes, the World Bank Regional programme, CAPACITY Project, and CDC second-generation surveillance.
Basis for CARHAP M&E Framework: LogFrame and Work Plan
The M&E framework describes how CARHAP will monitor the implementation of its activities and outputs, as well as the outcomes and impact of the programme, thus laying the basis for subsequent programme evaluation.
The CARHAP M&E framework builds on two key programme elements: the programme LogFrame and the overall Work plan, which specifies the activities and services in the three programme countries.
(1) The CARHAP LogFrame provides the overall basis for the M&E framework, by specifying the expected deliverables and results at the various levels (outputs, outcomes and impact), as well as the associated objectively verifiable indicators (OVIs) and means of verification (MOVs). A main aim of the CARHAP M&E plan is to provide data on these OVIs, using the MOVs.
(2) In addition, the M&E plan aims to provide operational data on the implementation of activities in all five CARHAP output areas. These activities are described in detailed country work plans, which build directly on the LogFrame. No specific OVIs will be defined for each activity, but additional M&E tools will be developed to monitor the implementation of activities and services, as well as assess their quality.
The means of verification are at the centre of the M&E strategy, as they identify the main data sources and M&E tools needed for monitoring the programme.
The M&E Framework shows the MOVs for OVIs at the impact, outcome (purpose) and output level. In addition, CARHAP needs to collect data on the key activities implemented and services delivered. As a rule, CARHAP will use information available from existing data sources to avoid duplication, and to contribute to one national HIV/AIDS M&E system based on commonly agreed upon indicators.
At the impact and outcome/purpose level, existing data from second-generation surveillance studies will be used. Other key sources of information are Government policy documents and reports.
Similarly, data from external sources is available for monitoring the delivery of outputs, especially for output areas 4 and 5 (strengthened national coordination and strategy development; and supportive legal and policy environments). This mostly involves records and reports on special meetings and events, as well as policy and strategy documents.
However, for Output areas 1-3, which are directly related to the implementation of harm reduction programmes, CARHAP will use standard reporting data generated by the programme itself (e.g. progress reports, minutes, training reports), and use specific M&E tools for monitoring the implementation and quality of harm reduction activities and services.
These M&E tools will build as much as possible on existing M&E practices and tools in the three programme countries, to strengthen compatibility with national M&E systems (under development in all countries) and other programmes and projects in the region.
Activities and services as specified in the Country Work Plans will be monitored against the deliverables and targets agreed upon in the contracts with individual HRSOs. Hence, M&E arrangements will be an integrated part of the Contracts between NIPs and HRSOs.
In addition to standardised M&E tools, Operations Research will be conducted on a limited scale to facilitate a better understanding of social, behavioural, economic and other factors underlying or affecting HR service delivery. This information can be used for process evaluation purposes as well.