Strengthening service delivery =>> Health information and monitoring systems =>>
Data Quality Self-Assessment (DQS) methodology and other tools finalized
|Status||Achievement of overall target|
|Target achieved||• Slight delays in translations of DQS (one of several tools), but will be finished before the end of 2004.|
• First field tests were conducted in Nepal, Morocco and Togo.
Responsible entity: WHO
Completed by: July 2004
Total budget: $381,925
Target description and how it will help reach GAVI milestones
In most countries the immunization system has now reached a level where decisions become more data-driven. This requires a monitoring and reporting network, capable of generating reliable data. The Data Quality Audit (DQA) tool, used as part of the GAVI process, is one method to assess the reliability of the reporting system. The DQAs have highlighted the need for on-going assessments and improvements of the reporting system.
The importance of data-drive decision making and the need to streamline and improve the quality of data has also been recognized at a larger scale, as evidenced through the creation of the Health Metrics Network. This network aims at integrating and coordinating various existing data systems. Immunization monitoring systems, being one of the key public health interventions in most countries, will be a part of this initiative. The activities proposed to achieve this target, will contribute to improved, on-going data collection in the field of immunization.
The Data Quality Self-Assessment (DQS) is designed to assess and to diagnose weaknesses with existing reporting systems at district level. It can be used to prepare for a DQA and/or to monitor progress in improvements introduced after a DQA. Ultimately, the DQS can become part of the routine monitoring system, as it is designed to be used by district- level staff, without input from external sources. The DQS has been developed but needs to be field tested and distributed.
In addition, new tools need to be developed to improve data monitoring, with special focus on district level information. All such tools will be designed to provide feedback to the immunization services and to contribute to improvements in immunization coverage (e.g. links with Reach Every District).
ACCESS MILESTONE: Tools will help countries to interpret and use data to focus better on underserved areas and on weaknesses in their immunization system.
Justification for selection of activities
Priority has been given to tools which are in demand and already under development, and can be finalized and applied most rapidly.
|Activities||Budget||Coordinating partner/ support partners||Expected outcomes|
|Pilot test, translate and distribute the Data Quality Self Assessment (DQS) Tool||$142,765||WHO/ CVP/PATH||The Data Quality Self Assessment (DQS) tool will be finalized, field tested, translated and printed.|
It will be available to countries through downloading from a website and through more traditional means of distribution.
Supporting software will be developed.
CVP/PATH will be a partner in the field testing of the tool.
|Other tools to monitor performance developed and field tested||$164,920||WHO||Specific tools to assist VF eligible countries finalized, field tested, translated and printed. These tools will help strengthening district level monitoring and supervision.|
Examples include: Computerized EPI Information System (CEIS); Mapping Tool; Basemaps Library; decision tree (choice for district level survey); supervisory checklist.
|Training materials and guidelines to assist countries with the use of the tools will be developed||$74,240||WHO/ CDC UNICEF||Development and distribution of set of training materials to improve system failures as highlighted by DQS/DQA;|
Production of best practice guidelines to assist countries in taking appropriate actions
Detailed information on activities
The finalization, field testing, translation and distribution of the DQS is seen as a logical follow-up to the DQA. The DQS can be carried out regularly by district-level staff, as part of their routine activities, and does not require on-going inputs from external sources. It will allow the district-level workers to monitor weaknesses and improvements in their reporting systems.
CVP/PATH will be partners to field test the methodology. As the tool will be used by district level workers, translation will be made into Russian, Arabic, French, Spanish, Portuguese, Iranian, and other languages.
Cost: $142,765, including 4 man-months plus field test and translation costs. About $ 48,560 will be used at global level, while the remainder is for country-level testing and implementation.
With improved collection of data, the need arises to better store, manage and analyze the data. Tools will be developed so that data management and analysis (including production of maps) will be possible at all levels, including district level. Tools will be developed, field tested and distributed to help managers with supervision and with the selection of the best available methodology to monitor specific aspects of the immunization program.
Cost: $164,920, which includes the equivalent of 7 man-months of work, plus costs for field testing. All these activities will take place at global level ($ 111,360), with the exception of field testing of the supervisory checklist, which will be at country level ($ 53,560)
It is anticipated that the recommendations by the DQAs, the findings of DQS, and improved data gathering in general will create a demand for guidelines and training on improving reporting systems. Training materials, “Practices Guidelines" will be developed and equivalent of work at global level. UNICEF and CDC are potential partners for this activity.
Cost: $ 74,240 for 4 man-months equivalent of work at global level. UNICEF and CDC are potential partners for this activity.
Targets by priority area
Strengthening service delivery
==>> Health information and monitoring systems
• Data Quality Self-Assessment (DQS) methodology and other tools finalized
• All countries with failed DQAs have received timely and adequate support
• DQS systematically used by at least 10 countries
• Health system (HMIS) and immunization (EPI) specific reporting coordinated, where possible
==>> Contributing to alleviation of system-wide barriers
==>> Enhanced efforts in large population countries
Ensuring access to vaccines and related products
==>> Procurement/Supply of existing products
==>> Development and introduction of new, near-term products
==>> Managing process for country support from Vaccine Fund
Securing long-term financing
==>> Financial sustainability
==>> Recapitalization of The Vaccine Fund
Strategic planning & monitoring
==>> Setting priorities
==>> Monitoring progress
==>> Alliance coordination