PROGRESS IN THE FACE OF INSECURITY IMPROVING HEALTH OUTCOMES IN AFGHANISTAN POLICY BRIEF TABLE OF CONTENTS ACKNOWLEDGMENTS   iii ABBREVIATIONS   v CONTEXT   1 OBJECTIVES AND METHODOLOGY   5 KEY FINDINGS   7 THE WAY FORWARD   17 REFERENCES   19 HEALTH SYSTEMS APPENDIX:  PERFORMANCE DOMAINS   25 i ACKNOWLEDGMENTS T his World Bank policy brief is based on the Afghanistan Health Services Study that was financed by the Afghanistan Reconstruction Trust Fund. The Ministry of Public Health generously provided data and assistance for completing this study. This policy brief was prepared by a World Bank task team that included Mickey Chopra (Lead Health Specialist, Global Solutions Lead for Service Delivery) and Aneesa Arur (Senior Health Specialist). Comments and inputs from Rekha Menon (Practice Manager, South Asia Region), Benjamin Loevinsohn (Lead Health Specialist), Ghulam Dastagir Sayed (Senior Health Specialist), Mohammed Tawab Hashemi (Senior Health Specialist), Andre Medici (Senior Economist), and Anugraha Palan (Senior Communications Officer) are gratefully acknowledged. Sheryl Silverman, Raouf Zia, Aisha Faquir, Anugraha Palan, and Juhie Bhatia provided communications and outreach support. The World Bank also thanks the joint working team from the Hospital for Sick Children Toronto, University of Toronto, and Aga Khan University that included Jai Das, Nadia Akseer, Zaid Bhatti, Arjumand Rizvi, and Zulfiqar Bhutta for their work on the Afghanistan Health Services Study. Finally, Martha P. Vargas and Christopher Pala provided valuable editorial assistance. iii ABBREVIATIONS AHS Afghanistan Household Survey ANC Ante-Natal Care ARI Acute Respiratory Infections BCG Bacillus Calmette-Guerin CO Contracting-out CI Contracting-in CPR Contraceptive Prevalence Rate DPT3 3rd dose Diphtheria Pertussis Tetanus KPK Khyber Pakhtunkhwa Province (Pakistan) MDGs Millennium Development Goals MICS Middle-Income Countries MMR Maternal Mortality Ratio MOPH Ministry of Public Health NGO Non-Governmental Organization, used consistently to also include CSOs (Civil Society Organizations) NMR Neonatal Mortality Rate ORS/ORT Oral Rehydration Salts/Oral Rehydration Therapy RMNCH Reproductive Maternal Neonatal and Child Health SBA Skilled Birth Attendant SDGs Sustainable Development Goals TT Tetanus Toxoid UNICEF United Nations International Children’s Emergency Fund USAID United States Agency for International Development WHO World Health Organization v CONTEXT The Afghan government has achieved substantial improvements in the health of its women and children over the last 15 years. These health gains have come about in the face of ongoing inse- curity and instability. Afghanistan’s investments and innovations in the health sector have provided a foundation for the continued socio-economic development of the country and the achievement of Afghanistan’s National Development Goals. While the improvements in health have been impressive given the context, there are some critical remaining challenges, including high levels of malnutrition and stunting, a persistently high fertility rate, and a deficit of health services in rural communities. This paper documents what has been learned over the last decade and half in Afghanistan. In recent years, armed conflict in Afghanistan has intensified. Since 2010, there has been a clear uptick in instability and insecurity in Afghanistan (figures 1a and 1b), and more and more peo- ple now live in areas that are affected by high levels of insecurity. Maintaining service delivery and responding to intensified health needs under these circumstances is a key challenge facing Afghani- stan’s health system. Scaling up service-delivery strategies that adapt well to situations of insecurity will be critical to maintaining and expanding coverage with high-quality services. Afghanistan has been at the forefront of establishing a large-scale, public-private model for service delivery. All of the publicly funded health services in Afghanistan today involve some form of contracting with non-governmental, non-profit entities or individuals. Two models predominate: ✦✦ Contracting-out (CO), or service-delivery contracts with NGOs. Most services are delivered by Non-Governmental Organizations (NGOs) under service-delivery contracts with the Ministry of Public Health (MOPH). As time has progressed, an increasing proportion of contracts have been awarded to Afghan NGOs: out of 49 contracts awarded for service delivery, 72 percent are now with local NGOs. All NGO contracts first focus on the delivery of standardized packages of services defined by the ministry; second, they assign clear geographical responsibility to the NGOs (typically for whole provinces with populations ranging from about 150,000 to one million); and third, they employ competitive selection of NGOs. ✦✦ Contracting-in (CI) managers. In addition, in three provinces near Kabul, namely Parwan, Panjshir and Kapisa, the MOPH contracts in managers to help strengthen services delivered by 1 FIGURE 1A. Provinces by level of insecurity, 2003–2010 Jawzjan Balkh Kunduz Badakhshan Takhar Samangan Faryab Baghlan Sari Pul Panjsher Nuristan Badghis Bamyan Parwan Kapisa Kunar Laghman Kubal Wardak Herat Nangarhar Ghor Logar Daykundi Ghazni Paktiya Khost Uruzgan Paktika Farah LEGEND Zobel Insecurity (Year 2003–08) Kandahar Minimal Hilmand Nimroz Moderate Severe FIGURE 1B. Provinces by level of insecurity, 2010–2015 Jawzjan Balkh Kunduz Badakhshan Takhar Samangan Faryab Baghlan Sari Pul Panjsher Nuristan Badghis Bamyan Parwan Kapisa Kunar Laghman Kabul Wardak Hirat Nangarhar Ghor Logar Daykundi Ghazni Paktya Khost Uruzgan Paktika Farah Zabul LEGEND Insecurity (Year 2009–15) Kandahar Low intensity Hilmand Nimroz Moderate Severe Note: Provinces were classified into low, moderate, and severe insecurity zones based on the number of battle-related deaths in each period, using data on battle-related deaths from the Uppsala Conflict Program. 2 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES MOPH staff. This model involves the competitive recruitment of managers who are paid market–based salaries; a procedure for selectively increasing the salaries of MOPH health workers and field managers; provision of a level of funding similar to that provided to the NGOs; and the use of the same monitoring and evaluation mechanisms as in other provinces. All the CI provinces are close to Kabul and are less affected by insecurity than the CO provinces, which gives them a systematic advantage in improving service delivery performance for which this analysis cannot control. THE AFGHANISTAN HEALTH SERVICES STUDY 3 OBJECTIVES AND METHODOLOGY This policy note is motivated by four main questions: ✦✦ Is the Afghan health system delivering good results to women and children in terms of service coverage and health systems performance? ✦✦ How has the escalating insecurity influenced these trends? ✦✦ Which model—CO or CI—delivered better results? ✦✦ How can service delivery in Afghanistan be improved and made resilient to insecurity and instability? Survey data are used to answer these questions. This note presents key findings and conclusions from the Afghanistan Health Services Study and focuses mainly on quantitative analyses of household surveys. These include the Multiple Indicator Cluster Surveys 2003 and 2010, as well as the Afghanistan Health Surveys of 2012 and 2015, and health facility surveys (Afghanistan Balanced Scorecard Data- sets 2004–2016). In addition, sensitivity analyses were conducted with date from the Demographic and Health Survey 2015. The service coverage outcomes that were examined include those in the standard ‘essential package of services,’ spanning the continuum of care for women and children. These include contraceptive cov- erage, antenatal care, skilled birth attendance, measles immunization, and use of oral rehydration salts for diarrhea. The health-systems performance indicators studied here correspond to performance domains used by the MOPH to monitor NGO contracts. These include: ✦✦ Degree of client satisfaction and community involvement; ✦✦ Human resources; ✦✦ Physical capacity to deliver quality care; ✦✦ Quality of services provisioned, or process measures of quality; ✦✦ Management systems at health facilities, and ✦✦ Measures of equity, in use and in client satisfaction. More details on these indicators are in the Appendix to this note. 5 Levels of insecurity over time were measured using battle-related deaths from the Uppsala Conflict Data Program, the international gold standard in this area. The quantitative analyses focus on two main windows, from 2003 to 2010 and from 2010/2011 to 2015/2016. The number of battle-related deaths in each period was used to classify provinces into three categories: ✦✦ Minimal insecurity: less than 300 battle-related deaths in any three consecutive years ✦✦ Moderate insecurity: 300–1,000 in any three consecutive years, and ✦✦ High insecurity: 1,000 or more in any three consecutive years in each window of analysis. The study analyzed the potential impact of contract mechanisms, degree of insecurity and NGO types on change in selected Reproductive, Maternal, Neonatal and Child Health (RMNCH) indicators for the 2003 to 2010 and 2010 to 2015 periods, and health facility performance systems indicators for 2004 to 2010 and 2011 to 2016 through panel data, linear and logistic regression methods. The cover- age models were adjusted for female illiteracy, percent of rural population, and battle-related deaths. Health-system outcome models were adjusted for patient volume, facility type, distance from provincial center, and region 6 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES KEY FINDINGS A fghanistan has made strong gains in health outcomes, health service coverage and health systems performance since 2003, with a particular impact on women and children’s health. All told, Afghanistan has made notable progress towards achieving the Millennium Develop- ment Goal (MDG) targets for improving maternal (MDG5) and child health (MDG4). Accord- ing to United Nations estimates, maternal mortality rates (MMR) declined from 1,100 to 396 deaths per 100,000 live births from 2000 to 2015 (Alkema and others 2016), and under-5 child mortality rates (U5MR) fell 34 percent (from 137 to 91 deaths per 1,000 live births). Newborn mortality rates (NMR) dropped 32 percent (from 53 to 36 deaths per 1,000 live births) (You and others 2016). Nev- ertheless, it is important to emphasize that in absolute terms there is considerable room for progress. Improvements achieved in health outcomes compare very favorably with improvements achieved by comparators. Afghanistan has achieved more improvements in key maternal and child health outcomes than has a key regional comparator (Figure 2), Khyber Pakhtunkhwa province FIGURE 2. Rates of change in health outcomes, percentage points per year1 U5MR Stunting –3.50 –3.00 –2.50 –2.00 –1.50 –1.00 –0.50 0.00 KPK Global Median AFG Note: U5MR = Under-5 Mortality Rate; AFG = Afghanistan (2000–2015); KPK = Khyber Pakhtunkhwa Province (2000–2015)2; Global Median (1980–2010). 1 This is a conservative estimate for Afghanistan, based on Akseer et al., 2016, Lancet Global Health; Global median is for countries with Afghanistan levels at baseline based on Arur, A. et al., 2011, HNP Discussion Paper, World Bank. 7 FIGURE 3. National trends in coverage for key reproductive and child health services, 2003–20153 70 60 50 Coverage (%) 40 30 20 10 0 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 Year Contraceptives (Any method) ANC by skilled provider Facility deliveries Contraceptives (Any modern method) TT two or more shots SBA (KPK). Improvements over time have also exceeded the global median for 75 low and lower-middle income countries (Akseer and others 2016; Arur and others 2011). Mirroring improvements in outcomes, there have been good improvements since 2003 in the coverage of maternal and child health services. Coverage of contraceptives, for example, increased until 2010. However, they have declined though at a slower rate, between 2010 and 2015— showing the need for a greater focus in this area. All other maternal and child health-service coverage indicators examined showed improvements across the 2010–2015 period, barring Tetanus Toxoid (TT) coverage, which declined over 2003–2010, but increased thereafter. Almost all provinces registered improvements in coverage between 2003 and 2015. Virtu- ally all provinces achieved improvements in coverage between 2003–2015 except for Nimroz and Nuristan during the years 2003–2010 and Khost and Zabul in 2010–2015. This overall assessment of coverage was based on improvements in the WHO’s composite coverage index.4 The pace at which service coverage improved in Afghanistan compares very favorably to that of other countries and regions in similar situations. The annual rate of improvement in maternal 2 Regional comparator chosen for geographic proximity and other contextual similarities, including security constraints. 3 Data sources include MICS 2003, 2010 and AHS 2015. 4 The Composite Coverage Index (CCI) is a composite of overall health coverage and includes both curative and preventative child and maternal health interventions (Boerma et al, 2008). This measure is calculated as a weighted coverage mean of eight essential interventions that represent broad categories of the continuum of care. The service categories included in the CCI are as follows: family planning, maternal and newborn care, immunization, and case management of sick children. Each continuum stage is given equal weight and the CCI is then calculated, as below. Note that FPS indicates family planning needs satisfied (related to contraceptive use) and CPNM refers to care seeking for ARI while MSL refers to Measles vaccination. 1 SBA + ANCS 2 DPT 3 + MSL + BCG ORT + CPNM  CCI =  FPS + + + 4  2 4 2  8 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES FIGURE 4. Rates of change in service coverage in percent per year, 2004–20105 Diarrhea (ORS) DPT3 CPR Modern ANC SBA –2.00 –1.00 0.00 1.00 2.00 3.00 4.00 5.00 KPK Global Median AFG Note: ORS = Oral Rehydration Salts; DPT3 = diphtheria, pertussis, tetanus 3rd dose; CPR = Contraceptive Prevalence Rate; ANC = Antenatal Care; SBA = Skilled Birth Attendance. and child health service coverage (figure 4) exceeds that of the regional comparator, KPK, as well as the global median for 75 low and lower–middle income countries. Progress on Diphtheria Pertus- sis and Tetanus (DPT3) coverage in Afghanistan lagged behind the global median, but not behind regional comparators. Between 2004 and 2010, health systems improved their performance considerably across the six indicators measured, though at varying rates (figure 5). The client and community per- formance domains show the most remarkable improvements. Successes were noted in the physical capacity to deliver care, as well. Management systems and human resources for health domains also improved considerably, while overall mission and quality-of-service provision remained relatively stable. Through 2011 to 2016, health systems performance continued to improve, although at a slower pace, with the exception of large improvements in the physical capacity to deliver high-quality care. As figure 6 shows, while health systems performance continued to improve over 2011–2016, the pace of improvements is slower than over the 2004–2010 period, but, most importantly, shows no sign of decelerating. The main exception is the physical capacity to deliver quality care, which contin- ued to improve at a fast pace. These trends were visible at the provincial level, as well. All provinces, except Zabul, made progress on health systems domains during 2004–2010, while all provinces, except Kapisa, Kunar, and Badghis, achieved health systems improvements during 2011–2016. 5 Akseer et al. 2016. Lancet Global Health; Global median is for countries with Afghanistan levels at baseline based on Arur, A. et al. 2011. HNP Discussion Paper, World Bank. THE AFGHANISTAN HEALTH SERVICES STUDY 9 FIGURE 5. Change in health-systems performance domains in FIGURE 6. Change in health systems performance Afghanistan, 2004–2010 domains in Afghanistan, 2011–2016* 100 100 90 90 80 80 Score/100 Score/100 70 70 60 60 50 50 40 40 30 30 2004 2005 2006 2007 2008 2009/10 2011/12 2012/13 2015 2016 Year Year Domain A: Client and Community Domain A: Client and Community Domain B: Human Resources Domain B: Human Resources Domain C: Physical Capacity Domain C: Physical Capacity Domain D: Quality of Service Provision Domain D: Quality of Service Provision Domain E: Management Systems Domain E: Management Systems Domain F: Overall Mission Domain F: Overall Mission Average composite score (Median) Average composite score (Median) Note: Definition of domains were changed after 2010 to raise the bar on performance; hence trends assessed separately for 2004–2010 and 2011–2016. Health service delivery and health systems have remained resilient to Insecurity A constant and growing state of insecurity and instability clearly presents a challenge to health service delivery. As can be expected, in descriptive analyses, health facilities in provinces with low insecurity typically achieved greater increases in service coverage. However, improvements in coverage were apparent in high as well as moderate insecurity areas, as well, with a few exceptions. For service coverage, differences in improvement between provinces with higher and lower levels of insecurity are small. Highly insecure provinces showed striking resilience over 2003–2010 and made significantly greater gains relative to provinces with lower levels of insecurity: they improved coverage of contraceptive use, Ante-Natal Care (ANC), Skilled Birth Attendant (SBA), care-seeking for ARI (Acute Respiratory Infections), and ORT (Oral Rehydration Therapy) use during this period, even after adjusting for maternal literacy, contracting type and rural residence. However, relative progress in scaling up childhood vaccines coverage was lacking in the highly insecure provinces (figure 7a). During 2010-2015, gains in contraceptive coverage, ANC, Bacillus Calmette-Guerin (BCG) vaccination, and ORT were significantly smaller in the highly insecure provinces compared to those with minimal insecurity after controlling for confounders (figure 7b). However, highly inse- cure areas achieved similar improvements in SBA, DPT3, and measles coverage, along with care-seeking for ARI, as compared to those areas with minimal insecurity. ORT coverage was most affected by insecu- rity, as improvements in coverage for this indicator were 4.9 percent lower in highly insecure provinces compared to minimally insecure provinces over a period of 5 years. 10 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES FIGURE 7A.  Percentage of average annual change in service coverage by severity of insecurity, 2003–2010 (Reference: Insecurity)* 10 8.2 8 6 4.1 4 3.5 3.0 3.1 2.9 2.8 2.1 2.1 2 1.5 1.5 0.5 0.2 0 –0.7 –2 –1.2 –2.2 –4 Contraceptive ANC SBA BCG DPT3/Penta Measles ORT Care Seeking Use for ARI Moderate Versus Minimal Insecurity Severe Versus Minimal Insecurity Note: *Red values indicate statistical significance at p = 0.10 or less. Model adjusted for the main effects of insecurity and time; and covariates, including maternal illiteracy, contracting type, and rural residence. Positive numbers mean that facilities in areas of severe or moderate insecurity achieved greater improvements than did facilities in minimally insecure zones. FIGURE 7B. Percent in average annual changes in service coverage by severity of insecurity, 2010–2015 (Reference: Minimal insecurity)* 6 4.4 4 2.4 1.8 2 0.2 0.0 0 –0.4 –1.1 –0.9 –1.0 –1.0 –2 –1.6 –1.7 –1.8 –4 –3.1 –3.1 – 4.9 –6 Contraceptive ANC SBA BCG DPT3/Penta Measles ORT Care Seeking Use for ARI Moderate Versus Minimal Insecurity Severe Versus Minimal Insecurity Note: Red values indicate statistical significance at p = 0.10 or less. Model was adjusted for the main effects of insecurity and time; and for covariates, including maternal illiteracy, contracting type, and rural residence. Positive numbers mean that facilities in areas of severe or moderate insecurity achieved greater improvements than did facilities in minimally insecure zones. Health-systems performance improvements have also been achieved across the spectrum of insecurity. In some health systems performance domains between 2003 to 2010, facilities in areas with low insecurity achieved greater improvements than did those in areas with high insecurity. However, in the period between 2011 and 2015, there was no detectable difference in unadjusted improvements in health systems performance between facilities located in areas of low, medium, and high insecurity. THE AFGHANISTAN HEALTH SERVICES STUDY 11 Evidence of resilience to conflict remains even after the analysis adjusts for confounders, which vary by analysis and are listed under each relevant figure. Differences in health-system performance between provinces with high and low insecu- rity were minimal, as well. Adjustments for confounders found that insecurity negatively impacted improvements in functioning equipment, infrastructure, client assessment, and provider knowledge in higher-conflict facilities during 201–2016 (figure 8b). However, improvements in health systems per- formance were only slightly smaller in severely insecure areas as compared to minimally insecure areas FIGURE 8A. Percent of average annual changes in health-systems performance by severity of insecurity, 2004–2010 (Reference: Minimal insecurity)* 20 15 13.8 10 7.0 6.9 5 0.2 1.0 0 –0.9 –5 –3.3 –2.3 – 4.0 –10 –15 –12.4 Functioning Drug Availability Infrastructure Patient History and Patient Equipment Examination Counseling Moderate Versus Minimal Insecurity Severe Versus Minimal Insecurity Note: *Red values indicate statistical significance at p = 0.10 or less. Model was adjusted for the main effects of insecurity and time; and for covariates, including patient volume, facility type, region, and contracting type. Positive numbers mean that facilities in areas of severe or moderate insecurity achieved greater improvements than didfacilities in minimally insecure zones. FIGURE 8B. Percent of average annual changes in health-systems performance by severity of insecurity, 2011–2016 (Reference: Minimal insecurity) * 4 3.1 3 2 1.7 1.6 1 0.6 0.7 0.8 0.2 0 –0.2 –0.2 –1 –2 –1.3 –1.9 –1.8 –3 –2.8 –2.8 –4 Functioning Drugs & Vaccines Infrastructure Patient Physical Patient Female Health Provider Equipment Availability Assessment Counseling Worker Knowledge Moderate Versus Minimal Insecurity Severe Versus Minimal Insecurity Note: *Red values indicate statistical significance at p = 0.10 or less. Model adjusted for the main effects of insecurity and time and for covariates, including patient volume, facility type, region, and contracting type. Positive numbers mean that facilities in areas of severe or moderate insecurity achieved greater improvements than did facilities in minimally insecure zones. 12 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES (between 1.8 and 2.8 percentage points lower over 5 years). Other health-systems performance domains for 2011–2016 demonstrated no statistically significant difference in improvement between facilities in severe, moderate, and minimally insecure areas. Contracting-in (CI) and Contracting-out (CO) Models deliver comparable results CI provinces achieved greater improvements in mother and child health coverage relative to CO provinces, but the difference in pace of improvements was small, suggesting comparable performance, with the exception of ORT use. Both CO and CI provinces achieved improvements in maternal and child health coverage during 2003 to 2010, as well as over 2010 to 2015 with a few excep- tions. Unadjusted comparisons of relative improvements in coverage over time found that CI provinces made greater gains during 2003–2010 and 2010–2015 as compared to CO provinces. After adjusting for confounders, CI provinces still achieved significantly greater improvements on most service coverage indicators relative to CO provinces during 2003-2010 and 2010-2015 (figures 9a and 9b). However, FIGURE 9A. Percent of average annual change in service coverage by type of contracting, 2003 and 2010 (Reference: Contracting-In)* 4 3 2 1.7 1.1 1 0.3 0 –1 –0.3 –0.7 –2 –1.6 –2.1 –1.9 –3 –4 Contraceptive ANC SBA BCG DPT3/Penta Measles ORT Care seeking Use for ARI Note: *Red values indicate statistical significance at p = 0.10 or less. Model adjusted for the main effects of contracting type and time and covariates, including maternal illiteracy, conflict, and rurality of residence. Positive numbers mean the CO provinces achieved greater improvements than did CI provinces. FIGURE 9B. Percent of average annual changes in service coverage by type of contracting, 2010–2015 (Reference: Contracting-In)* 0.0 0 –2 –1.5 –1.1 –1.6 –2.0 –4 –3.7 – 4.1 –6 –8 – 6.9 –10 –12 Contraceptive ANC SBA BCG DPT3/Penta Measles ORT Care seeking Use for ARI Note: *Red values indicate statistical significance at p = 0.10 or less. Model adjusted for the main effects of contracting type and time and covariates, including maternal illiteracy, conflict, and rurality of residence. Positive numbers mean the CO provinces achieved greater improvements than CI provinces THE AFGHANISTAN HEALTH SERVICES STUDY 13 the difference in the pace of improvements achieved by the two approaches was relatively small. Improvements in ORT use was an exception, which were 6.9 percent points lower in CO provinces over 2010–2015 than in CI provinces during the same period. The two contracting approaches deliver similar results in terms of improvements in health- systems performance, except in the case of drug availability, where CO facilities showed much greater improvements during 2011–2016. Adjusted comparisons of improvements over time show that CO facilities achieved similar or greater results in health systems performance during 2004–2010, with the exception of drug availability (figure 10a). By contrast, during 2011-2016, CO facilities achieved greater improvements over time relative to CI comparators on several indicators, including functioning equip- ment, availability of drugs and vaccines, client physical assessment, and client counseling (figure 10b). The FIGURE 10A. Percent of average annual changes in health-systems performance, by type of contracting, 2004–2010 (Reference: Contracting-In) * 4 3.1 3 2 1 0.6 0.3 0 –1 –1.1 –2 –3 –2.5 Functioning equipment Drug availability Infrastructure Patient history and Patient counseling examination Note: *Red values indicate statistical significance at p = 0.10 or less. Model was adjusted for the main effects of contracting type and time and covariates, including patient volume, facility type, distance of facility from province center, region, and conflict. Positive numbers mean the CO facilities achieved greater improvements than did CI facilities. FIGURE 10B. Percent of average annual changes in health-systems performance by type of contracting, 2011–2016 (Reference: Contracting-In) * 9 8.4 8 7 6 5 4 3.0 3 2.2 2 1.6 0.8 1 0 –1 –0.2 –0.5 Functioning Drugs & vaccines Infrastructure Patient physical Patient Female health Provider equipment availability assessment counseling worker knowledge Note: *Red values indicate statistical significance at p = 0.10 or less. Model adjusted for the main effects of contracting type and time and covariates, including patient volume, facility type, distance of facility from province center, region, and conflict. Positive numbers mean the CO facilities achieved greater improvements than did CI facilities. 14 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES availability of drugs increased to a far greater extent in CO facilities than in CI facilities over this same period. Even after controlling for confounders, drug availability increased on average 8.4 percent higher per year over 2011-2016 in CO facilities as compared to CI facilities. All findings from the contracting-model comparisons must take on board an important caveat: that CI provinces are much closer to Kabul and they are smaller than most CO provinces. This makes CI facilities easier to staff, supply, and manage than CO facilities and, thus, it is also easier to improve coverage in these provinces. The analysis methods cannot control for these advantages, which are likely to bias findings in favor of CI provinces. The CO model performed well in highly insecure and remote settings, and may present benefits over CI for such settings. Resilience of service delivery to insecurity seems to reflect NGO strategies, notably links with local communities and stakeholders. NGOs assess local situations and develop strategies to maintain service delivery in insecure areas. In the health-services study, links with local communities and stake- holders were identified as a key potential driver of resilience to insecurity in service delivery. NGOs recruit staff from local communities and build relationships with local powerbrokers. Such strategies enable them to continue delivering services in difficult contexts where there might be few alternative sources of medical services. The CO approach has clearly performed well in settings of high and escalating insecurity, and the ability of NGOs to respond quickly and with flexibility may explain good CO performance. Since CI provinces are generally more secure than CO provinces, no evidence is currently available on the resilience of the CI model in highly insecure settings. The CO approach may have intrinsic benefits that explain these findings, notably nimble recruitment, timely salary payments, flexibility with staff pay, and flexible/decentralized procurement. In addition, NGOs may be better able to access and deliver services in more insecure areas and may have better mobility. International reviews of CO on the use of health services also find that the CO approach is effective in low and middle-income countries, particularly in underserved areas and post-conflict settings. A recent systematic Cochrane review of the impact of CO in low and middle-income countries (Lagarde and others2009) finds that CO is an effective option, particularly in settings where governments may have had difficulty reaching populations. A literature review focused on contracting for primary care and nutrition services with broader inclusion criteria (Loevinsohn and others 2005) also concludes that contracting approaches, whether contracting for service delivery (or CO) or management contracting (or CI), have achieved impressive and rapid results in terms of scaling up service delivery. THE AFGHANISTAN HEALTH SERVICES STUDY 15 POLICY RECOMMENDATIONS: THE WAY FORWARD A fghanistan’s investments in health have largely shown good results, especially as compared to other similarly placed regions and countries. Health is a foundational investment in a nation’s human capital and in sustainable and inclusive economic growth: healthy children do better in school and healthy adults can more effectively participate in economic activity. Maintaining progress on health outcomes in Afghanistan will require building and expanding on the approaches that have already been tried successfully, as well as innovating further to account for continuing and often escalating inse- curity. Below are some learnings and recommendations based on this research. Both the Contracting-Out and Contracting-In models can be improved to increase performance and resilience. The CO approach has clearly performed well in settings of high and esca- lating insecurity, as well in remote provinces. This review found, as have others on Afghanistan, that the most successful approaches tend to maximize provider autonomy. This experience also suggests that going forward, embedding services closer to communities and strengthening ties with and accountability to local communities would be of great benefit. Prior research in Afghanistan on the impact of the Contracting-out model on service utiliza- tion and quality, using health-facility survey data, indicates three key factors in delivering results. These include robust and independent monitoring, coupled with a high degree of provider autonomy and credible links between payments to NGOs and performance. (Arur 2008). These previous studies into the differences among contracting-out models, as implemented with funding from the World Bank, the European Union, and the United States Agency for International Development (USAID) in Afghani- stan, found that, by contrast, additional resources without these elements failed to deliver greater improve- ments than in areas without any additional interventions. The Afghanistan health sector generates a wealth of data, which could be better used to drive performance improvements. These include third-party evaluation, survey data, and data generated by routine reporting systems, which could be used more extensively by the MOPH and the Provincial Health Departments to actively drive improvements in performance in both CO and CI areas. Greater effort could be put into ensuring better data quality and survey representativeness. There is also the potential to expand the role of Provincial Health Departments to provide technical support to improve service delivery and decision-making, rather than limiting themselves to their more narrowed current focus on coordination and monitoring. In addition, the involvement of MOPH technical departments in monitoring service delivery could be strengthened. 17 Effective purchasing of health services is key: this involves a greater focus on outputs and outcomes. In general, effective purchasing of health services is more critical to delivering better health results and improving value from health spending than the question of public or private ownership of health service providers. The fundamental building block for this is the availability of good performance data and purchaser capacity to use the data to better oversee provider performance. Strengthening citizen accountability and monitoring could improve both CO and CI per- formance. Findings on the trends of health-systems performance improvement indicate that the Afghan health system has done very well at the level of client and community engagement. A key finding from this study is that links to communities may explain conflict resilience: increasing citizen involvement in monitoring the delivery of services may be a promising approach, both to build conflict resilience in service delivery and as a part of a broader agenda of state-building. Rigorous research from other settings also points to the demonstrated value of community scorecards and citizen engagement in improving service delivery (Nyqvist and others 2017). For example, going forward, it may be worth- while to test innovative approaches that enable service beneficiaries to collect performance data as a complement to existing monitoring data sources, particularly in highly insecure areas. All reviews discussed here underscore the importance of robust evaluation and of results monitoring, as well as a focus on outputs and outcomes, rather than inputs, tends to yield better results. In light of this, it is important to shift back to true lump-sum budgets for con- tracted NGOs. The current contracts given to NGOs are lump-sum in theory; however, in practice, many NGOs say they often have to seek permission from the MOPH to transfer funds between line items, a cumbersome and time-consuming process. This is troubling, given the known benefits of provider autonomy to deliver good results, as long as providers are held accountable for their performance, as is the case with current contracting models in Afghanistan. Substantially greater improvements in pharmaceutical and vaccine availability in CO facilities points to the importance of continuing decentralized procurement and supply chains. At the same time, there is a need to oversee the quality of medical drugs through surveys and other approaches, such as spot checks to independently assess whether drugs available at service delivery points meet quality standards. 18 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES REFERENCES Advancing Partners & Communities. 2014. Country Profile: Afghanistan Community Health Programs. Arlington, VA: Advancing Partners and Communities. Afghanistan 2015 Demographic and Health Survey Available at: http://dhsprogram.com/pubs/pdf/ SR236/SR236.pdf. Agrasada, GV, J Gustafsson, E Kylberg, and U Ewald. 2005. “Postnatal peer counseling on exclu- sive breastfeeding of low-birthweight infants: a randomized, controlled trial.” Acta Paediatr. 94: 1109–1115. doi: 10.1080/08035250510025752. Akseer, N, AS Salehi, et al. 2016. “Achieving maternal and child health gains in Afghanistan: a count- down to 2015 country case study.” Lancet Global Health 4 (6): e393–413. Akseer, N, Z Bhatti, A Rizvi, AS Salehi, T Mashal, and ZA Bhutta. 2016. “Coverage and inequalities in maternal and child health interventions in Afghanistan.” BMC Public Health 16 (2): 797. Alkema, L., et al. 2016. “Global, regional, and national levels and trends in maternal mortality between 1990 and 2015, with scenario-based projections to 2030: a systematic analysis by the UN Maternal Mortality Estimation Inter-Agency Group.” Lancet 387 (10017): 462–474. Amudhan, S, K Mani, SK Rai, CS Pandav, and A Krishnan. 2013. “Effectiveness of demand and supply side interventions in promoting institutional deliveries—a quasi-experimental trial from rural north.” India Int J Epidemiol 42: 769–780. Arur, A. 2008. “Contracting for health services in Afghanistan-an analysis of changes in service use and quality of care.” Ph.D. Dissertation, Johns Hopkins University. Arur, A, D Peters, P Hansen, MA Mashkoor, LC Steinhardt, and G Burnham. 2010. “Contracting for Health Services and Curative Care Use in Afghanistan between 2004 and 2005.” Health Policy and Planning 25. Bailey, S, K Savage, and S O’Callaghan. 2008. Cash transfers in emergencies: A synthesis of World Vision’s experience and learning. A report commissioned by World Vision International. Monrovia, CA: World Vision International. Bailey, S, and K Hedlund. 2012. The impact of cash transfers on nutrition in emergency and transitional contexts: a review of the evidence. HPG Commissioned Reports. London, UK: Overseas Development Institute. Bari, S, I Mannan, MA Rahman, GL Darmstadt, MHR Seraji, AH Baqui, S El Arifeen, SM Rahman, SK Saha, NU Ahmen, S Ahmed, M Santosham, RE Black, and PJ Winch. 2006. “Bangladesh 19 Projahnmo-II Study Group. Trends in Use of Referral Hospital Services for Care of Sick New- borns in a Community-based Intervention in Tangail District.” J Health Popul Nutr 24: 519–529 Berg, LB. 2004. Qualitative research methods for the social science (5th ed.). Boston: Pearson Education. Bhutta, ZA. 2002. “Children of war: the real casualties of the Afghan conflict.” BMJ 324: 349. Bhutta, ZA, AK Yousafzai, and A Zipursky. 2010. “Pediatrics, War, and Children.” Current Problems in Pediatric and Adolescent Health Care 40 (2): 20–35. http://doi.org/10.1016/j.cppeds.2009.12.004. Bhutta, ZA, WJ Keenan, and S Bennett. 2016. “Children of war: urgent action is needed to save a gener- ation.” Lancet 388: 1275–1276. Boerma, JT, J Bryce, Y Kinfu, H Axelson, and CG Victora. 2008. “Mind the gap: equity and trends in coverage of maternal, newborn, and child health services in 54 Countdown countries.” Lancet 371 (9620): 1259–1267. Brazier, A. 2015. Afghan Community Engagement Project – Building community capacity to better under- stand and access primary health care services. Melbourne, Australia: South Eastern Melbourne Medi- care Local. http://www.enliven.org.au/sites/default/files/Afghan%20Community%20Engagement %20%26%20Health%20Literacy%20Project%20Final%20Report%20-%20SEMML%202015.pdf. Centre for Research on the Epidemiology of Disasters CRED. 2013. People Affected by Conflict: Human- itarian needs in numbers. Charmaz, K. 2006. Constructing grounded theory: A practical guide through qualitative analysis. Thousand Oaks, CA: Sage. Chowdhurym, AM, M Aminul Alam, and J Ahmed. 2006. “Development knowledge and experience: from Bangladesh to Afghanistan and beyond.” Bulletin of the World Health Organization 84 (8): 677–81. Coleman, I, and GT Lemmon. 2011. “Maternal Health in Afghanistan: Improving Health and Strength- ening Society.” Working Paper, New York, NY: Council on Foreign Relations. Cooper, PJ, M Tomlinson, L Swartz, M Landman, C Molteno, A Stein, K McPherson, and L Murray. 2009. “Improving quality of mother-infant relationship and infant attachment in socioeconomically deprived community in South Africa: randomised controlled trial.” BMJ (Online) 338: 997. Cottingham, J, C García-Moreno, and C Reis. 2008. “Sexual and reproductive health in conflict areas: The imperative to address violence against women.” BJOG: An International Journal of Obstetrics and Gynaecology 115 (3): 301–303. http://doi.org/10.1111/j.1471-0528.2007.01605.x. Creswell, JW. 2007. Qualitative inquiry and research design: Choosing among five traditions (2nd ed.). Thousand Oaks, CA: Sage. Creswell, JW. 2013. Qualitative inquiry and research design: Choosing among five approaches. Los Angeles, CA: Sage. Denzin, NK, and YS Lincoln, eds. 2005. The Sage handbook of qualitative research. Thousand Oaks, CA: Sage. Edward, A, C Branchini, I Aitken, M Roach, K Osei-Bonsu, and SH Arwal. 2015. “Toward universal coverage in Afghanistan: a multi-stakeholder assessment of capacity investments in the community health worker system.” Social Science & Medicine 145: 173–83. Engineer, CY, E Dale, A Agarwal, A Agarwal, O Alonge, A Edward, S Gupta, HB Schuh, G Burnham, and DH Peters. 2016. “Effectiveness of a pay-for-performance intervention to improve maternal and child health services in Afghanistan: a cluster-randomized trial.” International Journal of Epidemiology 45 (2): 451–459. 20 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES European Union. 2005. The National Risk and Vulnerability Assessment. https://www.wfp.org/content/ afghanistan-national-risk-and-vulnerability-assessment-2005-2007. ———. 2009. The National Risk and Vulnerability Assessment 2007–08. http://documents.wfp.org/stellent/ groups/public/documents/ena/wfp213398.pdf?iframe. ———. 2014. The National Risk and Vulnerability Assessment 2011–12. http://www.af.undp.org/content/ dam/afghanistan/docs/MDGs/NRVA%20REPORT-rev-5%202013.pdf. Ghobarah, HA, P Huth, and B Russet. 2004. “The post-war public health effects of civil conflict.” Soc Sci Med 59 (4): 869–884. Gilmore, B, and E McAuliffe. 2013. “Effectiveness of Community health workers delivering preven- tive interventions for maternal and child health in low- and middle-income countries: a systematic review.” BMC Public Health 13: 847. doi: 10.1186/1471-2458-13-847. Glesne, C. 1999. Becoming qualitative researchers: An introduction (2nd ed.). New York, NY: Longman. Grittner, MA. 2013. “Results-based Financing: Evidence from performance-based financing in the health sector.” Discussion paper, Deutsches Institut für Entwicklungspolitik. Guba, EG and YS Lincoln. 1989. Fourth generation evaluation. Thousand Oaks, CA: Sage. ———. 1994. “Competing paradigms in qualitative research.” In Qualitative research in nursing (3rd ed.) edited by I Holloway and S Wheeler. Oxford, UK: Blackwell Science. Hall, S. 2015. “Improving cash-based interventions Multipurpose cash grants and protection: Enhanced Response Capacity Project 2014–2015. The Impact of Cash Transfer Programmes on Protection Outcomes in Afghanistan.” Report commissioned by Norwegian Refugee Council (NRC) and UN Refugee Agency. ———. 2015. “A practical guide for practitioners of cash-based interventions in Afghanistan.” Report commissioned by Norwegian Refugee Council (NRC), UN Refugee Agency and Humanitarian Aid and Civil Protection. Haver, J, W Brieger, J Zoungrana, N Ansari, and J Kagoma. 2015. “Experiences engaging community health workers to provide maternal and newborn health services: Implementation of four programs.” International Journal of Gynecology & Obstetrics. 130: S32–39. Health Policy Project. 2015. A Health Insurance Feasibility Study in Afghanistan: Learning from Other Countries, a Legal Assessment, and a Stakeholder Analysis. Washington, DC: Futures Group, Health Policy Project. Hill, Z, M Dumbaugh, L Benton, K Källander, D Strachan, A ten Asbroek, J Tibenderana, B Kirkwood, and S Meek. 2014. “Supervising community health workers in low-income countries–a review of impact and implementation issues.” Glob Health Action 7 (1). doi:10.3402/gha.v7.24085. Huber, D, N Saeedi, and AK Samadi. 2010. “Achieving success with family planning in rural Afghan- istan.” Bulletin of the World Health Organization 88 (3): 227–31. Islamic Transitional Government of Afghanistan Ministry of Health. 2003. Policy on Community Based Health Worker (CHW). Jabbour, S. 2014. “Health and contemporary change in the Arab world.” Lancet 383 (9915): 477–479. http://doi.org/10.1016/S0140-6736(13)62567-2. Johns Hopkins School of Public Health. 2004–2016. BSC reports. Baltimore, MD: Johns Hopkins, School of Public Health. ———. Afghanistan Health survey 2012–13. Baltimore, MD: Johns Hopkins School of Public Health. THE AFGHANISTAN HEALTH SERVICES STUDY 21 Kruk, ME, LP Freedman, GA Anglin, and RJ Waldman. 2009. “Rebuilding health systems to improve health and promote statebuilding in post-conflict countries: a theoretical framework and research agenda.” Soc Sci Med 70 (1): 89–97. doi: 10.1016/j.socscimed.2009.09.042. Kvale, S. 1996. Interviews: An introduction to qualitative research interviewing. London, UK: Sage. KIT Royal Tropical Institute. 2015. An Impact Evaluation of the Results-based Financing Intervention in Afghanistan. FINAL REPORT 2015. Amsterdam, the Netherlands: KIT Royal Tropical Institute. http://www.kit.nl/health/wp-content/uploads/sites/4/2016/09/RBF-IE-2015-Final-Report.pdf. Lagarde, M, and N Palmer. 2009. “The impact of contracting out on health outcomes and use of health services in low and middle-income countries.” Cochrane Database of Systematic Reviews 4 (CD008133). doi: 10.1002/14651858.CD008133. Lin, A, and AS Salehi. 2013. “Stimulating demand: effects of a conditional cash transfer programme on increasing maternal and child health-service utilisation in Afghanistan, a quasi-experimental study.” Lancet 381: S84. Liu, L, S Oza, D Hogan, et al. 2016. “Global, regional, and national causes of under-5 mortality in 2000–15: an updated systematic analysis with implications for the Sustainable Development Goals.” Lancet 388 (10063): 3027–3035. http://dx.doi. org/10.1016/S0140-6736(16)31593-8. Lincoln, YS, and EG Guba. 2000. Paradigmatic controversies, contradictions, and emerging confluences. In Handbook of qualitative research, edited by NK Denzin and Y.S Lincoln, 163-188. Thousand Oaks, CA: Sage. Loevinsohn, B, and A Harding. 2005. “Buying results? Contracting for health service delivery in developing countries.” Lancet 366: 676–681. Mayhew, M, P Ickx, H Stanekzai, T Mashal, and W Newbrander. 2014. “Improving nutrition in Afghanistan through a community-based growth monitoring and promotion programme: A pre– post evaluation in five districts.” Global public health 9 (sup1): S58–75. Merriam, S. 2009. Qualitative research: A guide to design and implementation. San Francisco, California: Jossey-Bass. Ministry of Public Health Afghanistan. 2011. Afghanistan National Health Workforce Plan 2012–16. Kabul, Afghanistan: Ministry of Public Health Afghanistan. Mowafi, H. 2011. “Conflict, displacement and health in the Middle East.” Global Public Health 6 (5): 472–487. http://doi.org/10.1080/17441692.2011.570358. Najafizada, SA, R Labonté, and IL Bourgeault. 2014. “Community health workers of Afghanistan: a qualitative study of a national program.” Conflict and Health 8 (1): 1. Nyqvist, M, D de Walque, and J Svensson. 2017. “Experimental evidence on the Long-run Impact of Community-Based Monitoring.” American Economic Journal: Applied Economics 9 (1): 33–69. Patton, MQ. 2002. Qualitative research and evaluation methods (3rd ed). Thousand Oaks, CA: Sage Publication. Perry, H, R Zulliger, K Scott, D Javadi, J Gergen, and K Shelley. 2014. Case studies of large-scale commu- nity health worker programs: examples from Afghanistan, Bangladesh, Brazil, Ethiopia, India, Indonesia, Iran, Nepal, Pakistan, Rwanda, Zambia and Zimbabwe. Developing and strengthening community health worker programs at scale: a reference guide and case studies for program managers and policymakers. Washington, DC: Maternal and Child Health Integrated Program (MCHIP). Perry, HB, R Zulliger, and MM Rogers. 2014. “Community health workers in low-, middle-, and high-income countries: an overview of their history, recent evolution, and current effectiveness.” Annual review of public health 18 (35): 399–421. 22 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES Rao, KD, H Waters, L Steinhardt, S Alam, P Hansen, and AJ Naeem. 2009. “An experiment with community health funds in Afghanistan.” Health Policy and Planning 24 (4): 301–311. Reichenbach, L, and SN Shimul. 2011. “Sustaining health: the role of BRAC’s community health volun- teers in Bangladesh, Afghanistan and Uganda.” Dhaka, Bangladesh: BRAC Research and Evaluation Division. Richards, L. 2000. Using NVivo in qualitative research (2nd ed.). Melbourne, Australia: QSR International. Robertson, L, P Mushati, JW Eaton, et al. 2013. “Effects of unconditional and conditional cash transfers on child health and development in Zimbabwe: a cluster-randomised trial.” Lancet 381: 1283–1292. Samuel Hall Consulting. 2014. “Humanitarian Assistance through Mobile Cash Transfer in North- ern Afghanistan: An Evaluation of a DFID Pilot Project in Faryab, Jawzjan, and Samangan.” London, UK: Department for International Development. Save the Children. 2014. State of the World’s Mothers 2014: Saving Mothers and Children in Humanitarian Crises. London, UK: Save the Children. Retrieved from www.savethechildren.org. Sheth, M, and M Obrah. 2004. “Diarrhea prevention through food safety education.” Indian J Pediatr 71: 879–882. doi: 10.1007/BF02830824. Stake, RE. 1995. The Art of Case Study Research. Thousand Oaks, CA: Sage Publications. Standing, G. “How cash transfers boost work and economic security.” Trabajo preliminar, 58. Strauss, A, and J Corbin. 1990. Basics of qualitative research: Grounded theory procedures and techniques. Newbury Park, CA: Sage. UNFPA. Mid term review of FHH model Afghanistan. New York, NY: United Nations Population Fund. ———. 2014. State of Afghanistan’s Midwifery 2014. New York, NY: United Nations Population Fund. ———. 2016. Humanitarian Action 2016. New York, NY: United Nations Population Fund. Overview http://www.safebirthevenhere.org/sites/default/files/pub-pdf/16-150_UNFPA_Humanitar- ian_2016_Overview_Final_Sheet_Final_Web_version.pdf. UNICEF. 2010. MICS. New York, NY: United Nations International Children’s Emergency Fund. http://www.cso.gov.af/Content/files/AMICS-Jun24-2012-FINAL.pdf. ———. 2011. UNICEF Annual Report 2010. New York, NY: United Nations International Children’s Emergency Fund. ———. 2013. National Immunization Coverage Survey Afghanistan. New York, NY: United Nations Inter- national Children’s Emergency Fund.UNHCRC. 2012. An Introduction to Cash-Based Interventions in UNHCRC Operations. New York, NY: United Nations High Commissioner for Refugees. ———. 2013. National Nutrition Survey. Afghanistan 2013. New York, NY: United Nations International Children’s Emergency Fund. http://reliefweb.int/sites/reliefweb.int/files/resources/Report%20 NNS%20Afghanistan%202013%20( July%2026-14).pdf. ———. 2015. Assessing the Community Health Worker Role in the Polio Eradication Initiative’s Social Mobilisation Strategy. A report for the Afghanistan Ministry of the Public Health. New York, NY: United Nations International Children’s Emergency Fund. UNICEF. 2003. MICS. New York, NY: United Nations International Children’s Emergency Fund. http://catalog.ihsn.org/index.php/catalog/746. USAID. Afghanistan Demographic and Health Survey 2015. Central Statistics Organization. Minis- try of Public Health. Rockville, Maryland: The DHS Program, ICF International. https://www. dhsprogram.com/pubs/pdf/PR77/PR77.pdf. ———. 2012. World Vision Afghanistan. USAID Title II Multi-Year Assistance Program. Health and Livelihoods Initiative in Ghor. End of Project Evaluation Report. THE AFGHANISTAN HEALTH SERVICES STUDY 23 Waldman, R, L Strong, and A Wali. 2006. Afghanistan’s health system since 2001: condition improved, prognosis cautiously optimistic. Kabul, Afghanistan: Research and Evaluation Unit. Witvorapong, N, and AI Foshanji. 2016. “The impact of a conditional cash transfer program on the utilization of non-targeted services: Evidence from Afghanistan.” Social Science & Medicine 152: 87–95. World Bank. 2009. Taking stock: World Bank experience with results-based financing (RBF) for health. A World Bank Study. Washington, DC: World Bank. ———. 2010. Getting health results in Afghanistan. A World Bank Study. Washington, DC: World Bank. ———. 2011. Setting Targets in Health Nutrition and Population Projects. A World Bank Study. Wash- ington, DC: World Bank. http://siteresources.worldbank.org/HEALTHNUTRITIONAND POPULATION/Resources/281627-1095698140167/TargetSettinginHNPProjects.pdf. ———. 2013. Using Results-Based Financing to Achieve Maternal & Child Health. A World Bank Study. Washington, DC: World Bank. ———. 2014. Critical Administrative Constraints to Service Delivery: Improving Public Services in Afghani- stan’s Transformational Decade. A World Bank Study. Washington, DC: World Bank. ———. 2015. Verification of Performance in Results-Based Financing (RBF): The Case of Afghanistan. A World Bank Study. Washington, DC: World Bank. ———. 2017. Social Service Delivery in Violent Contexts: Achieving results against the Odds. A World Bank Study. Washington, DC: World Bank. World Health Organization. 2015. Humanitarian Health Action. Geneva, Switzerland: World Health Organization. http://www.who.int/hac/crises/ssd/releases/who_suistainable_development_ goals/en/. Yin, RK. 2003. Case study research: Design and methods (3rd ed). Thousand Oaks, CA: Sage. ———. 2009. Case study research: Design and methods. Applied social research methods series. (4th ed). Thousand Oaks, CA: Sage You, D, et al. 2015. “Global, regional, and national levels and trends in under-5 mortality between 1990 and 2015, with scenario-based projections to 2030: a systematic analysis by the UN Inter-agency Group for Child Mortality Estimation.” Lancet 386 (10010): 2275–2286. 24 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES APPENDIX: HEALTH SYSTEMS PERFORMANCE DOMAINS The health systems performance domains examined in this study correspond to those used by the Ministry of Public Health to monitor the Basic Package of Health Services delivered by contracted NGOs. They include the following: AFGHANISTAN HEALTH SECTOR Balanced Scorecard 2004 – 2016 2004–2010 2011–2016 Domain A: Client and Community Overall Patient Satisfaction xx 1 Patient Perception of Quality Index xx Overall Client Satisfaction and Perceived Quality-of-Care Index xx Written Shura-e-sehie activities in community xx 2 Community Involvement and Decision-Making Index xx 3 Health Post-Status Index (New) xx Domain B: Human Resources Health-Worker Satisfaction Index xx 4 Revised Health-Worker Satisfaction Index xx 5 Health-Worker Motivation Index xx 6 Salary Payment Current xx xx Staffing Index — Meeting minimum staff guidelines xx 7 Revised Staffing Index — Meeting minimum staff guidelines xx Provider Knowledge Score xx Revised Provider Knowledge Score xx 8 Revised Provider Knowledge Score xx New Provider Knowledge Score xx Staff received training in last year xx 9 Revised Staff received training (in last year) xx (continues on next page) 25 AFGHANISTAN HEALTH SECTOR Balanced Scorecard 2004 – 2016 2004–2010 2011–2016 Domain C: Physical Capacity Equipment Functionality Index xx 10 Revised Equipment Functionality Index xx Drug-Availability Index xx 11 Pharmaceuticals and Vaccines-Availability Index xx Laboratory-Functionality Index (Hospitals & CHCs) xx 12 Laboratory-Functionality Index (CHCs only) xx Clinical-Guidelines Index xx 13 Revised Clinical-Guidelines Index xx Infrastructure Index xx 14 Revised Infrastructure Index xx Domain D: Quality of Service Provision Patient-History and Physical-Exam Index xx 15 Client-Background and Physical-Assessment Index xx Patient-Counseling Index xx 16 Client-Counselling Index xx Proper sharps disposal xx 17 Universal Precautions xx 18 Time Spent with Client xx xx Domain E: Management Systems HMIS-Use Index xx 19 Revised HMIS-Use Index xx 20 Financial Systems xx 21 Health-Facility-Management-Functionality Index xx Domain F: Overall Mission Outpatient visit concentration index xx 22 New Outpatient visit concentration index xx xx Patient satisfaction concentration index xx 23 New Patient satisfaction concentration index xx xx Note: XX indicates availability of indicator in the respective time period; indicators highlighted in yellow are the same for both periods. 26 IMPROVING ACCESS TO AND QUALITY OF HEALTH SERVICES