article: Lymphatic filariasis (LF) elimination as a public health problem requires the interruption of transmission by administration of preventive mass drug administration (MDA) to the eligible population living in endemic districts. Suboptimal MDA coverage leads to persistent parasite transmission with consequential infection, disease and disability, and the need for continuing MDA rounds, requiring considerable investment. Routine coverage reports must be verified in each MDA implementation unit (IU) due to incorrect denominators and numerators used to calculate coverage estimates with administrative data. IU are usually the health districts. Coverage is verified so IU teams can evaluate their outreach and take appropriate action to improve performance. Mozambique and the Democratic Republic of Congo (DRC) have conducted MDA campaigns for LF since 2009 and 2014, respectively. To verify district reports and assess the declared achievement using administrative data of the minimum 80% coverage of eligible people (or 65% of the total population), both countries conducted rapid probability surveys using Lot Quality Assurance Sampling (LQAS) (n = 1102) in 2015 and 2016 in 58 IU in 49 districts. The surveys identified IU with suboptimal coverage, reasons residents did not take the medication, place where the medication was received, information sources, and knowledge about diseases prevented by the MDA. LQAS identified four inadequately covered IU triggering district team performance reviews with provincial and national teams and district retreatment. Provincial estimates using probability samples (weighted by populations sizes) were 10 and 17 percentage points lower than reported coverage in DRC and Mozambique. The surveys identified: absence from home during annual MDA rounds as the main reason for low performance and provided valuable information about pre-campaign and campaign activities resulting in improved strategies and continued progress towards elimination of LF and co-endemic Neglected Tropical Diseases.
  Five Neglected Tropical Diseases (NTDs), lymphatic filariasis (LF), onchocerciasis, schistosomiasis, trachoma and soil transmitted helminths, have been prioritised by the World Health Organisation (WHO) for elimination as public health problems by 2020. They were chosen due to their high prevalence, resulting morbidity and disability and the susceptibility of the parasites, causing the diseases, to efficient preventive treatment through mass drug administration (MDA) [1]. Lymphatic Filariasis is endemic in 32 countries in Africa with a population of more than 343 million people [2] living at risk. The infection is acquired in childhood. The adult parasite causes severe damage to the lymphatic system, which in 30% of the infected people, results in long-term disability [3]. Estimates of the morbidity caused by LF are complex due to stigma associated with the disease. Despite a suspected reduction in LF prevalence due to MDA, in 2013 there were 19. 43 million cases of hydrocele and 14. 41 million cases of Lymphedema attributed to the parasite Wuchereria Bancrofti, which is more prevalent in Africa [4]. LF is, according to the WHO, the second leading cause of long-term disability with an estimated 2. 78 to 5. 09 million DALYs lost per year [5]; in recent review of the Global Burden of Diseases estimated that 25 million DALYs were lost in 2015 despite the elimination activities[6]. Adult worms of Wuchereria bancrofti, live in people for five to 8-years, producing millions of larvae (microfilaria), which after undergoing transformation in mosquitoes, are transmitted to other people. The mainstay of the elimination campaign is the destruction of the microfilaria by the use of preventive medication. In African countries LF is frequently co-endemic with Onchocerciasis. In these countries the recommended elimination strategy is annual treatment of the eligible population (population living in the endemic districts over 5-years of age) with one dose of Ivermectine and Albendazole. In areas in Western Africa with co-endemic Loa-loa, and the possibility of serious encephalopathy when Ivermectine is administered[7], WHO recommended treatment with Albendazole every six months for five consecutive years. Elimination of LF as a public health problem requires a minimum of five consecutive annual MDA rounds with effective coverage, which is defined by the WHO as administration of medication to at least 65% of the total population. As the eligible population is the population over 5-years of age, at least 80% coverage of the eligible population needs to be reached (80% coverage x 80% of population is eligible = 64% total population rounded to 65% [1,8]. As reaching optimal coverage is the key to LF elimination [9], we use 80% medication coverage of the eligible population as the minimum target to be achieved by all IU. We recognize high transmission settings may require higher coverage because of the reservoir of parasites in the population not taking medication or who are not eligible for it, and the persistence of microfilaremia in populations not treated [10,11] due to co-endemicities. Reported coverage typically is the number of people registered as treated during the campaign (numerator) divided by population estimate based on a recent census (as is the case in Mozambique) or by a census of houses prior to the start of an MDA campaign (as in DRC). Both methods can produce errors both in the numerator and the denominator. In Mozambique medication is administered in “concentrações” or distribution points by mobile and fixed teams with a daily district target of 600–1500 persons based on estimations of the National Institute of Statistics. Administrative data is collected (age, gender and number of pills provided to each person) by one team member (usually the community health worker), as the treatment proceeds. It is then aggregated at the end of each distribution day and handed to the district data manager in a “daily reporting form. ” Sometimes these forms are compared with other data sources showing medication consumption. These daily distribution data are added to the campaign database and presented to the district management team. District data is sent to the province and national programmes. Campaigns are 5-days. At their end the district team send a final distribution report to provincial and national managers along with a summary of the medication received and administered. In DRC, medication is administered house-to-house by volunteer Community Drug Distributors (CDDs), who treat people in 20 houses (in towns this number increases to 100 houses); they are supervised by the “Infirmier titulaire” of the nearest health care centre. Although they complete a census of the population before the campaign, they may under-report “registration” and over-report coverage to avoid going back to houses with absent residents. In DRC the campaign follows the community-based Ivermectine distribution strategy in which each community conducts their campaign at their own time, which means that despite efforts to shorten the time, campaigns can take as long as 3-months to complete in one province. CDD records pass sequentially to sub-districts, districts, provinces and finally to the central level. This process can take several months as data are aggregated, cleaned and analysed at each level. While effort has gone into improving routine health information systems, and the hope is that they will eventually provide more accurate health information, several studies demonstrate that they remain inaccurate[12,13]. Recognising these short comings, WHO has requested that endemic countries conduct household surveys to validate the reported MDA coverage rate and support remedial action where microfilaremia persists despite reports of achieved coverage targets. Our literature search of LF elimination activity indicates that household survey data are scarce; and often only presented in annual meetings [14]. One report suggests using community monitoring to validate reported national coverage [15]. The lack of capacity and verified results at the IU level (typically districts) are major obstacles to obtaining useful results for improvement. Mozambique and the DRC are both endemic for LF. Mozambique has 115 districts endemic for LF and due to co-endemicity with Onchocerciasis has undertaken MDA with Ivermectin (IVM) and Albendazole (ALB) since 2009. DRC has 245 LF endemic districts and started MDA in 2014 with IVM and ALB for co-endemic LF-Onchocerciasis districts, and in 2015 with ALB alone twice a year in Kongo Central Loa-LF co-endemic areas [16]. We worked with the National NTD programmes in Mozambique and DRC to adapt Lot Quality Assurance Sampling (LQAS) methods to verify MDA coverage at the district and sub-district level to rapidly detect sub-optimal coverage, and provide relevant information to the IU teams to improve strategies for distribution in their areas of operation. LQAS was originally developed to assess industrial batch production in the 1920s[17–19], and subsequently adapted in the mid-1980s to improve primary health care services[20,21], This study demonstrates its utility for LF programme improvement, and exhibits the error present in administrative data.
  In Mozambique, two-weeks after the MDA, 21 data collectors and nine supervisors were trained for four days prior to surveying 21 SA in four provinces during 1–9 July 2016. In the DRC, 3 supervisors and 9 surveyors for Kongo Central were trained in Matadi in 2015. In 2016 40 data collectors and 10 supervisors were trained shortly after the MDA in five locations after training of trainers in Kinshasa from 14–17 July 2016 to facilitate this roll out, then replicated in the three capitals of the Kasai provinces (Kananga, Tshikapa and Mbuji-Maji) and in Matadi for Kongo Central. Data collection occurred immediately following the training. LSTM supervisors were deployed in each province to provide support to the national and provincial supervisors who verified the selection process and the interviews before the questionnaire was sent to the database. Data were collected using the following protocol. The sampling frame consisted of the list of villages with their population size supplied by the National Programs. Villages were selected using probability proportional to size. Upon arriving at the village, the enumerator visited the community leader to explain the purpose of the survey. With his help they constructed a hand drawn map of the community which was divided into segments of approximately the same size. One segment was selected randomly with a random number table [22]. The enumerator constructed a map of the segment and listed the houses, one of which was selected randomly and used as a reference house. In order to reduce the likelihood that a house was not included in the map and had zero probability of selection, the next nearest house walking distance to the door of the reference house became the starting point for the first interview. A list of eligible people was constructed and one person randomly selected with a random number table. If the person was present and gave consent the interview was completed. If the person was ≤12 years of age but ≥5-years, the mother or the father responded for the child, but in the presence of the child. If the selected person was not present but was in the village, the enumerator sent someone to bring him/her to the house. If the selected person was not in the village but returning in about 30 minutes the enumerator waited for him/her. If the person was not returning within 30 minutes and a family member had seen him/her take the medication then the family member responded. If it was possible for the enumerator to contact her/him by phone then the responses were corroborated. The enumerator returned in the evening to the home in the case the person was returning at night and information had not yet been corroborated. If the person was not returning and not able to be contacted then that person was not included in the sample. The house with the closest door to the current house’s front door was selected and the selection process for an eligible respondent was restarted. In Mozambique and DRC rural areas daily agricultural work begins at sunrise and by about 10AM most family members return to their homes. In urban areas or towns eligible people leave for work in early morning. Interviewers arrive in villages and towns at the time that people were typically at home, either mid-day in villages or very early or very late in towns. Enumerators used pen/pencil and paper in 2015 and smart phones programmed with Open Data Kit software[23] to record data in 2016. All questionnaires were uploaded daily (or when in a mobile network was available) to a Google cloud database for cleaning and analysis; daily updates and results were sent to the national programmes and the provincial health and medical directors. Data collection in each SA required an average of three-days. The study, from training through analysis and discussion of the results, took three-weeks in Mozambique; four-weeks in the Kasai region of DRC and two-weeks in the Kongo Central province. LQAS analyses were carried out mainly in Excel so that IU teams could to do their own analysis while the authors used SPSS to the complete analysis and to check IU level results. We weighted district SA data by the district SA population sizes for calculation of coverage and 95% confidence intervals.
  In Mozambique, verified provincial coverages were lower than those reported nationally by 6. 5 to 26. 1 percentage points (x¯ = 17. 4, SD = 8. 2). In the DRC, verified provincial coverages were -1. 6 to 27. 5 percentage points (x¯ = 10. 7, SD = 11. 5) lower than those reported (Tables 2 and 3). In Mozambique, IVM and ALB were distributed at the same time; therefore, we report one coverage estimate. Out of 21 SA LQAS classifications, four districts failed to reach the minimum coverage target. Nampula province, whose average endemicity is 53% in all its 23 districts, had 65. 9% (95%CI: ±8. 3%) coverage with three failing districts (Table 2). The remaining failure was in Cabo Delgado province. Two main reasons were given for not taking the medication: absence from home on the day of the campaign (38%), or illness (10%). Lymphoedema (55. 6%) and worms (41%) were the main reasons for taking the medication. Only 58 respondents (14. 5%) reported mild side effects (dizziness) after taking the medication. In 2015, the survey coverage of ALB in the Kongo Central province of DRC was 78. 6% (95% CI: ±6. 5%) vs. 87% reported coverage, with one district failing to achieve the 80% target. A pre-distribution census reached 92% of households contributing to the overestimation of coverage. People not registered in the census were less likely to receive the medication than registered persons. Only 21% of non-registered persons took the medication, versus 84% of those registered. The main reasons for non-registration and not taking the medication were absence from home (50%) and fear of adverse reactions (30%). ALB caused minor side effects in less than 1% of the 573,550 medicated persons reached by the first campaign. In 2016, districts and province health departments applied lessons learned from the first campaign and survey, with emphasis on transmitting medication safety and ensuring CDDs returned to the houses of the absent, no district in Kongo Central was classified as not reaching the target. Overall, 95% of the eligible population was registered, with 97% reported coverage and 90% (95% CI: ±5%) verified coverage (Table 3). While absence from home was still the main reason for not taking ALB (50%), fear of adverse effects was reduced to 13%, due to improvements in provincial and district supervision, social mobilisation and the lack of serious adverse effects in the previous year. For Kasai province, the ALB/IVM verified coverage was 82. 8% (95%CI: ±7. 8%). Coverage of each medication differs indicating that drug distribution took place at two different points in time. All 13 districts and 18 SAs reached their targets, except the district of Lubilanji in the city of Mbuji-Maji which reduced the Kasai Oriental provincial coverage to 72. 8% (95%CI: ±8. 2%), well under the target. (See S1 and S2 Tables for the DRC LQAS results.) In Kasai province, the main reason for not taking the medication was absence from home during the campaign. Although most interviewees knew the reasons for the campaign, Kasai and Kasai Central provincial residents frequently mentioned onchocerciasis and filariasis, and their consequences, as their main reasons for taking the medication. In Kasai Oriental province, treating worms was the primary incentive for taking the medication. Both national programmes reviewed the survey data daily and rapidly reacted to the results. In Mozambique, the decision was to treat again all eligible population in the three districts of Nampula province, reinforce training and support of district teams and improve supervision. In a subsequent LQAS assessment after the repeated campaign none of the three districts were classified as not reaching the 80% eligible population coverage target. Cabo Delgado district was not retreated due to lack of medication and funds. In the DRC, the strategy was to identify and treat individuals not treated during the campaign. Meetings with district and sub-district officers and CDDs were held to review results and treatment registers, identify underperforming sub-districts, reinforce CDD training and supervision, and intensify social mobilization. These actions resulted in the treatment of 12,644 additional people. In a subsequent LQAS survey, previously underperforming sub-districts were classified as reaching the targets for both medications.
  This study has limitations. The LQAS method would have incorrectly classified districts near to but not achieving the 80% eligible population target, as having reached the target. However, a conventional cluster survey may have experienced a similar problem because a 95% confidence interval can have a range of values that are both above and below the coverage target. This assessment interviewed individuals who were present in the village. This could have led to bias as individuals who did not take medication during the MDA would not have been included in the sampling. This limitation is one that is shared by other survey methods. This study demonstrated the usefulness of LQAS for routine monitoring and evaluation of national MDA programmes to produce rapid improvements in traditionally weak health systems. These results are consistent with the value of LQAS in other non-MDA programmes[32]. The important contribution for NTD control was to rapidly identify areas likely to have low coverage where transmission would therefore, continue. It provided accurate local evidence permitting immediate feedback to identify service delivery problems[33] that national programmes can use corrective action.
summary: Global elimination of lymphatic filariasis (LF) is achieved through treatment of at-risk populations with annual or bi-annual mass drug administration campaigns. In Africa campaigns need to be completed in 32 countries with 343 million people at risk. The World Health Organisation recommends verification of the campaign’s administrative records using household cluster surveys at least once every 5-years. However, cluster surveys are expensive and usually completed in a few districts only or at sub-national levels. Together with National Programmes in Mozambique and the Democratic Republic of the Congo (DRC) we adapted Lot Quality Assurance Sampling (LQAS) methods to verify campaign coverage because it is relatively inexpensive in comparison to other survey approaches, provides information and facilitates actions at the Implementation Unit (IU) level, which is usually the district. LQAS signals IU whose performance is likely to need improvement because MDA coverage is below the coverage target. Our results show consistently that administrative records over-estimated campaign coverage and did not detect implementation and coverage problems due to errors in numerators and denominators, incorrect reporting, and/or incorrect aggregation of tally sheets. The LQAS verification approach prompted immediate action to remedy coverage shortfalls averting persistent LF transmission and disease, and the costs associated with failed campaigns. Our study demonstrates that a rapid probability sample to verify coverage provides district teams with information after each campaign which can be used for action, and that one coverage survey every 5-years is insufficient for infectious disease elimination in highly endemic settings where achievement of optimal coverage is essential. It also demonstrates that LQAS provides a decentralised assessment, sensitive for detecting and ameliorating programme bottlenecks and can be used to verify MDA in other countries.
keywords: medicine and health sciences
  geographical locations
  census
  parasitic diseases
  ethnicities
  research design
  pharmaceutics
  drug administration
  supervisors
  africa
  research and analysis methods
  public and occupational health
  people and places
  mozambique
  kongo people
  professions
  survey research
  african people
  population groupings
  drug therapy
title: Improved assessment of mass drug administration and health district management performance to eliminate lymphatic filariasis