Are interventions to reduce the impact of arsenic contamination of groundwater on human health in developing countries effective? A systematic review

Abstract

Background

Within developing countries, groundwater provides an alternative drinking source to polluted surface water. However, the presence of arsenic in some groundwater sources has resulted in chronic worldwide poisoning. The aim of this review was to determine the effectiveness of field-based technologies for the removal of arsenic from groundwater in developing countries.

Methods

A structured search strategy was conducted in a range of databases. Titles, abstracts and full texts were screened using pre-defined inclusion criteria. Included studies were quality appraised prior to data extraction. The primary outcome was the percentage of effluent water samples meeting WHO guidelines for arsenic concentrations (≤0.01 mg/L). Secondary outcomes included: (a) arsenic concentrations in effluent water samples meeting the national guideline limit (≤0.05 mg/L), (b) arsenic concentrations in human tissue, and (c) knowledge and attitudes related to the interventions.

Results

Fifty-one reports, evaluating 50 different technologies, were included. Sixty-seven percent (n = 34) of studies were conducted in Bangladesh. Fifty of the included reports were appraised as ‘weak’, with one ‘strong’ report of a randomised-controlled trial.

In summary, the effectiveness of the oxidation and filtration interventions is poor, while the evidence for coagulation, co-precipitation and filtration, subterranean and membrane and electrolytic methods is mixed. Evidence regarding adsorption and zero valent iron interventions is more persuasive with most results suggesting good evidence of effectiveness (i.e. ≥95% of samples with arsenic concentrations ≤0.01 mg/L). In particular, activated alumina and sono/three-kolshi/gagri/pitcher filters have ≥95% of samples meeting national guidelines. Disappointingly, only one study reports excellent evidence of effectiveness: BRAC (2000) for activated alumina (i.e. ≥95% of samples with arsenic concentrations ≤0.01 mg/L).

The success of each technology was highly dependent on context, especially their acceptability to users, a sense of ownership and expectations of women’s roles in society.

Conclusions

Most studies were poorly conducted and reported. Consequently, although some technologies met national guidelines, the evidence-base for decision-making regarding arsenic mitigation technologies at household- and community-level is weak. To improve this situation, primary research needs to be commissioned with adequate sample sizes, testing the impact of key contextual factors, using valid tools for analysis, and meeting standards for completeness of reporting.

Background

Arsenic is now recognised to be one of the world’s greatest environmental hazards, threatening the lives of several hundred million people [1]. Whilst it has been used by humans for thousands of years in medicines and pigments, it is the naturally occurring arsenic, existing in rocks and soils, leaching into underground water which is the concern of this review. This form of arsenic, drawn from the ground by wells and used for drinking, is one of the most toxic and carcinogenic of all the natural groundwater contaminants [1].

Natural arsenic pollution occurs in diverse geological and climatic conditions. Although it occurs most commonly in sands deposited by large rivers, arsenic contaminated groundwater can be found in unconsolidated sediments and sedimentary, igneous and metamorphic rocks ranging from a few thousand to more than a billion years old [1]. As such, 21 countries are now recognised as experiencing arsenic groundwater contamination [2].

Of these 21 countries by far the worst pollution is found in Asia, along a particular band running from Pakistan to Taiwan, referred to as the South and Southeast Asian Belt [1]. The main drinking water in this region is extracted from shallow alluvial aquifers, which provide an alternative to polluted surface water and thereby reduce the incidence of water-borne diseases. However, arsenic is tasteless, odourless and colourless, therefore in areas such as Bangladesh and West Bengal in India, where the groundwater arsenic concentrations frequently exceed the WHO guidelines of 0.01 mg/L more than tenfold, these unacceptably high levels have gone undetected for a number of years [2–4].

Pollution of alluvial aquifers has also resulted in cases of arsenicosis in other countries in Southeast Asia including Vietnam, Nepal, Cambodia and China [5]. While there are few reported occurrences of arsenic contamination in Africa, it may be that the groundwater has simply not been tested.

The health consequences of long term exposure to elevated concentrations of arsenic are severe. Conditions include skin, lung, bladder and kidney cancer as well as pigmentation changes, skin thickening (hyperkeratosis), neurological and circulatory disorders, muscular weakness, loss of appetite and nausea [6]. Furthermore, because the effects of arsenic depend on cumulative exposure, the symptoms are most commonly seen in adults. As symptoms develop, a person’s ability to live a normal life is reduced. Sufferers may become unable to work, severely affecting the welfare of their families. The stigma of arsenic (As) poisoning also gives rise to social impacts such as ostracism and social exclusion [1].

There are three approaches to the mitigation of arsenic groundwater contamination: (i) removing As from groundwater, (ii) developing As-free sources, and (iii) developing surface water sources. Since the intention of this review was to evaluate interventions aimed at reducing the impact of arsenic contamination of groundwater, removal was the focus.

Interventions to reduce arsenic contamination of groundwater can be broadly classified according to the primary process of arsenic removal (see Table 1).

Table 1 Processes to remove arsenic from groundwater (adapted from Ravenscroft et al., 2009)

Objective of the review

Primary question

Are interventions to reduce the impact of arsenic contamination of groundwater on human health in developing countries effective?

The primary question was developed in consultation with AusAID and modified according to feedback received from the Collaboration for Environmental Evidence (CEE) and two external peer reviewers. However, it should be noted that this review is only part of the ‘overall picture’ of decreasing arsenic contamination of drinking water. The following factors are also likely to play an important role, but are not covered by this review:

• 1) Education of people who are exposed to As contaminated drinking water and subsequent behaviour change.

• 2) Exposure to arsenic through consumption of foodstuffs.

• 3) Co-ordination and monitoring of As mitigation strategies.

• 4) Technology choices.

• 5) Level of institutional support to communities and households.

Secondary question

What factors enable or constrain the effectiveness of these interventions in developing countries?

Methods

Searches

The literature search for this review was conducted in two stages:

• 1) A search of databases; and,

• 2) Citation chasing, pearl-growing and web-searching.

Search terms and languages

The search syntax was formulated to use arsenic (the term was truncated arsen* to capture arsenates or arsenates or other species of arsenic prevalent in groundwater [7] and water, or groundwater. This syntax was split into search clusters which were joined with the Boolean connector AND to give items which made reference in the title and/or abstract and/or keyword to (arsen*) AND (water or groundwater). The search was conducted in the English language. Please see Additional file 1 for further details.

In resources with no controlled syntax, or where the specificity of the search was lost given the broad remit of some of the search resources (i.e. Web of Science), we used a population filter to increase the specificity of search returns to developing countries. This filter named not only countries but also populations, and included a cross-check of developing countries, or third world terminology (i.e. under-developed), to maintain sensitivity. The list of named countries was developed from the funder’s list of includable countries (http://www.ausaid.gov.au/ngos/Pages/devel_list.aspx) – which was, in turn, cross-checked with the International Human Development Indicators (http://hdr.undp.org/en/statistics/). The IMF list of developing countries was also consulted. This filter was extensively tested in scoping against known includable studies.

All searching was limited as follows:

Date

1980-current (the period in which arsenic contamination of groundwater became widely recognised and interventions to address the problem were introduced) (Ravenscroft et al., 2009).

Language

Searches were limited to the English language, as early scoping searches indicated that this is the language of publication for scientific studies in countries where arsenic contamination of groundwater is an issue.

A full record of the search approach and searches as run is included in Additional file 1.

Databases

The following databases were searched:

• Assia via CSA

• Aqualine via ProQuest

• Biosis via ISI (Thompson Reuters)

• CAB Abstracts via Ebsco HOST

• Compendex via Engineering Village

• The Cochrane Library via http://www.thecochranelibrary.com

• Embase via OVID

• ERIC via CSA

• GreenFILE via EbscoHost

• HMIC via OVID

• IBSS via CSA

• Inspec via ISI (Thompson Reuters)

• Lilacs via http://regional.bvsalud.org/php/index.php?lang=en

• Medline via OVID

• Medline in Process via OVID

• NTIS via Enginering Village

• Pollution Abstracts via ProQuest

• PsycINFO via OVID

• Scopus via Scopus

• Sociological Abstracts via CSA

• Web of Science (CPCO-S/CPCO-SSH, SSCI) via ISI (Thompson Reuters)

• World Wide Political Science Abstracts (WPSA) via CSA

Searches for grey literature: contacts, internet searches, use of specific search terms or strings, filtering or limitations

The following web-resources, web-sites and organisations of note were searched, alongside conference abstracts (as above), library catalogues and Google, for grey, or difficult to locate, literature [8, 9].

Web-resources

• BL (British library) Direct and British Library Catalogue

• British Library for Development Studies (BDLS)

• Directory of Open Access Journals

• ELDIS

• Evidence-Based Policy in Development Network (EBPDN)

• Global Development Network (GDN)

• Google

• Index to Theses

• JOLIS

• RAPID (Research and Policy in Development)

• R4D Database

• The World Bank

• WHOLIS (World Health Organisation)

• WHO Regional Databases

Organisations of note

• African Development Bank

• African Medical and Research Foundation

• Asian Development Bank

• Australian Aid Agency

• British Geographical Survey

• Canadian International Development Agency

• Centers for Disease Control and Prevention

• Christian Aid

• Danish Development Agency

• Department for International Development

• European Commission

• Fresh Water Action Network

• GTZ (GIZ) Deutsche

• Inter-American Development Bank

• International Rescue Committee

• International Water Management Institute

• IRC (International Rescue Committee) International

• Japan Bank for International Cooperation

• Japan International Cooperation Agency

• Organisations of the United Nations (UNICEF, UNEP, UNDP, UN-HABITAT, UNRISD, FAO)

• Oxfam

• Overseas Development Agency

• Pan American Health Organisation

• Red Cross

• Swedish Development Agency

• US Agency for International Development

• Water and Sanitation Centre

• WaterAid

• World Bank (Office of Evaluation and Development)

• World Health Organisation

Citation chasing

Citation chasing was conducted on items included after full-text screening. Backwards citation chasing was conducted manually through reference scanning of bibliographies. Forwards citation chasing was conducted in Web of Knowledge (ISI Thompson Reuters).

The results from the citation chase were aggregated and de-duplicated against each other and the main review libraries (which contains the items from the main search and which have already been screened). This gave an additional 143 references to be screened. The results from the forwards citation chasing can be found in Additional file 1.

Study inclusion criteria

After the searches had been completed relevant studies were identified through two stages of screening. All titles and abstracts returned by the search strategy were screened by one of three reviewers (with a random sample of 10% being checked by a second reviewer). Where it was not clear from the title and abstract alone if the study met the inclusion criteria, the full-text of the study was retrieved to enable the second stage of screening also conducted by one of three reviewers (with a random sample of 25% being checked by a second reviewer). All disagreements about study inclusion and exclusion were resolved by discussion, and where necessary the involvement of a third reviewer. A kappa analysis was not conducted.

In order to be included, the study had to fulfil the following criteria:

Population (or ‘subject’)

The outcomes of interest involve both groundwater and people, therefore the subjects are either people living in, or groundwater sources in, developing countries (as defined by AusAID; see Additional file 2).

Intervention

A study of any technology (see Table 1) designed to remove or lower arsenic concentration in water intended for human consumption and tested in the community/household (field setting). This does NOT include national or local policy or specific educational interventions.

Comparators

Studies had to include a form of comparison e.g. pre/post comparison of filtered and unfiltered water, comparison with another technology intended to remove or lower arsenic concentration in groundwater, or comparison with no intervention.

Outcomes

All outcomes must be measured in field based studies and include either:

• 1) Arsenic concentration in groundwater intended for human consumption.

• 2) Arsenic concentration in human tissue or body fluids.

• 3) Observation of people’s behaviour relating to technologies intended to remove or lower arsenic concentration in groundwater intended for human consumption.

• 4) People’s knowledge or attitudes relating to technologies intended to remove or lower arsenic concentration in groundwater intended for human consumption.

Since this review was concerned with the viability of interventions during ‘real-life’ scenarios, a distinction was made to include only field tests which involved members of the community, as opposed to being operated solely by researchers.

Study design

Only comparative study designs were included (including, but not limited to, randomised controlled trials, before and after studies, and cross-sectional studies).

Exclusion criteria

Any studies which looked at the following topics were excluded from this review:

• Reduction of As contamination of rice by alternative methods of cooking, water management and irrigation.

• Reduction of As contamination in soil.

• Reduction of As in water by ferns grown in a hydroponic system, as opposed to field study.

• Nutritional supplements/intervention to minimise impact of As.

• Methods of As detection.

• Hydrogeological studies investigating actions which mobilise As.

Interventions such as dugwells, pond sand filters, rain water harvesting mechanisms, well-switching and GIS modelling were also excluded from the review since they do not reduce or remove arsenic from groundwater.

Study quality assessment

The studies included at full text were assessed using the McMaster University Effective Public Health Practice Project quality appraisal tool (http://www.ephpp.ca/tools.html; see Additional file 3). This tool is suitable for use across a wide range of quantitative study designs and has explicit criteria for rating selection bias, study design, confounders, blinding, data collection methods, withdrawal, intervention integrity and analyses as ‘strong’, ‘moderate’, or ‘weak’. Study quality appraisal was conducted by one of three reviewers, with a random sample of 25% checked by a second reviewer. Disagreements were resolved by discussion, with the involvement of a third reviewer if necessary.

Data extraction strategy

Data was extracted from included studies by one of three reviewers using a modified version of a data extraction form designed for use with complex public health studies [10]. Extracted data followed the outcomes described above and included details of the population, type of intervention, and context in which implemented – see Additional file 4. A random sample of 10% of the completed data extraction forms were checked by a second reviewer. Discrepancies were resolved by discussion, with the involvement of a third reviewer if necessary.

Data synthesis and presentation

All measures of arsenic concentration in groundwater are reported as mg/L in this review. All measures of arsenic concentration in human tissue are reported as μg/g creatinine and μg/L urine.

Primary outcomes

The primary outcome is the percentage of effluent water samples, i.e., water samples treated by the intervention, with arsenic concentrations below WHO guidelines (≤0.01 mg/L) [4]. The WHO guidelines are based on ‘safe/acceptable’ levels of exposure for humans, therefore those interventions meeting WHO guidelines are providing safe water for populations. Where data were available, exact 95% confidence intervals (CIs) for the percentage of samples meeting WHO guidelines were calculated using the binomial distribution [11]. The 95% CIs provide a measure of the uncertainty associated with the proportion of samples meeting WHO guidelines. This reflects the number of samples measured in the individual studies.

The results are presented by intervention, with interventions categorised into groupings depending on the primary processes involved.

Secondary outcomes

There are three secondary outcomes: (a) the proportion (and 95% CIs) of effluent water samples with arsenic concentrations below the guideline limit for the country in which the study was conducted (e.g. < 0.05 mg/L in Bangladesh), (b) arsenic concentrations measured in human tissue, and (c) aspects related to acceptance of the interventions.

The primary focus of this review was to establish the effectiveness of interventions to remove arsenic from groundwater. However, the qualitative information also identified in the articles was considered important in providing a context for the effectiveness results and was therefore compiled as a summary.

Overall summary of effectiveness

To aid summarising the effectiveness of the interventions, we define four categories based on the strength of evidence (Table 2).

Table 2 Strength of effectiveness evidence

Arsenic concentrations measured in human tissue are also presented, where such outcomes are measured and reported in the individual studies.

Variations of effectiveness

The design and setting of the technology and the characteristics of the influent water are likely to have a significant impact on the effectiveness of arsenic reduction or removal. These characteristics include [1]:

• 1) Arsenic and iron concentrations in the raw groundwater.

• 2) Cleaning, maintenance and cost of the technology.

• 3) Volume of treated water required (water demand).

Thus, where reported in the individual studies, we have presented and discussed evidence on variation in arsenic removal effectiveness due to these factors. Details on maintenance and flow rate (in terms of L/hr), whether from manufacturer guidance or from evaluation are presented. Costs associated with the technology are reported by the currency and year of the individual study. However, to allow comparison of costs across technologies, all costs have also been converted to Aus$ for the year 2011 using Shemilt (2010) [12].

Synthesis

Formal synthesis of quantitative outcomes across studies, i.e. meta-analysis, was not undertaken due to poor study quality, poor reporting quality and issues of heterogeneity between studies.

The main inhibitor of meta-analysis for this review was heterogeneity in the design and conduct of studies, such as differences in the intervention being assessed and the unit of analysis (samples from different sites, repeat samples from just one site, repeat samples from a number of sites, etc.). The poor quality of study conduct also influenced our decision, as potential biases may be masked in a meta-analysis. In terms of reporting quality, the outcome data required for synthesis could not be extracted for some studies, therefore this information would be lacking from the synthesis.

Overall, conducting a meta-analysis across these studies would have produced results which would have been difficult, if not impossible, to interpret. As many informative texts state, meta-analysis of study results, when studies are diverse or of poor quality, may be meaningless, with any real differences concealed [13–16].

Results

Included studies

The databases were searched from 1980 to August 2011 and forward citation chasing was completed by November 2011. The searches identified 11 457 potentially relevant articles (after de-duplication). Screening by title and abstract revealed a large proportion of the studies were laboratory based and therefore excluded. Three hundred and twenty one papers were requested for examination of full text, of which 44 were included in the review. A further seven articles were identified for inclusion via web searching and forward chasing of bibliographies (Figure 1).

Figure 1

Summary of study selection.

Included study characteristics

Additional file 5 provides a summary of each study detailing the country in which the study was conducted, the size and design of the study, the interventions and outcomes assessed, and an overview of study quality. Details on interventions such as household/community, costs and flow rates are in Tables 3, 4, 5, 6, 7 and 8. Further description of study quality is given in 'Included study characteristics' and Additional file 6. Fifty of the fifty-one included studies were appraised as ‘weak’ using the EPHPP quality appraisal tool, with only one study (a RCT; Milton et al. (2007)) appraised as ‘strong’ [17]. Whilst we recognise the difficulties for decision-makers of using a synthesis of methodologically-weaker studies, we did not exclude studies on the basis of quality as:

• The comparators in the RCT were limited to one includable technology (compared with no intervention);

• From using the EPHPP quality appraisal tool, we were aware that despite it being designed for use with public health rather than clinical studies, non-randomised studies were still likely to receive a ‘weak’ rating’; and

• Non-randomised study designs (such as before/after) were likely to be more appropriate for assessing the effectiveness of interventions to reduce arsenic contamination in water, as this study design:

○ allows the direct comparison of water samples before and after the intervention.

○ makes it less likely that confounding of the comparison by location, season and/or the characteristics of different water sources (such as the chemical composition of water samples) will occur.

Table 3 Summary of costs and flow rates for oxidation and filtration technologies

Table 4 Summary of costs and flow rates for coagulation, co-precipitation and filtration technologies

Table 5 Summary of costs and flow rates for adsorption processes

Table 6 Summary of costs and flow rates for zero valent iron technologies

Table 7 Summary of costs and flow rates for ion exchange technologies

Table 8 Summary of costs and flow rates for in situ arsenic removal, nanofiltration and electrocoagulation

A key for the ‘Outcomes’ and ‘Quality’ headings in Additional file 5 is provided below. A key for the study design elements of Additional file 5 can be found in Additional file 6, but in particular, under the ‘Study design’ heading in Additional file 5, a straight single line indicates that a survey of one group of participants was undertaken (i.e. as in Akman & Higano, (2002)) [18]. Two parallel straight lines indicates that a survey of two different groups of participants was undertaken (i.e. Ahmad et al. (2005) and Ahmad et al. (2006)) [19, 20]. A before/after study is indicated by the elongated S-shaped line as in Ashraf Ali et al. (2001) [21]. A randomised control trial design is denoted by a straight line that splits into two as for Milton et al. (2007) in Additional file 5 [17]. The width of the lines indicate the relative number of samples collected and analysed in each study, along with the blocks under the ‘No. samples’ heading.

Note that in Figure 2 (the key for Additional file 5) there is no marker for moderate overall quality, since all studies were considered to be of weak or strong quality. The validity and reliability items in Additional file 5 correspond to appraisal of data collection methods from the EPHPP quality appraisal tool (Additional file 7).

• For validity: “Were data collection tools shown to be valid?”

• For reliability: “Were data collection tools shown to be reliable?”

Figure 2

Key to the outcome and quality headings in Additional file 5 .

These two items are shown in Additional file 5 as they were deemed to be important for appraising study quality in the context of interventions to remove or reduce arsenic in groundwater.

The majority of studies (n = 34, 67%) are based in Bangladesh, with the remaining set in India (n = 10, 20%), Nepal (n = 3, 6%), Vietnam (n = 2, 4%), Cambodia (n = 1, 2%) and China (n = 1, 2%). Forty-four studies (86%) report an evaluation of the effectiveness of interventions (as indicated in column 3 of Additional file 5, under the “Outcome/Effectiveness” heading). Across these effectiveness studies there is great variation in the number of water samples measured, ranging from two samples reported in Oh et al. (2000) to 1074 samples reported in Ngai et al. (2006) [22, 23]. In addition, there are differences in the sample units across studies. For example, some studies report repeated samples over a period of days at one site [24], while other studies report on repeated samples at a number of wells at a number of sites [25]. For eight studies it is unclear whether a reported value is a single measurement or an average of an unknown number of measurements.

Six studies (12%) report on the effectiveness of interventions and provide detail on behavioural aspects related to the use of these interventions. A further seven studies (14%) provide evidence on behavioural aspects only. Studies assessing behavioural aspects generally have a large number of participants, e.g. Ahmad et al. (2006) reports on a study of 2700 households and Jakariya et al. (2007) who surveyed 2600 families [20, 26].

Of the 44 studies reporting on the effectiveness of interventions, all but one of these are before and after studies where influent and effluent water samples are analysed and compared for their arsenic content. The remaining study is a randomised control trial, where households are randomised to receive the intervention or to receive no intervention.

The most common design for the studies reporting on behavioural aspects of arsenic removal/reduction interventions is that of a survey where users of different interventions are surveyed at a particular time-point.

Across the 51 included studies, 50 different interventions are described. The wide range of technologies appears to be due to attempts to meet the varying needs of villagers in terms of availability of resources, cost, maintenance, and ease of use. In order to appraise the effectiveness of the interventions, they were classified into eight groups based on the primary process involved in the intervention as described by Ravenscroft et al. (2009) [1]:

• Oxidation and filtration

• Coagulation, co-precipitation and filtration

• Adsorption

• Ion exchange

• Zero valent iron

• Arsenic removal in situ

• Membrane

• Electrolytic

For example, the 3-kolshi filter, as evaluated in BRAC (2000), is defined as a zero valent iron intervention since this employs the solid elemental form of iron as filings or nails [27]. Details of the groups, the specific interventions and the primary processes involved are given in Table 9.

Table 9 Summary of interventions with details on mechanisms, where available

A summary of all interventions evaluated by each study can be found in Additional file 5 under the ‘Technologies’ heading. A breakdown of the number of studies and interventions included in the review is given in Figure 3, with interventions classified into the eight groupings. There are more interventions in the adsorption grouping because a number of studies have assessed a greater number of adsorption interventions than other types, in particular Amiri et al. (2010), BCSIR (2003) and BRAC (2000) (see Additional file 5) [27–29]. On the other hand, for zero valent iron technologies many studies have assessed the same type of intervention: the sono, three-pitcher/kolshi/gagri filter.

Figure 3

Number of studies and interventions within each intervention group.

The final column of Additional file 5 details the funding source for each study. For 36 of the studies (71%), the funding source could not be determined from the article and a further study reported no funding for their research.

Study quality assessment

The overall quality of the studies was poor, with all but one ranked as weak (Additional file 5). The one RCT was appraised as strong [17]. Fifteen studies were at least somewhat likely to have a representative population but in almost as many studies it was not possible to tell from the information available. Eighteen out of 23 relevant studies did not have enough information to be able to say what percentage of the sample population agreed to participate and most studies did not detail how the sample size was determined. Of the four that did, they were convenience samples.

• Eleven studies reported that the outcome assessor was blinded to the status of the water samples. Sixteen studies used valid measures (though not all were considered reliable), four studies reported using invalid and unreliable measures and the remaining 19 studies did not report this information about the measures that were used. Only four studies reported a drop out rate. For the remaining studies, this information was not described or was not applicable. Twelve studies do report the percentage of participants completing the study with nine studies reporting more than 80% of participants completing, however, in 11 studies this information could not be ascertained.

• Fifteen studies report over 80% of participants received the intervention allocation of interest but in the remaining appropriate studies this information was not present.

• Sixteen studies reported some information about the consistency with which the intervention was delivered/used but in ten studies this was not reported and in a further nine studies is was not possible to tell.

• In eight studies it was believed that the participants were likely to have received another unintended intervention and in 14 studies the likelihood was unclear.

• At least 18 studies reported the unit of analyses to match the unit of allocation within the study.

• In only two studies were the statistical analyses believed to be inappropriate for the results of the study [30, 31].

Overall, the general issues with quality included:

• Small or vague sample sizes,

• No information on withdrawal,

• No information given on samples taken for analysis, e.g. filtering, blanks, blinding, number of replicates taken at one point in time or over a period of time,

• No agreement or comparison between laboratory and field measurements,

• No details on lab accreditation,

• No participant characteristics,

• No randomisation,

• No details on intervention characteristics, e.g. household/community, costs, flow rate and maintenance requirements.

• At least four studies report that there were differences between the outcomes presented in the methods and those reported in the results [27, 28, 32, 33].

Synthesis of evidence

The effectiveness evidence for each of the intervention groupings is presented in this section. The primary outcome is the percentage of effluent water samples with arsenic concentrations below WHO guidelines (≤0.01 mg/L), based on ‘safe/acceptable’ levels of exposure for humans. There are three secondary outcomes: (a) the proportion of effluent water samples with arsenic concentrations below the guideline limit for the country in which the study was conducted (e.g. < 0.05 mg/L in Bangladesh), (b) arsenic concentrations measured in human tissue, and (c) behavioural aspects related to the use and acceptance of the interventions.

Figure 4 shows the number of studies reporting for which a quantitative effectiveness outcome is available within each intervention group. This figure also shows the number of unique interventions from these studies where effectiveness evidence is available. For instance, within the ‘oxidation and filtration’ group 16 studies provide effectiveness evidence for 12 different interventions, while for the ‘zero valent iron’ group, 13 studies provide effectiveness data for just two interventions.

Figure 4

The number of studies and interventions for each grouping where quantitative effectiveness evidence are available.

Given that some studies evaluate a number of interventions and some interventions are evaluated across a number of studies, there are 90 potential study-by-intervention outcomes available to inform the effectiveness of arsenic removal technologies for groundwater. For 77 of these outcomes, data on the percentage of samples meeting WHO and/or national arsenic guidelines could be extracted from the study articles. For 42 of these study-by-intervention outcomes, data on the percentage of samples meeting both WHO and national guidelines for arsenic concentrations are available, while for nine and 26 of the study-by-intervention outcomes data are only available to inform the percentage of samples meeting WHO guidelines or national guidelines, respectively. These numbers are broken down by the intervention groupings in Figure 5.

Figure 5

Data available for calculating the percentage of samples meeting WHO and national arsenic concentration guidelines.

For 13 study-by-intervention outcomes (= 90–77), data on the percentage of samples meeting WHO or national arsenic guidelines could not be extracted. This was mainly due to a lack of detail reported in the results section of the article. A list of the reasons why these data are not available for these 13 study-by-intervention outcomes is given in Additional file 8.

The available effectiveness data are presented in the following sections, by intervention grouping, for the primary outcome: the percentage of samples meeting WHO guidelines for As concentrations. First we provide detail on the interpretation of the figures in the following section.

Interpretation of figures

The solid dots in Figure 6 represent the percentage of samples meeting WHO guidelines for As concentrations for each intervention evaluated. The vertical lines above and below the solid dots represent the 95% CI for the percentage of samples meeting WHO guidelines, as defined to be excellent evidence of effectiveness (see Table 2). The solid horizontal line represents the cut-off where 95% of samples meet WHO guidelines. Thus, for the sand filter, 40% of samples meet the WHO guideline (solid dot), with a 95% CI ranging from 25% to 56%. The diamonds represent the approximate arsenic concentration in the influent water samples for each intervention (see right-hand-side y-axis of Figure 6). The dashed horizontal line represents the WHO guideline As concentration of 0.01 mg/L. The approximate influent As concentration for the sand filter is 0.2 mg/L. Note that where data are available, arsenic concentrations in influent water samples, except those for iron removal ceramic filters 1 and 2 (IRCF1 and IRCF2), are all well above the WHO guideline level (i.e. the dashed horizontal line). The arsenic concentrations in the influent water samples presented in Figures 6, 7, 8, 9, 10, 11 and 12 should be considered approximate as the reporting of this information is not consistent across, or even within, studies. For example, the approximate influent As concentration may reflect the median, mean or mid-point from a range of As concentrations reported in a study. For clarity, where more than one author has investigated the same technology, the abbreviation is suffixed with the author’s initials. The aim is to present the reader with an understanding of the magnitude of the influent As concentration, rather than report the exact As concentration. The interpretation of Figure 6, applies equally to Figures 7, 8, 9, 10, 11 and 12.

Figure 6

Percentage (95% CI) of samples meeting WHO guidelines for oxidation and filtration technologies. ModGAR, Modified GARNET [34]; Sand [35]; AIRP, arsenic and iron removal plant [36]; ARP, SPACE arsenic removal plant [37]; GAR, GARNET [38]; DCCF, domestic clay candle filter [39]; AIRP1, arsenic and iron removal plant [40]; AIRP2, arsenic and iron removal plant [41]; IOB1 – IOB3, iron oxidising bacteria for three sites [40]; IRCF1 and IRCF2, iron removal ceramic filter at two sites [32]; NIFSF, natural iron fine sand filter [42].

Figure 7

Percentage (95% CI) of samples meeting WHO guidelines for Coagulation, co-precipitation and filtration technologies. AIC, alum iron coagulation [21]; SIT(Ch1) – SIT(Ch6), Stevens Institute technology at six sites [43]; SIT [44], Stevens Institute technology [44]; BP Fer, BP & ferric alum [45]; P&G, Proctor and Gamble powder [33].

Figure 8

Percentage (95% CI) of samples meeting WHO guidelines for adsorption technologies. Act(BRAC1) and Act(BRAC2), activated alumina for two units [27]; Act(Sar), activated alumina [46]; Act(Sar1) and Act(Sar2), activated alumina for two time-periods [3]; ICS, iron coated sand [21], IOCS, iron oxide coated sand [47]; Safi [38]; FerOx, ferric oxide [24]; SIDKO [27]; ARP, arsenic removal plant [48].

Figure 9

Percentage (95% CI) of samples meeting WHO guidelines for adsorption technologies [[45]] . Act1-Act5, activated alumina at five sites; AB1 and AB2, Aqua Bind at two sites; RedHem, red haematite; AS&FH, aluminium silicate and ferric hydroxide; Adsorp1 and Adsorp2, AdsorpAs at two sites; Slurry, slurry/granular ferric hydroxide.

Figure 10

Percentage (95% CI) of samples meeting WHO guidelines for zero valent iron technologies (specifically from BRAC (2001).

Figure 11

Percentage (95% CI) of samples meeting WHO guidelines for zero valent iron technologies (from sources other than BRAC (2001). AANF, Asia arsenic network filter [42]; Sono(Del), Sono [42]; Sono(Hus1) and sono(Hus2), sono for 2 filters [49]; Sono(Mil), sono [17]; Sono(Ngai), sono[23, 30]; Sono(Shaf), Sono [32].

Figure 12

Percentage (95% CI) of samples meeting WHO guidelines for ion exchange technologies. FH, ferric hydroxide[45]; Resins, bucket of resins [45]; CP, catalytic precipitation [45]; ArsenX1 – ArsenX3, ArsenX for single and split columns [50].

Primary outcome: Samples meeting WHO guidelines for As concentrations

Oxidation and filtration technologies

Although outcome data on 14 oxidation and filtration studies is potentially available to inform these analyses, only 11 studies provide effectiveness evidence for the proportion of samples meeting WHO guidelines (As concentration ≤0.01 mg/L). These 11 studies provide data on 11 unique interventions, however the effectiveness of the iron oxidising bacteria (IOB) technology was assessed at three locations each having different influent arsenic and iron concentrations (leading to IOB1, IOB2 and IOB3) and the IRCF are reported for two different time-points (IRCF1 in April 2007 and IRCF2 in August 2007, based on dry and wet seasons). Thus, results for a total of 14 technologies are described below.

The oxidation and filtration technologies appear to perform poorly with the best performing technology, the sand filter evaluated by Berg et al. (2006), having only 40% of effluent water samples with As concentrations below the WHO guideline [35]. In fact, for half of the technologies presented in Figure 6, 0% of samples meet the WHO guidelines (modified garnet (ModGAR), arsenic and iron removal plant (AIRP), AIRP1, IOB1, IOB2, IRCF1 and natural iron fine sand filter (NIFSF)).

There are variations in the width of the 95% CIs, with many studies having very wide 95% CIs due to the small number of samples reported; for example, the NIFSF technology reports only four samples (one sample per month for four months).

Coagulation, co-precipitation and filtration technologies

Data on the percentage of samples meeting WHO guidelines could only be determined for five of nine studies evaluating the effectiveness of coagulation, co-precipitation and filtration technologies. One study provided data separately for six different wells and so the data in Figure 7 correspond to ten individual interventions. Based on data from these ten interventions, the coagulation, co-precipitation and filtration technologies appear to perform better than the oxidation and filtration technologies, with five of the nine technologies having ≥50% of samples meeting WHO guidelines (see Figure 7). The best performing technology, the alum iron coagulation (AIC), is reported by Ashraf Ali et al. (2001) to have 83% of samples meeting WHO guidelines with a 95% CI of 52% to 98% [21]. The width of the 95% CIs associated with all of these estimates (except those for BP and ferric alum (BP Fer) and Procter and Gamble Powder (P&G)) indicates a small number of samples analysed and reported. Note that where data are available, the influent As concentrations are well above the WHO guideline (solid diamonds on Figure 7).

Adsorption technologies

Out of 13 studies, data are available from ten on the percentage of samples meeting WHO guidelines. For nine of these ten studies results for 11 unique interventions are available as one study reports on an intervention separately for two different time-periods (Sarkar et al., 2008 for the activated alumina) [3] and another reports separately for two different sites (BRAC for the activated alumina) [27]. Thus, 11 estimates of the percentage of samples meeting WHO guidelines from nine of the ten studies are shown in Figure 8.

The study by Hossain et al. (2005) evaluated six distinct interventions over 12 sites (Figure 9): activated alumina interventions placed at separate five sites (Act1-Act5), Aquabind (AB1, AB2) placed at two sites, Adsorp As (Adsorp1 and Adsorp2) placed at two sites, red haematite (RedHem) placed at one site, aluminium silicate and ferric hydroxide (AS&FH) at one site and slurry/granular ferric hydroxide (Slurry) at one site [45]. The results for these 12 interventions are given in Figure 9 and have been separated from the other studies within this group for clarity.

The results for the total of 23 interventions suggests a great deal of variation in effectiveness, with two technologies having 100% of samples meeting WHO guidelines (see Figure 8: Act(BRAC1) and Act(BRAC2)), while over half of the technologies have <50% of samples meeting WHO guidelines. The iron oxide coated sand technology (IOCS) performs well with 91% of samples having As concentrations ≤0.01 mg/L. However, as with the technologies described above, there is a great deal of uncertainty in the majority of these estimates as the number of samples reported is often low (reflected in the wide 95% CIs). Note that the approximate influent As water concentrations, where available, are well above the WHO guideline.

Zero-valent technologies

Six of the 13 effectiveness studies provided data to calculate the percentage of effluent water samples meeting WHO guidelines. Three of these studies reported data separately for more than one individual intervention: Delowar et al. (2006) report on the Asia Arsenic Network Filter (AANF) and sono filter [42]. Hussam and Munir (2007) report on the sono filter at two different locations [49] and the BRAC report presents data for two wells over different time periods [27]. However, BRAC (2001) only reports on the percentage of effluent samples where arsenic concentrations were 0 mg/L. These data are shown in Figure 10.

The results from BRAC (2000) suggest that the sono filter performs reasonably well with >80% of samples having 0 mg/L of arsenic at the Jhikargachha site in the first six weeks of use [27]. For the Sonargaon site, after 15 weeks of use the percentage of samples having 0 mg/L is 60-80%.

Effectiveness data on zero valent iron interventions from other sources are shown in Figure 11. There is great variation in these estimates, with data on the sono filter implemented by Hussam and Munir (2007) [49] at one particular location (SonoHus1)) and the sono filter implemented by Ngai et al. (2006) (Sono(Ngai)) [23] suggesting good performance.

Ion exchange technologies

Data from two studies on five different ion exchange interventions, where one intervention is reported separately at two different locations, are available to calculate the percentage of samples meeting WHO guidelines. These data are presented in Figure 12, and suggest that ion exchange technologies are poor at reducing arsenic concentrations to within WHO guidelines, with the best performing intervention, catalytic precipitation as implemented by Hossain et al. (2005), having just 39% of samples meeting WHO guidelines [45].

Arsenic removal in situ, membrane and electrolytic technologies

As displayed in Figure 13, evidence from the two studies providing data on subterranean arsenic removal (SAR) ((1)SAR(Gupta)) and (1)SAR(V.Halem)) is inconsistent, with the SAR reported in Gupta having 72% of samples meeting WHO guidelines, while the percentage of samples meeting WHO guidelines in the Van Halem et al. (2010) study is just 6% [51].

Figure 13

Percentage (95% CI) of samples meeting WHO guidelines for arsenic removal in situ, membrane and electrolytic technologies. (1)SAR(Gupta), subterranean arsenic removal [52]; (1)SAR(V.Halem), subterranean arsenic removal [51]; (2)LPN1 – (2)LPN4, low pressure nanofiltration for four sites [22]; Electro, electrocoagulation [53].

Evidence for the effectiveness of nanofiltration is poor, as it is only based on two samples at two sites, hence the great width of the confidence intervals. However, the evidence from the only study evaluating electrocoagulation as a technology suggest this performs reasonably well with 82% of samples meeting WHO guidelines, but it does not reach our criteria for excellent evidence of effectiveness [53].

Secondary outcome: Percentage of samples meeting national guidelines for As concentrations

As Figure 5 shows, much more data are available from the included studies to calculate the percentage of samples meeting national guidelines than for WHO guidelines. This is perhaps due to the national guideline being seen as more achievable than the WHO guideline for arsenic concentrations in groundwater, but also field testing kits may have difficulty measuring at the WHO guidelines for arsenic concentrations in groundwater [1]. For all countries in which these studies were conducted (Bangladesh, India, Nepal, Cambodia, Vietnam and China), the national guideline for arsenic concentrations in groundwater is0.05 mg/L. This therefore helps comparison across studies and interventions for this outcome.

It should be noted that although there is evidence that clinical symptoms of arsenicosis may occur at < 0.05 mg/L [54], it has been argued that attempting to adopt a lower standard in a developing country, when the existing standard has not yet been achieved, may lead to scarce resources being misdirected [1].

Oxidation and filtration

The evidence on these technologies to reduce or remove arsenic to ≤ 0.5 mg/L is mixed, with most interventions having >60% of samples meeting national guidelines (see Additional file 9, Figures A and B). In particular, three interventions have 100% of samples meeting national guidelines: the Space ARP evaluated by Brennan (2011) [37], the garnet filter evaluated by Rahman et al. (2005) [38] and the IOB evaluated by Hassan et al. (2008) [40] in location 1. In contrast, the ardasha filter and passive sedimentation technologies have particularly poor performance with <10% of samples meeting national guidelines.

Coagulation, co-precipitation and filtration

Of the three different coagulation, co-precipitation and filtration technologies providing data for this outcome, only the Stevens Institute Technology, as implemented by BAMWSP, Cheng et al. (2004) and Meng et al. (2001), have any outcomes with ≥95% (see Additional file 9, Figures C and D) [25, 43, 44]. The P&G powder evaluated by Norton et al. (2009) has 86% of samples meeting national guidelines [33]. The DPHE/Danida technologies do not perform well across sites and studies, ranging from 3% to 80% of samples meeting national guidelines.

Adsorption

All but one of the adsorption interventions having available data have >95% of samples meeting national guidelines, therefore defined in this report as good evidence of effectiveness (see Additional file 9, Figures E and F). The intervention with < 95% of samples meeting national guidelines is the ARP as investigated by Hossain et al. (2006) [48].

Zero valent

The zero valent iron technologies are considered to have good evidence of effectiveness with 12 out of the 14 providing available data, having ≥95% of samples meeting national guidelines (see Additional file 9, Figure G). The sono intervention assessed by Milton et al. (2007) [17], the only RCT, has the lowest percentage of all zero valent iron technologies with 65% of samples meeting national guidelines.

Ion exchange

There is mixed evidence for the effectiveness of ion exchange technologies in terms of the percentage of samples meeting national guidelines for arsenic concentrations in groundwater (see Additional file 9, Figure H). The effectiveness of tetrahedron technologies is inconsistent across sites and within studies, ranging from 57% to 100% for different sites within the same study [25]. The ArsenX technologies have poor evidence of effectiveness [50].

Arsenic removal in situ, membrane and electrolytic technologies

Due to the low number of samples assessed in Oh et al. (2000) where membrane technology was evaluated [22], it is difficult to comment on the effectiveness of this technology (see Additional file 9, Figure I). Data on the subterranean arsenic removal in situ interventions is inconsistent ranging from 34% [51] to 85% [52]. However, the electrocoagulant technology evaluated by Wan et al. (2011) has 100% of samples meeting national guidelines (see Additional file 9, Figure I) [53].

Groundwater effectiveness summary

A summary of the groundwater effectiveness evidence from each study for each intervention evaluated can be found in Tables 10, 11, 12, 13, 14 and 15. They are summarised by their strength of effectiveness evidence as defined in Table 2, p 16. The hollow circles correspond to poor strength of evidence, the crossed-through circles represent good effectiveness evidence with the solid circles representing excellent evidence of effectiveness. For those interventions where the data are inconclusive, no corresponding circle is shown.

Table 10 Summary of effectiveness evidence for oxidation and filtration interventions

Table 11 Summary of effectiveness evidence for coagulation, co-precipitation and filtration interventions

Table 12 Summary of effectiveness evidence for adsorption interventions

Table 13 Summary of effectiveness evidence for ion exchange interventions

Table 14 Summary of effectiveness evidence for zero valent iron interventions

Table 15 Summary of effectiveness of evidence for other interventions

In summary, the effectiveness of the oxidation and filtration interventions is poor, while the evidence for coagulation, co-precipitation and filtration, subterranean and membrane and electrolytic methods is mixed with results providing either poor or good evidence for effectiveness. The evidence on adsorption and zero valent iron interventions is more promising with most results suggesting good effectiveness evidence. In particular, the activated alumina and sono three-kolshi/gagri/pitcher filters have ≥95% of samples meeting national guidelines. Disappointingly, only one study reports excellent evidence of effectiveness: BRAC (2000) for activated alumina [27].

Synthesis results – human tissue samples

Only three of the included studies report on measures of arsenic concentrations in human tissue or body fluids: Milton et al. (2007), Norton et al. (2009) and Hossain et al. (2005) [17, 33, 45]. Milton et al. (2007) report from their RCT urinary arsenic concentrations from individuals before and after (at one and 12 months post-intervention) use of the three-pitcher filter compared to individuals receiving no intervention [17]. They found that for controls, post-intervention urinary arsenic concentrations were statistically significantly greater than the pre-intervention concentrations. Regardless of whether the analysis was restricted to those individuals who self-reported compliance, the post-intervention urinary arsenic concentrations for those receiving the three-pitcher filter were not statistically significantly different to the pre-intervention concentrations for one and 12 month total urinary inorganic arsenic metabolites, and one month urinary inorganic arsenic. At 12 months, measures of urinary inorganic arsenic were statistically significantly higher than pre-intervention levels for the three-pitcher filter (mean 18.3 vs 24.4 μg/g creatinine). Milton et al. (2007) provide three possible explanations for why post-intervention urinary arsenic concentrations were not found to be as low as expected: a) incomplete compliance, b) individuals receiving sources of arsenic through routes other than household consumption, and c) the intervention not being as effective as expected [17].

Hossain et al. (2005) report on the effectiveness of ARPs based on adsorption, ion exchange or oxidation and filtration primary processes [45]. As a secondary analysis to arsenic concentrations in water, they analysed the urine samples of individuals. Hossain et al. (2005) briefly describe their results stating that 82% of the 150 individuals had urinary arsenic concentrations above the normal limit, two years after the ARPs had first been installed, with a mean of 104 μg/1.5 L (SD 116 μg/1.5 L). This was significantly higher than the urinary arsenic concentrations measured in 78 individuals in unaffected areas. Hossain et al. (2005) discuss technical reasons for the lack of effectiveness of the ARPs: maintenance, clogging and lack of user friendliness [45].

Norton et al. (2009) measured total urine arsenic concentration before and after the initiation of the Proctor and Gamble (flocculant-disinfectant) powder in 103 individuals [33]. They report a 42% reduction over 12 weeks in total urinary arsenic levels from a median of 385 μg/g to 225 μg/g. But they note that for 24 of 103 participants, total urinary arsenic levels were actually higher after the intervention was initiated than the arsenic levels before.

Norton et al. (2009) provide three possible explanations for what they consider a modest reduction in total urinary arsenic levels: a) the participants consumed water outside of the home where interventions to reduce arsenic were not in place, b) the consumption of food containing high levels of arsenic due, for example, to irrigation, and c) that the body stores arsenic and will release these stores when arsenic consumption decreases [33].

Reasons for variation in effectiveness

The effectiveness of each technology needs to be understood in context, for example, perception of the arsenic problem by the users, cost, flow rate and maintenance. Therefore, the supporting information from the included studies, has been summarised where available. Please note, it was not within the remit of this review to synthesise or interpret the extracted qualitative data.

Perception of the arsenic problem

The perception of people using the arsenic mitigation technologies has been shown to be integral to successful implementation of technologies, for example, it took 25 to 30 years to convert up to 97% of the rural population of Bangladesh to using tubewell water, as opposed to contaminated surface water, and even then it was easier than today’s alternative safe water options in terms of acceptance, technical viability, financial and maintenance aspects [55]. Furthermore, there have been instances of confusion due to previous experiences which have delayed uptake of arsenic removal technologies; for example, people using passive sedimentation as originally promoted by some organisations were approached to change their practise again despite having already made an effort to treat arsenic and change their behaviour [56].

General awareness of the arsenic problem is varied. Often, older people did not consider arsenic to be such a problem, particularly if they had been drinking water from the present sources for 25–30 years without noticing any issues. There was a general perception that arsenic was less likely to be considered a problem among illiterate communities [55]. In contrast, Jakariya (2003) also found that in a village with better socioeconomic conditions and higher levels of literacy, people were not willing to accept arsenic may be a problem in the long run [55]. It should be noted they had no individuals displaying the symptoms of arsenicosis. They were aware of the long incubation period of the disease and believed that their better nutritional status helped prevent it; this made the villagers reluctant to use arsenic free water.

Culture can be an issue when attempting to introduce new technologies. There is a ‘traditional’ practice in some areas that men never collect drinking water. Due to religious perceptions and cultural traditions, rural women avoid any sort of contact, including visual contact, with unknown male persons and non-relatives. This discourages men from fetching water from places where women usually do. If men do collect water they are often taunted for doing women’s work [55]. Hence, having to walk further to bring safe water can mean extra work for women. Lack of privacy has also been identified as a barrier to collecting water from the improved water options and some women considered having to go out of their house for water a prestige issue [57].

It would seem that whether a new technology was household- or community-based influenced its success, yet, the issue is complex. Hoque et al. (2004) found that people discontinued the use of all household-based water options after several weeks [57]. One third of these users switched to piped or manual deep tubewell water as it became available. People shared the costs for these options and claimed that walking to a safe, reliable and easily manageable water source once a day was more convenient than operating and maintaining household-based options [57].

An earlier study by Hoque et al., (2000) investigated various methods of implementation for the arsenic removal technologies were employed [56]. Proper education, training and regular sharing of information with the stakeholders were identified as the main driving factors behind the spontaneous participation of villagers. However, lack of information, education and communication materials for the promoting/motivating of stakeholders as well as for people was found to hamper the results.

Overall, understanding how new technologies will be received is highly contextual, not only for the users, but also with regard to the agencies installing them. Hossain et al. (2006) found indiscriminate installation of ARPs without proper preparatory steps, coupled with ill-maintenance, gross mismanagement and a sense of disowning on the parts of the users have resulted in misuse of these costly plants and the treated water [48]. Ngai et al. (2006) also found the Kanchan Arsenic Filter as an open source technology in some cases was not implemented with fidelity and coupled with lack of government approval slowed dissemination and acceptability of the project [23]. This was successfully overcome by training local entrepreneurs to solve problems. Similarly, Jakariya et al. (2007) found that options still in operation were those having highly motivated caretakers using personal initiatives to run the options [26].

Costs and flow rate

In developing countries cost will clearly be an issue. Many investigators were mindful of this; ensuring interventions used local materials and resources.

Interestingly, Hossain et al. (2006) found that technologies which were free were not seen as an asset by the community and therefore not maintained [48]. It seemed because the villagers had not invested, they felt no sense of ownership. A similar issue was found by BRAC (2000) [27]. None of the village water committees set up by them were taking responsibility for the free demonstration units provided, which subsequently fell into disrepair. BRAC (2000) considered this was either because of minor faults that cost little money to fix or routine maintenance of the options that would need physical labour to replace or regenerate. BRAC (2000) considered it may be that because the villagers did not have to pay, they lost interest, therefore they intend to ensure some community contribution to future projects to create a sense of ownership.

Other studies contradict the hypothesis of ownership. For example, Hoque et al., (2000) found community-based options were used by many families who initially showed no interest in the options at the planning phase and so did not share the costs [56]. A survey by Jakariya (2003) found 54% of respondents wanted free options from the government or some kind of government help to alleviate the problem, with 64% saying that they did not want to pay for any type of alternative safe water options [55].

The ability of the technology to produce sufficient water is also key to the success of a technology and should be balanced against cost. As a guide, approximately 50 L/day is considered an acceptable volume for a family’s needs [58]. The following tables summarise the cost and flow rate of technologies, where that information is given. Costs are given as Australian dollars for 2011. Where possible, flow rates have been converted to L/hr.

Household oxidation and filtration technologies listed in Table 3 display flow rates from 1–60 L/hr, with the majority of technologies achieving 1–5 L/hr. The sand filter, however, reached 60 L/hr. Community interventions achieved 140-200 L/hr. The costs within this group, where given, appear relatively low, presumably due to the use of local materials, such as sand.

With regard to the coagulation, co-precipitation and filtration group, flow rate is not necessarily a practical measure since some interventions involve only adding a powder, followed by stirring and settling. However, an estimate can be made of the production rate of arsenic free water (see Table 4) e.g. Star/CIWPL, 16–20 L after mixing and standing from 15 min to an hour. Otherwise the range for household technologies was 4.3-120 L/hr. The one community option produced 1000 L/hr.

Comparisons with regard to cost are difficult due to the lack of information, however, there are likely to be on-going costs due to the regular need for chemicals.

The range of flow rates for household adsorption technologies is broad (Table 5), from <1 to 120 L/hr. However, the community options appear capable of producing flow rates of 42 to 1000 L/hr. Unfortunately, information on operational costs was sparse. Capital costs for communities were generally high, in comparison to other technologies.

The zero valent iron technologies generally employ local materials, such as nails, brick chips and sand, therefore they are a comparatively cheap technology. However, as shown in Table 6 flow rates appear to be low, at around 2 L/hr for a household.

Table 7 shows ion exchange technology to be comparatively expensive and generally a community, as opposed to a household, option. Again, there is little information on operational costs, although start-up costs range from Aus$ 1300 to 5672.

The subterranean method of arsenic removal in Table 8 shows impressive flow rates of 167–1200 L/hr. Electrocoagulation and nanofiltration, which are more likely to be household options display respectable flow rates of 50 L/hr and 17 L/hr, respectively. Again, information on cost is minimal.

Maintenance

The level of maintenance required appears to be a key factor in the success or failure of arsenic removal technologies in developing countries. In some cases, it was not only the user who was unclear about the need for maintenance, for example, Hossain et al. (2006) found that authorities responsible for installation and upkeep of ARPS had no clear idea regarding frequency of backwashing [48].

It should also be noted, some of the technologies generate waste, which may or may not be contaminated with arsenic. Often, since there were no specific regulations in regard to the disposal of arsenic-laden spent regenerant on the Indian subcontinent, this waste is disposed of in the open field [46, 48].

The tables below (Tables 16, 17, 18, 19, 20 and 21) indicate details on required maintenance, as reported, accompanied by views of the users, where available.

Table 16 Maintenance of oxidation and filtration technologies

Table 17 Maintenance of coagulation, co-precipitation and filtration technologies

Table 18 Maintenance of adsorption technologies

Table 19 Maintenance for zero valent iron technologies

Table 20 Maintenance for ion exchange technologies

Table 21 Maintenance for subterranean arsenic removal and electrocoagulation

Review limitations

This review is limited primarily by the reporting and conduct of research in the included papers. All but one of the studies was assessed as weak due to poor reporting standards. Our primary outcome (percentage of samples meeting WHO guidelines) could not be determined from many of the study reports. It is unclear if this introduces outcome reporting bias into the review. For example, we have been unable to determine whether outcomes were not reported because none of the samples met the WHO guideline, or simply because older testing kits were not capable of measuring at this level.

Reviewers’ conclusions

Establishing the effectiveness of interventions to reduce the impact of arsenic contamination of groundwater on human health in developing countries is complex. Using systematic review methods, we were able to summarise evidence for the effectiveness of interventions, with the caveat that there were significant methodological weaknesses in much of the underlying research:

• Poor evidence of effectiveness:

○ oxidation and filtration

○ ion exchange

• Mixed evidence of effectiveness:coagulation, co-precipitation and filtration

○ subterranean (As removal in-situ)

○ membrane technologies

○ electrolytic methods

• Good evidence of effectiveness:

○ adsorption (with ≥95% of activated alumina samples meeting national guidelines)

○ zero valent iron (with ≥95% of sono three-pitcher filters samples meeting national guidelines)

We did not locate any evaluations of the effectiveness of lime softening or phytofiltration technologies.

Through extracting data about the implementation of interventions, we were also able to summarise some of the complexity of the contexts into which these interventions were introduced. These contexts may begin to explain why the effectiveness of interventions to reduce the impact of arsenic contamination of groundwater can vary greatly, although our findings here did not enable us to rank these issues in order of importance. Consideration of the following issues in decision-making about funding of interventions may be pivotal in whether or not they are effective and have the desired positive impact on human health in developing countries:

• Acceptability to users – technologies that are time-consuming to draw sufficient water from for a family’s needs or require frequent maintenance were unlikely to be used, thereby substantially limiting positive human health outcomes no matter how effective the underlying technology.

• Sense of ownership – communities’ willingness-to-pay for technologies varied greatly, with no clear pattern to indicate why this might be the case. Participation may be one explanation, as this was found to vary widely with the extent of education, training and regular sharing of information in the implementation of arsenic mitigation programmes.

• Perception – the perception of the problem is likely to be integral to behaviour change. Proper education, training and regular sharing of information with the stakeholders have been identified as the main driving factors behind the participation of villagers.

• Women’s role in society – following the introduction of technologies, changes to the location of (or frequency at which) women collect drinking water may clash with cultural expectations about women’s role in a community. The effectiveness of technologies may ultimately be rooted in community development programmes addressing gender inequalities.

We identified significant shortcomings in the rigour of the studies eligible for inclusion in this review. To improve the evidence-base for decision-making about the effectiveness of interventions about arsenic mitigation technologies at household- and community-level will require commissioning of primary research that:

• reports the number of samples meeting WHO guidelines.

• collects and tests an adequate number of water samples, and uses valid and reliable tools for measuring arsenic concentrations in water.

• reports the characteristics and properties of the intervention

• meets reporting guideline standards appropriate to the study design used; this could facilitate both the process of quality appraisal and the establishment of a common metric to enable comparison across studies in subsequent reviews.

• tests the impact of key implementation contextual factors (e.g. maintenance, culture, organisational support) on outcomes.

Research methods in the field of international development are developing in order to address the complexity of the situation and produce a more informative evidence base for decision makers. As highlighted by the challenges in this review, commissioners should pay close attention to these methods in both primary and secondary research.

The importance of understanding ‘how, when and why’ interventions are effective, as opposed to simply ‘are’ they effective, has been highlighted with the perspective of international development by Svoronos and Mate (2011) [59]. Context-specific evaluation designs such as randomised controlled trials with greater protocol flexibility, process evaluations, realist evaluation, and multiple case study designs may provide more nuanced understanding of the effectiveness of complex interventions [59]. It follows from this that systematic reviews of research in international development may also need to accommodate similar context-specificity and apply the principles of conventional systematic reviews rather than the methods in their entirety [60]. Context-specific systematic review methods developed in the health and social policy fields of high-income countries, which integrate quantitative and qualitative data [61–63], may prove fruitful methodological avenues to pursue in synthesising complex evidence for international development.