What specific plant traits support ecosystem services such as pollination, bio-control and water quality protection in temperate climates? A systematic map protocol
© The Author(s) 2017
Received: 12 August 2016
Accepted: 3 January 2017
Published: 1 February 2017
Agricultural intensification has increased diffuse source pollution within water catchments, reduced heterogeneity within the landscape and caused major declines in farmland wildlife, including birds, mammals, invertebrates and wildflowers. This increase in pollution and wildlife decline, has effected three vital ecosystem services, pollination, biological pest control and water quality protection. The morphological traits of plant species, such as floral display size and leaf area, provide support to these services and vegetative strips can be established with plants that have these desirable traits. Vegetative strips are widely used across Europe and integrated into government environmental schemes such as The Common Agricultural Policy and The Water Framework Directive. However, issues of land availability and food security require a sustainable intensification of current agricultural practices. One component of this process is to sow vegetative strips that are designed to support multiple ecosystem services. To do this, combinations of plant species that will support specific ecosystem services, have been designed. However, to enable a fully-informed design process, evidence must be collated on which specific plant traits provide the support to the target ecosystem services. We propose to systematically map all evidence on which specific plant traits provide support for three of the most vital ecosystem services, pollination, bio-control and water quality protection. Information from this map could inform future decisions on which plant species are suitable for inclusion within a multifunctional vegetative strip that aims to provide the target ecosystem services. The aim of this systematic map is to create a searchable database of studies that demonstrate evidence of plant traits and how they support the named ecosystem services.
Seven bibliographic databases, 25 organisational websites and 2 search engines, will be systematically searched with predefined and tested key search terms. All searches will be undertaken in English and only those undertaken in a temperate climate zone will be considered. Studies found will be screened at title, abstract and full text levels, recording the number of excluded articles. Following full text assessment, the meta-data of included studies will be incorporated into a systematic map database in Microsoft Access. A report will summarise the evidence, highlight any knowledge gaps, and provide recommendations for future research.
KeywordsPollinator Beneficial invertebrate Natural enemy Buffer strip Agri-environment scheme Biodiversity Multifunctional field margin Vegetative strip
Around the globe, farming practices have intensified over the past 60 years, with an increase in the application of pesticides and fertilisers and the removal of off-crop habitat such as hedgerows and vegetative strips [1, 2]. This has increased diffuse pollution within entire water catchments, reduced heterogeneity within the landscape and caused major declines in farmland wildlife, including birds, mammals, invertebrates and wildflowers [3–6]. This increase in pollution and decline in wildlife, directly affects the services that a farmland ecosystem provides to the land-owner. For example, in 2007, 35% of global agricultural crops were animal-pollinated , but declines in wild pollinator numbers and their associated plants , have led to pollination deficits [9–11]. In contrast, widespread use of pesticides has led to increased resistance in over 500 species of crop pests  and this number is still rising. A recent review by Bass et al. , collated evidence on the global rise in insect resistance to the widely used neonicotinoid insecticides. Within this review, using data extracted from Michigan University’s Arthropod Pesticide Resistance database , resistance was shown to be already present in over twenty insect pest species including some significant crop pests such as Bemisia tabaci, Myzus persicae, Aphis gossypii and Nilaparvata lugens. This, combined with recent calls for sustainable intensification , drives the need to control pests using other means, such as predation by their natural enemies (biological pest control) . However, supportive habitat that provides shelter, overwintering sites, alternate hosts or prey and pollen and nectar , has been widely removed . These off-crop habitats within agricultural land offer other benefits too. Riparian buffer strips, for example, provide a valuable barrier to pollution, protecting water quality . Without them, pollutants such as pesticides, nitrates and phosphates start to increase water toxicity and cause eutrophication [20–22].
Non-crop habitats, such as vegetative strips, can be established with plant species that have desirable traits, to try and return support for these vital ecosystem services , and support may even be made available through legislation and incentives. In Europe, for example, specified habitats, plants and animals are protected through the Habitats Directive , and water quality through the Water Framework Directive and the Nitrates Directive. The latter specifically addresses water pollution by leaching of nitrates from agriculture into farmland watercourses . Also, funding for the preservation of habitat biodiversity, water quantity and quality and the protection of soil from erosion is provided via the Common Agricultural Policy (CAP) [31–34].
Though these policies are effective, future availability of land is likely to be restricted due to food production requirements, which have increased with consumption growth, and issues of food security such as, competition for land, climate change and other land use pressures, caused by the continued exponential increase of the human population [35, 36]. This has created a need to sustainably intensify agriculture, which involves increasing food production from existing agricultural land whilst minimising pressure on the environment .
In order to support this sustainable intensification, it may be necessary to increase the ecosystem service value of off-crop habitats by designing vegetative strips that aim to support multiple ecosystem services [28, 37] rather than prioritising one over the others. Combinations of plant species to support specific ecosystem services, are already utilised in parts of Europe (e.g. [38, 39]). However, to enable the maximum functionality of measures such as vegetative strips, it may be valuable to consider which specific plant traits provide support to the target ecosystem services. Therefore, we propose to systematically map all evidence on specific plant traits that provide support for three of the most vital ecosystem services, pollination, bio-control and water quality protection.
Objective of the systematic map
This systematic map will collate existing research on plant traits and how they may support pollinators, natural enemies and water quality protection. It will focus on studies undertaken in temperate climate zones, applied to any type of habitat. The study will focus on specific plant traits that provide support for the target ecosystem services. Whole plant community traits will not be included in this map. The outputs will consist of a searchable database for all the named ecosystem services and a report summarising the nature and character of the evidence.
Crop pest natural enemy support
Water quality protection
Elements of the primary question
Water quality, pollinator species and natural enemies of insect crop pests, within temperate climates. A temperate zone has a temperature range of −3 to +18 °C, shown as ‘C’ in the Köppen-Geiger world map on climate classification Kottek et al. .
Specific plant traits, for example floral display size, leaf area etc.
Lack of traits or alternative traits, for example no floral display.
Outcomes of each study will be stated as they are found within the relevant articles included and details will be coded into the map accordingly.
The methods used in the development of the systematic map database will be adapted from the Collaboration for Environmental Evidence (CEE) Systematic Review Guidelines  and from an existing systematic map report, Randall and James .
A comprehensive search will be undertaken using multiple information sources to capture an un-biased sample of literature. The search strategy was developed to identify both published and grey literature.
Key search terms
An initial scoping search was performed to validate the methodology and used to provide a preliminary indication of the volume of relevant literature. Search terms were tested between November 2014 and March 2015 for specificity and sensitivity using the Harper Adams University library electronic database, ‘Findit@Harper’, and used to indicate the volume of relevant literature. The search terms, number of articles found and general quality of the search results were recorded in Microsoft Excel (Additional file 1).
The following Boolean search operators will be used. A wildcard (*) will be used where accepted by a database or search engine to pick up multiple word endings, for example plant* would pick up plant, plants, etc. A keyword may be made more restrictive by the addition of a qualifier e.g. (plant*) AND (trait*) AND (beneficial) AND (invertebrate*). The combination of qualifiers and keywords will vary for each ecosystem service, based on the results of the scoping search. The exact keyword and qualifier combinations to be used are listed in Table 1 in Additional file 2.
Plant traits identified by the systematic map will then be used as keywords for further searches linking them with the specific target ecosystem services, e.g. (floral display*) AND (pollinat*). This will ensure that the searches are as comprehensive as possible.
Sources of publications
Several online sources will be searched in the English language to identify relevant literature and a record of each search will be made to enable a re-run of the search if needed. Data that will be recorded include: date search conducted, database name, search term, number of hits and any other notes.
- 1.Bibliographic electronic databases:
Harper Adams University Library Database (‘Findit@Harper’) which includes the following relevant sources (all other sources included in this database can be found in Additional file 3):
ISI Web of Science involving the following products: ISI Web of Science; ISI Proceedings
Index to Theses Online
Agricola (United States department of Agriculture National Agricultural Library) NAL catalogue
Directory of Open Access Journals (DOAJ)
Grey literature for specialist searching
Where possible, Boolean search terms will be used in these databases. However if the technical infrastructure of a database does not support this search method, simplified subsets of the key search terms will be used.
- 2.1.1.Defra (https://www.gov.uk/government/organisations/department-for-environment-food-rural-affairs)
UK Environment Agency (https://www.gov.uk/government/organisations/environment-agency)
UK Forestry Commission/Forestry Research (http://www.forestry.gov.uk/)
The Woodland Trust, UK (https://www.woodlandtrust.org.uk/)
Natural England (https://www.gov.uk/government/organisations/natural-england)
Natural Resources Wales (https://naturalresources.wales/)
Scottish Natural Heritage (http://www.snh.gov.uk/)
Scottish Environment Protection Agency (https://www.sepa.org.uk/)
Northern Ireland Environment Agency (https://www.doeni.gov.uk/)
European Environment Agency (http://www.eea.europa.eu/)
European Commission Joint Research Centre (https://ec.europa.eu/jrc/en)
Ministry of Agriculture and Forestry (Finland) (http://mmm.fi/en/frontpage)
Swedish Environmental Protection Agency (http://www.swedishepa.se/)
Danish Environmental Protection Agency (http://eng.mst.dk/)
Ministry of Environment and Food of Denmark (http://en.mfvm.dk/the-ministry/)
Government Norway Portal (https://www.regjeringen.no/en/)
Flemish Environment Agency (http://en.vmm.be/)
Federal Environment Agency (Germany) (http://www.bmub.bund.de/en)
Federal Ministry of Food, Agriculture (Germany) (http://www.bmel.de)
Netherlands Environmental Assessment Agency (http://www.pbl.nl/en)
Federal Department for the Environment, Transport, Energy and Communication (Switzerland) (http://www.uvek.admin.ch/)
Federal Office for Agriculture (Switzerland) (http://www.blw.admin.ch)
Food and Agriculture Organization of the United Nations (http://www.fao.org)
Ecologic Institute (http://www.ecologic.eu)
EU Cost (European Cooperation in Science and Technology) (http://www.cost.eu)
Scirus (www.Scirus) and Google Scholar (scholar.google.com). The first 25 hits (.doc,.txt,.xls and.pdf documents where this can be separated) from each data source will be examined for appropriate data. No further links from the captured website will be followed unless to a document/pdf file
Other literature searches
Other specific/specialised databases will be searched where identified or recommended by experts within the field.
Key studies through stakeholder consultation
Bibliographies of articles viewed at full text will be searched for relevant articles missed by previous searches. Recognised experts, practitioners and authors will be contacted for further recommendations and to provide relevant unpublished material or missing data.
Article screening and study inclusion criteria
The results of each search term on each database will be imported into a separate EndNote X7 library file. All the database libraries will be incorporated into one library, recording the number of references captured. Using the automatic function in the EndNote X7 software, any duplicates will be removed.
The inclusion criteria will be applied by one reviewer to all potential articles at the title and abstract level. Where there is insufficient information to make an informed decision regarding an article’s inclusion, relevance to full text assessment will be assumed. A second reviewer will examine a random subset of at least 10% of the reference list to assess repeatability of the selection criteria. A kappa analysis will be performed to determine agreement between reviewers, with a score of 0.6 or above indicating substantial agreement. Disagreement between reviewers will be discussed and resolved by consensus. This same method will be used to assess the quality assessment and data extraction methods.
A full list of articles excluded at full text with reasons for exclusion will be provided.
All retrieved studies will be assessed for relevance using the following inclusion criteria:
Relevant subject(s) Studies that investigate some aspect of plant traits and how they provide support for the target ecosystem services will be considered for inclusion into the systematic map.
Relevant climate zone Studies that have been undertaken in a region with a temperate climate, i.e. those classified as ‘C’ in Kottek et al. .
Language All languages will be included in initial searches. Only studies published in English will be included in full text assessment. This is due to limited resources and the languages known by the study reviewers.
Date No date restrictions will be applied.
Relevant ecosystem service provided The following support for ecosystem services provided by plant traits will be included: support for pollinators and crop pest natural enemies and water quality protection.
Relevant Population Water quality, pollinator species and natural enemies of insect crop pests.
Relevant exposure Specific plant traits, for example floral display size, leaf area, root length, plant height.
Relevant comparator Lack of traits or alternative traits, for example no floral display.
Relevant outcome Outcomes of each study will be stated as they are found within the relevant articles included and details will be coded into the map accordingly.
Effects on pollinator abundance and diversity, visitation rates and attractiveness.
Effects on natural enemy abundance and diversity or predation rates
Effects on water quality protection including inhibiting pollution from nitrogen, phosphorus, pesticides and sediment levels.
Relevant study design: Any primary research study that collects experimental or quasi-experimental data to investigate the effect of specific plant traits on provision of the named ecosystem services.
Potential sources of bias
Due to limitations on resources, only English language articles will be included in full text assessment. This does limit the number of articles discovered. Further funding to translate relevant articles or employ a reviewer that can understand multiple languages, could help increase the geographical scale of this systematic map.
Study quality assessment
Study quality assessment categories. Modified from Haddaway et al. 
Quality assessment term applied
Other sources of bias
Well-replicated (>10 samples per group)
Random or blocked or exhaustive
Moderate level of replication (4–10 samples per group)
Not stated but clearly random or blocked
Not at all
Poorly-replicated or not stated (1–3 samples per group)
Purposive or not stated
For example, a replicated, randomised control trial with no obvious bias would be categorised with the term ‘yes’ in all cases. No articles will be excluded from the database based on study quality.
Data coding strategy
Target system (e.g. a specific plant species)
Target organism (e.g. specific pollinator species)
Target Ecosystem service
Study site (e.g. greenhouse, pine forest etc.)
Study timing (specific date(s) that the study took place)
Linked study (ID numbers from the article(s) in which the linked study took place will be cross-referenced here)
Country of origin
Climate (e.g. annual average rainfall values), only studies undertaken in temperate regions are to be included
Soil properties (e.g. free or poor draining/nutrient levels)
Time of planting
Species of crop pest natural enemy
Species of pollinator
Data regarding the study characteristics, quality of design and results will be recorded. A notes section will identify any other interesting results such as other ecosystem services provided (e.g. nutrient or carbon cycling or carbon sequestration), but will not be included in further analysis. Where there is more than one article found for a study, each article will be recorded and cross referenced in the database. Also, where there is more than one study within an article, information about each study will be included in the database.
The systematic map database will describe the extent of the research in the field. It will be searchable by topic and can be arranged according to topic areas, publication date, type of ecosystem service, plant species, plant trait, country of study etc. Simple numerical accounts of the frequencies in each category will be able to be obtained from the systematic map. Pivot tables will be generated in order to identify trends in the research.
Where information regarding the reasons for heterogeneity is presented in the studies, it will be recorded e.g. species of pollinator, time of sampling etc. Where necessary and feasible, authors will be contacted for missing/suitable data.
Subject experts will review the completed systematic map database to ensure that all relevant categories have been defined.
Study mapping and presentation
The systematic map will be presented in an Access database, accompanied by a report describing the nature and character of the evidence. Summary graphs and tables of the study characteristics and quality will be presented. Possible knowledge gaps will also be identified, and recommendations will be made for future research based on the findings of the map.
CJB: Design, drafting and revision of protocol. NPR: Conception of project and design of protocol, involved in drafting and revision of protocol, final approval of version. HMC: Participated in the drafting and revision of the manuscript. AW: Participated in the drafting and revision of the manuscript. All authors read and approved the final manuscript.
The authors wish to thank those who commented on a previous draft of the manuscript. Harper Adams University provided access to the library databases.
The authors declare that they have no competing interests. Any reviewers involved in this review that are also authors of relevant articles will not be included in the decisions connected to the inclusion and critical appraisal of the articles.
Availability of data and materials
All data generated or analysed during this study are included in this published article and information files.
This systematic map is funded through a Ph.D. Studentship provided by the Biotechnology and Biological Sciences Research Council and Syngenta Ltd.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Robinson RA, Sutherland WJ. Post-war changes in arable farming and biodiversity in Great Britain. Appl Ecol. 2002;39:157–76.View ArticleGoogle Scholar
- Ehrlich PR, Ehrlich AH. Can a collapse of global civilization be avoided? Proc R Soc B. 2013;280:20122845.View ArticleGoogle Scholar
- Benton TG, Vickery JA, Wilson JD. Farmland biodiversity: Is habitat heterogeneity the key?. Trends Ecol Evol. 2003;18:182–88.View ArticleGoogle Scholar
- Donald PF, Green RF, Heath MF. Agricultural intensification and the collapse of Europe’s farmland bird populations. Proc R Soc B. 2001;268:25–9.View ArticleGoogle Scholar
- Flowerdew JR. Mammal biodiversity in agricultural habitats. In: Kirkwood RC, editor. Biodiversity and conservation in agriculture: proceedings of an international symposium organised by the British Crop Protection Council. 1997. p. 25–40.Google Scholar
- Sotherton NW, Self MJ. Changes in plant and arthropod diversity on lowland farmland: an overview. In: Aebischer NJ, Evans AD, Grice PV, Vickery JA, editors. The ecology and conservation of lowland farmland birds. British Ornithologist's Union; 2000. p. 26–35.Google Scholar
- Klein AM, Vaissiere BE, Cane JH, Steffan-Dewenter I, Cunningham SA, Kremen C, Tscharntke T. Importance of pollinators in changing landscapes for world crops. Proc R Soc B. 2007;274:303–13.View ArticleGoogle Scholar
- Biesmeijer JC, Roberts SPM, Reemer M, Ohlemüller R, Edwards M, Peeters T, Schaffers AP, Potts SG, Kleukers R, Thomas CD, Settele J. Parallel declines in pollinators and insect-pollinated plants in Britain and the Netherlands. Science. 2006;313:351–4.View ArticleGoogle Scholar
- Kevan PG, Phillips TP. The economic impacts of pollinator declines: an approach to assessing the consequences. Conserv Ecol. 2001;5:8.View ArticleGoogle Scholar
- Kremen C, Williams NM, Thorp RW. Crop pollination from native bees at risk from agricultural intensification. Proc Natl Acad Sci USA. 2002;99:16812–6.View ArticleGoogle Scholar
- Garratt MP, Truslove CL, Coston DJ, Evans RL, Moss ED, Dodson C, Jenner N, Biesmeijer JC, Potts SG. Pollination deficits in UK apple orchards. J Pollinat Ecol. 2014;12:9–14.Google Scholar
- Green MB, LeBaron HM, Moberg WK. Managing resistance to agrochemicals. From fundamental research to practical strategies. Washington: American Chemical Society; 1990.View ArticleGoogle Scholar
- Bass C, Denholm I, Williamson MS, Nauen R. The global status of insect resistance to neonicotinoid insecticides. Pest Biochem Physiol. 2015;121:78–87.View ArticleGoogle Scholar
- Arthropod pesticide resistance database. Michigan State University. 2014. http://www.pesticideresistance.com. Accessed 23 Nov 2016.
- Garnett T, Godfray C. Sustainable intensification in agriculture. Navigating a course through competing food system priorities. Food Climate Research Network and the Oxford Martin Programme on the Future of Food. 2012. http://futureoffood.ox.ac.uk/sites/futureoffood.ox.ac.uk/files/SI%20report%20-%20final.pdf. Accessed 29 Nov 2016.
- Fiedler AK, Landis DA, Wratten SD. Maximizing ecosystem services from conservation biological control: the role of habitat management. Biol Control. 2008;45:254–71.View ArticleGoogle Scholar
- Gurr G, Wratten S, Barbosa P. Success in conservation biological control of arthropods. In: Gurr G, Wratten S, editors. Biological control: measures of success. Berlin: Springer; 2010. p. 105–32.Google Scholar
- Rusch A, Chaplin-Kramer R, Gardiner MM, Hawro V, Holland J, Landis D, Thies C, Tscharntke T, Weisser WW, Winqvist C, Woltz M. Agricultural landscape simplification reduces natural pest control: a quantitative synthesis. Agric Ecosyst Environ. 2016;221:198–204.View ArticleGoogle Scholar
- Reichenberger S, Bach M, Skitschak A, Frede H-G. Mitigation strategies to reduce pesticide inputs into ground- and surface water and their effectiveness: a review. Sci Total Environ. 2007;384:1–35.View ArticleGoogle Scholar
- Kuivila KM, Foe CG. Concentrations, transport and biological effects of dormant spray pesticides in the San Francisco Estuary, California. Environ Toxicol Chem. 1995;14:1141–50.View ArticleGoogle Scholar
- Thorburn PJ, Biggs JS, Weier KL, Keating BA. Nitrate in ground waters of intensive agricultural areas in coastal Northeastern Australia. Agric Ecosyst Environ. 2003;94:49–58.View ArticleGoogle Scholar
- Gevao B, Semple KT, Jones KC. Bound pesticide residues in soils: a review. Environ Pollut. 2000;108:3–14.View ArticleGoogle Scholar
- Bommarco R, Kleijn D, Potts SG. Ecological intensification: harnessing ecosystem services for food security. Trends Ecol Evolut. 2013;28:230–8.View ArticleGoogle Scholar
- Kattge J, Diaz S, Lavorel S, Prentice I, Leadley P, Bönisch G, Garnier E, Westoby M, Reich PB, Wright I. TRY–a global database of plant traits. Global Change Biology. 2011;17:2905–35.View ArticleGoogle Scholar
- Kudo G, Ishii HS, Hirabayashi Y, Ida TY. A test of the effect of floral color change on pollination effectiveness using artificial inflorescences visited by bumblebees. Oecologia. 2007;154:119–28.View ArticleGoogle Scholar
- Bianchi F, Wackers FL. Effects of flower attractiveness and nectar availability in field margins on biological control by parasitoids. Biol Control. 2008;46:400–8.View ArticleGoogle Scholar
- Burylo M., Dutoit T, Rey F. Species traits as practical tools for ecological restoration of marly eroded lands. Restoration Ecol. 2014;22:633–40.View ArticleGoogle Scholar
- Hackett M, Lawrence A. Multifunctional role of field margins in arable farming. European Crop Protection Association, Cambridge Environmental Assessments, ADAS UK Ltd. http://www.ecpa.eu/files/attachments/Field%20Margins%20Arable%20Farming_V02.pdf (2014). Accessed 23 Feb 2015.
- European commission: Environment. The Habitats Directive http://ec.europa.eu/environment/nature/legislation/habitatsdirective/index_en.htm (2016). Accessed 29 March 2016.
- European commission: Environment. Introduction to the new EU Water Framework Directive http://ec.europa.eu/environment/water/water-framework/info/intro_en.htm (2016). Accessed 29 Mar 2016.
- European commission: Agriculture and biodiversity. http://ec.europa.eu/agriculture/envir/biodiv/index_en.htm (2016). Accessed 29 Mar 2016.
- European commission: Agriculture and Water. http://ec.europa.eu/agriculture/envir/water/index_en.htm (2016). Accessed 29 Mar 2016.
- European commission: Agriculture and Pesticides. http://ec.europa.eu/agriculture/envir/pesticides/index_en.htm (2016). Accessed 29 Mar 2016.
- European commission: Soil and agriculture http://ec.europa.eu/agriculture/envir/pesticides/index_en.htm (2016). Accessed 29 Mar 2016.
- United Nations, Department of Economic and Social Affairs, Population Division: World population prospects, the 2015 Revision. http://esa.un.org/unpd/wpp/DataQuery/ (2015). Accessed 31 Mar 2016.
- Godfray HC, Beddington JR, Crute IR, Haddad L, Lawrence D, Muir JF, Pretty J, Robinson S, Thomas SM, Toulmin C. Food security: the challenge of feeding 9 billion people. Science. 2010;327:812–8.View ArticleGoogle Scholar
- Stutter MI, Chardon WJ, Kronvang B. Riparian buffer strips as a multifunctional management tool in agricultural landscapes. J Environ Qual. 2012;41:297–303.View ArticleGoogle Scholar
- Syngenta UK Ltd. Grower’s guidelines. Operation pollinator: multifunctional landscapes. Cambridge: Syngenta UK Ltd; 2014.Google Scholar
- Ecostac. Optimising Ecosystem Services in Terms of Agronomy and Conservation. http://www.lancaster.ac.uk/lec/sites/ecostac/seed_selection.php (2009). Accessed 4 Nov 2016.
- Kottek M, Grieser J, Beck C, Rudolf B, Rubel F. World map of the Köppen-Geiger climate classification updated. Meteorol Z. 2006;15:259–63.View ArticleGoogle Scholar
- Collaboration for Environmental Evidence: Guidelines for Systematic Review in Environmental Management. Version 4.0. http.//www.environmentalevidence.org/Authors.htm (2010). Accessed 23 Feb 2015.
- Randall NP, James KL. The effectiveness of integrated farm management, organic farming and agri-environment schemes for conserving biodiversity in temperate Europe: a systematic map. Environ. Evid.. 2012;1:4.View ArticleGoogle Scholar
- Stevens A, Milne R. The effectiveness revolution and public health. In: Scalley G, editor. Progress in Public Health. London: Royal Society for Medicine Press; 1997. p. 197–225.Google Scholar
- Pullin AS, Knight, TM. Effectiveness in conservation practice: pointers from medicine and public health. Conserv Biol. 2001;15:50–4.View ArticleGoogle Scholar
- Haddaway NR, Styles D, Pullin AS. Evidence on the environmental impacts of farm land abandonment in high altitude/mountain regions: a systematic map. Environ Evid. 2014;3:17.View ArticleGoogle Scholar