Table 4 Critical appraisal data sheet to be completed for each study when assessing study validity
Validity domain | Parameter | Optional entries [free text if empty] |
|---|---|---|
Sampling strategy | Number of replicates | Â |
Number of sampling points per replicate | Â | |
Scale of studied ecosystem (m2) | 1–10/> 101–102/> 102–103/> 103–104/> 104–105/> 105 | |
Total study length (years) | Â | |
Follow-up period after treatments (days) | Â | |
Sampling frequency | Â | |
Study design details | Study design | BA/CI/BACI/RCT/other [specify] |
Group matching | Independent groups/matched pairs | |
Randomisation of treatment allocation | Yes/yes, within pairs/no/unclear | |
Selection bias | Risk of selection bias | Low/probably low/probably high/high/unclear |
Appropriateness of control sites relative to treated sites based on their ecological similarity | Yes/no/unclear | |
Comment on risk of selection bias | Â | |
Performance bias | Reported or suspected confounding factor | Yes/no/unclear |
Reported or suspected time-related trend | Yes/no/unclear | |
Reported or suspected contamination of study groups | Yes/no/unclear | |
Risk of performance bias | Low/probably low/probably high/high/unclear | |
Comment on risk of Performance bias | Â | |
Detection bias | Differences in sampling or measuring methods between study groups | Yes/no/unclear |
Differences in sampling timing | Yes/no/unclear | |
Differences in sampling efficiency | Yes/no/unclear | |
Risk of detection bias | Low/probably low/probably high/high/unclear | |
Comment on risk of detection bias | Â | |
Reporting bias | All measured outcomes reported | Yes/no [specify] |
External validity | Target species | Â |
Effect on target species | Aimed effect achieved/other significant effect [specify]/no significant effect/not reported | |
Dose and frequency of treatments | Â | |
Comment on external validity | Â |