Assessing community-based conservation projects: A systematic review and multilevel analysis of attitudinal, behavioral, ecological, and economic outcomes

Table 10 Results of inter-coder reliability test comparing researchers coding of a paper with the responses of corresponding authors to a questionnaire distributed by the researchers

Variable name	Cohen’s Kappa
Project impetus	0.49
Establishment	0.47
Decision-making	0.61
Approach local culture	0.84
Approach local institutions	0.58
Resource use	−0.14
Economic benefits	0.10
Equitable distribution	0.32
Elite capture	0.25
Capacity skills	0.18
Capacity institutions	0.08
Social capital	0.24
Environmental education	0.26
Market integration	0.13
Supportive local culture	0.32
Effective local government	0.46
Tenure	0.35
Charisma	−0.09
Population size	0.78
Population heterogeneity	0.62
Attitudinal outcomes	0.66
Behavioral outcomes	0.56
Ecological outcomes	0.67
Economic outcomes	0.52

Kappa values greater than 0.40 indicate moderate agreement, greater than 0.60 indicate substantial agreement, and greater than 0.80 indicate almost perfect agreement [89]. Negative values close to zero indicate that the disagreement between researchers and authors was likely due to chance, while larger negative values suggest that researchers and authors had a different perception of how to code for that variable. Note that not all variables were included in the questionnaire for authors.

ISSN: 2047-2382