Confidence interval for two kappa reliability coefficients

Source: R/statpsych3.R

Computes confidence intervals for the intraclass kappa coefficient and Cohen's kappa coefficient with two dichotomous ratings.

ci.kappa(alpha, f00, f01, f10, f11)

Arguments

alpha

alpha level for 1-alpha confidence

f00

number of objects rated y = 0 and x = 0

f01

number of objects rated y = 0 and x = 1

f10

number of objects rated y = 1 and x = 0

f11

number of objects rated y = 1 and x = 1

Value

Returns a 2-row matrix. The results in row 1 are for the intraclass kappa. The results in row 2 are for Cohen's kappa. The columns are:

  • Estimate - estimate of interrater reliability

  • SE - standard error

  • LL - lower limit of the confidence interval

  • UL - upper limit of the confidence interval

References

Fleiss JL, Paik MC (2003). Statistical Methods for Rates and Proportions, 3rd edition. Wiley.

Examples

ci.kappa(.05, 31, 12, 4, 58)
#>               Estimate         SE        LL        UL
#> IC kappa:    0.6736597 0.07479965 0.5270551 0.8202643
#> Cohen kappa: 0.6756757 0.07344761 0.5317210 0.8196303

# Should return:
#               Estimate         SE        LL        UL
# IC kappa:    0.6736597 0.07479965 0.5270551 0.8202643
# Cohen kappa: 0.6756757 0.07344761 0.5317210 0.8196303