krippendorffsalpha: An R Package for Measuring Agreement Using Krippendorff’s Alpha Coefficient

R package krippendorffsalpha provides tools for measuring agreement using Krippendorff’s α coefficient, a well-known nonparametric measure of agreement (also called inter-rater reliability and various other names). This article first develops Krippendorff’s α in a natural way and situates α among statistical procedures. Then, the usage of package krippendorffsalpha is illustrated via analyses of two datasets, the latter of which was collected during an imaging study of hip cartilage. The package permits users to apply the α methodology using built-in distance functions for the nominal, ordinal, interval, or ratio levels of measurement. User-defined distance functions are also supported. The fitting function can accommodate any number of units, any number of coders, and missingness. Bootstrap inference is supported, and the bootstrap computation can be carried out in parallel.

John Hughes
2020-10-30

CRAN packages used

krippendorffsalpha, irr, icr, irrCAC, pbapply

CRAN Task Views implied by cited packages

HighPerformanceComputing, Psychometrics

Reuse

Text and figures are licensed under Creative Commons Attribution CC BY 4.0. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".

Citation

For attribution, please cite this work as

Hughes, "The R Journal: krippendorffsalpha: An R Package for Measuring Agreement Using Krippendorff's Alpha Coefficient", {The R Journal}, 2020

BibTeX citation

@article{RJ-2021-046,
  author = {Hughes, John},
  title = {The R Journal: krippendorffsalpha: An R Package for Measuring Agreement Using Krippendorff's Alpha Coefficient},
  journal = {{The R Journal}},
  year = {2020},
  note = {https://doi.org/10.32614/RJ-2021-046},
  doi = {10.32614/RJ-2021-046},
  volume = {13},
  issue = {1},
  issn = {2073-4859},
  pages = {413-425}
}