R package krippendorffsalpha provides tools for measuring agreement using Krippendorff’s \(\alpha\) coefficient, a well-known nonparametric measure of agreement (also called inter-rater reliability and various other names). This article first develops Krippendorff’s \(\alpha\) in a natural way and situates \(\alpha\) among statistical procedures. Then, the usage of package krippendorffsalpha is illustrated via analyses of two datasets, the latter of which was collected during an imaging study of hip cartilage. The package permits users to apply the \(\alpha\) methodology using built-in distance functions for the nominal, ordinal, interval, or ratio levels of measurement. User-defined distance functions are also supported. The fitting function can accommodate any number of units, any number of coders, and missingness. Bootstrap inference is supported, and the bootstrap computation can be carried out in parallel.
Supplementary materials are available in addition to this article. It can be downloaded at RJ-2021-046.zip
Text and figures are licensed under Creative Commons Attribution CC BY 4.0. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".
For attribution, please cite this work as
Hughes, "krippendorffsalpha: An R Package for Measuring Agreement Using Krippendorff's Alpha Coefficient", The R Journal, 2021
BibTeX citation
@article{RJ-2021-046,
author = {Hughes, John},
title = {krippendorffsalpha: An R Package for Measuring Agreement Using Krippendorff's Alpha Coefficient},
journal = {The R Journal},
year = {2021},
note = {https://doi.org/10.32614/RJ-2021-046},
doi = {10.32614/RJ-2021-046},
volume = {13},
issue = {1},
issn = {2073-4859},
pages = {413-425}
}