The R Journal: article published in 2021, volume 13:1

krippendorffsalpha: An R Package for Measuring Agreement Using Krippendorff's Alpha Coefficient PDF download
John Hughes , The R Journal (2021) 13:1, pages 413-425.

Abstract R package krippendorffsalpha provides tools for measuring agreement using Krippendorff’s α coefficient, a well-known nonparametric measure of agreement (also called inter-rater reliability and various other names). This article first develops Krippendorff’s α in a natural way and situates α among statistical procedures. Then, the usage of package krippendorffsalpha is illustrated via analyses of two datasets, the latter of which was collected during an imaging study of hip cartilage. The package permits users to apply the α methodology using built-in distance functions for the nominal, ordinal, interval, or ratio levels of measurement. User-defined distance functions are also supported. The fitting function can accommodate any number of units, any number of coders, and missingness. Bootstrap inference is supported, and the bootstrap computation can be carried out in parallel.

Received: 2020-10-30; online 2021-06-08, supplementary material, (709 bytes)
CRAN packages: krippendorffsalpha, irr, icr, irrCAC, pbapply
CRAN Task Views implied by cited CRAN packages: HighPerformanceComputing, Psychometrics

CC BY 4.0
This article and supplementary materials are licensed under a Creative Commons Attribution 4.0 International license.

  author = {John Hughes},
  title = {{krippendorffsalpha: An R Package for Measuring Agreement
          Using Krippendorff's Alpha Coefficient}},
  year = {2021},
  journal = {{The R Journal}},
  doi = {10.32614/RJ-2021-046},
  url = {},
  pages = {413--425},
  volume = {13},
  number = {1}