The R Journal: accepted article

This article will be copy edited and may be changed before publication.

krippendorffsalpha: An R Package for Measuring Agreement Using Krippendorff's Alpha Coefficient PDF download
John Hughes

Abstract R package krippendorffsalpha provides tools for measuring agreement using Krippen dorff’s α coefficient, a well-known nonparametric measure of agreement (also called inter-rater reliability and various other names). This article first develops Krippendorff’s α in a natural way, and situates α among statistical procedures. Then the usage of package krippendorffsalpha is illustrated via analyses of two datasets, the latter of which was collected during an imaging study of hip cartilage. The package permits users to apply the α methodology using built-in distance functions for the nominal, ordinal, interval, or ratio levels of measurement. User-defined distance functions are also supported. The fitting function can accommodate any number of units, any number of coders, and missingness. Bootstrap inference is supported, and the bootstrap computation can be carried out in parallel.

Received: 2020-10-30; online 2021-06-08
CRAN packages: krippendorffsalpha, irr, icr, irrCAC, pbapply
CRAN Task Views implied by cited CRAN packages: HighPerformanceComputing, Psychometrics

CC BY 4.0
This article is licensed under a Creative Commons Attribution 4.0 International license.

  author = {John Hughes},
  title = {{krippendorffsalpha: An R Package for Measuring Agreement
          Using Krippendorff's Alpha Coefficient}},
  year = {2021},
  journal = {{The R Journal}},
  doi = {10.32614/RJ-2021-046},
  url = {}