An Open Source R/Shiny app for assessing the inter-rater agreement for nominal or ordinal scales.
Everything that you need is free, and can be downloaded in a few minutes.
- R from http://www.r-project.org/
- RStudio from http://www.rstudio.com/products/rstudio/download/
- The three source files in this repository that end with .R.
Create a folder somewhere called InterRaterFacets, and put the three .R files in it. Then launch RStudio and load the necessary libraries by running at the command prompt (lower left window):
install.packages(c("shiny","tidyr","ggplot2"))
Now use the File menu to find and open ui.R in the InterRaterFacets folder. Look for a green arrow with "Run App" near the top of the screen. Click that to run the app.
For instructions and implementation notes, see the wiki: http://github.com/stanislavzza/Inter-Rater/wiki