Two-rater Agreement and Kappa Review

How to use Two-rater Agreement and Kappa Review

Read one ordered category-by-category count table. Agreement weights are exact identity, linear distance or squared distance weights. Observed and independent-marginal agreement produce kappa, while a degenerate expected agreement of one remains explicitly undefined.

1. Enter model json (schema and units below).
2. Choose the stated convention and check the units and supported model.
3. Calculate, inspect the result, then copy or download it.

Good to know

• Plain decimal JSON numbers or strings, at most six fractional places, magnitude at most 1,000,000,000; raw numeric spellings and duplicate object members are checked. Exact rational arithmetic is capped at 8,192 bits. Text is at most 30,000 characters; a local JSON download preserves exact fractions or full stored approximate numbers. 2–20 ordered categories and square whole counts 0–1,000,000. Exactly two raters rating the same records, with no missing pairs. Ordinal weighting uses your category order. No universal interpretation thresholds, rater truth, test-retest model or confidence interval.
• Local calculation only; no input persistence or external lookup. Text/JSON is limited to 30000 characters and output to 1000000 characters. Numeric model inputs and precision/work limits are stated on this page. Approximate JSON numbers retain full stored values; exact arithmetic outputs retain decimal or fraction strings. Unsupported states fail explicitly.