Hypotheses for Attribute Agreement Analysis

For an attribute agreement analysis, you test agreement by looking at the p-values for kappa statistics and Kendall's coefficients.

Hypotheses for Kappa

For Within Appraiser, the hypotheses to test for agreement are:
  • H0: the agreement within appraiser is due to chance.
  • H1: the agreement within appraiser is not due to chance.
For Each Appraiser vs Standard, the hypotheses to test for agreement are:
  • H0: the agreement between appraisers' ratings and the standard is due to chance.
  • H1: the agreement between appraisers' ratings and the standard is not due to chance.
For Between Appraisers, the hypotheses to test for agreement are:
  • H0: the agreement between appraisers is due to chance.
  • H1: the agreement between appraisers is not due to chance.
For All Appraisers vs Standard, the hypotheses to test for agreement are:
  • H0: the agreement between appraisers' ratings and the standard is due to chance.
  • H1: the agreement between appraisers' ratings and the standard is not due to chance.

Hypotheses for Kendall's Coefficient

For Within Appraiser, the hypotheses to test for agreement are:
  • H0: there is no association among multiple ratings made by an appraiser.
  • H1: the ratings within appraiser are associated.
For Each Appraiser vs Standard, the hypotheses to test for agreement are:
  • H0: there is no association between the ratings of each appraiser and standard.
  • H1: the ratings by each appraiser are associated with the standard.
For Between Appraisers, the hypotheses to test for agreement are:
  • H0: there is no association between the appraisers' ratings.
  • H1: the ratings between appraisers are associated.
For All Appraisers vs Standard, the hypotheses to test for agreement are:
  • H0: there is no association between ratings of all appraisers and the known standard.
  • H1: the ratings by all appraisers are associated with the known standard.
By using this site you agree to the use of cookies for analytics and personalized content.  Read our policy