Simulated annealing for maximum rater agreement

In this work we consider the weighted kappa as a measure of rater agreement for ordinal variables, and we use a simulated annealing algorithm to find the maximum agreement configuration. The proposed algorithm allow us to show, through some examples, that the maximum agreement depends strongly on the choice of the weighting scheme.