Skip Navigation

Interrater Agreement

Inter-rater Agreement is the degree to which two raters using the same scale give the same rating in identical situations.

  • Reliable raters agree with the "official" rating of an evaluation example.
  • Reliable raters agree with each other about the exact ratings to be awarded.
  • Reliable raters agree about which evaluation example is better and which is worse.

Inter-rater Agreement are essential to:

  • Bridge the credibility gap.
  • Train raters.
  • Monitor system performance.
  • Link professional development to evaluation results.

Within the evaluation process, Inter-rater Agreement are used during:

  • Teacher and Building Leader observations.
  • Teacher and Building Leader artifact reviews.
  • Teacher and Building Leader summary ratings #1 and #2.
  • Teacher and Building Leader final summative evaluation ratings.

 Inter-rater Agreement trainings at the district level need to include:

  • Team discussions and agreements about Inter-rater Reliability and Inter-rater Agreement.
  • Team review of data collection and analysis.
  • Training design at preservice and inservice levels.
  • Regular training check-ups.
  • Coaching and observation.
  • Monitoring ratings.

Educator Evaluation Contacts

Copyright 2024 by Kansas State Department of Education | 900 SW Jackson St. | Topeka, KS 66612 Privacy Statement  |  Terms Of Use  |  System Maintenance Notices  |  Open Records (PDF)

The Kansas State Department of Education does not discriminate on the basis of race, color, religion, national origin, sex, disability, or age in its programs and activities. (more information...)


To accommodate people with disabilities, on request, auxiliary aides and services will be provided and reasonable modifications to policies and programs will be made. To request accommodations or for more information please contact the Office of General Counsel at gc@ksde.org or by 785-296-3201.