Summary of Reliability Information of the
Four estimates of the reliability of the Regents Comprehensive Examination in English are summarized below. The first three address interrater reliability of the open-ended scoring, and the fourth addresses, internal consistency of all test questions.
I. Department Review of Regents Comprehensive Examination in English, June 1999
II. Range Holistic Scoring Agreement for pretest: .87 — .94**
III. Agreement of Scores — correlation of field test to operational test: .98***
IV. Internal Consistency Reliability:**** .89 (Form A) (Field Test) .89 (Form B)
* The Department will compile statistics on how many changes were made per paper for a more accurate estimate of agreement.
*** Assessment and Evaluation Services — an estimate of interrater agreement
**** Assessment and Evaluation Services