Table 2. Estimated probability of success for the least and most consistent standard setters in test 1
Item SS 2 SS 8
AR CP Max.err AR CP Max.err
1 0.6 0.47 0.53 0.65 0.52 0.52
2 0.75 0.85 0.85 0.7 0.92 0.92
3 0.5 0.48 0.52 0.5 0.53 0.53
4 0.75 0.41 0.59 0.7 0.47 0.53
5 0.5 0.54 0.54 0.5 0.60 0.60
6 0.45 0.50 0.50 0.55 0.62 0.62
7 0.5 0.47 0.53 0.6 0.53 0.53
8 0.6 0.35 0.65 0.7 0.42 0.58
9 0.6 0.55 0.55 0.55 0.61 0.61
10 0.6 0.59 0.59 0.5 0.68 0.68
11 0.6 0.64 0.64 0.45 0.71 0.71
12 0.7 0.58 0.58 0.7 0.66 0.66
13 0.75 0.83 0.83 0.8 0.91 0.91
14 0.8 0.31 0.69 0.75 0.36 0.64
15 0.4 0.58 0.58 0.55 0.70 0.70
16 0.6 0.35 0.65 0.65 0.42 0.58
17 0.6 0.58 0.58 0.7 0.65 0.65
18 0.5 0.55 0.55 0.6 0.65 0.65
19 0.4 0.53 0.53 0.4 0.59 0.59
20 0.4 0.54 0.54 0.45 0.59 0.59

Note: SS= standard setter; AR= Original Angoff rating; CP= Conditional Probability. Max.err= The maximum absolute value of the error of specification.

 Int J Med Educ. 2023; 14:123-130; doi: 10.5116/ijme.64ed.e296