In addition to “chance,” there are 4 other sources of bias that can obscure interpretation of interobserver agreement.
Describe each source of bias.
reactivity of reliability assessment - bx changes when you know your work is being checked
observer drift - change in the application of definitions of bx over time
Expectancies and Feedback - when observers expectations of change and feedback from experimenters combine, it may influence data taken by observer
Complexities of observations - the less complex the observations, the higher the agreement