ANROWS Instrument for assessing Risk of bias in quantitative Impact Studies (ANROWS-IRIS): Risk of bias rating tool

Abstract

The ANROWS Instrument for assessing Risk of bias in quantitative Impact Studies (ANROWS-IRIS) is a bespoke risk of bias tool developed as part of the ANROWS Evidence Portal. It has been designed for use with the quantitative impact evaluations included in the ANROWS Evidence Portal as well as for systematic reviews in the social and psychological sciences more broadly. The tool is designed to be applied to quantitative impact evaluations of interventions to critically appraise them across six domains that collectively examine whether the design, reporting and implementation of an evaluation study can support the conclusion that the intervention caused a change in the measured outcomes, or if study flaws are likely to lead to over- or underestimates of the effect of the intervention.