SABER Seminar Series 2023: What am I actually measuring? The role of validity evidence in STEM education research

STEM education researchers often rely on instruments (surveys, assessments, etc.) to measure variables such as attitudes, understanding, or behaviors. These measurements are frequently used to make decisions about the impact or effectiveness of an intervention or practice. However, not all measurements are created equal. Validity evidence is necessary to demonstrate that relevant variables are being measured accurately in order to support conclusions drawn from the data. This talk will discuss standards for providing validity evidence and considerations for instrument developers and users. Relevant examples from the STEM education literature will be provided and a resource in chemistry education, the Chemistry Instrument Review and Assessment Library (CHIRAL; chiral.chemedx.org) will be highlighted.