Test Retest Reliability of the Adaptive Chemistry Assessment Survey for Teachers: Measurement Error and Alternatives to Correlation
Determining the error of measurement is a necessity for researchers engaged in bench chemistry, chemistry education research (CER) and a multitude of other fields. Discussions regarding what constructs measurement error entails and how to best measure them have occurred, but the critiques about traditional measures have yielded few alternatives. We present a brief review of psychometric reliability from its beginning in the early 1900s as well as a summary of critiques of the test retest reliability coefficient. Then, we posit our own novel measurement, the zeta range estimator, to assist in quantifying and accounting for measurement error that those interested in educational researchers will find beneficial. We provide a proof of concept using simulated data and then analyze the reliability of items on the Adaptive Chemistry Assessment Survey for Teachers, a survey designed to characterize data driven inquiry. While the focus is for CER, the zeta range estimator also holds significant value for those ou.