An Analysis of Accommodations Issues from the Standards and Assessments Peer Review. Technical Report 51.
A report commissioned by the Accommodations Monitoring Study Group of the Assessing Special Education Students State Collaborative on Assessment and Student Standards. It is the second in a three-part series providing information to states about the monitoring of accommodations to address the question of how states meet the NCLB requirement to routinely monitor the extent to which test accommodations are consistent with those provided during instruction, specifically for students with IEPs. This technical report provides a comprehensive analysis of the peer review guidance information and the methodology used in the research, as well as summarizing themes found across multiple peer reviews of state assessment systems. The first report in the series is Hints and Tips for Addressing Accommodations Issues for Peer Review.
A Summary of the Research on the Effects of Test Accommodations: 2007-2008. Technical Report 56.
The use of accommodations for both instruction and assessment continues to be of great importance for students with disabilities. Numerous efforts are underway to ensure that students with disabilities participate meaningfully in more inclusive classrooms and large-scale assessments. Still, there is a need for greater understanding of the ways in which accommodations are selected and implemented during classroom instruction and assessments. The purpose of this report is to provide an update on the state of the research on testing accommodations, as well as to identify promising areas of research likely to contribute to understanding of current and emerging issues.
Item-Level Comparative Analysis of Online and Paper Administrations of the Texas Assessment of Knowledge and Skills
This article describes a comparative study conducted at the item level for paper and online administrations of a statewide high stakes assessment. The goal was to identify characteristics of items that may have contributed to mode effects. Item-level analyses compared two modes of the Texas Assessment of Knowledge and Skills (TAKS) for up to four subjects at two grade levels. The analyses included significance tests of p-value differences, DIF, and response distributions for each item. Additional analyses investigated item position effects and objective-level mode differences. No evidence of item position effects emerged, but significant differences were found for several items and objectives in all subjects at grade 8 and in mathematics and English language arts (ELA) at grade 11. Differences generally favored the paper group. ELA items that were longer in passage length and math items that required graphing and geometric manipulations or involved scrolling in the online administration tended to be the items showing mode differences.