While high stakes exams have always been an integral part of education, certain standardized admissions tests invite disproportionate discussion about their value relative to essentially anything else. The roller coaster of test optional policies only adds uncertainty to questions about the utility of the SAT & ACT at a time when these finely tuned assessments may actually be better than ever in terms of providing critical insight into relative academic ability and college readiness. What makes tests like these so effective?
When we consider whether an exam is worth our time, we look at three critical factors: validity, reliability, and fairness.
VALIDITY
Test validity describes the degree to which a test measures what it claims to measure. The higher the validity, the more closely linked the test is to its stated focus. As College Board has said, tests themselves are not valid or invalid. Instead, we validate the use of a test score. This point deserves attention because much of the misinformation and anxiety around influential assessments arise from invalid interpretation of otherwise useful scores. The type of validity most valued in admissions tests like the SAT & ACT is predictive validity.
UPSHOT: A test has high validity is worth preparing for.
RELIABILITY
Test reliability describes the stability or consistency of measurement over time. Similar inputs should produce similar results time after time. Of critical importance in standardized testing is test-retest reliability, which refers to exam consistency among different administrations. Tests that lack this level of reliability cannot be trusted because scores from different administrations would not be comparable.
UPSHOT: A test has high reliability can be effectively prepared for.
FAIRNESS
Test fairness describes its freedom from any kind of bias. Truly objective standardized tests should be appropriate for all qualified test takers regardless of race, religion, gender, social class, or age. This means that each question must be carefully crafted and screened to ensure that it tests only what it is intended to test without bias. The SAT struggled with a reputation as a “wealth test” for years, particularly after the infamous OARSMAN:REGATTA scandal that ultimately led to the 2005 demise of the Analogies question type.
UPSHOT: A test has high fairness provides a level playing field for test takers.
The SAT & ACT, both forged and reforged in the crucible of public scrutiny and controversy, have emerged as model citizens in the society of standardized tests. Dogged for decades by questions of bias or relevance, these classic college admissions tests improve every year in validity, reliability, and fairness. Of course, the public must remain vigilant as long as so much rides on test scores, but, at least for now, these exams are worth preparing for, can be prepared for, and provide a level playing field for test takers.
Mike Bergin