The educational legislation known as No Child Left Behind was initially embraced by the education and the public policy sectors, but since its inception criticisms have grown as to such effectiveness of policies that advocate for standardized testing versus more traditional assessment methods. Nevertheless, standardized testing has grown to include higher education, spurred in part by a 2005 Department of Education commission report lamenting the lack of transparency in higher ed practices. In response, many U.S. colleges and universities have adopted standardized student outcomes assessments and partnered with organizations such as Voluntary System of Accountability to better meet accreditation requirements, evaluate teaching effectiveness and, on the national stage, provide the foundation for educational policy recommendations.
These tests may prove useful to higher education institutions, but observers say that their accuracy may be suspect, as the tests typically don’t effect a student’s grade and they are less inclined to try to do their best. Attempts to incentivize test takers with better course grades and/or financial incentives have proved successful in the past, but are not always possible to implement on a wide scale.
A 2012 study from the Educational Testing Service in Princeton, N.J., published in Educational Researcher, “Measuring Learning Outcomes in Higher Education: Motivation Matters,” investigates the links between student motivation, motivational instruction and test format on standardized test scores. More than 750 participants representing a mix of race, gender and academic aptitude with at least one year of college experience were offered $50 to complete a 36-item multiple-choice test and essay question online, followed by a survey that measured student motivation. Students signed one version of three possible consent forms: 1) individual test results could be shared with faculty and potential employers (the “personal” condition); 2) individual test results would be private, but scores would be averaged from all participants from that college and could be shared with faculty and employers (the “institutional” condition); or, 3) test results were for research purposes only and would not be shared (the “control” condition).
Key study findings included:
- “Students do not exert their best effort in taking low-stakes outcomes assessments … [C]onclusions about value-added learning changed dramatically depending on the test of choice and the motivation levels.” There was no difference in overall performance outcomes across the three participating higher educational institutions involved in the study: a research institution, a master’s institution and a community college.
- Student motivation and performance were both consistently higher for the multiple choice component of the test. The researchers suggest that essay tests require more effort and motivation.
- Motivated sophomores performed as well as the typical senior regardless of condition: with respect to test performance, “the motivational effect for sophomores was as large as 2 years of college education.”
- Students assigned to the “personal” condition group performed on average 41% better than those in the control group; those assigned to the “institutional” condition group performed on average 23% better than control group participants. Students in the “personal” group also scored significantly higher on the personal essay component of the test.
- The researchers suggest that many factors may influence student motivation levels, and that while linking a bonus to student performance may encourage performance, there are ways to motivate students that do not incur financial costs.
- Seniors in the institutional condition did not excel at the essay-writing component of the test: “it may take a stronger reason than caring about one’s institutional reputation for seniors to be serious about writing an essay.”
The researchers suggest that low student motivation on standardized tests has likely resulted in underperformance; this could influence an institution’s reputation for good or ill: “Institutions doing a good job of motivating students could achieve significantly higher rankings than institutions doing a poor job of motivating students, even though their students may have comparable academic abilities.”
Past research has also found that motivation and test performance are linked. A 2007 study shows that “some individuals do not try their best when no performance based incentives are provided, though these individuals are not the less able ones.”
Tags: youth, higher education