Wednesday, July 1, 2020

4 Mistakes the College Board Made Regarding the June SAT

I want to preface my criticism by acknowledging that College Board and ETS took what was a horrible situation — and that was their own doing, mind you — and made it better than it might have been. At the end of the day, the same cannot be said of any number of corporate mistakes. And yet Most well-advised companies have learned a PR protocol for dealing with â€Å"disasters† — tainted food, product recalls, CEO meltdowns. College Board apparently missed many of those lessons. 1) Take Responsibility When reports first started developing, College Board only put a small blurb on its website that it was investigating the problem and, essentially, putting all of the blame on ETS. On Monday, the release was updated to glibly minimize the problem and act as if College Board had been prepared for this all along. And it still kept the finger pointed at ETS. Students don’t care about blame; they care about scores and college applications. Emphasizing the role of ETS served to minimize College Board’s control over the SAT — not a good thing when it is making the most dramatic overhaul in 75 years. Pretending that the SAT was constructed to handle just this sort of doomsday scenario was tone deaf and implied that College Board had been over-testing students by a third for decades. 2) Put Senior Executives Out Front Unsigned web posts and grudging statements from communication directors imply that the College Board did not take the issue seriously — an issue that impacts almost 500,000 testers! If College Board President David Coleman can’t be bothered to address the problem, what more important tasks is he working on? 3) Solutions, not Spin Explain why the mistake happened, what steps have been taken to prevent it in the future, and what solutions are being offered. To its credit, College Board did come out with a partial solution on Monday. It did not handle everything well and did not think through the obvious follow-up questions from students — Will these scores hurt me? Can I cancel the scores? Can I retake the test for free? Have you surveyed your college membership to make sure that they’ll accept my scores? College Board has yet to provide any hard data to back up its claims. Spin also created an obvious  dissonance. College Board was quick to trumpet the fact that the multi-section structure of the SAT saved the day. One can almost hear the movie trailer voice in the statement that test administrations can be fragile, so our assessments are not.    College Board  was probably a little too quick to trumpet that fact. The redesigned SAT — the one that they have been heavily promoting and that will arrive in March 2016 — is not based on a multi-section structure, and cross-domain scores mean that sections are inter-dependent. One printing error on the new SAT and everything has to be wiped clean. It could be argued that the simpler structure — also in use by the ACT — will be less confusing and less prone to printing errors. The idea that the College Board had an extra section in reserve is unsupported by any evidence. Nowhere in the original construction documents, decades of research, multiple technical manuals, and specifications for several test re-workings can I find any mention of superfluous questions added to make the test resilient to fire drills and power outages to mistiming and disruptive behavior. Creating hundreds of extra questions is expensive. Printing and shipping costs would go up. And proctoring and other administrative costs would be much higher. In short, College Board and ETS would have been spending millions of dollars each year to protect against a once-in-a-lifetime event. 4) Don’t let rumors and opponents take the lead. Get ahead of the story. Rumors and fear swept through online forums and social media while the College Board remained mum. It has been in catch-up mode throughout the incident. College Board is compounding its pain by responding in bits and pieces. The error impacted 1 section. The error impacted 2 sections. Students might receive a free October test. They might not. They will. College Board kept referring back to a changing web post rather than explaining things fully to their audience. Not once has College Board tweeted any information about the situation. Every delay or change in the story hands a megaphone to SAT opponents such as Bob Schaeffer at FairTest. It must have left some folks at the ACT headquarters in Iowa City sniggering. Earlier this spring ACT put out a piece extolling its own long-term consistency and making a not-even-thinly-veiled attack on the new SAT’s radical redo and the tests previous revisions and score recentering. The title of the ACT piece sounds prophetic in retrospect: Why Scores on the ACT Test Are Scores You Can Trust. The fact is that this sort of printing error could have happened to ACT or Pearson or ETS, and no testing company is setup to deal with the scope of what developed on June 6. It happened to the SAT, though, and College Board needs to be the one addressing it fully. Want to learn how students should respond to mishaps on test day? We have come up with six strategies that every student should know.

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.