Robo-Readers and Robo-Graders are proposed programmes that may one day replace humans when it comes to assessing quality in an essay. Some programs, like the e-Rater, can rate 16,000 essays in 20 seconds. (Winerip) They use algorithms based on what makes a "good" essay without taking into account every factor that truly does make an essay good. (ETS, Winerip) This is an alarming prospect.
The Robo-Readers and Robo-Graders use algorithms and rules to score the essays. Not only is this one-sided and superficial and insufficient when it comes to grading a paper holistically, but it makes it easy for those who desire to cheat on their standardized test. They can throw in words, phrases, and make their essay longer to take advantage of the Robo-Grader's rigid rules. An essay can be completely nonsensical and generally poorly written and yet receive a high score because it contains everything the algorithms are looking for. (Winerip) A teacher would give an essay filled with nonsense key words a bad grade. They would realize what's going on, when a computer has little or no way of distinguishing between key words that fit because they are simply there and keywords that fit because they are part of a well-written essay.
Another unfortunate aspect of assessment that the readers lack is the consideration of poetic and unconventional writing. Teachers may grade a paper better if they are strikingly well written and make the paper pleasant to read. (Simon) A computer would simply look at the words processed and not care what lyrical order they are in or how engaging and beautiful the words they process are.
That's not to say these Robo-Graders have no benefits. They are exponentially quicker than human graders and don't take things into account like personal beliefs (even subconsciously, human graders may hold these) or frustration with sloppy handwriting. (Simon)
The question is, though, do these benefits come close to outweighing the loss of poetry, wordplay, and pleasant writing that will no doubt be present as students strive for the best scores?
No comments:
Post a Comment