Les Perelman is a research affiliate at the Massachusetts Institute of Technology. Perelman taught writing and composition at MIT, where he served as Director of Writing Across the Curriculum and an Associate Dean of Undergraduate Education. He was an executive committee member of the Conference on College Composition and Communication. and Co-Chair of its Committee on Assessment
Perelman is known as a critic of automated essay scoring (AES), and was instrumental in the College Board's decision to scrap the Writing Section of the SAT.
Video Les Perelman
Teaching
Perelman taught in and directed writing programs at Tulane University and the University of Southern California. At MIT, he taught writing and composition and served as the director of Writing Across the Curriculum and an Associate Dean in the Office of Undergraduate Education.
Maps Les Perelman
Criticism of the SAT Writing Section
Following his 2005 study of essay samples as well as graded essays provided by the College Board for reference on the writing portion of the SAT, Perelman reported a high correlation between the length of an essay and score received. He also noted that the essays were not penalized for any factual inaccuracies.
In 2013, Perelman met with David Coleman the incoming President of the College Board, and an outcome of that conversation was Coleman's decision to abolish the mandatory SAT Writing Section.
Criticism of automated scoring
In 2012, Perelman demonstrated that long pretentious incoherent essays could achieve higher scores from the ETS scoring engine e-Rater than well written essays.
In 2014, Perelman collaborated with students at MIT and Harvard to develop BABEL, the "Basic Automatic B.S. Essay Language" Generator. The nonsense essays generated by BABEL are claimed to perform well when graded by AES systems. Automated graders, Perelman argues, "cannot read meaning, and they cannot check facts. More to the point, they cannot tell gibberish from lucid writing." Perelman's work is cited by the NCTE in their Position Statement on Machine Scoring, which expresses similar concerns about the limitations of AES:
Computer scoring systems can be "gamed" because they are poor at working with human language, further weakening the validity of their assessments and separating students not on the basis of writing ability but on whether they know and can use machine-tricking strategies.
References
External links
- BABEL Generator
- Les Perelman's Web Site
Source of article : Wikipedia
0 Comments