Using the Criterion Service for Remediation, Placement and Assessment
How often does the computer’s score agree with the score of a faculty reader?
In the vast majority of cases, ETS researchers generally found either exact or adjacent agreement (within one point) between the Criterion scores and those of a trained essay reader. Both used the same scoring guidelines and scoring system.
How can the Criterion service be used for writing remediation and in basic skills
writing classes?
Professors assign the Criterion standard topics or use their own topics to give students opportunities for additional writing practice. The Criterion topics library contains a group of writing assignments called “College Level Preparatory.” These topics are graded against a lower level scoring rubric and can be assigned to gradually move incoming freshmen up to the first-year writing level. Professors may assign topics to encourage students to focus on essential problem areas that will improve their writing. The immediate feedback features of the Criterion service provide additional motivation for students to write and revise their essays when writing on their own.
The Criterion Training Workshop provides more detailed information on using the Criterion service for remediation and in basic skills classes.
How do institutions use the Criterion scores for placement?
Some colleges assign students to composition classes on the basis of their scores on a Criterion-scored essay — or the combination of a Criterion score and other indicators. The electronic score should not be the sole basis for a placement decision. It is best to combine a Criterion score with the score of a faculty reader in the same way that institutions combine scores from two different faculty readers. If the two scores differ by more than one point, a different faculty reader should also evaluate the essay.
How do institutions use the Criterion service for assessment purposes?
Some institutions use the Criterion scores for exit testing — combining a Criterion score with the score from a faculty reader in the same way they combined scores from two different faculty readers. If the two scores differ by more than one point, a different faculty reader also evaluates the essay. Some institutions use the Criterion service for benchmark testing, assigning the Criterion-scored essays at specified points during a semester.
How can the Criterion service be used in a campus writing lab?
When the Criterion service is used in a campus writing lab, tutors and writing mentors have access to topics, feedback and student portfolios. They also have a way to communicate with professors about student progress. Use of the Criterion service in a writing lab facilitates writing across the curriculum when students use the lab to check in-progress writing for all of their classes. Providing access to an open-ended professor’s topic allows students to write an essay about any subject assigned by any professor. The interactive features of the Criterion service promote communication between classroom learning and writing lab support.
How do students feel about being scored by a machine?
Most of today’s students have had experience with instant feedback in computer programs and are becoming more comfortable with the idea of computerized scoring.
Can the Criterion service score essays on other topics?
Yes. Using the Scored Instructor Topic feature, teachers can create their own topics that are parallel to the Criterion library prompts, and the students’ essays will receive holistic scores upon completion.
A Criterion pop-up window explains the requirements, and a button link offers step-by-step instructions on how to create either a persuasive or expository topic that can be scored.
Back to Criterion FAQ Main