In Examplary, you create a rubric for each open question on its Scoring tab. You pick one of four models, from a simple list of criteria to an analytical rubric with performance levels. The AI uses the rubric to suggest a score for each answer, and you use it to check that suggestion.
Students don't see the rubric. The clearer it is, the closer the suggestions from AI grading come to how you'd grade yourself.
Where to find a question's rubric
Open a question in Edit test and go to the Scoring tab. Choose the model at the top. If Examplary generated the test for you, every question already has a rubric you can adjust.
Closed questions, like multiple choice or true/false, don't have a Scoring tab. For those, you only set the Points under Settings. A correct answer earns all the points, a wrong one earns none.
Which rubric fits your question?
| Model | How the points work | Good for |
|---|---|---|
| Simple criteria (the default) | A list of requirements, each worth its own points. The answer earns the points for every requirement it meets. | Short answers with a few fixed elements |
| Analytical rubric | Several criteria, each with levels. One level is chosen per criterion, and the points add up. | Essays, reports and long answers you assess on several points |
| Holistic rubric | One set of levels for the answer as a whole. One level is chosen. | Answers you assess as a whole |
| Exact values | A list of correct answers with their points. If the answer matches exactly, it earns those points, otherwise zero. | A number, a year or a single word |
The first criterion of an analytical rubric starts with four levels, from Needs improvement to Above average. Each criterion you add after that copies the levels of the one before. You can change the titles, descriptions and points, and add or remove levels.
Exact values doesn't involve the AI: Examplary compares the answer character by character and grades it itself. Turn on Ignore whitespace and capitalization if both New York and new york should count. A typo scores zero, unless you add that spelling as a correct answer too.
Adding a model answer and grading guidance
The menu with the three dots next to the rubric has Add model answer and Add grading guidance. A model answer shows what a complete answer looks like. Grading guidance is for anything that doesn't fit the criteria, such as Don't count spelling mistakes or Without an example, 2 points at most.
The AI gets both when it suggests a score, and you see them next to every answer. Students don't.
Generating a rubric or using one you already have
- In the same menu, choose Generate rubric.... The window is labeled Experimental.
- Describe what you want to assess, or add a file with Add file.
- Click Generate.
If you already have a rubric, such as a Word file from your department, add that file. Examplary uses the rubric in the file as its starting point and shortens the descriptions. When you import a whole test, Examplary keeps its answer key and rubric as close to the original as it can.
The new rubric takes the place of the old one straight away, without asking. The model can change along with it.
Reusing or sharing a rubric
Using the same rubric again and again, for example for every essay? Choose Save as template..., give it a name and click Save. For the next question, choose Select from template.... The question gets a copy, so changing it doesn't change the template. Templates are only visible to you.
To share the rubric with your students beforehand, use Print rubric or Export as Word document. For an assignment outside Examplary, you can make a rubric with the free rubric builder, no account needed.
Leaving a question out of the grade
To ask a question without counting it, choose Exclude from grading in the question's menu. The question then doesn't count toward the points or the grade.
Changing the rubric while you grade
If you notice during grading that the rubric could be better, change it from Grade test.
- Open an answer.
- Next to Scoring criteria, click the pencil (Edit rubric).
- Change the rubric and choose Save changes.
The AI then suggests a new score for every answer that was graded automatically. Anything you've already graded or accepted yourself stays as it is.
If you change the rubric in Edit test, answers that are already in won't be graded again. Use Edit rubric in Grade test for that.