Reviewer guide
As a reviewer you are the last careful reader before a rubric is used to grade real answers. Your job is to make sure every row is accurate to the conversation and images, fair to every valid answer, and follows the Rubric rules. Read the GitHub page, the conversation, the images and the fellow's rubric with an eye for detail. Don't assume anything is right because it looks tidy.
A Review 1 claim has a 45-minute timer. Plan to spend most of it on the conversation, the images and the critical rows.
What you open, in this order
The Task's Github Page
The final user request first, then the conversation history, then every image.
The Fellow's Final Rubric
On the HAI platform: summary, every row, weights, dimensions, image numbers and change logs.
The Draft Rubric
On the GitHub page, to see what the fellow changed, kept and deleted.
The Outcome and Rationale
The fellow's outcome and overall edit rationale.
In Review 1 you can edit the summary, every rubric row and the review outcome. You also give the Standard Quality Score (1 to 5).
Standard quality score
Score the fellow's submission before your edits.