Task workflow
Follow these steps on every task. We expect a task to take about 1.5 hours. You have 2 hours from when you claim it.
Open the Task's GitHub Page
In the task on the HAI platform, click the link in "Task page on GitHub". The page has a short "How to use this page" box at the top and three buttons that jump to "Final user request", "Conversation history" and "Draft rubric".
Work Out What the User Wants
Start with "Final user request". That is the message your rubric grades. Then read "Conversation history" for context. Keep any goals or limits from earlier turns that still apply, and ignore anything the user dropped or already got. Earlier AI replies can be wrong, so never treat them as the correct answer.
Look at Every Image Yourself
Images are numbered in order across the whole conversation (Image 1, Image 2, and so on). Open each one. Do not trust the draft's description of an image until you have checked it.
Review the Draft Rubric
Read the draft summary and every draft criterion. Then go back to the task on the HAI platform, where the same draft is loaded. Keep, rewrite, split, merge or remove criteria, and add anything essential that is missing. Aim for a small, clear set. There is no target number. Use the Rubric rules for every row you keep, rewrite or add.
Check Weight, Dimension and Image Numbers
For every criterion, check that the weight is right, the dimension fits, and the image numbers point to the images a person needs to judge it. Use "No image needed" when a criterion does not depend on any image. Then add a short change log note to every criterion. If you did not change a criterion, write "No change".
Choose the Outcome and Write Your Rationale
Pick the outcome that matches what you did. Then write one to three sentences on what you changed and why, or why the draft held up.
Self-check and Submit
Go through the self-check list, tick the box and submit.
What happens after you submit
Your task goes to Review 1, where a reviewer checks every row. Small fixes are made by the reviewer and the task moves on to a final Audit. If something bigger needs fixing, it comes back to you with comments. Fix every point, then re-run the pre-submit checklist on the whole rubric.
The page is private, so make sure you are signed in to GitHub. If you still see a "404" page, you do not have access yet. Ask in the Project Markeb Slack channel.