Project Markeb

    Welcome to Project Markeb.

    In this project you check and improve rubrics. A rubric is a short checklist used to grade how well an AI answers a user's coding question. Every conversation in this project includes images, such as screenshots of errors, code or designs.

    Each task gives you a draft rubric that an AI already wrote. Your job is to turn it into a final rubric that is accurate, fair and easy to grade with.

    The one thing to remember

    The draft is a starting point, not the answer. Check every criterion against the conversation and the actual images before you keep it.

    How a task works, in one minute

    1

    Open the task

    Claim a task on the HAI platform and click the link in "Task page on GitHub".

    2

    Read and look

    On the GitHub page, read the final user request, skim the earlier conversation for context and look at every image.

    3

    Fix the rubric

    Back on the HAI platform, edit the pre-loaded draft: keep, rewrite, split, merge, remove or add criteria.

    4

    Finish and submit

    Pick an outcome, write a short edit rationale, tick the self-check and submit.

    On the tasking platform, this project appears as Project Markeb. If you have a question at any point, ask in the Project Markeb Slack channel.

    Your task