Sample Tasks
Try a Real AI Training Task
See what the work actually looks like. Grade an AI response the way professional evaluators do, then compare your thinking with an expert evaluation.
Sample Task
Outlier-Style Evaluation Simulator
This is a real task type from the masterclass. Read the prompt, review the AI response, and grade it across 8 criteria the way professional AI trainers do. When you submit, you will see how a professional evaluated the same response.
Task: AI Response Evaluation
The Prompt
Give me exactly three causes of inflation in Kenya in bullet points. Keep the tone strictly professional.
The AI Response
Inflation in Kenya is a complex issue! Here are some causes:
- Increased money supply
- High cost of fuel and energy
- Drought affecting food production
- Global supply chain disruptions
- High taxation
I hope this helps you understand the economy better. Let me know if you need more info!
Evaluation Criteria
CRITERION 01
Instruction Following
Did the AI follow all instructions (exact number of items, requested format, tone)?
Rating
CRITERION 02
Factual Accuracy and Correctness
Is the information correct and verifiable?
Rating
CRITERION 03
Relevance
Does the response directly address the question without unrelated information?
Rating
CRITERION 04
Completeness
Did the AI address every important part of the request?
Rating
CRITERION 05
Reasoning Quality and Logical Consistency
Does the conclusion follow logically from the evidence provided?
Rating
CRITERION 06
Clarity and Readability
Is the response understandable and well-organized for the audience?
Rating
CRITERION 07
Safety and Policy Compliance
Does the response avoid harmful instructions or inappropriate disclosures?
Rating
CRITERION 08
Formatting and Constraint Compliance
Did the output follow explicit structural requirements (e.g., bullet points vs. essays)?
Rating
FINAL VERDICT
Overall Rating
Considering everything above, how would you rate the AI response as a whole?
Rating
9 ratings still missing.
Ready to learn all the task types?
The masterclass walks you through each task type step by step, so you know exactly what is expected before you ever start.