RLHF Preference Ranker (part-time)

Summary Ongoing role comparing and ranking AI model responses to train language models using RLHF (Reinforcement Learning from Human Feedback). Responsibilities - Compare pairs of AI responses and select the better one - Rate responses on helpfulness, accuracy, and safety - Provide written justification for preference decisions - Follow evolving evaluation rubrics and guidelines - Process 100+ comparisons per shift Requirements - Strong critical thinking and writing skills - Understanding of AI model behavior and limitations - Ability to articulate clear reasoning for preferences Schedule & Details - Type: Remote / Part-time / Ongoing How to Apply Apply with your reasoning skills and any AI evaluation experience.

Test a paid category

Bank diamonds so your next unlock and daily access are covered.

Enter a cash pool

Stake against other taskers on the same ten questions.

Sit an assessment

A badge opens Starter, Skilled and Elite tasks — up to $1,000.00 each.