Text Situated Alignment Generalist – BA

Overview

This is a short-term human-AI interaction evaluation pilot assessing whether providing social context before a user request helps a language model generate more relevant and personalized advice. Contributors create realistic social scenarios, interact with the model under different conditions, and evaluate response quality.

What You’ll Do

• Create realistic and ongoing social scenarios involving personal, professional, or interpersonal context
• Interact with the language model under assigned evaluation conditions
• Evaluate model responses for relevance, usefulness, personalization, clarity, and alignment with provided context
• Explain the reasoning behind each rating through clear and detailed written feedback
• Follow project guidelines and complete assigned tasks within the required timeline

Requirements

• Strong written English proficiency and clear communication skills
• Creative and analytical thinking for developing realistic social scenarios
• Educational or professional background in Business Analysis, English, Literature, Journalism, Creative Writing, Scriptwriting, Content Writing, Film and Video Captioning, or related field
• Ability to understand nuanced interpersonal situations and evaluate AI-generated responses objectively
• Three or more years of experience in data annotation, human-AI interaction, content evaluation, or similar analytical projects (preferred but not mandatory)