Experienced Generalist

1. Role Overview

Mercor is seeking generalist experts to support a large-scale project with a leading AI research partner. The goal is to create and refine a diverse dataset of human-aligned tasks for supervised fine-tuning (SFT) of frontier models. Generalists will contribute by generating realistic prompts, evaluating AI outputs, and iterating on responses to ensure quality and domain relevance. This is a short-term, project-based opportunity ideal for professionals with broad analytical capabilities and writing skills.

2. Key Responsibilities

• Create / evaluate base prompts across a range of generalist topics

• Review and revise AI-generated responses for clarity, accuracy, and alignment with human reasoning

• Develop prompt-response iterations using variations in length, style, and system prompts

• Contribute to benchmarking efforts by identifying failure points in model responses

• Create Rubrics to evaluate the prompts

• Apply consistent quality standards across diverse content types (e.g., summaries, Q&A, synthesis tasks)

3. Ideal Qualifications

• 2+ years of experience in research, education, writing, editing, or adjacent analytical fields

• Proven ability to communicate complex topics clearly and concisely

• Strong attention to detail and critical thinking skills

• Comfort working independently with evolving task guidelines

• Familiarity with LLMs or AI-assisted writing tools is a plus

4. More About the Opportunity

• Expected commitment: 10–25 hours/week

• Flexible task structure with batch-based assignments

5. Application Process

• Submit your resume to get started

• Complete the Domain Expert interview

• We aim to follow up within a few business days