English Speakers AI Personalization Rater

About the opportunity

Help our client improve how AI systems personalize responses for everyday email users. In this remote contractor assignment, you will review AI-generated answers using authorized personal email history as context. You will judge whether each response is relevant, accurate, helpful, and appropriately personalized. Your careful, objective feedback will help improve the quality and reliability of future AI experiences.

What you will do

• Assess AI-generated responses for relevance, accuracy, helpfulness, and appropriate personalization.

• Compare multiple responses and determine which delivers the stronger overall experience.

• Identify unsupported assumptions, incorrect personalization, irrelevant recommendations, and subtle inconsistencies.

• Explain your judgments through clear, detailed, and well-reasoned written feedback.

• Follow evaluation guidelines consistently while protecting privacy and maintaining confidentiality.

What we are looking for

• Strong English (US) proficiency, including the ability to read and evaluate nuanced written content.

• A primary personal @gmail.com account used regularly for communication.

• A Gmail interface or display language set to English, with the majority of inbox content in English.

• A well-established inbox with approximately 1,000 or more emails and regular account activity.

• Authorization to use the qualifying account's email history for this evaluation project.

• A bachelor's degree or equivalent practical experience in any field.

• At least two years of professional experience.

• Strong analytical judgment, attention to detail, and the ability to work independently in a remote setting.

• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical area is helpful but not required.

• A desktop or laptop, reliable internet access, and the ability to follow detailed project instructions.

Engagement details

• Remote contractor assignment with an immediate start.

• Expected duration of 12 to 16 weeks.

• At least 4 hours of availability per day, up to 40 hours per week.

• At least 4 hours of working-time overlap with Pacific Time.

Compensation

• $12-15 USD per hour.