Mercor is seeking detail-oriented transcribing and writing experts to contribute to a high-impact audio AI research project with a leading lab. Freelancers will listen to and transcribe audio, annotate images, and evaluate videos to help train advanced language models. This is a short-term, flexible opportunity for professionals with strong academic backgrounds, fluent in both Dutch and English, and with a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted text.

Job Details

Transcribe and Optimise Audio/Video

Create detailed audio and video transcriptions with multiple constraints and instructions in Dutch, with supporting work in English when required.

Define and Document Evaluation Standards

Establish high-level expectations for correct responses in general consumer audio contexts.
Develop comprehensive evaluation rubrics and guidelines in Dutch and English.

Conduct Model Testing and Grading

Run prompts through models and assess preliminary outputs against defined expectations.

Support Benchmarking and Quality Assurance

Collaborate in QA review processes to ensure prompt tasks and rubrics meet high standards of rigour.
Maintain consistency and reliability before integration into official benchmarks.

Minimum Qualifications

Strong writing and critical thinking skills
Ability to work independently and meet deadlines
Fluent in Dutch and English
Able to work within GMT or PST working hours

Preferred Qualifications

College students or graduates

Application & Onboarding Process

Complete an AI-led interview (approximately 15 minutes)
If selected, you will be invited to work on the project

More Details About This Role

Expected commitment of 3–6 months
You’ll work in a structured project environment with clear goals and tools

Dutch Audio Generalist Evaluator Expert

Description