Remote | Dutch Audio Generalist Evaluator Expert -- $50/hr

We are sharing a specialised part-time consulting opportunity for Dutch language experts with strong transcription, evaluation, analytical writing, and instructional clarity skills.

This role supports collaborations with a leading AI research laboratory working to improve advanced language models through audio transcription, image annotation, video evaluation, benchmarking, and structured quality workflows in Dutch.

Selected professionals will help transcribe audio and video content, develop evaluation standards, assess model outputs, support benchmarking processes, and contribute to improving the overall quality and reliability of multilingual AI systems.

Key Responsibilities

Professionals in this role may contribute to:

Audio, Video & Image Evaluation
Create detailed audio and video transcriptions in Dutch, with supporting work in English when required
Annotate images and evaluate video content as part of structured project workflows
Ensure outputs follow detailed constraints, instructions, and formatting requirements

Evaluation Standards & Documentation
Establish high-level expectations for correct responses in general consumer audio contexts
Develop comprehensive evaluation rubrics and guidelines in Dutch and English
Document standards to support consistency, clarity, and rigorous evaluation workflows

Model Testing & Grading
Run prompts through models and assess preliminary outputs against defined expectations
Evaluate outputs for quality, clarity, and alignment with task requirements
Provide structured feedback to improve model performance and task reliability

Benchmarking & Quality Assurance
Collaborate in quality assurance review processes to ensure prompt tasks and rubrics meet high standards of rigour
Maintain consistency and reliability before materials are integrated into official benchmarks
Support structured project workflows with strong attention to detail and quality control

Ideal Profile

Strong candidates may have:
Fluency in Dutch and English
Strong writing and critical thinking skills
Ability to work independently and meet deadlines
Comfort working within GMT or PST working hours
Strong attention to detail and ability to produce well-structured written outputs
Interest in careful, instruction-based evaluation work

Preferred qualifications

College student or graduate
Prior experience with transcription, annotation, evaluation, or structured research workflows
Comfort working in a project environment with clear goals and tools
Interest in AI, language models, or applied research environments

Why This Opportunity

Contribute directly to a high-impact audio AI research project
Gain hands-on exposure to real-world AI evaluation, transcription, and benchmarking workflows
Help improve advanced multilingual language models across audio, video, and visual tasks
Flexible remote work with structured processes and competitive compensation

Contract Details

Independent contractor role
Fully remote with flexible scheduling
Compensation of $50/hr
Expected commitment of approximately 3–6 months
Weekly payments via Stripe or Wise
Projects may be extended, shortened, or concluded early depending on project needs and performance
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Please note: We are unable to support H1-B or STEM OPT candidates at this time
Location requirements: United States, United Kingdom, or Singapore
Candidates must be able to work within GMT or PST working hours

About the Platform

This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects.

Experts contribute to improving advanced AI systems by providing specialised expertise in transcription, annotation, evaluation, multilingual quality assurance, and applied language research.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy