Demo

English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contrator)

CNTXT AI
Brooklyn, NY Remote Full Time
POSTED ON 4/23/2026
AVAILABLE BEFORE 10/20/2026

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Salary.com Estimation for English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contrator) in Brooklyn, NY
$77,450 to $115,876
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contrator)?

Sign up to receive alerts about other jobs on the English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contrator) career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$65,633 - $114,239
Income Estimation: 
$96,258 - $169,043
Income Estimation: 
$82,030 - $177,506
Income Estimation: 
$121,624 - $187,737
Income Estimation: 
$112,235 - $184,757
Income Estimation: 
$66,993 - $81,397
Income Estimation: 
$87,578 - $109,717
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at CNTXT AI

  • CNTXT AI Boston, MA
  • Position Summary In this remote, hourly contractor role, you will evaluate AI-generated biology content to help improve accuracy, reliability, and clarity.... more
  • 1 Day Ago

  • CNTXT AI Miami, FL
  • Position Summary In this remote, hourly contractor role, you will evaluate AI-generated medical content and develop cases that test clinical reasoning accu... more
  • 1 Day Ago


Not the job you're looking for? Here are some other English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contrator) jobs in the Brooklyn, NY area that may be a better fit.

  • English 1 Bronx, NY
  • Are you an experienced ESL teacher or an educator ready to take your teaching skills overseas? English 1 is looking for passionate, culturally curious teac... more
  • 1 Day Ago

  • English 1 Brooklyn, NY
  • Are you an experienced ESL teacher or an educator ready to take your teaching skills overseas? English 1 is looking for passionate, culturally curious teac... more
  • 4 Days Ago

AI Assistant is available now!

Feel free to start your new journey!