Demo

Data Scientist – AI Training & Evaluation

Alignerr
Chicago, IL Contractor
POSTED ON 4/4/2026
AVAILABLE BEFORE 5/2/2026
About The Role

We're looking for data scientists based in London to help train, evaluate, and improve next-generation AI systems. You'll leverage your expertise in statistics, machine learning, and data analysis to assess AI model outputs, design evaluation frameworks, and ensure AI systems deliver accurate, reliable results.

  • Organization: Alignerr
  • Type: Hourly Contract
  • Compensation: $25–$40 /hour
  • Location: Remote
  • Commitment: 10–40 hours/week

What You'll Do

  • Evaluate AI model outputs for accuracy, reasoning quality, and statistical soundness
  • Design and apply data-driven evaluation criteria and scoring rubrics
  • Analyze patterns in AI-generated responses to identify systematic errors or biases
  • Create high-quality training data including prompts, solutions, and annotations in your areas of expertise
  • Provide structured, detailed feedback to improve model performance across data science and analytical tasks
  • Review AI-generated code, visualizations, and statistical analyses for correctness
  • Work independently and asynchronously on your own schedule

Who You Are

  • Based in London, United Kingdom
  • Degree in Data Science, Statistics, Computer Science, Mathematics, or a related quantitative field (MS or PhD preferred)
  • Strong foundation in statistics, probability, and machine learning concepts
  • Proficiency in Python, R, SQL, or similar data analysis tools
  • Experience with data wrangling, exploratory data analysis, and model evaluation
  • Excellent analytical thinking and attention to detail
  • Clear written communication — able to explain complex technical concepts simply
  • Self-motivated and comfortable working independently

Nice to Have

  • Experience with deep learning frameworks (PyTorch, TensorFlow)
  • Familiarity with NLP, LLMs, or AI evaluation workflows
  • Published research or industry experience in applied machine learning
  • Background in A/B testing, causal inference, or experimental design

Why Join Us

  • Work on cutting-edge AI projects shaping the future of technology
  • Collaborate with top research labs and AI teams globally
  • Freelance perks: full autonomy, flexible scheduling, and remote-first culture
  • Gain deep exposure to how state-of-the-art LLMs are trained and evaluated
  • Potential for ongoing work and long-term contract extension
  • Be part of a growing community of expert contributors making AI smarter

Application Process (Takes 10–15 min)

  • Submit your resume
  • Complete a short screening
  • Project matching and onboarding

PS: Our team reviews applications daily. Please complete your application steps to be considered for this opportunity.

Salary : $25 - $40

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Data Scientist – AI Training & Evaluation?

Sign up to receive alerts about other jobs on the Data Scientist – AI Training & Evaluation career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$90,112 - $113,166
Income Estimation: 
$116,765 - $144,626
Income Estimation: 
$90,112 - $113,166
Income Estimation: 
$116,765 - $144,626
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Alignerr

  • Alignerr Charlotte, AR
  • About The Job At Alignerr, we partner with the world’s leading AI research teams and labs to build and train cutting-edge AI models. As a Population Health... more
  • 11 Days Ago

  • Alignerr Denver, CO
  • About The Role We’re looking for entrepreneurship instructors to help evaluate AI systems trained on startups, innovation, and business planning. Organizat... more
  • 11 Days Ago

  • Alignerr Seattle, WA
  • Role Overview The Principal Cloud Security Architect evaluates cloud architectures, identity models, permissions, and security controls across large-scale ... more
  • 11 Days Ago

  • Alignerr Seattle, WA
  • Location: Remote About The Job At Alignerr, we partner with the world’s leading AI research teams and labs to build and train cutting-edge AI models. Remot... more
  • 11 Days Ago


Not the job you're looking for? Here are some other Data Scientist – AI Training & Evaluation jobs in the Chicago, IL area that may be a better fit.

  • QuantumBlack, AI by McKinsey Chicago, IL
  • Who You'll Work With Driving lasting impact and building long-term capabilities with our clients is not easy work. You are the kind of person who thrives i... more
  • 1 Month Ago

  • QuantumBlack, AI by McKinsey Chicago, IL
  • Who You'll Work With Driving lasting impact and building long-term capabilities with our clients is not easy work. You are the kind of person who thrives i... more
  • 2 Days Ago

AI Assistant is available now!

Feel free to start your new journey!