Demo

Python Insfrastructure Engineer - Model Evaluation

Alignerr
York, NY Contractor
POSTED ON 12/18/2025
AVAILABLE BEFORE 1/16/2026
About The Job

Alignerr connects top technical experts with leading AI labs to build, evaluate, and improve next-generation models. We work on real production systems and high-impact research workflows across data, tooling, and infrastructure.

Position

Senior Python Full-Stack Engineer — AI Data & Infrastructure

Type: Contract, Remote Commitment: 20–40 hours/week Compensation: Competitive, hourly (based on experience)

Role Responsibilities

  • Design, build, and optimize high-performance systems in Python supporting AI data pipelines and evaluation workflows
  • Develop full-stack tooling and backend services for large-scale data annotation, validation, and quality control
  • Improve reliability, performance, and safety across existing Python codebases
  • Collaborate with data, research, and engineering teams to support model training and evaluation workflows
  • Identify bottlenecks and edge cases in data and system behavior, and implement scalable fixes
  • Participate in synchronous reviews to iterate on system design and implementation decisions

Qualifications

Must-Have

  • Native or fluent English speaker
  • Full-stack developer experience with a strong systems programming background
  • 3-5 years of professional experience writing production Python.
  • Experience building evaluation harnesses for ML models, integrating with inference frameworks.
  • Strong background in observability and metrics collection to monitor system reliability and model performance.
  • Clear written and verbal communication skills.
  • Ability to commit 20–40 hours per week.

Preferred

  • Prior experience with data annotation, data quality, or evaluation systems
  • Familiarity with AI/ML workflows, model training, or benchmarking pipelines
  • Experience with distributed systems or developer tooling

Application Process

  • Submit your resume
  • Complete a short technical screening
  • Project matching and onboarding

Salary : $50 - $75

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Python Insfrastructure Engineer - Model Evaluation?

Sign up to receive alerts about other jobs on the Python Insfrastructure Engineer - Model Evaluation career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$92,369 - $122,605
Income Estimation: 
$117,024 - $149,811
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Alignerr

  • Alignerr Denver, CO
  • Location: Remote About The Job At Alignerr, we partner with the world’s leading AI research teams and labs to build and train cutting-edge AI models. Write... more
  • 13 Days Ago

  • Alignerr Denver, CO
  • Location: Remote About The Job At Alignerr, we partner with the world’s leading AI research teams and labs to build and train cutting-edge AI models. Write... more
  • 13 Days Ago

  • Alignerr Seattle, WA
  • Location: Remote About the job At Alignerr, we partner with the world’s leading AI research teams and labs to build and train cutting-edge AI models. Write... more
  • 13 Days Ago

  • Alignerr Seattle, WA
  • Researcher - Lean 4 & Formal Proof Systems Location: Remote About the job At Alignerr, we partner with the world’s leading AI research teams and labs to bu... more
  • 13 Days Ago


Not the job you're looking for? Here are some other Python Insfrastructure Engineer - Model Evaluation jobs in the York, NY area that may be a better fit.

  • Cohere York, NY
  • Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are bui... more
  • 14 Days Ago

  • Capgemini York, NY
  • Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired ... more
  • 4 Days Ago

AI Assistant is available now!

Feel free to start your new journey!