What are the responsibilities and job description for the Data Scientist – AI Training & Evaluation position at Alignerr?
About The Role
AI is only as smart as the experts who train it — and that's where you come in. We're looking for data scientists to evaluate, improve, and help shape the next generation of AI systems. Your expertise in statistics, machine learning, and data analysis will directly influence how AI models reason, respond, and perform across complex analytical tasks.
This is a fully remote, flexible contract role that lets you contribute to cutting-edge AI research on your own schedule.
AI is only as smart as the experts who train it — and that's where you come in. We're looking for data scientists to evaluate, improve, and help shape the next generation of AI systems. Your expertise in statistics, machine learning, and data analysis will directly influence how AI models reason, respond, and perform across complex analytical tasks.
This is a fully remote, flexible contract role that lets you contribute to cutting-edge AI research on your own schedule.
- Organization: Alignerr
- Type: Hourly Contract
- Location: Remote
- Commitment: 10–40 hours/week
- Evaluate AI model outputs for accuracy, reasoning quality, and statistical soundness
- Design and apply data-driven evaluation criteria and scoring rubrics
- Analyze patterns in AI-generated responses to identify systematic errors or biases
- Create high-quality training data — including prompts, solutions, and annotations — in your areas of expertise
- Provide structured, detailed feedback to improve model performance across data science and analytical tasks
- Review AI-generated code, visualizations, and statistical analyses for correctness
- Work independently and asynchronously on your own schedule
- Degree in Data Science, Statistics, Computer Science, Mathematics, or a related quantitative field (MS or PhD preferred)
- Strong foundation in statistics, probability, and machine learning concepts
- Proficient in Python, R, SQL, or similar data analysis tools
- Experienced with data wrangling, exploratory data analysis, and model evaluation
- Excellent analytical thinking with sharp attention to detail
- Strong written communication in English — able to explain complex concepts clearly and simply
- Self-motivated and comfortable working independently in an async environment
- Experience with deep learning frameworks such as PyTorch or TensorFlow
- Familiarity with NLP, large language models (LLMs), or AI evaluation workflows
- Published research or industry experience in applied machine learning
- Background in A/B testing, causal inference, or experimental design
- Work on cutting-edge AI projects alongside top research labs and AI teams globally
- Gain rare, hands-on insight into how state-of-the-art LLMs are trained and evaluated
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with access to meaningful, intellectually stimulating work
- Be part of a growing community of expert contributors making AI smarter and more reliable
- Potential for ongoing work and long-term contract extension
Salary : $25 - $40