What are the responsibilities and job description for the Data Scientist – AI Training & Evaluation position at Alignerr?
About The Role
We're looking for data scientists based in London to help train, evaluate, and improve next-generation AI systems. You'll leverage your expertise in statistics, machine learning, and data analysis to assess AI model outputs, design evaluation frameworks, and ensure AI systems deliver accurate, reliable results.
We're looking for data scientists based in London to help train, evaluate, and improve next-generation AI systems. You'll leverage your expertise in statistics, machine learning, and data analysis to assess AI model outputs, design evaluation frameworks, and ensure AI systems deliver accurate, reliable results.
- Organization: Alignerr
- Type: Hourly Contract
- Compensation: $25–$40 /hour
- Location: Remote
- Commitment: 10–40 hours/week
- Evaluate AI model outputs for accuracy, reasoning quality, and statistical soundness
- Design and apply data-driven evaluation criteria and scoring rubrics
- Analyze patterns in AI-generated responses to identify systematic errors or biases
- Create high-quality training data including prompts, solutions, and annotations in your areas of expertise
- Provide structured, detailed feedback to improve model performance across data science and analytical tasks
- Review AI-generated code, visualizations, and statistical analyses for correctness
- Work independently and asynchronously on your own schedule
- Based in London, United Kingdom
- Degree in Data Science, Statistics, Computer Science, Mathematics, or a related quantitative field (MS or PhD preferred)
- Strong foundation in statistics, probability, and machine learning concepts
- Proficiency in Python, R, SQL, or similar data analysis tools
- Experience with data wrangling, exploratory data analysis, and model evaluation
- Excellent analytical thinking and attention to detail
- Clear written communication — able to explain complex technical concepts simply
- Self-motivated and comfortable working independently
- Experience with deep learning frameworks (PyTorch, TensorFlow)
- Familiarity with NLP, LLMs, or AI evaluation workflows
- Published research or industry experience in applied machine learning
- Background in A/B testing, causal inference, or experimental design
- Work on cutting-edge AI projects shaping the future of technology
- Collaborate with top research labs and AI teams globally
- Freelance perks: full autonomy, flexible scheduling, and remote-first culture
- Gain deep exposure to how state-of-the-art LLMs are trained and evaluated
- Potential for ongoing work and long-term contract extension
- Be part of a growing community of expert contributors making AI smarter
- Submit your resume
- Complete a short screening
- Project matching and onboarding
Salary : $25 - $40