What are the responsibilities and job description for the Data Scientist – AI Training & Evaluation position at Alignerr?
About The Role
We're looking for data scientists to help train, evaluate, and improve next-generation AI systems. Your expertise in statistics, machine learning, and data analysis will directly shape how AI reasons, interprets data, and delivers results — making a real and measurable impact on the future of AI.
We're looking for data scientists to help train, evaluate, and improve next-generation AI systems. Your expertise in statistics, machine learning, and data analysis will directly shape how AI reasons, interprets data, and delivers results — making a real and measurable impact on the future of AI.
- Organization: Alignerr
- Type: Hourly Contract
- Location: Remote (US-based)
- Commitment: 10–40 hours/week
- Evaluate AI model outputs for accuracy, reasoning quality, and statistical soundness
- Design and apply data-driven evaluation criteria and scoring rubrics
- Analyze patterns in AI-generated responses to identify systematic errors or biases
- Create high-quality training data including prompts, solutions, and annotations in your areas of expertise
- Provide structured, detailed feedback to improve model performance across data science and analytical tasks
- Review AI-generated code, visualizations, and statistical analyses for correctness
- Work independently and asynchronously on your own schedule
- Based in the United States
- Degree in Data Science, Statistics, Computer Science, Mathematics, or a related quantitative field (MS or PhD preferred)
- Strong foundation in statistics, probability, and machine learning concepts
- Proficient in Python, R, SQL, or similar data analysis tools
- Experienced with data wrangling, exploratory data analysis, and model evaluation
- Excellent analytical thinking and sharp attention to detail
- Clear written communicator — able to explain complex technical concepts simply
- Self-motivated and comfortable working independently
- Experience with deep learning frameworks (PyTorch, TensorFlow)
- Familiarity with NLP, LLMs, or AI evaluation workflows
- Published research or industry experience in applied machine learning
- Background in A/B testing, causal inference, or experimental design
- Work on cutting-edge AI projects shaping the future of technology
- Collaborate with top research labs and AI teams globally
- Fully remote and flexible — work on your own schedule, your own way
- Gain deep, hands-on exposure to how state-of-the-art LLMs are trained and evaluated
- Be part of a growing community of expert contributors making AI smarter and more reliable
- Potential for ongoing work and long-term contract extension
Salary : $25 - $40