What are the responsibilities and job description for the Full Stack Developer position at Haystack?
We're collaborating with a pioneering company that's at the forefront of advancing AI agents through human feedback. They are dedicated to shaping the future of autonomous systems by training Large Language Models (LLMs) to become proactive, multi-step agents capable of designing, coordinating, and optimising complex, real-world workflows.
The Role
The Role
- Develop objective, verifiable criteria (rubrics) to evaluate system performance
- Review system logs and 'trajectories' to refactor code and improve execution paths
- Test systems for vulnerabilities, including improper data exposure and unauthorized access escalations
- Help train generative AI models to function as proactive, multi-step agents
- 2 years of experience in backend engineering, AI automation, or complex systems integration
- Proven ability to build and maintain production-grade software with modular separation
- Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java)
- Experience working with SQL databases and building for live, non-mocked environments
- Outstanding attention to detail and ability to provide clear, high-density technical feedback
- Opportunity to contribute to cutting-edge AI agent development
- Fully remote freelance role with flexible hours
- Competitive hourly rates for core project work
- Additional incentives and earning opportunities through 'Missions'
Salary : $50