What are the responsibilities and job description for the Full Stack Developer position at Haystack?
FULL STACK DEVELOPER
We're collaborating with a cutting-edge company that's revolutionising how the world's most innovative organisations develop and refine their AI agents through advanced human feedback. This rapidly growing firm is at the forefront of training Large Language Models to operate as proactive, multi-step agents, designing, coordinating, and optimising complex, real-world architectural workflows.
The Role
We're collaborating with a cutting-edge company that's revolutionising how the world's most innovative organisations develop and refine their AI agents through advanced human feedback. This rapidly growing firm is at the forefront of training Large Language Models to operate as proactive, multi-step agents, designing, coordinating, and optimising complex, real-world architectural workflows.
The Role
- Develop objective, verifiable criteria (rubrics) to evaluate system performance and ensure outputs meet strict functional requirements.
- Review system logs and 'trajectories' to refactor code, improve execution paths, and achieve optimal reliability.
- Test systems for vulnerabilities, including improper data exposure, unauthorised access escalations, and edge-case failures.
- Contribute expertise to train generative AI models for leading AI organisations.
- 2 years of experience in backend engineering, AI automation, or complex systems integration.
- Proven ability to build and maintain production-grade software with modular separation.
- Strong command of at least two major programming languages (e.g., Python, JavaScript, Go, or Java) and experience with SQL databases.
- Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
- Outstanding attention to detail and ability to provide clear, high-density technical feedback on complex system behaviours.
- Experience with multi-stage coordination tasks where data acquisition leads to reasoned output is a plus.
- Opportunity to shape the future of autonomous agents and advanced generative systems.
- Fully remote, freelance role with flexible hours and competitive hourly pay up to $50.
- Additional earning potential through incentives, with top contributors boosting earnings by an average of 11%.
- Work on impactful projects with leading AI organisations.
Salary : $50