What are the responsibilities and job description for the Software Developer position at Haystack?
We're working with a company that helps the world's most innovative organisations enhance their AI agents through human feedback. They collaborate with leading AI teams to train Large Language Models (LLMs) to function as proactive, multi-step agents, focusing on designing, coordinating, and optimising complex, real-world architectural workflows.
The Role
The Role
- Help train generative AI models and shape the future of autonomous agents.
- Develop objective, verifiable criteria (rubrics) to evaluate system performance and ensure outputs meet strict functional requirements.
- Review system logs and 'trajectories' to refactor code, improve execution paths, and reach a 'Golden Path' of perfect reliability.
- Test systems for vulnerabilities, including improper data exposure, unauthorized access escalations, and edge-case failures.
- Contribute your expertise to teaching advanced generative systems to design, coordinate, and optimize complex workflows.
- 2 years of experience in backend engineering, AI automation, or complex systems integration.
- Proven ability to build and maintain production-grade software with modular separation.
- Strong command of at least two major programming languages (e.g., Python, JavaScript, Go, or Java) and experience with SQL databases.
- Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
- Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.
- Opportunity to work with cutting-edge AI technology and influence the future of autonomous agents.
- Fully remote, flexible freelance work with competitive hourly rates.
- Additional incentives and opportunities for higher earnings based on expertise and project needs.
- Join a network of skilled software experts contributing to groundbreaking AI projects.
Salary : $50