What are the responsibilities and job description for the Software Developer position at Haystack?
We are working with a company that is at the forefront of AI innovation, providing human feedback to enhance the capabilities of advanced AI agents. They collaborate with leading AI organizations to train Large Language Models (LLMs) to design, coordinate, and optimize complex, real-world architectural workflows.
The Role
The Role
- Help train generative AI models by contributing your software expertise.
- Develop objective and verifiable criteria (rubrics) to evaluate system performance.
- Review system logs and "trajectories" to refactor code and improve execution paths.
- Design systems to ensure outputs meet strict functional requirements and reach a "Golden Path" of perfect reliability.
- Test systems for vulnerabilities, including improper data exposure, unauthorized access escalations, and edge-case failures.
- 2 years of experience in backend engineering, AI automation, or complex systems integration.
- Proven ability to build and maintain production-grade software with modular separation.
- Strong command of at least two major programming languages (e.g., Python, JavaScript, Go, or Java).
- Experience working with SQL databases.
- Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
- Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.
- Opportunity to shape the future of autonomous agents.
- Flexible, fully remote work with flexible hours.
- Competitive hourly rates for project work, with additional incentives.
- Contribute to cutting-edge projects with leading AI organizations.
Salary : $50