Software Developer

We're working with a cutting-edge platform that helps the world's most innovative companies improve their AI agents by providing human feedback. This rapidly growing company is at the forefront of training Large Language Models (LLMs) to function as proactive, multi-step agents, specializing in designing, coordinating, and optimizing complex, real-world architectural workflows.

The Role

• Help train generative AI models for leading AI organizations.
• Develop objective, verifiable criteria (rubrics) to evaluate system performance and ensure outputs meet strict functional requirements.
• Review system logs and "trajectories" to refactor code, improve execution paths, and reach a "Golden Path" of perfect reliability.
• Test systems for vulnerabilities, including improper data exposure, unauthorized access escalations, and edge-case failures.
• This is a freelance role offering flexible hours and fully remote work.
  
  

What You'll Need

• 2 years of experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production-grade software with modular separation.
• Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience with SQL databases.
• Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
• Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.
• Must be authorized to work in your country of residence.
  
  

What's On Offer

• Earn up to $50 per hour for core project work.
• Additional incentives average 7.5% on top of core project rates through Missions.
• Flexible hours and fully remote work arrangements.
• Opportunity to contribute to the development of advanced generative AI systems.
  
  

Apply via Haystack today!