What are the responsibilities and job description for the Sr. AI / Machine Learning Platform Engineer - Voice Agents position at Skyrocket Ventures?
Sr. AI / Machine Learning Platform Engineer - Voice Agents
Location: San Francisco, CA (you can work from home 2x/week)
The company has raised $6 million in seed funding and has already reached a $8 million/year run rate in only 16 months. The company is comprised of 15 people and 8 engineers, and is rapidly hiring.
You would be reporting to the CTO/Cofounder, who was previously a machine learning tech lead and manager at Google.
The company will pay a salary up to $300k, plus equity which could be very lucrative.
Job Responsibilities:
- Primarily programming in Python. The company seeks language agnostic engineers who are able and interested to learn new technologies as needed.
- Time spent will be roughly 50% building a simulation and evaluation platform for AI agents, and 50% working on the framework used to build the AI agents.
- Designing, building, and enhancing a simulation and evaluation platform used to rigorously test, benchmark, and improve AI agents across a wide range of tasks and environments.
- Developing scalable evaluation frameworks, tooling, and methodologies to measure agent performance, reliability, decision quality, and failure modes.
- Build core frameworks, abstractions, and infrastructure used to develop, orchestrate, and deploy AI agents.
- Collaborating closely with other engineers to rapidly iterate on agent architectures, capabilities, and evaluation strategies.
- Creating systems that enabling reproducible experiments, large-scale simulations, and data-driven optimization of agent behavior.
- Improving developer workflows, testing capabilities, and platform reliability to accelerate AI agent development and deployment.
- Analyzing evaluation results and agent behaviors to identify weaknesses, guide improvements, and drive overall system performance.
- Contributing to technical architecture and engineering best practices across both the agent framework and evaluation platform stack.
Qualifications:
- 5-10 years of engineering experience in good organizations.
- Strong communication skills.
- Strong software engineering experience building complex backend systems, platforms, frameworks, or developer tooling.
- Experience designing or building evaluation, testing, simulation, benchmarking, or experimentation systems for AI/ML products or distributed systems.
- Strong programming skills in Python and/or other modern backend languages.
- Experience working with LLMs, AI agents, reinforcement learning systems, or other modern AI application architectures.
- Strong understanding of software architecture, scalability, reliability, and performance optimization.
- Experience building internal platforms, SDKs, APIs, orchestration systems, or infrastructure that enable rapid product development.
- Ability to analyze complex system behavior, debug issues, and improve reliability through data-driven approaches.
- Comfortable working in fast-moving, ambiguous environments with a high degree of ownership and autonomy.
About Skyrocket Ventures
Skyrocket Ventures is a recruiting firm for hundreds of high growth technology companies that range from industry leaders to top-tier startups. This opportunity is with one of our client companies for a full-time permanent hire. Please only apply if you are authorized to work in the U.S.
Please note that even if this job is not a perfect match, we encourage you to apply as long as it is in the ballpark. Companies are often flexible in hiring candidates who do not perfectly fit their written job description, as long as the most important qualifications are there and the candidate is good in general.
Most of the jobs we are recruiting for are not posted online, so if you would like to know of all the opportunities we have that match your interests and qualifications, then please get in touch with us.
After you apply to this job posting, we’ll consider you for this job as well as any other potential matches with our client companies. If we have any potential matches, we’ll share your resume with those companies and contact you about any interview opportunities we can get you.
Thank you, and we wish you a great job search!
Salary : $8 - $300,000