What are the responsibilities and job description for the Senior AI/ML Engineer II position at ExecutivePlacements.com?
What Youll Be Doing:
- Architect and deliver production-grade agentic systems: multi-agent orchestration, workflow management, state/memory handling, and runtime governance.
- Design and orchestrate modular, LLM-powered agents (e.g., Planner, Tool Executor, QA, Validator) using scalable orchestration patterns (sequential, router, parallel, map-reduce), with clear handoff protocols, shared memory, and structured communication.
- Define and enforce guardrails and governance: prompt sanitization, access control, audit trails, threat modeling, and strategies for injection defense, hallucination control, misuse prevention, and compliance.
- Establish evaluation and monitoring methods for multi-agent systems: accuracy, safety, cost, and latencyleveraging observability practices (logs, telemetry, tracing, capturing intermediate outputs) and feedback loops to continuously refine performance.
- Build fine-tuning and deployment pipelines: supervised fine-tuning, inference optimization, post-deployment updates, and scaling hardened systems with retries, error handling, and fairness checks.
- Rapidly define and deliver MCPs (Minimum Capable Products): identify minimal agent roles and orchestration logic, validate quickly, and expand iteratively into robust multi-agent applications.
- Integrate seamlessly with the GradientAI platform: ensuring agents leverage DO services (inference, KBs, Functions, storage, networking) for scale, reliability, and cost-efficiency.
- Apply strong software engineering practices: testing, CI/CD, code quality, scalable architectures, and distributed system design.
- Collaborate cross-functionally with product managers, infra teams, design and UX, and other engineers to ship features that developers adopt and trust.
- Participate and support in operational excellence
- Independently ship product features from planning to launch to maintenance with high autonomy
- Collaborate with other engineers to find elegant architectures and solutions
- Proven experience in software development at scale, with strong foundations in distributed systems, system design, and cloud-native engineering.
- Hands-on experience in shipping AI/ML systems into production.
- Drive observability, guardrails, and evaluation best practices for multi-agent workflows, ensuring visibility, safety, and continuous improvement.
- Partner closely with UX and design teams to ensure agentic features deliver simple, intuitive, and developer-first experiences.
- Contribute to platform-level improvements (component libraries, reusable tools, design systems) that accelerate adoption and developer productivity.
- Mentor and support teammates in applying guardrails, governance, and orchestration patterns consistently across projects.
- Ability to balance engineering trade-offs (reliability, latency, cost) with business outcomes.
- 5 years of relevant industry experience in software engineering and deploying agentic AI systems in production within high-growth environments.
- $200,000 - $260,0000
Salary : $200,000 - $2,600,000