Demo

Senior AI Engineer (LLM & Agent Systems) — Platform

Calliere
York, NY Full Time
POSTED ON 6/10/2026
AVAILABLE BEFORE 8/9/2026

Role Summary
This role focuses on designing and scaling reusable AI-driven workflows, particularly those powered by large language models and autonomous agents. You will build foundational components and abstractions that enable multiple internal teams to rapidly develop and deploy intelligent systems. The position emphasizes system reliability, evaluation rigor, and thoughtful tradeoffs in model and tooling selection.

Core Ownership Areas

  • Develop reusable agent-based workflows to accelerate delivery across multiple projects.

  • Define and maintain evaluation standards to ensure consistent model performance over time.

  • Improve system reliability across key dimensions such as accuracy, latency, and robustness.

  • Build shared APIs and platform components used broadly across engineering teams.

Key Responsibilities

  • Design and implement orchestration patterns for LLM-powered agents.

  • Evaluate and select models, tools, and providers based on performance, cost, and reliability.

  • Build testing frameworks, evaluation pipelines, and monitoring systems for AI outputs.

  • Implement safeguards, fallback mechanisms, and cost optimization strategies.

  • Collaborate with platform and backend engineers to integrate AI capabilities into scalable services.

  • Identify repeatable patterns across projects and convert them into reusable platform features.



Requirements

Required Experience

  • Strong background in building production-grade distributed systems or platform infrastructure.

  • Practical experience developing and deploying LLM-based or agent-driven systems.

  • Demonstrated ability to design for reliability, observability, and cost efficiency.

  • High standards for code quality and system design.

Nice-to-Have Experience

  • Familiarity with retrieval systems, embeddings, or context management pipelines.

  • Experience working within regulated or security-conscious environments.

Approach to Work

  • Prioritizes measurable quality through structured evaluation and testing.

  • Designs systems for reuse, scalability, and clean abstraction layers.

  • Focuses on building solutions that generalize beyond a single use case or team.



Benefits

- Hybrid onsite.
- Incredible perks and comp package. 

Salary : $200,000 - $400,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior AI Engineer (LLM & Agent Systems) — Platform?

Sign up to receive alerts about other jobs on the Senior AI Engineer (LLM & Agent Systems) — Platform career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$92,877 - $110,401
Income Estimation: 
$120,933 - $155,034
Income Estimation: 
$114,618 - $136,401
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other Senior AI Engineer (LLM & Agent Systems) — Platform jobs in the York, NY area that may be a better fit.

  • exacare ai York, NY
  • About ExaCare AI ExaCare AI is a leading health tech company on a mission to build the AI operating system for post-acute care. Our platform turns messy, u... more
  • 4 Days Ago

  • Norm Ai York, NY
  • About Norm Ai Norm Ai, the leading Legal & Compliance AI company, has a client base with a combined $30 trillion in assets under management. By turning leg... more
  • 3 Days Ago

AI Assistant is available now!

Feel free to start your new journey!