Demo

ML Engineer - Agent Infrastructure

Engram
San Francisco, CA Full Time
POSTED ON 7/23/2026
AVAILABLE BEFORE 8/21/2026
About The Role

We're building Monad, our agent runtime that orchestrates complex workflows with memory, reasoning, and tool integration. You'll own critical infrastructure that powers AI systems across clinical research, cybersecurity, and scientific computing.

What you'll do

  • Build and maintain the Monad DAG execution engine
  • Implement trace logging and observability for agent workflows
  • Design tool integration patterns for domain-specific capabilities
  • Optimize inference latency and throughput for production workloads
  • Work closely with research to integrate new memory and reasoning capabilities

Requirements

  • 5 years experience in software engineering, with focus on ML systems
  • Strong Python skills; experience with async programming
  • Experience building production ML/AI systems at scale
  • Understanding of LLM inference, tokenization, and prompting
  • Familiarity with distributed systems and message queues

Nice to have

  • Experience with agent frameworks (LangChain, AutoGPT, etc.)
  • Background in compilers or runtime systems
  • Contributions to open-source ML projects

Salary.com Estimation for ML Engineer - Agent Infrastructure in San Francisco, CA
$122,348 to $157,078
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a ML Engineer - Agent Infrastructure?

Sign up to receive alerts about other jobs on the ML Engineer - Agent Infrastructure career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$77,900 - $95,589
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other ML Engineer - Agent Infrastructure jobs in the San Francisco, CA area that may be a better fit.

  • Mach9 San Francisco, CA
  • The role At Mach9, ML infrastructure engineers build and maintain the systems that power production AI models for civil engineering and surveying. Our ML p... more
  • Just Posted

  • Recruiting From Scratch San Francisco, CA
  • Who is Recruiting from Scratch : Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware... more
  • 1 Day Ago

AI Assistant is available now!

Feel free to start your new journey!