Demo

MLOps Engineer

Evlo AI
Boston, MA Full Time
POSTED ON 8/30/2026
AVAILABLE BEFORE 9/28/2026
About The Role

The role owns the infrastructure, orchestration, and deployment pipelines that power large-scale machine learning and generative AI systems in production.

The team works closely with machine learning engineers and data scientists to ensure models scale reliably, maintain low latency, and remain observable under heavy enterprise workloads.

Key Responsibilities

  • Design and implement scalable MLOps infrastructure using Kubernetes, Docker, Terraform, and modern CI/CD pipelines
  • Build automated model training, validation, and deployment pipelines to streamline the path from research to production
  • Deploy and manage model serving endpoints using Triton, TorchServe, vLLM, or AWS SageMaker for low-latency inference
  • Configure automated monitoring systems for data drift, concept drift, system latency, and infrastructure resource utilization
  • Implement comprehensive logging, tracing, and observability frameworks for complex LLM and traditional ML workflows
  • Collaborate with security and engineering teams to ensure compliance, model governance, and robust access controls

What We Are Looking For

  • 3–7 years of experience in MLOps, DevOps, or machine learning infrastructure engineering
  • Strong proficiency in Python, containerization technologies (Docker), and orchestration platforms (Kubernetes)
  • Hands-on experience with cloud infrastructure providers such as AWS, GCP, or Azure
  • Familiarity with model serving frameworks, feature stores (Feast, Hopsworks), and vector databases
  • Solid understanding of CI/CD principles and infrastructure-as-code tools like Terraform or Ansible
  • Bonus: Experience managing LLM inference optimization, vLLM, Triton, or large-scale distributed training clusters

Salary.com Estimation for MLOps Engineer in Boston, MA
$129,012 to $163,023
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a MLOps Engineer?

Sign up to receive alerts about other jobs on the MLOps Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$117,024 - $149,811
Income Estimation: 
$137,568 - $176,908
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Evlo AI

  • Evlo AI Boston, MA
  • About The Role The role owns the full-cycle enterprise sales process, driving net-new revenue and expansion opportunities within high-growth B2B SaaS organ... more
  • 1 Day Ago

  • Evlo AI Washington, DC
  • About The Role The role owns the end-to-end development of native mobile applications across iOS and Android platforms, delivering performant, highly respo... more
  • 2 Days Ago

  • Evlo AI Denver, CO
  • About The Role The role owns the analytical infrastructure and insights engine, turning raw event data and financial metrics into actionable strategic deci... more
  • 2 Days Ago

  • Evlo AI Denver, CO
  • About The Role The role owns the end-to-end product lifecycle for core software platforms, translating ambiguous business problems into clear technical roa... more
  • 2 Days Ago


Not the job you're looking for? Here are some other MLOps Engineer jobs in the Boston, MA area that may be a better fit.

  • NxT Level Boston, MA
  • Job Description. Job Description. Technical Lead Manager, Machine Learning Operations. Location. United States. Employment Type. Full-time. Focus. MLOps, M... more
  • 26 Days Ago

  • TetraScience Cambridge, MA
  • Who We Are TetraScience is the Scientific Data and AI Cloud company. We are catalyzing the Scientific AI revolution by designing and industrializing AI-nat... more
  • 29 Days Ago

AI Assistant is available now!

Feel free to start your new journey!