Demo

Senior ML Ops Engineer

Franklin Fitch
Boston, MA Full Time
POSTED ON 4/18/2026
AVAILABLE BEFORE 5/17/2026

Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | Boston (Hybrid)


A venture-backed AI startup is expanding its engineering team and hiring a Senior MLOps Engineer to build and scale production-grade AI systems for healthcare automation.


This role is focused on building secure, scalable AI infrastructure that supports real enterprise deployment.


Responsibilities:

  • Deploy NLP, OCR, and multimodal AI models in secure cloud environments
  • Design scalable ML pipelines with strong observability, reliability, and performance
  • Build data schemas and ETL workflows for annotations, training, tuning, and benchmarking
  • Establish best practices in experiment tracking, model versioning, and reproducibility
  • Write high-quality, maintainable production code
  • Build internal AI tools to support engineering and product teams
  • Identify and mitigate technical risks early in the release cycle


Requirements:

  • 8–10 years total engineering experience
  • 4 years in MLOps, SRE, DevOps, ML Platform, or similar
  • Strong background in AI data modeling, versioning, and annotation workflows
  • Recent experience delivering scalable enterprise AI products
  • Familiarity with MLflow, LangChain, LangFuse, W&B, CrewAI, or similar frameworks
  • Understanding of monitoring, experiment comparison, and evaluation frameworks
  • Experience with multiple database technologies
  • Strong communication skills and comfort in cross-functional environments
  • Preference for candidates with a mix of startup and tech-company experience
  • Heavy big-bank or Fortune 500 backgrounds are less aligned


Why This Role:

  • High-impact AI work in a complex, meaningful domain
  • Early-stage ownership with influence over AI architecture and engineering culture
  • Competitive compensation, equity, benefits, and flexible time off
  • Flat structure and direct access to leadership


Location: Boston area (hybrid). Local candidates preferred.

Salary : $190,000 - $210,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior ML Ops Engineer?

Sign up to receive alerts about other jobs on the Senior ML Ops Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$105,313 - $133,528
Income Estimation: 
$126,015 - $168,198
Income Estimation: 
$126,033 - $165,110
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Franklin Fitch

  • Franklin Fitch Wilton, CT
  • Identity Management Engineer Contract (6 months renewals) Hybrid - Wilton, CT About the Role: We are seeking a skilled Identity Management Engineer to supp... more
  • 11 Days Ago

  • Franklin Fitch Georgia, GA
  • Staff Agentic AI Engineer | Remote (Only Atlanta-based candidates) | $200K - $250K We’re partnered with a fast-scaling AI startup building production-grade... more
  • 11 Days Ago

  • Franklin Fitch Atlanta, GA
  • Security Architect | Global Professional Services Firm | Atlanta (Hybrid) I’m working with a leading global professional services organization to appoint a... more
  • 11 Days Ago

  • Franklin Fitch Memphis, TN
  • Windows Systems Engineer Location: Memphis, Tennessee Salary: Up to $100,000 Work Type: Full Onsite A stable, long-established distribution company is hiri... more
  • 12 Days Ago


Not the job you're looking for? Here are some other Senior ML Ops Engineer jobs in the Boston, MA area that may be a better fit.

  • Generate:Biomedicines Somerville, MA
  • About Generate:Biomedicines Generate:Biomedicines is a new kind of therapeutics company – existing at the intersection of machine learning, biological engi... more
  • 28 Days Ago

  • Pragmatike Cambridge, MA
  • Location: Cambridge, MA (Eastern Time / UTC -4) Relocation package available or Remote option for Out-Of-State applicants Start date: ASAP Languages: Engli... more
  • 18 Days Ago

AI Assistant is available now!

Feel free to start your new journey!