Demo

Senior ML Ops Engineer

Franklin Fitch
Boston, MA Full Time
POSTED ON 6/8/2026 CLOSED ON 6/13/2026

What are the responsibilities and job description for the Senior ML Ops Engineer position at Franklin Fitch?

Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | Boston (Hybrid)


A venture-backed AI startup is expanding its engineering team and hiring a Senior MLOps Engineer to build and scale production-grade AI systems for healthcare automation.


This role is focused on building secure, scalable AI infrastructure that supports real enterprise deployment.


Responsibilities:

  • Deploy NLP, OCR, and multimodal AI models in secure cloud environments
  • Design scalable ML pipelines with strong observability, reliability, and performance
  • Build data schemas and ETL workflows for annotations, training, tuning, and benchmarking
  • Establish best practices in experiment tracking, model versioning, and reproducibility
  • Write high-quality, maintainable production code
  • Build internal AI tools to support engineering and product teams
  • Identify and mitigate technical risks early in the release cycle


Requirements:

  • 8–10 years total engineering experience
  • 4 years in MLOps, SRE, DevOps, ML Platform, or similar
  • Strong background in AI data modeling, versioning, and annotation workflows
  • Recent experience delivering scalable enterprise AI products
  • Familiarity with MLflow, LangChain, LangFuse, W&B, CrewAI, or similar frameworks
  • Understanding of monitoring, experiment comparison, and evaluation frameworks
  • Experience with multiple database technologies
  • Strong communication skills and comfort in cross-functional environments
  • Preference for candidates with a mix of startup and tech-company experience
  • Heavy big-bank or Fortune 500 backgrounds are less aligned


Why This Role:

  • High-impact AI work in a complex, meaningful domain
  • Early-stage ownership with influence over AI architecture and engineering culture
  • Competitive compensation, equity, benefits, and flexible time off
  • Flat structure and direct access to leadership


Location: Boston area (hybrid). Local candidates preferred.

Salary : $190,000 - $210,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior ML Ops Engineer?

Sign up to receive alerts about other jobs on the Senior ML Ops Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$105,313 - $133,528
Income Estimation: 
$126,015 - $168,198
Income Estimation: 
$126,033 - $165,110
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
This job has expired.
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Franklin Fitch

  • Franklin Fitch Atlanta, GA
  • Senior Technical Lead | Atlanta, GA | Hybrid | $130K - $165K A well-established technology company with a global enterprise client base is hiring a Senior ... more
  • 5 Days Ago

  • Franklin Fitch Howell, NJ
  • Pod Manager – MSP | $90k–$110k | 2 days onsite Howell, NJ Click apply if you are an IT Manager working at an MSP in New Jersey! What’s in it for you Lead 1... more
  • 7 Days Ago

  • Franklin Fitch Boston, MA
  • A leading enterprise organisation is seeking a senior Solutions Architect to help drive the modernisation of large-scale cloud data platforms and lakehouse... more
  • 8 Days Ago

  • Franklin Fitch York, NY
  • Desktop Support Technician - Hybrid, NYC - Up to $105,000 DOE What You’ll Do Provide Tier 2 technical support for end users across desktop, laptop, mobile,... more
  • 8 Days Ago


Not the job you're looking for? Here are some other Senior ML Ops Engineer jobs in the Boston, MA area that may be a better fit.

  • Strategy& Boston, MA
  • At PwC, our people in operations consulting specialise in providing consulting services on optimising operational efficiency and effectiveness. These indiv... more
  • 10 Days Ago

  • Generate:Biomedicines Somerville, MA
  • About Generate:Biomedicines Generate:Biomedicines is a new kind of therapeutics company – existing at the intersection of machine learning, biological engi... more
  • 22 Days Ago

AI Assistant is available now!

Feel free to start your new journey!