Demo

Senior ML Ops Engineer

Franklin Fitch
York, NY Full Time
POSTED ON 6/4/2026
AVAILABLE BEFORE 7/3/2026

Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | NYC (Hybrid)


A venture-backed AI startup is expanding its engineering team and hiring a Senior MLOps Engineer to build and scale production-grade AI systems for healthcare automation.


This role is focused on building secure, scalable AI infrastructure that supports real enterprise deployment.


Responsibilities:

  • Deploy NLP, OCR, and multimodal AI models in secure cloud environments
  • Design scalable ML pipelines with strong observability, reliability, and performance
  • Build data schemas and ETL workflows for annotations, training, tuning, and benchmarking
  • Establish best practices in experiment tracking, model versioning, and reproducibility
  • Write high-quality, maintainable production code
  • Build internal AI tools to support engineering and product teams
  • Identify and mitigate technical risks early in the release cycle


Requirements:

  • 8–10 years total engineering experience
  • 4 years in MLOps, SRE, DevOps, ML Platform, or similar
  • Strong background in AI data modeling, versioning, and annotation workflows
  • Recent experience delivering scalable enterprise AI products
  • Familiarity with MLflow, LangChain, LangFuse, W&B, CrewAI, or similar frameworks
  • Understanding of monitoring, experiment comparison, and evaluation frameworks
  • Experience with multiple database technologies
  • Strong communication skills and comfort in cross-functional environments
  • Preference for candidates with a mix of startup and tech-company experience
  • Heavy big-bank or Fortune 500 backgrounds are less aligned


Why This Role:

  • High-impact AI work in a complex, meaningful domain
  • Early-stage ownership with influence over AI architecture and engineering culture
  • Competitive compensation, equity, benefits, and flexible time off
  • Flat structure and direct access to leadership


Location: NYC area (hybrid). Local candidates preferred.

Salary : $190,000 - $210,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior ML Ops Engineer?

Sign up to receive alerts about other jobs on the Senior ML Ops Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$105,313 - $133,528
Income Estimation: 
$126,015 - $168,198
Income Estimation: 
$126,033 - $165,110
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Franklin Fitch

  • Franklin Fitch Atlanta, GA
  • Senior Technical Lead | Atlanta, GA | Hybrid | $130K - $165K A well-established technology company with a global enterprise client base is hiring a Senior ... more
  • 5 Days Ago

  • Franklin Fitch Boston, MA
  • Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | Boston (Hybrid) A venture-backed AI startup is expanding its engineering team and h... more
  • 6 Days Ago

  • Franklin Fitch Howell, NJ
  • Pod Manager – MSP | $90k–$110k | 2 days onsite Howell, NJ Click apply if you are an IT Manager working at an MSP in New Jersey! What’s in it for you Lead 1... more
  • 7 Days Ago

  • Franklin Fitch Boston, MA
  • A leading enterprise organisation is seeking a senior Solutions Architect to help drive the modernisation of large-scale cloud data platforms and lakehouse... more
  • 8 Days Ago


Not the job you're looking for? Here are some other Senior ML Ops Engineer jobs in the York, NY area that may be a better fit.

  • SoHo Dragon York, NY
  • Senior AI/ML Engineer Client: Global advertising company Location: Chicago or NYC; 3 days a week onsite. We’re seeking a senior AI/ML Engineer with minimum... more
  • 17 Days Ago

  • FutureFit AI York, NY
  • Staff / Principal MLOps Engineer Contract (6 months, potential to convert) or Full-Time | USD $195,000 - $220,000 (NYC) | Remote (US or Canada) Introductio... more
  • 5 Days Ago

AI Assistant is available now!

Feel free to start your new journey!