Demo

ML Systems Engineer: Distributed LLM Training & Inference

Scale AI
York, NY Full Time
POSTED ON 8/16/2026
AVAILABLE BEFORE 10/16/2026
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates sh

Salary.com Estimation for ML Systems Engineer: Distributed LLM Training & Inference in York, NY
$122,218 to $157,389
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a ML Systems Engineer: Distributed LLM Training & Inference?

Sign up to receive alerts about other jobs on the ML Systems Engineer: Distributed LLM Training & Inference career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$86,680 - $110,316
Income Estimation: 
$110,730 - $135,754
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Scale AI

  • Scale AI Washington, DC
  • We are seeking a highly skilled Infrastructure Security Engineer to join our team. This role is integral to ensuring the security and integrity of our plat... more
  • 1 Day Ago

  • Scale AI Seattle, WA
  • Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering M... more
  • 1 Day Ago

  • Scale AI Austin, TX
  • At Scale, we build the AI systems behind some of the country's most important decisions. On the Public Sector Engineering team, you'll embed directly with ... more
  • 1 Day Ago

  • Scale AI Honolulu, HI
  • Scale AI is seeking a highly skilled and motivated Mission Software Engineer to join our dynamic Federal Engineering team. As a part of this team, you will... more
  • 2 Days Ago


Not the job you're looking for? Here are some other ML Systems Engineer: Distributed LLM Training & Inference jobs in the York, NY area that may be a better fit.

  • Scale AI York, NY
  • A leading AI technology firm in New York is seeking a talented individual to build and optimize their training and inference frameworks for large language ... more
  • 17 Days Ago

  • Apetan Consulting llc York, NY
  • LLM DevOps/Inference Engineer- Client: Protégé Location: REMOTE Duration 12-18 months Must Have: Build and maintain the AWS infrastructure for the evaluati... more
  • 29 Days Ago

AI Assistant is available now!

Feel free to start your new journey!