Demo

Machine Learning Systems Engineer

Classie AI
Palo Alto, CA Full Time
POSTED ON 12/4/2025
AVAILABLE BEFORE 6/1/2026

Classie is an early stage startup at the intersection of product and research. Team members have deployed at scale in companies such as Google, Nvidia, VMware, have academic background from Stanford, and have done over 20 startups among them. Classie is building the first platform to supervise AI in real-time, using a systems-first approach to explain and secure complex AI agent behavior at high token volume.


We're looking for a ML Systems Engineer who will help design, build and maintain our rapidly expanding core ML systems. You’ll solve hard problems working alongside a team of cross-stack experts who have done it before, contributing to the creation of a category-defining company.


Responsibilities

  • Design and implement ML inference machinery for fast, cost-effective, and high-accuracy real-time analysis.
  • Develop and maintain data pipelines for activity tracing, storage, and event detection across the platform.
  • Build and scale training infrastructure, and develop self-learning mechanisms.


Qualifications

Required: Deep knowledge of PyTorch or JAX

Preferred Experience:

  • Designing data synthesis pipelines and dataset construction.
  • Designing evaluation frameworks and custom benchmarks to measure model capability
  • Implementing model acceleration techniques (e.g., Sparsification / Quantization-aware training)
  • Working knowledge of high-throughput serving systems (e.g., vLLM / SGLang)
  • Working knowledge of RL systems (e.g., verl) is a plus.


Salary.com Estimation for Machine Learning Systems Engineer in Palo Alto, CA
$144,542 to $170,211
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Machine Learning Systems Engineer?

Sign up to receive alerts about other jobs on the Machine Learning Systems Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$163,289 - $195,234
Income Estimation: 
$136,356 - $178,393
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$70,609 - $91,165
Income Estimation: 
$86,680 - $110,316
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$86,680 - $110,316
Income Estimation: 
$110,730 - $135,754
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$110,730 - $135,754
Income Estimation: 
$128,617 - $162,576
Income Estimation: 
$117,033 - $148,289
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other Machine Learning Systems Engineer jobs in the Palo Alto, CA area that may be a better fit.

  • Cisco Systems, Inc. San Jose, CA
  • Meet the Team We are an agile team with a startup feel and a strong bias for action. We move fast, embrace failure as part of the process, and stay focused... more
  • 15 Days Ago

  • Cisco Systems, Inc. San Jose, CA
  • Meet the Team Join the engineering team building theintelligent backbone of Splunk Observability Cloud. We are committed to leveraging the latest advanceme... more
  • 2 Months Ago

AI Assistant is available now!

Feel free to start your new journey!