Demo

Machine Learning Engineer - On-Device Speech Recognition

DeepRec.ai
San Francisco, CA Full Time
POSTED ON 5/3/2026
AVAILABLE BEFORE 5/21/2026
Machine Learning Engineer - On-Device Speech Recognition
$200,000 - $300,000
San Francisco, hybrid (3x per week)
Full time / Permanent

This company builds AI-powered tools that help professionals capture and use what's said in the real world of work - meetings, conversations, voice notes. It's profitable, bootstrapped, and growing fast: $250M revenue run rate in under three years, with over 1.5 million users globally.

The product is working. The next step is making the speech engine significantly better by making it smaller, faster, and more accurate across every device and language it runs on.

What you'll do
  • Design and train lightweight on-device ASR models (e.g. Streaming Transducer, CTC) that run efficiently on mobile and embedded hardware
  • Compress and optimize models using quantization, pruning, and knowledge distillation
  • Clean, align, and augment multilingual speech data; handle low-resource languages and noisy real-world conditions
  • Work closely with engineering teams to convert and deploy models into production

What "great" looks like
  • You've trained or fine-tuned ASR models at production scale, not just in research settings
  • You know at least one major ASR framework deeply (Wenet, Espnet, Icefall/K2, or Zipformer) and understand how they actually work at a structural level
  • You've deployed on-device or offline ASR models and solved the messy problems that come with real hardware constraints
  • You've done hands-on post-training quantization and know how to recover accuracy when it degrades
  • Master's or PhD in Computer Science, Signal Processing, or similar, and 3–5 years in speech algorithms

Bonus: published research at ICASSP or Interspeech, experience with Zipformer / Paraformer / SenseVoice, or knowledge distillation from large speech models to compact ones.

Why join

  • Profitable, fast-moving company. Your work ships and gets used by over a million people
  • Real ownership of the on-device speech stack, not one task on a large team's backlog
  • Hybrid San Francisco team building both hardware and AI systems in parallel
  • Meaningful datasets and global product scale to test and prove your work
  • Clear growth toward senior technical leadership as the audio function expands

Salary : $200,000 - $300,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Machine Learning Engineer - On-Device Speech Recognition?

Sign up to receive alerts about other jobs on the Machine Learning Engineer - On-Device Speech Recognition career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at DeepRec.ai

  • DeepRec.ai San Francisco, CA
  • Speech Algorithm Engineer (Speech LLM / SpeechLLM) $200,000 - $300,000 San Francisco, Hybrid 3x per week in office Full time / Permanent About the Role Thi... more
  • 12 Days Ago

  • DeepRec.ai Palo Alto, CA
  • 🚀 Senior Platform Engineer (Backend) | Palo Alto (Hybrid) Generative AI | Healthcare Build technology that truly matters. We’re working with a high-growth... more
  • 3 Days Ago

  • DeepRec.ai San Francisco, CA
  • Machine Learning Engineer – Speech Model Training $250,000 - $300,000 San Francisco, CA Hybrid, 3x per week in office Full time / Permanent In this role yo... more
  • 3 Days Ago

  • DeepRec.ai San Francisco, CA
  • Staff Agentic AI Engineer / AI Engineer $200,000 - $250,000 San Francisco, CA Onsite, 5x per week in office Full time / Permanent Most "agentic AI" roles a... more
  • 3 Days Ago


Not the job you're looking for? Here are some other Machine Learning Engineer - On-Device Speech Recognition jobs in the San Francisco, CA area that may be a better fit.

  • Plaud San Francisco, CA
  • About Plaud Inc. Plaud is building the world's most trusted AI work companion for professionals to elevate productivity and performance through note-taking... more
  • 2 Days Ago

  • DeepRec.ai San Francisco, CA
  • Machine Learning Engineer – Speech Model Training $250,000 - $300,000 San Francisco, CA Hybrid, 3x per week in office Full time / Permanent In this role yo... more
  • 3 Days Ago

AI Assistant is available now!

Feel free to start your new journey!