Demo

Senior/Staff AI Engineer

DataDirect Networks
San Francisco, CA Full Time
POSTED ON 5/23/2026
AVAILABLE BEFORE 7/23/2026
Senior/Staff AI Engineer
Job Locations US-CA-San Francisco - Remote | US-NC-Raleigh
Job ID 2026-5811 Name Linked Remote: San Francisco, CA Country United States City San Francisco - Remote Worker Type Regular Full-Time Employee Posting Location : State/Province CA
Overview

Build the AI infrastructure layer that determines whether modern models actually work in production.

Most AI roles sit at the application layer. This one does not.

At DDN, we're hiring an AI Engineer to work on the hard part of AI: the systems, storage, and performance infrastructure behind real-world model serving and inference. This is the role for engineers who care about what happens under load, at scale, and in production - not just in demos.

If your background sits at the intersection of AI infrastructure, distributed systems, and performance engineering, this is the kind of role where your depth will matter.

Job Description

What you'll do

    Build and optimize LLM serving and inference systems for production environments
  • Improve performance across GPU and CPU pathways
  • Work on KV cache, memory, storage, and throughput bottlenecks
  • Design and scale systems that support RAG and retrieval-heavy AI workloads
  • Contribute to infrastructure where storage architecture and systems efficiency materially affect AI performance
  • Solve engineering problems at the intersection of AI, high-performance systems, and distributed infrastructure

What we're looking for

  • An engineer who has spent meaningful time building or optimizing production AI systems, not just experimenting with models
  • Someone who understands how inference performance is shaped by the interaction between compute, memory, storage, and serving architecture
  • Deep hands-on experience working close to the systems layer - for example, improving how workloads run across GPU and CPU resources, reducing bottlenecks, or tuning infrastructure for better throughput and latency
  • Evidence of real ownership in areas like model serving, retrieval, caching, storage, or distributed performance, rather than purely application-layer AI work
  • The ability to move comfortably between architecture decisions and hands-on implementation, especially in environments where efficiency and scale matter
  • A background that suggests you can operate in technically demanding environments, whether that comes from AI infrastructure, high-performance systems, storage platforms, or adjacent distributed systems work
  • PhD preferred, but far less important than having built serious systems in the real world

Why this role is compelling

  • This is not a "prompt engineering" job.
  • This is not an "AI wrapper" job.
  • This is not a generic backend role with AI sprinkled on top.
  • This is a chance to work on the infrastructure that determines whether modern AI systems are fast, scalable, efficient, and commercially viable.
  • If you want to work on the real mechanics of AI performance - serving, retrieval, compute efficiency, memory behavior, storage architecture, and inference at scale - this is where that work happens.

Who will love this role

  • Engineers who enjoy deep systems problems
  • Builders who care about performance, scale, and architecture
  • People who want to work where AI meets infrastructure
  • Candidates who would rather solve hard technical bottlenecks than ship surface-level AI features

Who should not apply

This role is not for:

  • Purely academic researchers without meaningful production ownership
  • Generic software engineers without clear AI systems or inference depth
  • Candidates focused mainly on prompt engineering or lightweight application integrations
  • MLOps generalists who have not worked deeply on serving, storage, or performance-critical AI systems

Salary Range: $150,000 - $250,000

DDN

Why DDN - DDN has deep credibility in high-performance infrastructure, and this role sits in a part of the market where that foundation matters. If you want to build the systems serious AI depends on - rather than the layer that merely sits on top of it - this is a rare opportunity to do exactly that.

Apply if you want to build the infrastructure behind production AI - not just consume it.

#Linkedin


DataDirect Networks, Inc. is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity, gender expression, transgender, sex stereotyping, sexual orientation, national origin, disability, protected Veteran Status, or any other characteristic protected by applicable federal, state, or local law.

 

Salary : $150,000 - $250,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior/Staff AI Engineer?

Sign up to receive alerts about other jobs on the Senior/Staff AI Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at DataDirect Networks

  • DataDirect Networks San Francisco, CA
  • Senior / Staff NFS Engineer Job Locations US-CA-San Francisco - Remote | US-NC-Raleigh Job ID 2026-5807 Name Linked Remote: San Francisco, CA Country Unite... more
  • 2 Days Ago

  • DataDirect Networks San Francisco, CA
  • Senior/Staff Fuse Developer Job Locations US-CA-San Francisco - Remote | US-NC-Raleigh Job ID 2026-5812 Name Linked Remote: San Francisco, CA Country Unite... more
  • 2 Days Ago

  • DataDirect Networks Los Angeles, CA
  • Account Executive / Client Director Job Locations US-Remote Job ID 2026-5817 Name Linked Remote: US Country United States City Remote Worker Type Regular F... more
  • 2 Days Ago

  • DataDirect Networks Los Angeles, CA
  • NVIDIA Partner Marketing Manager Job Locations US-CA-Remote Job ID 2025-5524 Name Linked Remote: California Country United States City Remote Worker Type R... more
  • 11 Days Ago


Not the job you're looking for? Here are some other Senior/Staff AI Engineer jobs in the San Francisco, CA area that may be a better fit.

  • JazzX AI San Francisco, CA
  • About JazzX AI Vision: Enterprises operating on institutional intelligence—governed, self-improving, and scalable beyond individual expertise. JazzX AI is ... more
  • 3 Days Ago

  • Scale AI, Inc. San Francisco, CA
  • About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with leading ... more
  • 6 Days Ago

AI Assistant is available now!

Feel free to start your new journey!