Demo

AI Performance Engineer

Graphcore
Milpitas, CA Full Time
POSTED ON 5/25/2026
AVAILABLE BEFORE 7/18/2026
About Us

Graphcore is one of the world’s leading innovators in Artificial Intelligence compute.

It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry.

As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone.

Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation.

Job Summary

Graphcore’s AI/ML training and inference infrastructure is rapidly scaling to meet the growing demands of AI workloads across mobile, edge, and datacenter environments. This role focuses on optimizing performance across ARM-based architectures and large-scale distributed systems, ensuring efficiency, scalability, and reliability across the full hardware-software stack.

The Team

The System Engineering Performance team architects and optimizes high-performance infrastructure for large-scale datacenter deployments. The team works across hardware, software, networking, and system architecture to deliver cutting-edge AI solutions and ensure optimal system performance at scale.

Responsibilities and Duties

  • Analyze ML models’ compute and memory requirements using roofline analysis and simulations
  • Collaborate across hardware and software teams to optimize large-scale AI workloads
  • Benchmark, monitor, and troubleshoot system performance across distributed systems
  • Optimize communication stacks including MPI, NCCL, UCX, RDMA, and networking fabrics
  • Profile and optimize AI workloads, focusing on performance bottlenecks
  • Develop high-quality, ARM-compatible code and documentation

Candidate Profile

Essential

  • BS/MS in Computer Science, Electrical Engineering, or related field
  • Experience with distributed systems and communication libraries (MPI, NCCL, UCX, libfabric)
  • Strong programming skills in C and Python
  • Experience profiling and optimizing HPC or AI/ML workloads
  • Familiarity with ML benchmarks such as MLPerf

Desirable

  • Experience with GPUs or accelerated computing architectures
  • Knowledge of HPC networking and interconnect technologies (InfiniBand, RoCE)
  • Familiarity with ML frameworks such as PyTorch or TensorFlow
  • Understanding of ARM architectures and toolchains
  • Strong debugging, profiling, and performance optimization skills

Salary.com Estimation for AI Performance Engineer in Milpitas, CA
$135,015 to $173,862
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Performance Engineer?

Sign up to receive alerts about other jobs on the AI Performance Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Graphcore

  • Graphcore Austin, TX
  • About Us Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastruct... more
  • 1 Day Ago

  • Graphcore Austin, TX
  • About Us Graphcore is a globally recognised leader in Artificial Intelligence computing systems. The company designs advanced semiconductors and data centr... more
  • 3 Days Ago

  • Graphcore Austin, TX
  • About Us Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastruct... more
  • 4 Days Ago

  • Graphcore Austin, TX
  • About us At Graphcore, we’re building the future of AI compute. We’re a team of semiconductor, software and AI experts, with deep experience in creating th... more
  • 4 Days Ago


Not the job you're looking for? Here are some other AI Performance Engineer jobs in the Milpitas, CA area that may be a better fit.

  • NVIDIA AI Santa Clara, CA
  • Job Requisition ID JR2013607 Job Category Engineering Time Type Full time NVIDIA has been transforming computer graphics, PC gaming, and accelerated comput... more
  • 3 Days Ago

  • Hippocratic AI Palo Alto, CA
  • About Us Hippocratic AI is the leading generative AI company in healthcare. We have the only system that can have safe, autonomous, clinical conversations ... more
  • 23 Days Ago

AI Assistant is available now!

Feel free to start your new journey!