Demo

Principal Software Engineer, AI Accelerator

Ampere Computing LLC
Santa Clara, CA Full Time
POSTED ON 7/26/2026
AVAILABLE BEFORE 8/25/2026
Description

Invent the future with us.

Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient AI compute.

As a pioneer in the new frontier of energy efficient high-performance computing, Ampere is part of the Softbank Group of companies driving sustainable computing for AI, Cloud, and edge applications.

Join us at Ampere and work alongside a passionate and growing team - we'd love to have you apply!

About the role:

In this role, you will optimize computational graphs to unlock the full potential of Ampere's deep learning accelerator. You'll work across the full SW/HW stack - from inference serving and framework integration down to compiler, runtime, and compute kernels.

What you'll achieve:
  • Optimize deep learning computational graphs for performance, throughput, and latency on Ampere's accelerator hardware
  • Enable popular models and frameworks (PyTorch, Llama.cpp) and serving platforms (vLLM, SGLang)
  • Identify and implement graph-level optimizations: op fusion, pattern recognition, redundancy elimination
  • Collaborate on HW/SW co-design to push computational efficiency
  • Work with cross-functional teams to integrate AI solutions into Ampere's AI hardware platforms

About you:
  • Bachelors degree in Computer Science, Mathematics or a related technical field & 8 years of related experience; or Master's degree & 6 years
  • Strong CS fundamentals: algorithms, data structures, systems
  • Solid graph algorithm knowledge and reasoning ability
  • Proficiency in Python and C/C
  • Demonstrated exceptional problem-solving ability - IOI medal, ACM ICPC medal, Codeforces Grandmaster, USACO Platinum, or equivalent competitive programming achievement is a big plus
  • Fast learner who can pick up new domains quickly and maximize agent-assisted development
  • Familiarity with deep learning concepts and neural network architectures is a plus

What we'll offer:

At Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, cash long-term incentive, and comprehensive benefits. The full base pay range for this role is between $195,000 and $292,000. Our benefits include health, wellness, and financial programs that support employees through every stage of life.

Benefit highlights include:
  • Premium medical insurance, dental insurance, vision insurance, as well as income protection and a 401K retirement plan, so that you can feel secure in your health and financial future.
  • Unlimited Flextime and 10 paid holidays so that you can embrace a healthy work-life balance.
  • A variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day.

And there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are excited to share more about our career opportunities with you through the interview process. Our benefits include health, wellness, and financial programs that support employees through every stage of life.

#LI-DR

#LI-Hybrid

Ampere is an inclusive and equal opportunity employer and welcomes applicants from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, national origin, citizenship, religion, age, veteran and/or military status, sex, sexual orientation, gender, gender identity, gender expression, physical or mental disability, or any other basis protected by federal, state or local law.

Salary : $195,000 - $292,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Principal Software Engineer, AI Accelerator?

Sign up to receive alerts about other jobs on the Principal Software Engineer, AI Accelerator career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$176,149 - $220,529
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Ampere Computing LLC

  • Ampere Computing LLC Portland, OR
  • Description Invent the future with us. Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach ... more
  • 1 Day Ago

  • Ampere Computing LLC Portland, OR
  • Description Invent the future with us. Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach ... more
  • 1 Day Ago

  • Ampere Computing LLC Portland, OR
  • Description Invent the future with us. Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach ... more
  • 1 Day Ago

  • Ampere Computing LLC Santa Clara, CA
  • Description Invent the future with us. Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach ... more
  • 1 Day Ago


Not the job you're looking for? Here are some other Principal Software Engineer, AI Accelerator jobs in the Santa Clara, CA area that may be a better fit.

  • Ampere Computing LLC Santa Clara, CA
  • Description Invent the future with us. Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach ... more
  • 1 Day Ago

  • Ampere Santa Clara, CA
  • Description Invent the future with us. Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach ... more
  • 2 Days Ago

AI Assistant is available now!

Feel free to start your new journey!