Demo

Compiler Engineer

Oho Group
San Jose, CA Full Time
POSTED ON 5/7/2026
AVAILABLE BEFORE 6/4/2026

Compiler Engineer – GPU – up to $300k (Fully Remote)


Overview:

We have partnered with an incredibly exciting start-up focused on developing GPU software and intellectual property, founded by a prominent GPU architect. Having recently raised 20m in seed round funding, our client is on the hunt for a compiler engineer to help them continue to grow.


About the role:

  • Design and implement compiler infrastructure focused on accelerating GPU workloads.
  • Create and streamline MLIR-based compilation passes targeting IP and GPU architectures.
  • Build and maximise LLVM backend components, particularly register allocation, instruction selection, and target specific optimizations.


About you:

  • 5 years compiler engineering experience, focused on GPU or hardware accelerator backends.
  • High level of skill in C and LLVM, particularly LLVM IR and pass infrastructure.
  • Experience working with high-level GPU kernel frameworks such as Triton, as well as practical knowledge of Claude Code or equivalent AI-assisted workflows.


Why apply?

  • Chance to work with an elite founder and be a part of a growing company with hundreds of patents.
  • You will be learning directly from top-tier chip/GPU architects allowing for a great opportunity to upskill and work among the best in the business.
  • Opportunity to test yourself as part of an ambitious project, seeking to re-architect the GPU stack.


Salary

  • Up to $300k salary, medical insurance, vision insurance, dental insurance, 401k
  • San Jose, CA, USA (in person)


Apply now as interviews are being scheduled.


#GPU #backend #LLVM #MLIR #TRITON #C

Salary : $280,000 - $300,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Compiler Engineer?

Sign up to receive alerts about other jobs on the Compiler Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$117,871 - $153,580
Income Estimation: 
$131,745 - $167,716
Income Estimation: 
$144,503 - $184,592
Income Estimation: 
$102,541 - $137,871
Income Estimation: 
$153,752 - $200,235
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Oho Group

  • Oho Group Santa Clara, CA
  • We are seeking a Senior SoC Design & Integration Engineer to lead the architecture, design, and implementation of complex SoCs for next-generation compute ... more
  • 8 Days Ago

  • Oho Group Boston, MA
  • Electrical Manufacturing Engineer - Startup - Boston The Oho Group are working closely with an exceptionally well-funded deep-tech startup at the forefront... more
  • Just Posted

  • Oho Group Boston, MA
  • Electrical Manufacturing Engineer - Boston - Well-Funded Startup The Oho Group have partnered with a startup building the future of quantum computing who a... more
  • Just Posted

  • Oho Group Boston, MA
  • The Opportunity Join an innovative deep-tech company developing highly advanced hardware systems. This role will focus on designing and developing low-nois... more
  • Just Posted


Not the job you're looking for? Here are some other Compiler Engineer jobs in the San Jose, CA area that may be a better fit.

  • IC Resources Palo Alto, CA
  • Staff / Principal Compiler Engineer – AI Accelerators Location: Palo Alto (California) Working Model: Hybrid A stealth-mode AI hardware company is looking ... more
  • 2 Days Ago

  • TetraMem - Accelerate The World San Jose, CA
  • Responsibilities Develop compiler toolchain to translate deep learning models to revolutionary new hardware Innovative in ways to optimize the speed and ef... more
  • 3 Days Ago

AI Assistant is available now!

Feel free to start your new journey!