Demo

Senior Compiler Engineer

Oho Group
San Jose, CA Full Time
POSTED ON 6/5/2026
AVAILABLE BEFORE 7/4/2026

About the Role


Incredible opportunity to work with a deep-tech company building foundational software for next-generation AI and high-performance computing workloads. Operating at the intersection of compiler technology, hardware abstraction, and accelerated computing, the team is tackling some of the most challenging problems in modern GPU software infrastructure.


This is an exciting opportunity to work on cutting-edge compiler technology, helping build the systems that enable AI and HPC workloads to execute efficiently across advanced GPU and accelerator architectures.


Key Responsibilities


  • You will design and develop compiler infrastructure focused on accelerating machine learning and high-performance compute workloads on modern GPU architectures.
  • You'll get the chance to build and optimise MLIR-based compilation pipelines, developing transformation and optimisation passes that improve performance across a range of hardware targets.
  • You will contribute to LLVM backend development, working on key compiler components including instruction selection, register allocation, scheduling, and target-specific optimisations.
  • This is an excellent opportunity for you to collaborate with compiler, hardware, and systems engineers to deliver scalable, high-performance software solutions.
  • You'll be responsible for analysing compiler output, profiling performance, and identifying opportunities to improve execution efficiency across GPU workloads.
  • You will help shape the evolution of the compiler stack as new hardware capabilities, workloads, and optimisation strategies emerge.


Required Qualifications


  • You'll need at least 5 years of experience in compiler engineering, with a strong focus on GPU architectures, hardware accelerators, or performance-critical systems.
  • You should have expert-level C development skills and extensive experience working with LLVM infrastructure.
  • You must have a strong understanding of LLVM IR, compiler pass development, and optimisation techniques.
  • Experience building, extending, or maintaining compiler backends is essential.
  • You'll need strong problem-solving skills and the ability to work across complex software and hardware domains.


Preferred Qualifications


  • Experience developing MLIR-based compiler pipelines and optimisation passes.
  • Exposure to GPU kernel programming frameworks such as Triton or similar technologies.
  • Understanding of modern AI workloads and the compiler challenges associated with accelerated machine learning systems.
  • Experience with performance profiling, code generation, and hardware-aware optimisation techniques.
  • Familiarity with AI-assisted development tools and workflows, including Claude Code or similar platforms.


Education


You should be educated to BS, MS, or PhD level in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or possess equivalent industry experience.


Package & Benefits


  • Competitive salary up to $300,000.
  • Comprehensive medical, dental, and vision coverage.
  • 401(k) retirement plan.
  • Flexible working arrangements with the option to work remotely or on-site in San Jose.


Apply now as interviews are actively being scheduled.

Salary : $250,000 - $300,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior Compiler Engineer?

Sign up to receive alerts about other jobs on the Senior Compiler Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$79,473 - $93,666
Income Estimation: 
$90,372 - $103,622
Income Estimation: 
$61,825 - $80,560
Income Estimation: 
$90,032 - $105,965
Income Estimation: 
$85,996 - $102,718
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Oho Group

  • Oho Group Los Angeles, CA
  • Why This Role You’ll work on real, large-scale aerospace systems where embedded software directly drives hardware performance. This is a hands-on role for ... more
  • 2 Days Ago

  • Oho Group San Jose, CA
  • Senior/Lead Inference Systems Engineer (ML/AI) About the Role We're looking for a Senior or Lead Inference Systems Engineer to help build the next generati... more
  • 2 Days Ago

  • Oho Group Boston, MA
  • The Opportunity Join an advanced technology company developing complex, high-performance systems that integrate hardware and software. As an Optical Engine... more
  • 3 Days Ago

  • Oho Group Austin, TX
  • The Opportunity Join a high-performance engineering team building advanced systems from the ground up. You’ll work close to the hardware, developing embedd... more
  • 3 Days Ago


Not the job you're looking for? Here are some other Senior Compiler Engineer jobs in the San Jose, CA area that may be a better fit.

  • NVIDIA AI Santa Clara, CA
  • Job Requisition ID JR2016592 Job Category Engineering Time Type Full time NVIDIA has been transforming computer graphics, PC gaming, and accelerated comput... more
  • 15 Days Ago

  • NVIDIA AI Santa Clara, CA
  • Job Requisition ID JR2016941 Job Category Engineering Time Type Full time Data Processing Units (DPUs) are the new class of programmable processors ignitin... more
  • 16 Days Ago

AI Assistant is available now!

Feel free to start your new journey!