Demo

Graph Optimization Engineer

Oho Group
San Jose, CA Full Time
POSTED ON 6/17/2026
AVAILABLE BEFORE 7/15/2026

Compiler Optimization Engineer / Well-funded start-up / Greenfield opportunity


Exciting chance to join a well-funded startup building a hardware-agnostic AI compiler allowing you to write once, run on any accelerator architecture at full performance.


We're hiring a core engineer to own the graph optimisation layer of our compiler stack. You'll have real ownership over how the next generation of AI models perform across diverse and emerging hardware targets.


About the role:


  • You'll design and implement graph-level transformation passes — operator fusion, layout propagation, tiling, dead code elimination, and constant folding
  • You'll get the chance to define and evolve our intermediate representation (IR) as ML model architectures and hardware capabilities advance
  • You'll dig into real performance data to surface optimisation gaps and deliver measurable gains in throughput and latency
  • You'll get the chance to build out testing and validation infrastructure to guarantee correctness across optimisation passes and hardware targets
  • You'll work closely with frontend and code generation teams to keep IR interfaces clean and pipelines well-structured
  • You'll get the chance to prototype and propose new optimisation strategies as the model and hardware landscape evolves


Key Requirements:


  • You'll hold a degree in CS or Computer Engineering (BS, MS, or PhD)
  • You'll have strong hands-on C/C experience in performance-critical environments
  • You'll bring deep knowledge of graph-level compiler optimisation — fusion, tiling, layout transformations, DCE
  • You'll be able to speak to concrete, measurable performance outcomes from your work


It's a big plus if:


  • You have hands-on experience with MLIR, XLA, or comparable graph-level IR frameworks
  • You're familiar with ML framework internals — PyTorch eager/compile mode, JAX/XLA, or TensorRT
  • You've explored polyhedral models or affine analysis for loop and tensor optimisation
  • You understand hardware memory hierarchies and how layout choices drive performance on GPUs and accelerators
  • You've worked with quantisation, sparsity, or other model-level optimisation techniques
  • You've contributed to open-source compiler or ML infrastructure projects

Salary : $200,000 - $250,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Graph Optimization Engineer?

Sign up to receive alerts about other jobs on the Graph Optimization Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$86,732 - $101,718
Income Estimation: 
$106,100 - $124,886
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Oho Group

  • Oho Group Los Angeles, CA
  • This is a high impact leadership role offering the opportunity to build processes, influence strategy, and play a key role in scaling a complex hardware or... more
  • 12 Days Ago

  • Oho Group Los Angeles, CA
  • Head Of Manufacturing We are looking for a Head of Manufacturing to define and execute manufacturing strategy in a fast-moving, product-focused environment... more
  • 12 Days Ago

  • Oho Group Boston, MA
  • The Opportunity Join an advanced technology company developing complex, high-performance systems that integrate hardware and software. As an Optical Engine... more
  • 15 Days Ago

  • Oho Group San Jose, CA
  • About the Opportunity A genuine ground-floor opportunity at a stealth, well-funded AI hardware startup building a custom AI SoC and full inference serving ... more
  • 2 Days Ago


Not the job you're looking for? Here are some other Graph Optimization Engineer jobs in the San Jose, CA area that may be a better fit.

  • Galaxy i Technologies, Inc. Sunnyvale, CA
  • Hello Everyone Looking for strong Graph Database Engineers with hands-on experience in TigerGraph and large-scale data platform engineering. ✅ Required Ski... more
  • 7 Days Ago

  • Greylock Partners Palo Alto, CA
  • Summary: Core focus: Generative AI/LLM's knowledge graph metadata lake Experience: 6 years industry overall experience with 3 in ML Infra or MLE Expertise:... more
  • 4 Days Ago

AI Assistant is available now!

Feel free to start your new journey!