What are the responsibilities and job description for the Runtime Engineer position at Oho Group?
Runtime Engineer — AI Compiler Infrastructure | Well-Funded AI Systems Startup
About the Role
As a Runtime Engineer, you'll sit at the heart of that stack: taking the output of our optimizing compiler and making it execute efficiently and correctly across diverse hardware targets. This is a low-level systems role with broad scope — parallelization, kernel scheduling, performance analysis, and close collaboration with compiler and product teams.
Key Responsibilities
- Design, build, and maintain our multi-target runtime system
- Apply parallelization and partitioning techniques to automate kernel generation and exploit optimized execution paths
- Benchmark and analyze compiler outputs on target hardware
- Build tooling to identify and diagnose performance bottlenecks
- Prototype and data-drive exploration of new runtime approaches
- Work with the product team to translate ML engineer needs into runtime improvements
Key Requirements
- Degree in Computer Science or Computer Engineering
- Experience with compiler or runtime systems
- Strong C/C (C 14 or newer)
- Deep understanding of asynchronous and concurrent programming
- Understanding of hardware architecture: memory hierarchies, vector/scalar instructions
- Familiarity with OS kernel or hypervisor internals
Bonus: GPU programming (CUDA/ROCm), deep learning frameworks (PyTorch, JAX, Triton), HPC or large compute cluster experience
Salary : $200,000 - $250,000