Demo

Software Engineer - C++ / GPU Virtualization / Cloud Infrastructure

USA Tech Recruit
San Francisco, CA Full Time
POSTED ON 4/7/2026
AVAILABLE BEFORE 5/7/2026

Software Engineer - C / GPU Virtualization / Cloud Infrastructure


We are partnered with a high-growth infrastructure startup that is rethinking how the world accesses GPU compute making breakthrough strides in the GPU virtualization stack. The team are looking for an experienced Software Engineer to work on some of the hardest problems surrounding GPU clusters.


This is a permanent onsite position in San Francisco.


Key Responsibilities

  • Own the performance optimization of the core C virtualization library, squeezing every microsecond out of the stack.
  • Drive R&D into complex problems like GPU oversubscription, checkpointing, and distributed cluster orchestration.
  • Implement support for next-generation GPU architectures, requiring a deep understanding of the entire system from driver to user-space.
  • Tackle high-stakes systems-level debugging and root-cause analysis in live production environments.
  • Identify and resolve performance bottlenecks specifically within large-scale Machine Learning and LLM training workloads.


Key Requirements:

  • Exceptional skills in modern C (Systems level) with a focus on memory management, concurrency, and low-latency execution.
  • A strong grasp of GPU computing (CUDA/ROCm), drivers, or virtualization technologies.
  • Comfortable working close to the metal, including knowledge of PCIe, NVLink, or InfiniBand.
  • A background working in Trading Companies/Hedge Funds/HFT is highly advantageous (either in industry or academic internships.


Keywords: Systems Engineer / C / GPU Virtualization / CUDA / Performance Optimization / Low-Level Programming / Distributed Systems / Cloud Infrastructure / Kernel / Drivers / ML Infrastructure / High-Performance Computing (HPC)


If you are interested in this Software Engineer position, please send a copy of your CV to ts@eu-recruit.com


By applying to this role you understand that we may collect your personal data and store and process it on our systems. For more information please see our Privacy Notice https://eu-recruit.com/wp-content/uploads/2024/07/European-Tech-Recruit-Privacy-Notice-2024.pdf

Salary.com Estimation for Software Engineer - C++ / GPU Virtualization / Cloud Infrastructure in San Francisco, CA
$117,172 to $146,825
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at USA Tech Recruit

  • USA Tech Recruit Los Angeles, CA
  • Full Stack Software Engineer - High Growth Start Up / AI Tools We are partnered with a fast-growing construction technology company building mission-critic... more
  • 6 Days Ago


Not the job you're looking for? Here are some other Software Engineer - C++ / GPU Virtualization / Cloud Infrastructure jobs in the San Francisco, CA area that may be a better fit.

  • OpenAI San Francisco, CA
  • About The Team The Fleet team at OpenAI supports the computing environment that powers our cutting-edge research and product development. We oversee large-... more
  • 10 Days Ago

  • Cohere San Francisco, CA
  • Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are bui... more
  • 7 Days Ago

AI Assistant is available now!

Feel free to start your new journey!