Demo

Member of Technical Staff, Kernels

Magic
San Francisco, CA Full Time
POSTED ON 5/3/2026
AVAILABLE BEFORE 8/18/2026
Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.

About The Role

As a Kernel Engineer, you will design, implement, and maintain high-performance kernels to optimize throughput and latency during training and inference.

Magic's long-context windows create distinct kernel optimization challenges around memory utilization, data movement, and sustained throughput.

What you'll work on

  • Design and implement kernels that support high-performance long-context behavior
  • Ownership of kernel design, implementation, deployment, and production reliability
  • Focus on robustness, extensive testing, and functional correctness, while pushing on performance
  • Evaluate porting Magic’s compute kernels to alternative hardware options
  • Co-design kernels with understanding and interaction with training, inference, and RL teams
  • For a sample of our work, see Magic-Attention, presented at GTC 2026

What we’re looking for

  • Low-level programming experience targeting AI accelerators such as NVIDIA Blackwell or Google TPUs
  • Develop and optimize GPU kernels in frameworks such as NCCL, MSCCLPP, CUTLASS, CuTeDSL, Triton, Quack, Flash-Attention, and similar frameworks
  • Experience in other kernel authoring frameworks such as Pallas/Mosaic (GPU or TPU), or Mojo also maps well to the work on Magic's kernel team
  • Strong depth over shallow breadth: for kernel engineering, we prefer candidates with deep expertise in computer architecture, low-level machine optimizations, and code generation, with breadth across ML
  • Agility, ownership mindset, and grit

Compensation, Benefits And Perks (US)

  • Annual salary ranges between $225K - $550K based on experience
  • Equity is a significant part of total compensation, in addition to salary
  • 401(k) plan with 6% salary matching
  • Generous health, dental and vision insurance for you and your dependents
  • Unlimited paid time off
  • Visa sponsorship and relocation stipend to bring you to SF, if possible
  • A small, fast-paced, highly focused team

Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.

Our culture

  • Integrity. Words and actions should be aligned
  • Hands-on. At Magic, everyone is building
  • Teamwork. We move as one team, not N individuals
  • Focus. Safely deploy AGI. Everything else is noise
  • Quality. Magic should feel like magic

Compensation Range: $225K - $550K

Salary : $225,000 - $550,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other Member of Technical Staff, Kernels jobs in the San Francisco, CA area that may be a better fit.

  • Gimlet Labs, Inc. San Francisco, CA
  • About Us Gimlet Labs is building the first heterogeneous neocloud for AI workloads. As AI systems scale, the industry is hitting fundamental limits in powe... more
  • 14 Days Ago

  • Vapi San Francisco, CA
  • Vapi (/ˈVɑːpi/) We’re creating the shift to voice as humanity’s default interface We’re the most configurable platform for deploying voice agents We’ve gro... more
  • 17 Days Ago

AI Assistant is available now!

Feel free to start your new journey!