Demo

Head of Engineering

ZRG Careers
Boston, MA Full Time
POSTED ON 4/18/2026
AVAILABLE BEFORE 5/17/2026

For decades, progress in complex computer systems relied solely on human ingenuity. We are changing that paradigm. We are building an AI-based systems engineer that augments human experts to design and optimize the next generation of AI infrastructure.


Our Platform is a multi-agent system that mimics the R&D process of top-tier engineers—reasoning, experimenting, and analyzing experimental data in depth to deliver results 10-100x faster than human experts. We are turning weeks of manual systems engineering into hours of automated, high-performance output. Based on a decade of award-winning research at a top-tier research institution, and backed by significant VC- and angel-backed funding, we are now scaling our engineering organization to meet the demands of the AI era.


About the Role

We are looking for a dynamic, highly technical, hands-on Head of Engineering to lead our small but exceptional team of engineers. This is a “player-coach” role for a leader who still loves to dive into the design, architecture, and code with the team, but is equally passionate about (i) driving accountability, (ii) building a high-performance, truth-seeking, can-do culture, and (iii) delivering tangible business results.


You will manage the development of our platform that optimizes demanding AI workloads. You will report to the co-founder and CEO, and also work closely with our other co-founder, playing a pivotal role in shaping the technical and organizational future.


Responsibilities

  • Lead & scale: Manage and grow a highly productive team of systems and AI engineers, fostering a culture of disciplined rigor without bureaucratic friction.
  • Drive execution: Ensure that research-led designs and experiments are implemented in a robust, production-faithful platform that handles complex processing pipelines and heterogeneous hardware infrastructure.
  • Engineering execution: Own and execute the engineering roadmap, working closely with the Product and Business leadership of the company.
  • Bridge the gap between research and platform: Our work spans the range from research on trustworthy agentic AI to scalable and reliable platform engineering.


Desired Expertise and Experience

  • Systems intuition: You have a deep understanding of the entire stack, from model code and serving frameworks (Triton, vLLM) to hardware-specific runtime configurations.
  • Robust agentic AI systems: You have experience with agentic AI and a strong desire to build these systems using software and systems engineering principles.
  • Leadership depth: Experience managing small, high-performance teams in a fast-paced startup or advanced R&D environment. You know how to drive a team toward milestones while maintaining high software and system quality.
  • Technical excellence:
  • Strong proficiency in Python and AI/ML frameworks (e.g., PyTorch).
  • Experience with one or more of cloud systems for AI workloads, GPU optimization, and performance engineering.
  • Experience with agentic AI systems.
  • Experience with heterogeneous hardware environments and AI/ML pipelines.
  • Mission-driven: You believe AI is the ultimate collaborator for discovering new ideas in AI-driven systems and are excited to contribute to this mission.


Why Join?

  • Strong pedigree: Work alongside a team of renowned experts in AI-driven systems, leading our engineering group.
  • Massive impact: Our technology has demonstrated the ability to achieve significant improvements in long-running engineering research and design tasks spanning performance engineering, model pipeline development, and cost optimization..
  • Robust financials: Our seed round closed recently; we’re backed by top-tier VC firms, as well as recognized industry luminaries. We have also been signing paid PoCs with marquee customers.
  • Solving hard problems: We are solving the fundamental bottlenecks of the AI revolution: performance, complexity, and cost.

Salary.com Estimation for Head of Engineering in Boston, MA
$377,361 to $495,734
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Head of Engineering?

Sign up to receive alerts about other jobs on the Head of Engineering career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$108,245 - $136,486
Income Estimation: 
$136,683 - $171,343
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at ZRG Careers

  • ZRG Careers York, NY
  • Looking for a GTM Recruiter to source and screen candidates . You’ll play a vital role in identifying, attracting, and hiring exceptional GTM/Sales candida... more
  • 11 Days Ago

  • ZRG Careers Ohio, OH
  • We are seeking an experienced Construction Recruiter to support high-volume hiring needs for a 3–6 month remote contract. This role will focus on sourcing,... more
  • 5 Days Ago

  • ZRG Careers Allentown, PA
  • Global Benefits Manager About Fuller Technologies For over a century, Fuller Technologies has invested in the people behind our solutions. We foster a cult... more
  • 5 Days Ago

  • ZRG Careers Allentown, PA
  • Director of Global Payroll, Mobility and Systems People behind the solutions At Fuller Technologies, we know that building a strong team starts with creati... more
  • 5 Days Ago


Not the job you're looking for? Here are some other Head of Engineering jobs in the Boston, MA area that may be a better fit.

  • Liberate Boston, MA
  • Head of Solution Engineering / Solution Engineering Manager (M3–M5) Title: Head of Solution Engineering / Solution Engineering Manager Level: M3–M5 (Manage... more
  • 13 Days Ago

  • Britebound Brand Boston, MA
  • THE ROLE: Head of Engineering – TeenVoice , Inc TeenVoice is a fast-growing, well-funded, for-profit startup in the insights space and a wholly owned subsi... more
  • 22 Days Ago

AI Assistant is available now!

Feel free to start your new journey!