Demo

Junior Technical Program Manager — Infrastructure Operations

togetherai
San Francisco, CA Full Time
POSTED ON 5/22/2026
AVAILABLE BEFORE 7/21/2026

About the Role

Together AI runs one of the most demanding GPU fleets in the industry. Keeping that fleet healthy - every node online, every GPU performing, every datacenter transition running on schedule - is operationally complex and genuinely high-stakes. We're looking for a Junior TPM to own that operational reality.

This is not a coordination or status-reporting role. You will own the end-to-end node lifecycle - from the moment a node goes down through repair, return, and re-integration - and you'll drive the cross-functional work to close every gap as fast as possible. You'll manage datacenter bring-ups, hunt down GPU utilization loss, and build the processes and dashboards that make our fleet operations more visible and accountable over time.

The environment moves fast and doesn't always come with a clear playbook. Much of what you'll work on is genuinely novel - you'll be figuring things out alongside engineers who are building at the frontier. If that sounds like an obstacle, this isn't the right role. If it sounds like the best possible way to learn, keep reading.

Responsibilities

  • Own the end-to-end node lifecycle - from failure through repair, return, and re-integration — across provider ticketing, internal tooling, and the state machine that governs each stage
  • Drive node remediation to resolution with urgency, eliminating gaps in ownership at every handoff
  • Manage project timelines for new datacenter bring-ups, coordinating across internal teams and external providers to keep milestones on track
  • Identify and diagnose GPU utilization loss across the fleet, working with engineering leads to drive resolution
  • Build dashboards and tracking processes that make efficiency gaps visible and ensure they get closed
  • Continuously improve operational workflows through process improvements and lightweight automation
  • Develop and maintain relationships with external datacenter providers

Requirements

  • Some prior experience in a TPM role - we're open to candidates who came into TPM from engineering, ops, or another technical function, but you should have done the work in practice: owning programs end-to-end, driving cross-functional resolution, managing external dependencies
  • A technical background or demonstrated experience in a highly technical environment - you don't need to know GPUs on day one, but you need to be able to engage meaningfully with technical problems and earn credibility with infrastructure engineers
  • A genuine bias toward action - you see a problem and start moving, even when the path forward isn't fully clear
  • Resilience in a fast-paced, sometimes chaotic environment - you adapt quickly, stay effective under pressure, and don't wait for perfect conditions to make progress
  • Strong organizational instincts - you can manage multiple workstreams, track dependencies, and keep things moving without losing the thread
  • Ability to zoom out - you can be deep in the weeds on an operational problem while keeping the bigger picture in view

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $150,000 - $175,000 equity benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. This is a hybrid role based in the Bay Area.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

 

Salary : $150,000 - $175,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Junior Technical Program Manager — Infrastructure Operations?

Sign up to receive alerts about other jobs on the Junior Technical Program Manager — Infrastructure Operations career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$168,545 - $198,692
Income Estimation: 
$182,502 - $249,036
Income Estimation: 
$207,946 - $249,343
Income Estimation: 
$175,165 - $219,883
Income Estimation: 
$182,642 - $260,237
Income Estimation: 
$155,621 - $191,711
Income Estimation: 
$188,022 - $236,092
Income Estimation: 
$205,940 - $255,928
Income Estimation: 
$199,907 - $266,531
Income Estimation: 
$195,700 - $270,403
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at togetherai

  • togetherai San Francisco, CA
  • About the Role Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events... more
  • 2 Days Ago

  • togetherai San Francisco, CA
  • Staff Engineer — API Core Platform About the role Together AI is seeking an experienced Backend Engineer to found Together’s API Platform team within the P... more
  • 3 Days Ago

  • togetherai San Francisco, CA
  • About the Role Together AI is building the best inference infrastructure for voice applications. Our Voice AI platform powers production-grade, real-time v... more
  • 3 Days Ago

  • togetherai San Francisco, CA
  • About the Role Together AI is defining the infrastructure layer for the next generation of voice applications. Our Voice AI platform powers production-grad... more
  • 3 Days Ago


Not the job you're looking for? Here are some other Junior Technical Program Manager — Infrastructure Operations jobs in the San Francisco, CA area that may be a better fit.

  • Together AI San Francisco, CA
  • About The Role Together AI runs one of the most demanding GPU fleets in the industry. Keeping that fleet healthy - every node online, every GPU performing,... more
  • 3 Days Ago

  • Sigma San Francisco, CA
  • Sigma unlocks the value of data by delivering cloud-scale analytics and business intelligence with the simplicity of a spreadsheet, complete with pivot tab... more
  • 25 Days Ago

AI Assistant is available now!

Feel free to start your new journey!