Demo

Product Manager, AI Infrastructure

Arm
Austin, TX Full Time
POSTED ON 4/24/2026
AVAILABLE BEFORE 5/23/2026
Product Management, Datacenter AI / ML

The future isn’t just about technology - it’s about people and the limitless possibilities AI can unlock for us all. As AI transforms how we live, work, and connect, Arm is at its very foundation, powering the innovations that are shaping our world.

Arm’s Cloud AI team is building next-generation platforms to power the AI workloads of tomorrow and we’re growing our product management organization to help guide this journey. This is an opportunity to help shape the product direction of a major strategic investment while also helping build a new team and culture.

As a member of the team, you’ll own the integration of hardware, software, and services into a production AI compute platform that supports critical customer workloads. You’ll be responsible for defining the end-to-end product, identifying mismatches across system components, and driving decisions required to deliver a production system. We’re looking for deeply technical, independent product leaders who thrive in ambiguity and can move seamlessly between product definition, system-level problem solving, technical analysis, and partner & customer engagement.

Responsibilities

  • Define the AI compute product, including supported workloads, system capabilities, and constraints
  • Own system integration for AI compute platforms, ensuring hardware, software, and services combine into a production-ready system
  • Identify and resolve gaps across hardware, software, and deployment plans (e.g.: performance, system behavior, capacity)
  • Drive multi-functional decisions when system components or timelines don’t align
  • Translate customer, system, and technical constraints into clear product tradeoffs and priorities for engineering teams

Required Skills and Experience:

  • Proven experience delivering complex, multi-component compute systems (including hardware & software)
  • Strong systems thinking - ability to reason across layer boundaries and understand end-to-end system behavior
  • Proven ability to drive ambiguous, multi-functional problems to resolution, including making product tradeoffs across competing constraints
  • Solid understanding of datacenter AI infrastructure (compute, memory, networking, software & services)
  • 6 years of experience in product management, systems or solution engineering, or related product leadership role
  • Bachelor's degree or equivalent experience in Electrical or Computer Engineering

“Nice-to-Have” Skills and Experience:

  • Experience with data center compute deployment at scale, including service readiness, fleet rollout, or capacity planning for AI compute
  • Experience working with ML accelerators
  • Hands-on experience building or running GenAI workloads at scale
  • Experience with real-world hardware-software codesign (e.g., accelerators, distributed systems, or large-scale cloud services)
  • Masters or PhD degree in Electrical or Computer Engineering

In Return:

Help shape products that will define the future of AI compute and define what world-class product management looks like in AI infrastructure. You’ll grow as a leader and technical voice - and help ensure Arm delivers the products our customers need today and the platforms that will power tomorrow.

Accommodations at Arm

At Arm, we want our people to Do Great Things. If you need support or an accommodation to Be Your Brilliant Self during the recruitment process, please email accommodations@arm.com. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Hybrid Working at Arm

Arm’s hybrid approach to working is centered around flexibility, where we split our time between the office and other locations to get our work done. Within that framework, we empower groups and teams to determine their own particular hybrid working pattern, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Salary Range: $249,900-$338,100 per year

We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Accommodations at Arm

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email accommodations@arm.com . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working at Arm

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Salary : $249,900 - $338,100

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Product Manager, AI Infrastructure?

Sign up to receive alerts about other jobs on the Product Manager, AI Infrastructure career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$147,514 - $184,796
Income Estimation: 
$182,852 - $230,675
Income Estimation: 
$147,514 - $184,796
Income Estimation: 
$182,852 - $230,675
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Arm

  • Arm San Jose, CA
  • Job ID 2026-17106 Date posted 08/04/2026 Location San Jose, California Category Segment Marketing Director of Segment Marketing Cloud infrastructure is und... more
  • 15 Days Ago

  • Arm San Jose, CA
  • Job ID 2026-16563 Date posted 12/03/2026 Location San Jose, California Category Sales About At Arm, we are shaping the future of compute for cloud and AI i... more
  • 15 Days Ago

  • Arm Austin, TX
  • Job ID 2026-16865 Date posted 03/03/2026 Location Austin, Texas Category IT The Regional Service Delivery Specialist combines critical issue management, ma... more
  • Just Posted

  • Arm San Jose, CA
  • Job ID 2026-17187 Date posted 22/04/2026 Location San Jose, California Category Finance & Accounting We are seeking an outstanding Senior Director of Finan... more
  • Just Posted


Not the job you're looking for? Here are some other Product Manager, AI Infrastructure jobs in the Austin, TX area that may be a better fit.

  • NODA AI Austin, TX
  • Product Manager – NODA AI Location: Austin, TX (Hybrid on-site, with up to 20% travel) Clearance Requirement: U.S. Citizen with the ability to obtain a sec... more
  • 14 Days Ago

  • Sprinklr Austin, TX
  • Sprinklr is the definitive, AI-native platform for Unified Customer Experience Management (Unified-CXM), empowering brands to deliver extraordinary experie... more
  • 17 Days Ago

AI Assistant is available now!

Feel free to start your new journey!