Demo

AI Infrastructure Director

VinSmart Future
Mountain View, CA Full Time
POSTED ON 5/7/2026
AVAILABLE BEFORE 6/4/2026

Work Location: Hanoi: TechnoPark Tower, Vinhomes Ocean Park, Hanoi, Vietnam

Job overview:

We are investing in hyperscale AI infrastructure, with a long-term vision to develop multi-GW AI data center capacity and large-scale GPU compute clusters, enabling frontier model training and AI deployment at national scale.

We are looking for a Director of AI Infrastructure to architect, build, and scale our end-to-end AI infrastructure stack - from data center design to distributed training and inference systems.

This is a founding leadership role with full ownership of architecture, technology decisions, and ecosystem partnerships to build one of the largest AI infrastructure platforms in Southeast Asia.


What you will own:

1. End-to-End AI Infrastructure Architecture

Define and design the full stack of AI infrastructure:

→ Hyperscale data centers (multi-MW → GW-scale roadmap)

→ GPU clusters (hundreds → thousands GPUs, scaling toward 10,000 )

→ High-performance networking and distributed storage

Architect systems for frontier-scale model training and large-scale inference

2. Hyperscale Compute & Distributed Systems

  • Build and operate large-scale GPU clusters (Phase 1: 500–1000 GPUs, scaling beyond)
  • Design distributed systems for training, scheduling, and orchestration
  • Optimize throughput, latency, utilization, and cost efficiency

3. AI Platform & Inference Systems

  • Lead development of training and inference platforms
  • Design systems for serving AI models at scale (millions of users / requests)
  • Optimize model deployment, performance, and reliability

4. Data Center Strategy & Execution

  • Lead design and scaling of AI-ready data centers (tens of MW → multi-GW roadmap)
  • Drive decisions on power density, cooling (liquid/air), and rack design
  • Own vendor ecosystem across NVIDIA, OEMs, networking, and infrastructure partners

5. Build the Team & Ecosystem

  • Build and lead a world-class AI infrastructure organization
  • Define engineering culture, hiring standards, and execution model
  • Establish partnerships with global leaders in AI, cloud, and hardware ecosystems


What we are looking for:

We are open to candidates from different backgrounds, as long as you have built systems at scale in at least one of the following:

Option A - Distributed AI / Compute

  • Built or operated large-scale distributed training systems
  • Deep expertise in GPU clusters, HPC, or AI compute infrastructure

Option B - AI Platform / Inference

  • Built AI platforms or large-scale inference systems
  • Strong understanding of LLMs, training pipelines, and model optimization

Option C - Data Center / Hardware Infrastructure

  • Designed or operated hyperscale data centers (MW-scale or beyond)
  • Strong expertise in power, cooling, and high-density compute systems.

You might be a fit if you have:

  • Experience working with hundreds → thousands → tens of thousands of GPUs
  • Built systems for frontier AI / hyperscale cloud / HPC environments
  • Strong hands-on technical depth combined with leadership and builder mindset

Why this role is unique

  • Greenfield build - no legacy constraints
  • Real scale commitment - multi-MW to 3–4GW AI infrastructure roadmap
  • Full ownership - architecture, vendor selection, and execution
  • Opportunity to shape national-scale AI capabilities

Compensation & Benefits

  • Flexible executive compensation (structured based on candidate profile)
  • Relocation & long-term incentives
  • Access to Vingroup ecosystem (housing, healthcare, education…)


📩 Apply via:

Email: v.hanhtt41@vinsmartfuture.tech

For more information, please direct message me.

Salary.com Estimation for AI Infrastructure Director in Mountain View, CA
$169,635 to $209,627
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Infrastructure Director?

Sign up to receive alerts about other jobs on the AI Infrastructure Director career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$89,966 - $112,616
Income Estimation: 
$118,163 - $145,996
Income Estimation: 
$120,777 - $151,022
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$86,891 - $130,303
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other AI Infrastructure Director jobs in the Mountain View, CA area that may be a better fit.

  • Abaka AI Palo Alto, CA
  • About Abaka AI Abaka AI is built on one mission: to be the world’s most trusted data partner for AI companies. More than 1,000 industry leaders across Gene... more
  • 2 Months Ago

  • NVIDIA AI Santa Clara, CA
  • Job Requisition ID JR2007409 Job Category Sales Time Type Full time NVIDIA is looking for an experienced GPU and network systems Solutions Architect & Engi... more
  • 4 Days Ago

AI Assistant is available now!

Feel free to start your new journey!