Senior Engineering Program Manager – ML Compute Infrastructure

Verified Job On Employer Career Site

Job Summary:

Apple is where individual imaginations gather together, committing to the values that lead to great work. The AIML team at Apple is building groundbreaking technology and is seeking a senior engineering program manager for its ML Training platform, which provides services to internal Apple developers for machine learning lifecycle management. This role involves overseeing capacity expansions, compute buildouts, and accelerator hardware strategy, while collaborating with various teams to ensure optimal performance and scalability of the infrastructure.

Responsibilities:

• As a key EPM of the AI/ML team, you will be responsible for establishing cross-functional partnerships with ML partner understanding their use cases and improve the ease of use of the compute services.

• You will collaborate with the Apple’s AIML engineering teams to define a partnership strategy across the ML ecosystem including 3rd party public cloud, Apple’s internal cloud, silicon vendors, and OSS providers

• You will lead technical evaluations of emerging accelerator technologies (GPUs, TPUs, and custom silicon), balancing power, performance, cost, and compatibility to ensure infrastructure decisions are forward-looking and cost-efficient

• Own cross-functional execution of capacity integration efforts — aligning hardware procurement, rack deployment, networking, and software readiness to ensure seamless delivery at scale

• Translate ML platform and model training requirements into concrete infrastructure programs, ensuring technical risks are anticipated and mitigated early.

Qualifications:

Required:

• 6 years of meaningful work experience as an Engineering Program Manager

• Demonstrated ability to define vision and lead cross-functional execution in highly technical domains

• Experience leading vendor engagements and partnerships across cloud, silicon, and hardware infrastructure providers

• Strong understanding of large-scale compute architecture and capacity planning for ML workloads

• Familiarity with AI/ML frameworks (e.g., TensorFlow, PyTorch), infrastructure orchestration, and high-performance computing environments

• MS/PhD in EE, CS, Systems Engineering, or equivalent work experience

Preferred:

• Hands-on experience with accelerator benchmarking, evaluation frameworks, or infrastructure cost modeling

• Experience managing data center expansion programs or deploying high-density compute for ML

• Strong competence in price/performance parity analysis for hardware procurement decisions

• Advanced technical degree and/or deep infrastructure consulting background

• Prior experience scaling ML infrastructure in hybrid or on-prem environments

Company:

Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software. Founded in 1976, the company is headquartered in Cupertino, California, USA, with a team of 10001 employees. The company is currently Public Company. Apple has a track record of offering H1B sponsorships.