Sr. Staff Software Engineer - GPU Network Software, RCCL

WHAT YOU DO AT AMD CHANGES EVERYTHING

We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world’s most important challenges. We strive for execution excellence while being direct, humble, collaborative, and inclusive of diverse perspectives. 

AMD together we advance_

THE ROLE: 

Do you want to develop multi node GPU communication libraries to enable high performance computing and machine learning workloads at Exascale?  AMD is searching for talented and motivated engineers to develop Communication libraries as part of the AMD Radeon Open Ecosystem (ROCm). 

THE PERSON: 

You are accustomed to working in a dynamic, geographically distributed agile team, where partnership and collaboration are paramount.  You possess excellent written and verbal communication skills, strong attention to detail, and the ability to express your work in a clear, cohesive fashion.  You are results-oriented and accustomed to tight deadlines and changing priorities.  Most importantly, you are constantly thinking of ways to improve performance of software and hardware. 

KEY RESPONSIBILITIES: 

• Support AMD’s RCCL, an open source, GPU-accelerated communication collective middleware and related technologies 
• Design, implement, and test networking features for multi-GPU and multi-node communication libraries. 
• Benchmark, profile and optimize code to maximize throughput on single-GPU, multi-GPU and clustered systems 
• Deliver high-quality code and documentation following best practices for open source software development 
• Work with key technical experts across AMD and with our partners and customers to improve ROCm applications, libraries, and tools 
• Deploy the libraries on large clusters and debug complex system level issues that could span across different layers of the software stack: gpu kernel drivers, nic driver etc. 

PREFERRED EXPERIENCE: 

• Strong background developing applications and libraries in C, C , and Python 
• Experience working with RoCE(RDMA over Converge Ethernet), Libfabric and InfiniBand  
• Experience working with Linux Kerner, Device drivers and network drivers. 
• Experience designing and building GPU Networks for Large Scale Clusters 
• Experience in collective communication libraries: MPI, RCCL, SHMEM and optimization to scale collective communication to scale distributed systems.  
• In-depth knowledge of best-practices in software development, including testing, profiling, debugging, documentation, version control, issue tracking, and planning 
• Contributions to open-source libraries and applications 

NICE TO HAVE: 

• GPU software development using HIP, CUDA, or OpenCL 
• Understanding of CPU and GPU architectures and low-level optimization techniques including assembly programming and/or vectorization 

ACADEMIC CREDENTIALS: 

• B.Sc. or B.Eng. degree in Computer Science, Software Engineering, Electrical Engineering,  or equivalent 
• Advanced degrees, such as M.Sc., M.Eng., Ph.D. are preferred. 

LOCATION: Santa Clara, California 

#LI-JT1 

#LI-HYBRID

Benefits offered are described:  AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.