What are the responsibilities and job description for the Staff AI Engineer - LLM, Gen AI, Deep Learning Inference Solutions position at Advanced Micro Devices, Inc?
WHAT YOU DO AT AMD CHANGES EVERYTHING
At AMD, our mission is to build great products that accelerate next-generation computing experiences – from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you'll discover the real differentiator is our culture. We push the limits of innovation to solve the world's most important challenges –striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.
Together, we advance your career.
THE ROLE:
This is a specialized engineering position responsible for Product Engineering program technical planning for next-generation AMD microprocessors. This individual serves as a critical technical point of contact to the business, design, platform validation and product engineering teams. We have competitive benefit packages and an award-winning culture. Join us!
THE PERSON:
You will provide technical supervision or mentoring to junior engineers and influence others as a subject matter expert. A successful candidate is one who can drive technical decisions independently, has accountability for accuracy, reliability and completeness of assignment results critical to the project’s success. This role allows the opportunity to influence technical decisions that have a significant impact on multiple products or the product line.
KEY RESPONSIBILITIES:
- Drive end-to-end productization of AI inferencing solutions across AMD CPU, NPU, and AI PC platforms, with a strong focus on flow design, usability, and performance analysis.
Develop and publish onboarding tutorials, methodologies, and technical collateral for inference software components, including Compiler, Quantizer, Optimizer, Runtime, Profiler, Visualizer, and Debugger.
Partner with software developers to co-own AI software and model optimization efforts, provide early feedback on usability and specifications, and identify potential pain points through holistic product usage analysis.
Engage with internal and external stakeholders to troubleshoot workflows, meet performance or accuracy goals, and create reproducible use cases that drive adoption of AMD inference solutions.
Collaborate with sales and marketing teams to support strategic business engagements and customer success.
PREFERRED EXPERIENCE:
- MSEE with 4–12 years of demonstrated experience in AI/ML software development.
- Strong expertise in Python and C .
- Hands-on experience with AI frameworks such as PyTorch, ONNX, llama.cpp, etc.
- Work experience with one or more popular Deep Learning or Generative AI model architectures such as CNNs, Transformers, LLMs, Stable Diffusion, etc.
- Proficiency in model analysis, optimization, performance benchmarking, and accuracy measurement.
- Experience with quantization and pruning of neural networks is preferred.
- Familiarity with latest Generative AI architectures such as LLM, VLM, VLA, MoE, with exposure to models like Llama, Gemma, Qwen, DeepSeek, Mistral, Phi, etc.
- Experience working on or contributing to open-source AI projects is a plus.
- Experience with modern inference frameworks such as vLLM, SGLang, Dynamo, TensorRT-LLM, etc. is preferred.
- Familiarity with any AI accelerator SDK such as NVIDIA TensorRT, Intel OpenVINO, Qualcomm Neural Processing SDK, AWS Inferentia, etc. will set you apart from other candidates.
- Strong documentation and presentation skills for clear and concise communication.
ACADEMIC CREDENTIALS:
- Master’s in computer engineering or computer science or electrical engineering, or comparable disciplines
LOCATION:
- San Jose, CA
- Longmont, CO
#LI-TC1
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
