Senior Principal Software Engineer - AI Infrastructure Innovation

Oracle Cloud Infrastructure’s (OCI) architecture development engineering team is seeking a highly driven GPU platform software & system development engineer at the Principal Engineer level. We are at the forefront of AI innovation, exploring the next generation of AI accelerators and hardware solutions.

As a Senior Principal software engineer, part of our growing team, you will be involved in evaluation, prototyping, and optimizing cutting-edge AI hardware, AI accelerators, including custom-designed AI chips and systems and software to drive next-gen Cloud AI Infrastructure platforms. 

You will contribute to platform definition, platform development oversight as well as in house development, design reviews, system integration, performance testing and characterization. You will interact closely with third party GPU IC suppliers & partners as well as internal hardware and software development teams to help drive Oracle’s AI Cloud platform solution space. You will be a critical part of the team developing Oracle’s growing Cloud AI Infra solutions.

You will work with the latest AI hardware architectures, benchmark their performance, and collaborate with software engineers to ensure tight integration with AI workloads. You’ll have a direct impact on shaping the future of AI hardware for machine learning and deep learning applications.

Career Level - IC5

Responsibilities:

Our Senior Principal engineers are also the people who can work independently and provide technical leadership to the broader organization. You should have experience developing AI infrastructure and operating high-scale services, and an understanding of how to make these cloud-scale services resilient. The ideal candidate will be technically strong and productive; someone who knows how to balance speed and quality with iterative and incremental improvements. You understand operational excellence and know-how to infuse a culture of being proactive within your team. You recommend and justify major changes to new and existing products and establish consensus with data-driven approaches.

• Evaluation of system architecture and proposed implementation path analysis. 
• Work directly with hardware design and development teams on architecture, implementation, development, deployment, and troubleshooting of AI hardware platforms. Collaboration is also expected with the wider Oracle engineering and operations functional groups as well as our external partners. 
• Conduct comprehensive benchmarking and performance analysis of AI accelerators from emerging hardware vendors (e.g., SambaNova, Groq).
• Compare and contrast new AI accelerators with industry-standard hardware (e.g., NVIDIA GPUs) for training and inference workloads.
• Develop tools and processes for evaluating the performance of hardware in real-world AI applications.
• Contribute to the design and improvement of performance optimization algorithms for AI models running on the hardware.

Basic Qualifications

• BS or MS degree in Computer Science or relevant technical field involving coding or equivalent practical experience.
• 10 years of total experience in software development
• Demonstrated ability to write great code using Java, GoLang, C#, or similar OO languages.
• Solid knowledge of AI / GPU platform architecture and their capabilities. 
• Experience working on large-scale, highly distributed services infrastructure.
• Solid working experience with GPU supplier test code as well as open-source AI test / characterization tools.
• Experience with the architecture, design, and implementation of modern server platforms consisting of multiple architectures and vendors, including x86 and ARM server architectures.
• Demonstrated experience debugging and root-causing complex issues that may have a mix of hardware and software causes.
• Systematic problem-solving approach, strong communication skills, a sense of ownership, and drive

Preferred Qualifications

• Experience as technical lead on a large-scale cloud service
• Hands-on experience developing and maintaining services on a public cloud platform (e.g., AWS, Azure, Oracle)
• Experience with AI accelerator chips (e.g., SambaNova, Groq, etc.).
• Knowledge of AI accelerator benchmarks and tools for performance evaluation (e.g., MLPerf, DeepBench).
• Understanding of AI model optimization techniques for hardware acceleration.
• strong understanding and experience running firmware and system diagnostics tools using BMC firmware, UEFI/ BIOS and Linux tools. Skilled in scripting to customize tests.

Salary : $96,800 - $251,600