At Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a diverse team of fellow creators and inventors. We act with the speed and attitude of a start-up, with the scale and customer-focus of the leading enterprise software company in the world.

Oracle Generative AI Services is an exciting team in Oracle Cloud Infrastructure. We are delivering innovative services at the intersection of artificial intelligence and cloud infrastructure. In Generative AI Services team, you will build and operate massive-scale cloud services leveraging state of art machine learning technologies. We are committed to providing the best in cloud products to meet the needs of our customers who are tackling some of the world’s most challenging problems.

We’re looking for a Director of Machine Learning Engineering with expertise and passion in building teams, coaching individuals, and solving difficult problems in LLM (Large Language Model) training and serving infrastructure.

As a Director of Machine Learning Engineering, you will build and lead Machine Learning Engineering teams to define, design, develop service and infrastructure with cutting edge technology. You would be responsible to provide leadership, direction, and strategy to the team, establish and develop the team to meet and execute the strategy, working with geographically distributed teams, and contributing to the success of your team and other related teams. We expect you to deliver large-scale projects on time with high quality.

Required Qualifications 

• MS or BS in Computer Science, or equivalent experience
• 5 years of experience managing Machine Learning Engineering teams.
• 12 years of software engineering experience
• Strong communication skills, analytical skills, and project management skills
• Experience in AI model performance optimization and pushing model to production.
• Experience in AI model training infrastructure.
• Strong knowledge of data structures, algorithms, operating systems, networking and distributed systems fundamentals 

 Preferred Qualifications

• Production experience with cloud computing.
• Experience with Large Language Model (LLM) serving technologies like DeepSpeed, FasterTransformer, vLLM etc.
• Experience with popular model training and serving frameworks like KServe, KubeFlow, Triton etc.
• Experience with LLM fine-tuning, especially the latest parameter efficient fine-tuning technologies and multi-task serving technologies
• Experience with deep learning frameworks (such as PyTorch, JAX, or TensorFlow) and deep learning architectures (especially Transformers).
• Experience in diagnosing, fixing and resolving issues in AI model training and serving