Demo

Machine Learning Engineer Lead

Compunnel Inc.
Raleigh, NC Contractor
POSTED ON 8/28/2026
AVAILABLE BEFORE 9/27/2026
Job Summary The Machine Learning Engineer Lead will define and lead the architecture of scalable AI/ML and agentic systems across the global product portfolio. This senior technical leadership role will focus on large-scale distributed ML systems, LLM and RAG architectures, Agentic AI frameworks, tool orchestration, and enterprise platform engineering. The role will shape long-term AI platform strategy, establish technical standards, and mentor engineering teams while supporting highly available, secure, and scalable AI systems. Key Responsibilities Define reference architectures for LLM, machine learning, and agent-based systems across products. Design high-availability and low-latency inference platforms capable of operating at global scale. Establish reusable platform components for model lifecycle management, deployment, monitoring, and operationalization. Architect scalable AI platforms supporting large-scale distributed ML systems and enterprise AI workloads. Architect multi-step, reasoning-driven agentic AI systems. Design orchestration patterns for tool use, API invocation, and structured function calling. Lead the implementation and governance of Model Context Protocol (MCP) servers to standardize tool integration and context management. Define guardrails, permissions, security controls, and audit mechanisms for enterprise-safe AI systems. Establish and maintain best practices for MLOps, CI/CD, observability, scalability, and system reliability. Design and implement scalable inference systems using containerization and Kubernetes. Drive the deployment and optimization of LLM, Generative AI, and RAG solutions in production environments. Design cloud-based AI/ML architectures across AWS, Azure, or Google Cloud Platform. Establish technical standards and architectural patterns for AI/ML and agentic systems across engineering teams. Embed Responsible AI principles into platform architecture and engineering practices. Provide technical leadership, mentorship, and guidance to senior engineers and engineering teams. Collaborate with cross-functional teams to influence technical direction and ensure alignment with enterprise AI platform strategy. Support people management, leadership, and team development activities as required. Required Qualifications 10 years of experience building and deploying production-grade machine learning systems at scale. Strong experience with LLMs, Generative AI, and RAG deployments in production environments. Strong Python development background. Expertise designing and implementing AI/ML systems in cloud environments such as AWS, Azure, or Google Cloud Platform. Hands-on experience with Kubernetes, containerization, and scalable inference systems. Experience designing agentic AI systems and tool orchestration frameworks. Experience implementing and governing MCP servers or structured architectures for tool integration and context management. Experience with large-scale distributed ML systems and enterprise platform engineering. Experience establishing MLOps, CI/CD, observability, and system reliability practices. Demonstrated people management, technical leadership, or mentorship experience. Strong understanding of high-availability and low-latency AI/ML architectures. Ability to define technical standards and influence architecture and engineering decisions across teams. Education: Bachelors Degree

Hourly Wage Estimation for Machine Learning Engineer Lead in Raleigh, NC
$89.00 to $108.00
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Machine Learning Engineer Lead?

Sign up to receive alerts about other jobs on the Machine Learning Engineer Lead career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$179,606 - $233,815
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$179,606 - $233,815
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Compunnel Inc.

  • Compunnel Inc. Indianapolis, IN
  • Job Summary We are seeking a Senior ServiceNow Full Stack Developer with strong hands-on experience in both ServiceNow development and React application de... more
  • Just Posted

  • Compunnel Inc. Wilmington, NC
  • Job Summary The Digital Enablement Analyst supports a technical organization with digital tools, data quality, reporting, process improvement, and the prac... more
  • Just Posted

  • Compunnel Inc. Raleigh, NC
  • Job Summary We are seeking an experienced Database Engineer with 8 years of database engineering experience to work at the intersection of database enginee... more
  • Just Posted

  • Compunnel Inc. Austin, TX
  • Job Summary We are seeking a Mid-Level Front End Developer to contribute to Schwabs in-house Creative Center (C2) and help deliver high-quality digital exp... more
  • Just Posted


Not the job you're looking for? Here are some other Machine Learning Engineer Lead jobs in the Raleigh, NC area that may be a better fit.

  • RELX Raleigh, NC
  • About Our Team LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,800 employees worldwide, is part of RELX (www.rel... more
  • 6 Days Ago

  • hackajob Raleigh, NC
  • hackajob is collaborating with LexisNexis to connect them with exceptional professionals for this role. About Our Team LexisNexis Legal & Professional, whi... more
  • 1 Month Ago

AI Assistant is available now!

Feel free to start your new journey!