Demo

Lead AI/ML Engineer

Vanguard and Careers
Charlotte, NC Full Time
POSTED ON 1/5/2026
AVAILABLE BEFORE 3/4/2026
We are looking for a highly skilled Machine Learning Engineer with strong experience in Generative AI and Retrieval‑Augmented Generation (RAG). The ideal candidate has hands‑on expertise building production‑grade GenAI systems, including vector search, document processing, embedding pipelines, and evaluation frameworks. Experience with Graph RAG approaches is highly preferred. Java experience is a strong plus. You will work across data engineering, ML engineering, and platform teams to design scalable, secure, and high‑quality AI capabilities that power critical business use cases.

Responsibilities

  • Architect, build, and deploy RAG pipelines, including chunking, embeddings, vector stores, retrieval, ranking, grounding, and evaluation.

  • Design and implement Graph RAG solutions leveraging knowledge graphs for multi‑hop reasoning and structured retrieval.

  • Build robust, scalable ML/LLM services using Python (and Java where applicable) with well‑designed APIs and microservices.

  • Develop data processing pipelines for ingestion, transformation, metadata extraction, and indexing.

  • Implement observability, monitoring, evaluation harnesses, automated testing, and CI/CD for GenAI services.

  • Optimize retrieval quality, response accuracy, latency, and cost across model retrieval layers.

  • Apply responsible AI, security, and governance practices for LLM systems (e.g., content filtering, guardrails, model monitoring).

  • Collaborate with product, data engineering, and cloud platform teams to translate business problems into robust AI solutions.

  • Produce clear documentation, design specs, and operational runbooks for all delivered components.

Required Qualifications

  • 3 years of experience as an ML Engineer, AI Engineer, or similar role.

  • Hands‑on experience building GenAI applications and RAG systems end‑to‑end.

  • Strong proficiency in Python for ML/LLM development.

  • Experience with vector databases (e.g., pgvector, Pinecone, Weaviate, FAISS) and embedding models.

  • Knowledge of LLM frameworks (LangChain, LlamaIndex, Transformers, etc.).

  • Strong understanding of cloud environments (AWS/Azure) and containerized deployments.

  • Solid software engineering foundations — APIs, microservices, version control, testing, CI/CD.

  • Experience with data pipelines, ETL/ELT, and processing unstructured data.

  • Ability to evaluate retrieval quality, implement ranking strategies, and build evaluation datasets.

  • Excellent communication skills and ability to work in cross‑functional teams.

Preferred Qualifications

  • Graph RAG experience using knowledge graphs, graph databases, or graph‑based retrieval.

  • Experience with Java for backend services, data processing, or connector development.

  • Familiarity with MLOps/LLMOps tooling and practices.

  • Experience integrating AI outputs into metadata/catalog systems or workflows.

  • Experience with prompt engineering, guardrailing, and LLM safety controls.

What We’re Looking For

A builder who loves engineering elegant, reliable systems that scale — someone who understands both machine learning and strong software engineering practices, is passionate about GenAI, and is excited to push the boundaries of RAG and Graph RAG capabilities.

Special Factors

Sponsorship

Vanguard is not offering visa sponsorship for this position.

About Vanguard

At Vanguard, we don't just have a mission—we're on a mission.

To work for the long-term financial wellbeing of our clients. To lead through product and services that transform our clients' lives. To learn and develop our skills as individuals and as a team. From Malvern to Melbourne, our mission drives us forward and inspires us to be our best.

How We Work

Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.

Salary.com Estimation for Lead AI/ML Engineer in Charlotte, NC
$96,205 to $115,922
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Lead AI/ML Engineer?

Sign up to receive alerts about other jobs on the Lead AI/ML Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Vanguard and Careers

  • Vanguard and Careers Washington, DC
  • Vanguard’s Global Public Policy (GPP) function is responsible for managing Vanguard’s policymaker relationships and driving our investor-focused policy age... more
  • 8 Days Ago

  • Vanguard and Careers Salt Lake, UT
  • Are you ready to help us redefine what exceptional client service looks like? Join our team of “crew” as a Client Service Excellence Center associate! Abou... more
  • 8 Days Ago

  • Vanguard and Careers Salt Lake, UT
  • Have your FINRA Series 7 and 63 and a passion for serving others? Join our team of “crew” as a Client Service Excellence Center associate! About this Job: ... more
  • 8 Days Ago

  • Vanguard and Careers Scottsdale, AZ
  • About this job: At Vanguard, we have a client-first mentality that we live and breathe every day through our mission, “to take a stand for all investors, t... more
  • 8 Days Ago


Not the job you're looking for? Here are some other Lead AI/ML Engineer jobs in the Charlotte, NC area that may be a better fit.

  • ExecutivePlacements.com Charlotte, NC
  • We are looking for a highly skilled Machine Learning Engineer with strong experience in Generative AI and Retrieval-Augmented Generation (RAG). The ideal c... more
  • 13 Days Ago

  • ExecutivePlacements.com Charlotte, NC
  • Job Position: AI/ML Engineer (L1) Experience: 0-2 Years Location: All Locations Department: AI/ML Engineer Domain: AI/ML Job Description Roles and Responsi... more
  • 23 Days Ago

AI Assistant is available now!

Feel free to start your new journey!