Demo

Gen AI Architect

Cloud BC Labs
Charlotte, NC Full Time
POSTED ON 9/12/2026
AVAILABLE BEFORE 10/12/2026
Position : Gen AI Architect

Location : Charlotte, NC (Hybrid)

Term : C2C/W2 Role

Job Summary:

We are seeking an experienced Generative AI Architect to design, architect, and implement scalable, secure, and enterprise-grade GenAI solutions. The ideal candidate will have strong expertise in Generative AI, LLMs, AWS/Azure/GCP cloud platforms, RAG, AI/ML architecture, prompt engineering, vector databases, and AI agent frameworks.

The candidate will work closely with business stakeholders, data scientists, ML engineers, software engineers, and cloud teams to translate business requirements into production-ready GenAI solutions.

Key Responsibilities
  • Design and define end-to-end Generative AI architecture for enterprise applications.
  • Architect solutions using LLMs, RAG, AI Agents, prompt engineering, embeddings, vector databases, and foundation models.
  • Evaluate and select appropriate LLMs/foundation models based on performance, cost, security, latency, and business requirements.
  • Design scalable RAG pipelines including document ingestion, chunking, embeddings, retrieval, reranking, and response generation.
  • Develop and implement AI Agent / Agentic AI architectures using tools, APIs, workflows, memory, and orchestration.
  • Integrate GenAI solutions with enterprise applications, APIs, databases, data platforms, and cloud services.
  • Design solutions using cloud AI services such as AWS Bedrock, Amazon SageMaker, Azure OpenAI, Azure AI, or Google Vertex AI.
  • Define architecture for model serving, inference, monitoring, evaluation, observability, and lifecycle management.
  • Establish best practices for Responsible AI, security, privacy, governance, and compliance.
  • Design mechanisms to mitigate hallucinations, prompt injection, data leakage, and unauthorized model access.
  • Collaborate with data engineering teams to leverage structured and unstructured enterprise data.
  • Lead technical discussions, architecture reviews, proof-of-concepts, and technology evaluations.
  • Provide technical guidance and mentorship to AI/ML engineers and development teams.
  • Optimize GenAI applications for performance, scalability, reliability, latency, and cost.
  • Create architecture diagrams, technical design documents, standards, and implementation guidelines.

Note: Kindly interested candidates pls share the resume to Pooja.yadav@cbcinc.ai

Salary.com Estimation for Gen AI Architect in Charlotte, NC
$91,377 to $115,068
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Gen AI Architect?

Sign up to receive alerts about other jobs on the Gen AI Architect career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$89,966 - $112,616
Income Estimation: 
$118,163 - $145,996
Income Estimation: 
$120,777 - $151,022
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$86,891 - $130,303
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other Gen AI Architect jobs in the Charlotte, NC area that may be a better fit.

  • Synechron Charlotte, NC
  • We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovati... more
  • 17 Days Ago

  • Synechron Charlotte, NC
  • We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovati... more
  • 2 Days Ago

AI Assistant is available now!

Feel free to start your new journey!