Demo

AI Architect – Generative AI & Enterprise Solutions

EXL
Jersey, NJ Full Time
POSTED ON 9/10/2026
AVAILABLE BEFORE 10/9/2026

We are seeking an AI Architect to help build the technical vision and architecture for generative AI across the Global Technology Commercial Cloud practice. Sitting within the Global Technology organization that runs our AWS cloud environments for commercial solutions, automation platform (GitHub, Jenkins, Artifactory, SonarQube), and cloud operations, you will define how we design, deploy, and operate GenAI solutions at scale – safely, reliably, and cost-effectively.


Responsibilities:


This is a senior, highly visible role that blends deep technical mastery with executive influence. You are expected to be a recognized expert in generative AI – frameworks, agent harnesses, and the realities of production deployment – and equally comfortable in the boardroom, translating complex technology into clear business value for CXO-level stakeholders and helping shape enterprise AI strategy.

Architecture & Technical Leadership

  • Drive the end-to-end architecture and technical vision for generative AI within the function – reference architectures, patterns, and standards that teams build against.
  • Make authoritative technology decisions, selecting the right models, frameworks, and agent harnesses for each use case, balancing capability, latency, cost, and risk.
  • Move solutions from proof-of-concept to production with realistic, production-grade designs – covering orchestration, retrieval (RAG), evaluation, observability, guardrails, and human-in-the-loop.
  • Integrate GenAI into the existing cloud solutions and automation platform (AWS, CI/CD toolchain, ITSM) so GenAI is a first-class, governed capability.

Running AI at Scale

  • Design for scale and operational excellence for GenAI workloads – throughput, latency, reliability, and cost optimization (token economics, caching, model routing).
  • Establish the operational foundation including evaluation pipelines, monitoring, drift/quality management, and incident response for Agentic solutions.
  • Bake in guardrails such as security, data privacy, responsible-AI, hallucination mitigation, and regulatory compliance into every architecture.

Executive Engagement & Strategy

  • Advise and influence to CXO-level leaders, translating complex AI concepts into clear business value, trade-offs, risks, and roadmaps.
  • Shape the generative-AI strategy and roadmap for the enterprise, aligning technology investment with business outcomes and priorities.
  • Build and present business cases, ROI, and build-vs-buy analyses for AI initiatives.
  • Serve as an evangelist and trusted expert – to executives, engineering teams, and external partners – and champion an enterprise AI vision.

Enablement & Governance

  • Mentor and upskill engineering teams and set architecture governance, review gates, and reusable building blocks.
  • Define and steward AI governance, standards, and best practices in partnership with security, data, and legal.


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field – or equivalent practical experience.
  • 10 years of experience in software/AI engineering and architecture, including senior technical leadership on large-scale systems.
  • Recognized depth in generative AI: LLMs, prompt/context engineering, RAG, agent frameworks (e.g., LangChain, Amazon Bedrock Agents), and agent harnesses.
  • Proven track record designing and running GenAI solutions in production at scale – including evaluation, observability, cost, and reliability.
  • Deep hands-on knowledge of AWS and its AI services (e.g., Amazon Bedrock), plus core cloud infrastructure (compute, networking, IAM, containers).
  • Strong grounding with enterprise architecture practices, integration, and the modern DevOps toolchain (GitHub, Jenkins, Artifactory, SonarQube).
  • Exceptional communication and executive-presence skills – able to hold credible, persuasive CXO-level conversations and articulate complex technology in business terms.
  • Solid understanding of responsible-AI, security, and data-governance considerations for enterprise AI.


Salary.com Estimation for AI Architect – Generative AI & Enterprise Solutions in Jersey, NJ
$140,938 to $174,334
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Architect – Generative AI & Enterprise Solutions?

Sign up to receive alerts about other jobs on the AI Architect – Generative AI & Enterprise Solutions career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$170,589 - $211,671
Income Estimation: 
$132,903 - $169,021
Income Estimation: 
$144,671 - $184,917
Income Estimation: 
$136,361 - $179,761
Income Estimation: 
$86,891 - $130,303
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at EXL

  • EXL Cleveland, OH
  • About Us: Our passion at EXL is enabling organizations to achieve a measurable, competitive advantage through Data Management. We partner with our clients ... more
  • 1 Day Ago

  • EXL Jersey, NJ
  • What Makes This Role Different Work alongside client teams in high-impact environments, moving from problem discovery to production deployment. Combine bus... more
  • 2 Days Ago

  • EXL Jersey, NJ
  • Role: Business Data Analyst with Property & Casualty (P&C) Insurance Claims domain Location: Jersey City, NJ (hybrid - 3 days on-site and 2 days’ work from... more
  • 4 Days Ago

  • EXL Anderson, SC
  • Commercial and personal line insurance carriers rely on EXL as a key business partner through our Castle High Value and EXL Risk Control service offerings.... more
  • 6 Days Ago


Not the job you're looking for? Here are some other AI Architect – Generative AI & Enterprise Solutions jobs in the Jersey, NJ area that may be a better fit.

  • Empower Retirement Greenwood, CO
  • Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own. We have a ... more
  • Just Posted

  • NTT DATA, Inc. Texas, TX
  • Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading in... more
  • 1 Day Ago

AI Assistant is available now!

Feel free to start your new journey!