Demo

Gen AI Architect

Shiv Software Experts LLC
Bridgewater, NJ Full Time
POSTED ON 7/10/2026
AVAILABLE BEFORE 8/9/2026

Gen AI Architect

Full Time only

Experience: 12 to 15 Years

We are seeking a highly experienced Agentic AI / Generative AI Architect with 15 years of software and solution architecture experience, combined with handson expertise in Data Science, Machine Learning, and modern agent-based AI systems. This role requires deep technical leadership in designing, implementing, and governing advanced multi-agent AI ecosystems, RAG pipelines, cloud-native AI platforms, and GenAI engineering practices. The ideal candidate will drive endtoend solution architecture for enterprise-grade AI applications while ensuring scalability, robustness, security, and operational excellence.

What You''''ll Do: 

  • Design & Implement Agentic AI Systems
  • Architect and build multi-agent, goal-driven, autonomous AI systems using frameworks such as:
    • AutoGen
    • LangGraph
    • CrewAI
  • Create intelligent agent ecosystems supporting orchestration, reasoning, and collaborative task execution.
  • Prompt Engineering & LLM Expertise
  • Apply advanced prompt engineering techniques including:
    • Few-shot prompting
    • Chain-of-thought reasoning
    • Prompt templates
  • Optimize prompt flows for deterministic, scalable LLM-driven systems
  • Cloud-Native AI Architecture
  • Design and deploy AI/LLM systems on cloud platforms such as AWS Bedrock, Azure OpenAI, Google Vertex AI, etc.
  • Ensure solutions meet enterprise NFRs including performance, security, cost-optimization, and availability.
  • RAG Pipelines, Vector Databases & MCP
  • Architect and deploy RAG pipelines using vector databases such as:
    • Pinecone
    • Weaviate
    • ChromaDB
    • FAISS
  • Implement MCP Servers and Agent-to-Agent (A2A) communication frameworks.
  • LMOPs / GenAIOPs
  • Implement end-to-end operational pipelines for GenAI applications including:
    • Continuous integration & deployment
    • Model monitoring & drift detection
    • Logging, observability, and troubleshooting mechanisms
  • Establish governance models, reusable patterns, and GenAI best practices.
  • Application & Microservices Architecture
  • Design microservices-based systems using Spring Boot, REST APIs, and secure API design patterns.
  • Implement API security, versioning, and distributed system governance.
  • Architect cloud-native applications using AWS/Azure/Google Cloud Platform, Spring Cloud, PCF, or equivalent.
  • Collaboration & Leadership
  • Work closely with Data Scientists, Product Owners, Business SMEs, and Engineering teams.
  • Lead end-to-end solution architecture for enterprise AI initiatives.
  • Conduct technical presentations, architectural reviews, and stakeholder communication.

 

Expertise You''''ll Bring:

  • 5 years in software/solution architecture.
  • Proven experience as a Data Scientist or ML Engineer with exposure to agentic AI systems.
  • Experience designing multi-agent systems using AutoGen, LangGraph, CrewAI, etc.
  • Strong understanding of cloud AI platforms (Bedrock, Azure OpenAI, Vertex AI).
  • Hands-on experience with AI Code Assist tools such as:
    • GitHub Copilot
    • Windsurf
    • Cursor
    • AWS Q
  • Expertise in Vector Databases, RAG pipelines, MCP, and multi-agent communication.
  • Strong proficiency in Python (preferred), and optionally Java/Node.js.
  • Experience with microservices, Spring Boot, REST APIs, API security, and versioning.
  • Proficiency in Docker, Kubernetes, CI/CD pipelines.
  • Strong grasp of design patterns and architecture principles.
  • Deep understanding of cloud-native design and distributed systems.
  • Experience designing AI systems that meet NFRs: scalability, security, performance, maintainability.
  • Exceptional communication and presentation skills.
  • Ability to articulate complex AI concepts to technical and non-technical audiences.
  • Strong leadership, problem-solving mindset, and strategic thinking abilities.
  • Ability to collaborate with cross-functional teams to translate business needs into AI-powered solutions.

Salary.com Estimation for Gen AI Architect in Bridgewater, NJ
$153,777 to $188,196
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Gen AI Architect?

Sign up to receive alerts about other jobs on the Gen AI Architect career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$172,688 - $210,712
Income Estimation: 
$132,903 - $169,021
Income Estimation: 
$144,671 - $184,917
Income Estimation: 
$136,361 - $179,761
Income Estimation: 
$86,891 - $130,303
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Shiv Software Experts LLC

  • Shiv Software Experts LLC Atlanta, GA
  • Position: Tester III - Software Testing Duration: 9 Months Work Type: Hybrid Locations: Atlanta, GA / Dallas, TX / Oakland, KS Must be local to any of the ... more
  • 5 Days Ago

  • Shiv Software Experts LLC Queens, NY
  • Seeking experienced paralegal for solo practice law firm in Fresh Meadows, Queens. We specialize in residential and commercial real estate transactions, re... more
  • 6 Days Ago

  • Shiv Software Experts LLC Milwaukee, WI
  • Seeks a litigation paralegal with at least five years of experience and fully capable of assisting our attorneys in all phases of the litigation lifecycle,... more
  • 3 Days Ago

  • Shiv Software Experts LLC Bridgewater, NJ
  • Sr. Architect Full Time only Experience: 15 t0 18 Years Job Description: Architect/Sr. Architect - GenAI & Enterprise Architecture (Banking/Insurance) Role... more
  • 3 Days Ago


Not the job you're looking for? Here are some other Gen AI Architect jobs in the Bridgewater, NJ area that may be a better fit.

  • Compugra Systems Inc Bridgewater, NJ
  • Location: Bridgewater, NJ Persistent Office Full-time only Experience: 12 to 15 Years We are seeking a highly experienced Agentic AI / Generative AI Archit... more
  • 4 Days Ago

  • TekShapers Raritan, NJ
  • Role : Gen AI Architect Location : Raritan, NJ Type : Full-Time Required Experience: Hands-on Gen AI Architect, hybrid work 3-4 days in Raritan, NJ. Must h... more
  • 7 Days Ago

AI Assistant is available now!

Feel free to start your new journey!