Demo

Senior AI Architect & Lead Prompt Engineer

AIT Global, Inc.
Sunnyvale, CA Contractor
POSTED ON 7/31/2026
AVAILABLE BEFORE 8/31/2026
Job Title: Senior AI Architect & Lead Prompt Engineer
Location: Sunnyvale, CA
Key Responsibilities:
  • AI Architecture & Design: Lead the end-to-end architecture of multi-agent
  • systems, moving from initial concept to production-grade deployment on Google
  • Cloud Platform (Google Cloud Platform).
  • Prompt Engineering & Orchestration: Develop sophisticated prompt
  • engineering frameworks, including system prompts, few-shot templates, and
  • output guardrails. Utilize Chain-of-Thought (CoT) prompting and structured
  • prompt chains for complex reasoning tasks.
  • Intelligent Dialog Systems: Design conversational interfaces using Dialogflow
  • and Gemini-powered agents to manage inquiry routing and automated workflow
  • orchestration.
  • System Integration: Architect integrations between LLM platforms (Vertex
  • AI/Gemini) and enterprise CRM/ITSM tools like Salesforce and ServiceNow,
  • specifically focusing on Telecom-grade inquiry response and ticketing workflows.
  • RAG & Knowledge Retrieval: Build and optimize RAG (Retrieval-Augmented
  • Generation) pipelines grounded in internal client policies and technical
  • documentation.
  • MLOps & Deployment: Oversee the deployment of microservices using GKE
  • (Google Kubernetes Engine), Cloud SQL, and Cloud Build, ensuring scalable
  • and reliable AI performance.
Required Core Expertise:
  • LLM Stack: Deep expertise in Gemini, Vertex AI, and LangChain or
  • LlamaIndex.
  • Enterprise Integration: Proven experience architecting AI solutions that
  • interface with Salesforce and ServiceNow within a Telecom or large enterprise
  • context.
  • Agentic Systems: Experience building multi-agent architectures for autonomous
  • task execution and workflow automation.
  • Data & Search: Mastery of hybrid search, reranking, and vector databases (e.g.,
  • Redis, PostgreSQL).
Qualifications:
  • Experience: 10 years in the AI stack, ranging from classical NLP/NLU to
  • modern generative AI architectures.
  • Education: B.Tech in Computer Science, Mathematics, or a related technical
  • field.
  • Technical Proficiency: Strong command of Python, Terraform IAC, Docker, and
  • the Google Cloud Platform ecosystem (GKE, Cloud Deploy).
  • Industry Knowledge: Demonstrated understanding of the Service Now,
  • Salesforce, Net Cracker in Telecommunications service lifecycle, specifically
  • regarding inquiry management and automated support.
Tools & Platforms:
  • AI/ML: Gemini, Vertex AI, Hugging Face, OpenAI, Claude.
  • Frameworks: LangChain, LlamaIndex, Dialogflow.
  • Cloud & Infra: Google Cloud Platform (GKE, Cloud Build), Docker, TensorRT.
  • Data: Cloud SQL, PostgreSQL, Redis.

Hourly Wage Estimation for Senior AI Architect & Lead Prompt Engineer in Sunnyvale, CA
$76.00 to $98.00
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior AI Architect & Lead Prompt Engineer?

Sign up to receive alerts about other jobs on the Senior AI Architect & Lead Prompt Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at AIT Global, Inc.

  • AIT Global, Inc. Draper, UT
  • Job Title: Chargeback Analyst Location: Draper, UT (Hybrid) This position will be a part of the Payment and Risk Operation team and will be responsible for... more
  • 1 Day Ago

  • AIT Global, Inc. Newport, VA
  • Job Title: Process Engineer Banking Operations (Small Business Focus) Location: Newport News, VA (Hybrid) About the Role: Rockwoods is seeking a Process En... more
  • 1 Day Ago

  • AIT Global, Inc. York, NY
  • Job Title: Snowflake Data Engineer Location: NY - NJ Role Overview: Build and scale cloud data products on Snowflake supporting institutional trading, risk... more
  • 1 Day Ago

  • AIT Global, Inc. Bloomington, MN
  • Job Title: Senior Project Engineering Manager - Substation - 158 Location: Bloomington, MN Role Overview: As a Senior Substation Project Engineering Manage... more
  • 2 Days Ago


Not the job you're looking for? Here are some other Senior AI Architect & Lead Prompt Engineer jobs in the Sunnyvale, CA area that may be a better fit.

  • Kutir Technologies Sunnyvale, CA
  • Position Title: Prompt Engineer Lead / Architect Location: Sunnyvale CA Duration: 6 months Key Responsibilities: AI Architecture & Design: Lead the end-to-... more
  • 2 Days Ago

  • Kutir Inc Sunnyvale, CA
  • Position Title: Prompt Engineer Lead / Architect Location: Sunnyvale CA Duration: 6 months Key Responsibilities: AI Architecture & Design: Lead the end-to-... more
  • 2 Days Ago

AI Assistant is available now!

Feel free to start your new journey!