Demo

AI Architect - Paramus, NJ / Hybrid (Require local candidates)

USG, Inc.
Paramus, NJ Full Time
POSTED ON 6/25/2026
AVAILABLE BEFORE 7/24/2026

Hope you are fine.

I have multiple opportunities for AI Architect with my client. Please go through the below job description and let me know your interest for the same

Role Name: AI Architect

Work site: Paramus, NJ / Hybrid

Employment Type: Full-Time

Job Summary

AI Architect – Google AI & Generative Intelligence

Experience Required: 12–18 Years in Software Engineering | 7 Years in AI/ML & Generative AI

Role Overview

We are seeking a highly accomplished AI Architect with deep expertise in Google AI technologies and Generative AI to lead the design and implementation of enterprise-scale AI solutions. This role requires strong architectural vision, hands-on technical depth, and leadership in building production-grade AI systems leveraging LLMs, SLMs, and multi-agent frameworks.

The ideal candidate will drive AI strategy, define scalable architectures, and lead cross-functional teams in delivering cutting-edge AI-powered applications using the Google Cloud ecosystem, modern AI frameworks, and robust MLOps practices.

Key Responsibilities

1. AI Architecture & Strategy

  • Define end-to-end AI/GenAI architecture for enterprise-grade applications.  
  • Establish best practices for LLM/SLM adoption, multi-agent systems, and RAG architectures.
  • Drive AI platform strategy leveraging Google Cloud (Vertex AI, GKE, Cloud Run).
  • Lead architecture reviews, technical governance, and design standards.

2. LLM / SLM & Generative AI Solutions

  • Architect solutions using commercial LLMs such as Gemini, GPT, and Claude.
  • Design scalable systems using open-source models (Mixtral, Mistral, Gemma, Phi-3).
  • Define strategies for fine-tuning (LoRA, QLoRA, PEFT) and model optimization.
  • Oversee model evaluation frameworks and benchmarking (HELM, lm-eval, RAGAS).

3. Google AI Ecosystem Leadership

  • Lead adoption of:
    • Vertex AI for model lifecycle management
    • Google Agent Development Kit (ADK) for intelligent agents
    • Google Workspace integrations (Docs, Sheets, Gmail, Drive, Meet)
  • Architect solutions using BigQuery, Lakehouse, and Vector Databases.

4. AI Platform & MLOps Architecture

  • Design scalable MLOps pipelines for training, deployment, and monitoring.
  • Define CI/CD strategies for AI systems using GitHub Actions / GitLab CI.
  • Establish observability frameworks using LangSmith, MLflow, Weights & Biases.  
  • Optimize infrastructure cost and performance across cloud and hybrid environments.

5. Multi-Agent Systems & AI Frameworks

  • Architect complex workflows using:
    • LangChain, LlamaIndex, LangGraph
    • Semantic Kernel for multi-agent orchestration
  • Design intelligent automation pipelines and agent collaboration patterns.

6. Data & RAG Architecture

  • Design enterprise RAG pipelines using Vertex AI Vector DB, ChromaDB.  
  • Define data ingestion, transformation, and governance strategies.
  • Architect semantic search and knowledge retrieval systems.

7. Application & Integration Architecture

  • Define backend architecture using FastAPI / Node.js APIs.
  • Architect API management and security using Apigee / MuleSoft.
  • Guide frontend architecture using React / Angular for AI-driven applications.

8. Engineering Leadership

  • Provide technical leadership and mentorship to AI/ML engineers.
  • Collaborate with product, data, and engineering teams for solution delivery.
  • Lead design documentation, architecture diagrams, and technical roadmaps.
  • Ensure adherence to coding standards, testing, and quality frameworks.

9. Deployment & Infrastructure

  • Architect deployments across:
    • Google Cloud Platform (Vertex AI, GKE, Cloud Run)
    • Hybrid and on-prem environments
    • Edge AI use cases
  • Ensure scalability, reliability, and security of AI systems.

10. AI Governance & Responsible AI

  • Define frameworks for AI ethics, bias mitigation, and explainability.
  • Establish governance for model lifecycle, monitoring, and compliance.
  • Implement safeguards for hallucination detection and output validation.

Required Qualifications

  • 12–18 years of software engineering experience.
  • 7 years in AI/ML with strong focus on Generative AI and LLMs.
  • Deep expertise in Google AI ecosystem (Vertex AI, Gemini, ADK, AI Studio).
  • Strong experience in LLMs, SLMs, RAG, and multi-agent architectures.
  • Proficiency in Python and familiarity with Node.js.
  • Hands-on experience with MLOps, CI/CD, and cloud-native architecture (Google Cloud Platform).
  • Proven experience designing scalable, production-grade AI systems.

Preferred Qualifications

  • Google Cloud Certifications (Professional ML Engineer / Cloud Architect).
  • Experience contributing to open-source AI/ML projects.
  • Expertise in edge AI and hybrid cloud deployments.
  • Experience building enterprise AI platforms or COEs.
  • Strong leadership experience mentoring and scaling AI teams

Key Skills Summary

  • Generative AI (LLMs, SLMs, RAG, Agents)
  • Google Cloud AI Stack (Vertex AI, Gemini, ADK)
  • AI Frameworks (LangChain, LangGraph, LlamaIndex, Semantic Kernel)
  • MLOps & Observability (MLflow, W&B, LangSmith)
  • Cloud & Infrastructure (Google Cloud Platform, Kubernetes, Serverless)
  • Backend & APIs (FastAPI, Node.js, Apigee)
  • Data & Vector DBs (BigQuery, ChromaDB, Vector Search)

 

 

Jaya Kushwaha

Associate  Manager – Recruitment 

Email:

USG Inc. | Vistara Solutions Inc.

eye

Salary.com Estimation for AI Architect - Paramus, NJ / Hybrid (Require local candidates) in Paramus, NJ
$147,309 to $189,275
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Architect - Paramus, NJ / Hybrid (Require local candidates)?

Sign up to receive alerts about other jobs on the AI Architect - Paramus, NJ / Hybrid (Require local candidates) career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at USG, Inc.

  • USG, Inc. Port Reading, NJ
  • Day Shift (7am-3pm) Starting hourly pay rate $34.15 - $35.90 per hour Role & Responsibilities Daily oversight of the plant storeroom functions to ensure sa... more
  • 1 Day Ago

  • USG, Inc. Chicago, IL
  • Position Summary Results-driven Salesforce Data Modeler to support our evolving Customer Experience team. Responsible for designing robust, integrated data... more
  • 1 Day Ago

  • USG, Inc. Los Angeles, CA
  • Hello, Hope you are fine. I have multiple opportunities for Service Manager with my client. Please go through the below job description and let me know you... more
  • 1 Day Ago

  • USG, Inc. Portage, MI
  • Hi This is Sudheer from United Software Group Inc. Hope you’re doing great today. I have an opening for the below requirement. If you’re interested please ... more
  • 2 Days Ago


Not the job you're looking for? Here are some other AI Architect - Paramus, NJ / Hybrid (Require local candidates) jobs in the Paramus, NJ area that may be a better fit.

  • Prohires Paramus, NJ
  • Job Title: AI Architect Location: Paramus, NJ / Hybrid Job Description: AI Architect – Google AI & Generative Intelligence Experience Required: 12–18 Years... more
  • 6 Days Ago

  • Jobs via Dice Paramus, NJ
  • Dice is the leading career destination for tech experts at every stage of their careers. Our client, Prohires, is seeking the following. Apply via Dice tod... more
  • 6 Days Ago

AI Assistant is available now!

Feel free to start your new journey!