What are the responsibilities and job description for the Senior GenAi/ Agentic Lead/ Architect (Hands on exp. is must) position at Nityo Infotech Corporation?
Role: Senior GenAi/ Agentic Lead/ Architect (Hands on exp. is must)
Location: Santa Clara, CA (Onsite)
We are seeking a highly skilled Cloud Architect with expertise in Generative AI, Copilot Studio, and multicloud platforms spanning Azure (including Azure AI Foundry), AWS, and Google Cloud. This role will design scalable, secure, and productionready AI systems, enabling RAG, agentic workflows, and enterprise copilots.
Core Responsibilities:
- Architect endtoend Generative AI solutions, including model serving (vLLM, TGI), API integration, and user interaction layers.
- Design and implement RAG architecture using vector stores, embeddings, hybrid search, and reranking to embed enterprise knowledge into LLMs.
- Create agentic systems, enabling multiagent collaboration for complex, stateful workflows and reasoningdriven automation.
- Develop and govern Copilots in Copilot Studio, including connectors, actions, plugins, DLP rules, environment strategy, and integration with Microsoft 365 and enterprise systems.
- Leverage Azure AI Foundry (prompt flow, evaluators, safety, model orchestration) to operationalize LLM applications at scale.
- Evaluate and optimize AI system performance, balancing quality, latency, throughput, cost efficiency, and safety compliance.
- Implement Responsible AI, security, and HITL (HumanintheLoop) controls, ensuring compliance in regulated environments.intheLoop) controls, ensuring compliance in regulated environments.
- Produce clear, maintainable documentation for architecture, patterns, and operational processes.
Required Qualifications:
- 8 10 years of experience in cloud architecture or enterprise software engineering.
- 3 years of handson experience designing or delivering Generative AI or LLM applications.
- Proven experience with Azure AI Foundry, Azure OpenAI, and Copilot Studio (actions, connectors, governance, M365 integration).
- Experience deploying AI solutions on AWS (Bedrock, SageMaker) and/or Google Cloud Platform (Vertex AI).
- Handson experience with RAG, vector databases (Azure AI Search, Pinecone, OpenSearch, Vertex Matching Engine), embeddings, and hybrid search.
- Deep understanding of cloud security (IAM/RBAC, Key Vault/KMS, VPC/PrivateLink, token safety).
- Experience with Kubernetes (AKS/EKS/GKE), containerization, API frameworks (FastAPI, Node.js, .NET), Python, TypeScript, or C#/.NET.
- Working knowledge of transformer architectures and model adaptation techniques (finetuning, LoRA, prompt engineering).
- Familiarity with AI Ops / MLOps tools such as Prompt Flow, MLflow, SageMaker Pipelines, or Vertex Pipelines.
Preferred Qualifications:
- Experience implementing agentbased systems using frameworks like LangChain, LlamaIndex, Semantic Kernel, or AutoGen.
- Background working with enterprise data ecosystems (Databricks, Snowflake, BigQuery, Redshift).
- Knowledge of Responsible AI frameworks, guardrails, safety filters, PII redaction, and evaluation methodologies.
- Experience in regulated industries (healthcare, finance, government), with understanding of compliance controls.
- Experience with observability (OpenTelemetry, PrometheGrafana, App Insights) for AI workloads.
Education:
- Bachelor s/ Masters in Computer Science, Engineering, Information Systems, Data Science, or related field (required).
Salary : $70 - $80