What are the responsibilities and job description for the Azure Databricks architect position at TekShapers?
Job Title: Architect – Databricks
Location: - Mahwah, NJ (Hybrid)
Employment Type: : Fulltime (FTE)
Job Description:
Architect – Databricks ((Cosmos / Vector DB Engineer (AI Serving Layer))
Experience: 12 years
Location Preferred: New Jersey (Minimum 2 Days in office/ Hybrid)
Requirement Summary :
Build and operate the enterprise AI Serving Layer that connects Global Pipelines, Gold Layer data, Enterprise Serving Layers, documents, and knowledge assets to Copilots, AI Agents, Semantic Search, and GenAI applications. Responsible for vectorization, embeddings, retrieval, indexing, AI APIs, and RAG architecture required to make enterprise data consumable by AI at scale.
Requirement Specifications: Skill needed in the candidate –
- Cosmos DB (NoSQL, Mongo API)
- Azure AI Search & Vector Search
- Azure OpenAI & Embeddings
- RAG Architecture & Semantic Retrieval
- Databricks, Spark, Python
- FastAPI, API Development
- AI Security & Governance
- AI Serving Infrastructure & Operations
- Terraform, Bicep, Git, CI/CD
- RBAC, RLS, OLS, ABAC