What are the responsibilities and job description for the Azure Databricks Architect position at Happiest Minds Technologies Limited?
Key Responsibilities:
- Lead customer discussion, architecture design and implementation for large scale modern data platform implementations.
- Lead the setup and evolution of DataOps processes: CI/CD pipelines, observability, automation, testing, lineage, and monitoring.
- Define intake, triage, escalation, and support workflows from scratch to support BAU operations.
- Work with global teams (support, platform, and data engineering) to ensure smooth handoffs and delivery of tasks.
- Create frameworks, runbooks, and reusable modules to enable fast onboarding and continuous delivery.
- Act as a thought partner to leadership on platform scalability, data governance, and modernization. Work closely with offshore SMEs to help position Happiest Minds offering.
- Mentor engineers and support teams on architectural best practices, performance tuning, and operational excellence.
- Participate in architecture reviews, vendor/tool evaluations, and innovation initiatives.
Skills & Experience:
- 15 years in data architecture and engineering roles.
- Strong knowledge of Modern Data Platform, DataOps, MLOps, and AIOps principles and tooling.
- Deep hands-on experience with Databricks (Delta Lake, notebooks, workflow, Unity Catalog).
- Proficiency in Python, SQL, PySpark, and REST APIs.
- Proven experience with Azure services such as ADF, Stored Procedures, Purview, Azure DevOps etc.
- Knowledge and hands of experience with downstream like Business Intelligence (Power BI, Tableau), AI/ML and GenAI.
- Experience with enterprise data governance (catalogues, access control, lineage).
- Strong understanding of support models and SLAs in enterprise environments.
Preferred Qualifications:
- Certifications in Azure and Databricks
- Experience working in regulated industry, Energy and Utility.