What are the responsibilities and job description for the Azure Databricks Architect position at Happiest Minds Technologies?
Happiest Minds, the Mindful IT Company, applies agile methodologies to enable digital transformation for enterprises and technology providers by delivering seamless customer experience, business efficiency and actionable insights. We leverage a spectrum of disruptive technologies such as: Big Data Analytics, AI & Cognitive Computing, Internet of Things, Cloud, Security, SDN-NFV, RPA, Blockchain, etc. Positioned as Born Digital . Born Agile , our capabilities spans across product engineering, digital business solutions, infrastructure management and security services. We deliver these services across industry sectors such as retail, consumer packaged goods, edutech, e-commerce, banking, insurance, hi-tech, engineering R&D, manufacturing, automotive and travel/transportation/hospitality.
Headquartered in Bangalore, India; Happiest Minds has operations in USA, UK, The Netherlands, Australia and Middle East.
Key Responsibilities:
- Lead customer discussion, architecture design and implementation for large scale modern data platform implementations.
- Lead the setup and evolution of DataOps processes: CI/CD pipelines, observability, automation, testing, lineage, and monitoring.
- Define intake, triage, escalation, and support workflows from scratch to support BAU operations.
- Work with global teams (support, platform, and data engineering) to ensure smooth handoffs and delivery of tasks.
- Create frameworks, runbooks, and reusable modules to enable fast onboarding and continuous delivery.
- Act as a thought partner to leadership on platform scalability, data governance, and modernization. Work closely with offshore SMEs to help position Happiest Minds offering.
- Mentor engineers and support teams on architectural best practices, performance tuning, and operational excellence.
- Participate in architecture reviews, vendor/tool evaluations, and innovation initiatives.
Skills & Experience:
- 15 years in data architecture and engineering roles.
- Strong knowledge of Modern Data Platform, DataOps, MLOps, and AIOps principles and tooling.
- Deep hands-on experience with Databricks (Delta Lake, notebooks, workflow, Unity Catalog).
- Proficiency in Python, SQL, PySpark, and REST APIs.
- Proven experience with Azure services such as ADF, Stored Procedures, Purview, Azure DevOps etc.
- Knowledge and hands of experience with downstream like Business Intelligence (Power BI, Tableau), AI/ML and GenAI.
- Experience with enterprise data governance (catalogues, access control, lineage).
- Strong understanding of support models and SLAs in enterprise environments.
Preferred Qualifications:
- Certifications in Azure and Databricks
- Experience working in regulated industry, Energy and Utility.