What are the responsibilities and job description for the Azure DataBricks Data Architect position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Lightning Minds Inc., is seeking the following. Apply via Dice today!
Role: Azure Databricks Data Architect
An Azure Databricks Data Architect is responsible for designing and implementing scalable, high-performance data platforms on Microsoft Azure. The role focuses on end-to-end Lakehouse architecture, ensuring data governance, security, and optimization for advanced analytics and AI workloads.
Core Responsibilities:
Design and oversee Databricks Lakehouse architecture using Delta Lake and Apache Spark.
Define data strategies, reusable ingestion frameworks, transformation processes, and storage models for batch and real-time processing.
Implement Unity Catalog for data lineage, security, and access control management.
Guide teams in building optimized data pipelines and tuning Spark jobs for performance.
Lead cloud migration initiatives and integrate Databricks with tools such as Microsoft Purview and Power BI.
Required Skills & Qualifications:
Strong expertise in PySpark, Python, Scala, and SQL.
Hands-on experience with Azure services including ADLS, Azure Data Factory (ADF), and Azure SQL.
7 12 years of experience in data engineering/architecture with leadership and architecture consulting exposure.
Preferred certifications:
Databricks Certified Data Engineer Professional
Azure Solutions Architect Expert
Role: Azure Databricks Data Architect
An Azure Databricks Data Architect is responsible for designing and implementing scalable, high-performance data platforms on Microsoft Azure. The role focuses on end-to-end Lakehouse architecture, ensuring data governance, security, and optimization for advanced analytics and AI workloads.
Core Responsibilities:
Design and oversee Databricks Lakehouse architecture using Delta Lake and Apache Spark.
Define data strategies, reusable ingestion frameworks, transformation processes, and storage models for batch and real-time processing.
Implement Unity Catalog for data lineage, security, and access control management.
Guide teams in building optimized data pipelines and tuning Spark jobs for performance.
Lead cloud migration initiatives and integrate Databricks with tools such as Microsoft Purview and Power BI.
Required Skills & Qualifications:
Strong expertise in PySpark, Python, Scala, and SQL.
Hands-on experience with Azure services including ADLS, Azure Data Factory (ADF), and Azure SQL.
7 12 years of experience in data engineering/architecture with leadership and architecture consulting exposure.
Preferred certifications:
Databricks Certified Data Engineer Professional
Azure Solutions Architect Expert