Lead Data Engineer (Azure / Databricks / ADF)

Job Description

We are seeking a highly skilled Lead Data Engineer to serve as the technical anchor for the enterprise s Internal Analytics Platform, the central source of truth for all data and reporting needs. This hands-on leadership role involves architecting and building scalable data solutions across Azure, Databricks, ADF, SQL, ETL pipelines, and modern data lake architectures. The ideal candidate brings deep expertise in cloud data engineering, strong leadership skills, and a passion for building high-performance analytical ecosystems.

Key Responsibilities

• Lead the design, development, and implementation of enterprise-scale data engineering solutions.

• Architect and optimize solutions across Azure Databricks, Azure Data Factory, SQL, and Data Lake/Delta Lake platforms.

• Develop, automate, and improve ETL/ELT pipelines and analytical data models.

• Implement and maintain CI/CD pipelines and Infrastructure as Code (IaC) using Terraform or Pulumi.

• Mentor and guide junior engineers, enforcing coding standards and data engineering best practices.

• Collaborate closely with cross-functional teams to ensure data quality, performance, and reliability.

• Drive innovation in data ingestion, transformation, and governance processes.

Qualifications

• 8 years of professional data engineering experience with demonstrated technical leadership.

• Strong expertise in the Azure ecosystem Azure Databricks, ADF, Key Vault, ADLS Gen2, Azure SQL.

• Advanced proficiency in SQL, Python, and PySpark for data ingestion and transformation.

• Proven experience designing data lake / delta lake / medallion architectures.

• Hands-on experience with high-volume ETL pipeline development and optimization.

• Proficiency with CI/CD automation and IaC tools (Terraform, Pulumi).

• Familiarity with Power BI, Tableau, and Agile development methodologies.