Azure Data Engineer Level 3

Job Description
Position Overview

• We are looking for a highly skilled, hands-on Senior Data Engineer to join our Data & Analytics team.
• In this role, you will play a key part in building and scaling behavioral and Ecommerce data platform, enabling trusted analytics and making AI-ready data available across the organization.
• You will be responsible for designing and implementing robust, scalable data pipelines, modeling complex, high-volume datasets, and delivering high-quality, well-structured data products to power business insights and future AI capabilities.
• This is a delivery-focused engineering position demanding deep technical expertise in Azure, Databricks, and Synapse, combined with experience managing large-scale behavioral data in enterprise environments.

Required Qualifications

• 5 years of experience in data engineering or similar roles, with hands-on delivery of cloud-based data solutions.
• Preferred Engineering certifications: Microsoft Certified: Azure Data Engineer Associate and Databricks: Databricks Certified Data Engineer Professional
• Strong expertise in Databricks and Azure Synapse, with practical experience in Spark-based data processing.
• Proficient in modern data architectures (Lakehouse, ELT/ETL pipelines, real-time data processing).
• Advanced SQL skills for data transformation and performance optimization.
• Proven ability to model and manage large-scale, complex behavioral and Ecommerce datasets.
• Expert in BI and best practices for data enablement and self-service analytics.
• Hands-on experience with Unity Catalog and data cataloging tools (e.g., Alation) for governance and metadata management.
• Working knowledge of behavioral analytics platforms (Adobe Analytics, Adobe Customer Journey Analytics).
• Strong collaboration and communication skills
• Experience operating in agile delivery environments, balancing speed, scalability, and solution quality.

Key Responsibilities

• Design, build, and maintain robust, scalable ELT/ETL pipelines and data transformations using Databricks, Spark, and Synapse.
• Model high-volume, complex event-level datasets (digital behavior, Ecommerce transactions, marketing interactions) to support dashboards, experimentation, ML models, and marketing activation.
• Enforce data governance, discoverability, and stewardship using Unity Catalog and Alation, ensuring compliance and lineage tracking.
• Validate and reconcile data pipelines against established behavioral datasets such as Adobe Customer Journey Analytics (CJA) and Adobe Analytics.
• Partner with data architects, analysts, data scientists, and marketing teams to deliver trusted, reusable, and well-structured datasets that power BI dashboards and decision-making.
• Mature the data ingestion, processing, orchestration, and curation capabilities leveraging Delta Lake optimization, Databricks Workflows, and Synapse for analytical consumption.
• Support and optimize semantic models and data marts that enable self-service analytics through AI/BI Dashboards and Power BI.
• Participate in agile delivery processes (sprint planning, backlog refinement, documentation), collaborating through Jira and Confluence.
• Document data assets, transformations, and pipelines for discoverability, transparency, and long-term maintainability.