What are the responsibilities and job description for the Data Engineer position at NexGen Tech Solutions?
Job Summary
We are looking for an experienced Data Engineer with strong expertise in the Microsoft Azure Data Platform to design, develop, and optimize scalable data solutions. The ideal candidate will have hands-on experience with Microsoft Fabric, Azure Databricks, Azure Data Factory, Python, PySpark, SQL, and modern data warehousing techniques. Experience building enterprise-grade ETL/ELT pipelines, implementing data lakehouse architectures, and supporting analytics and AI initiatives is highly preferred.
Key Responsibilitie
- sDesign, develop, and maintain scalable data pipelines using Microsoft Fabric, Azure Data Factory (ADF), and Azure Databricks
- .Develop robust ETL/ELT processes to ingest, transform, and load structured and unstructured data from multiple enterprise systems
- .Build and optimize data solutions using Python, PySpark, SQL, and Spark technologies
- .Design and implement modern Lakehouse architecture using Microsoft Fabric and Delta Lake
- .Create and maintain data models for reporting, analytics, and machine learning workloads
- .Optimize Spark jobs and SQL queries for performance and cost efficiency
- .Implement data quality, validation, governance, and monitoring frameworks
- .Work closely with Data Architects, Business Analysts, Data Scientists, and BI developers to deliver scalable data solutions
- .Build reusable frameworks for ingestion, transformation, and orchestration
- .Implement CI/CD pipelines and Infrastructure as Code where applicable
- .Troubleshoot production issues and provide ongoing support for enterprise data platforms
- .Ensure compliance with security, governance, and data privacy standards
.
Required Skil
lsAzure Data Platfo
- rmMicrosoft Fabr
- icAzure Databric
- ksAzure Data Factory (AD
- F)Azure Data Lake Storage Ge
- n2Azure Synapse Analytics (Preferre
- d)Azure SQL Databa
- seAzure Key Vau
- ltAzure Monit
orProgrammi
- ngPyth
- onPySpa
- rkS
- QLSpark S
QLData Engineeri
- ngETL/ELT Developme
- ntData Lakehouse Architectu
- reDelta La
- keData Modeli
- ngData Warehousi
- ngPerformance Optimizati
- onData Quality Framewor
- ksData Validati
- onData Integrati
onDevO
- psAzure DevO
- psG
- itCI/CD Pipelin
- esARM Templates/Bicep/Terraform (Preferre
d)
Nice to H
- aveSnowfl
- akeAzure Functi
- onsMicrosoft Power
- BIAzure Machine Learn
- ingAzure Event
- HubApache Ka
- fkaREST A
- PIsDoc
- kerKuberne
tes
Preferred Certificat
- ionsMicrosoft Certified: Azure Data Engineer Associate (DP-
- 203)Microsoft Certified: Fabric Analytics Engineer Associate (DP-
- 600)Microsoft Certified: Azure Fundamentals (AZ-
900)
Required Exper
- ience5 years of experience in Data Enginee
- ring.3 years of experience with Azure Data Plat
- form.2 years of hands-on experience with Microsoft Fa
- bric.Strong experience with Azure Databricks and PyS
- park.Expertise in Python and advanced SQL develop
- ment.Experience building enterprise-scale data pipelines and data l
- akes.Hands-on experience with Azure Data Factory and orchestra
- tion.Strong understanding of data modeling, dimensional modeling, and data warehouse conc
- epts.Experience with CI/CD, Git, and Azure De