What are the responsibilities and job description for the AZURE DATA ENGINEER position at Arbor Tek Systems?
Role: Azure Databricks Data Engineer Location : Charlotte, NC and Jersey City, NJ Onsite Job Type: Contract Duration: 12 months with possible extension
Job Summary
We are seeking a skilled Data Engineer with strong expertise in Azure Databricks to design, develop, and maintain scalable data pipelines and analytics solutions. The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and modern data architecture (lakehouse).
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks
Work with PySpark / Apache Spark for data processing and transformation
Build and manage ETL/ELT workflows using Azure Data Factory (ADF)
Integrate data from multiple sources into Azure Data Lake Storage (ADLS)
Implement and optimize Delta Lake / Lakehouse architecture
Perform data cleansing, validation, and transformation for analytics use cases
Monitor and optimize performance of data pipelines and jobs
Collaborate with data scientists, analysts, and business teams
Ensure data security, governance, and compliance standards
Troubleshoot production issues and perform root cause analysis
Required Skills & Experience
Strong hands-on experience with Azure Databricks
Expertise in PySpark / Apache Spark
Proficiency in SQL and Python
Experience with Azure Data Factory (ADF)
Knowledge of Azure Data Lake Storage (ADLS Gen2)
Experience building ETL/ELT pipelines
Understanding of data modeling (star/snowflake schemas)
Familiarity with data warehousing concepts
Strong debugging and performance tuning skills
Salary : $55 - $57