Sr. Azure Data Engineer for our direct client for a Long Term Remote position. We need Senior Data Engineer with strong background in Azure Data Factory, Data Lakes, Lakehouse, ETL, DevOps, SQL and PowerBI.

It will be a Long Term Remote Project.

Required Skills and Qualifications:

1.Proven experience working with Microsoft Fabric, including Azure Data Factory, Azure Data Lake, and related services.

2.Proficiency in programming languages such as Python, SQL, and PowerShell for data manipulation, automation, and scripting tasks.

3.Strong understanding of data warehousing concepts, data modelling techniques, and dimensional modelling principles.

4.Experience with lakehouse architecture principles, including the integration of data lakes and data warehouses for unified data storage, management, and analytics.

5.Familiarity with platforms such as Delta Lake for transactional capabilities on data lakes, schema enforcement, and time travel features.

6.Experience with designing and implementing ETL/ELT processes, data integration solutions, and data pipelines in a cloud environment.

7.Solid knowledge of database systems, both relational (e.g., SQL Server) and NoSQL (e.g., Cosmos DB), and proficiency in writing efficient SQL queries.

8.Familiarity with data governance practices and data quality management.

9.Excellent problem-solving skills with the ability to troubleshoot complex technical issues and performance bottlenecks.

10.Strong communication skills with the ability to effectively collaborate with cross[1]functional teams and translate business requirements into technical solutions.

Preferred Qualifications:

1.Knowledge of DevOps practices and tools for CI/CD, infrastructure as code (IaC), and automated deployment (e.g., Azure DevOps, Terraform).

2.Familiarity with machine learning concepts and frameworks (e.g., TensorFlow, PyTorch) for implementing predictive analytics and machine learning pipelines.

3.Experience with containerization technologies such as Docker and orchestration tools for deploying and managing containerized applications.

4.Experience with C# or .Net

5.Experience with Data Visualization (e.g. PowerBI)