We are seeking a highly skilled and motivated Senior Data Engineer with a strong focus on the Microsoft Azure tech stack. The ideal candidate will have a deep understanding of data architecture, data modeling, and data processing, with a proven track record of leveraging Azure services to build robust, scalable data & analytics solutions for the purpose of delivering AI, machine learning, and data visualization solutions for mid-market and enterprise organizations.

Responsibilities

1. Design, build, and maintain data pipelines in Azure, using services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database.

2. Implement data storage solutions using Azure Blob Storage, Azure Data Lake, and Azure Cosmos DB.

3. Develop and optimize data processing algorithms and data sets to support data analytics and machine learning initiatives.

4. Work closely with data scientists, analysts, and other stakeholders to understand data needs and implement solutions.

5. Ensure data quality and integrity using Azure Purview and other data governance tools.
6. Monitor and troubleshoot data pipelines, implementing fixes and improvements as needed.

7. Stay up to date with the latest Azure services and technologies, and advocate for their adoption where appropriate.

Qualifications

1. Bachelor's degree in Computer Science, Information Systems, or a related field. Advanced degree preferred.

2. 5 years of experience in data engineering using the Azure tech stack.
3. Proficiency in SQL and experience with Python and/or another scripting language.

4. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services.

5. Knowledge of data warehousing concepts and best practices.
6. Strong problem-solving skills and the ability to work independently and in a team.

7. Excellent English communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.