What are the responsibilities and job description for the Azure Databricks Data Engineer position at TALENT Software Services?
Job Requirements
- Location: Louisville, KY
- Duration: 6 months
- Experience Required: 8-10 years
- Role: Databricks / Azure Data Engineer
- Experience developing and implementing data pipelines using Azure Data Factory (ADF).
- Experience ingesting data from multiple sources using Azure ADF.
- Experience transforming data using Azure Databricks and Delta Lake.
- Experience with Azure DevOps for CI/CD, including:
- Stories
- Bugs
- Issue management
- Experience implementing Prefect.
- Strong hands-on experience with Databricks.
- Experience working with Microsoft Azure integration solutions.
- Work on Agile development projects and participate in sprint delivery.
- Design and implement data integration solutions in Microsoft Azure.
- Develop and maintain data pipelines using Azure Data Factory.
- Ingest data from various source systems into Azure.
- Perform data transformations using Azure Databricks and Delta Lake.
- Implement and maintain workflows using Prefect.
- Perform data analysis and troubleshooting for data-related issues.
- Assist in identifying and resolving data quality and pipeline issues.
- Collaborate with development teams to support CI/CD processes using Azure DevOps.
- Act as an individual contributor and problem solver.
- Participate in Agile ceremonies, sprint planning, and delivery activities.
- Experience working in Agile development environments.
- Experience with sprint planning and sprint delivery.
- Strong analytical and problem-solving skills.
- Ability to work independently as an individual contributor.
- Role Description: Databricks
- Essential Skill: Databricks
- Desirable Skills: Not specified
- Keyword: Databricks
- Skill Category: Digital - Databricks
Salary : $42 - $42