What are the responsibilities and job description for the ETL Developer with Azure Databricks position at Tricon Solutions?
ETL Developer with Azure Databricks
Location: Remote – anywhere in US
Type: ongoing on W2
Key Skills & Requirements:
- 5 years of experience in creating ETL jobs using Azure Databricks with Oracle and SQL Server as backend.
- Strong understanding of ETL concepts including full load and incremental load using Databricks and Azure Data Factory (ADF) pipelines.
- Experience in creating ETL pipelines with Azure Data Factory and sequencing Databricks jobs in ADF.
- Experience in creating reusable notebooks in Azure Databricks, including the use of functions and parameters.
- Proficiency in Python programming language.
- Strong Oracle and SQL Server query experience, with knowledge of CTEs, ANSI SQL, and Oracle functions.
- Experience with SQL set operators such as MINUS, EXCEPT, UNION, etc.
- Proficiency in creating PL/SQL blocks, triggers, and indexes.
- Experience in query performance tuning, including working with indexes and partitions.
- Strong troubleshooting and defect resolution skills.
- Excellent communication and client-facing skills.
