What are the responsibilities and job description for the Senior ETL Developer position at Compunnel Inc.?
Description
We are seeking a highly skilled and experienced Senior ETL Tools Developer with deep expertise in Microsoft Azure Data Factory ADF and modern data integration platforms The ideal candidate will lead the design development and optimization of scalable ETL pipelines and build robust integration interfaces with enterprise platforms such as Coupa and SAP
Key Responsibilities
- Design develop and maintain robust ETL pipelines using MS Azure Data Factory MS Azure Databricks and other Azure services
- Build and manage data integration interfaces between internal systems and external platforms such as Coupa and SAP
- Collaborate with data architects analysts and business stakeholders to understand data requirements and deliver scalable solutions
- Optimize data workflows for performance reliability and cost efficiency
- Implement data quality checks error handling and logging mechanisms
- Participate in code reviews architecture discussions unit testing and performance tuning
- Ensure compliance with data governance security and privacy standards
- Mentor junior developers and contribute to best practices in data engineering
Required Qualifications
- Bachelor’s or master's degree in computer science information systems or related field
- 5 years of experience in ETLELT development with at least 2 years focused on Azure Data Factory
- Strong proficiency in SQL Postgres and data transformation logic
- Experience with Azure Blob Storage Azure Functions and Databricks
- Handson experiences integrating with Coupa and SAP platforms
- Familiarity with CICD pipelines and version control tools e.g. Git Azure DevOps
- Experience with Unix Linux shell scripting for automation and process orchestration
- Expertise in data extraction transformation and loading from to various data sources eg relational databases flat files XML JSON etc.
- Solid understanding of data warehousing concepts dimensional modeling and big data processing
- Excellent problem-solving communication and documentation skills
Preferred Good to Have Qualifications
- Experience with IBM DataStage development
- Experience with Power BI Snowflake or Apache Spark
- Knowledge of data lake architecture data mesh or data fabric concepts
- Microsoft Azure certifications eg DP203 Data Engineering on Microsoft Azure
Experience with RESTSOAP APIs and middleware platforms for enterprise integration.