What are the responsibilities and job description for the Data & BI Senior Data Engineer position at Axiom Software Solutions Limited?
Job Description:
We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS, Azure DevOps, and ETL processes. This role will involve designing, developing, testing, and deploying ETL jobs, collaborating with cross-functional teams, and ensuring efficient data processing.
Key Responsibilities:
Design, develop, test, and deploy Matillion ETL jobs in accordance with project requirements.
Collaborate with the Data and BI team to understand data integration needs and translate them into Matillion ETL solutions.
Create and modify Python code/components in Matillion jobs.
Identify opportunities for performance optimization and implement enhancements to ensure efficient data processing.
Collaborate with cross-functional teams, including database administrators, data engineers, and business analysts, to ensure seamless integration of ETL processes.
Create and maintain comprehensive documentation for Matillion ETL jobs, ensuring knowledge transfer within the team.
Create, test, and deploy SQL Server Integration Service (SSIS) packages and schedule them via Active Batch scheduling tool.
Create Matillion deployment builds using Azure DevOps CI/CD pipeline and perform release manager activities.
Review code of other developers (L2, L3-BI/DI) to ensure code standards and provide approval as part of code review activities.
Resolve escalation tickets from the L2 team as part of the on-call schedule.
Working knowledge of API and Postman tool is an added advantage.
Qualifications:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
5 years of experience in data engineering, with a focus on ETL processes.
Proficiency in Matillion, SSIS, Azure DevOps, and ETL.
Strong knowledge of SQL, Python, and data integration techniques.
Experience with performance optimization and data processing enhancements.
Excellent collaboration and communication skills.
Ability to work in a fast-paced, dynamic environment.
Preferred Skills:
Experience with cloud platforms such as AWS or Azure.
Knowledge of data warehousing and data modeling.
Familiarity with DevOps practices and CI/CD pipelines.
Strong problem-solving skills and attention to detail.
