Role & Responsibilities

• Craft and build reusable components, frameworks, and libraries at scale to support analytics products.
• Design and implement product features in collaboration with business and Technology stakeholders.
• Identify and tackle issues concerning data management to improve data quality.
• Clean, prepare and optimize data for ingestion and consumption.
• Collaborate on the implementation of new data management projects and re-structure of the current data architecture.
• Implement automated workflows and routines using workflow scheduling tools.
• Build continuous integration, test-driven development, and production deployment frameworks.
• Collaboratively review design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
• Analyse and profile data for designing scalable solutions.
• Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues.
• Develop architecture and design patterns to process and store high volume data sets.
• Participate in an Agile / Scrum methodology to deliver high - quality software releases every 2 weeks through Sprints.

Requirements

Top Skills

·Python

·Databricks

·AWS