Description

• Design and build reusable components, frameworks and libraries at scale to support analytics products.
• Design and implement product features in collaboration with business and Technology stakeholders.
• Anticipate, identify and solve issues concerning data management to improve data quality.
• Clean, prepare and optimize data at scale for ingestion and consumption.
• Drive the implementation of new data management projects and re-structure of the current data architecture.
• Implement complex automated workflows and routines using workflow scheduling tools.
• Build continuous integration, test-driven development and production deployment frameworks.
• Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
• Analyze and profile data for designing scalable solutions.
• Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues.
• Mentor and develop other data engineers in adopting best practices.

Requirements

Top 3 Skills

• PySpark
• AWS
• Big Data

NOTE

• Candidate is expected to work as per the PST Time Zone