WHAT ARE WE LOOKING FOR

We are seeking a hard-working Lead DataEngineer an important role in the development of Organization Enterprise Data& Analytics capabilities! You will be a member of an organization focusingon the development and delivery of data solutions and capabilities. Thesuccessful candidate is motivated by thinking big data, technically proficient,and enjoys working in a fast-paced environment. 

WHAT WILL YOU WORK ON

As a Lead Data Engineer, you will drive workto completion with hands-on development responsibilities, and partner with theEngineering Manager to provide thought leadership and innovation. 

IN THIS ROLE, YOU WILL:

·Provide technical leadership towardsarchitecting and delivering end to end solutions.

·Work together with Product managersand partners for prioritization, impact assessment and resolution.

·Driving and ensuring the team's workare of the highest quality and on time.

·Perform design, code and test planreviews developed by other data engineers in support of maintaining dataengineering standards.

·Partnering with other teams for crossfunctional initiatives.

·Craft and build reusable components, frameworks,and libraries at scale to support analytics products.

·Design and implement product featuresin collaboration with business and Technology partners.

·Develop architecture and designpatterns to process and store high volume data sets.

·Identify and tackle issues concerningdata management to improve data quality.

·Collaborate on the implementation ofnew data management projects and re-structure of the current data architecture.Implement automated workflows and routines using workflow scheduling tools.

·Build continuous integration,test-driven development, and production deployment frameworks.

·Troubleshoot data issues and performroot cause analysis to proactively resolve product and operational issues. Participatein an Agile / Scrum methodology to deliver high-quality software releases every2 weeks through Sprints. 

WHO WILL YOU WORK WITH

Requirements

WHAT YOU BRING

We are looking for best-in-class talent thatbrings the following key skills and experience to this role:

·Minimum Bachelor's degree in IT orrelated field.

·One of the following alternatives maybe accepted: PhD or Law 3 years; Masters 4 years; Associates 6 years;High School 7 years exp.

·7 years' of experience with detailedknowledge of data warehouse technical architectures, infrastructure components,ETL/ ELT, and reporting/analytic tools.

·3 years’ experience in DatabricksLakehouse Platform

·4 years’ experience in Big Data stackenvironments (Hadoop, SPARK, Hive& Delta Lake)

·4 years' working with multiple fileformats (Parque, Avro, Delta Lake) & API

·3 years' experience in cloudenvironments like AWS (Serverless technologies like AWS Lambda, API Gateway,NoSQL like Dynamo, EMR & S3)

·Experience with relational andnon-relational SQL

·Proven experience in coding languageslike Python, Scala & Java

·Have experience in building real-timestreaming data pipelines.

·Experience in pub/sub modes like Kafka

·Solid grasp of data structures andalgorithms

·Experience building lambda, kappa,microservice and batch architecture.

·Experience working on CI/CD processesand source control tools such as GitHub and related dev processes