What are the responsibilities and job description for the Data Engineer position at Sharpedge Solutions?
Data Engineer
12 Month contract
Location - Holmdel, NJ -Hybrid
who is a self-starter, fueled by collaboration, able to transform conceptual designs into reliable, scalable processes that meet or exceed customer needs. A person should be very good at analytical, problem solving and troubleshooting data pipelines root cause analysis and resolutions. Working with various Development team, Technology partners and business stakeholders to deliver unified and timely support, while upholding quality and resolution standards to fulfil the operational needs of our business stakeholders.
Person should have
- 10 Years of IT experience, with 7 years of experience as an ETL/ELT developer/data engineer.
- 3 years of Databricks data engineering experience (Databricks Data Engineer and/or Spark Developer certification preferred)
- Knowledge in GitHub, Jenkins, Informatica
- Working knowledge of the Finance or Insurance industry
- Expert in AWS Databricks, Python, Spark
- Strong SQL, and UNIX Shell scripting experience
- Performance tuning data pipelines, track record communicating issues & follow-up through issue resolution.
- Production Support for applications, monitor production jobs, triage issues to appropriate team & resolve any issues in a timely manner.