What are the responsibilities and job description for the Lead Data Engineer position at Strategic Staffing Solutions?
Job Title: Lead Data Engineer (Finance Data Aggregator Support)
Location: Charlotte, NC (Hybrid)
Pay: $80/hr - W2 ONLY
Duration: 24 Months
Job Summary:
We are seeking a Lead Data Engineer (P4 level contractor) to support the Finance Data Aggregator (CADS) project. This role will focus on building out the Conformance Layer on DPC (Data Processing Cloud) for all Finance-related use cases. The ideal candidate will have deep expertise in data engineering, strong development skills in ETL pipelines using PySpark, and advanced SQL capabilities.
Key Responsibilities:
- Lead the development of ETL pipelines utilizing the PySpark framework.
- Support the build-out of the Conformance Layer on DPC specifically for Finance data use cases.
- Design, develop, and optimize complex data workflows to support Finance applications.
- Ensure data quality, consistency, and governance within the new Conformance Layer.
- Work closely with Finance stakeholders and technical teams to gather requirements and translate them into scalable technical solutions.
- Troubleshoot, optimize, and enhance data processes as needed.
Required Experience and Skills:
- Proven experience in data engineering roles, particularly with ETL pipeline development.
- Expertise in PySpark for big data processing.
- Deep and advanced knowledge of SQL for querying, transformation, and optimization.
- Experience supporting financial systems or projects involving Finance data aggregation.
- Strong problem-solving skills with the ability to lead initiatives independently.
Salary : $80
