What are the responsibilities and job description for the Sr Data Engineer position at Client Resources, Inc.?
Senior Data Engineer, Contract to Hire
Experienced Senior Data Engineer to design, develop, and optimize scalable data solutions that support business intelligence, analytics, and enterprise data needs. This role is ideal for a hands-on engineer who enjoys working with complex data, building reliable pipelines, and improving the way data moves throughout an organization.
The ideal candidate will bring strong SQL and Python expertise along with hands-on experience using DataStage and dbt to develop, transform, and maintain high-quality data solutions.
Key Responsibilities
Experienced Senior Data Engineer to design, develop, and optimize scalable data solutions that support business intelligence, analytics, and enterprise data needs. This role is ideal for a hands-on engineer who enjoys working with complex data, building reliable pipelines, and improving the way data moves throughout an organization.
The ideal candidate will bring strong SQL and Python expertise along with hands-on experience using DataStage and dbt to develop, transform, and maintain high-quality data solutions.
Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL/ELT processes.
- Develop and optimize complex SQL queries, stored procedures, and data transformations.
- Use Python to automate data processes, develop integrations, and support data engineering workflows.
- Develop and maintain ETL solutions using IBM DataStage.
- Build and manage data transformation workflows using dbt.
- Integrate data from multiple sources while ensuring accuracy, reliability, and performance.
- Troubleshoot data pipeline issues and identify opportunities to improve efficiency and scalability.
- Partner with analysts, developers, architects, and business stakeholders to understand data requirements and deliver effective solutions.
- Support data quality, testing, documentation, and engineering best practices.
- Mentor team members and contribute to the continued improvement of data engineering standards and processes.
- 7 years of experience in data engineering, data development, or a related field.
- Advanced SQL skills with experience working with large and complex datasets.
- Strong hands-on Python development experience.
- Experience designing and developing ETL processes using IBM DataStage.
- Hands-on experience with dbt for data transformation and modeling.
- Strong understanding of ETL/ELT concepts, data pipelines, data modeling, and data integration.
- Experience troubleshooting and optimizing data processes for performance and reliability.
- Strong problem-solving, communication, and collaboration skills.
- Ability to work independently while contributing effectively within a cross-functional team.