What are the responsibilities and job description for the Data Engineer position at Haystack?
Data Engineer | Dothan, United States | On-site | $90,000 – $125,000 per year
We're working with a leading consulting and recruiting firm specializing in connecting top-tier IT professionals with diverse business needs, ranging from Fortune 500 companies to growing enterprises. They are renowned for their ability to deliver effective, customized solutions for time-sensitive initiatives, fostering long-term strategic partnerships.
The Role
We're working with a leading consulting and recruiting firm specializing in connecting top-tier IT professionals with diverse business needs, ranging from Fortune 500 companies to growing enterprises. They are renowned for their ability to deliver effective, customized solutions for time-sensitive initiatives, fostering long-term strategic partnerships.
The Role
- Design, develop, and maintain robust data pipelines for efficient real-time and batch processing.
- Implement ETL/ELT processes and data integration strategies.
- Ingest data from various sources (SQL databases, APIs, cloud platforms, flat files) into data warehouses or data lakes.
- Monitor and optimize data integration processes and applications for performance.
- Ensure data quality and consistency within the data warehouse.
- Develop custom integrations and transformations using SQL and/or Python.
- 5 years of experience in designing and/or implementing ETL/ELT processes and data integration.
- Solid understanding of data warehousing concepts, ETL processes, and data modeling techniques.
- Experience with integration tools such as Qlik, Talend, Informatica, or SSIS.
- Strong understanding of data governance, MDM, metadata management, and data quality frameworks.
- Proven ability to communicate complex technical concepts effectively to both technical and non-technical stakeholders.
- Must be a US Citizen or Green Card holder.
- Competitive salary between $90,000 to $125,000 per year.
- Comprehensive benefits package including healthcare, insurance, and 401k.
- Holiday, vacation, and PTO benefits.
- Opportunities to work on diverse projects with various clients.
Salary : $90,000 - $125,000