What are the responsibilities and job description for the Data Engineer position at Haystack?
We're hiring on behalf of a Haystack partner!
The Role
The Role
- Work closely with business, IT, Analyst and Data Science groups to collect business requirements
- Develop, deploy, and support high-performance inbound and outbound data pipelines
- Optimize data pipelines for performance, scalability, and reliability
- Ensure quality of critical data elements and prepare data quality remediation plans
- Document the design and support strategy of data pipelines
- Troubleshoot and resolve data engineering issues as they arise
- Bachelor's Degree in Computer Science, Computer Engineering, Software Engineering, or related technical field
- Three (3) plus years of experience in building data lakes and cloud data platforms
- Experience working with GCP technologies like BigQuery, Composer, GCS, DataStream, Dataflows
- Expert knowledge of SQL and Python programming
- Experience working with Airflow as a workflow management tool
- Experience in tuning queries for performance and scalability
- Health, dental, vision, life, and disability insurance
- 401k Retirement Program 6% employer match
- Flexible Time Off (FTO) Policy
- 12 Paid Holidays
Salary : $74,065 - $133,902