What are the responsibilities and job description for the Data Engineer position at Haystack?
A world-class IT services company that serves thousands of clients globally, this organization values innovation, collaboration, and continuous learning, offering quality career resources, training, certifications, and development opportunities.
The Role
The Role
- Design and build ELT pipelines within Google Cloud Platform (GCP)
- Develop scalable data ingestion and transformation processes
- Utilize Composer, Dataflow, BigQuery, SQL, and Python for data movement and orchestration
- Contribute to the building and enhancement of a new enterprise data platform
- Collaborate with architects, analysts, and senior engineers on platform design and implementation
- Ensure the data quality, performance, and scalability of pipelines
- Bachelor's degree in Computer Science or a related field, or equivalent experience
- 2-4 years of hands-on experience building solutions in Google Cloud Platform (GCP)
- Proficiency in SQL and Python
- Experience with Composer, Dataflow, and BigQuery
- Ability to transition abstract concepts into stable and supportable software solutions
- Strong problem-solving and analysis skills
- Opportunity to work on a new Google Cloud Platform-based data platform
- Access to quality career resources, training, and certifications
- Comprehensive benefits package and development opportunities
- A supportive environment that values continuous learning