What are the responsibilities and job description for the Mid-Level Google Cloud Platform Data Engineer position at Haystack?
This rapidly growing global leader in technology services and talent solutions, with a strong presence across North America, Europe, and Asia, is seeking a talented individual to join their team. They partner with clients to activate ideas and solutions, driving business transformation for a diverse portfolio of over 6,000 clients, including many Fortune 500 companies.
The Role
The Role
- Develop and maintain data pipelines using Spark, PySpark, Python, and Kafka
- Design and implement real-time streaming solutions with Spark Streaming and Flink
- Migrate on-prem data and workloads to Google Cloud Platform (GCP)
- Work extensively with GCP services such as BigQuery, Cloud Composer, Data Proc, and Cloud Storage
- Translate technical requirements into architecture, design, and deployment deliverables
- Collaborate with internal teams, architects, and stakeholders to support platform enablement
- 3 years of experience in Data Engineering, including hands-on experience with Hadoop and Google Cloud Data Solutions
- Proficiency with GCP Data Services: BigQuery, Cloud Storage, Data Proc, Cloud Composer
- Experience with migrating data from on-prem environments to GCP
- 2 years of real-time processing experience using Kafka, Flink, and Spark Streaming
- 3 years of experience with data lakes and Python development
- Ability to convert requirements into scalable technical designs and perform production deployments
- Opportunity to work on a large-scale migration project to GCP
- Exposure to cutting-edge data engineering technologies
- A collaborative team setting focused on innovation and modernization
- Competitive hourly compensation package
Salary : $38 - $40