What are the responsibilities and job description for the Big Data Engineer (Java & GCP) position at NucleusTeq?
Job Description-
We are looking for a skilled Big Data Engineer with strong expertise in cloud data platforms and large-scale data processing. The ideal candidate will design, build, and optimise scalable data pipelines using Google Cloud services and Big Data technologies, ensuring efficient data processing, storage, and analytics.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on Google Cloud Platform.
- Work extensively with GCS, Dataproc, BigQuery, and Composer (Airflow) for data ingestion, processing, orchestration, and analytics.
- Experience in Java is a must.
- Ensure data quality, reliability, and performance through monitoring and optimization.
- Collaborate with data analysts, architects, and business stakeholders to understand requirements and deliver data solutions.
- Implement best practices in data engineering, including data governance, security, and cost optimisation.
- Troubleshoot performance bottlenecks and provide scalable solutions.
- Maintain documentation for pipelines, workflows, and system architecture.
Required Skills & Qualifications
- 5 years of experience in Big Data engineering and cloud-based data platforms.
- Strong hands-on experience with Google Cloud Platform (GCS, Dataproc, BigQuery, Composer/Airflow).
- Solid understanding of ETL/ELT processes, data warehousing, and data modelling.
- Experience with workflow orchestration tools and pipeline automation.
- Good knowledge of SQL, scripting languages, and performance tuning.
- Strong analytical, problem-solving, and communication skills.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on Google Cloud Platform.
- Work extensively with GCS, Dataproc, BigQuery, and Composer (Airflow) for data ingestion, processing, orchestration, and analytics.
- Experience in Java.
- Ensure data quality, reliability, and performance through monitoring and optimization.
- Collaborate with data analysts, architects, and business stakeholders to understand requirements and deliver data solutions.
- Implement best practices in data engineering, including data governance, security, and cost optimisation.
- Troubleshoot performance bottlenecks and provide scalable solutions.
- Maintain documentation for pipelines, workflows, and system architecture.
Required Skills & Qualifications
- 5 years of experience in Big Data engineering and cloud-based data platforms.
- Strong hands-on experience with Google Cloud Platform (GCS, Dataproc, BigQuery, Composer/Airflow)..
- Solid understanding of ETL/ELT processes, data warehousing, and data modelling.
- Experience with workflow orchestration tools and pipeline automation.
- Good knowledge of SQL, scripting languages, and performance tuning.
- Strong analytical, problem-solving, and communication skills.
Why Join Us?
- Work in an innovative environment with the business that is shaping the future of data migration.
- Be part of a dynamic, high-growth environment at NucleusTeq.
- Competitive salary and comprehensive benefits package.
Salary : $5