What are the responsibilities and job description for the Senior GCP Data Engineer position at Prodapt?
Overview
Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, we serve telecom and tech companies that are building networks and shaping the digital experiences of tomorrow. We deliver consulting, managed services, and business reengineering. Our strength comes from being both AI-first and Telco-native. Gartner recognizes Prodapt as a Large, Telecom-Native Regional IT Service Provider. This expertise allows us to provide tailored solutions that directly address industry challenges. Our focus is on being a customer-centric partner, fully aligning with our client's business goals and driving their success at every step. With over 6,000 Prodaptians across 30 countries and backed by the 130-year legacy of the Jhaver Group, Prodapt combines a heritage of excellence with cutting-edge innovation.
We are seeking an experienced Senior Data Engineer with strong expertise in Google Cloud Platform (GCP), Hadoop ecosystem, and data engineering R&D. The ideal candidate will design, build, and optimize large-scale data pipelines, perform advanced research on emerging technologies, and ensure data solutions are scalable, secure, and high-performing.
Responsibilities
Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, we serve telecom and tech companies that are building networks and shaping the digital experiences of tomorrow. We deliver consulting, managed services, and business reengineering. Our strength comes from being both AI-first and Telco-native. Gartner recognizes Prodapt as a Large, Telecom-Native Regional IT Service Provider. This expertise allows us to provide tailored solutions that directly address industry challenges. Our focus is on being a customer-centric partner, fully aligning with our client's business goals and driving their success at every step. With over 6,000 Prodaptians across 30 countries and backed by the 130-year legacy of the Jhaver Group, Prodapt combines a heritage of excellence with cutting-edge innovation.
We are seeking an experienced Senior Data Engineer with strong expertise in Google Cloud Platform (GCP), Hadoop ecosystem, and data engineering R&D. The ideal candidate will design, build, and optimize large-scale data pipelines, perform advanced research on emerging technologies, and ensure data solutions are scalable, secure, and high-performing.
Responsibilities
- Data Engineering & Architecture
- Design and implement data pipelines for batch and streaming using GCP services (BigQuery, Dataflow, Pub/Sub, Dataproc).
- Develop and maintain Hadoop-based solutions (Hive, HBase, Spark, Oozie).
- Optimize data storage and retrieval for structured and unstructured data.
- R&D and Innovation
- Research and prototype new data processing frameworks, cloud-native architectures, and performance optimization techniques.
- Evaluate emerging technologies (e.g., AI/ML integration, real-time analytics) for adoption.
- Performance & Scalability
- Tune BigQuery queries and Hadoop clusters for cost and performance efficiency.
- Implement in-memory caching strategies (e.g., Memorystore/Redis) for low-latency access.
- BS or MS in CS/ECE or related 10 years of experience in data science and data engineering.
