What are the responsibilities and job description for the GCP DATA PLATFORM ENGINEER position at capgemini?
We are building a hybrid data platform that bridges an on premises big data cluster with Google Cloud Platform and we need an engineer who can own this integration end to end This role is central to establishing a repeatable production grade pattern for multitenant data platform architecture starting with GCP as the first cloud tenant on an existing on prem Cloudera cluster You will configure the foundational infrastructure service accounts Iceberg table formats metadata catalog integration via Apache Gravitino and role based access controls
Key responsibilities:
Configure and provision the on premises Cloudera cluster environment including service account creation role definitions and permission structures for multitenant access
Design and implement Apache Iceberg table structures optimized for hybrid on-prem cloud workloads
Integrate the Iceberg REST Catalog IRC with Apache Gravitino to establish a unified metadata layer across on prem and GCP environments
Establish GCP as a production tenant on the existing on prem Cloudera cluster validating the end to end architecture pattern
Define and enforce data access governance including role based permissions and service account security policies across both environments
Drive the full lifecycle from environment setup through to production deployment
Publish comprehensive documentation and architectural blueprints covering cross platform interoperability best practices vendor recommendations and access patterns for hybrid data lake implementations
Requirements:
5 years of relevant experience in data platform engineering
Hands-on experience with Google Cloud Platform GCP
Experience with onpremises Cloudera big data clusters
Experience with Apache Iceberg table format
Experience with Iceberg REST Catalog IRC
Experience with Apache Gravitino for metadata catalog integration
Experience with service account creation and role based access control in hybrid environments
Skills required:
Google Cloud Platform Cloudera Apache Iceberg Iceberg REST Catalog Apache Gravitino Service Account Management Role Based Access Control Hybrid Data Platform Architecture Multi Tenant Data Platform
Experience:
5 years
From the Client:
Setup DPC environment create a service account Iceberg tables IRC with Gravitino DPC roles and permissions existing DPC cluster with GCP as one of the tenants to establish this pattern and take it all the way to production
Setup GCP environment create a service account Iceberg tables IRC GCP IAM roles and permissions existing GCP project GDWdev4 project to establish this pattern and take it all the way to production
Get IRC from DPC and GCP to sync with each other it can be one or more IRC from DPC and GCP
DPC and GCP platform should have the ability
Establish the pattern on interoperability for data access between DPC and GCP for Iceberg tables
Put the governance and guardrails around this access patterns and persona mapping on GCP side
Publish document and blueprints on this cross platform interoperability best practices vendor recommendations and access patterns
The pay range that the employer in good faith reasonably expects to pay for this position is $43.46/hour - $67.90/hour. Our benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis.
Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.
Salary : $43 - $68