What are the responsibilities and job description for the Data Platform Engineer – Private Cloud / Kubernetes position at VeeAR Projects Inc.?
Overview:
We are seeking a highly skilled Data Platform Engineer to support the buildout and enablement of a large-scale data private cloud platform supporting enterprise data analytics workloads. This platform will support 70 tenants and is a critical component of a broader data center migration initiative.
This role will focus primarily on core platform engineering while also supporting tenant enablement, observability, and security controls to ensure the environment is scalable, secure, and production-ready.
Key Responsibilities:
- Design and build a scalable data private cloud platform leveraging Kubernetes and OpenShift.
- Configure and integrate platform components, including compute, storage, and networking layers, and support object storage and execution engines where applicable.
- Support environment buildout in preparation for enterprise data center migration, including configuration of foundational infrastructure such as firewalls and load balancing in collaboration with network teams.
- Ensure platform readiness to support multi-tenant data workloads.
- Enable onboarding of 70 tenant applications onto the platform by defining access models, resource allocation, and environment setup.
- Collaborate with stakeholders to ensure tenants can successfully adopt and use the platform.
- Design and implement observability frameworks, including monitoring, alerting, and dashboards.
- Develop automation solutions to support platform provisioning, deployments, and ongoing operations.
- Implement and maintain platform-level security and compliance controls, ensuring alignment with enterprise policies and supporting enforcement of extensive data and technical controls.
- Partner with cross-functional teams, including networking, security, and infrastructure, to support delivery, solutioning, and requirements definition.
- Support acceleration of deliverables across both platform buildout and tenant enablement based on capacity needs.
Required Skills & Experience
- Strong experience with Kubernetes, preferably OpenShift.
- Strong Linux experience.
- Experience building and configuring enterprise platforms from the ground up.
- Experience designing and implementing observability solutions across platforms.
- Hands-on experience with tools such as Grafana, Prometheus, BigPanda, PagerDuty, or ThousandEyes.
- Experience with automation tools, including Terraform and Helm.
- Experience with GitOps practices, preferably Argo CD.
- Experience using ServiceNow.
Preferred Experience
- Kubernetes or OpenShift preferred.
- Object Storage.
- Execution Engines such as Spark or Trino.
- Table formats such as Iceberg or Hive.
- Metadata Lineage tools, such as Datahub.
- Observability tools, including Grafana, Prometheus, BigPanda, PagerDuty, ThousandEyes, alert, and dashboard design.
- ServiceNow.
- Automation tools, including Terraform, Helm, and GitOps with Argo CD preferred.
Good to Have:
- Experience with OpenShift ingress and egress control, including design and enforcement of secure north-south traffic patterns.
- Experience with load balancing and traffic routing for internal and external services with high availability.
- Experience with network segmentation and isolation across tenants, namespaces, and environments in multi-tenant platforms.
- Experience with Kubernetes or OpenShift Network Policies, including default deny and least privilege communication controls.