What are the responsibilities and job description for the Data Engineering Lead – Data, Cloud & AI position at TheStaffed?
Our client is seeking a Data Engineering Lead – Data, Cloud & AI to architect and deliver modern cloud-based data platforms supporting analytics, AI, and machine learning workloads. This is a senior hands-on engineering role combining deep data engineering expertise with cloud and AI platform leadership.
Responsibilities & Qualifications
- Contribute to and validate data and analytics architecture
- Establish engineering standards and best practices across data platform initiatives
- Design and build scalable data platforms using cloud-native services
- Implement ingestion, transformation, and orchestration pipelines
- Implement and support Data Product frameworks
- Optimize platform performance and cost efficiency
- Implement Infrastructure-as-Code and CI/CD pipeline integrations
- Enable observability, reliability, and containerized workload standards
- Enable ML pipelines and support model deployment and monitoring
- Collaborate with data scientists and architects on feature engineering workflows
Requirements
- 10 years of data engineering experience
- Strong Python and SQL skills
- Experience with GCP data services (BigQuery, Dataflow, Vertex AI, Pub/Sub)
- Experience with Snowflake or Databricks
- Knowledge of ML workflows and platform engineering
- Experience with streaming architectures
- Experience with DevOps, automation, and Infrastructure-as-Code
- Familiarity with AI/LLM code assist tools
- Strong understanding of modern data modeling approaches