What are the responsibilities and job description for the Data Engineer (Python, Spark, GCP, PySpark) - Locals only & No c2c position at Redolent, Inc?
We are actively looking for a Data Engineer In Sunnyvale CA
TITLE: Data Engineer (Spark, Python, GCP, Airflow)
LOCATION: Sunnyvale CA
FT
Salary: DOE
Visa Elegibility: EAD, GC, USC, TN
NO c2c
Key skills - Apache Spark, Python, GCP, BigQuery, Dataflw, Airflow,
Description:
- 5 years of experience in Data engineering build, and maintain robust data pipelines using Apache Spark and Python.
- Develop and manage workflow orchestration using Apache Airflow.
- Implement scalable data solutions on Google Cloud Platform (GCP) using services like BigQuery, Cloud Storage, Dataflow, and Vertex AI. collaborate with data scientists to embed machine learning models into production-grade data pipelines. Ensure high performance, reliability, and scalability of data systems.
- Monitor, troubleshoot, and optimize data workflows and ML model performance.
- Maintain documentation and follow best practices for version control, testing, and deployment.