What are the responsibilities and job description for the Senior Data Platform Engineer position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, EITAcies, Inc., is seeking the following. Apply via Dice today!
Job Description
We are hiring a Senior Data Platform Engineer for an onsite role in Austin, TX
This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.
Key Responsibilities:
Job Description
We are hiring a Senior Data Platform Engineer for an onsite role in Austin, TX
This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.
Key Responsibilities:
- Design and maintain Airflow DAGs for production data workflows
- Develop and optimize Spark / PySpark jobs on Dataproc
- Build and optimize complex SQL transformations
- Develop REST APIs using FastAPI Python to support data services
- Implement robust data quality and validation frameworks
- Monitor pipeline performance, retries, and SLA compliance
- 6 years of data engineering experience
- Strong Python programming skills
- Production experience with Apache Spark PySpark
- Experience with Airflow DAG development
- Hands-on experience with Google Cloud Platform (Dataproc, BigQuery, Cloud Storage preferred)
- Experience building APIs using FastAPI
- Strong SQL and data modeling knowledge
- Experience implementing data quality checks (schema validation, row count checks, anomaly detection)