What are the responsibilities and job description for the Databricks Data Engineer AWS - Hybrid position at TechTriad?
USC or GC ONLY
Locals ONLY
NO Vendors
Summary:
Seeking a Senior Data Engineer to design, build, and optimize large-scale data systems powering machine learning and analytics. The role focuses on developing the Feature Store, building robust data pipelines, and ensuring scalable, efficient performance across Databricks and AWS environments.
Responsibilities:
- Build and optimize pipelines using Databricks (PySpark, Delta Lake, SQL) and AWS (S3, Glue, EMR, Lambda, Kinesis)
- Develop and maintain a centralized Feature Store
- Support model deployment, CI/CD, and data quality frameworks
- Collaborate with data scientists and ML engineers to productionize ML workflows
Qualifications:
- 7–10 years in Data engineering or distributed systems
- Expertise with Databricks and AWS
- Strong skills in Python (preferred), Scala, or Java
- Experience with Feature Stores, ML pipelines, and CI/CD
Preferred:
Experience with Unity Catalog, MLflow, Airflow, Kubernetes, and data observability tools