What are the responsibilities and job description for the AWS Data Engineer Data Platforms (Databricks) : Reston, VA (Local only) position at Lightning Minds Inc.?
AWS Data Engineer Data Platforms (Databricks)
Reston, VA (Local only)
13 years experience
Job Summary
We are seeking a seasoned Data Platform Infrastructure Engineer with strong AWS cloud expertise and handson experience in Databricks, EMR, and Glue. The role involves designing, building, and maintaining secure, scalable, and productionready data platforms across development, test, and production environments.
Required Skills
- 6 years in AWS cloud & modern data platforms
- Strong Python & PySpark development experience
- Handson Databricks platform management
- AWS services: EC2, Lambda, S3, EFS, Glue, EMR, CloudWatch, IAM
- Infrastructure automation (Terraform), CI/CD (GitLab)
- Monitoring, governance, resiliency, and optimization
- Familiarity with AIassisted development tools
Responsibilities
- Design, implement, and manage AWSbased data platform infrastructure
- Provision & support EMR, Glue, and Databricks environments
- Configure secure networking, encryption, and access controls
- Manage IAM roles, secrets, and platform security
- Automate deployments with Terraform & support CI/CD pipelines
- Establish monitoring, alerting, and operational processes
- Ensure resiliency, disaster recovery, and cost/performance guardrails