What are the responsibilities and job description for the Data Engineer with PySpark, AWS (14 yrs exp min) position at DataAffect?
Role: Senior Data Engineer PySpark, AWS
Location: Charlotte, NC
Duration: 12 months
Required Qualifications
- Minimum 14 years in data engineering with 8 years hands-on PySpark/Spark
- Deep expertise in AWS data services: EMR, Glue, S3, Redshift, Kinesis, Lambda, IAM
- Strong Python and SQL skills. Experience with Scala is a plus
- Expert in data modeling, partitioning strategies, and distributed computing concepts
- Solid understanding of data governance, security, and compliance: encryption, Lake Formation, RBAC
- Experience leading teams and driving architecture decisions in complex environments
Salary : $70 - $72