What are the responsibilities and job description for the AWS Data Engineer - Reston, VA(Onsite) position at Sage IT Inc?
Role: AWS Data Engineer
Location: Reston,VA (Onsite)
Qualifications (Data Engineer/ Python Developer)
- 10 years hands-on Python development experience for big data application.
- Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.
- Strong development experience in AWS platforms/services such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.
- Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.
- Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.
- Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.
- Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusions
- Collaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organization
- Possess strong analytical and problem-solving skills
Skills:
- Required 10 years of Python development experience for big data application
- Required 5 years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, Glue
- Required 5 years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization
- Hands on experience with CI/CD pipeline tools such as Gitlab/Terraform