What are the responsibilities and job description for the Senior AWS Data Engineer-Cloud Data Engineer position at IPolarity LLC?
Senior AWS Data Engineer / Cloud Data Engineer
Hybrid 3 days/week in Newark, NJ.
Job Summary
We are seeking a highly skilled Senior AWS Data Engineer to design, develop, and maintain scalable cloud-based data solutions. The ideal candidate will have strong experience building AWS data platforms, data pipelines, ETL/ELT solutions, and CI/CD automation using modern DevOps practices.
Responsibilities
- Design, develop, and maintain scalable data pipelines and enterprise data platforms on AWS.
- Build end-to-end data solutions including data ingestion, storage, processing, integration, and access.
- Develop ETL/ELT workflows and automated pipelines from databases, file systems, APIs, and other data sources into AWS data platforms.
- Design and implement AWS data lake and data warehouse solutions using services such as S3, Glue, Athena, EMR/Spark, Redshift, RDS, Lambda, Step Functions, and Lake Formation.
- Build and maintain CI/CD pipelines using Jenkins, CloudBees, CloudFormation, and DevOps tools.
- Develop secure, reliable, and high-performing applications using Python, SQL, and Shell scripting.
- Implement data security and access controls using AWS IAM and Redshift RBAC.
- Participate in architecture discussions, code reviews, troubleshooting, and Agile development activities.
- Collaborate with product, QA, and engineering teams to deliver enterprise data solutions.
Required Qualifications
- Bachelor’s degree in Computer Science, Software Engineering, MIS, or equivalent experience.
- 8 years of experience as a Data Engineer with strong AWS cloud experience.
- AWS Solutions Architect or AWS Developer certification required.
- Strong hands-on experience with AWS services including:
- S3, Glue, Athena, EMR/Spark, Redshift, RDS/Aurora, DynamoDB
- Lambda, Step Functions, IAM, KMS, Secrets Manager
- EventBridge, CloudWatch, CloudTrail, Lake Formation, DataSync, DMS
- Experience building AWS data lakes, data warehouses, and scalable data pipelines.
- Strong programming skills in Python, SQL, and Shell scripting.
- Experience with DevOps practices, CI/CD pipelines, Jenkins, CloudFormation, and Infrastructure as Code.
- Experience with source control tools such as Bitbucket and collaboration tools such as Jira and Confluence.
- Experience with Docker, SonarQube, Artifactory, and build tools such as Maven/Gradle is preferred.
Preferred Skills
- Experience with real-time streaming solutions using Amazon Kinesis, AWS Managed Kafka, and Managed Airflow.
- Experience working in Agile/Scrum environments.
- Strong problem-solving, communication, and collaboration skills.