What are the responsibilities and job description for the AWS Data Engineer position at Matlen Silver?
We are seeking a skilled AWS Data Engineer to join our team. The ideal candidate will design, build and maintain scalable data pipelines and infrastructure on AWS to support data driven decision making. You will collaborate with architects, analysts and software engineers to ensure efficient data flow and accessibility across the organization.
Key Responsibilities:
• Design, develop and maintain data pipelines using AWS services such as AWS Glue, Lamda, S3, Redshift and Athena.
• Build and optimize data models for performance and scalability
• Implement ETL/ELT processes to extract, transform and load data from various sources into AWS data stores
• Ensure data quality, integrity and security by implementing best practices and governance policies
• Monitor and optimize data pipeline performance, ensuring low latency and high availability
• Collaborate with cross-functional teams to understand data requirements and deliver solutions
• Automate data workflows using tools like AWS Step Functions or Airflow
• Implement CI/CD pipelines for data infrastructure deployment
• Stay updates on AWS data services and industry trends to recommend improvements
Required Qualifications:
• Bachelor’s degree in Computer Science, Engineering or related field
• 5 years of experience as a Data Engineer or similar role
• Strong proficiency with AWS services (e.g. S3, Glue, Macie)
• Experience with SQL and NoSQL databases
• Proficiency in programming languages like Python, Terraform, Scala or Java for data processing
• Experience with ETL tools and frameworks (e.g. AWS Glue, Apache Spark)
• Familiarity with data modeling, schema design and data warehousing concepts
• Knowledge of CI/CD practices and version control systems
• Strong problem solving skills and attention to detail
Preferred Qualifications:
• AWS Certification (e.g. AWS Certified Data Analytics, AWS Certified Solutions Architect)
• Experience with big data technologies like Hadoop, Spark or Kafka
• Knowledge of data governance and compliance frameworks
• Experience with IaC tools like Terraform
Primary SkillAmazon Web Services
Desired Skills
NoSQL DB
Tertiary Skill
Spark
Key Responsibilities:
• Design, develop and maintain data pipelines using AWS services such as AWS Glue, Lamda, S3, Redshift and Athena.
• Build and optimize data models for performance and scalability
• Implement ETL/ELT processes to extract, transform and load data from various sources into AWS data stores
• Ensure data quality, integrity and security by implementing best practices and governance policies
• Monitor and optimize data pipeline performance, ensuring low latency and high availability
• Collaborate with cross-functional teams to understand data requirements and deliver solutions
• Automate data workflows using tools like AWS Step Functions or Airflow
• Implement CI/CD pipelines for data infrastructure deployment
• Stay updates on AWS data services and industry trends to recommend improvements
Required Qualifications:
• Bachelor’s degree in Computer Science, Engineering or related field
• 5 years of experience as a Data Engineer or similar role
• Strong proficiency with AWS services (e.g. S3, Glue, Macie)
• Experience with SQL and NoSQL databases
• Proficiency in programming languages like Python, Terraform, Scala or Java for data processing
• Experience with ETL tools and frameworks (e.g. AWS Glue, Apache Spark)
• Familiarity with data modeling, schema design and data warehousing concepts
• Knowledge of CI/CD practices and version control systems
• Strong problem solving skills and attention to detail
Preferred Qualifications:
• AWS Certification (e.g. AWS Certified Data Analytics, AWS Certified Solutions Architect)
• Experience with big data technologies like Hadoop, Spark or Kafka
• Knowledge of data governance and compliance frameworks
• Experience with IaC tools like Terraform
Primary SkillAmazon Web Services
Desired Skills
- AWS Certification (e.g. AWS Certified Data Analytics, AWS Certified Solutions Architect)
- Experience with big data technologies like Hadoop, Spark or Kafka
- Knowledge of data governance and compliance frameworks
- Experience with IaC tools like Terraform
- Bachelor’s degree in Computer Science, Engineering or related field
- 5 years of experience as a Data Engineer or similar role
- Strong proficiency with AWS services (e.g. S3, Glue, Macie)
- Experience with SQL and NoSQL databases
- Proficiency in programming languages like Python, Terraform, Scala or Java for data processing
- Experience with ETL tools and frameworks (e.g. AWS Glue, Apache Spark)
- Familiarity with data modeling, schema design and data warehousing concepts
- Knowledge of CI/CD practices and version control systems
- Strong problem solving skills and attention to detail
NoSQL DB
Tertiary Skill
Spark