What are the responsibilities and job description for the Senior Data Engineer – AWS Infrastructure Automation position at Jobright.ai?
Verified Job On Employer Career Site
Job Summary:
Amazon Data Services, Inc. is seeking a Senior Data Engineer to join their AWS Infrastructure Services team. This role focuses on developing and maintaining automated ETL pipelines and analytics infrastructure to support internal business customers and enhance data management practices.
Responsibilities:
• Develop and maintain automated ETL pipelines (with monitoring) using scripting languages such as Python, Spark, SQL and AWS services such as S3, Glue, Lambda, SNS, SQS, KMS.
• Implement and support reporting and analytics infrastructure for internal business customers.
• Develop and maintain data security and permissions solutions for enterprise scale data warehouse and data lake implementations including data encryption and database user access controls and logging.
• Develop data objects for business analytics using data modeling techniques.
• Develop and optimize data warehouse and data lake tables using best practices for DDL, physical and logical tables, data partitioning, compression, and parallelization.
• Develop and maintain data warehouse and data lake metadata, data catalog, and user documentation for internal business customers.
• Work with internal business customers and software development teams to gather and document requirements for data publishing and data consumption via data warehouse, data lake, and analytics solutions.
Qualifications:
Required:
• 5 years of data engineering experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience with SQL
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
• Experience mentoring team members on best practices
Preferred:
• Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
• Experience operating large data warehouses
Company:
Amazon is a tech firm with a focus on e-commerce, cloud computing, digital streaming, and artificial intelligence. Founded in 1994, the company is headquartered in Seattle, Washington, USA, with a team of 10001 employees. The company is currently Public Company. Amazon has a track record of offering H1B sponsorships.
