What are the responsibilities and job description for the Sr Data Engineer position at The Walt Disney Company?
The Senior Data Software Engineer will create data ingestion pipelines including workloads and applications inside AWS. Implements, troubleshoots, and optimizes distributed solutions based on big data technologies like SQL, S3, Glue, MSK, Snowflake and Redshift to solve large scale processing problems in a Cloud DW environment. Designs syndicated and curated data views that will be used for reporting, analytics, and advanced applications. Apply technical expertise and mathematical concepts to challenging programming problems. Strong communication, interpersonal, and collaboration skills, including the ability to work effectively in an agile / scrum environment.
What You'll Do
What You'll Do
- Design and develop data pipelines in AWS & Snowflake
- Design and develop data views, assist with architecture decisions, deployment, and feedback.
- Strong knowledge and practical experience with AWS Services (CDK, CloudFormation, Kinesis, Lambda, SQS, SNS, S3, EC2)
- Ability to debug and troubleshoot across a broad technical stack.
- Product ownership and strong business support in enterprise level theme park related environment.
- Working with a variety of business partner groups across Disney Parks and Resorts to implement optimal technical solutions.
- Provide data and system analysis needed for feature engineering.
- Minimum of 5 years of years of experience in data engineering with SQL in a Data Warehouse environment
- Strong knowledge of Python and object-oriented programming concepts.
- Experience building data pipelines and complex data transformations.
- 5 years of experience with AWS S3, Glue, MSK, Redshift, Spark, and related tools
- Solid working experience with Snowflake native objects like SnowPipe, external/internal stages, external tables, integration objects, stored procedures (Snowflake Scripting), stream & task, data masking, time traveland cloning.
- Working knowledge of Data Build Tool (DBT)
- 5 years of experience in software development in an agile environment.
- Production experience with DevOps Tools like: Terraform or CDK.
- Strong conceptual understanding of security at rest and in transit for big data pipelines.
- Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in complex situations.
- Strong systems and data analysis skills, and experience with testing in data space.
- Strong domain knowledge of ticketing and entitlement systems. Hands-on experience with architecture, design, data models, eventing infrastructure, and implementation details
- Bachelor’s Degree in Computer Science, Distributed Computing, Machine Learning, Mathematics or related field
Salary : $135,200 - $181,200