Job Description Advance Auto Business Support LLC is seeking a Data Engineer reporting to its Raleigh, NC location. Job Description: Responsible for the design and development of ETL data pipelines in AWS platform, using Python, Pyspark, Lambda, Glue Dynamo DB, and Talend. Build common frameworks and data models for loading data from various sources in On-Prem or Cloud using Snowflake, SQL, and additional AWS technology components. Build data pipelines and applications to stream and process datasets at low latencies. Fetch data from event-based streaming (e.g. Kafka or MQ) to be consumed within the Data Lake. Design and develop code to wrangle small and large volume datasets into raw and cleansed zones. Design an develop methods for the conversion of multiple data formats (CSV, XML, JSON, etc) into a common Parquet format for optimization with output formats as needed by the stakeholder community. Design and implement batch and stream data processing pipelines, how to optimize, and partition of data structures. Maintain and operate continuous build, test, and integration pipelines. Deploy codes to AWS environments using Terraform and CI/CD frameworks. Work with stakeholders, products, data, and design teams for technical specifications, as well as design recommendations and support. Collaborate with data engineering team, subject matter experts, and enterprise architects on new capabilities as needed. Participate in staff meetings and Scrum calls for projects. Position allows for telecommuting from home from anywhere within the United States. Minimum Requirements: Bachelor’s degree in Computer Science, Computer Engineering, Technology Management, Electronics Engineering, or related technical field of study and three (3) years of experience in data architecture or software development related position. The position requires three (3) years of experience with the following skills: ETL tools (Talend), data modeling, and architecture; ETL optimization; designing, coding, and tuning big data processes using Apache Spark or similar technologies; Big data technologies (Spark/Hive); operating very large data warehouses or data lake; CI/CD concepts related to deploying data pipelines to higher environments; IAM, AWS Networking related services and access controls; On-premise to cloud migrations and IT Transformations; and distributed systems and data architecture (Lambda). Foreign degree equivalent accepted. How to Apply: Resumes to: recruiting@advance-auto.com. 4885-8103-5434, v. 1 California Residents click below for Privacy Notice: http://www.worldpaccareers.com/uploads/2/4/0/4/24047148/advance_auto_parts_--_california_candidate_privacy_notice.pdf At Advance Auto Parts we have a passion for YES. Each day we are motivated by a passion to help our Customers. We have a commitment to advance the lives of our fellow Team Members, Customers, and the Communities where we live and work. When you join our team, you become one of more than 70,000 knowledgeable and experienced Team Members who take pride in providing outstanding customer service to our customers, communities and each other every day. With over 5,100 stores in the United States, Canada, Puerto Rico and Virgin Islands, we are a leading automotive aftermarket parts provider. With opportunities ranging from our front lines in our Stores to our Distribution Centers to our Corporate Support Center and our rapidly growing Professional Business, we have the career for you.