You haven't searched anything yet.
Advance Auto Business Support LLC is seeking a Data Engineer reporting to its Raleigh, NC location.
Job Description: Responsible for the design and development of ETL data pipelines in AWS platform, using Python, Pyspark, Lambda, Glue Dynamo DB, and Talend. Build common frameworks and data models for loading data from various sources in On-Prem or Cloud using Snowflake, SQL, and additional AWS technology components. Build data pipelines and applications to stream and process datasets at low latencies. Fetch data from event-based streaming (e.g. Kafka or MQ) to be consumed within the Data Lake. Design and develop code to wrangle small and large volume datasets into raw and cleansed zones. Design an develop methods for the conversion of multiple data formats (CSV, XML, JSON, etc) into a common Parquet format for optimization with output formats as needed by the stakeholder community. Design and implement batch and stream data processing pipelines, how to optimize, and partition of data structures. Maintain and operate continuous build, test, and integration pipelines. Deploy codes to AWS environments using Terraform and CI/CD frameworks. Work with stakeholders, products, data, and design teams for technical specifications, as well as design recommendations and support. Collaborate with data engineering team, subject matter experts, and enterprise architects on new capabilities as needed. Participate in staff meetings and Scrum calls for projects. Position allows for telecommuting from home from anywhere within the United States.
Minimum Requirements: Bachelor’s degree in Computer Science, Computer Engineering, Technology Management, Electronics Engineering, or related technical field of study and three (3) years of experience in data architecture or software development related position. The position requires three (3) years of experience with the following skills: ETL tools (Talend), data modeling, and architecture; ETL optimization; designing, coding, and tuning big data processes using Apache Spark or similar technologies; Big data technologies (Spark/Hive); operating very large data warehouses or data lake; CI/CD concepts related to deploying data pipelines to higher environments; IAM, AWS Networking related services and access controls; On-premise to cloud migrations and IT Transformations; and distributed systems and data architecture (Lambda). Foreign degree equivalent accepted.
How to Apply: Resumes to: recruiting@advance-auto.com.
4885-8103-5434, v. 1
California Residents click below for Privacy Notice:
http://www.worldpaccareers.com/uploads/2/4/0/4/24047148/advance_auto_parts_--_california_candidate_privacy_notice.pdf
Full Time
Retail
$110k-136k (estimate)
04/03/2024
06/30/2024
shop.advanceautoparts.com
DELRAY BEACH, FL
>50,000
1932
Public
DAVE WILLINS
$10B - $50B
Retail
Advance Auto Parts is a retailer of automotive replacement parts and accessories in the United States
The job skills required for Data Engineer include SQL, Python, Data Engineering, AWS, Big Data, Data Warehouse, etc. Having related job skills and expertise will give you an advantage when applying to be a Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.