What are the responsibilities and job description for the Sr. Data Engineer - PERM - MUST BE LOCAL position at Resource 1, Inc.?
Resource 1 is in need of a Sr. Data Engineer for a full-time/ permanent position with our client in Naperville, IL. Candidate must be local to Illinois because of future hybrid onsite in Naperville expected. Our client is an employee-owned company with excellent benefits, growth opportunities and profit-sharing bonus.
This position is focused on building modern data pipelines, integrations and back-end data solutions. Selected individual will work within cross-functional Agile teams, collaborating with product owners, business analysts and other engineers to design and deliver data solutions that power business insights and AI products.
Responsibilities:
- Design and develop scalable data pipelines for ingestion, transformation and integration using AWS services.
- Pull data from PostgreSQL and SQL Server to migrate to AWS.
- Create and modify jobs in AWS and modify logic in SQL Server.
- Create SQL queries, stored procedures and functions in PostgreSQL and RedShift.
- Provide input on data modeling and schema design as needed.
- Manage infrastructure through infrastructure-as-code templates (Serverless Framework), supporting new data products and services in AWS.
- Support inbound/ outbound data flows, including APIs, S3 replication and secured data.
- Assist with data visualization/ reporting as needed.
- Follow an Agile development methodology, with regular workshops and standup meetings, working in two-week sprints.
Qualifications:
- 5 years of data engineering experience.
- Experience with AWS and its associated array of offerings (Glue, Redshift, Athena, S3, Lambda, Spectrum).
- Strong experience with SQL, Python and PySpark.
- A background in supply chain, logistics or distribution would be a plus.
- Experience with Power BI is a plus.
Salary : $125,000 - $140,000