1000 Jobs in chicago, il
Sky Consulting Inc is Hiring a Senior Data Engineer Near Chicago, IL
This is a Fulltime role, No C2C Enquiries please.
We are looking for candidates having experience in Migration from Oracle to Snowflake.
Title: Data Engineer
Location: Chicago IL
Hybrid (2-3 days onsite)
Job Description:
Key Responsibilities:
Data Integration:
Implement and maintain data synchronization between on-premises Oracle databases and Snowflake using Kafka and CDC tools.
Support Data Modeling:
Assist in developing and optimizing the data model for Snowflake, ensuring it supports our analytics and reporting requirements.
Data Pipeline Development:
Design, build, and manage data pipelines for the ETL process, using Airflow for orchestration and Python for scripting, to transform raw data into a format suitable for our new Snowflake data model.
Reporting Support:
Collaborate with data architect to ensure the data within Snowflake is structured in a way that supports efficient and insightful reporting.
Technical Documentation:
Create and maintain comprehensive documentation of data pipelines, ETL processes, and data models to ensure best practices are followed and knowledge is shared within the team.
Tools and Skillsets:
Data engineering: proven track record of developing and maintaining data pipelines and data integration projects
Databases:
Strong experience with Oracle, Snowflake, and Databricks.
Data Integration Tools: Proficiency in using Kafka and CDC tools for data ingestion and synchronization.
Orchestration Tools: Expertise in Airflow for managing data pipeline workflows.
Programming: Advanced proficiency in Python and SQL for data processing tasks.
Data Modeling: Understanding of data modeling principles and experience with data warehousing solutions.
Cloud Platforms: Knowledge of cloud infrastructure and services, preferably Azure, as it relates to Snowflake and Databricks integration.
Collaboration Tools: Experience with version control systems (like Git) and collaboration platforms.
CI/CD Implementation: Utilize CI/CD tools to automate the deployment of data pipelines and infrastructure changes, ensuring high-quality data processing with minimal manual intervention.
Communication: Excellent communication and teamwork skills, with a detail-oriented mindset. Strong analytical skills, with the ability to work independently and solve complex problems.
Key Skills: Snowflake, Databricks, Python, SQL
Job Summary
Full Time
Business Services
$108k-140k (estimate)
06/09/2024
07/07/2024
skyconsultingservices.com
ARVADA, CO
<25
2005
<$5M
Business Services
Related Companies
The job skills required for Senior Data Engineer include Collaboration, etc. Having related job skills and expertise will give you an advantage when applying to be a Senior Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Senior Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a CAE Designer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.
Similar Jobs
Popular Articles
