83 Data Engineer Jobs in Chicago, IL
Sorry! This job is no longer available. Please explore similar jobs listed on the left.
Baanyan Software Services, Inc is Hiring a Data Engineer Near Chicago, IL
Job Details
Job Summary: The Data Management Specialist will be responsible for managing and optimizing our organization's data infrastructure, ensuring data quality, and implementing data solutions using PySpark, DataBricks, Snowflake, and/or Redshift. The ideal candidate will have a strong background in data management, programming, and cloud-based data platforms.
Key Responsibilities:
- Develop and maintain data pipelines using PySpark to process and transform large volumes of data.
- Design, implement, and optimize data solutions using DataBricks for data analytics and machine learning applications.
- Manage and administer cloud-based data platforms such as Snowflake and Redshift, ensuring high availability, scalability, and performance.
- Collaborate with cross-functional teams to understand data requirements and deliver tailored data solutions.
- Implement data governance policies and procedures to ensure data quality, consistency, and security.
- Monitor and troubleshoot data issues, ensuring timely resolution and minimal impact on business operations.
- Stay updated with the latest trends and technologies in data management, cloud computing, and big data analytics.
- Provide technical guidance and mentorship to junior data management team members.
Qualifications:
- Bachelor's degree in Computer Science, Information Systems, or related field; Master's degree preferred.
- Minimum of 5 years of experience in data management, data engineering, or related role.
- Strong programming skills in Python and experience with PySpark for data processing and analytics.
- Hands-on experience with DataBricks for building and optimizing data pipelines.
- Proficiency in managing and administering cloud-based data platforms such as Snowflake and/or Redshift.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
- Excellent analytical, problem-solving, and communication skills.
- Ability to work effectively in a fast-paced environment and manage multiple priorities.
Preferred Qualifications:
- Certifications in PySpark, DataBricks, Snowflake, or Redshift.
- Experience with other data management tools and technologies.
- Knowledge of machine learning algorithms and techniques.
- Experience working in banking and payments domain.
Job Summary
Full Time
IT Outsourcing & Consulting
$120k-147k (estimate)
04/18/2024
04/26/2024
baanyan.com
EDISON, NJ
50 - 100
2009
Private
ARCHANA DARIPALLI
$10M - $50M
IT Outsourcing & Consulting
Related Companies
The job skills required for Data Engineer include Python, Data Engineering, Big Data, Computer Science, Machine Learning, Data Modeling, etc. Having related job skills and expertise will give you an advantage when applying to be a Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.
Similar Jobs
Popular Articles
