2 DATA ENGINEER Jobs in Oldwick, NJ
AM Best Company is Hiring a DATA ENGINEER Near Oldwick, NJ
Overview
The Data Engineer will build data pipelines / data orchestrator and data structures for existing operational data stores, Azure data lake & data warehouse. They will develop proof-of-concepts to evaluate new technologies and suggest improved and better ways to re-architect existing data loading processes and data structures. They will work independently with minimal supervision within the Data Engineering team and will collaborate with other teams in an agile environment. They will have a creative mindset, knack to solve complex problems, passion to work with data, and a positive attitude.
Responsibilities
- Design and develop ELT / ETL to load data from internal sources into operational data stores, Azure data lake and data warehouse.
- Create APIs, data structures and schemas to store and retrieve data.
- Create and maintain data mappings, data definitions, architecture and data flow diagrams.
- Implement solutions to validate and test data quality.
- Build proof-of-concepts to determine viability of new processes and technologies.
- Deploy and manage code in non-prod and prod environments.
- Troubleshoot data related issues and fix defects.
- Optimize and performance tune databases and queries.
- Participate in code reviews and train other team members.
- Document code and create code templates based on industry best practices.
Qualifications
- Bachelor’s Degree and/or equivalent experience required.
- Minimum 5 years of experience working as a Data Engineer, ETL Engineer, Data/ETL Architect or similar roles.
Skills
• 5 years of solid continuous experience in Python. • 3 years of continuous experience with Airflow. • 3 years of experience with Azure Data Factory (ADF) or similar. • 3 years of experience working with relational databases: Oracle, SQL Server, PostgreSQL, or similar. • 3 years of experience working with NoSQL databases: MongoDB, Cosmos DB, DocumentDB or similar • 3 years of experience writing SQL code. • 3 years of experience in Kimball Dimensional Modeling (Star-Schema). • 2 years of experience in columnar databases: Snowflake, Azure Synapse, or similar. • 2 years of Azure / AWS experience. Pluses, but not required: Any work experience in the following: • ETL / ELT: Spark, Apache NiFi, Kafka, Luigi, Prefect. • Languages: Java, Scala, R. • Platforms: Databricks. • Databases: Redis, Elasticsearch. • Data Orchestrator: Control-M, JAMS.Job Summary
Other
Print & Book Publishing
$105k-130k (estimate)
02/16/2024
02/15/2025
ambest.com
OLDWICK, NJ
500 - 1,000
1899
ARTHUR SNYDER
$50M - $200M
Print & Book Publishing
Related Companies
The job skills required for DATA ENGINEER include SQL, Data Engineering, AWS, Azure, Java, Agile, etc. Having related job skills and expertise will give you an advantage when applying to be a DATA ENGINEER. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by DATA ENGINEER. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for DATA ENGINEER positions, which can be used as a reference in future career path planning. As a DATA ENGINEER, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary DATA ENGINEER. You can explore the career advancement for a DATA ENGINEER below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.
Similar Jobs
Popular Articles
