4 Data Engineer Jobs in Edison, NJ
Diverse Lynx is Hiring a Data Engineer Near Edison, NJ
Location: Edison NJ (Onsite)
Duration: Full-time
8-10 Years
Skill: Data Engineer
" Design, develop, monitor, and operate data pipelines and maintenance of existing data pipelines.
" Collaborating with product owner and analysts to provide data-driven solutions and insights.
" Implementing data transformations and aggregations for large datasets.
" Ensuring data security and compliance with data governance policies.
" Developing in languages like Pyspark and Python.
" Preprocess of structured and unstructured data.
" Analyze, transform, and create SQL queries.
" Developing and optimizing Spark-based data processing applications on the AWS Databricks platform.
" Troubleshooting and debugging data-related issues on the AWS Databricks platform.
" Integrating Databricks with other data storage and processing systems.
What we are looking for:
" Expertise in Apache Spark along with Spark streaming & Spark SQL.
" Highly proficient with Apache Spark, Scala/ Python and PySpark.
" Good understanding & hands-on experience Gitlab with CI/CD.
" Hands-on experience in AWS Services like S3, Glue is required.
" Working knowledge of AWS Databricks, Cluster Management.
" Design, build, and test data pipelines and workflows using AWS Databricks.
" Having the knowledge about Optimizing AWS Databricks Streaming jobs.
" Have a deep understanding of AWS Cloud platforms and data engineering technologies.
" Strong SQL skills to perform data analysis and understanding of source data.
" Familiarity with NoSQL databases and JSON formats.
" Experience in building ETL / data warehouse transformation processes.
" Strong knowledge of Data Management principles.
" Good to have experience in analytical tool.
" Good to have experience in Alteryx/Tableau.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Job Summary
Full Time
$127k-156k (estimate)
05/07/2024
05/20/2024
diverselynx.com
PRINCETON, NJ
200 - 500
2002
Private
SHUBHENDRA VARMA
$50M - $200M
IT Outsourcing & Consulting
Related Companies
About Diverse Lynx
Diverse Lynx is a provider of mobile application development, web designing, consulting and quality assurance services.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.
