10 network data engineer Jobs in scottsdale, az
Ignitec Inc is Hiring a Data Engineer Near Scottsdale, AZ
Ignitec infuses industry standards and leading technology capabilities to solve complex problems and deliver value with increased quality and lower performance risks. Our solutions combine top technology personnel, the latest cutting-edge technology, and Agile approaches to bring innovative ideas to life. We do not seek to meet expectation, we continuously strive to exceed them.
We have received our MBE Certification from NMSDC as a certified Minority Small Business Enterprise. We take pride in the MBE certification and partner with organizations to meet their Minority (D&I) Small Business goals. We are also a certified Minority Business Enterprise by the USPAACC, which recently awarded Ignitec “The FAST 50 Asian American Business Award” in 2022. We are also DBE certified by the Virginia Department of SBSD.
Title: ETL/Data Engineer
Salary: $130,000 - $140k/yr on W2
Location: Scottsdale, Arizona
Job Requirements
- 6-8 years of IT experience focusing on enterprise data architecture and management.
- Experience in Conceptual/Logical/Physical Data Modeling & expertise in Relational and Dimensional Data Modeling
- Must have : Skillset: Java, Scala, S3, Glue, aws , Redshift.
- Experience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required
- Experience with Spark Scala and Java programming
- Data Lake concepts such as time travel and schema evolution and optimization
- Structured Streaming and Delta Live Tables with Databricks as a bonus
- Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data
- mart build, and data lakes implementation/support
- Advanced level understanding of streaming data pipelines and how they differ from batch systems
- Formalize concepts of how to handle late data, defining windows, and data freshness
- Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
- Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc.
- Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
- Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
- Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
- Indexing and partitioning strategy experience
- Debug, troubleshoot, design, and implement solutions to complex technical issues
- Experience with large-scale, high-performance enterprise big data application deployment and solution
- Architecture experience in AWS environment a bonus
- Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
- Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelines
- Experience working with AWS Lambdas for configuration and optimization and experience with S3
- Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.
- Ability to thrive in a team-based environment
- Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior-level of management
Job Summary
Full Time
$101k-125k (estimate)
04/30/2024
05/13/2024
ignitec.com
Bristol
<25
Related Companies
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.
