979 Senior Data Engineer Jobs in New York, NY
Aura Intelligence is Hiring a Senior Data Engineer Near New York, NY
We are looking for someone who is constantly looking for ways to increase the effectiveness of the team through the use of technology, and who shares our values of being low ego, obsessed, curious, and collaborative. If this sounds like you, we would love to hear from you! setareh@auraintel.com
What you will do
- You'll define the processes and ETL infrastructure to transform and make data readily available across the product
- You'll help in executing the roadmap for data infrastructure and systems to power high volume product features using Aura's data.
- Design and implement robust data pipelines, guaranteeing data quality and timely data delivery across our product.
- You'll determine the best ways to handle Aura's unique data model and usage patterns to derive insights and bring intelligence to product features like search.
- You'll partner with data scientists and other internal stakeholders to understand their needs and then design, build and monitor pipelines that meet today's requirements but can gracefully scale with our growing data size
- You'll implement automated workflows that lower manual/operational cost for stakeholders, define and uphold SLAs for timely delivery of data, move the company closer to democratizing data and a self-serve model (query exploration, dashboards, data catalog, data discovery)
- Track record of building highly performant, highly observable, and highly scalable systems.
- 5 years of experience building data intensive applications
- Experience building systems with good abstractions and scalable architecture
- Solid architectural vision: You have strong intuition around long-term system design and continuous improvements to performance and scaling
- Proven expertise in cloud computing , particularly AWS
- Skill in containerization and orchestration technologies , like Docker and Kubernetes (EKS preferred)
- Experience with Snowflake ,
- Knowledge of orchestration tools , preferably Airflow
- Building and maintaining ETL/ELT pipelines
- Utilization of cloud monitoring and administration tools
- Understanding of data warehouse maintenance , including data wrangling, model integration, anomaly detection, and comprehensive documentation.
- Awareness of CI/CD practices
- Be passionate about analytics use cases, data models, and solving complex data problems, then this is the team for you!
- 2 years of experience in an early-stage startup.
- Proven track record migrating systems in a changing environment that allows for little to no downtime to meet increasing demand.
- Obsessed about your craft and share your knowledge (tech talks, articles, open source, etc).
- Experience in working in Python/strongly typed languages.
The Process
Our recruitment strategy deviates from traditional software engineering interviews to focus on the practical aspects of the job.
Our Interview Process
- Introduction Chat
- Take-home Assignment
- Engineering Call
- Product Partner Call
- CEO Chat
- Referral Check
Job Summary
Full Time
$107k-141k (estimate)
04/24/2024
05/12/2024
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a CAE Designer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.
