19 Sr. Big Data Engineer Jobs in Sunnyvale, CA
Redolent is Hiring a Sr. Big Data Engineer Near Sunnyvale, CA
Title: Sr. Big Data Engineer
Location: Sunnyvale, CA
Duration: 6 Months
Rate: Market
As part of the International eCommerce Data Engineering team, you'll be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You'll interact with the engineers, product managers, BI developers and architects to provide scalable robust technical solutions.
Essential Job Functions & Responsibilities :
- Min 6-8 years of Big data development experience
- Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development
- Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
- Experience with Java, Python to write data pipelines and data processing layers
- Experience in writing map-reduce jobs
- Demonstrates expertise in writing complex, highly-optimized queries across large data sets
- Proven, working expertise with Big Data Technologies Hadoop, Hive, Kafka, Presto, Spark, just to name a few
- Highly Proficient in SQL
- Experience with Cloud Technologies ( GCP, Azure)
- Experience with Relational, NoSQL/in memory data stores would be a big plus ( Oracle, Cassandra, Druid)
- Provides and supports the implementation and operations of the data pipelines and analytical solutions
- Performance tuning experience of systems working with large data sets
- Experience with clickstream data processing
- Experience with Data Governance ( Data Quality, Metadata Management, Security, etc.)
- Experience in developing RESTful API data service
- Retail experience is huge plus
Job Summary
Full Time
$128k-157k (estimate)
12/13/2023
05/04/2024
redolentech.com
San Jose, CA
25 - 50
Related Companies
The following is the career advancement route for Sr. Big Data Engineer positions, which can be used as a reference in future career path planning. As a Sr. Big Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Sr. Big Data Engineer. You can explore the career advancement for a Sr. Big Data Engineer below and select your interested title to get hiring information.
Similar Jobs
Popular Articles
