What are the responsibilities and job description for the Data Engineer position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Tror, is seeking the following. Apply via Dice today!
Job Title: - Data Engineer
Location: - Scottsdale AZ (Day 1 Onsite)
Job Type: - Contract
Need 12 years of experience.
Must have:
Job Title: - Data Engineer
Location: - Scottsdale AZ (Day 1 Onsite)
Job Type: - Contract
Need 12 years of experience.
Must have:
- Strong Experience in Scala, Spark, hive SQL, Hadoop and Kafka
- Proficiency in Hive and SQL optimization.
- Understanding of distributed systems and big data architecture.
- Knowledge of streaming frameworks (Spark Streaming, Kafka Streams).
- Good to have – Aerospike experience.
- Must have Primary skills required Cloudera (Hadoop), Spark Scala or Spark Java and SQL
- The resources should also have good understanding of Hive, Aerospike.
- The resources should have strong analytical skills.
- Should have worked on large scale ETL and DW projects and pipelines.
- Real time data streaming experience and batch orchestration, data quality and reconciliation, understanding of concepts like Data Governance is a must.
- Strong communication skills and ability to independently work and troubleshoot problems and come up with solutions.