What are the responsibilities and job description for the Big Data Engineer (Hybrid Onsite - W2 contract) position at Xoriant Corporation?
Job Details
Job Title : Big Data Engineer
Location: Atlanta, GA (3 days a week Hybrid onsite)
Duration : Long term contract
Contract: W2
Job Description: Key Responsibilities:
- Design and implement high-performance data pipelines using Apache Spark and Scala.
- Optimize Spark jobs for efficiency, scalability, and reliability.
- Collaborate with cross-functional teams and diverse data sources to deliver data-driven insights.
- Monitor, troubleshoot, and maintain production data pipelines to ensure seamless operations.
- Create and maintain comprehensive documentation for all data systems and processes.
Required Skills & Qualifications:
- 5 years of hands-on experience with Apache Spark and Scala Java
- Strong understanding of distributed computing concepts and Spark internals.
- Experience with Big Data ecosystems including HDFS, Hive, Kafka, and HBase.
- Proven ability to write optimized, maintainable Spark jobs using Scala.
- Strong problem-solving and analytical skills, with a focus on data-driven solutions.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Salary : $60 - $70