ROLE TITLE : Spark Scala Developer (with Java)

ROLE LOCATION(S): New Jersey, NJ(HybriD)

Responsibilities:

• Design, develop, and maintain Spark Scala applications for data processing and analysis.
• Utilize Java programming language for implementing custom functionalities and optimizations within Spark applications.
• Build efficient and scalable data pipelines to process and transform large volumes of data.
• Collaborate with data engineers and data scientists to integrate machine learning models and algorithms into Spark applications.
• Optimize Spark jobs for performance and scalability, including tuning of configuration parameters and resource management.
• Troubleshoot and debug issues with Spark applications in production environments.
• Work closely with cross-functional teams to deploy and monitor Spark applications on cloud platforms.
• Stay updated with the latest advancements in big data technologies and contribute to continuous improvement of data processing workflows.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or related field.
• Strong proficiency in Scala programming language.
• Solid understanding of Apache Spark framework and its ecosystem components.
• Proficiency in Java programming language, with experience in building scalable applications.
• Hands-on experience in designing and implementing data processing pipelines using Spark.
• Familiarity with distributed computing concepts and big data technologies (Hadoop, Kafka, etc.).
• Experience with SQL and relational databases (MySQL, PostgreSQL, etc.).
• Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.