What are the responsibilities and job description for the Java Developer with Spark / Scala position at Jobs via Dice?
We are seeking a highly skilled Senior Software Engineer with a strong background in software development, particularly in Java/Spark or Scala/Spark. The ideal candidate will have hands-on experience with big data technologies and a solid understanding of database concepts. This role requires a proactive individual who can contribute to the development of innovative solutions in a fast-paced environment.
Responsibilities:
Responsibilities:
- Design, develop, and maintain scalable software applications using Java/Spark or Scala/Spark.
- Implement and manage CI/CD processes to ensure smooth deployment and integration of software solutions.
- Utilize version control tools like GIT for code management and collaboration.
- Work with the Hadoop ecosystem and big data technologies, including Hive, Kafka, S3, and Iceberg.
- Perform Spark performance tuning and optimization to enhance application efficiency.
- Develop and execute SQL queries for data manipulation and retrieval.
- Engage in data modeling and normalization to ensure data integrity and accessibility.
- Write and maintain UNIX bash scripts for automation and process improvement.
- Collaborate with cross-functional teams to define, design, and ship new features.
- Participate in code reviews and provide constructive feedback to peers.
- Stay updated with emerging technologies and industry trends to continuously improve skills and knowledge.
- Strong proficiency in Java/Spark or Scala/Spark.
- Extensive experience with SparkSQL.
- Proficient in using version control tools like GIT.
- Solid understanding of CI/CD processes and build tools such as Gradle and Maven.
- Hands-on experience with the Hadoop ecosystem and big data technologies.
- Strong knowledge of database concepts and SQL.
- Experience with UNIX bash scripting.