What are the responsibilities and job description for the Java Spark Engineer position at Micasa Global?
Job Title: Java Spark Engineer
Location: Berkeley Heights, NJ
Work Mode: 5 Days Onsite
Employment Type: Contract
Responsibilities
- Design and develop scalable, fault-tolerant data pipelines using Java and Apache Spark.
- Build and optimize batch and streaming ETL/ELT applications for large-scale datasets.
- Perform Spark performance tuning including partitioning, memory optimization, shuffle reduction, skew handling, and resource optimization.
- Develop high-quality, reusable, and maintainable code following coding standards.
- Participate in architecture discussions and technical design reviews.
- Collaborate with product owners, architects, and cross-functional teams to deliver scalable solutions.
- Support production environments, troubleshoot issues, perform root cause analysis, and ensure high system availability.
- Work with Kafka-based streaming applications.
- Contribute to CI/CD automation, containerization, and infrastructure improvements.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
- 7 years of professional Java development experience
- 5 years hands-on experience with Apache Spark in production environments
- Expert-level understanding of distributed systems: fault tolerance, data locality, shuffle mechanics, resource management
- Proven track record designing systems processing terabyte scale data
- Strong SQL skills and deep familiarity with columnar storage formats (Parquet, ORC, Avro, Delta Lake/Iceberg)
- Experience with cluster managers (YARN, Kubernetes) and cloud-managed Spark
- Proficiency with Kafka
- Strong grasp of CI/CD, containerization, and infrastructure-as-code practices