What are the responsibilities and job description for the Core Java + Apache Spark Engineer position at Transcend IT Solutions?
Position Tittle: Core Java Apache Spark Engineer
Location: Tampa, FL 3x a week onsite Hybrid
Duration: Long Term
Job Details:
We are seeking a Java Developer – Supervisory to join our team within a TechFin environment. The ideal candidate will have strong experience in Core Java, Apache Spark, and big data platforms and a proven ability to design and optimize large-scale data pipelines for credit risk analytics and regulatory reporting.
Responsibilities:
- Design, develop, optimize, and maintain scalable data pipelines using Core Java and Apache Spark for large-scale financial datasets.
- Lead batch processing initiatives for credit risk analytics, including stress loss (GSST, CCAR) and expected credit loss (CECL, IFRS9, ICAAP).
- Ensure efficient storage, retrieval, and governance of risk data across Hadoop, Hive, Impala, and Spark ecosystems.
- Implement Spark performance best practices such as partitioning, caching, and memory management.
- Maintain code quality through automated testing, CI/CD pipelines (Tekton, Harness), and GitHub-based workflows.
- Collaborate with cross-functional teams to deliver compliant, reliable solutions for regulatory reporting.
Required Skills & Qualifications:
- 7 years of software development with Core Java and Java 8 concepts, including OOP, OOD, Collections, Exception Handling, JDBC, Multithreading, Streams, Lambda Expressions, and Functional Interfaces.
- 2 years of Apache Spark (Java API) with RDD, DataFrame, and Dataset expertise.
- 5 years of SQL/NoSQL databases such as Oracle, MySQL, Postgres, MongoDB, Couchbase, or Neo4j.
- 3 years leading or owning projects end-to-end with multi-team collaboration.
- Experience in financial markets and credit risk systems, including scenario analysis and stress testing.
- Proficiency with GitHub, Tekton, Harness, and CI/CD practices.
- Ability to operate in a fast-paced environment and deliver reliable code.
Preferred Skills:
- Experience with Hadoop ecosystem tools such as Hive and Impala in production workloads.
- Experience with agentic AI tooling (e.g., Devin, Claude, or Copilot) to enhance development productivity.
- Background in Agile delivery and test automation practices.
Salary : $75 - $85