What are the responsibilities and job description for the Software Engineer – Java, Big Data & Cloud Infrastructure position at IMCS Group?
Job: Software Engineer – Java, Big Data & Cloud Infrastructure
Location ; Sunnyvale, CA or Austin, TX
Need technical hands on coder
About the Role
We are looking for an experienced Software Engineer to design, build, and maintain scalable backend services and data-driven systems. The ideal candidate has strong expertise in Java, exposure to Big Data technologies (including Apache Iceberg), Kubernetes, and CI/CD practices, and thrives in a fast-paced, collaborative engineering environment.
Responsibilities
- Design, develop, and maintain robust, scalable Java-based backend applications and services.
- Build and support data pipelines that read/write large-scale datasets, leveraging Apache Iceberg table format for efficient, reliable storage and querying.
- Work with Big Data ecosystems (e.g., Spark, Kafka, Hive) as needed to support platform and application features.
- Containerize applications and manage deployments using Kubernetes, ensuring high availability, scalability, and fault tolerance.
- Design and maintain CI/CD pipelines (e.g., Jenkins, GitLab CI, GitHub Actions) to automate build, test, and deployment workflows.
- Collaborate with cross-functional teams including data engineers, DevOps, QA, and product managers to deliver end-to-end solutions.
- Write clean, well-tested, maintainable code following best software engineering practices.
- Monitor, troubleshoot, and optimize production systems for performance and reliability.
- Participate in code reviews, architecture discussions, and technical design decisions.
- Ensure data quality, security, and compliance across services and pipelines.
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience).
- 3 years of professional software engineering experience.
- Strong proficiency in Java (Java 8 ), including multithreading, collections, and design patterns.
- Working knowledge of Big Data frameworks/table formats such as Apache Iceberg, Spark, or Hive.
- Experience with ETL/data workflow concepts (building, consuming, or integrating with pipelines).
- Experience deploying and managing containerized applications with Kubernetes (Helm, Docker).
- Proven experience building and maintaining CI/CD pipelines (Jenkins, GitLab CI/CD, GitHub Actions, or similar).
- Solid understanding of relational and NoSQL databases (e.g., MySQL, PostgreSQL, Cassandra, MongoDB).
- Experience with version control systems (Git) and Agile/Scrum development practices.
- Strong problem-solving, debugging, and analytical skills.
Preferred Qualifications
- Experience with cloud platforms (AWS, Azure, or GCP).
- Familiarity with data lakehouse architectures and table formats (Iceberg, Delta Lake, Hudi).
- Knowledge of infrastructure-as-code tools (Terraform, Ansible).
- Experience with monitoring/observability tools (Prometheus, Grafana, ELK/EFK stack).
- Exposure to microservices architecture and RESTful API design.
- - Understanding of data security, governance, and compliance best practices.