Senior Backend Java Engineer with AI / LLM

Position Overview

We are seeking an experienced Senior Backend Java Engineer with specialized expertise in Generative AI, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG).

In this role, you will help modernize enterprise systems, build scalable event-driven backend services, and integrate intelligent AI capabilities directly into high-throughput Java applications. You will work at the intersection of core enterprise backend infrastructure (Java, Spring Boot, Kafka, NoSQL) and cutting-edge GenAI architecture.

Key Responsibilities

• Backend Development: Design, build, and maintain high-performance, fault-tolerant backend microservices using Java (17 ) and Spring Boot.
• GenAI & RAG Integration: Build and optimize end-to-end Retrieval-Augmented Generation (RAG) pipelines and integrate LLM orchestration frameworks into enterprise Java services.
• Event-Driven Architecture: Implement robust real-time streaming pipelines and asynchronous messaging using Apache Kafka.
• Data Layer Management: Utilize NoSQL databases (e.g., Cassandra, MongoDB, Cosmos DB) for scalable unstructured data storage, caching, and vector storage integration.
• AI Orchestration: Implement vector embeddings, similarity search algorithms, and contextual retrieval solutions to enrich GenAI responses using enterprise data.
• API & System Design: Design RESTful APIs and modern cloud-native architectures deployed on Azure or Google Cloud Platform.
• Engineering Excellence: Write clean, modular, and testable code; drive CI/CD automation; and maintain high standards for observability, performance, and security.

Required Qualifications & Tech Stack

Core Java & Backend Architecture

Java: 6 years of professional software development experience with deep expertise in Core Java (Java 11/17/21) and Spring Boot.

Kafka: Demonstrated expertise with Apache Kafka for event-driven messaging, event streaming, and pub/sub patterns.

NoSQL: Hands-on experience with NoSQL data stores (Cassandra, MongoDB, DynamoDB, or Couchbase).

Artificial Intelligence & Machine Learning

LLMs: Practical experience integrating LLMs (e.g., OpenAI API, Azure OpenAI, Anthropic, or open-source models) into production applications.

RAG Frameworks: Proven experience architecting and deploying Retrieval-Augmented Generation (RAG) applications.

Vector Databases: Experience with vector stores and semantic search systems (e.g., Pinecone, Milvus, Qdrant, ChromaDB, or PGVector).

AI Tooling & Orchestration: Knowledge of AI orchestration frameworks (e.g., Spring AI, LangChain4j, Semantic Kernel, or custom Java wrapper clients).

Cloud & DevOps

Experience with cloud platforms (Microsoft Azure or Google Cloud Platform).

Proficiency with containerization (Docker, Kubernetes) and CI/CD pipelines (Jenkins, GitHub Actions).

Experience with build tools (Maven, Gradle) and Git version control.

Preferred Qualifications

Prior experience in retail, supply chain, payments, or e-commerce domains at scale.

Experience with AI-assisted developer productivity tools (GitHub Copilot, Cursor, Claude).

Knowledge of prompt engineering, model fine-tuning, and guardrails implementation for enterprise LLM deployments.

Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.

DynamoDB,Apache,Kafka,Apache Kafka,Maven,OpenAI API,AI,AI capabilities,backend services,backend,build tools,caching,Cassandra,cloud,modern cloud,containerization,CI/CD,Cosmos DB,Couchbase,Cursor,data stores,Databases,Docker,Event-Driven Architecture,fault-tolerant,Generative AI,Retrieval-Augmented Generation (RAG),Retrieval-Augmented Generation (RAG) pipelines,Git version control,GitHub Copilot,GitHub Actions,Gradle,Computer Science,Java,Core Java,Java applications,Jenkins,Kubernetes,LLM,Large Language Models,LLMs,model fine-tuning,asynchronous messaging,microservices,Azure,Microsoft Azure,MongoDB,AI Orchestration,NoSQL,NoSQL databases,open-source,productivity tools,prompt engineering,RESTful APIs,search algorithms,semantic search,software development,Software Engineering,Spring Boot,integrating,unstructured data,high-performance,architecture,architecting,automation,E-Commerce,infrastructure,pub/sub,Retail,security,Semantic,Backend Java,testable code,supply chain,System Design,Tooling

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.

Salary : $60