What are the responsibilities and job description for the Senior AI/ML Engineer position at Prodapt?
Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A “Great Place To Work® Certified™” company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80 locations globally.
Job Summary: We are looking for a skilled AI/ML Developer to join our agentic platform team. You will design, develop, and deploy LLM-powered agents and pipelines that directly serve field technicians in production. You will work closely with the platform architect and contribute to the core multi-agent orchestration system.
Work Arrangement: Onsite Role – 5 days a week
Interview: Two rounds - Video interview and In-person (Final Discussion)
Key Responsibilities:
- Design and develop LLM-powered agents using LangGraph and LangChain frameworks
- Build and enhance multi-agent orchestration pipelines with conditional routing, state management, and error recovery
- Develop RAG pipelines with hybrid search (semantic keyword), re-ranking, and Reciprocal Rank Fusion
- Implement tool-calling agents with parallel API execution, sequential enrichment chains, and summarization
- Build real-time streaming capabilities (WebSocket / SSE) for conversational AI
- Integrate with Azure OpenAI APIs with circuit breaker patterns and fallback chains
- Implement prompt engineering and dynamic prompt management (DB-backed with in-memory caching)
- Design and implement multi-modal AI features (image analysis with vision models)
- Write production-quality Python code with error handling, logging, observability, and unit tests
- Participate in code reviews, architecture discussions, and sprint delivery
Required Skills & Experience:
Must-Have
- 10 years of software development with strong Python expertise in production environments
- 2 years hands-on LLM development (LangChain, LangGraph, or equivalent frameworks)
- RAG pipeline experience - embeddings, vector search, re-ranking, answer generation
- LLM APIs - OpenAI Chat Completions, Responses API, streaming, tool calling
- Async Python - asyncio, httpx, FastAPI
- Prompt engineering - system prompts, few-shot, structured JSON output
- Circuit breaker patterns, retry logic, resilient service design
- PostgreSQL and async ORMs (SQLAlchemy async / Alembic)
- Git, CI/CD, Docker, Kubernetes basics
- Strong system design skills - microservices, distributed systems, API design
Nice-to-Have
- LangGraph StateGraph (conditional edges, node pipelines, compiled graphs)
- Multi-agent systems - orchestration, routing, RBAC-based access control
- Langfuse or similar LLM observability (tracing, token usage, latency)
- WebSocket and SSE streaming protocols
- Multi-modal AI (vision models, image analysis)
- Vector databases (OpenSearch, Pinecone, pgvector)
- AWS services (Aurora PostgreSQL, SSM, IAM, EKS)
- Telecommunications or field service domain experience
Education: Bachelor’s degree, or foreign equivalent, in Computer Science or Information Technology
Best regards,
Raja Kumar