What are the responsibilities and job description for the GenAI / Agentic AI Engineer (RAG & LLM Apps position at ConglomerateIT?
Title:GenAI / Agentic AI Engineer (RAG & LLM Apps)
Location: US - Remote / Hybrid (multiple locations)
Type: Full-time or Contract (W2/C2C)
Level: Mid Senior (10 Years Only)
We are hiring RAG-first GenAI engineers to build LLM-powered applications and agentic workflows for enterprise clients. This role centers on retrieval quality and reliable LLM integration as the foundation for agentic features.
What you'll do
-
Architect end-to-end RAG: chunking, embedding selection, hybrid/semantic search, re-ranking, citation and evaluation
-
Build LLM-powered microservices and APIs (FastAPI / REST)
-
Integrate and orchestrate LLMs (OpenAI, Claude, Gemini, Llama) into product and internal workflows
-
Add agentic behavior on top of RAG: tool-calling, multi-step task execution, guardrails, hallucination handling
-
Stand up and tune vector-store infrastructure; deploy and monitor in production
Must have
-
Strong Python
-
End-to-end RAG experience
-
Vector databases (Pinecone, Weaviate, pgvector, FAISS, or similar)
-
LLM API integration (OpenAI / Anthropic / Gemini / Llama)
-
LangChain and/or LlamaIndex
-
FastAPI / REST and one cloud (AWS, Azure, or Google Cloud Platform)
Nice to have
-
LangGraph, MCP, DSPy
-
Knowledge graphs / Neo4j, evals/LangSmith, MLOps
Founded in 2014, is a global leader in delivering innovative IT solutions and services. Headquartered in the USA with a presence in the UK, Canada, and India, we specialize in offering industry-leading expertise and cutting-edge products that help our clients maximize their technological investments. Our focus on best-in-class solutions, a highly knowledgeable team, and proactive talent mapping ensure we remain at the forefront of the IT industry.
ConglomerateIT is driven by our Center for Excellence and Innovation, an initiative dedicated to keeping us ahead in a rapidly evolving technology landscape. We understand that building strong relationships is key to our success, and this commitment has enabled us to partner with Fortune 500 companies and leading system integrators worldwide. Our ability to provide local talent on a global scale ensures that we can meet the contingent project requirements of our clients efficiently and effectively.