What are the responsibilities and job description for the Senior AI Engineer position at JSG (Johnson Service Group, Inc.)?
Our client is seeking a Senior AI Engineer with strong AI quality experience to build, evaluate, and improve enterprise AI solutions, with a focus on GenAI, RAG, and agent-based workflows in an Azure environment. (remote US only)
Must Have skills
Must Have skills
- Experience building and supporting GenAI and LLM-based solutions
- Strong skills in Python
- Experience with Azure AI services, including Azure AI Foundry or related tools
- Experience with RAG systems and retrieval-based AI workflows
- Familiarity with LangChain, LangGraph, or agent-based orchestration
- Experience validating LLM outputs for quality, accuracy, and consistency
- Exposure to evaluation frameworks, testing, or quality processes for AI systems
- Experience with Azure AI Search
- Exposure to AI test automation or monitoring workflows
- Familiarity with Responsible AI, governance, or compliance practices
- Experience with knowledge graphs, GraphRAG, Pinecone, FAISS, OpenSearch, or similar tools
- Experience in enterprise or regulated environments
- Experience supporting human-in-the-loop or audit-focused AI processes
- Build and improve enterprise AI solutions across GenAI, RAG, and agent-based systems
- Support development of LLM-powered applications in an Azure-based environment
- Design and enhance retrieval pipelines and grounded response workflows
- Contribute to evaluation and validation of AI outputs for quality, safety, and consistency
- Help develop structured approaches for testing and monitoring AI solutions
- Work with cross-functional teams to deliver reliable, governed, and production-ready AI systems
- Support documentation, quality standards, and Responsible AI practices