What are the responsibilities and job description for the AI Engineer (Java + Generative AI) position at Henderson Scott?
AI Engineer (Java Generative AI)
Chicago, IL (Hybrid)
$120,000–$140,000 benefits
We’re hiring a hands-on AI Engineer to design, build, and deploy scalable AI solutions that solve real enterprise business challenges.
This role is ideal for an engineer with strong Java development experience and practical exposure to Generative AI technologies, including LLMs, RAG pipelines, embeddings, and intelligent agent workflows.
You’ll be working on production-grade AI applications rather than experimental proof-of-concepts, helping deliver scalable, secure, enterprise-ready solutions.
The role
- Design, develop, and deploy AI/ML and Generative AI solutions
- Build LLM-powered applications, including RAG architectures, AI agents, prompt orchestration, embeddings, and vector search
- Develop scalable Java APIs and microservices
- Translate business requirements into production-ready AI solutions with measurable outcomes
- Implement MLOps / LLMOps best practices including CI/CD, monitoring, governance, observability, and version control
- Partner with product, cloud, data engineering, and AI teams across global delivery environments
- Support production deployment, optimisation, and continuous improvement
- Ensure AI solutions are built with security, compliance, and responsible AI principles in mind
What we’re looking for
- 4–8 years in software engineering, AI engineering, ML engineering, or similar
- Strong commercial Java development experience
- Hands-on experience with Generative AI / LLM-based applications
- Experience with:
- RAG
- Prompt Engineering
- Embeddings
- Vector Search / Vector Databases
- AI Agents / Agentic Workflows
- Good understanding of SQL / NoSQL / data engineering concepts
- Cloud deployment experience (GCP preferred, AWS/Azure considered)
- Experience with Docker, Kubernetes, and CI/CD pipelines
- Strong communication and stakeholder collaboration skills
Nice to have
- Model fine-tuning experience
- Predictive ML exposure
- Experience in enterprise or regulated environments
If you’re excited by building practical AI applications that deliver measurable business impact, we’d love to hear from you.
Salary : $120,000 - $140,000