Demo

SR Agentic AI / LLM Engineer

Jobs via Dice
Chicago, IL Full Time
POSTED ON 4/22/2026
AVAILABLE BEFORE 5/21/2026
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Next Gen IT Inc, is seeking the following. Apply via Dice today!

SR Agentic AI / LLM Engineer

Hybrid - Chicago, IL (Open for relocation)

Looking for a SR Agentic AI / LLM Engineer to work onsite in Chicago. They need SR Level – someone who has built RAG solutions from scratch.

Design, develop, and maintain scalable web services using FastAPI or Flask frameworks.

Write efficient, reusable, and modular Python code to support API-driven LLM applications.

Lang Chain & Supporting Frameworks:

Implement Lang Chain to build custom pipelines for document indexing, retrieval, and summarization.

Integrate Lang Chain’s RAG capabilities with other components like vector stores and retrievers to support real-time querying and document processing.

RAG Pipelines:

Architect and deploy Retrieval-Augmented Generation (RAG) systems for chatbots, knowledge systems, and other generative AI applications.

Optimize RAG systems for speed, accuracy, and scalability across multiple use cases.

Vector Stores & Retrievers:

Work with vector databases like Pinecone, Chroma, FAISS, or Milvus to store and manage embeddings.

Implement retrievers and re-rankers to improve query efficiency, ensuring high-quality and relevant outputs for users.

AWS Cloud Deployment:

Deploy and manage LLM-based applications on AWS, leveraging services such as Lambda, EC2, S3, EKS, and RDS.

Ensure the scalability, availability, and reliability of deployed applications.

Dashboards and Monitoring (Optional):

Create monitoring dashboards using tools like Grafana or Tableau for real-time system monitoring, analytics, and performance insights.

Experimentation with Generative AI:

Research and integrate the latest advancements in generative AI technologies.

Experiment with fine-tuning and adapting large language models (like GPT, BERT) for new, innovative use cases.

Required Technical Skills

Python proficiency, especially with web frameworks like FastAPI or Flask.

Strong experience with Lang Chain and associated libraries.

Proven expertise in building and optimizing RAG pipelines.

Proficiency in using vector databases (e.g., Pinecone, FAISS).

Experience with retrievers and re-rankers.

Solid understanding of AWS services (Lambda, EC2, RDS, etc.).

Knowledge of SQL and NoSQL databases.

Familiarity with dashboarding tools such as Grafana and Tableau.

Soft Skills

Problem-solving: Ability to handle complex and dynamic challenges with AI solutions.

Collaboration: Experience working in multidisciplinary teams (data scientists, DevOps, etc.).

Adaptability: Eagerness and passion to keep up with the latest AI advancements and incorporate them into solutions.

Communication: Excellent verbal and written communication skills to convey technical information to both technical and non-technical stakeholders.

Salary.com Estimation for SR Agentic AI / LLM Engineer in Chicago, IL
$115,008 to $148,144
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a SR Agentic AI / LLM Engineer?

Sign up to receive alerts about other jobs on the SR Agentic AI / LLM Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Jobs via Dice

  • Jobs via Dice Sheridan, WY
  • Dice is the leading career destination for tech experts at every stage of their careers. Our client, Varmoda Tech LLC, is seeking the following. Apply via ... more
  • 14 Days Ago

  • Jobs via Dice Alaska, AK
  • job summary: Enterprise Healthcare client has an immediate opening for a highly motivated Project Manager III to join their dynamic and growing team. All q... more
  • 14 Days Ago

  • Jobs via Dice Burlington, VT
  • Desktop Deployment Technician (Part-Time - 20 Hours a week) (Contract Role) Overview We are seeking a Desktop Deployment Technician to support a large-scal... more
  • 14 Days Ago

  • Jobs via Dice Georgia, VT
  • Dice is the leading career destination for tech experts at every stage of their careers. Our client, AaraTechnologies Inc, is seeking the following. Apply ... more
  • 14 Days Ago


Not the job you're looking for? Here are some other SR Agentic AI / LLM Engineer jobs in the Chicago, IL area that may be a better fit.

  • Next Gen IT Inc Chicago, IL
  • SR Agentic AI / LLM Engineer Hybrid - Chicago, IL (Open for relocation) Looking for a SR Agentic AI / LLM Engineer to work onsite in Chicago. They need SR ... more
  • 1 Day Ago

  • Xlysi Chicago, IL
  • Role Overview We are seeking an experienced AI-focused Software Engineer to design, build, and scale intelligent applications powered by modern AI and larg... more
  • 27 Days Ago

AI Assistant is available now!

Feel free to start your new journey!