Demo

LLM / GenAI Engineer

Evlo AI
Washington, DC Full Time
POSTED ON 8/1/2026
AVAILABLE BEFORE 8/30/2026
About The Role

The role is for someone who has moved beyond basic prompting and understands what it takes to build production-grade AI systems: robust RAG pipelines, agentic workflows, fine-tuning pipelines, and systematic evaluation frameworks.

The engineering team owns complex pieces of a scalable AI platform, collaborating closely with applied scientists, backend engineers, and stakeholders to deliver high-performance generative AI solutions.

Key Responsibilities

  • Design and implement production-ready RAG architectures using LangChain, LlamaIndex, or custom frameworks
  • Build and optimize vector database integrations including Pinecone, Weaviate, and pgvector for low-latency semantic search at scale
  • Develop systematic LLM evaluation frameworks incorporating benchmark suites, LLM-as-judge pipelines, and regression testing
  • Run parameter-efficient fine-tuning pipelines such as LoRA and QLoRA on domain-specific datasets using PyTorch and Hugging Face
  • Integrate Large Language Models with external tools and APIs to support complex, multi-step agentic workflows
  • Write observable, tested, and well-documented Python code, participating actively in architecture reviews and team deployments

What We Are Looking For

  • 3–6 years of software engineering experience, with a minimum of 2 years specifically focused on building and deploying LLM and GenAI applications in production
  • Deep familiarity with LLM orchestration frameworks like LangChain or LlamaIndex and vector database management
  • Strong Python development skills including asynchronous programming, REST API design, and cloud infrastructure integration
  • Solid understanding of embedding models, tokenization, prompt engineering limits, and foundational transformer architectures
  • Bachelor's degree in Computer Science, Artificial Intelligence, or equivalent practical experience
  • Bonus: Experience with model quantization, vLLM optimization, TensorRT-LLM, or publishing research in NLP/GenAI domains

Salary.com Estimation for LLM / GenAI Engineer in Washington, DC
$124,514 to $160,391
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a LLM / GenAI Engineer?

Sign up to receive alerts about other jobs on the LLM / GenAI Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Evlo AI

  • Evlo AI Washington, DC
  • About The Role The role leads the accounting function, overseeing US GAAP compliance, financial reporting, and internal controls in a fast-paced environmen... more
  • 2 Days Ago

  • Evlo AI Phoenix, AZ
  • About The Role The role drives full-cycle talent acquisition for technical and operational teams, partnering closely with hiring managers to scale high-per... more
  • 2 Days Ago

  • Evlo AI Denver, CO
  • About The Role The role owns the end-to-end product lifecycle for technical platforms, bridging complex engineering capabilities with concrete business str... more
  • 2 Days Ago

  • Evlo AI Seattle, WA
  • About The Role The Sales Development Representative role serves as the foundation of the revenue organization, identifying high-potential target accounts, ... more
  • 2 Days Ago


Not the job you're looking for? Here are some other LLM / GenAI Engineer jobs in the Washington, DC area that may be a better fit.

  • Scale.jobs Washington, DC
  • About The Role This role focuses on building and scaling production-grade Generative AI systems, moving beyond basic prototyping to deploy robust RAG pipel... more
  • 8 Days Ago

  • Capital One Mc Lean, VA
  • Overview Lead AI Engineer At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been a... more
  • 16 Days Ago

AI Assistant is available now!

Feel free to start your new journey!