Demo

Senior AI Engineer – LLM, RAG

brightai
Palo Alto, CA Full Time
POSTED ON 1/5/2026
AVAILABLE BEFORE 3/5/2026

Senior AI Engineer – RAG Systems

Bright.AI is a high-growth Physical AI company transforming how businesses interact with the physical world through intelligent automation. Our AI platform processes visual, spatial, and temporal data from billions of real-world events—captured across edge devices, mobile sensors, and cloud infrastructure—to enable intelligent decision-making at scale.

We are now hiring a Senior AI Engineer – LLM, RAG to lead the development of Retrieval-Augmented Generation (RAG) systems that harness the power of large language models (LLMs) and real-world knowledge sources. This role is pivotal to building next-generation intelligent assistants that help technicians and operators troubleshoot complex issues in industrial settings.

You’ll work at the intersection of NLP, foundational models, and real-time information systems—developing intelligent tools that turn manuals, technician notes, and sensor data into actionable, conversational guidance for the physical world.

Responsibilities

  • Lead the architecture and development of RAG systems that combine LLMs (e.g., LLAMA, Mistral, Claude, GPT) with structured and unstructured external information sources.
  • Develop AI-powered assistants to support technicians in diagnosing and resolving anomalies or failures in factory, plant, or industrial settings.
  • Build pipelines to ingest, preprocess, and index large corpora of documents (manuals, logs, notes, procedures) for semantic search and grounding.
  • Customize and fine-tune foundational models to incorporate domain-specific language, tone, and logic for industrial troubleshooting scenarios.
  • Collaborate with product, data, and cloud teams to design scalable, privacy-compliant, and latency-sensitive LLM applications.
  • Design evaluation strategies to measure performance, accuracy, and user experience of RAG-enabled systems in production settings.
  • Stay up to date with the latest advances in LLM architectures, retrieval methods, and prompt engineering, and integrate emerging techniques into the product roadmap.

Educational Background

  • M.S. or Ph.D. in Computer Science, AI, Machine Learning, or a related field, with specialization in NLP or deep learning.
  • Strong research or applied background in large language models (LLMs) and retrieval-augmented generation (RAG) systems. Agentic RAG experience is highly desirable.

Required Skills & Expertise

  • 5 years of experience in machine learning or AI with a strong focus on NLP, LLMs, or conversational AI.
  • Fluency with modern LLMs and open-source foundational models (e.g., LLAMA, Falcon, Mistral, GPT, Claude).
  • Experience building RAG pipelines with tools like LangChain, LlamaIndex, or custom vector database integrations, with at least one production grade system was built.
  • Fluency with prompt engineering, instruction tuning, or fine-tuning open-source models.
  • Deep understanding of document retrieval (semantic search, embedding generation, similarity metrics) and vector stores (e.g., FAISS, Weaviate, Pinecone).
  • Strong foundation in core machine learning techniques, including experience with reinforcement learning (RL) or decision-making models.
  • Proficiency with ML development frameworks such as PyTorch, Hugging Face Transformers, or similar.  Strong Python programming is a must.
  • Experience integrating AI systems into real-world applications with user-facing interfaces and operational constraints.
  • Excellent problem-solving and critical thinking skills; ability to design solutions for complex, ambiguous problems.
  • Strong written and verbal communication skills, with ability to collaborate cross-functionally with engineers, product managers, and domain experts.

Bonus Qualifications

  • Experience applying LLMs in industrial or physical infrastructure settings (e.g., manufacturing, logistics, utilities, energy).
  • Knowledge of industrial control systems, maintenance workflows, or technician support processes.
  • Exposure to multimodal models or integrating textual data with sensor and/or time-series data.
  • Prior experience in a startup or a fast-paced environment building LLM-powered products from the ground up.

Salary.com Estimation for Senior AI Engineer – LLM, RAG in Palo Alto, CA
$143,988 to $182,131
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior AI Engineer – LLM, RAG?

Sign up to receive alerts about other jobs on the Senior AI Engineer – LLM, RAG career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$77,900 - $95,589
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at brightai

  • brightai Palo Alto, CA
  • BrightAI is a high-growth company at the forefront of AI, IoT, Cloud, and Mobile technologies. We are dedicated to revolutionizing industries and transform... more
  • 14 Days Ago

  • brightai Palo Alto, CA
  • Bright.AI is a high-growth Physical-AI company transforming how businesses interact with the physical world through intelligent automation. We are building... more
  • 15 Days Ago

  • brightai Palo Alto, CA
  • Staff Computer Vision/AI Engineer Bright.AI is a high-growth Physical-AI company transforming how businesses interact with the physical world through intel... more
  • 5 Days Ago

  • brightai Palo Alto, CA
  • BrightAI is a high-growth Physical-AI company transforming how businesses interact with the physical world through intelligent automation. We are building ... more
  • 6 Days Ago


Not the job you're looking for? Here are some other Senior AI Engineer – LLM, RAG jobs in the Palo Alto, CA area that may be a better fit.

  • Eightfold AI Santa Clara, CA
  • About Eightfold.ai Eightfold.ai is revolutionizing HR technology with AI. We are building the next generation of our AI-powered talent platform, aiming to ... more
  • 4 Days Ago

  • Eightfold AI Santa Clara, CA
  • About Eightfold.ai Eightfold.ai is revolutionizing HR technology with AI. We are building the next generation of our AI-powered talent platform, aiming to ... more
  • 1 Day Ago

AI Assistant is available now!

Feel free to start your new journey!