Demo

Senior AI Engineer

7AI
Boston, MA Full Time
POSTED ON 4/18/2026
AVAILABLE BEFORE 5/17/2026
7AI empowers Security teams to shift high-value tasks to intelligent AI agents that help reshape the future of cybersecurity and automation. We’re building at the bleeding edge of AI, blending deep engineering with practical product impact. You’ll collaborate with mission-driven teams in a fast-paced, high-growth environment where your contributions directly influence what’s next in AI-powered systems.

This role builds on, but is distinct from, traditional ML engineering: the focus is not on training models from scratch, but on composing, optimizing, and scaling AI systems that solve complex enterprise problems.

What You’ll Do

  • Architect and build LLM-powered systems — design retrieval workflows, context management, agent prompts, and structured output pipelines.
  • Orchestrate AI workflows using tools like LangChain, LlamaIndex, or similar frameworks, integrating them with product APIs and backend services.
  • Drive prompt engineering and iteration — refine prompts, templates, and context strategies to meet product quality and reliability goals.
  • Manage real-world evaluation metrics — measure usefulness, factual correctness, latency, and UX impact vs. classic accuracy alone.
  • Collaborate across functions — work closely with product, platform, and backend teams to ensure seamless integration.
  • Develop reliable, scalable deployments — focus on performance, cost efficiency, and observability in production environments.

Who You Are

  • Experienced in building real LLM applications — you’ve shipped systems that use large models meaningfully.
  • Strong software engineering skills — Python/TypeScript, API design, backend integration, and cloud deployment.
  • Tool fluency — comfortable with RAG, vector databases (e.g., Pinecone/Weaviate), workflow frameworks (LangChain, Dust), and related tooling.
  • Architectural thinker — you can diagram end-to-end solutions incorporating context windows, caching strategies, tool calls, and multi-step reasoning.
  • Product-oriented — you care not just that the AI works, but that it delivers value safely and reliably to users.

Basic Qualifications

  • 6 years of software engineering experience, with at least 1 year working building AI in production.
  • BS Degree in Computer Science or related field. Masters degree is a plus.
  • Demonstrated use of LLMs in production workflows or complex prototypes.
  • Strong coding ability in Python or equivalent; familiarity with backend frameworks and cloud services.
  • Experience with API integrations, database systems, and scalable architectures.
  • Experience with multi-modal models or multi-agent system design.
  • Familiarity with AI safety guardrails, hallucination mitigation, and structured output enforcement.
  • Knowledge of vector DBs, RAG architectures, and prompt lifecycle tooling.

Salary.com Estimation for Senior AI Engineer in Boston, MA
$146,613 to $188,254
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior AI Engineer?

Sign up to receive alerts about other jobs on the Senior AI Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at 7AI

  • 7AI Boston, MA
  • We are seeking a Senior Backend Software Engineer to join our core team. You will help design, implement, and ship the core data pipeline and processing pl... more
  • 1 Day Ago

  • 7AI Boston, MA
  • 7AI is looking for a Senior Account Executive for the Northeast Region, who will be a critical strategic partner in launching our market entry and sales ac... more
  • 1 Day Ago

  • 7AI Boston, MA
  • As a Senior Platform Engineer , you’ll be at the heart of our infrastructure - designing, building, and scaling the core platform that powers our AI-driven... more
  • 1 Day Ago

  • 7AI Boston, MA
  • We’re a fast-growing, seed-stage Cybersecurity startup backed by top investors — and we’re scaling quickly to keep up with demand. We’re looking for a Grow... more
  • 1 Day Ago


Not the job you're looking for? Here are some other Senior AI Engineer jobs in the Boston, MA area that may be a better fit.

  • Shield AI Boston, MA
  • Founded in 2015, Shield AI is a venture-backed deep-tech company with the mission of protecting service members and civilians with intelligent systems. Its... more
  • 22 Days Ago

  • Shield AI Boston, MA
  • Founded in 2015, Shield AI is a venture-backed deep-tech company with the mission of protecting service members and civilians with intelligent systems. Its... more
  • 3 Days Ago

AI Assistant is available now!

Feel free to start your new journey!