Demo

Sr AI Engineer

Zensark Inc
Boston, MA Contractor
POSTED ON 5/22/2026
AVAILABLE BEFORE 6/21/2026

Job Title: AI Engineer

Location: Boston, MA – 4 days/week onsite-locals only with DL copy

Pay rate: Senior Level - $70/hr c2c

Senior Level – 15 yrs

Visa: H1B

F2F Interview is required

 

Job Description:

This role focuses on developing AI applications powered by large language models (LLMs), retrieval-augmented generation (RAG), Model Context Protocol (MCP) servers, and Agentic AI across the enterprise. Need someone with Langchain/LangGraph exp.

Seeking a highly skilled AI Engineer to design and build Generative and Agentic AI systems that transform how our company operates and serves customers. This role focuses on developing AI applications powered by large language models (LLMs), retrieval-augmented generation (RAG), Model Context Protocol (MCP) servers, and Agentic AI across the enterprise for internal and customer facing use cases.

The ideal candidate has strong experience with a modern AI/ML stack, including a profound Python experience, including AI relevant packages and tools, LLM architectures and frameworks, RAG, MCP, prompt engineering, use of AI tools, budling teams of AI agents, and production-grade AI systems design and development.

You will work closely with technology, data, and business teams to build scalable AI solutions that drive operational efficiency and innovation across the enterprise.

Key Responsibilities:

•             Design, build, and deploy scalable LLM-powered applications, solutions, and digital products for customer support, business use cases, and internal productivity.

•             Develop AI agents, Agentic Platforms, and Agentic AI systems capable of reasoning, planning, and executing multi-step workflows.

•             Implement Retrieval-Augmented Generation (RAG) architectures and pipelines to leverage proprietary data, and internal knowledge bases.

•             Build MCP servers, multi-connectivity enabled and multi-modal Agentic platforms, and AI assistants to support internal teams and customer facing.

•             Integrate AI/ML solutions with enterprise systems, APIs, and data platforms.

•             Design prompt strategies, evaluation frameworks, and guardrails to ensure accuracy, security, and regulatory compliance.

•             Optimize LLM performance through fine-tuning, prompt engineering, and model orchestration.

•             Develop MLOps and LLMOps pipelines for monitoring, evaluation, and continuous improvement of AI systems.

•             Help in forming buy or build decisions and work with external vendors, consultants and internal teams to deliver scalable top-quality AI solutions timely.

•             Stay up to date with emerging advancements in AI/ML, Generative AI, Agentinc frameworks, and model architectures.

Required Qualifications:

•             Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Applied Mathematics, or related field.

•             2 years of software engineering experience, including work with machine learning (ML) or AI systems.

•             Hands-on experience building LLM-powered applications in production environments.

•             Strong programming skills in Python, and familiarity with AI/ML relevant packages such as NumPy, Pandas, SciPy and Scikit-learn.

•             Experience with LLM ecosystems such as:

o             OpenAI / Anthropic / Google, Open-source LLMs

o             Hugging Face

o             LangChain, LlamaIndex, or similar orchestration frameworks

•             Experience building RAG pipelines and working with vector databases.

•             Understanding of prompt engineering, embeddings, and model evaluation.

•             Experience building APIs, MCPs, and scalable backend services.

•             Experience with Claude Code, Codex, Cursor, GitHub Copilot, or similar.

•             Ability to collaborate with cross-functional teams.

•             Passion for technology and AI.

Preferred Qualifications:

•             Experience building AI agents, agentic platforms, or autonomous workflows.

•             Familiarity with agent frameworks (LangGraph, AutoGen, CrewAI, Semantic Kernel, Frontier, etc.).

•             Experience with fine-tuning LLMs or parameter-efficient training methods (LoRA, PEFT).

•             Experience with cloud-based AI infrastructure (AWS, Azure, or Google Cloud Platform).

•             Familiarity with Java, JS, and Java applications and environments.

•             Experience with MLOps / LLMOps tools and evaluation pipelines.

Experience implementing AI governance, observability, and guardrails.

Salary : $70

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Sr AI Engineer?

Sign up to receive alerts about other jobs on the Sr AI Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Zensark Inc

  • Zensark Inc San Jose, CA
  • Job Description: Cloud Platform Proficiency: Strong experience with Google Cloud Platform (Google Cloud Platform), including managing data access, subscrip... more
  • 1 Day Ago


Not the job you're looking for? Here are some other Sr AI Engineer jobs in the Boston, MA area that may be a better fit.

  • Rezolve Ai Waltham, MA
  • Role: Sr Network Engineer Location: Waltham MA Job Type: Contract-C2C & W2 Job Overview : We are looking for two experienced Senior Network Engineers (US-b... more
  • 6 Days Ago

  • Outlier AI Boston, MA
  • About the Project Outlier helps the world's most innovative companies improve their AI agents by providing human feedback. Do you want to shape the future ... more
  • 12 Days Ago

AI Assistant is available now!

Feel free to start your new journey!